2020-06-12T17:28:09.587 INFO:root:teuthology version: 1.0.0-6c966fe 2020-06-12T17:28:09.590 DEBUG:teuthology.run:Teuthology command: teuthology --block --name kchai-2020-06-12_17:27:13-fs-octopus-distro-basic-smithi --verbose --owner scheduled_kchai@teuthology --description fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-ec-root.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_latest.yaml} tasks/volumes.yaml} --lock --archive /home/teuthworker/archive/kchai-2020-06-12_17:27:13-fs-octopus-distro-basic-smithi/5142799 -- /tmp/teuthology-worker.ps93sn78.tmp 2020-06-12T17:28:09.625 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-06-12T17:28:09.690 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/kchai-2020-06-12_17:27:13-fs-octopus-distro-basic-smithi/5142799 branch: octopus description: fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-ec-root.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_latest.yaml} tasks/volumes.yaml} email: tchaikov@gmail.com first_in_suite: false job_id: '5142799' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: kchai-2020-06-12_17:27:13-fs-octopus-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: rhel os_version: '8.1' overrides: admin_socket: branch: octopus ceph: cephfs_ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 91d24f498556f86f6d1318d2efd5210c35b36762 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: 91d24f498556f86f6d1318d2efd5210c35b36762 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: octopus-py3 sha1: 7b96008319793b6b4f7dacea0de024bbac590889 owner: scheduled_kchai@teuthology priority: 90 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.1 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - client.2 - client.3 sha1: 91d24f498556f86f6d1318d2efd5210c35b36762 sleep_before_teardown: 0 suite: fs suite_branch: octopus-py3 suite_path: /home/teuthworker/src/github.com_tchaikov_ceph_octopus-py3/qa suite_relpath: qa suite_repo: https://github.com/tchaikov/ceph.git suite_sha1: 7b96008319793b6b4f7dacea0de024bbac590889 tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_volumes teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.27834 2020-06-12T17:28:09.691 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_tchaikov_ceph_octopus-py3/qa; will attempt to use it 2020-06-12T17:28:09.691 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_tchaikov_ceph_octopus-py3/qa/tasks 2020-06-12T17:28:09.692 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-06-12T17:28:09.694 INFO:teuthology.task.internal:Checking packages... 2020-06-12T17:28:09.718 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'basic' and ceph hash '91d24f498556f86f6d1318d2efd5210c35b36762' 2020-06-12T17:28:09.719 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-06-12T17:28:09.719 INFO:teuthology.packaging:ref: None 2020-06-12T17:28:09.720 INFO:teuthology.packaging:tag: None 2020-06-12T17:28:09.720 INFO:teuthology.packaging:branch: octopus 2020-06-12T17:28:09.720 INFO:teuthology.packaging:sha1: 91d24f498556f86f6d1318d2efd5210c35b36762 2020-06-12T17:28:09.721 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2020-06-12T17:28:10.006 INFO:teuthology.task.internal:Found packages for ceph version 15.2.3-298.g7488806bf1 2020-06-12T17:28:10.006 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-06-12T17:28:10.020 INFO:teuthology.task.internal:no buildpackages task found 2020-06-12T17:28:10.021 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-06-12T17:28:10.036 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-06-12T17:28:10.036 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-06-12T17:28:10.089 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-06-12T17:28:20.107 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-06-12T17:28:30.126 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:28:40.141 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:28:50.161 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:29:00.179 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:29:10.197 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:29:20.215 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:29:30.233 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:29:40.251 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:29:50.269 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:30:00.287 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:30:10.305 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-06-12T17:30:20.322 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:30:30.337 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:30:40.355 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:30:50.373 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:31:00.392 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:31:10.412 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:31:20.434 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:31:30.448 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:31:40.461 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:31:50.479 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:32:00.494 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:32:10.503 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:32:20.522 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:32:30.541 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:32:40.559 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:32:50.574 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:33:00.588 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:33:10.607 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:33:20.623 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:33:30.641 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:33:40.660 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:33:50.680 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:34:00.696 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:34:10.716 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:34:20.736 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:34:30.762 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T17:34:40.780 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_kchai@teuthology', 'count': 2, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/kchai-2020-06-12_17:27:13-fs-octopus-distro-basic-smithi/5142799'} 2020-06-12T17:34:40.807 DEBUG:teuthology.lock.ops:locked ubuntu@smithi038.front.sepia.ceph.com, ubuntu@smithi150.front.sepia.ceph.com 2020-06-12T17:34:40.877 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fba61350bf8>, signals=[15]) 2020-06-12T17:34:41.091 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of rhel 8.1 2020-06-12T17:34:41.095 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of rhel 8.1 2020-06-12T17:34:41.390 INFO:teuthology.orchestra.console:Power off smithi150 2020-06-12T17:34:41.393 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-06-12T17:34:41.428 INFO:teuthology.orchestra.console:Power off smithi038 2020-06-12T17:34:41.429 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-06-12T17:34:41.439 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T17:34:41.456 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T17:34:45.474 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T17:34:45.492 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T17:34:49.597 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T17:34:49.611 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T17:34:49.813 INFO:teuthology.orchestra.console:Power off for smithi150 completed 2020-06-12T17:34:49.914 INFO:teuthology.orchestra.console:Power on smithi150 2020-06-12T17:34:49.915 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-06-12T17:34:49.939 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T17:34:53.727 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T17:34:53.941 INFO:teuthology.orchestra.console:Power off for smithi038 completed 2020-06-12T17:34:53.965 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T17:34:54.043 INFO:teuthology.orchestra.console:Power on smithi038 2020-06-12T17:34:54.044 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-06-12T17:34:54.071 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T17:34:54.186 INFO:teuthology.orchestra.console:Power on for smithi150 completed 2020-06-12T17:34:54.288 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish 2020-06-12T17:34:58.113 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T17:35:02.230 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T17:35:02.445 INFO:teuthology.orchestra.console:Power on for smithi038 completed 2020-06-12T17:35:02.547 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish 2020-06-12T17:37:18.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T17:37:27.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T17:37:36.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T17:37:40.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T17:37:45.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T17:37:49.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T17:37:54.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T17:37:58.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T17:38:03.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T17:38:07.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T17:38:12.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T17:38:16.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T17:38:25.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T17:38:34.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T17:38:43.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T17:39:18.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T17:39:19.048 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-06-12T17:39:19.051 INFO:teuthology.orchestra.run.smithi038:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-06-12T17:39:19.384 INFO:teuthology.provision.fog.smithi038:Node is ready 2020-06-12T17:39:19.385 INFO:teuthology.orchestra.run.smithi038:> hostname 2020-06-12T17:39:19.400 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038.front.sepia.ceph.com 2020-06-12T17:39:19.401 INFO:teuthology.orchestra.run.smithi038:> grep smithi038.front.sepia.ceph.com /etc/hosts 2020-06-12T17:39:19.456 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38 smithi038.front.sepia.ceph.com smithi038 2020-06-12T17:39:19.456 INFO:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2020-06-12T17:39:19.605 INFO:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hosts 2020-06-12T17:39:19.638 INFO:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/172.21.15.38/172.21.15.38/g' /etc/hosts 2020-06-12T17:39:19.720 INFO:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hostname 2020-06-12T17:39:19.791 INFO:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2020-06-12T17:39:19.867 INFO:teuthology.provision.fog.smithi038:Deploy complete! 2020-06-12T17:39:19.868 DEBUG:teuthology.parallel:result is None 2020-06-12T17:39:49.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T17:39:49.898 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-06-12T17:39:49.898 INFO:teuthology.orchestra.run.smithi150:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-06-12T17:39:50.208 INFO:teuthology.provision.fog.smithi150:Node is ready 2020-06-12T17:39:50.209 INFO:teuthology.orchestra.run.smithi150:> hostname 2020-06-12T17:39:50.224 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150.front.sepia.ceph.com 2020-06-12T17:39:50.225 INFO:teuthology.orchestra.run.smithi150:> grep smithi150.front.sepia.ceph.com /etc/hosts 2020-06-12T17:39:50.288 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150 2020-06-12T17:39:50.289 INFO:teuthology.orchestra.run.smithi150:> sudo hostname smithi150 2020-06-12T17:39:50.413 INFO:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hosts 2020-06-12T17:39:50.441 INFO:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/172.21.15.150/172.21.15.150/g' /etc/hosts 2020-06-12T17:39:50.508 INFO:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hostname 2020-06-12T17:39:50.575 INFO:teuthology.orchestra.run.smithi150:> sudo hostname smithi150 2020-06-12T17:39:50.642 INFO:teuthology.provision.fog.smithi150:Deploy complete! 2020-06-12T17:39:50.642 DEBUG:teuthology.parallel:result is None 2020-06-12T17:39:50.783 INFO:teuthology.lock.ops:Checking smithi038.front.sepia.ceph.com 2020-06-12T17:39:50.784 INFO:teuthology.lock.ops:New key found. Updating... 2020-06-12T17:39:50.809 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com 2020-06-12T17:39:50.809 INFO:teuthology.lock.ops:New key found. Updating... 2020-06-12T17:39:50.834 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server 2020-06-12T17:39:50.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-06-12T17:39:50.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T17:39:50.918 INFO:teuthology.orchestra.run.smithi038:> true 2020-06-12T17:39:51.097 INFO:teuthology.orchestra.run.smithi038:> uname -m 2020-06-12T17:39:51.152 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2020-06-12T17:39:51.152 INFO:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2020-06-12T17:39:51.206 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="Red Hat Enterprise Linux" 2020-06-12T17:39:51.207 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8.1 (Ootpa)" 2020-06-12T17:39:51.207 INFO:teuthology.orchestra.run.smithi038.stdout:ID="rhel" 2020-06-12T17:39:51.208 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="fedora" 2020-06-12T17:39:51.208 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8.1" 2020-06-12T17:39:51.208 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2020-06-12T17:39:51.208 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.1 (Ootpa)" 2020-06-12T17:39:51.209 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2020-06-12T17:39:51.209 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.1:GA" 2020-06-12T17:39:51.209 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.redhat.com/" 2020-06-12T17:39:51.210 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-06-12T17:39:51.210 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:39:51.210 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-06-12T17:39:51.211 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.1 2020-06-12T17:39:51.211 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-06-12T17:39:51.211 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.1" 2020-06-12T17:39:51.213 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2020-06-12T17:39:51.238 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server 2020-06-12T17:39:51.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-06-12T17:39:51.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T17:39:51.314 INFO:teuthology.orchestra.run.smithi150:> true 2020-06-12T17:39:51.401 INFO:teuthology.orchestra.run.smithi150:> uname -m 2020-06-12T17:39:51.455 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2020-06-12T17:39:51.456 INFO:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2020-06-12T17:39:51.510 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Red Hat Enterprise Linux" 2020-06-12T17:39:51.511 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8.1 (Ootpa)" 2020-06-12T17:39:51.511 INFO:teuthology.orchestra.run.smithi150.stdout:ID="rhel" 2020-06-12T17:39:51.512 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="fedora" 2020-06-12T17:39:51.512 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8.1" 2020-06-12T17:39:51.512 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8" 2020-06-12T17:39:51.513 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.1 (Ootpa)" 2020-06-12T17:39:51.513 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2020-06-12T17:39:51.513 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.1:GA" 2020-06-12T17:39:51.514 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.redhat.com/" 2020-06-12T17:39:51.514 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-06-12T17:39:51.514 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:39:51.515 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-06-12T17:39:51.515 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.1 2020-06-12T17:39:51.516 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-06-12T17:39:51.517 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.1" 2020-06-12T17:39:51.518 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2020-06-12T17:39:51.540 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-06-12T17:39:51.585 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi038.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCv7yp7C2yCa31nPdnmf5TyaWDG1raO4Kf3PyMgKJmgdLNw1KoiDl4MPyaGJ9/Xdnb00Cw9cN80CET8zIlLNdj97h3xn8FibnrVmwnA/+vaUwSw7wi+fkOnDuxtisGEplyoW8nb5zXOE7kNh3OL7vtSniYGKzb3nu5dC41IITncnONTLRdFdzMYDRYbR8USkNyjZGXSmUkBKP8kxC6rnhmmbkLJqKIB6wXrFMQzcqPx17xgu7HTIQf3EC+gTdJoGaU2BU+jTJ5QH3TTMyw09YX/lQd7gH6NrVxXnBd2C+lmb2P47ThuOeGQ/kptC1/aYLF4vvLCwA1PSVLkRNP4IxHlbCk7KRUxXJproZpavqA+fixO28gqFJWMQb/S01HF/lhSMue6k9Q14+sDTm4dqgxjpNBaGzzeMrGvMBpzIgvOaMRDUCaX5HByqqfc0uypowVxSWNnwj4Jz/QDhr9M0m7yRtgjTE7TcYdQaDwoZtd63Ngjfl7McVOgOcRktcSLSs8= smithi150.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VR5fZNwkNG76K7a8RuptCG0MI0zRFYUGR1ErDoFWJ2e71r8r550o1iAZLy1rJw/U6elIVyCozZYMkwcIH1bi4W9Lkn6vJDJKed/gDyIoR82APvBe5eBtLkvm43gYO3Qhq/t0D83mfEdmKxlnbYbSoFCIoeZ0PyffJy15nc3f4NsOafVSWLEBOWJ4ggRK+oyrEJLSnGYUcu9jSDuMBRflN1HysNmOrZ9EOGQcpOVQ0RtcYe/qs20mLpgJJduKqj9CzjI58MMG27DzM3Sa5E3V8GBsku0Q4JMsNUqW2surMFCwKXrtPf8awGs6WBNzgVZ1LNOLJr9VSh+74i+SswzZ1w04lmzYQ9jLtwR+p11UNRTWq6xN9f0KKeHzl5Gu/CCt4wFWymATgxxkQvVENLWzEW7HHtD0yE99NCkHTJnpTs5QIqx3rtNskaS79/6aROQFnTBkVVP75OYAeIB0uwJ5qmsb9x/M1InkOO4+7756Obow/FbdJvWCUZ5PuDwvcyk= 2020-06-12T17:39:51.586 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-06-12T17:39:51.651 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-06-12T17:39:51.674 INFO:teuthology.task.internal:Saving configuration 2020-06-12T17:39:51.702 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-06-12T17:39:51.713 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-06-12T17:39:51.729 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-06-12 17:34:40.788360', 'description': '/home/teuthworker/archive/kchai-2020-06-12_17:27:13-fs-octopus-distro-basic-smithi/5142799', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNuFUxtFOgKF8PI0JxPk91bIQMx8Fmb4CJQf+AN6VkOQTs3qknxbO3yE3CCsG4LmkvY9Sa8rilbSptwXTXq7twE=', 'os_version': '8.1', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'rhel', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi038.front.sepia.ceph.com'} 2020-06-12T17:39:51.751 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-06-12 17:34:40.788381', 'description': '/home/teuthworker/archive/kchai-2020-06-12_17:27:13-fs-octopus-distro-basic-smithi/5142799', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPMwMG5iMUsRvqz5FQ+3KhjtYgaFJr8Y0mmCfYPsCst0OyttQDItUsT0rmSn1LfCPiMDzfexnJc8DAUWWh/cL3g=', 'os_version': '8.1', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'rhel', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi150.front.sepia.ceph.com'} 2020-06-12T17:39:51.752 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-06-12T17:39:51.767 INFO:teuthology.task.internal:roles: ubuntu@smithi038.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.1'] 2020-06-12T17:39:51.767 INFO:teuthology.task.internal:roles: ubuntu@smithi150.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.2', 'client.3'] 2020-06-12T17:39:51.768 INFO:teuthology.run_tasks:Running task console_log... 2020-06-12T17:39:51.878 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fba613c68c8>, signals=[15]) 2020-06-12T17:39:51.880 INFO:teuthology.run_tasks:Running task internal.connect... 2020-06-12T17:39:51.890 INFO:teuthology.task.internal:Opening connections... 2020-06-12T17:39:51.890 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi038.front.sepia.ceph.com 2020-06-12T17:39:51.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T17:39:51.986 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi150.front.sepia.ceph.com 2020-06-12T17:39:51.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T17:39:52.061 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-06-12T17:39:52.073 INFO:teuthology.orchestra.run.smithi038:> uname -m 2020-06-12T17:39:52.118 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2020-06-12T17:39:52.119 INFO:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2020-06-12T17:39:52.177 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="Red Hat Enterprise Linux" 2020-06-12T17:39:52.177 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8.1 (Ootpa)" 2020-06-12T17:39:52.177 INFO:teuthology.orchestra.run.smithi038.stdout:ID="rhel" 2020-06-12T17:39:52.178 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="fedora" 2020-06-12T17:39:52.178 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8.1" 2020-06-12T17:39:52.178 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2020-06-12T17:39:52.178 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.1 (Ootpa)" 2020-06-12T17:39:52.178 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2020-06-12T17:39:52.179 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.1:GA" 2020-06-12T17:39:52.179 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.redhat.com/" 2020-06-12T17:39:52.179 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-06-12T17:39:52.179 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:39:52.179 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-06-12T17:39:52.180 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.1 2020-06-12T17:39:52.180 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-06-12T17:39:52.180 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.1" 2020-06-12T17:39:52.180 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2020-06-12T17:39:52.206 INFO:teuthology.orchestra.run.smithi150:> uname -m 2020-06-12T17:39:52.224 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2020-06-12T17:39:52.225 INFO:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2020-06-12T17:39:52.279 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Red Hat Enterprise Linux" 2020-06-12T17:39:52.279 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8.1 (Ootpa)" 2020-06-12T17:39:52.280 INFO:teuthology.orchestra.run.smithi150.stdout:ID="rhel" 2020-06-12T17:39:52.280 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="fedora" 2020-06-12T17:39:52.280 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8.1" 2020-06-12T17:39:52.280 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8" 2020-06-12T17:39:52.280 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.1 (Ootpa)" 2020-06-12T17:39:52.281 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2020-06-12T17:39:52.281 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.1:GA" 2020-06-12T17:39:52.281 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.redhat.com/" 2020-06-12T17:39:52.281 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-06-12T17:39:52.281 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:39:52.282 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-06-12T17:39:52.282 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.1 2020-06-12T17:39:52.282 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-06-12T17:39:52.282 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.1" 2020-06-12T17:39:52.283 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2020-06-12T17:39:52.307 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-06-12T17:39:52.328 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-06-12T17:39:52.347 INFO:teuthology.task.internal:Checking for old test directory... 2020-06-12T17:39:52.348 INFO:teuthology.orchestra.run.smithi038:> test '!' -e /home/ubuntu/cephtest 2020-06-12T17:39:52.352 INFO:teuthology.orchestra.run.smithi150:> test '!' -e /home/ubuntu/cephtest 2020-06-12T17:39:52.366 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-06-12T17:39:52.388 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-06-12T17:39:52.389 INFO:teuthology.orchestra.run.smithi038:> test -z $(ls -A /var/lib/ceph) 2020-06-12T17:39:52.406 INFO:teuthology.orchestra.run.smithi150:> test -z $(ls -A /var/lib/ceph) 2020-06-12T17:39:52.436 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-06-12T17:39:52.482 INFO:teuthology.run_tasks:Running task kernel... 2020-06-12T17:39:52.504 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'mds.a': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'mds.b': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.2': {'kdb': True, 'sha1': 'distro'}, 'client.3': {'kdb': True, 'sha1': 'distro'}} 2020-06-12T17:39:52.505 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2020-06-12T17:39:52.506 INFO:teuthology.orchestra.run.smithi038:> uname -r 2020-06-12T17:39:52.520 INFO:teuthology.orchestra.run.smithi038.stdout:4.18.0-193.el8.x86_64 2020-06-12T17:39:52.521 INFO:teuthology.task.kernel:Running kernel on smithi038: 4.18.0-193.el8.x86_64 2020-06-12T17:39:52.521 INFO:teuthology.orchestra.run.smithi038:> sudo yum install -y kernel 2020-06-12T17:39:54.457 INFO:teuthology.orchestra.run.smithi038.stdout:Updating Subscription Management repositories. 2020-06-12T17:39:54.471 INFO:teuthology.orchestra.run.smithi038.stdout:Unable to read consumer identity 2020-06-12T17:39:54.666 INFO:teuthology.orchestra.run.smithi038.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-06-12T17:39:56.100 INFO:teuthology.orchestra.run.smithi038.stdout:Copr repo for ceph-el8 owned by ktdreyer 353 kB/s | 47 kB 00:00 2020-06-12T17:39:56.468 INFO:teuthology.orchestra.run.smithi038.stdout:Extra Packages for Enterprise Linux 22 MB/s | 6.9 MB 00:00 2020-06-12T17:39:57.901 INFO:teuthology.orchestra.run.smithi038.stdout:lab-extras 3.7 MB/s | 20 kB 00:00 2020-06-12T17:39:58.236 INFO:teuthology.orchestra.run.smithi038.stderr:Modular dependency problem: 2020-06-12T17:39:58.236 INFO:teuthology.orchestra.run.smithi038.stderr: 2020-06-12T17:39:58.236 INFO:teuthology.orchestra.run.smithi038.stderr: Problem: conflicting requests 2020-06-12T17:39:58.237 INFO:teuthology.orchestra.run.smithi038.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-06-12T17:39:58.616 INFO:teuthology.orchestra.run.smithi038.stdout:Package kernel-4.18.0-193.el8.x86_64 is already installed. 2020-06-12T17:39:58.617 INFO:teuthology.orchestra.run.smithi038.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-06-12T17:39:58.691 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2020-06-12T17:39:58.691 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2020-06-12T17:39:58.692 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2020-06-12T17:39:58.833 INFO:teuthology.orchestra.run.smithi038:> echo no | sudo yum reinstall kernel || true 2020-06-12T17:39:59.187 INFO:teuthology.orchestra.run.smithi038.stdout:Updating Subscription Management repositories. 2020-06-12T17:39:59.188 INFO:teuthology.orchestra.run.smithi038.stdout:Unable to read consumer identity 2020-06-12T17:39:59.260 INFO:teuthology.orchestra.run.smithi038.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-06-12T17:39:59.424 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:02 ago on Fri 12 Jun 2020 05:39:57 PM UTC. 2020-06-12T17:39:59.455 INFO:teuthology.orchestra.run.smithi038.stderr:Modular dependency problem: 2020-06-12T17:39:59.455 INFO:teuthology.orchestra.run.smithi038.stderr: 2020-06-12T17:39:59.455 INFO:teuthology.orchestra.run.smithi038.stderr: Problem: conflicting requests 2020-06-12T17:39:59.456 INFO:teuthology.orchestra.run.smithi038.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-06-12T17:39:59.552 INFO:teuthology.orchestra.run.smithi038.stdout:Installed package kernel-4.18.0-193.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-06-12T17:39:59.553 INFO:teuthology.orchestra.run.smithi038.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-06-12T17:39:59.603 INFO:teuthology.orchestra.run.smithi038.stderr:Error: No packages marked for reinstall. 2020-06-12T17:39:59.672 INFO:teuthology.orchestra.run.smithi038:> sudo yum reinstall -y kernel || true 2020-06-12T17:40:00.027 INFO:teuthology.orchestra.run.smithi038.stdout:Updating Subscription Management repositories. 2020-06-12T17:40:00.028 INFO:teuthology.orchestra.run.smithi038.stdout:Unable to read consumer identity 2020-06-12T17:40:00.110 INFO:teuthology.orchestra.run.smithi038.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-06-12T17:40:00.278 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:03 ago on Fri 12 Jun 2020 05:39:57 PM UTC. 2020-06-12T17:40:00.306 INFO:teuthology.orchestra.run.smithi038.stderr:Modular dependency problem: 2020-06-12T17:40:00.307 INFO:teuthology.orchestra.run.smithi038.stderr: 2020-06-12T17:40:00.307 INFO:teuthology.orchestra.run.smithi038.stderr: Problem: conflicting requests 2020-06-12T17:40:00.307 INFO:teuthology.orchestra.run.smithi038.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-06-12T17:40:00.383 INFO:teuthology.orchestra.run.smithi038.stdout:Installed package kernel-4.18.0-193.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-06-12T17:40:00.384 INFO:teuthology.orchestra.run.smithi038.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-06-12T17:40:00.453 INFO:teuthology.orchestra.run.smithi038.stderr:Error: No packages marked for reinstall. 2020-06-12T17:40:00.515 INFO:teuthology.orchestra.run.smithi038:> rpm -q kernel --last | head -n 1 2020-06-12T17:40:00.584 INFO:teuthology.orchestra.run.smithi038.stdout:kernel-4.18.0-193.el8.x86_64 Sun 10 May 2020 01:56:55 PM UTC 2020-06-12T17:40:00.585 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-193.el8.x86_64 2020-06-12T17:40:00.586 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-06-12T17:40:00.586 INFO:teuthology.orchestra.run.smithi150:> uname -r 2020-06-12T17:40:00.606 INFO:teuthology.orchestra.run.smithi150.stdout:4.18.0-193.el8.x86_64 2020-06-12T17:40:00.607 INFO:teuthology.task.kernel:Running kernel on smithi150: 4.18.0-193.el8.x86_64 2020-06-12T17:40:00.607 INFO:teuthology.orchestra.run.smithi150:> sudo yum install -y kernel 2020-06-12T17:40:02.561 INFO:teuthology.orchestra.run.smithi150.stdout:Updating Subscription Management repositories. 2020-06-12T17:40:02.574 INFO:teuthology.orchestra.run.smithi150.stdout:Unable to read consumer identity 2020-06-12T17:40:02.810 INFO:teuthology.orchestra.run.smithi150.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-06-12T17:40:04.179 INFO:teuthology.orchestra.run.smithi150.stdout:Copr repo for ceph-el8 owned by ktdreyer 416 kB/s | 47 kB 00:00 2020-06-12T17:40:04.600 INFO:teuthology.orchestra.run.smithi150.stdout:Extra Packages for Enterprise Linux 19 MB/s | 6.9 MB 00:00 2020-06-12T17:40:05.988 INFO:teuthology.orchestra.run.smithi150.stdout:lab-extras 4.0 MB/s | 20 kB 00:00 2020-06-12T17:40:06.299 INFO:teuthology.orchestra.run.smithi150.stderr:Modular dependency problem: 2020-06-12T17:40:06.299 INFO:teuthology.orchestra.run.smithi150.stderr: 2020-06-12T17:40:06.300 INFO:teuthology.orchestra.run.smithi150.stderr: Problem: conflicting requests 2020-06-12T17:40:06.300 INFO:teuthology.orchestra.run.smithi150.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-06-12T17:40:06.484 INFO:teuthology.orchestra.run.smithi150.stdout:Package kernel-4.18.0-193.el8.x86_64 is already installed. 2020-06-12T17:40:06.485 INFO:teuthology.orchestra.run.smithi150.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-06-12T17:40:06.552 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2020-06-12T17:40:06.553 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do. 2020-06-12T17:40:06.553 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2020-06-12T17:40:06.764 INFO:teuthology.orchestra.run.smithi150:> echo no | sudo yum reinstall kernel || true 2020-06-12T17:40:07.095 INFO:teuthology.orchestra.run.smithi150.stdout:Updating Subscription Management repositories. 2020-06-12T17:40:07.095 INFO:teuthology.orchestra.run.smithi150.stdout:Unable to read consumer identity 2020-06-12T17:40:07.164 INFO:teuthology.orchestra.run.smithi150.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-06-12T17:40:07.314 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:00:02 ago on Fri 12 Jun 2020 05:40:05 PM UTC. 2020-06-12T17:40:07.343 INFO:teuthology.orchestra.run.smithi150.stderr:Modular dependency problem: 2020-06-12T17:40:07.343 INFO:teuthology.orchestra.run.smithi150.stderr: 2020-06-12T17:40:07.343 INFO:teuthology.orchestra.run.smithi150.stderr: Problem: conflicting requests 2020-06-12T17:40:07.343 INFO:teuthology.orchestra.run.smithi150.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-06-12T17:40:07.464 INFO:teuthology.orchestra.run.smithi150.stdout:Installed package kernel-4.18.0-193.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-06-12T17:40:07.465 INFO:teuthology.orchestra.run.smithi150.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-06-12T17:40:07.538 INFO:teuthology.orchestra.run.smithi150.stderr:Error: No packages marked for reinstall. 2020-06-12T17:40:07.615 INFO:teuthology.orchestra.run.smithi150:> sudo yum reinstall -y kernel || true 2020-06-12T17:40:07.943 INFO:teuthology.orchestra.run.smithi150.stdout:Updating Subscription Management repositories. 2020-06-12T17:40:07.944 INFO:teuthology.orchestra.run.smithi150.stdout:Unable to read consumer identity 2020-06-12T17:40:08.007 INFO:teuthology.orchestra.run.smithi150.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-06-12T17:40:08.159 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:00:03 ago on Fri 12 Jun 2020 05:40:05 PM UTC. 2020-06-12T17:40:08.188 INFO:teuthology.orchestra.run.smithi150.stderr:Modular dependency problem: 2020-06-12T17:40:08.188 INFO:teuthology.orchestra.run.smithi150.stderr: 2020-06-12T17:40:08.188 INFO:teuthology.orchestra.run.smithi150.stderr: Problem: conflicting requests 2020-06-12T17:40:08.189 INFO:teuthology.orchestra.run.smithi150.stderr: - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64 2020-06-12T17:40:08.295 INFO:teuthology.orchestra.run.smithi150.stdout:Installed package kernel-4.18.0-193.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-06-12T17:40:08.296 INFO:teuthology.orchestra.run.smithi150.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-06-12T17:40:08.369 INFO:teuthology.orchestra.run.smithi150.stderr:Error: No packages marked for reinstall. 2020-06-12T17:40:08.448 INFO:teuthology.orchestra.run.smithi150:> rpm -q kernel --last | head -n 1 2020-06-12T17:40:08.534 INFO:teuthology.orchestra.run.smithi150.stdout:kernel-4.18.0-193.el8.x86_64 Sun 10 May 2020 01:56:55 PM UTC 2020-06-12T17:40:08.534 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-193.el8.x86_64 2020-06-12T17:40:08.535 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-06-12T17:40:08.535 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-06-12T17:40:08.535 INFO:teuthology.orchestra.run.smithi038:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-06-12T17:40:08.608 INFO:teuthology.orchestra.run.smithi038.stdout:ttyS1 2020-06-12T17:40:08.617 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-06-12T17:40:08.617 INFO:teuthology.orchestra.run.smithi150:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-06-12T17:40:08.657 INFO:teuthology.orchestra.run.smithi150.stdout:ttyS1 2020-06-12T17:40:08.669 INFO:teuthology.run_tasks:Running task internal.base... 2020-06-12T17:40:08.873 INFO:teuthology.task.internal:Creating test directory... 2020-06-12T17:40:08.874 INFO:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-06-12T17:40:08.886 INFO:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-06-12T17:40:08.901 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-06-12T17:40:08.916 INFO:teuthology.run_tasks:Running task internal.archive... 2020-06-12T17:40:08.960 INFO:teuthology.task.internal:Creating archive directory... 2020-06-12T17:40:08.964 INFO:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-06-12T17:40:08.968 INFO:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-06-12T17:40:08.995 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-06-12T17:40:09.003 INFO:teuthology.task.internal:Enabling coredump saving... 2020-06-12T17:40:09.004 INFO:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-06-12T17:40:09.037 INFO:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-06-12T17:40:09.077 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-06-12T17:40:09.090 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-06-12T17:40:09.101 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-06-12T17:40:09.120 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-06-12T17:40:09.121 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-06-12T17:40:09.134 INFO:teuthology.task.internal:Configuring sudo... 2020-06-12T17:40:09.135 INFO:teuthology.orchestra.run.smithi038:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-06-12T17:40:09.139 INFO:teuthology.orchestra.run.smithi150:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-06-12T17:40:09.172 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-06-12T17:40:09.189 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-06-12T17:40:09.189 INFO:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-06-12T17:40:09.219 INFO:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-06-12T17:40:09.233 INFO:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-06-12T17:40:09.316 INFO:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-06-12T17:40:09.379 INFO:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-06-12T17:40:09.457 INFO:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-06-12T17:40:09.513 INFO:teuthology.orchestra.run.smithi038:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-06-12T17:40:09.599 INFO:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-06-12T17:40:09.633 INFO:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-06-12T17:40:09.696 INFO:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-06-12T17:40:09.771 INFO:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-06-12T17:40:09.821 INFO:teuthology.orchestra.run.smithi150:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-06-12T17:40:09.907 INFO:teuthology.orchestra.run.smithi038:> sudo service rsyslog restart 2020-06-12T17:40:09.910 INFO:teuthology.orchestra.run.smithi150:> sudo service rsyslog restart 2020-06-12T17:40:09.976 INFO:teuthology.orchestra.run.smithi038.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-06-12T17:40:10.018 INFO:teuthology.orchestra.run.smithi150.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-06-12T17:40:10.439 INFO:teuthology.run_tasks:Running task internal.timer... 2020-06-12T17:40:10.456 INFO:teuthology.task.internal:Starting timer... 2020-06-12T17:40:10.457 INFO:teuthology.run_tasks:Running task pcp... 2020-06-12T17:40:10.500 INFO:teuthology.run_tasks:Running task selinux... 2020-06-12T17:40:10.517 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2020-06-12T17:40:10.518 INFO:teuthology.orchestra.run.smithi038:> sudo service auditd rotate 2020-06-12T17:40:10.595 INFO:teuthology.orchestra.run.smithi038.stdout:Rotating logs: [ OK ] 2020-06-12T17:40:10.596 INFO:teuthology.orchestra.run.smithi150:> sudo service auditd rotate 2020-06-12T17:40:10.654 INFO:teuthology.orchestra.run.smithi150.stdout:Rotating logs: [ OK ] 2020-06-12T17:40:10.655 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-06-12T17:40:10.656 INFO:teuthology.orchestra.run.smithi038:> /usr/sbin/getenforce 2020-06-12T17:40:10.681 INFO:teuthology.orchestra.run.smithi038.stdout:Permissive 2020-06-12T17:40:10.681 INFO:teuthology.orchestra.run.smithi150:> /usr/sbin/getenforce 2020-06-12T17:40:10.701 INFO:teuthology.orchestra.run.smithi150.stdout:Permissive 2020-06-12T17:40:10.701 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi038.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi150.front.sepia.ceph.com': 'permissive'} 2020-06-12T17:40:10.702 INFO:teuthology.orchestra.run.smithi038:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-06-12T17:40:10.757 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-06-12T17:40:10.758 INFO:teuthology.orchestra.run.smithi150:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-06-12T17:40:10.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-06-12T17:40:10.787 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-06-12T17:40:10.787 INFO:teuthology.orchestra.run.smithi038:> sudo /usr/sbin/setenforce permissive 2020-06-12T17:40:10.832 INFO:teuthology.orchestra.run.smithi150:> sudo /usr/sbin/setenforce permissive 2020-06-12T17:40:10.859 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-06-12T17:40:10.871 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2020-06-12T17:40:10.872 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-06-12T17:40:10.892 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-06-12T17:40:10.894 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi038.front.sepia.ceph.com,smithi150.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-06-12T17:40:11.325 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-06-12T17:40:12.446 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-06-12T17:40:14.989 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-06-12T17:40:15.015 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:15 +0000 (0:00:00.086) 0:00:00.086 *********** 2020-06-12T17:40:15.034 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:15 +0000 (0:00:00.018) 0:00:00.104 *********** 2020-06-12T17:40:16.620 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-06-12T17:40:16.622 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] 2020-06-12T17:40:16.700 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:16 +0000 (0:00:01.665) 0:00:01.771 *********** 2020-06-12T17:40:17.236 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-06-12T17:40:17.270 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:17 +0000 (0:00:00.569) 0:00:02.340 *********** 2020-06-12T17:40:17.634 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi150.front.sepia.ceph.com] 2020-06-12T17:40:17.706 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:17 +0000 (0:00:00.436) 0:00:02.777 *********** 2020-06-12T17:40:17.893 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** ok: [smithi038.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-06-12T17:40:17.928 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:17 +0000 (0:00:00.222) 0:00:02.999 *********** 2020-06-12T17:40:17.937 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-06-12T17:40:17.943 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-06-12T17:40:17.987 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:17 +0000 (0:00:00.058) 0:00:03.058 *********** 2020-06-12T17:40:17.996 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-06-12T17:40:17.998 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:40:18.031 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:18 +0000 (0:00:00.043) 0:00:03.101 *********** 2020-06-12T17:40:18.248 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-06-12T17:40:18.255 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-06-12T17:40:18.300 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:18 +0000 (0:00:00.268) 0:00:03.370 *********** 2020-06-12T17:40:18.344 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:40:18.390 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:18 +0000 (0:00:00.085) 0:00:03.456 *********** 2020-06-12T17:40:18.569 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** ok: [smithi038.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-12T17:40:18.608 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:18 +0000 (0:00:00.222) 0:00:03.678 *********** 2020-06-12T17:40:18.627 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-12T17:40:18.671 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:18 +0000 (0:00:00.062) 0:00:03.741 *********** 2020-06-12T17:40:19.883 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-06-12T17:40:19.885 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1591983618.6903174-78603795055306/source", "state": "file", "uid": 0} 2020-06-12T17:40:19.923 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:19 +0000 (0:00:01.252) 0:00:04.994 *********** 2020-06-12T17:40:19.934 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1591983618.6384819-106054725678828/source", "state": "file", "uid": 0} 2020-06-12T17:40:19.972 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:19 +0000 (0:00:00.043) 0:00:05.038 *********** 2020-06-12T17:40:20.668 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-06-12T17:40:20.670 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-06-12T17:40:20.672 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2020-06-12T17:40:20.674 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2020-06-12T17:40:20.677 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-06-12T17:40:20.805 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-06-12T17:40:20.813 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-06-12T17:40:20.987 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:20 +0000 (0:00:01.010) 0:00:06.048 *********** 2020-06-12T17:40:21.049 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:21 +0000 (0:00:00.071) 0:00:06.119 *********** 2020-06-12T17:40:21.055 INFO:teuthology.task.ansible.out: 2020-06-12T17:40:21.701 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi038.front.sepia.ceph.com] 2020-06-12T17:40:21.729 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] 2020-06-12T17:40:21.878 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. Friday 12 June 2020 17:40:21 +0000 (0:00:00.824) 0:00:06.944 *********** 2020-06-12T17:40:22.028 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:22 +0000 (0:00:00.154) 0:00:07.099 *********** 2020-06-12T17:40:22.690 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-06-12T17:40:22.693 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.240305", "end": "2020-06-12 17:40:22.645430", "rc": 0, "start": "2020-06-12 17:40:22.405125", "stderr": "", "stderr_lines": [], "stdout": "982b99592bd601b0475ee21e26576645605e4b52", "stdout_lines": ["982b99592bd601b0475ee21e26576645605e4b52"]} changed: [smithi150.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.205988", "end": "2020-06-12 17:40:22.638606", "rc": 0, "start": "2020-06-12 17:40:22.432618", "stderr": "", "stderr_lines": [], "stdout": "982b99592bd601b0475ee21e26576645605e4b52", "stdout_lines": ["982b99592bd601b0475ee21e26576645605e4b52"]} 2020-06-12T17:40:22.740 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:22 +0000 (0:00:00.712) 0:00:07.811 *********** 2020-06-12T17:40:22.793 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:22 +0000 (0:00:00.050) 0:00:07.862 *********** 2020-06-12T17:40:22.985 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.010330", "end": "2020-06-12 17:40:22.955469", "failed_when_result": false, "rc": 0, "start": "2020-06-12 17:40:22.945139", "stderr": "", "stderr_lines": [], "stdout": "f148133fb0c07a635fda93cc17e7dcc2a5d008b7", "stdout_lines": ["f148133fb0c07a635fda93cc17e7dcc2a5d008b7"]} 2020-06-12T17:40:23.019 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:23 +0000 (0:00:00.227) 0:00:08.090 *********** 2020-06-12T17:40:23.021 INFO:teuthology.task.ansible.out: 2020-06-12T17:40:23.040 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.018982", "end": "2020-06-12 17:40:23.011573", "failed_when_result": false, "rc": 0, "start": "2020-06-12 17:40:22.992591", "stderr": "", "stderr_lines": [], "stdout": "f148133fb0c07a635fda93cc17e7dcc2a5d008b7", "stdout_lines": ["f148133fb0c07a635fda93cc17e7dcc2a5d008b7"]} 2020-06-12T17:40:23.078 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:23 +0000 (0:00:00.057) 0:00:08.148 *********** 2020-06-12T17:40:23.092 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:40:23.126 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:23 +0000 (0:00:00.048) 0:00:08.197 *********** 2020-06-12T17:40:23.135 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:40:23.174 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:23 +0000 (0:00:00.042) 0:00:08.239 *********** 2020-06-12T17:40:23.179 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:40:23.226 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:23 +0000 (0:00:00.056) 0:00:08.296 *********** 2020-06-12T17:40:23.236 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:40:23.274 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:23 +0000 (0:00:00.047) 0:00:08.343 *********** 2020-06-12T17:40:23.282 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-06-12T17:40:23.284 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:40:23.327 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:23 +0000 (0:00:00.054) 0:00:08.398 *********** 2020-06-12T17:40:23.341 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:40:23.378 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:23 +0000 (0:00:00.049) 0:00:08.448 *********** 2020-06-12T17:40:23.386 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-06-12T17:40:23.388 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:40:23.424 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:23 +0000 (0:00:00.045) 0:00:08.493 *********** 2020-06-12T17:40:23.434 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:40:23.472 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:23 +0000 (0:00:00.049) 0:00:08.543 *********** 2020-06-12T17:40:23.484 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:40:23.526 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:23 +0000 (0:00:00.053) 0:00:08.596 *********** 2020-06-12T17:40:23.535 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:40:23.576 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:23 +0000 (0:00:00.049) 0:00:08.646 *********** 2020-06-12T17:40:23.759 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-06-12T17:40:23.761 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-12T17:40:23.804 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:23 +0000 (0:00:00.222) 0:00:08.869 *********** 2020-06-12T17:40:23.812 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-12T17:40:23.849 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:23 +0000 (0:00:00.050) 0:00:08.920 *********** 2020-06-12T17:40:24.114 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-06-12T17:40:24.116 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-06-12T17:40:24.172 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-06-12T17:40:24.371 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-06-12T17:40:24.427 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-06-12T17:40:24.599 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-06-12T17:40:24.648 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-06-12T17:40:24.829 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2020-06-12T17:40:24.858 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2020-06-12T17:40:25.065 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-06-12T17:40:25.077 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-06-12T17:40:25.288 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-06-12T17:40:25.299 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-06-12T17:40:25.512 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-06-12T17:40:25.553 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-06-12T17:40:25.714 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-06-12T17:40:25.787 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-06-12T17:40:25.940 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-06-12T17:40:26.014 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-06-12T17:40:26.157 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-06-12T17:40:26.229 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-06-12T17:40:26.369 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-06-12T17:40:26.459 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-06-12T17:40:26.604 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'aemerson', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-06-12T17:40:26.697 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'aemerson', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-06-12T17:40:26.810 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-06-12T17:40:26.909 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-06-12T17:40:27.029 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-06-12T17:40:27.149 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-06-12T17:40:27.238 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-06-12T17:40:27.370 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-06-12T17:40:27.445 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-06-12T17:40:27.611 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-06-12T17:40:27.670 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-06-12T17:40:27.850 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-06-12T17:40:27.882 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-06-12T17:40:28.105 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-06-12T17:40:28.154 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-06-12T17:40:28.350 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-06-12T17:40:28.397 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-06-12T17:40:28.578 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-06-12T17:40:28.632 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-06-12T17:40:28.836 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-06-12T17:40:28.922 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-06-12T17:40:29.061 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-06-12T17:40:29.140 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-06-12T17:40:29.292 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-06-12T17:40:29.366 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-06-12T17:40:29.515 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-06-12T17:40:29.590 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-06-12T17:40:29.760 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-06-12T17:40:29.822 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-06-12T17:40:29.991 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-06-12T17:40:30.016 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-06-12T17:40:30.225 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-06-12T17:40:30.236 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-06-12T17:40:30.460 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-06-12T17:40:30.495 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-06-12T17:40:30.675 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-06-12T17:40:30.697 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-06-12T17:40:30.912 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-06-12T17:40:30.953 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-06-12T17:40:31.119 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-06-12T17:40:31.196 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-06-12T17:40:31.344 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-06-12T17:40:31.404 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-06-12T17:40:31.570 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-06-12T17:40:31.644 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-06-12T17:40:31.774 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-06-12T17:40:31.873 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-06-12T17:40:31.985 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-06-12T17:40:32.126 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-06-12T17:40:32.206 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-06-12T17:40:32.346 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-06-12T17:40:32.413 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-06-12T17:40:32.588 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-06-12T17:40:32.634 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-06-12T17:40:32.799 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-06-12T17:40:32.882 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-06-12T17:40:33.043 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-06-12T17:40:33.086 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-06-12T17:40:33.255 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-06-12T17:40:33.293 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-06-12T17:40:33.472 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-06-12T17:40:33.504 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-06-12T17:40:33.695 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-06-12T17:40:33.719 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-06-12T17:40:33.907 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-06-12T17:40:33.919 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-06-12T17:40:34.119 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-06-12T17:40:34.139 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-06-12T17:40:34.351 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-06-12T17:40:34.366 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-06-12T17:40:34.567 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-06-12T17:40:34.592 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-06-12T17:40:34.769 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-06-12T17:40:34.821 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-06-12T17:40:34.984 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-06-12T17:40:35.047 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-06-12T17:40:35.198 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-06-12T17:40:35.262 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-06-12T17:40:35.399 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-06-12T17:40:35.496 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-06-12T17:40:35.624 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-06-12T17:40:35.728 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-06-12T17:40:35.825 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-06-12T17:40:35.941 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-06-12T17:40:36.027 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-06-12T17:40:36.181 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-06-12T17:40:36.253 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-06-12T17:40:36.401 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-06-12T17:40:36.467 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-06-12T17:40:36.640 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-06-12T17:40:36.681 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-06-12T17:40:36.851 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-06-12T17:40:36.898 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-06-12T17:40:37.080 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-06-12T17:40:37.129 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-06-12T17:40:37.306 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-06-12T17:40:37.335 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-06-12T17:40:37.533 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-06-12T17:40:37.545 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-06-12T17:40:37.755 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-06-12T17:40:37.798 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-06-12T17:40:37.972 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-06-12T17:40:38.013 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-06-12T17:40:38.185 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-06-12T17:40:38.208 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-06-12T17:40:38.425 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-06-12T17:40:38.436 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-06-12T17:40:38.635 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-06-12T17:40:38.647 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-06-12T17:40:38.857 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-06-12T17:40:39.080 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-06-12T17:40:39.093 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-06-12T17:40:39.278 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-06-12T17:40:39.326 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-06-12T17:40:39.481 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-06-12T17:40:39.547 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-06-12T17:40:39.695 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-06-12T17:40:39.782 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-06-12T17:40:39.929 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-06-12T17:40:39.999 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-06-12T17:40:40.138 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-06-12T17:40:40.213 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-06-12T17:40:40.359 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-06-12T17:40:40.452 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-06-12T17:40:40.560 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-06-12T17:40:40.679 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-06-12T17:40:40.778 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-06-12T17:40:40.907 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-06-12T17:40:40.976 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-06-12T17:40:41.137 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-06-12T17:40:41.185 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-06-12T17:40:41.359 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-06-12T17:40:41.398 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-06-12T17:40:41.596 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-06-12T17:40:41.598 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-06-12T17:40:41.802 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-06-12T17:40:41.826 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-06-12T17:40:42.051 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-06-12T17:40:42.247 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-06-12T17:40:42.269 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-06-12T17:40:42.451 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-06-12T17:40:42.493 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-06-12T17:40:42.663 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-06-12T17:40:42.716 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-06-12T17:40:42.865 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-06-12T17:40:42.938 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-06-12T17:40:43.071 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-06-12T17:40:43.174 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-06-12T17:40:43.281 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-06-12T17:40:43.406 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-06-12T17:40:43.469 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-06-12T17:40:43.619 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-06-12T17:40:43.669 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-06-12T17:40:43.845 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-06-12T17:40:43.867 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-06-12T17:40:44.064 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-06-12T17:40:44.075 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-06-12T17:40:44.283 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-06-12T17:40:44.304 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-06-12T17:40:44.493 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-06-12T17:40:44.505 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-06-12T17:40:44.711 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-06-12T17:40:44.754 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-06-12T17:40:44.931 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-06-12T17:40:44.953 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-06-12T17:40:45.161 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-06-12T17:40:45.166 INFO:teuthology.task.ansible.out: 2020-06-12T17:40:45.180 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-06-12T17:40:45.374 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-06-12T17:40:45.375 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-06-12T17:40:45.586 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-06-12T17:40:45.625 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-06-12T17:40:45.790 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-06-12T17:40:45.813 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-06-12T17:40:45.989 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-06-12T17:40:46.038 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-06-12T17:40:46.197 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-06-12T17:40:46.266 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-06-12T17:40:46.420 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-06-12T17:40:46.482 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-06-12T17:40:46.623 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-06-12T17:40:46.729 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-06-12T17:40:46.826 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-06-12T17:40:46.917 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-06-12T17:40:47.033 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2020-06-12T17:40:47.167 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-06-12T17:40:47.256 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2020-06-12T17:40:47.394 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-06-12T17:40:47.469 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2020-06-12T17:40:47.621 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-06-12T17:40:47.685 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2020-06-12T17:40:47.846 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-06-12T17:40:47.889 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2020-06-12T17:40:48.071 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-06-12T17:40:48.093 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2020-06-12T17:40:48.095 INFO:teuthology.task.ansible.out: 2020-06-12T17:40:48.297 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2020-06-12T17:40:48.308 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2020-06-12T17:40:48.525 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2020-06-12T17:40:48.536 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2020-06-12T17:40:48.747 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2020-06-12T17:40:48.758 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2020-06-12T17:40:48.963 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2020-06-12T17:40:48.990 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2020-06-12T17:40:49.203 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2020-06-12T17:40:49.431 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2020-06-12T17:40:49.646 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2020-06-12T17:40:49.869 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2020-06-12T17:40:50.095 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2020-06-12T17:40:50.328 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2020-06-12T17:40:50.427 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-06-12T17:40:51.566 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "name": "prateek", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2020-06-12T17:40:52.011 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-06-12T17:40:52.761 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "name": "jelopez", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2020-06-12T17:40:53.298 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "name": "prateek", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2020-06-12T17:40:53.981 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "name": "dcain", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2020-06-12T17:40:54.479 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "name": "jelopez", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2020-06-12T17:40:55.142 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "name": "sunny", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2020-06-12T17:40:55.263 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:55 +0000 (0:00:31.413) 0:00:40.333 *********** 2020-06-12T17:40:55.304 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-06-12T17:40:55.341 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:55 +0000 (0:00:00.078) 0:00:40.411 *********** 2020-06-12T17:40:55.402 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-06-12T17:40:55.404 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 2020-06-12T17:40:55.406 INFO:teuthology.task.ansible.out: 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAx 2020-06-12T17:40:55.407 INFO:teuthology.task.ansible.out:j+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8ea 2020-06-12T17:40:55.409 INFO:teuthology.task.ansible.out:c8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f261 2020-06-12T17:40:55.413 INFO:teuthology.task.ansible.out:02d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomai 2020-06-12T17:40:55.415 INFO:teuthology.task.ansible.out:wang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redha 2020-06-12T17:40:55.417 INFO:teuthology.task.ansible.out:t.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4Uk 2020-06-12T17:40:55.417 INFO:teuthology.task.ansible.out:ibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMiv 2020-06-12T17:40:55.420 INFO:teuthology.task.ansible.out:DNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "beng 2020-06-12T17:40:55.422 INFO:teuthology.task.ansible.out:land@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name" 2020-06-12T17:40:55.424 INFO:teuthology.task.ansible.out:: "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643 2020-06-12T17:40:55.426 INFO:teuthology.task.ansible.out:eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4 2020-06-12T17:40:55.428 INFO:teuthology.task.ansible.out:yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}]}, "changed": false} 2020-06-12T17:40:55.463 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:55 +0000 (0:00:00.122) 0:00:40.534 *********** 2020-06-12T17:40:55.788 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ changed: [smithi038.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "name": "dcain", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2020-06-12T17:40:56.354 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-06-12T17:40:56.355 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com -> localhost] => {"after": "982b99592bd601b0475ee21e26576645605e4b52", "attempts": 1, "before": "982b99592bd601b0475ee21e26576645605e4b52", "changed": false, "remote_url_changed": false} 2020-06-12T17:40:56.388 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:56 +0000 (0:00:00.924) 0:00:41.458 *********** 2020-06-12T17:40:56.761 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-06-12T17:40:56.763 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-06-12T17:40:57.051 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-06-12T17:40:57.053 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "name": "sunny", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2020-06-12T17:40:57.131 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-06-12T17:40:57.133 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-06-12T17:40:57.169 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:57 +0000 (0:00:00.777) 0:00:42.236 *********** 2020-06-12T17:40:57.198 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-06-12T17:40:57.240 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:57 +0000 (0:00:00.074) 0:00:42.310 *********** 2020-06-12T17:40:57.299 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-06-12T17:40:57.301 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 2020-06-12T17:40:57.302 INFO:teuthology.task.ansible.out: 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAx 2020-06-12T17:40:57.304 INFO:teuthology.task.ansible.out:j+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8ea 2020-06-12T17:40:57.306 INFO:teuthology.task.ansible.out:c8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f261 2020-06-12T17:40:57.308 INFO:teuthology.task.ansible.out:02d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomai 2020-06-12T17:40:57.311 INFO:teuthology.task.ansible.out:wang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redha 2020-06-12T17:40:57.313 INFO:teuthology.task.ansible.out:t.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"} 2020-06-12T17:40:57.314 INFO:teuthology.task.ansible.out:, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMiv 2020-06-12T17:40:57.315 INFO:teuthology.task.ansible.out:DNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "beng 2020-06-12T17:40:57.317 INFO:teuthology.task.ansible.out:land@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name" 2020-06-12T17:40:57.319 INFO:teuthology.task.ansible.out:: "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643 2020-06-12T17:40:57.320 INFO:teuthology.task.ansible.out:eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez 2020-06-12T17:40:57.326 INFO:teuthology.task.ansible.out:75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name 2020-06-12T17:40:57.330 INFO:teuthology.task.ansible.out:": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}]}, "changed": false} 2020-06-12T17:40:57.362 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:57 +0000 (0:00:00.122) 0:00:42.433 *********** 2020-06-12T17:40:57.377 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-06-12T17:40:57.686 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2020-06-12T17:40:57.690 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2020-06-12T17:40:57.960 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-06-12T17:40:58.155 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* ok: [smithi038.front.sepia.ceph.com -> localhost] => {"after": "982b99592bd601b0475ee21e26576645605e4b52", "attempts": 1, "before": "982b99592bd601b0475ee21e26576645605e4b52", "changed": false, "remote_url_changed": false} 2020-06-12T17:40:58.194 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:40:58 +0000 (0:00:00.831) 0:00:43.264 *********** 2020-06-12T17:40:58.286 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-06-12T17:40:58.288 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2020-06-12T17:40:58.290 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-06-12T17:40:58.575 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-06-12T17:40:58.577 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-06-12T17:40:58.891 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2020-06-12T17:40:58.903 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-06-12T17:40:59.197 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-06-12T17:40:59.220 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:40:59.228 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-06-12T17:40:59.513 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2020-06-12T17:40:59.515 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-06-12T17:40:59.524 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'aemerson', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:40:59.536 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2020-06-12T17:40:59.537 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2020-06-12T17:40:59.564 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:40:59.566 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:40:59.841 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-06-12T17:40:59.864 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-06-12T17:41:00.129 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2020-06-12T17:41:00.131 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-06-12T17:41:00.185 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2020-06-12T17:41:00.187 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-06-12T17:41:00.419 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-06-12T17:41:00.505 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-06-12T17:41:00.719 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-06-12T17:41:00.835 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2020-06-12T17:41:01.016 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2020-06-12T17:41:01.164 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-06-12T17:41:01.176 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:01.316 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-06-12T17:41:01.490 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2020-06-12T17:41:01.492 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-06-12T17:41:01.499 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'aemerson', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:01.523 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:01.524 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:01.607 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-06-12T17:41:01.849 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-06-12T17:41:01.909 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-06-12T17:41:02.167 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2020-06-12T17:41:02.170 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-06-12T17:41:02.200 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2020-06-12T17:41:02.202 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-06-12T17:41:02.471 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-06-12T17:41:02.497 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2020-06-12T17:41:02.499 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2020-06-12T17:41:02.784 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-06-12T17:41:02.795 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-06-12T17:41:03.095 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2020-06-12T17:41:03.112 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-06-12T17:41:03.424 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-06-12T17:41:03.426 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2020-06-12T17:41:03.428 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-06-12T17:41:03.696 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-06-12T17:41:03.742 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-06-12T17:41:03.979 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-06-12T17:41:04.055 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-06-12T17:41:04.284 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-06-12T17:41:04.390 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2020-06-12T17:41:04.394 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-06-12T17:41:04.583 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-06-12T17:41:04.696 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2020-06-12T17:41:04.698 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2020-06-12T17:41:04.870 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-06-12T17:41:05.010 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-06-12T17:41:05.162 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2020-06-12T17:41:05.164 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-06-12T17:41:05.314 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-06-12T17:41:05.460 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-06-12T17:41:05.631 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2020-06-12T17:41:05.633 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-06-12T17:41:05.794 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-06-12T17:41:05.961 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-06-12T17:41:06.077 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-06-12T17:41:06.276 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-06-12T17:41:06.437 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-06-12T17:41:06.584 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-06-12T17:41:06.725 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-06-12T17:41:06.894 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-06-12T17:41:07.033 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-06-12T17:41:07.206 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-06-12T17:41:07.311 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-06-12T17:41:07.521 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2020-06-12T17:41:07.527 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-06-12T17:41:07.607 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-06-12T17:41:07.837 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-06-12T17:41:07.900 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-06-12T17:41:08.142 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-06-12T17:41:08.195 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2020-06-12T17:41:08.197 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-06-12T17:41:08.446 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-06-12T17:41:08.478 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2020-06-12T17:41:08.479 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-06-12T17:41:08.762 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-06-12T17:41:08.772 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-06-12T17:41:09.066 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-06-12T17:41:09.077 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-06-12T17:41:09.367 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-06-12T17:41:09.368 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-06-12T17:41:09.672 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2020-06-12T17:41:09.676 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-06-12T17:41:09.683 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-06-12T17:41:09.983 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-06-12T17:41:09.985 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2020-06-12T17:41:09.986 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2020-06-12T17:41:09.989 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-06-12T17:41:10.289 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-06-12T17:41:10.303 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-06-12T17:41:10.566 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-06-12T17:41:10.630 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2020-06-12T17:41:10.632 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-06-12T17:41:10.860 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-06-12T17:41:10.924 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2020-06-12T17:41:10.930 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-06-12T17:41:11.163 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-06-12T17:41:11.242 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-06-12T17:41:11.453 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-06-12T17:41:11.540 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-06-12T17:41:11.737 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2020-06-12T17:41:11.739 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-06-12T17:41:11.856 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-06-12T17:41:12.028 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-06-12T17:41:12.179 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2020-06-12T17:41:12.181 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-06-12T17:41:12.318 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-06-12T17:41:12.490 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2020-06-12T17:41:12.492 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2020-06-12T17:41:12.494 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-06-12T17:41:12.626 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2020-06-12T17:41:12.628 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2020-06-12T17:41:12.826 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-06-12T17:41:12.910 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-06-12T17:41:13.127 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-06-12T17:41:13.201 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-06-12T17:41:13.434 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-06-12T17:41:13.502 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2020-06-12T17:41:13.504 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-06-12T17:41:13.749 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-06-12T17:41:13.781 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-06-12T17:41:14.051 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-06-12T17:41:14.073 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-06-12T17:41:14.367 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2020-06-12T17:41:14.369 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-06-12T17:41:14.454 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-06-12T17:41:14.673 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-06-12T17:41:14.746 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-06-12T17:41:14.976 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-06-12T17:41:15.038 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-06-12T17:41:15.276 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2020-06-12T17:41:15.278 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2020-06-12T17:41:15.318 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-06-12T17:41:15.590 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-06-12T17:41:15.626 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-06-12T17:41:15.894 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-06-12T17:41:15.911 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-06-12T17:41:16.203 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-06-12T17:41:16.224 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2020-06-12T17:41:16.226 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-06-12T17:41:16.494 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-06-12T17:41:16.547 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-06-12T17:41:16.785 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-06-12T17:41:16.848 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-06-12T17:41:17.078 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-06-12T17:41:17.193 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-06-12T17:41:17.359 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-06-12T17:41:17.501 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-06-12T17:41:17.651 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-06-12T17:41:17.797 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-06-12T17:41:17.965 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-06-12T17:41:18.108 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-06-12T17:41:18.244 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-06-12T17:41:18.406 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-06-12T17:41:18.526 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-06-12T17:41:18.717 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-06-12T17:41:18.835 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-06-12T17:41:19.024 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-06-12T17:41:19.122 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-06-12T17:41:19.329 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-06-12T17:41:19.435 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-06-12T17:41:19.650 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-06-12T17:41:19.740 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-06-12T17:41:19.946 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-06-12T17:41:20.028 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-06-12T17:41:20.262 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-06-12T17:41:20.315 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-06-12T17:41:20.575 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-06-12T17:41:20.618 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-06-12T17:41:20.894 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-06-12T17:41:20.923 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-06-12T17:41:21.217 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U 2020-06-12T17:41:21.219 INFO:teuthology.task.ansible.out:1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-06-12T17:41:21.501 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2020-06-12T17:41:21.503 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-06-12T17:41:21.525 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-06-12T17:41:21.810 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-06-12T17:41:21.840 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-06-12T17:41:22.092 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-06-12T17:41:22.143 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-06-12T17:41:22.408 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-06-12T17:41:22.456 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-06-12T17:41:22.717 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-06-12T17:41:22.779 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-06-12T17:41:23.015 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-06-12T17:41:23.096 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-06-12T17:41:23.311 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-06-12T17:41:23.402 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-06-12T17:41:23.614 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-06-12T17:41:23.722 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-06-12T17:41:23.914 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-06-12T17:41:24.041 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-06-12T17:41:24.216 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-06-12T17:41:24.352 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2020-06-12T17:41:24.356 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-06-12T17:41:24.514 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-06-12T17:41:24.660 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2020-06-12T17:41:24.662 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-06-12T17:41:24.785 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-06-12T17:41:24.970 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-06-12T17:41:25.087 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-06-12T17:41:25.286 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-06-12T17:41:25.384 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-06-12T17:41:25.606 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-06-12T17:41:25.677 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-06-12T17:41:25.920 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-06-12T17:41:25.988 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2020-06-12T17:41:25.990 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-06-12T17:41:26.231 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-06-12T17:41:26.283 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-06-12T17:41:26.555 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-06-12T17:41:26.601 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-06-12T17:41:26.863 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-06-12T17:41:26.886 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-06-12T17:41:27.173 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-06-12T17:41:27.198 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-06-12T17:41:27.487 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-06-12T17:41:27.503 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-06-12T17:41:27.783 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-06-12T17:41:27.808 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-06-12T17:41:28.082 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-06-12T17:41:28.116 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-06-12T17:41:28.378 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-06-12T17:41:28.473 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-06-12T17:41:28.673 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2020-06-12T17:41:28.777 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-06-12T17:41:28.965 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2020-06-12T17:41:29.101 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-06-12T17:41:29.261 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2020-06-12T17:41:29.411 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2020-06-12T17:41:29.413 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-06-12T17:41:29.580 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2020-06-12T17:41:29.762 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-06-12T17:41:29.881 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2020-06-12T17:41:30.068 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-06-12T17:41:30.177 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2020-06-12T17:41:30.382 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-06-12T17:41:30.467 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2020-06-12T17:41:30.701 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-06-12T17:41:30.764 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2020-06-12T17:41:31.029 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-06-12T17:41:31.051 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2020-06-12T17:41:31.336 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-06-12T17:41:31.338 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2020-06-12T17:41:31.440 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:31 +0000 (0:00:33.246) 0:01:16.511 *********** 2020-06-12T17:41:31.504 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-06-12T17:41:31.506 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:31.515 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:31.526 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:31.527 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:31.548 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:31.550 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:31.562 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:31.571 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:31.636 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-06-12T17:41:31.861 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-06-12T17:41:31.863 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2020-06-12T17:41:31.893 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:31.947 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-06-12T17:41:31.949 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-06-12T17:41:32.179 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-06-12T17:41:32.181 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'aemerson', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2020-06-12T17:41:32.268 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-06-12T17:41:32.270 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2020-06-12T17:41:32.462 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-06-12T17:41:32.464 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-06-12T17:41:32.560 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-06-12T17:41:32.562 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2020-06-12T17:41:32.758 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi150.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-06-12T17:41:32.766 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:32.777 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:32.779 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:32.789 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:32.799 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:32.801 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:32.810 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:32.821 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:32.832 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:32.847 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:32.865 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-06-12T17:41:32.867 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var 2020-06-12T17:41:32.869 INFO:teuthology.task.ansible.out:": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:32.891 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:32.893 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:32.902 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:32.925 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:32.936 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:32.938 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:32.949 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:32.954 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:32.960 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:32.971 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:32.973 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:32.983 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.008 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.014 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.019 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.021 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.033 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.052 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.054 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.064 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.066 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.076 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.087 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.089 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.100 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.111 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.113 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.122 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.141 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.143 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.158 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.164 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.165 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.186 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.189 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.197 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.199 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2020-06-12T17:41:33.209 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-06-12T17:41:33.211 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.225 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.235 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.237 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.258 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.266 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.277 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.278 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.289 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.291 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.301 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.303 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.314 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.325 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.327 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.341 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.349 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.354 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.365 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.376 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.388 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.398 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.400 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.410 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.421 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.431 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.433 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.443 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.445 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.466 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.477 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.483 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.499 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.501 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.511 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.525 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.535 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.545 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.552 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2020-06-12T17:41:33.561 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.569 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.585 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.607 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.612 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.620 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.634 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.646 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.648 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.657 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.713 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:33 +0000 (0:00:02.272) 0:01:18.783 *********** 2020-06-12T17:41:33.772 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:33.813 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:33 +0000 (0:00:00.100) 0:01:18.884 *********** 2020-06-12T17:41:33.855 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi038.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2020-06-12T17:41:34.076 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T17:41:34.081 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-06-12T17:41:34.193 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-06-12T17:41:34.194 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2020-06-12T17:41:34.288 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T17:41:34.289 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-06-12T17:41:34.501 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-06-12T17:41:34.514 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-06-12T17:41:34.516 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2020-06-12T17:41:34.689 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T17:41:34.690 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-06-12T17:41:34.820 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-06-12T17:41:34.822 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2020-06-12T17:41:34.897 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi150.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-06-12T17:41:35.095 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2020-06-12T17:41:35.127 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi038.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2020-06-12T17:41:35.215 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:35 +0000 (0:00:01.401) 0:01:20.285 *********** 2020-06-12T17:41:35.278 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-06-12T17:41:35.279 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:35.286 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:35.297 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:35.298 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:35.308 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:35.320 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T17:41:35.322 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:35.343 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:35.366 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:35.529 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T17:41:35.531 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2020-06-12T17:41:35.677 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2020-06-12T17:41:35.699 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:35.731 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T17:41:35.734 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-06-12T17:41:35.947 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-06-12T17:41:35.994 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-06-12T17:41:35.996 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'aemerson', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2020-06-12T17:41:36.140 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T17:41:36.141 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-06-12T17:41:36.312 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-06-12T17:41:36.355 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi150.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-06-12T17:41:36.545 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-06-12T17:41:36.621 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi038.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-06-12T17:41:36.634 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.646 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.660 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.674 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.681 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.707 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.709 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.718 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.720 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.733 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.742 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.773 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi150.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-06-12T17:41:36.775 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.786 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.789 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.800 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.802 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.815 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.824 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.838 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.857 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.858 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.859 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.879 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.881 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.901 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.903 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.913 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.915 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.924 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.938 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.950 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.951 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi150.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-06-12T17:41:36.975 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-06-12T17:41:36.977 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:36.990 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.001 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.023 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.034 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.057 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.075 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.077 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.094 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.105 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.117 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.128 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.139 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.158 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.163 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.165 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.190 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.201 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi150.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-06-12T17:41:37.214 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.248 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.250 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.261 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.275 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.277 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.297 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.302 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.313 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.322 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.339 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.346 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.357 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.378 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.390 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.391 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.402 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.413 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.425 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.430 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi150.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-06-12T17:41:37.439 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.454 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.465 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.467 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.488 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.498 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.520 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.522 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.537 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.539 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.561 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.573 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.592 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.607 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.614 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.616 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.627 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.644 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T17:41:37.648 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-06-12T17:41:37.683 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:37 +0000 (0:00:02.468) 0:01:22.754 *********** 2020-06-12T17:41:37.725 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-06-12T17:41:37.727 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:37.759 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:37 +0000 (0:00:00.076) 0:01:22.830 *********** 2020-06-12T17:41:37.841 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T17:41:37.846 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-06-12T17:41:38.022 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-06-12T17:41:38.064 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-06-12T17:41:38.244 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-06-12T17:41:38.279 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-06-12T17:41:38.457 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-06-12T17:41:38.495 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-06-12T17:41:38.691 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-06-12T17:41:38.714 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-06-12T17:41:38.896 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-06-12T17:41:38.918 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-06-12T17:41:39.100 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-06-12T17:41:39.134 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2020-06-12T17:41:39.303 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-06-12T17:41:39.341 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-06-12T17:41:39.514 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-06-12T17:41:39.554 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2020-06-12T17:41:39.725 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-06-12T17:41:39.773 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-06-12T17:41:39.944 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-06-12T17:41:39.976 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-06-12T17:41:40.149 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-06-12T17:41:40.229 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-06-12T17:41:40.371 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-06-12T17:41:40.462 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-06-12T17:41:40.581 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-06-12T17:41:40.675 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-06-12T17:41:40.774 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-06-12T17:41:40.880 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-06-12T17:41:40.987 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-06-12T17:41:41.093 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-06-12T17:41:41.213 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2020-06-12T17:41:41.328 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-06-12T17:41:41.414 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-06-12T17:41:41.544 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-06-12T17:41:41.622 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-06-12T17:41:41.772 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-06-12T17:41:41.875 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-06-12T17:41:42.016 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-06-12T17:41:42.106 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-06-12T17:41:42.242 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-06-12T17:41:42.305 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-06-12T17:41:42.441 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-06-12T17:41:42.495 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-06-12T17:41:42.669 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-06-12T17:41:42.739 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-06-12T17:41:42.878 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-06-12T17:41:42.935 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2020-06-12T17:41:43.004 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:43 +0000 (0:00:05.244) 0:01:28.074 *********** 2020-06-12T17:41:43.091 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-06-12T17:41:43.293 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-06-12T17:41:43.513 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-06-12T17:41:43.606 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "checksum": "f166a1846201ae42f076bd651ad63f80375d8a1b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "594f3164ffc654444ae430b4df4334d6", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1591983703.0466197-194694515760392/source", "state": "file", "uid": 0} 2020-06-12T17:41:43.637 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:43 +0000 (0:00:00.632) 0:01:28.707 *********** 2020-06-12T17:41:43.680 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi150.front.sepia.ceph.com] => { "msg": "Host smithi150.front.sepia.ceph.com is running RedHat 8.1 (Ootpa)" } 2020-06-12T17:41:43.718 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:43 +0000 (0:00:00.082) 0:01:28.789 *********** 2020-06-12T17:41:43.739 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi038.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-06-12T17:41:43.772 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-06-12T17:41:43.774 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2020-06-12T17:41:43.819 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:43 +0000 (0:00:00.099) 0:01:28.888 *********** 2020-06-12T17:41:43.849 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-06-12T17:41:43.851 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:43.895 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:43 +0000 (0:00:00.070) 0:01:28.959 *********** 2020-06-12T17:41:43.942 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T17:41:43.944 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-06-12T17:41:44.170 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-06-12T17:41:44.385 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-06-12T17:41:44.428 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.314287", "end": "2020-06-12 17:41:44.389477", "rc": 0, "start": "2020-06-12 17:41:44.075190", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-06-12T17:41:44.475 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:44 +0000 (0:00:00.586) 0:01:29.546 *********** 2020-06-12T17:41:44.533 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:44.577 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:44 +0000 (0:00:00.098) 0:01:29.645 *********** 2020-06-12T17:41:44.593 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T17:41:44.594 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-06-12T17:41:44.629 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-06-12T17:41:44.631 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:44.673 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:44 +0000 (0:00:00.098) 0:01:29.743 *********** 2020-06-12T17:41:44.714 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-06-12T17:41:44.716 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:44.747 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:44 +0000 (0:00:00.074) 0:01:29.818 *********** 2020-06-12T17:41:44.791 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:44.827 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:44 +0000 (0:00:00.077) 0:01:29.895 *********** 2020-06-12T17:41:44.832 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T17:41:44.834 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-06-12T17:41:44.856 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:44.891 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:44 +0000 (0:00:00.065) 0:01:29.961 *********** 2020-06-12T17:41:44.935 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2020-06-12T17:41:44.974 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:44 +0000 (0:00:00.083) 0:01:30.044 *********** 2020-06-12T17:41:45.030 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi038.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-06-12T17:41:45.042 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** ok: [smithi150.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi150.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-12T17:41:45.071 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:45 +0000 (0:00:00.097) 0:01:30.142 *********** 2020-06-12T17:41:45.116 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-06-12T17:41:45.118 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2020-06-12T17:41:45.167 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:45 +0000 (0:00:00.094) 0:01:30.237 *********** 2020-06-12T17:41:45.248 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T17:41:45.252 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-06-12T17:41:45.471 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2020-06-12T17:41:45.700 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-06-12T17:41:45.909 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-06-12T17:41:46.132 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-06-12T17:41:46.341 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-06-12T17:41:46.373 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1591983706.2408755-5feb9jsx/katello-ca-consumer-latest.noarchv6lemb78.rpm"]} 2020-06-12T17:41:46.412 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:46 +0000 (0:00:01.246) 0:01:31.483 *********** 2020-06-12T17:41:46.552 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T17:41:46.554 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-06-12T17:41:46.775 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-06-12T17:41:46.994 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-06-12T17:41:47.205 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2020-06-12T17:41:47.271 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:47 +0000 (0:00:00.858) 0:01:32.341 *********** 2020-06-12T17:41:47.417 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-06-12T17:41:47.419 INFO:teuthology.task.ansible.out:fatal: [smithi150.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2020-06-12T17:41:47.452 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:47 +0000 (0:00:00.181) 0:01:32.523 *********** 2020-06-12T17:41:47.503 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-06-12T17:41:47.505 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2020-06-12T17:41:47.540 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:47 +0000 (0:00:00.087) 0:01:32.610 *********** 2020-06-12T17:41:47.889 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-06-12T17:41:47.890 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "checksum": "f166a1846201ae42f076bd651ad63f80375d8a1b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "594f3164ffc654444ae430b4df4334d6", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1591983707.307156-50394109636720/source", "state": "file", "uid": 0} 2020-06-12T17:41:47.929 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:47 +0000 (0:00:00.389) 0:01:32.999 *********** 2020-06-12T17:41:47.958 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-06-12T17:41:47.960 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => { "msg": "Host smithi038.front.sepia.ceph.com is running RedHat 8.1 (Ootpa)" } 2020-06-12T17:41:47.998 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:47 +0000 (0:00:00.069) 0:01:33.069 *********** 2020-06-12T17:41:48.038 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-06-12T17:41:48.040 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2020-06-12T17:41:48.082 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:48 +0000 (0:00:00.078) 0:01:33.147 *********** 2020-06-12T17:41:48.112 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:48.140 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:48 +0000 (0:00:00.062) 0:01:33.210 *********** 2020-06-12T17:41:48.723 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-06-12T17:41:48.730 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.367316", "end": "2020-06-12 17:41:48.697670", "rc": 0, "start": "2020-06-12 17:41:48.330354", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-06-12T17:41:48.765 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:48 +0000 (0:00:00.624) 0:01:33.835 *********** 2020-06-12T17:41:48.796 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-06-12T17:41:48.798 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:48.830 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:48 +0000 (0:00:00.065) 0:01:33.901 *********** 2020-06-12T17:41:48.861 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:48.896 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:48 +0000 (0:00:00.066) 0:01:33.967 *********** 2020-06-12T17:41:48.938 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:48.975 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:48 +0000 (0:00:00.078) 0:01:34.045 *********** 2020-06-12T17:41:49.014 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-06-12T17:41:49.016 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:49.052 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:49 +0000 (0:00:00.077) 0:01:34.123 *********** 2020-06-12T17:41:49.092 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:49.134 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:49 +0000 (0:00:00.080) 0:01:34.203 *********** 2020-06-12T17:41:49.175 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-06-12T17:41:49.177 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2020-06-12T17:41:49.208 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:49 +0000 (0:00:00.075) 0:01:34.278 *********** 2020-06-12T17:41:49.279 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-06-12T17:41:49.281 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-12T17:41:49.315 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:49 +0000 (0:00:00.106) 0:01:34.385 *********** 2020-06-12T17:41:49.354 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-06-12T17:41:49.363 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2020-06-12T17:41:49.389 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:49 +0000 (0:00:00.074) 0:01:34.459 *********** 2020-06-12T17:41:50.418 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1591983710.2796998-ngxniz1z/katello-ca-consumer-latest.noarchfd1mqphh.rpm"]} 2020-06-12T17:41:50.445 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:50 +0000 (0:00:01.056) 0:01:35.516 *********** 2020-06-12T17:41:51.433 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-06-12T17:41:51.435 INFO:teuthology.task.ansible.out:fatal: [smithi038.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2020-06-12T17:41:51.466 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:51 +0000 (0:00:01.020) 0:01:36.536 *********** 2020-06-12T17:41:51.507 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-06-12T17:41:51.509 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2020-06-12T17:41:51.541 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:51 +0000 (0:00:00.074) 0:01:36.611 *********** 2020-06-12T17:41:55.530 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-06-12T17:41:55.532 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-06-12T17:41:55.567 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:55 +0000 (0:00:04.026) 0:01:40.638 *********** 2020-06-12T17:41:55.618 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-06-12T17:41:55.620 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2020-06-12T17:41:55.652 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:55 +0000 (0:00:00.084) 0:01:40.722 *********** 2020-06-12T17:41:56.583 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-06-12T17:41:56.585 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.684117", "end": "2020-06-12 17:41:56.536010", "failed_when_result": false, "rc": 0, "start": "2020-06-12 17:41:55.851893", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7Server\n8\n8.0\n8.1\n8.2", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7Server", "8", "8.0", "8.1", "8.2"]} 2020-06-12T17:41:56.645 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:56 +0000 (0:00:00.993) 0:01:41.715 *********** 2020-06-12T17:41:56.686 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-06-12T17:41:56.690 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:56.730 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:56 +0000 (0:00:00.084) 0:01:41.800 *********** 2020-06-12T17:41:56.771 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:56.808 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:56 +0000 (0:00:00.077) 0:01:41.878 *********** 2020-06-12T17:41:56.836 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-06-12T17:41:56.838 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-12T17:41:56.870 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:56 +0000 (0:00:00.062) 0:01:41.941 *********** 2020-06-12T17:41:56.925 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-06-12T17:41:56.927 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:41:56.970 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:56 +0000 (0:00:00.099) 0:01:42.040 *********** 2020-06-12T17:41:59.027 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-06-12T17:41:59.029 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-06-12T17:41:59.071 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:59 +0000 (0:00:02.101) 0:01:44.142 *********** 2020-06-12T17:41:59.119 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-06-12T17:41:59.125 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2020-06-12T17:41:59.179 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:41:59 +0000 (0:00:00.107) 0:01:44.249 *********** 2020-06-12T17:42:00.201 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-06-12T17:42:00.204 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.774300", "end": "2020-06-12 17:42:00.156272", "failed_when_result": false, "rc": 0, "start": "2020-06-12 17:41:59.381972", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7Server\n8\n8.0\n8.1\n8.2", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7Server", "8", "8.0", "8.1", "8.2"]} 2020-06-12T17:42:00.251 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:00 +0000 (0:00:01.069) 0:01:45.319 *********** 2020-06-12T17:42:00.293 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:00.332 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:00 +0000 (0:00:00.083) 0:01:45.402 *********** 2020-06-12T17:42:00.386 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:00.443 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:00 +0000 (0:00:00.111) 0:01:45.513 *********** 2020-06-12T17:42:00.473 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-12T17:42:00.506 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:00 +0000 (0:00:00.063) 0:01:45.577 *********** 2020-06-12T17:42:00.546 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-06-12T17:42:00.548 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:00.580 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:00 +0000 (0:00:00.073) 0:01:45.650 *********** 2020-06-12T17:42:07.781 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-06-12T17:42:07.783 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:10.589030", "end": "2020-06-12 17:42:07.754255", "rc": 0, "start": "2020-06-12 17:41:57.165225", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2020-06-12T17:42:07.823 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:07 +0000 (0:00:07.242) 0:01:52.893 *********** 2020-06-12T17:42:07.865 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2020-06-12T17:42:07.904 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:07 +0000 (0:00:00.080) 0:01:52.974 *********** 2020-06-12T17:42:07.946 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:07.977 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:07 +0000 (0:00:00.073) 0:01:53.048 *********** 2020-06-12T17:42:08.027 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-06-12T17:42:08.029 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2020-06-12T17:42:08.062 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:08 +0000 (0:00:00.084) 0:01:53.132 *********** 2020-06-12T17:42:08.102 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-06-12T17:42:08.103 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2020-06-12T17:42:08.135 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:08 +0000 (0:00:00.073) 0:01:53.206 *********** 2020-06-12T17:42:11.919 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:11.093167", "end": "2020-06-12 17:42:11.881079", "rc": 0, "start": "2020-06-12 17:42:00.787912", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2020-06-12T17:42:11.959 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:11 +0000 (0:00:03.824) 0:01:57.030 *********** 2020-06-12T17:42:12.011 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-06-12T17:42:12.013 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2020-06-12T17:42:12.046 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:12 +0000 (0:00:00.086) 0:01:57.116 *********** 2020-06-12T17:42:12.090 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:12.126 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:12 +0000 (0:00:00.080) 0:01:57.196 *********** 2020-06-12T17:42:12.178 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-06-12T17:42:12.186 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2020-06-12T17:42:12.220 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:12 +0000 (0:00:00.094) 0:01:57.291 *********** 2020-06-12T17:42:12.263 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2020-06-12T17:42:12.297 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:12 +0000 (0:00:00.076) 0:01:57.367 *********** 2020-06-12T17:42:12.299 INFO:teuthology.task.ansible.out: 2020-06-12T17:42:12.992 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** changed: [smithi150.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-06-12T17:42:13.038 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:13 +0000 (0:00:00.741) 0:01:58.109 *********** 2020-06-12T17:42:17.473 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-06-12T17:42:17.475 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:04.206902", "end": "2020-06-12 17:42:17.442460", "rc": 0, "start": "2020-06-12 17:42:13.235558", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2020-06-12T17:42:17.508 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:17 +0000 (0:00:04.469) 0:02:02.578 *********** 2020-06-12T17:42:17.613 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-06-12T17:42:17.614 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-06-12T17:42:17.657 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:17 +0000 (0:00:00.149) 0:02:02.728 *********** 2020-06-12T17:42:17.659 INFO:teuthology.task.ansible.out: 2020-06-12T17:42:17.876 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-06-12T17:42:17.878 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2020-06-12T17:42:17.916 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:17 +0000 (0:00:00.258) 0:02:02.987 *********** 2020-06-12T17:42:18.143 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-06-12T17:42:18.146 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-12T17:42:18.184 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:18 +0000 (0:00:00.268) 0:02:03.255 *********** 2020-06-12T17:42:18.720 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-06-12T17:42:18.722 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-06-12T17:42:19.219 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-06-12T17:42:19.258 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:19 +0000 (0:00:01.073) 0:02:04.329 *********** 2020-06-12T17:42:19.786 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-06-12T17:42:19.789 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-06-12T17:42:20.289 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-06-12T17:42:20.321 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:20 +0000 (0:00:01.063) 0:02:05.392 *********** 2020-06-12T17:42:20.368 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-06-12T17:42:20.369 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:20.403 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:20 +0000 (0:00:00.081) 0:02:05.474 *********** 2020-06-12T17:42:20.433 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-06-12T17:42:20.435 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:20.468 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:20 +0000 (0:00:00.064) 0:02:05.538 *********** 2020-06-12T17:42:20.506 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:20.553 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:20 +0000 (0:00:00.084) 0:02:05.623 *********** 2020-06-12T17:42:20.594 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-06-12T17:42:20.606 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:20.628 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:20 +0000 (0:00:00.074) 0:02:05.698 *********** 2020-06-12T17:42:20.658 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-06-12T17:42:20.660 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:20.691 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:20 +0000 (0:00:00.063) 0:02:05.762 *********** 2020-06-12T17:42:20.720 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-06-12T17:42:20.722 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:20.754 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:20 +0000 (0:00:00.062) 0:02:05.824 *********** 2020-06-12T17:42:20.783 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-06-12T17:42:20.785 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:20.818 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:20 +0000 (0:00:00.063) 0:02:05.888 *********** 2020-06-12T17:42:20.851 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-06-12T17:42:20.853 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:20.888 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:20 +0000 (0:00:00.070) 0:02:05.958 *********** 2020-06-12T17:42:20.934 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-06-12T17:42:20.936 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:20.979 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:20 +0000 (0:00:00.091) 0:02:06.049 *********** 2020-06-12T17:42:21.523 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-06-12T17:42:21.525 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.334938", "end": "2020-06-12 17:42:21.500346", "rc": 0, "start": "2020-06-12 17:42:21.165408", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T17:42:21.563 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:21 +0000 (0:00:00.583) 0:02:06.633 *********** 2020-06-12T17:42:22.064 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:04.173017", "end": "2020-06-12 17:42:22.038897", "rc": 0, "start": "2020-06-12 17:42:17.865880", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2020-06-12T17:42:22.103 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:22 +0000 (0:00:00.540) 0:02:07.173 *********** 2020-06-12T17:42:22.340 INFO:teuthology.task.ansible.out: 2020-06-12T17:42:22.342 INFO:teuthology.task.ansible.out:TASK [common : Remove old apt-mirror repository definition.] ******************* ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2020-06-12T17:42:22.390 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:22 +0000 (0:00:00.287) 0:02:07.461 *********** 2020-06-12T17:42:22.392 INFO:teuthology.task.ansible.out: 2020-06-12T17:42:22.624 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-06-12T17:42:22.625 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-12T17:42:22.661 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:22 +0000 (0:00:00.269) 0:02:07.730 *********** 2020-06-12T17:42:23.228 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-06-12T17:42:23.230 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-06-12T17:42:23.756 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-06-12T17:42:23.795 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:23 +0000 (0:00:01.135) 0:02:08.866 *********** 2020-06-12T17:42:24.093 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-06-12T17:42:24.095 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-06-12T17:42:24.128 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:24 +0000 (0:00:00.332) 0:02:09.198 *********** 2020-06-12T17:42:24.167 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-06-12T17:42:24.169 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:24.203 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:24 +0000 (0:00:00.075) 0:02:09.274 *********** 2020-06-12T17:42:24.250 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:24.286 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:24 +0000 (0:00:00.082) 0:02:09.356 *********** 2020-06-12T17:42:24.316 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-06-12T17:42:24.319 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:24.353 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:24 +0000 (0:00:00.067) 0:02:09.424 *********** 2020-06-12T17:42:24.365 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-06-12T17:42:24.367 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-06-12T17:42:24.389 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:24.427 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:24 +0000 (0:00:00.074) 0:02:09.498 *********** 2020-06-12T17:42:24.865 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-06-12T17:42:24.867 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-06-12T17:42:24.903 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:24 +0000 (0:00:00.475) 0:02:09.973 *********** 2020-06-12T17:42:24.954 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} TASK [common : Clean yum cache] ************************************************ skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:24.984 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:24 +0000 (0:00:00.081) 0:02:10.054 *********** 2020-06-12T17:42:25.027 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:25 +0000 (0:00:00.043) 0:02:10.098 *********** 2020-06-12T17:42:25.039 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-06-12T17:42:25.041 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:25.075 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:25 +0000 (0:00:00.047) 0:02:10.145 *********** 2020-06-12T17:42:25.121 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:25.160 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:25 +0000 (0:00:00.080) 0:02:10.226 *********** 2020-06-12T17:42:25.205 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-06-12T17:42:25.207 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:25.243 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:25 +0000 (0:00:00.087) 0:02:10.313 *********** 2020-06-12T17:42:25.282 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-06-12T17:42:25.284 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:25.316 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:25 +0000 (0:00:00.072) 0:02:10.386 *********** 2020-06-12T17:42:25.344 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-06-12T17:42:25.346 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:25.378 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:25 +0000 (0:00:00.062) 0:02:10.448 *********** 2020-06-12T17:42:25.407 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-06-12T17:42:25.410 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:25.445 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:25 +0000 (0:00:00.067) 0:02:10.515 *********** 2020-06-12T17:42:25.474 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-06-12T17:42:25.476 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:25.509 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:25 +0000 (0:00:00.063) 0:02:10.578 *********** 2020-06-12T17:42:25.537 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-06-12T17:42:25.539 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:25.571 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:25 +0000 (0:00:00.062) 0:02:10.641 *********** 2020-06-12T17:42:26.528 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.731985", "end": "2020-06-12 17:42:26.500369", "rc": 0, "start": "2020-06-12 17:42:25.768384", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T17:42:26.575 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:26 +0000 (0:00:01.003) 0:02:11.645 *********** 2020-06-12T17:42:29.225 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-06-12T17:42:29.227 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-06-12T17:42:29.270 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:29 +0000 (0:00:02.694) 0:02:14.340 *********** 2020-06-12T17:42:29.299 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-06-12T17:42:29.301 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:29.334 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:29 +0000 (0:00:00.064) 0:02:14.405 *********** 2020-06-12T17:42:29.364 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-06-12T17:42:29.366 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:29.401 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:29 +0000 (0:00:00.066) 0:02:14.471 *********** 2020-06-12T17:42:29.441 INFO:teuthology.task.ansible.out: 2020-06-12T17:42:29.443 INFO:teuthology.task.ansible.out:TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-06-12T17:42:29.444 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:29.481 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:29 +0000 (0:00:00.080) 0:02:14.552 *********** 2020-06-12T17:42:29.524 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-06-12T17:42:29.526 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:29.562 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:29 +0000 (0:00:00.080) 0:02:14.632 *********** 2020-06-12T17:42:30.090 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-06-12T17:42:30.127 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:30 +0000 (0:00:00.565) 0:02:15.198 *********** 2020-06-12T17:42:30.129 INFO:teuthology.task.ansible.out: 2020-06-12T17:42:31.930 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: smartmontools", "Installed: smartmontools-1:7.1-7.el8.x86_64", "Removed: smartmontools-1:6.6-3.el8.x86_64"]} 2020-06-12T17:42:31.974 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:31 +0000 (0:00:01.846) 0:02:17.044 *********** 2020-06-12T17:42:32.548 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-06-12T17:42:32.550 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-06-12T17:42:33.070 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-06-12T17:42:33.549 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-06-12T17:42:33.588 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:33 +0000 (0:00:01.613) 0:02:18.658 *********** 2020-06-12T17:42:33.806 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-06-12T17:42:33.839 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:33 +0000 (0:00:00.251) 0:02:18.909 *********** 2020-06-12T17:42:34.344 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-06-12T17:42:34.345 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-06-12T17:42:34.811 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-06-12T17:42:35.286 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-06-12T17:42:35.320 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:35 +0000 (0:00:01.481) 0:02:20.391 *********** 2020-06-12T17:42:35.363 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:35.401 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:35 +0000 (0:00:00.081) 0:02:20.472 *********** 2020-06-12T17:42:35.444 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-06-12T17:42:35.450 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-06-12T17:42:35.485 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:35 +0000 (0:00:00.082) 0:02:20.555 *********** 2020-06-12T17:42:35.710 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-06-12T17:42:35.712 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-06-12T17:42:35.747 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:35 +0000 (0:00:00.262) 0:02:20.817 *********** 2020-06-12T17:42:35.799 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-06-12T17:42:35.801 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-06-12T17:42:35.810 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-06-12T17:42:35.821 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-06-12T17:42:35.832 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-06-12T17:42:35.868 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:35 +0000 (0:00:00.121) 0:02:20.938 *********** 2020-06-12T17:42:37.550 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-06-12T17:42:37.552 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: smartmontools", "Installed: smartmontools-1:7.1-7.el8.x86_64", "Removed: smartmontools-1:6.6-3.el8.x86_64"]} 2020-06-12T17:42:37.586 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:37 +0000 (0:00:01.717) 0:02:22.656 *********** 2020-06-12T17:42:38.147 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-06-12T17:42:38.149 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-06-12T17:42:38.732 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-06-12T17:42:39.289 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-06-12T17:42:39.325 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:39 +0000 (0:00:01.739) 0:02:24.395 *********** 2020-06-12T17:42:39.550 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-06-12T17:42:39.552 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-06-12T17:42:39.584 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:39 +0000 (0:00:00.258) 0:02:24.654 *********** 2020-06-12T17:42:40.115 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-06-12T17:42:40.117 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-06-12T17:42:40.596 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-06-12T17:42:41.098 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-06-12T17:42:41.135 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:41 +0000 (0:00:01.551) 0:02:26.205 *********** 2020-06-12T17:42:41.180 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:41.219 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:41 +0000 (0:00:00.083) 0:02:26.289 *********** 2020-06-12T17:42:41.269 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-06-12T17:42:41.271 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-06-12T17:42:41.305 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:41 +0000 (0:00:00.086) 0:02:26.376 *********** 2020-06-12T17:42:42.549 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-06-12T17:42:42.551 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-06-12T17:42:42.583 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:42 +0000 (0:00:01.277) 0:02:27.653 *********** 2020-06-12T17:42:42.649 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi038.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-06-12T17:42:42.658 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-06-12T17:42:42.669 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-06-12T17:42:42.706 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:42 +0000 (0:00:00.123) 0:02:27.777 *********** 2020-06-12T17:42:42.716 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-06-12T17:42:42.717 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load", "Installed: nagios-plugins-2.3.3-3.el8.x86_64", "Installed: nagios-plugins-load-2.3.3-3.el8.x86_64", "Installed: nrpe-4.0.3-1.el8.x86_64", "Removed: nrpe-4.0.2-2.el8.x86_64", "Removed: nagios-plugins-2.3.3-1.el8.x86_64", "Removed: nagios-plugins-load-2.3.3-1.el8.x86_64"]} 2020-06-12T17:42:42.753 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:42 +0000 (0:00:00.047) 0:02:27.824 *********** 2020-06-12T17:42:42.805 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:42.836 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:42 +0000 (0:00:00.083) 0:02:27.907 *********** 2020-06-12T17:42:43.362 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-06-12T17:42:43.395 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:43 +0000 (0:00:00.558) 0:02:28.466 *********** 2020-06-12T17:42:43.397 INFO:teuthology.task.ansible.out: 2020-06-12T17:42:43.895 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-06-12T17:42:43.897 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-06-12T17:42:43.965 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:43 +0000 (0:00:00.570) 0:02:29.036 *********** 2020-06-12T17:42:44.006 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-06-12T17:42:44.008 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2020-06-12T17:42:44.022 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-06-12T17:42:44.059 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:44 +0000 (0:00:00.094) 0:02:29.130 *********** 2020-06-12T17:42:44.295 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-06-12T17:42:44.297 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-12T17:42:44.342 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:44 +0000 (0:00:00.282) 0:02:29.413 *********** 2020-06-12T17:42:44.611 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-06-12T17:42:44.613 INFO:teuthology.task.ansible.out:fatal: [smithi150.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-06-12T17:42:44.646 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:44 +0000 (0:00:00.303) 0:02:29.716 *********** 2020-06-12T17:42:44.687 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-06-12T17:42:44.689 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:44.721 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:44 +0000 (0:00:00.074) 0:02:29.791 *********** 2020-06-12T17:42:45.257 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-06-12T17:42:45.259 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-06-12T17:42:45.295 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:45 +0000 (0:00:00.573) 0:02:30.365 *********** 2020-06-12T17:42:46.127 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-06-12 17:42:39 UTC", "ActiveEnterTimestampMonotonic": "218538708", "ActiveExitTimestamp": "Fri 2020-06-12 17:42:39 UTC", "ActiveExitTimestampMonotonic": "218517171", "ActiveState": "active", "After": "local-fs.target var-run.mount network.target basic.target time-sync.target nss-lookup.target systemd-tmpfiles-setup.service -.mount tmp.mount systemd-journald.socket system.slice sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-06-12 17:42:39 UTC", "AssertTimestampMonotonic": "218537496", "Before": "shutdown.target plymouth-quit.service multi-user.target xdm.service getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-06-12 17:42:39 UTC", "ConditionTimestampMonotonic": "218537496", 2020-06-12T17:42:46.130 INFO:teuthology.task.ansible.out:"ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "17409", "ExecMainStartTimestamp": "Fri 2020-06-12 17:42:39 UTC", "ExecMainStartTimestampMonotonic": "218538676", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2020-06-12 17:42:39 UTC", "InactiveEnterTimestampMonotonic": "218536663", "InactiveExitTimestamp": "Fri 2020-06-12 17:42:39 UTC", "InactiveExitTimestampMonotonic": "218538708", "InvocationID": "dfe46a7271cc46a5afeb026b0feae74b", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control 2020-06-12T17:42:46.132 INFO:teuthology.task.ansible.out:-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127425", "LimitNPROCSoft": "127425", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127425", "LimitSIGPENDINGSoft": "127425", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "17409", "MemoryAccounting": "yes", "MemoryCurrent": "884736", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tm 2020-06-12T17:42:46.134 INFO:teuthology.task.ansible.out:p /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-06-12 17:42:39 UTC", "StateChangeTimestampMonotonic": "218538708", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-06-12 17:42:39 UTC", "WatchdogTimestampMonotonic": "218538707", "WatchdogUSec": "0"}} 2020-06-12T17:42:46.173 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:46 +0000 (0:00:00.875) 0:02:31.241 *********** 2020-06-12T17:42:46.383 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-06-12T17:42:46.386 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001745", "end": "2020-06-12 17:42:46.353348", "rc": 0, "start": "2020-06-12 17:42:46.351603", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-06-12T17:42:46.424 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:46 +0000 (0:00:00.253) 0:02:31.494 *********** 2020-06-12T17:42:48.579 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-06-12T17:42:48.582 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-06-12T17:42:48.624 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:48 +0000 (0:00:02.194) 0:02:33.688 *********** 2020-06-12T17:42:50.670 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load", "Installed: nagios-plugins-2.3.3-3.el8.x86_64", "Installed: nagios-plugins-load-2.3.3-3.el8.x86_64", "Installed: nrpe-4.0.3-1.el8.x86_64", "Removed: nrpe-4.0.2-2.el8.x86_64", "Removed: nagios-plugins-2.3.3-1.el8.x86_64", "Removed: nagios-plugins-load-2.3.3-1.el8.x86_64"]} 2020-06-12T17:42:50.719 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:50 +0000 (0:00:02.101) 0:02:35.790 *********** 2020-06-12T17:42:50.762 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-06-12T17:42:50.764 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:50.808 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:50 +0000 (0:00:00.088) 0:02:35.878 *********** 2020-06-12T17:42:51.357 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-06-12T17:42:51.359 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-06-12T17:42:51.413 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:51 +0000 (0:00:00.604) 0:02:36.483 *********** 2020-06-12T17:42:51.951 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-06-12T17:42:51.953 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-06-12T17:42:51.987 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:51 +0000 (0:00:00.574) 0:02:37.058 *********** 2020-06-12T17:42:52.028 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-06-12T17:42:52.030 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2020-06-12T17:42:52.039 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-06-12T17:42:52.076 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:52 +0000 (0:00:00.088) 0:02:37.146 *********** 2020-06-12T17:42:52.307 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* ok: [smithi038.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-12T17:42:52.356 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:52 +0000 (0:00:00.280) 0:02:37.427 *********** 2020-06-12T17:42:52.636 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-06-12T17:42:52.638 INFO:teuthology.task.ansible.out:fatal: [smithi038.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-06-12T17:42:52.670 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:52 +0000 (0:00:00.313) 0:02:37.740 *********** 2020-06-12T17:42:52.711 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:42:52.744 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:52 +0000 (0:00:00.074) 0:02:37.815 *********** 2020-06-12T17:42:53.273 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-06-12T17:42:53.275 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-06-12T17:42:53.309 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:53 +0000 (0:00:00.565) 0:02:38.380 *********** 2020-06-12T17:42:53.647 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-06-12T17:42:53.648 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-06-12 17:42:47 UTC", "ActiveEnterTimestampMonotonic": "259196935", "ActiveExitTimestamp": "Fri 2020-06-12 17:42:47 UTC", "ActiveExitTimestampMonotonic": "259171282", "ActiveState": "active", "After": "local-fs.target var-run.mount network.target system.slice tmp.mount -.mount nss-lookup.target time-sync.target systemd-journald.socket sysinit.target basic.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-06-12 17:42:47 UTC", "AssertTimestampMonotonic": "259196196", "Before": "shutdown.target multi-user.target plymouth-quit.service xdm.service getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-06-12 17:42:47 UTC", "ConditionTimestampMonotonic": "259196195", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "C 2020-06-12T17:42:53.651 INFO:teuthology.task.ansible.out:ontrolGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "17481", "ExecMainStartTimestamp": "Fri 2020-06-12 17:42:47 UTC", "ExecMainStartTimestampMonotonic": "259196909", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2020-06-12 17:42:47 UTC", "InactiveEnterTimestampMonotonic": "259195383", "InactiveExitTimestamp": "Fri 2020-06-12 17:42:47 UTC", "InactiveExitTimestampMonotonic": "259196935", "InvocationID": "f3d6411046a94e42a2412a6442dbfe05", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "Limi 2020-06-12T17:42:53.659 INFO:teuthology.task.ansible.out:tCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127449", "LimitNPROCSoft": "127449", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127449", "LimitSIGPENDINGSoft": "127449", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "17481", "MemoryAccounting": "yes", "MemoryCurrent": "888832", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": " 2020-06-12T17:42:53.660 INFO:teuthology.task.ansible.out:no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-06-12 17:42:47 UTC", "StateChangeTimestampMonotonic": "259196935", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-06-12 17:42:47 UTC", "WatchdogTimestampMonotonic": "259196934", "WatchdogUSec": "0"}} 2020-06-12T17:42:53.682 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:53 +0000 (0:00:00.371) 0:02:38.752 *********** 2020-06-12T17:42:53.900 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-06-12T17:42:53.902 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001705", "end": "2020-06-12 17:42:53.871901", "rc": 0, "start": "2020-06-12 17:42:53.870196", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-06-12T17:42:53.946 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:53 +0000 (0:00:00.261) 0:02:39.013 *********** 2020-06-12T17:42:56.256 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-06-12T17:42:56.260 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-06-12T17:42:56.292 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:42:56 +0000 (0:00:02.349) 0:02:41.363 *********** 2020-06-12T17:43:29.922 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-06-12T17:43:29.925 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted", "Installed: selinux-policy-3.14.3-41.el8_2.4.noarch", "Installed: selinux-policy-targeted-3.14.3-41.el8_2.4.noarch", "Removed: selinux-policy-3.14.3-41.el8_2.2.noarch", "Removed: selinux-policy-targeted-3.14.3-41.el8_2.2.noarch"]} 2020-06-12T17:43:29.962 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:43:29 +0000 (0:00:33.669) 0:03:15.032 *********** 2020-06-12T17:43:30.809 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-06-12T17:43:30.811 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-06-12T17:43:30.843 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:43:30 +0000 (0:00:00.881) 0:03:15.914 *********** 2020-06-12T17:43:39.015 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted", "Installed: selinux-policy-3.14.3-41.el8_2.4.noarch", "Installed: selinux-policy-targeted-3.14.3-41.el8_2.4.noarch", "Removed: selinux-policy-3.14.3-41.el8_2.2.noarch", "Removed: selinux-policy-targeted-3.14.3-41.el8_2.2.noarch"]} 2020-06-12T17:43:39.056 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:43:39 +0000 (0:00:08.212) 0:03:24.126 *********** 2020-06-12T17:43:39.645 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-06-12T17:43:39.678 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:43:39 +0000 (0:00:00.622) 0:03:24.749 *********** 2020-06-12T17:43:47.287 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-06-12T17:43:47.289 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.225667", "end": "2020-06-12 17:43:47.255428", "failed_when_result": false, "rc": 0, "start": "2020-06-12 17:43:31.029761", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-06-12T17:43:47.326 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:43:47 +0000 (0:00:07.647) 0:03:32.396 *********** 2020-06-12T17:43:47.864 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-06-12T17:43:47.903 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:43:47 +0000 (0:00:00.577) 0:03:32.974 *********** 2020-06-12T17:43:48.120 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-06-12T17:43:48.122 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.010905", "end": "2020-06-12 17:43:48.096489", "rc": 0, "start": "2020-06-12 17:43:48.085584", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T17:43:48.160 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:43:48 +0000 (0:00:00.254) 0:03:33.228 *********** 2020-06-12T17:43:48.391 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-06-12T17:43:48.393 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.010472", "end": "2020-06-12 17:43:48.356153", "rc": 0, "start": "2020-06-12 17:43:48.345681", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T17:43:48.434 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:43:48 +0000 (0:00:00.276) 0:03:33.505 *********** 2020-06-12T17:43:56.688 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-06-12T17:43:56.690 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.790896", "end": "2020-06-12 17:43:56.662247", "failed_when_result": false, "rc": 0, "start": "2020-06-12 17:43:39.871351", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-06-12T17:43:56.740 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:43:56 +0000 (0:00:08.305) 0:03:41.810 *********** 2020-06-12T17:43:57.298 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-06-12T17:43:57.300 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-06-12T17:43:57.335 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:43:57 +0000 (0:00:00.594) 0:03:42.405 *********** 2020-06-12T17:43:57.567 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-06-12T17:43:57.569 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.013007", "end": "2020-06-12 17:43:57.539874", "rc": 0, "start": "2020-06-12 17:43:57.526867", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T17:43:57.625 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:43:57 +0000 (0:00:00.289) 0:03:42.695 *********** 2020-06-12T17:43:57.853 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-06-12T17:43:57.855 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.011983", "end": "2020-06-12 17:43:57.828962", "rc": 0, "start": "2020-06-12 17:43:57.816979", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T17:43:57.887 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:43:57 +0000 (0:00:00.262) 0:03:42.957 *********** 2020-06-12T17:44:04.848 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-06-12T17:44:04.850 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.193864", "end": "2020-06-12 17:44:04.820845", "rc": 0, "start": "2020-06-12 17:43:48.626981", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T17:44:04.884 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:04 +0000 (0:00:06.996) 0:03:49.954 *********** 2020-06-12T17:44:05.105 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-06-12T17:44:05.107 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-06-12T17:44:05.139 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:05 +0000 (0:00:00.255) 0:03:50.209 *********** 2020-06-12T17:44:05.178 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-06-12T17:44:05.180 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-06-12T17:44:05.214 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:05 +0000 (0:00:00.075) 0:03:50.285 *********** 2020-06-12T17:44:05.264 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-06-12T17:44:05.266 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-06-12T17:44:05.302 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:05 +0000 (0:00:00.087) 0:03:50.373 *********** 2020-06-12T17:44:05.346 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-06-12T17:44:05.348 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "podman-docker", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2020-06-12T17:44:05.383 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:05 +0000 (0:00:00.081) 0:03:50.454 *********** 2020-06-12T17:44:05.443 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-06-12T17:44:05.445 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-06-12T17:44:05.478 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:05 +0000 (0:00:00.094) 0:03:50.548 *********** 2020-06-12T17:44:05.684 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-06-12T17:44:05.686 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-06-12T17:44:05.729 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:05 +0000 (0:00:00.251) 0:03:50.800 *********** 2020-06-12T17:44:05.938 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2020-06-12T17:44:05.986 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:05 +0000 (0:00:00.245) 0:03:51.045 *********** 2020-06-12T17:44:06.016 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:06.045 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:06 +0000 (0:00:00.070) 0:03:51.115 *********** 2020-06-12T17:44:06.075 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-06-12T17:44:06.077 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:06.111 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:06 +0000 (0:00:00.066) 0:03:51.181 *********** 2020-06-12T17:44:06.341 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-06-12T17:44:06.342 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-06-12T17:44:06.378 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:06 +0000 (0:00:00.267) 0:03:51.449 *********** 2020-06-12T17:44:06.956 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-06-12T17:44:07.003 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:07 +0000 (0:00:00.624) 0:03:52.073 *********** 2020-06-12T17:44:07.058 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-06-12T17:44:07.060 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi150"}, "changed": false} 2020-06-12T17:44:07.103 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:07 +0000 (0:00:00.100) 0:03:52.174 *********** 2020-06-12T17:44:08.232 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-06-12T17:44:08.234 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi150", "ansible_hostname": "smithi150", "ansible_nodename": "smithi150"}, "changed": false, "name": "smithi150"} 2020-06-12T17:44:08.282 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:08 +0000 (0:00:01.178) 0:03:53.353 *********** 2020-06-12T17:44:08.780 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-06-12T17:44:08.782 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-06-12T17:44:08.816 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:08 +0000 (0:00:00.533) 0:03:53.886 *********** 2020-06-12T17:44:09.329 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-06-12T17:44:09.331 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-06-12T17:44:09.370 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:09 +0000 (0:00:00.554) 0:03:54.441 *********** 2020-06-12T17:44:10.052 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-06-12T17:44:10.054 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-06-12T17:44:10.087 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:10 +0000 (0:00:00.716) 0:03:55.158 *********** 2020-06-12T17:44:10.621 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-06-12T17:44:10.622 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-06-12T17:44:10.668 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:10 +0000 (0:00:00.580) 0:03:55.738 *********** 2020-06-12T17:44:10.886 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-06-12T17:44:10.888 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-06-12T17:44:10.926 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:10 +0000 (0:00:00.253) 0:03:55.992 *********** 2020-06-12T17:44:11.142 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-06-12T17:44:11.144 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-06-12T17:44:11.177 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:11 +0000 (0:00:00.255) 0:03:56.248 *********** 2020-06-12T17:44:11.414 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-06-12T17:44:11.415 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-06-12T17:44:11.458 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:11 +0000 (0:00:00.280) 0:03:56.528 *********** 2020-06-12T17:44:11.969 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-06-12T17:44:12.024 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:12 +0000 (0:00:00.566) 0:03:57.094 *********** 2020-06-12T17:44:12.541 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-06-12T17:44:12.573 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:12 +0000 (0:00:00.549) 0:03:57.643 *********** 2020-06-12T17:44:14.437 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-06-12T17:44:14.439 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.650890", "end": "2020-06-12 17:44:14.407424", "rc": 0, "start": "2020-06-12 17:44:12.756534", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T17:44:14.472 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:14 +0000 (0:00:01.898) 0:03:59.542 *********** 2020-06-12T17:44:14.514 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-06-12T17:44:14.516 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:14.556 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:14 +0000 (0:00:00.083) 0:03:59.626 *********** 2020-06-12T17:44:14.961 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-06-12T17:44:14.963 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.854022", "end": "2020-06-12 17:44:14.930418", "rc": 0, "start": "2020-06-12 17:43:58.076396", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T17:44:14.995 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:14 +0000 (0:00:00.439) 0:04:00.065 *********** 2020-06-12T17:44:15.100 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-06-12T17:44:15.102 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-06-12T17:44:15.140 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:15 +0000 (0:00:00.144) 0:04:00.210 *********** 2020-06-12T17:44:15.169 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-06-12T17:44:15.202 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:15 +0000 (0:00:00.062) 0:04:00.272 *********** 2020-06-12T17:44:15.235 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-06-12T17:44:15.237 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-06-12T17:44:15.272 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:15 +0000 (0:00:00.069) 0:04:00.342 *********** 2020-06-12T17:44:15.312 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-06-12T17:44:15.314 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-06-12T17:44:15.352 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:15 +0000 (0:00:00.080) 0:04:00.423 *********** 2020-06-12T17:44:15.406 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-06-12T17:44:15.408 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-06-12T17:44:15.454 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:15 +0000 (0:00:00.092) 0:04:00.516 *********** 2020-06-12T17:44:15.503 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-06-12T17:44:15.505 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "podman-docker", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2020-06-12T17:44:15.541 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:15 +0000 (0:00:00.095) 0:04:00.611 *********** 2020-06-12T17:44:15.596 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi038.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-06-12T17:44:15.632 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:15 +0000 (0:00:00.091) 0:04:00.703 *********** 2020-06-12T17:44:15.865 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-06-12T17:44:15.897 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:15 +0000 (0:00:00.264) 0:04:00.968 *********** 2020-06-12T17:44:16.124 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2020-06-12T17:44:16.161 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:16 +0000 (0:00:00.263) 0:04:01.232 *********** 2020-06-12T17:44:16.198 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:16.224 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:16 +0000 (0:00:00.062) 0:04:01.294 *********** 2020-06-12T17:44:16.253 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-06-12T17:44:16.254 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:16.291 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:16 +0000 (0:00:00.066) 0:04:01.361 *********** 2020-06-12T17:44:16.302 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-06-12T17:44:16.304 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.843983", "end": "2020-06-12 17:44:16.243601", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-06-12 17:44:15.399618", "stderr": "", "stderr_lines": [], "stdout": "Updating Subscription Management repositories.\nRepository successfully enabled.", "stdout_lines": ["Updating Subscription Management repositories.", "Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2020-06-12T17:44:16.304 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-06-12T17:44:16.339 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:16 +0000 (0:00:00.048) 0:04:01.410 *********** 2020-06-12T17:44:16.379 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-06-12T17:44:16.381 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:16.413 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:16 +0000 (0:00:00.074) 0:04:01.484 *********** 2020-06-12T17:44:16.478 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-06-12T17:44:16.481 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-06-12T17:44:16.515 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:16 +0000 (0:00:00.099) 0:04:01.584 *********** 2020-06-12T17:44:16.532 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-06-12T17:44:16.534 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-06-12T17:44:16.566 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:16 +0000 (0:00:00.053) 0:04:01.637 *********** 2020-06-12T17:44:16.576 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-06-12T17:44:16.578 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:16.611 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:16 +0000 (0:00:00.044) 0:04:01.682 *********** 2020-06-12T17:44:16.643 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-12T17:44:16.644 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:16.681 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:16 +0000 (0:00:00.069) 0:04:01.752 *********** 2020-06-12T17:44:16.721 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-06-12T17:44:16.723 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:16.754 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:16 +0000 (0:00:00.072) 0:04:01.825 *********** 2020-06-12T17:44:16.795 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:16.836 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:16 +0000 (0:00:00.081) 0:04:01.906 *********** 2020-06-12T17:44:17.056 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* fatal: [smithi150.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006605", "end": "2020-06-12 17:44:17.033480", "msg": "non-zero return code", "rc": 1, "start": "2020-06-12 17:44:17.026875", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-06-12T17:44:17.094 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:17 +0000 (0:00:00.258) 0:04:02.165 *********** 2020-06-12T17:44:17.136 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:17.169 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:17 +0000 (0:00:00.075) 0:04:02.240 *********** 2020-06-12T17:44:17.180 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-06-12T17:44:17.182 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-06-12T17:44:17.215 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:17 +0000 (0:00:00.045) 0:04:02.285 *********** 2020-06-12T17:44:17.256 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi038"}, "changed": false} 2020-06-12T17:44:17.289 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:17 +0000 (0:00:00.073) 0:04:02.359 *********** 2020-06-12T17:44:17.901 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-06-12T17:44:17.909 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi038", "ansible_hostname": "smithi038", "ansible_nodename": "smithi038"}, "changed": false, "name": "smithi038"} 2020-06-12T17:44:17.936 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:17 +0000 (0:00:00.647) 0:04:03.006 *********** 2020-06-12T17:44:18.450 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-06-12T17:44:18.486 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:18 +0000 (0:00:00.550) 0:04:03.556 *********** 2020-06-12T17:44:19.032 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-06-12T17:44:19.034 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-06-12T17:44:19.070 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:19 +0000 (0:00:00.584) 0:04:04.141 *********** 2020-06-12T17:44:19.768 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-06-12T17:44:19.769 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-06-12T17:44:19.803 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:19 +0000 (0:00:00.732) 0:04:04.873 *********** 2020-06-12T17:44:20.348 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-06-12T17:44:20.350 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-06-12T17:44:20.381 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:20 +0000 (0:00:00.578) 0:04:05.452 *********** 2020-06-12T17:44:20.606 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-06-12T17:44:20.608 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-06-12T17:44:20.645 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:20 +0000 (0:00:00.263) 0:04:05.715 *********** 2020-06-12T17:44:20.867 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-06-12T17:44:20.869 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-06-12T17:44:20.902 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:20 +0000 (0:00:00.256) 0:04:05.972 *********** 2020-06-12T17:44:21.148 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-06-12T17:44:21.150 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-06-12T17:44:21.188 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:21 +0000 (0:00:00.286) 0:04:06.258 *********** 2020-06-12T17:44:21.722 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-06-12T17:44:21.724 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-06-12T17:44:21.758 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:21 +0000 (0:00:00.570) 0:04:06.828 *********** 2020-06-12T17:44:22.294 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-06-12T17:44:22.333 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:22 +0000 (0:00:00.574) 0:04:07.403 *********** 2020-06-12T17:44:22.973 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-06-12T17:44:22.975 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-99.module+el8.2.0+5827+8c39933c.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-06-12T17:44:23.018 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:23 +0000 (0:00:00.681) 0:04:08.085 *********** 2020-06-12T17:44:24.622 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-06-12T17:44:24.624 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.068827", "end": "2020-06-12 17:44:24.590622", "rc": 0, "start": "2020-06-12 17:44:22.521795", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T17:44:24.666 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:24 +0000 (0:00:01.651) 0:04:09.737 *********** 2020-06-12T17:44:24.713 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:24.752 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:24 +0000 (0:00:00.085) 0:04:09.823 *********** 2020-06-12T17:44:25.321 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-06-12T17:44:25.324 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-06-12T17:44:25.364 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:25 +0000 (0:00:00.611) 0:04:10.434 *********** 2020-06-12T17:44:25.394 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-06-12T17:44:25.436 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:25 +0000 (0:00:00.072) 0:04:10.506 *********** 2020-06-12T17:44:26.553 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-06-12T17:44:26.558 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.861722", "end": "2020-06-12 17:44:26.518470", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-06-12 17:44:25.656748", "stderr": "", "stderr_lines": [], "stdout": "Updating Subscription Management repositories.\nRepository successfully enabled.", "stdout_lines": ["Updating Subscription Management repositories.", "Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2020-06-12T17:44:26.587 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:26 +0000 (0:00:01.150) 0:04:11.657 *********** 2020-06-12T17:44:26.626 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-06-12T17:44:26.628 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:26.660 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:26 +0000 (0:00:00.073) 0:04:11.731 *********** 2020-06-12T17:44:26.706 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-06-12T17:44:26.708 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-06-12T17:44:26.717 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-06-12T17:44:26.756 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:26 +0000 (0:00:00.094) 0:04:11.826 *********** 2020-06-12T17:44:26.796 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-06-12T17:44:26.798 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:26.840 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:26 +0000 (0:00:00.082) 0:04:11.908 *********** 2020-06-12T17:44:26.867 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-12T17:44:26.869 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:26.904 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:26 +0000 (0:00:00.065) 0:04:11.974 *********** 2020-06-12T17:44:26.944 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-06-12T17:44:26.950 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:26.978 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:26 +0000 (0:00:00.074) 0:04:12.048 *********** 2020-06-12T17:44:27.018 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-06-12T17:44:27.019 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:27.053 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:27 +0000 (0:00:00.073) 0:04:12.122 *********** 2020-06-12T17:44:27.290 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* fatal: [smithi038.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006983", "end": "2020-06-12 17:44:27.264805", "msg": "non-zero return code", "rc": 1, "start": "2020-06-12 17:44:27.257822", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-06-12T17:44:27.334 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:27 +0000 (0:00:00.282) 0:04:12.404 *********** 2020-06-12T17:44:27.373 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-06-12T17:44:27.375 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:27.407 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:27 +0000 (0:00:00.072) 0:04:12.477 *********** 2020-06-12T17:44:28.334 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-06-12T17:44:28.336 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-7.el8.x86_64", "Removed: boost-random-1.66.0-7.el8.x86_64"]} 2020-06-12T17:44:28.372 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:28 +0000 (0:00:00.965) 0:04:13.443 *********** 2020-06-12T17:44:33.353 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-06-12T17:44:33.356 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-99.module+el8.2.0+5827+8c39933c.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-06-12T17:44:33.389 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:33 +0000 (0:00:05.016) 0:04:18.459 *********** 2020-06-12T17:44:37.781 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: git-all", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: podman", "Installed: podman-docker", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: podman-docker-1.6.4-12.module+el8.2.0+6669+dde598ec.noarch", "Installed: qemu-kvm-block-rbd-15:2.12.0-99.module+el8.2.0+5827+8c39933c.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: boost-program-options-1.66.0-7.el8.x86_64", "Installed: boost-random-1.66.0-7.el8.x86_64", "Installed: podman-1.6.4-12.module+el8.2.0+6669+dde598ec.x86_64", "Removed: podman-docker-1.6.4-11.module+el8.2.0+6368+cf16aa14.noarch", "Removed: podman-1.6.4-11.module+el8.2.0+6368+cf16aa14.x86_64"]} 2020-06-12T17:44:37.821 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:37 +0000 (0:00:04.432) 0:04:22.892 *********** 2020-06-12T17:44:38.949 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-06-12T17:44:38.951 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-7.el8.x86_64", "Removed: boost-random-1.66.0-7.el8.x86_64"]} 2020-06-12T17:44:38.983 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:38 +0000 (0:00:01.161) 0:04:24.054 *********** 2020-06-12T17:44:40.011 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-06-12T17:44:40.013 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: dbench"]} 2020-06-12T17:44:40.049 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:40 +0000 (0:00:01.065) 0:04:25.120 *********** 2020-06-12T17:44:42.236 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-06-12T17:44:42.237 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-06-12T17:44:42.271 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:42 +0000 (0:00:02.222) 0:04:27.342 *********** 2020-06-12T17:44:42.312 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-06-12T17:44:42.314 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:42.346 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:42 +0000 (0:00:00.074) 0:04:27.417 *********** 2020-06-12T17:44:42.691 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-06-12T17:44:42.692 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice dbus.socket dbus.service basic.target sysinit.target polkit.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ip6tables.service ebtables.service ipset.service shutdown.target iptables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-06-12T17:44:42.694 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127425", "LimitNPROCSoft": "127425", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127425", 2020-06-12T17:44:42.697 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127425", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice dbus.socket sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-06-12T17:44:42.702 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-06-12T17:44:42.728 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:42 +0000 (0:00:00.382) 0:04:27.799 *********** 2020-06-12T17:44:43.049 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-06-12T17:44:43.050 INFO:teuthology.task.ansible.out:fatal: [smithi150.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-06-12T17:44:43.088 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:43 +0000 (0:00:00.358) 0:04:28.157 *********** 2020-06-12T17:44:43.874 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-06-12T17:44:43.915 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:43 +0000 (0:00:00.828) 0:04:28.986 *********** 2020-06-12T17:44:43.946 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-06-12T17:44:43.947 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:43.983 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:43 +0000 (0:00:00.068) 0:04:29.054 *********** 2020-06-12T17:44:44.014 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-06-12T17:44:44.015 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:44.053 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:44 +0000 (0:00:00.070) 0:04:29.124 *********** 2020-06-12T17:44:44.099 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-06-12T17:44:44.102 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:44.146 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:44 +0000 (0:00:00.093) 0:04:29.217 *********** 2020-06-12T17:44:44.197 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:44.230 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:44 +0000 (0:00:00.083) 0:04:29.300 *********** 2020-06-12T17:44:44.281 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-06-12T17:44:44.283 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:44.326 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:44 +0000 (0:00:00.096) 0:04:29.397 *********** 2020-06-12T17:44:44.358 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-06-12T17:44:44.362 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:44.393 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:44 +0000 (0:00:00.067) 0:04:29.464 *********** 2020-06-12T17:44:44.424 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-06-12T17:44:44.466 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:44 +0000 (0:00:00.072) 0:04:29.537 *********** 2020-06-12T17:44:44.496 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-06-12T17:44:44.497 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:44.534 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:44 +0000 (0:00:00.067) 0:04:29.604 *********** 2020-06-12T17:44:44.582 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-06-12T17:44:44.584 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:44.627 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:44 +0000 (0:00:00.092) 0:04:29.697 *********** 2020-06-12T17:44:44.668 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-06-12T17:44:44.670 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-06-12T17:44:44.679 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-06-12T17:44:44.718 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:44 +0000 (0:00:00.091) 0:04:29.788 *********** 2020-06-12T17:44:44.747 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-06-12T17:44:44.749 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:44.783 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:44 +0000 (0:00:00.065) 0:04:29.853 *********** 2020-06-12T17:44:44.785 INFO:teuthology.task.ansible.out: 2020-06-12T17:44:44.824 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-06-12T17:44:44.859 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:44 +0000 (0:00:00.076) 0:04:29.930 *********** 2020-06-12T17:44:44.895 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-06-12T17:44:44.897 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:44.938 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:44 +0000 (0:00:00.078) 0:04:30.008 *********** 2020-06-12T17:44:44.978 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-06-12T17:44:44.980 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:45.025 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:45 +0000 (0:00:00.087) 0:04:30.095 *********** 2020-06-12T17:44:45.069 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-06-12T17:44:45.070 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:45.115 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:45 +0000 (0:00:00.090) 0:04:30.186 *********** 2020-06-12T17:44:45.179 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-06-12T17:44:45.181 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:45.225 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:45 +0000 (0:00:00.109) 0:04:30.295 *********** 2020-06-12T17:44:45.267 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-06-12T17:44:45.269 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:45.304 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:45 +0000 (0:00:00.079) 0:04:30.375 *********** 2020-06-12T17:44:45.340 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-06-12T17:44:45.342 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:45.375 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:45 +0000 (0:00:00.070) 0:04:30.445 *********** 2020-06-12T17:44:45.415 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-06-12T17:44:45.417 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:45.450 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:45 +0000 (0:00:00.075) 0:04:30.520 *********** 2020-06-12T17:44:45.480 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-06-12T17:44:45.482 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:45.519 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:45 +0000 (0:00:00.069) 0:04:30.590 *********** 2020-06-12T17:44:45.559 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:45.605 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:45 +0000 (0:00:00.086) 0:04:30.676 *********** 2020-06-12T17:44:45.634 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-06-12T17:44:45.636 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:45.667 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:45 +0000 (0:00:00.062) 0:04:30.738 *********** 2020-06-12T17:44:45.707 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-06-12T17:44:45.709 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:45.752 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:45 +0000 (0:00:00.084) 0:04:30.822 *********** 2020-06-12T17:44:45.791 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-06-12T17:44:45.793 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:45.824 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:45 +0000 (0:00:00.072) 0:04:30.895 *********** 2020-06-12T17:44:45.867 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:45.899 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:45 +0000 (0:00:00.074) 0:04:30.969 *********** 2020-06-12T17:44:45.941 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-06-12T17:44:45.942 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:45.975 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:45 +0000 (0:00:00.076) 0:04:31.046 *********** 2020-06-12T17:44:46.006 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-06-12T17:44:46.008 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:46.042 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:46 +0000 (0:00:00.066) 0:04:31.112 *********** 2020-06-12T17:44:46.071 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-06-12T17:44:46.073 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:46.104 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:46 +0000 (0:00:00.062) 0:04:31.175 *********** 2020-06-12T17:44:46.144 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-06-12T17:44:46.146 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:46.178 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:46 +0000 (0:00:00.072) 0:04:31.247 *********** 2020-06-12T17:44:46.217 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:46.251 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:46 +0000 (0:00:00.074) 0:04:31.322 *********** 2020-06-12T17:44:46.291 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-06-12T17:44:46.293 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:46.324 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:46 +0000 (0:00:00.072) 0:04:31.394 *********** 2020-06-12T17:44:46.374 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-06-12T17:44:46.376 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:46.415 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:46 +0000 (0:00:00.091) 0:04:31.485 *********** 2020-06-12T17:44:46.461 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:46.491 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:46 +0000 (0:00:00.075) 0:04:31.561 *********** 2020-06-12T17:44:46.519 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-06-12T17:44:46.522 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:46.553 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:46 +0000 (0:00:00.062) 0:04:31.624 *********** 2020-06-12T17:44:46.583 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-12T17:44:46.584 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:46.617 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:46 +0000 (0:00:00.063) 0:04:31.687 *********** 2020-06-12T17:44:46.648 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:46.679 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:46 +0000 (0:00:00.062) 0:04:31.750 *********** 2020-06-12T17:44:46.719 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-06-12T17:44:46.721 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:46.766 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:46 +0000 (0:00:00.080) 0:04:31.830 *********** 2020-06-12T17:44:46.788 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-06-12T17:44:46.790 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:46.821 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:46 +0000 (0:00:00.061) 0:04:31.892 *********** 2020-06-12T17:44:46.851 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-06-12T17:44:46.853 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:46.890 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:46 +0000 (0:00:00.068) 0:04:31.960 *********** 2020-06-12T17:44:46.919 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-06-12T17:44:46.920 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:46.952 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:46 +0000 (0:00:00.062) 0:04:32.023 *********** 2020-06-12T17:44:46.997 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-06-12T17:44:46.998 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:47.044 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:47 +0000 (0:00:00.091) 0:04:32.114 *********** 2020-06-12T17:44:47.086 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:47.134 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:47 +0000 (0:00:00.089) 0:04:32.204 *********** 2020-06-12T17:44:47.164 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:47.204 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:47 +0000 (0:00:00.070) 0:04:32.274 *********** 2020-06-12T17:44:47.245 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-06-12T17:44:47.246 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:47.282 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:47 +0000 (0:00:00.078) 0:04:32.353 *********** 2020-06-12T17:44:47.326 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:47.359 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:47 +0000 (0:00:00.077) 0:04:32.430 *********** 2020-06-12T17:44:47.399 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-06-12T17:44:47.401 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:47.434 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:47 +0000 (0:00:00.074) 0:04:32.504 *********** 2020-06-12T17:44:47.474 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-06-12T17:44:47.476 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:47.508 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:47 +0000 (0:00:00.073) 0:04:32.578 *********** 2020-06-12T17:44:47.558 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-06-12T17:44:47.560 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:47.591 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:47 +0000 (0:00:00.083) 0:04:32.662 *********** 2020-06-12T17:44:47.623 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-06-12T17:44:47.625 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:47.655 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:47 +0000 (0:00:00.063) 0:04:32.725 *********** 2020-06-12T17:44:47.684 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:47.718 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:47 +0000 (0:00:00.063) 0:04:32.789 *********** 2020-06-12T17:44:47.760 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-06-12T17:44:47.762 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:47.794 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:47 +0000 (0:00:00.076) 0:04:32.865 *********** 2020-06-12T17:44:47.828 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-06-12T17:44:47.830 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:47.861 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:47 +0000 (0:00:00.066) 0:04:32.932 *********** 2020-06-12T17:44:47.891 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-06-12T17:44:47.893 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:47.926 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:47 +0000 (0:00:00.064) 0:04:32.997 *********** 2020-06-12T17:44:47.956 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-06-12T17:44:47.960 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:47.997 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:47 +0000 (0:00:00.071) 0:04:33.068 *********** 2020-06-12T17:44:48.039 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-06-12T17:44:48.041 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:48.090 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:48 +0000 (0:00:00.092) 0:04:33.160 *********** 2020-06-12T17:44:48.119 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-06-12T17:44:48.121 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:48.154 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:48 +0000 (0:00:00.064) 0:04:33.225 *********** 2020-06-12T17:44:48.193 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-06-12T17:44:48.200 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:48.229 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:48 +0000 (0:00:00.074) 0:04:33.299 *********** 2020-06-12T17:44:48.269 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-06-12T17:44:48.271 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:48.305 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:48 +0000 (0:00:00.076) 0:04:33.376 *********** 2020-06-12T17:44:48.348 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-06-12T17:44:48.350 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:48.385 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:48 +0000 (0:00:00.079) 0:04:33.455 *********** 2020-06-12T17:44:48.425 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-06-12T17:44:48.426 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:48.461 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:48 +0000 (0:00:00.076) 0:04:33.532 *********** 2020-06-12T17:44:48.490 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-06-12T17:44:48.492 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:48.524 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:48 +0000 (0:00:00.063) 0:04:33.595 *********** 2020-06-12T17:44:48.555 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-06-12T17:44:48.557 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:48.588 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:48 +0000 (0:00:00.064) 0:04:33.659 *********** 2020-06-12T17:44:48.631 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-06-12T17:44:48.633 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:48.668 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:48 +0000 (0:00:00.079) 0:04:33.739 *********** 2020-06-12T17:44:48.710 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-06-12T17:44:48.714 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:48.743 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:48 +0000 (0:00:00.075) 0:04:33.814 *********** 2020-06-12T17:44:48.783 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-12T17:44:48.786 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-06-12T17:44:48.816 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:48 +0000 (0:00:00.072) 0:04:33.886 *********** 2020-06-12T17:44:48.870 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi150.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-06-12T17:44:48.876 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-06-12T17:44:48.887 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-06-12T17:44:48.901 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-06-12T17:44:48.903 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-06-12T17:44:48.913 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-06-12T17:44:48.925 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-06-12T17:44:48.962 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:48 +0000 (0:00:00.145) 0:04:34.032 *********** 2020-06-12T17:44:49.002 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-06-12T17:44:49.004 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: git-all", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: podman", "Installed: podman-docker", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: podman-docker-1.6.4-12.module+el8.2.0+6669+dde598ec.noarch", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-99.module+el8.2.0+5827+8c39933c.x86_64", "Installed: boost-program-options-1.66.0-7.el8.x86_64", "Installed: boost-random-1.66.0-7.el8.x86_64", "Installed: podman-1.6.4-12.module+el8.2.0+6669+dde598ec.x86_64", "Removed: podman-docker-1.6.4-11.module+el8.2.0+6368+cf16aa14.noarch", "Removed: podman-1.6.4-11.module+el8.2.0+6368+cf16aa14.x86_64"]} 2020-06-12T17:44:49.059 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:49 +0000 (0:00:00.097) 0:04:34.130 *********** 2020-06-12T17:44:49.235 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-06-12T17:44:49.237 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004081", "end": "2020-06-12 17:44:49.190907", "rc": 0, "start": "2020-06-12 17:44:49.186826", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-06-12T17:44:49.280 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:49 +0000 (0:00:00.220) 0:04:34.351 *********** 2020-06-12T17:44:49.330 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-06-12T17:44:49.332 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:49.367 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:49 +0000 (0:00:00.087) 0:04:34.438 *********** 2020-06-12T17:44:49.408 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:49.455 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:49 +0000 (0:00:00.088) 0:04:34.526 *********** 2020-06-12T17:44:49.497 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:49.529 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:49 +0000 (0:00:00.073) 0:04:34.599 *********** 2020-06-12T17:44:49.577 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-06-12T17:44:49.579 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:49.611 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:49 +0000 (0:00:00.081) 0:04:34.681 *********** 2020-06-12T17:44:51.466 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: dbench"]} 2020-06-12T17:44:51.515 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:51 +0000 (0:00:01.904) 0:04:36.586 *********** 2020-06-12T17:44:52.162 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-06-12T17:44:52.164 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-06-12T17:44:52.205 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:52 +0000 (0:00:00.690) 0:04:37.276 *********** 2020-06-12T17:44:52.256 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-06-12T17:44:52.258 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930491990016, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227170896, 'block_used': 12924212, 'inode_total': 61054976, 'inode_available': 60986774, 'inode_used': 68202, 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227170896, "block_size": 4096, "block_total": 240095108, "block_used": 12924212, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986774, "inode_total": 61054976, "inode_used": 68202, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930491990016, "size_total": 983429562368, "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}} 2020-06-12T17:44:52.295 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:52 +0000 (0:00:00.090) 0:04:37.366 *********** 2020-06-12T17:44:52.514 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-06-12T17:44:52.516 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005147", "end": "2020-06-12 17:44:52.484227", "rc": 0, "start": "2020-06-12 17:44:52.479080", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T17:44:52.548 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:52 +0000 (0:00:00.252) 0:04:37.618 *********** 2020-06-12T17:44:52.600 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi150.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930491990016, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227170896, 'block_used': 12924212, 'inode_total': 61054976, 'inode_available': 60986774, 'inode_used': 68202, 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227170896, "block_size": 4096, "block_total": 240095108, "block_used": 12924212, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986774, "inode_total": 61054976, "inode_used": 68202, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930491990016, "size_total": 983429562368, "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:52.642 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:52 +0000 (0:00:00.094) 0:04:37.713 *********** 2020-06-12T17:44:52.682 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-06-12T17:44:52.716 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:52 +0000 (0:00:00.073) 0:04:37.787 *********** 2020-06-12T17:44:53.875 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-06-12T17:44:53.877 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-06-12T17:44:53.910 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:53 +0000 (0:00:01.193) 0:04:38.981 *********** 2020-06-12T17:44:53.952 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-06-12T17:44:53.954 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:53.986 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:53 +0000 (0:00:00.076) 0:04:39.057 *********** 2020-06-12T17:44:54.197 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-06-12T17:44:54.199 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-vg4b5D63Bl5okLg8u8HuibRMfnLWOI8XsK81hg0hY9ICd00fDQTzfFbEUwAxqS9d'], 'uuids': ['6bd99c23-ed97-401f-b99a-1269bcebcfe3'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.246482", "end": "2020-06-12 17:44:54.162193", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-vg4b5D63Bl5okLg8u8HuibRMfnLWOI8XsK81hg0hY9ICd00fDQTzfFbEUwAxqS9d"], "labels": [], "masters": [], "uuids": ["6bd99c23-ed97-401f-b99a-1269bcebcfe3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 17:44:52.915711", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-12T17:44:54.341 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-06-12T17:44:54.345 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.socket system.slice basic.target polkit.service sysinit.target dbus.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target ipset.service iptables.service ip6tables.service ebtables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-06-12T17:44:54.347 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127449", "LimitNPROCSoft": "127449", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127449", 2020-06-12T17:44:54.349 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127449", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target dbus.socket", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-06-12T17:44:54.350 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-06-12T17:44:54.393 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:54 +0000 (0:00:00.406) 0:04:39.464 *********** 2020-06-12T17:44:54.395 INFO:teuthology.task.ansible.out: 2020-06-12T17:44:54.748 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi038.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-06-12T17:44:54.796 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:54 +0000 (0:00:00.402) 0:04:39.866 *********** 2020-06-12T17:44:54.797 INFO:teuthology.task.ansible.out: 2020-06-12T17:44:55.114 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-06-12T17:44:55.162 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:55 +0000 (0:00:00.366) 0:04:40.233 *********** 2020-06-12T17:44:55.165 INFO:teuthology.task.ansible.out: 2020-06-12T17:44:55.208 INFO:teuthology.task.ansible.out: 2020-06-12T17:44:55.210 INFO:teuthology.task.ansible.out:TASK [testnode : Install abrt] ************************************************* 2020-06-12T17:44:55.211 INFO:teuthology.task.ansible.out: skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:55.213 INFO:teuthology.task.ansible.out: 2020-06-12T17:44:55.262 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:55 +0000 (0:00:00.099) 0:04:40.332 *********** 2020-06-12T17:44:55.264 INFO:teuthology.task.ansible.out: 2020-06-12T17:44:55.305 INFO:teuthology.task.ansible.out: 2020-06-12T17:44:55.307 INFO:teuthology.task.ansible.out:TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:55.356 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:55 +0000 (0:00:00.094) 0:04:40.426 *********** 2020-06-12T17:44:55.386 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-06-12T17:44:55.388 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:55.420 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:55 +0000 (0:00:00.063) 0:04:40.490 *********** 2020-06-12T17:44:55.460 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-06-12T17:44:55.462 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-Ib6Kxr-QmNR-ORlw-tqa4-Romq-6ZPR-HixRHn', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300GX400BGN', 'nvme-nvme.8086-43564654363233333030475834303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_4', 'vg_nvme-lv_1', 'vg_nvme-lv_3', 'vg_nvme-lv_5', 'vg_nvme-lv_2']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.064568", "end": "2020-06-12 17:44:55.424616", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Ib6Kxr-QmNR-ORlw-tqa4-Romq-6ZPR-HixRHn", "nvme-INTEL_SSDPEDMD400G4_CVFT623300GX400BGN", "nvme-nvme.8086-43564654363233333030475834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 17:44:54.360048", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-06-12T17:44:55.464 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:55.511 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:55 +0000 (0:00:00.091) 0:04:40.582 *********** 2020-06-12T17:44:55.552 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-06-12T17:44:55.554 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:55.590 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:55 +0000 (0:00:00.079) 0:04:40.661 *********** 2020-06-12T17:44:55.631 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-06-12T17:44:55.633 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:55.665 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:55 +0000 (0:00:00.074) 0:04:40.736 *********** 2020-06-12T17:44:55.706 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-06-12T17:44:55.740 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:55 +0000 (0:00:00.074) 0:04:40.810 *********** 2020-06-12T17:44:55.783 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:55.816 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:55 +0000 (0:00:00.076) 0:04:40.886 *********** 2020-06-12T17:44:55.856 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-06-12T17:44:55.857 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:55.891 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:55 +0000 (0:00:00.075) 0:04:40.962 *********** 2020-06-12T17:44:55.935 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-06-12T17:44:55.936 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-06-12T17:44:55.948 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-06-12T17:44:55.989 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:55 +0000 (0:00:00.097) 0:04:41.059 *********** 2020-06-12T17:44:56.020 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-06-12T17:44:56.022 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:56.053 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:56 +0000 (0:00:00.064) 0:04:41.124 *********** 2020-06-12T17:44:56.083 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-06-12T17:44:56.119 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:56 +0000 (0:00:00.065) 0:04:41.189 *********** 2020-06-12T17:44:56.148 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-06-12T17:44:56.150 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:56.187 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:56 +0000 (0:00:00.068) 0:04:41.258 *********** 2020-06-12T17:44:56.227 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-06-12T17:44:56.229 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:56.261 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:56 +0000 (0:00:00.073) 0:04:41.331 *********** 2020-06-12T17:44:56.300 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-06-12T17:44:56.302 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:56.334 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:56 +0000 (0:00:00.073) 0:04:41.405 *********** 2020-06-12T17:44:56.366 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:56.403 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:56 +0000 (0:00:00.068) 0:04:41.473 *********** 2020-06-12T17:44:56.432 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:56.465 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:56 +0000 (0:00:00.062) 0:04:41.536 *********** 2020-06-12T17:44:56.506 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-06-12T17:44:56.508 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:56.539 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:56 +0000 (0:00:00.073) 0:04:41.610 *********** 2020-06-12T17:44:56.569 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-06-12T17:44:56.571 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:56.609 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:56 +0000 (0:00:00.069) 0:04:41.679 *********** 2020-06-12T17:44:56.638 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-06-12T17:44:56.640 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:56.673 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:56 +0000 (0:00:00.063) 0:04:41.743 *********** 2020-06-12T17:44:56.702 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-06-12T17:44:56.703 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:56.735 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:56 +0000 (0:00:00.062) 0:04:41.806 *********** 2020-06-12T17:44:56.755 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-06-12T17:44:56.757 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-vg4b5D63Bl5okLg8u8HuibRMfnLWOI8XlCJsT5zdOd8BcyfcSNJGcWUckB32FJD7'], 'uuids': ['229c6584-ff6a-4f73-b2e1-b1a6814d7848'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.056220", "end": "2020-06-12 17:44:56.696776", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-vg4b5D63Bl5okLg8u8HuibRMfnLWOI8XlCJsT5zdOd8BcyfcSNJGcWUckB32FJD7"], "labels": [], "masters": [], "uuids": ["229c6584-ff6a-4f73-b2e1-b1a6814d7848"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 17:44:55.640556", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-12T17:44:56.767 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-06-12T17:44:56.769 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:56.806 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:56 +0000 (0:00:00.070) 0:04:41.876 *********** 2020-06-12T17:44:56.835 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-06-12T17:44:56.836 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:56.869 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:56 +0000 (0:00:00.063) 0:04:41.939 *********** 2020-06-12T17:44:56.898 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-06-12T17:44:56.900 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:56.931 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:56 +0000 (0:00:00.062) 0:04:42.001 *********** 2020-06-12T17:44:56.960 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-06-12T17:44:56.962 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:56.994 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:56 +0000 (0:00:00.062) 0:04:42.064 *********** 2020-06-12T17:44:57.023 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-06-12T17:44:57.025 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:57.057 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:57 +0000 (0:00:00.063) 0:04:42.127 *********** 2020-06-12T17:44:57.098 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:57.129 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:57 +0000 (0:00:00.071) 0:04:42.199 *********** 2020-06-12T17:44:57.159 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:57.191 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:57 +0000 (0:00:00.062) 0:04:42.262 *********** 2020-06-12T17:44:57.220 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-06-12T17:44:57.222 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:57.253 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:57 +0000 (0:00:00.062) 0:04:42.324 *********** 2020-06-12T17:44:57.281 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-06-12T17:44:57.283 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:57.315 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:57 +0000 (0:00:00.061) 0:04:42.385 *********** 2020-06-12T17:44:57.342 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-06-12T17:44:57.344 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:57.376 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:57 +0000 (0:00:00.060) 0:04:42.446 *********** 2020-06-12T17:44:57.427 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-06-12T17:44:57.429 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:57.460 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:57 +0000 (0:00:00.084) 0:04:42.530 *********** 2020-06-12T17:44:57.500 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-06-12T17:44:57.501 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:57.537 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:57 +0000 (0:00:00.076) 0:04:42.607 *********** 2020-06-12T17:44:57.567 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-06-12T17:44:57.569 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:57.601 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:57 +0000 (0:00:00.064) 0:04:42.672 *********** 2020-06-12T17:44:57.630 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-12T17:44:57.633 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:57.664 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:57 +0000 (0:00:00.062) 0:04:42.735 *********** 2020-06-12T17:44:57.694 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-06-12T17:44:57.696 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:57.728 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:57 +0000 (0:00:00.062) 0:04:42.798 *********** 2020-06-12T17:44:57.757 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:57.792 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:57 +0000 (0:00:00.063) 0:04:42.861 *********** 2020-06-12T17:44:57.823 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-06-12T17:44:57.825 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:57.866 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:57 +0000 (0:00:00.070) 0:04:42.932 *********** 2020-06-12T17:44:57.901 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-06-12T17:44:57.903 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:57.935 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:57 +0000 (0:00:00.073) 0:04:43.005 *********** 2020-06-12T17:44:57.963 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-06-12T17:44:57.965 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:57.997 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:57 +0000 (0:00:00.062) 0:04:43.067 *********** 2020-06-12T17:44:58.007 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-06-12T17:44:58.009 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-vg4b5D63Bl5okLg8u8HuibRMfnLWOI8Xubk7eTcFQnaIu6zSeWUZ1EbGhgG5oVzJ'], 'uuids': ['9b62e31f-addf-4398-b3b1-e27b63aa58dd'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.058118", "end": "2020-06-12 17:44:57.961735", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-vg4b5D63Bl5okLg8u8HuibRMfnLWOI8Xubk7eTcFQnaIu6zSeWUZ1EbGhgG5oVzJ"], "labels": [], "masters": [], "uuids": ["9b62e31f-addf-4398-b3b1-e27b63aa58dd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 17:44:56.903617", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-12T17:44:58.041 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-06-12T17:44:58.042 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:58.074 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:58 +0000 (0:00:00.077) 0:04:43.145 *********** 2020-06-12T17:44:58.114 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:58.144 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:58 +0000 (0:00:00.069) 0:04:43.214 *********** 2020-06-12T17:44:58.173 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-06-12T17:44:58.175 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:58.208 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:58 +0000 (0:00:00.063) 0:04:43.278 *********** 2020-06-12T17:44:58.248 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-06-12T17:44:58.250 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:58.283 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:58 +0000 (0:00:00.075) 0:04:43.354 *********** 2020-06-12T17:44:58.313 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-06-12T17:44:58.314 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:58.346 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:58 +0000 (0:00:00.062) 0:04:43.416 *********** 2020-06-12T17:44:58.388 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-06-12T17:44:58.390 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:58.430 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:58 +0000 (0:00:00.084) 0:04:43.501 *********** 2020-06-12T17:44:58.469 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-06-12T17:44:58.471 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:58.501 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:58 +0000 (0:00:00.070) 0:04:43.571 *********** 2020-06-12T17:44:58.530 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-06-12T17:44:58.533 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:58.563 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:58 +0000 (0:00:00.062) 0:04:43.634 *********** 2020-06-12T17:44:58.603 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-06-12T17:44:58.605 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:58.639 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:58 +0000 (0:00:00.075) 0:04:43.709 *********** 2020-06-12T17:44:58.670 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:58.711 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:58 +0000 (0:00:00.072) 0:04:43.781 *********** 2020-06-12T17:44:58.753 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-06-12T17:44:58.755 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:58.803 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:58 +0000 (0:00:00.091) 0:04:43.873 *********** 2020-06-12T17:44:58.835 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-06-12T17:44:58.837 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:58.868 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:58 +0000 (0:00:00.065) 0:04:43.939 *********** 2020-06-12T17:44:58.898 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-06-12T17:44:58.900 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:58.932 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:58 +0000 (0:00:00.063) 0:04:44.002 *********** 2020-06-12T17:44:58.961 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-06-12T17:44:58.963 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:58.994 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:58 +0000 (0:00:00.062) 0:04:44.064 *********** 2020-06-12T17:44:59.034 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-06-12T17:44:59.046 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:59.080 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:59 +0000 (0:00:00.085) 0:04:44.150 *********** 2020-06-12T17:44:59.146 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-06-12T17:44:59.148 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:59.181 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:59 +0000 (0:00:00.100) 0:04:44.251 *********** 2020-06-12T17:44:59.220 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-06-12T17:44:59.222 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:59.256 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:59 +0000 (0:00:00.073) 0:04:44.324 *********** 2020-06-12T17:44:59.286 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:59.336 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:59 +0000 (0:00:00.081) 0:04:44.406 *********** 2020-06-12T17:44:59.349 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-06-12T17:44:59.350 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-vg4b5D63Bl5okLg8u8HuibRMfnLWOI8XmipDyzQmonFClcr1eND6Gd2cBuvM0Ijd'], 'uuids': ['3540b12c-27f9-4da3-98e4-df0b7461b2f7'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.093733", "end": "2020-06-12 17:44:59.271483", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-vg4b5D63Bl5okLg8u8HuibRMfnLWOI8XmipDyzQmonFClcr1eND6Gd2cBuvM0Ijd"], "labels": [], "masters": [], "uuids": ["3540b12c-27f9-4da3-98e4-df0b7461b2f7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 17:44:58.177750", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-12T17:44:59.351 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTME', 'wwn-0x5000c5009293e56f'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XTME', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c5009293e56f', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTME-part1', 'wwn-0x5000c5009293e56f-part1'], 'uuids': ['0dcc33de-53c3-4ea8-baab-7ca3c59fe577'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTME", "wwn-0x5000c5009293e56f"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTME-part1", "wwn-0x5000c5009293e56f-part1"], "labels": [], "masters": [], "uuids": ["0dcc33de-53c3-4ea8-baab-7ca3c59fe577"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XTME", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293e56f"}}, 2020-06-12T17:44:59.353 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-06-12T17:44:59.394 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:59.428 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:59 +0000 (0:00:00.092) 0:04:44.498 *********** 2020-06-12T17:44:59.468 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-06-12T17:44:59.470 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:59.505 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:59 +0000 (0:00:00.076) 0:04:44.575 *********** 2020-06-12T17:44:59.535 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-06-12T17:44:59.537 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:59.569 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:59 +0000 (0:00:00.064) 0:04:44.639 *********** 2020-06-12T17:44:59.599 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-06-12T17:44:59.600 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:59.632 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:59 +0000 (0:00:00.063) 0:04:44.702 *********** 2020-06-12T17:44:59.662 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:59.694 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:59 +0000 (0:00:00.062) 0:04:44.765 *********** 2020-06-12T17:44:59.723 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-06-12T17:44:59.725 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:44:59.756 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:59 +0000 (0:00:00.062) 0:04:44.827 *********** 2020-06-12T17:44:59.798 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-06-12T17:44:59.828 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:59 +0000 (0:00:00.072) 0:04:44.899 *********** 2020-06-12T17:44:59.890 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-06-12T17:44:59.892 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-06-12T17:44:59.902 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-06-12T17:44:59.913 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-06-12T17:44:59.924 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-06-12T17:44:59.925 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-06-12T17:44:59.935 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-06-12T17:44:59.946 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-06-12T17:44:59.998 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:44:59 +0000 (0:00:00.164) 0:04:45.063 *********** 2020-06-12T17:45:00.232 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-06-12T17:45:00.234 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004295", "end": "2020-06-12 17:45:00.206680", "rc": 0, "start": "2020-06-12 17:45:00.202385", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-06-12T17:45:00.276 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:00 +0000 (0:00:00.283) 0:04:45.346 *********** 2020-06-12T17:45:00.318 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-06-12T17:45:00.320 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:00.355 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:00 +0000 (0:00:00.078) 0:04:45.425 *********** 2020-06-12T17:45:00.394 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-06-12T17:45:00.396 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:00.427 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:00 +0000 (0:00:00.072) 0:04:45.497 *********** 2020-06-12T17:45:00.468 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-06-12T17:45:00.470 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:00.512 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:00 +0000 (0:00:00.085) 0:04:45.583 *********** 2020-06-12T17:45:00.553 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-06-12T17:45:00.554 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:00.603 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:00 +0000 (0:00:00.090) 0:04:45.674 *********** 2020-06-12T17:45:00.615 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-06-12T17:45:00.616 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-vg4b5D63Bl5okLg8u8HuibRMfnLWOI8Xh3G6mgnJjGMuARIDG4Gx6n8dnKOZBEdL'], 'uuids': ['a11cfe0f-4001-42ca-9b69-620f80a37795'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.063737", "end": "2020-06-12 17:45:00.553959", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-vg4b5D63Bl5okLg8u8HuibRMfnLWOI8Xh3G6mgnJjGMuARIDG4Gx6n8dnKOZBEdL"], "labels": [], "masters": [], "uuids": ["a11cfe0f-4001-42ca-9b69-620f80a37795"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 17:44:59.490222", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-12T17:45:00.669 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:00 +0000 (0:00:00.065) 0:04:45.740 *********** 2020-06-12T17:45:01.070 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-06-12T17:45:01.072 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-vg4b5D63Bl5okLg8u8HuibRMfnLWOI8XsK81hg0hY9ICd00fDQTzfFbEUwAxqS9d'], 'uuids': ['6bd99c23-ed97-401f-b99a-1269bcebcfe3'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.140981", "end": "2020-06-12 17:45:01.040235", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-vg4b5D63Bl5okLg8u8HuibRMfnLWOI8XsK81hg0hY9ICd00fDQTzfFbEUwAxqS9d"], "labels": [], "masters": [], "uuids": ["6bd99c23-ed97-401f-b99a-1269bcebcfe3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 17:45:00.899254", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138458 s, 833 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138458 s, 833 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-12T17:45:01.303 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-Ib6Kxr-QmNR-ORlw-tqa4-Romq-6ZPR-HixRHn', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300GX400BGN', 'nvme-nvme.8086-43564654363233333030475834303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_4', 'vg_nvme-lv_1', 'vg_nvme-lv_3', 'vg_nvme-lv_5', 'vg_nvme-lv_2']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.035986", "end": "2020-06-12 17:45:01.269144", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Ib6Kxr-QmNR-ORlw-tqa4-Romq-6ZPR-HixRHn", "nvme-INTEL_SSDPEDMD400G4_CVFT623300GX400BGN", "nvme-nvme.8086-43564654363233333030475834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 17:45:01.233158", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0334682 s, 3.4 GB/s", "std 2020-06-12T17:45:01.304 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0334682 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} 2020-06-12T17:45:01.646 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-vg4b5D63Bl5okLg8u8HuibRMfnLWOI8XlCJsT5zdOd8BcyfcSNJGcWUckB32FJD7'], 'uuids': ['229c6584-ff6a-4f73-b2e1-b1a6814d7848'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.144028", "end": "2020-06-12 17:45:01.617328", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-vg4b5D63Bl5okLg8u8HuibRMfnLWOI8XlCJsT5zdOd8BcyfcSNJGcWUckB32FJD7"], "labels": [], "masters": [], "uuids": ["229c6584-ff6a-4f73-b2e1-b1a6814d7848"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 17:45:01.473300", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.14142 s, 816 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.14142 s, 816 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-12T17:45:01.975 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-vg4b5D63Bl5okLg8u8HuibRMfnLWOI8Xubk7eTcFQnaIu6zSeWUZ1EbGhgG5oVzJ'], 'uuids': ['9b62e31f-addf-4398-b3b1-e27b63aa58dd'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.141200", "end": "2020-06-12 17:45:01.945191", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-vg4b5D63Bl5okLg8u8HuibRMfnLWOI8Xubk7eTcFQnaIu6zSeWUZ1EbGhgG5oVzJ"], "labels": [], "masters": [], "uuids": ["9b62e31f-addf-4398-b3b1-e27b63aa58dd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 17:45:01.803991", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.1386 s, 832 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.1386 s, 832 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-12T17:45:02.304 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-vg4b5D63Bl5okLg8u8HuibRMfnLWOI8XmipDyzQmonFClcr1eND6Gd2cBuvM0Ijd'], 'uuids': ['3540b12c-27f9-4da3-98e4-df0b7461b2f7'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.141567", "end": "2020-06-12 17:45:02.271600", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-vg4b5D63Bl5okLg8u8HuibRMfnLWOI8XmipDyzQmonFClcr1eND6Gd2cBuvM0Ijd"], "labels": [], "masters": [], "uuids": ["3540b12c-27f9-4da3-98e4-df0b7461b2f7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 17:45:02.130033", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138956 s, 830 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138956 s, 830 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-12T17:45:02.316 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTME', 'wwn-0x5000c5009293e56f'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XTME', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c5009293e56f', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTME-part1', 'wwn-0x5000c5009293e56f-part1'], 'uuids': ['0dcc33de-53c3-4ea8-baab-7ca3c59fe577'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTME", "wwn-0x5000c5009293e56f"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTME-part1", "wwn-0x5000c5009293e56f-part1"], "labels": [], "masters": [], "uuids": ["0dcc33de-53c3-4ea8-baab-7ca3c59fe577"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XTME", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293e56f"}}, 2020-06-12T17:45:02.319 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-06-12T17:45:02.645 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-vg4b5D63Bl5okLg8u8HuibRMfnLWOI8Xh3G6mgnJjGMuARIDG4Gx6n8dnKOZBEdL'], 'uuids': ['a11cfe0f-4001-42ca-9b69-620f80a37795'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.147651", "end": "2020-06-12 17:45:02.617284", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-vg4b5D63Bl5okLg8u8HuibRMfnLWOI8Xh3G6mgnJjGMuARIDG4Gx6n8dnKOZBEdL"], "labels": [], "masters": [], "uuids": ["a11cfe0f-4001-42ca-9b69-620f80a37795"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 17:45:02.469633", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.144992 s, 796 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.144992 s, 796 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-12T17:45:02.686 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:02 +0000 (0:00:02.016) 0:04:47.756 *********** 2020-06-12T17:45:02.960 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-06-12T17:45:02.961 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.062742", "end": "2020-06-12 17:45:02.923376", "rc": 0, "start": "2020-06-12 17:45:02.860634", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T17:45:02.993 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:02 +0000 (0:00:00.307) 0:04:48.064 *********** 2020-06-12T17:45:03.002 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-06-12T17:45:03.003 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-06-12T17:45:03.038 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:03 +0000 (0:00:00.044) 0:04:48.109 *********** 2020-06-12T17:45:03.098 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-06-12T17:45:03.100 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930491916288, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227170878, 'block_used': 12924230, 'inode_total': 61054976, 'inode_available': 60986770, 'inode_used': 68206, 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227170878, "block_size": 4096, "block_total": 240095108, "block_used": 12924230, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986770, "inode_total": 61054976, "inode_used": 68206, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930491916288, "size_total": 983429562368, "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}} 2020-06-12T17:45:03.138 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:03 +0000 (0:00:00.100) 0:04:48.209 *********** 2020-06-12T17:45:03.232 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.041852", "end": "2020-06-12 17:45:03.208249", "rc": 0, "start": "2020-06-12 17:45:03.166397", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T17:45:03.265 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:03 +0000 (0:00:00.125) 0:04:48.335 *********** 2020-06-12T17:45:03.295 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-06-12T17:45:03.334 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:03 +0000 (0:00:00.069) 0:04:48.404 *********** 2020-06-12T17:45:03.364 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-06-12T17:45:03.366 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005311", "end": "2020-06-12 17:45:03.339159", "rc": 0, "start": "2020-06-12 17:45:03.333848", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:03.401 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:03 +0000 (0:00:00.067) 0:04:48.472 *********** 2020-06-12T17:45:03.438 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:03 +0000 (0:00:00.036) 0:04:48.509 *********** 2020-06-12T17:45:03.458 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-06-12T17:45:03.460 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930491916288, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227170878, 'block_used': 12924230, 'inode_total': 61054976, 'inode_available': 60986770, 'inode_used': 68206, 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227170878, "block_size": 4096, "block_total": 240095108, "block_used": 12924230, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986770, "inode_total": 61054976, "inode_used": 68206, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930491916288, "size_total": 983429562368, "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:03.492 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:03 +0000 (0:00:00.054) 0:04:48.563 *********** 2020-06-12T17:45:03.502 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-06-12T17:45:03.504 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:03.539 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:03 +0000 (0:00:00.047) 0:04:48.610 *********** 2020-06-12T17:45:03.548 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-06-12T17:45:03.582 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:03 +0000 (0:00:00.043) 0:04:48.653 *********** 2020-06-12T17:45:03.593 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-06-12T17:45:03.595 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:03.630 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:03 +0000 (0:00:00.047) 0:04:48.700 *********** 2020-06-12T17:45:03.669 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-06-12T17:45:03.671 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:03.703 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:03 +0000 (0:00:00.072) 0:04:48.773 *********** 2020-06-12T17:45:03.918 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-06-12T17:45:03.920 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-12T17:45:03.952 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:03 +0000 (0:00:00.249) 0:04:49.023 *********** 2020-06-12T17:45:04.002 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-06-12T17:45:04.004 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930491990016, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227170896, 'block_used': 12924212, 'inode_total': 61054976, 'inode_available': 60986774, 'inode_used': 68202, 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227170896, "block_size": 4096, "block_total": 240095108, "block_used": 12924212, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986774, "inode_total": 61054976, "inode_used": 68202, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930491990016, "size_total": 983429562368, "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:04.037 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:04 +0000 (0:00:00.084) 0:04:49.108 *********** 2020-06-12T17:45:04.094 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:04.125 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:04 +0000 (0:00:00.088) 0:04:49.196 *********** 2020-06-12T17:45:04.165 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-12T17:45:04.167 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:04.199 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:04 +0000 (0:00:00.073) 0:04:49.269 *********** 2020-06-12T17:45:04.238 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-12T17:45:04.241 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:04.271 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:04 +0000 (0:00:00.072) 0:04:49.342 *********** 2020-06-12T17:45:04.321 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-06-12T17:45:04.323 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:04.354 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:04 +0000 (0:00:00.083) 0:04:49.425 *********** 2020-06-12T17:45:04.394 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-06-12T17:45:04.396 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:04.427 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:04 +0000 (0:00:00.072) 0:04:49.497 *********** 2020-06-12T17:45:04.466 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-06-12T17:45:04.468 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:04.502 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:04 +0000 (0:00:00.075) 0:04:49.572 *********** 2020-06-12T17:45:05.073 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-06-12T17:45:05.075 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-9moygUqPmSA829vjT9HuaRaVNecO6zU3tdaOIjoHsifnD1suONyEGwUXTnid2dSJ'], 'uuids': ['a565706f-ac9d-4b8c-aed1-97658c387abb'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.240747", "end": "2020-06-12 17:45:05.034741", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-9moygUqPmSA829vjT9HuaRaVNecO6zU3tdaOIjoHsifnD1suONyEGwUXTnid2dSJ"], "labels": [], "masters": [], "uuids": ["a565706f-ac9d-4b8c-aed1-97658c387abb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 17:45:03.793994", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-12T17:45:05.291 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-06-12T17:45:05.294 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-06-12T17:45:05.327 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:05 +0000 (0:00:00.825) 0:04:50.398 *********** 2020-06-12T17:45:06.058 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-06-12T17:45:06.060 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-12T17:45:06.389 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-12T17:45:06.390 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-06-12T17:45:06.390 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-tFuCyy-2pTj-c5oW-BHZu-1XeD-9rzZ-WZBBk3', 'nvme-INTEL_SSDPEDKE040T7_BTLE736103BB4P0KGN', 'nvme-eui.0100000001000000e4d25c000034df14'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDKE040T7', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '7814037168', 'sectorsize': '512', 'size': '3.64 TB', 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [3DNAND, Beta Rock Controller]', 'holders': ['vg_nvme-lv_4', 'vg_nvme-lv_1', 'vg_nvme-lv_3', 'vg_nvme-lv_5', 'vg_nvme-lv_2']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.079519", "end": "2020-06-12 17:45:06.351955", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [3DNAND, Beta Rock Controller]", "links": {"ids": ["lvm-pv-uuid-tFuCyy-2pTj-c5oW-BHZu-1XeD-9rzZ-WZBBk3", "nvme-INTEL_SSDPEDKE040T7_BTLE736103BB4P0KGN", "nvme-eui.0100000001000000e4d25c000034df14"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDKE040T7", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "7814037168", "sectorsize": "512", "size": "3.64 TB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 17:45:05.272436", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures des 2020-06-12T17:45:06.392 INFO:teuthology.task.ansible.out:troyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-12T17:45:06.711 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-06-12T17:45:06.712 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-12T17:45:07.049 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-12T17:45:07.386 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-12T17:45:07.433 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:07 +0000 (0:00:02.106) 0:04:52.504 *********** 2020-06-12T17:45:07.646 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-06-12T17:45:07.648 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi038.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-9moygUqPmSA829vjT9HuaRaVNecO6zU3JEOhyJnInDQlJVC3P0Sjt0FqQ9c9thow'], 'uuids': ['a5a27ec3-fe7f-4fe6-8836-ed4f078b34a7'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.047232", "end": "2020-06-12 17:45:07.614744", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-9moygUqPmSA829vjT9HuaRaVNecO6zU3JEOhyJnInDQlJVC3P0Sjt0FqQ9c9thow"], "labels": [], "masters": [], "uuids": ["a5a27ec3-fe7f-4fe6-8836-ed4f078b34a7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 17:45:06.567512", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or a 2020-06-12T17:45:07.649 INFO:teuthology.task.ansible.out:fter you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-12T17:45:07.681 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:07 +0000 (0:00:00.247) 0:04:52.752 *********** 2020-06-12T17:45:07.911 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-06-12T17:45:07.913 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-12T17:45:08.090 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-12T17:45:08.279 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-12T17:45:08.487 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-12T17:45:08.509 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:08.548 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:08 +0000 (0:00:00.866) 0:04:53.619 *********** 2020-06-12T17:45:08.756 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-06-12T17:45:08.758 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-06-12T17:45:08.795 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:08 +0000 (0:00:00.246) 0:04:53.865 *********** 2020-06-12T17:45:08.835 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-06-12T17:45:08.837 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:08.876 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:08 +0000 (0:00:00.081) 0:04:53.947 *********** 2020-06-12T17:45:08.907 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-06-12T17:45:08.909 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-9moygUqPmSA829vjT9HuaRaVNecO6zU3uy4SO1L89lZtG4HkO1BCkwkz3qJORnCl'], 'uuids': ['cbf1d392-2996-4f38-ad72-a13553fa3a0f'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.044765", "end": "2020-06-12 17:45:08.872939", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-9moygUqPmSA829vjT9HuaRaVNecO6zU3uy4SO1L89lZtG4HkO1BCkwkz3qJORnCl"], "labels": [], "masters": [], "uuids": ["cbf1d392-2996-4f38-ad72-a13553fa3a0f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 17:45:07.828174", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-12T17:45:09.476 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-06-12T17:45:09.477 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true} 2020-06-12T17:45:09.517 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:09 +0000 (0:00:00.641) 0:04:54.588 *********** 2020-06-12T17:45:10.165 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-06-12T17:45:10.167 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-9moygUqPmSA829vjT9HuaRaVNecO6zU3odJL8XwV7tHFS4Tcf7RJx3sIT0T6cFny'], 'uuids': ['ac74c7cc-1e3a-4104-8ed5-0b828cce922f'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.045329", "end": "2020-06-12 17:45:10.133141", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-9moygUqPmSA829vjT9HuaRaVNecO6zU3odJL8XwV7tHFS4Tcf7RJx3sIT0T6cFny"], "labels": [], "masters": [], "uuids": ["ac74c7cc-1e3a-4104-8ed5-0b828cce922f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 17:45:09.087812", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-12T17:45:10.177 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J33D', 'wwn-0x5000c500871b5cd5'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4J33D', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871b5cd5', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J33D-part1', 'wwn-0x5000c500871b5cd5-part1'], 'uuids': ['0dcc33de-53c3-4ea8-baab-7ca3c59fe577'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J33D", "wwn-0x5000c500871b5cd5"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J33D-part1", "wwn-0x5000c500871b5cd5-part1"], "labels": [], "masters": [], "uuids": ["0dcc33de-53c3-4ea8-baab-7ca3c59fe577"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J33D", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871b5cd5"}}, 2020-06-12T17:45:10.179 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-06-12T17:45:11.127 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-06-12T17:45:11.129 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-06-12T17:45:11.163 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:11 +0000 (0:00:01.645) 0:04:56.234 *********** 2020-06-12T17:45:11.203 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-06-12T17:45:11.205 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:11.242 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:11 +0000 (0:00:00.078) 0:04:56.312 *********** 2020-06-12T17:45:11.271 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-06-12T17:45:11.273 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:11.305 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:11 +0000 (0:00:00.062) 0:04:56.375 *********** 2020-06-12T17:45:11.334 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-06-12T17:45:11.336 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:11.368 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:11 +0000 (0:00:00.063) 0:04:56.438 *********** 2020-06-12T17:45:11.411 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:11.443 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:11 +0000 (0:00:00.074) 0:04:56.513 *********** 2020-06-12T17:45:11.455 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-06-12T17:45:11.456 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-9moygUqPmSA829vjT9HuaRaVNecO6zU3eOcyHdUto2CdVwjrf4ysvt5Rb9W7zZSj'], 'uuids': ['a09c7719-13aa-46c7-9cd2-effa6a4b84c4'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.051996", "end": "2020-06-12 17:45:11.406952", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-9moygUqPmSA829vjT9HuaRaVNecO6zU3eOcyHdUto2CdVwjrf4ysvt5Rb9W7zZSj"], "labels": [], "masters": [], "uuids": ["a09c7719-13aa-46c7-9cd2-effa6a4b84c4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 17:45:10.354956", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-12T17:45:11.503 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:11 +0000 (0:00:00.055) 0:04:56.569 *********** 2020-06-12T17:45:11.512 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-06-12T17:45:11.514 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:11.547 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:11 +0000 (0:00:00.049) 0:04:56.618 *********** 2020-06-12T17:45:11.588 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:11.621 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:11 +0000 (0:00:00.073) 0:04:56.691 *********** 2020-06-12T17:45:11.661 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:11.698 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:11 +0000 (0:00:00.073) 0:04:56.765 *********** 2020-06-12T17:45:11.725 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:11.758 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:11 +0000 (0:00:00.062) 0:04:56.828 *********** 2020-06-12T17:45:11.797 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-06-12T17:45:11.799 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:11.831 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:11 +0000 (0:00:00.073) 0:04:56.901 *********** 2020-06-12T17:45:11.861 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-06-12T17:45:11.862 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:11.894 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:11 +0000 (0:00:00.062) 0:04:56.964 *********** 2020-06-12T17:45:11.914 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-06-12T17:45:11.915 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-9moygUqPmSA829vjT9HuaRaVNecO6zU3tdaOIjoHsifnD1suONyEGwUXTnid2dSJ'], 'uuids': ['a565706f-ac9d-4b8c-aed1-97658c387abb'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.160545", "end": "2020-06-12 17:45:11.878016", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-9moygUqPmSA829vjT9HuaRaVNecO6zU3tdaOIjoHsifnD1suONyEGwUXTnid2dSJ"], "labels": [], "masters": [], "uuids": ["a565706f-ac9d-4b8c-aed1-97658c387abb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 17:45:11.717471", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.157856 s, 731 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.157856 s, 731 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-12T17:45:11.936 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-06-12T17:45:11.938 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:11.975 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:11 +0000 (0:00:00.075) 0:04:57.040 *********** 2020-06-12T17:45:12.153 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-06-12T17:45:12.155 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-tFuCyy-2pTj-c5oW-BHZu-1XeD-9rzZ-WZBBk3', 'nvme-INTEL_SSDPEDKE040T7_BTLE736103BB4P0KGN', 'nvme-eui.0100000001000000e4d25c000034df14'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDKE040T7', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '7814037168', 'sectorsize': '512', 'size': '3.64 TB', 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [3DNAND, Beta Rock Controller]', 'holders': ['vg_nvme-lv_4', 'vg_nvme-lv_1', 'vg_nvme-lv_3', 'vg_nvme-lv_5', 'vg_nvme-lv_2']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.036333", "end": "2020-06-12 17:45:12.124110", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [3DNAND, Beta Rock Controller]", "links": {"ids": ["lvm-pv-uuid-tFuCyy-2pTj-c5oW-BHZu-1XeD-9rzZ-WZBBk3", "nvme-INTEL_SSDPEDKE040T7_BTLE736103BB4P0KGN", "nvme-eui.0100000001000000e4d25c000034df14"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDKE040T7", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "7814037168", "sectorsize": "512", "size": "3.64 TB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 17:45:12.087777", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0336441 s, 3.4 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 2020-06-12T17:45:12.157 INFO:teuthology.task.ansible.out:MB, 110 MiB) copied, 0.0336441 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} 2020-06-12T17:45:12.498 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-06-12T17:45:12.500 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-06-12T17:45:12.534 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:12 +0000 (0:00:00.563) 0:04:57.603 *********** 2020-06-12T17:45:12.542 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-06-12T17:45:12.544 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-9moygUqPmSA829vjT9HuaRaVNecO6zU3JEOhyJnInDQlJVC3P0Sjt0FqQ9c9thow'], 'uuids': ['a5a27ec3-fe7f-4fe6-8836-ed4f078b34a7'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.160675", "end": "2020-06-12 17:45:12.482816", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-9moygUqPmSA829vjT9HuaRaVNecO6zU3JEOhyJnInDQlJVC3P0Sjt0FqQ9c9thow"], "labels": [], "masters": [], "uuids": ["a5a27ec3-fe7f-4fe6-8836-ed4f078b34a7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 17:45:12.322141", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.157996 s, 730 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.157996 s, 730 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-12T17:45:12.862 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-06-12T17:45:12.864 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-06-12 17:39:17 UTC", "ActiveEnterTimestampMonotonic": "15894390", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "ntpd.service system.slice -.mount basic.target systemd-journald.socket sysinit.target sntp.service ntpdate.service tmp.mount systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-06-12 17:39:16 UTC", "AssertTimestampMonotonic": "14800686", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-06-12 17:39:16 UTC", "ConditionTimestampMonotonic": "14800662", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service ntpd.service shutdown.target", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-06-12T17:45:12.866 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2444", "ExecMainStartTimestamp": "Fri 2020-06-12 17:39:17 UTC", "ExecMainStartTimestampMonotonic": "15844817", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-06-12 17:39:16 UTC", "InactiveExitTimestampMonotonic": "14837994", "InvocationID": "1b0af1bbebd54fae884beab90d842361", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-06-12T17:45:12.867 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127425", "LimitNPROCSoft": "127425", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127425", "LimitSIGPENDINGSoft": "127425", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2444", "MemoryAccounting": "yes", "MemoryCurrent": "2646016", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-06-12T17:45:12.869 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-06-12 17:39:17 UTC", "StateChangeTimestampMonotonic": "15894390", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-06-12 17:39:17 UTC", "WatchdogTimestampMonotonic": "15844831", "WatchdogUSec": "0"}} 2020-06-12T17:45:12.944 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:12 +0000 (0:00:00.410) 0:04:58.015 *********** 2020-06-12T17:45:12.956 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-06-12T17:45:12.957 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-9moygUqPmSA829vjT9HuaRaVNecO6zU3uy4SO1L89lZtG4HkO1BCkwkz3qJORnCl'], 'uuids': ['cbf1d392-2996-4f38-ad72-a13553fa3a0f'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.162938", "end": "2020-06-12 17:45:12.845967", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-9moygUqPmSA829vjT9HuaRaVNecO6zU3uy4SO1L89lZtG4HkO1BCkwkz3qJORnCl"], "labels": [], "masters": [], "uuids": ["cbf1d392-2996-4f38-ad72-a13553fa3a0f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 17:45:12.683029", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.160249 s, 720 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.160249 s, 720 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-12T17:45:12.970 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-12T17:45:12.972 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-06-12T17:45:13.006 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:13 +0000 (0:00:00.061) 0:04:58.076 *********** 2020-06-12T17:45:13.045 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-12T17:45:13.047 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-06-12T17:45:13.080 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:13 +0000 (0:00:00.073) 0:04:58.150 *********** 2020-06-12T17:45:13.111 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-06-12T17:45:13.116 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:13.151 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:13 +0000 (0:00:00.070) 0:04:58.221 *********** 2020-06-12T17:45:13.181 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-06-12T17:45:13.183 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:13.215 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:13 +0000 (0:00:00.064) 0:04:58.286 *********** 2020-06-12T17:45:13.244 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-06-12T17:45:13.248 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-9moygUqPmSA829vjT9HuaRaVNecO6zU3odJL8XwV7tHFS4Tcf7RJx3sIT0T6cFny'], 'uuids': ['ac74c7cc-1e3a-4104-8ed5-0b828cce922f'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.153590", "end": "2020-06-12 17:45:13.201171", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-9moygUqPmSA829vjT9HuaRaVNecO6zU3odJL8XwV7tHFS4Tcf7RJx3sIT0T6cFny"], "labels": [], "masters": [], "uuids": ["ac74c7cc-1e3a-4104-8ed5-0b828cce922f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 17:45:13.047581", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.150984 s, 764 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.150984 s, 764 MB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi038.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J33D', 'wwn-0x5000c500871b5cd5'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4J33D', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871b5cd5', 'partitions' 2020-06-12T17:45:13.250 INFO:teuthology.task.ansible.out:: {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J33D-part1', 'wwn-0x5000c500871b5cd5-part1'], 'uuids': ['0dcc33de-53c3-4ea8-baab-7ca3c59fe577'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J33D", "wwn-0x5000c500871b5cd5"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J33D-part1", "wwn-0x5000c500871b5cd5-part1"], "labels": [], "masters": [], "uuids": ["0dcc33de-53c3-4ea8-baab-7ca3c59fe577"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J33D", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871b5cd5"}}, "skip_reason": "Conditional result was False"} TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:13.302 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:13 +0000 (0:00:00.086) 0:04:58.372 *********** 2020-06-12T17:45:13.519 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-06-12T17:45:13.561 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:13 +0000 (0:00:00.259) 0:04:58.632 *********** 2020-06-12T17:45:13.614 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-06-12T17:45:13.616 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-9moygUqPmSA829vjT9HuaRaVNecO6zU3eOcyHdUto2CdVwjrf4ysvt5Rb9W7zZSj'], 'uuids': ['a09c7719-13aa-46c7-9cd2-effa6a4b84c4'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.157515", "end": "2020-06-12 17:45:13.562711", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-9moygUqPmSA829vjT9HuaRaVNecO6zU3eOcyHdUto2CdVwjrf4ysvt5Rb9W7zZSj"], "labels": [], "masters": [], "uuids": ["a09c7719-13aa-46c7-9cd2-effa6a4b84c4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 17:45:13.405196", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.154857 s, 745 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.154857 s, 745 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-12T17:45:13.668 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:13 +0000 (0:00:00.106) 0:04:58.739 *********** 2020-06-12T17:45:13.958 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi038.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.066965", "end": "2020-06-12 17:45:13.921865", "rc": 0, "start": "2020-06-12 17:45:13.854900", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T17:45:13.990 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:13 +0000 (0:00:00.317) 0:04:59.057 *********** 2020-06-12T17:45:14.082 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-06-12T17:45:14.084 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-06-12T17:45:14.130 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:14 +0000 (0:00:00.143) 0:04:59.200 *********** 2020-06-12T17:45:14.261 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.046825", "end": "2020-06-12 17:45:14.230414", "rc": 0, "start": "2020-06-12 17:45:14.183589", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T17:45:14.296 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:14 +0000 (0:00:00.166) 0:04:59.366 *********** 2020-06-12T17:45:14.328 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-06-12T17:45:14.372 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:14 +0000 (0:00:00.075) 0:04:59.442 *********** 2020-06-12T17:45:14.412 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-06-12T17:45:14.414 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:14.464 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:14 +0000 (0:00:00.092) 0:04:59.534 *********** 2020-06-12T17:45:14.505 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-06-12T17:45:14.507 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:14.538 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:14 +0000 (0:00:00.074) 0:04:59.609 *********** 2020-06-12T17:45:14.578 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-06-12T17:45:14.580 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:14.617 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:14 +0000 (0:00:00.078) 0:04:59.688 *********** 2020-06-12T17:45:14.657 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:14.689 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:14 +0000 (0:00:00.072) 0:04:59.760 *********** 2020-06-12T17:45:14.915 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-06-12T17:45:14.917 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-12T17:45:14.951 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:14 +0000 (0:00:00.261) 0:05:00.021 *********** 2020-06-12T17:45:15.015 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-06-12T17:45:15.018 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930491916288, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227170878, 'block_used': 12924230, 'inode_total': 61054976, 'inode_available': 60986770, 'inode_used': 68206, 'uuid': '0dcc33de-53c3-4ea8-baab-7ca3c59fe577'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227170878, "block_size": 4096, "block_total": 240095108, "block_used": 12924230, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986770, "inode_total": 61054976, "inode_used": 68206, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930491916288, "size_total": 983429562368, "uuid": "0dcc33de-53c3-4ea8-baab-7ca3c59fe577"}, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:15.057 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:15 +0000 (0:00:00.106) 0:05:00.127 *********** 2020-06-12T17:45:15.093 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-06-12T17:45:15.096 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:15.130 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:15 +0000 (0:00:00.073) 0:05:00.200 *********** 2020-06-12T17:45:15.171 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-12T17:45:15.174 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:15.206 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:15 +0000 (0:00:00.076) 0:05:00.277 *********** 2020-06-12T17:45:15.247 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-12T17:45:15.249 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:15.283 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:15 +0000 (0:00:00.076) 0:05:00.353 *********** 2020-06-12T17:45:15.329 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-06-12T17:45:15.331 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:15.364 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:15 +0000 (0:00:00.081) 0:05:00.434 *********** 2020-06-12T17:45:15.415 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-06-12T17:45:15.417 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:15.451 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:15 +0000 (0:00:00.086) 0:05:00.521 *********** 2020-06-12T17:45:15.491 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:15.527 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:15 +0000 (0:00:00.076) 0:05:00.598 *********** 2020-06-12T17:45:15.538 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-06-12T17:45:15.540 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-06-12T17:45:15.584 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:15 +0000 (0:00:00.056) 0:05:00.654 *********** 2020-06-12T17:45:15.618 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-06-12T17:45:15.620 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:15.651 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:15 +0000 (0:00:00.067) 0:05:00.722 *********** 2020-06-12T17:45:15.690 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-06-12T17:45:15.693 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-06-12T17:45:15.723 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:15 +0000 (0:00:00.072) 0:05:00.794 *********** 2020-06-12T17:45:15.947 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-06-12T17:45:15.949 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-06-12T17:45:15.985 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:15 +0000 (0:00:00.261) 0:05:01.055 *********** 2020-06-12T17:45:16.035 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-06-12T17:45:16.037 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:16.069 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:16 +0000 (0:00:00.084) 0:05:01.140 *********** 2020-06-12T17:45:16.078 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi038.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-06-12T17:45:16.113 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:16 +0000 (0:00:00.044) 0:05:01.184 *********** 2020-06-12T17:45:16.122 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-06-12T17:45:16.125 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-06-12T17:45:16.176 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:16 +0000 (0:00:00.062) 0:05:01.246 *********** 2020-06-12T17:45:16.234 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:16.268 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:16 +0000 (0:00:00.091) 0:05:01.338 *********** 2020-06-12T17:45:16.485 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi150.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-06-12T17:45:16.522 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:16 +0000 (0:00:00.251) 0:05:01.590 *********** 2020-06-12T17:45:16.531 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-06-12T17:45:16.533 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-12T17:45:16.731 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi150.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-06-12T17:45:16.767 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:16 +0000 (0:00:00.247) 0:05:01.838 *********** 2020-06-12T17:45:16.808 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:16.841 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:16 +0000 (0:00:00.073) 0:05:01.912 *********** 2020-06-12T17:45:16.861 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-06-12T17:45:16.863 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-12T17:45:16.893 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi150.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-06-12T17:45:16.895 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-06-12T17:45:16.905 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-06-12T17:45:16.916 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-06-12T17:45:16.958 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:16 +0000 (0:00:00.116) 0:05:02.028 *********** 2020-06-12T17:45:17.008 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-06-12T17:45:17.011 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:17.025 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:17.026 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:17.036 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:17.074 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:17 +0000 (0:00:00.113) 0:05:02.141 *********** 2020-06-12T17:45:17.113 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-12T17:45:17.114 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:17.161 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:17 +0000 (0:00:00.090) 0:05:02.232 *********** 2020-06-12T17:45:17.191 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:17.242 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:17 +0000 (0:00:00.080) 0:05:02.313 *********** 2020-06-12T17:45:17.257 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-06-12T17:45:17.259 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-12T17:45:17.271 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:17.309 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:17 +0000 (0:00:00.066) 0:05:02.379 *********** 2020-06-12T17:45:17.338 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-06-12T17:45:17.341 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:17.374 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:17 +0000 (0:00:00.065) 0:05:02.444 *********** 2020-06-12T17:45:17.404 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:17.456 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:17 +0000 (0:00:00.081) 0:05:02.526 *********** 2020-06-12T17:45:17.496 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-06-12T17:45:17.498 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:17.532 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:17 +0000 (0:00:00.076) 0:05:02.603 *********** 2020-06-12T17:45:17.583 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-06-12T17:45:17.585 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi038.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-12T17:45:17.621 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:17 +0000 (0:00:00.088) 0:05:02.691 *********** 2020-06-12T17:45:17.662 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-06-12T17:45:17.664 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:17.698 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:17 +0000 (0:00:00.076) 0:05:02.768 *********** 2020-06-12T17:45:17.941 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-06-12T17:45:17.943 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005043", "end": "2020-06-12 17:45:17.899925", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-06-12 17:45:17.894882", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T17:45:17.963 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-06-12T17:45:17.965 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-12T17:45:18.001 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:17 +0000 (0:00:00.303) 0:05:03.071 *********** 2020-06-12T17:45:18.135 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-06-12T17:45:18.137 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003015", "end": "2020-06-12 17:45:18.090165", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-06-12 17:45:18.087150", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T17:45:18.224 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-06-12T17:45:18.226 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-06-12T17:45:18.268 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:18 +0000 (0:00:00.267) 0:05:03.339 *********** 2020-06-12T17:45:18.319 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-06-12T17:45:18.321 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002740", "end": "2020-06-12 17:45:18.281699", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-06-12 17:45:18.278959", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-06-12T17:45:18.522 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi038.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-12T17:45:18.530 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-06-12T17:45:18.533 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003131", "end": "2020-06-12 17:45:18.472527", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-06-12 17:45:18.469396", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T17:45:18.571 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:18 +0000 (0:00:00.302) 0:05:03.641 *********** 2020-06-12T17:45:18.611 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-06-12T17:45:18.648 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:18 +0000 (0:00:00.077) 0:05:03.719 *********** 2020-06-12T17:45:18.722 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-06-12T17:45:18.724 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-12T17:45:18.859 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-06-12T17:45:18.861 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-06-12T17:45:18.933 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-06-12T17:45:18.935 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-12T17:45:19.121 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-12T17:45:19.136 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:19.177 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:19 +0000 (0:00:00.525) 0:05:04.245 *********** 2020-06-12T17:45:19.397 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-06-12T17:45:19.399 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-06-12T17:45:19.432 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:19 +0000 (0:00:00.257) 0:05:04.502 *********** 2020-06-12T17:45:19.472 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-06-12T17:45:19.473 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:19.505 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:19 +0000 (0:00:00.073) 0:05:04.575 *********** 2020-06-12T17:45:19.989 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi038.front.sepia.ceph.com] => {"changed": true} 2020-06-12T17:45:20.038 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:20 +0000 (0:00:00.521) 0:05:05.097 *********** 2020-06-12T17:45:20.375 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-06-12T17:45:20.409 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:20 +0000 (0:00:00.382) 0:05:05.480 *********** 2020-06-12T17:45:20.444 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-06-12T17:45:20.446 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:20.480 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:20 +0000 (0:00:00.070) 0:05:05.551 *********** 2020-06-12T17:45:20.521 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-06-12T17:45:20.523 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:20.556 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:20 +0000 (0:00:00.075) 0:05:05.626 *********** 2020-06-12T17:45:20.597 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-06-12T17:45:20.599 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:20.635 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:20 +0000 (0:00:00.078) 0:05:05.705 *********** 2020-06-12T17:45:20.665 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-06-12T17:45:20.666 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:20.698 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:20 +0000 (0:00:00.063) 0:05:05.769 *********** 2020-06-12T17:45:20.738 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-06-12T17:45:20.740 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:20.772 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:20 +0000 (0:00:00.073) 0:05:05.842 *********** 2020-06-12T17:45:20.804 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-06-12T17:45:20.805 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:20.843 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:20 +0000 (0:00:00.066) 0:05:05.909 *********** 2020-06-12T17:45:20.870 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:20.912 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:20 +0000 (0:00:00.073) 0:05:05.982 *********** 2020-06-12T17:45:20.942 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-06-12T17:45:20.944 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:20.978 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:20 +0000 (0:00:00.064) 0:05:06.047 *********** 2020-06-12T17:45:21.006 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-06-12T17:45:21.007 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:21.039 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:21 +0000 (0:00:00.062) 0:05:06.110 *********** 2020-06-12T17:45:21.068 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-06-12T17:45:21.070 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:21.101 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:21 +0000 (0:00:00.062) 0:05:06.172 *********** 2020-06-12T17:45:21.130 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-06-12T17:45:21.131 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:21.165 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:21 +0000 (0:00:00.064) 0:05:06.236 *********** 2020-06-12T17:45:21.725 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-06-12T17:45:21.726 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-06-12T17:45:21.770 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:21 +0000 (0:00:00.604) 0:05:06.840 *********** 2020-06-12T17:45:22.118 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-06-12T17:45:22.120 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-06-12 17:38:48 UTC", "ActiveEnterTimestampMonotonic": "20085168", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service basic.target ntpdate.service tmp.mount sysinit.target -.mount sntp.service systemd-journald.socket ntpd.service system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-06-12 17:38:47 UTC", "AssertTimestampMonotonic": "18929520", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-06-12 17:38:47 UTC", "ConditionTimestampMonotonic": "18929492", "ConfigurationDirectoryMode": "0755", "Conflicts": "ntpd.service shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-06-12T17:45:22.121 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2434", "ExecMainStartTimestamp": "Fri 2020-06-12 17:38:48 UTC", "ExecMainStartTimestampMonotonic": "20022462", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-06-12 17:38:47 UTC", "InactiveExitTimestampMonotonic": "18967598", "InvocationID": "4c952f1b28604c59acd1204dcc8a8b5b", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-06-12T17:45:22.123 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127449", "LimitNPROCSoft": "127449", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127449", "LimitSIGPENDINGSoft": "127449", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2434", "MemoryAccounting": "yes", "MemoryCurrent": "2826240", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-06-12T17:45:22.125 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-06-12 17:38:48 UTC", "StateChangeTimestampMonotonic": "20085168", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-06-12 17:38:48 UTC", "WatchdogTimestampMonotonic": "20022477", "WatchdogUSec": "0"}} 2020-06-12T17:45:22.182 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:22 +0000 (0:00:00.405) 0:05:07.246 *********** 2020-06-12T17:45:22.209 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-12T17:45:22.210 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-06-12T17:45:22.244 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:22 +0000 (0:00:00.068) 0:05:07.315 *********** 2020-06-12T17:45:22.284 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-06-12T17:45:22.322 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:22 +0000 (0:00:00.077) 0:05:07.392 *********** 2020-06-12T17:45:22.352 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:22.385 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:22 +0000 (0:00:00.063) 0:05:07.455 *********** 2020-06-12T17:45:22.415 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-06-12T17:45:22.417 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:22.449 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:22 +0000 (0:00:00.063) 0:05:07.519 *********** 2020-06-12T17:45:22.488 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-06-12T17:45:22.490 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:22.523 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:22 +0000 (0:00:00.074) 0:05:07.593 *********** 2020-06-12T17:45:22.752 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-06-12T17:45:22.754 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-06-12T17:45:22.786 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:22 +0000 (0:00:00.262) 0:05:07.856 *********** 2020-06-12T17:45:23.336 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-06-12T17:45:23.338 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-06-12T17:45:23.375 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:23 +0000 (0:00:00.589) 0:05:08.446 *********** 2020-06-12T17:45:24.608 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-06-12T17:45:24.610 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-06-12T17:45:24.641 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:24 +0000 (0:00:01.265) 0:05:09.712 *********** 2020-06-12T17:45:24.672 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-06-12T17:45:24.674 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:24.707 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:24 +0000 (0:00:00.065) 0:05:09.777 *********** 2020-06-12T17:45:24.746 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-06-12T17:45:24.748 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2020-06-12T17:45:24.780 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:24 +0000 (0:00:00.073) 0:05:09.850 *********** 2020-06-12T17:45:25.005 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-06-12T17:45:25.040 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:25 +0000 (0:00:00.260) 0:05:10.111 *********** 2020-06-12T17:45:25.078 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-06-12T17:45:25.079 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:25.113 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:25 +0000 (0:00:00.072) 0:05:10.184 *********** 2020-06-12T17:45:25.155 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-06-12T17:45:25.156 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-06-12T17:45:25.192 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:25 +0000 (0:00:00.078) 0:05:10.262 *********** 2020-06-12T17:45:25.233 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:25.267 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:25 +0000 (0:00:00.074) 0:05:10.337 *********** 2020-06-12T17:45:25.492 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-06-12T17:45:25.494 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-06-12T17:45:25.526 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:25 +0000 (0:00:00.259) 0:05:10.596 *********** 2020-06-12T17:45:25.750 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-06-12T17:45:25.752 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-06-12T17:45:25.783 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:25 +0000 (0:00:00.257) 0:05:10.854 *********** 2020-06-12T17:45:25.814 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:25.847 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:25 +0000 (0:00:00.064) 0:05:10.918 *********** 2020-06-12T17:45:25.897 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-06-12T17:45:25.899 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-06-12T17:45:25.909 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2020-06-12T17:45:25.911 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2020-06-12T17:45:25.923 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-06-12T17:45:25.964 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:25 +0000 (0:00:00.116) 0:05:11.034 *********** 2020-06-12T17:45:26.028 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi038.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:26.030 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:26.039 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:26.041 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:26.050 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:26.090 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:26 +0000 (0:00:00.125) 0:05:11.160 *********** 2020-06-12T17:45:26.131 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-12T17:45:26.133 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:26.167 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:26 +0000 (0:00:00.076) 0:05:11.237 *********** 2020-06-12T17:45:26.196 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-06-12T17:45:26.197 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:26.233 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:26 +0000 (0:00:00.066) 0:05:11.304 *********** 2020-06-12T17:45:26.262 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-06-12T17:45:26.264 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:26.298 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:26 +0000 (0:00:00.064) 0:05:11.368 *********** 2020-06-12T17:45:26.339 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-06-12T17:45:26.340 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:26.380 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:26 +0000 (0:00:00.079) 0:05:11.447 *********** 2020-06-12T17:45:26.409 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-06-12T17:45:26.411 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:26.448 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:26 +0000 (0:00:00.071) 0:05:11.519 *********** 2020-06-12T17:45:26.477 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-06-12T17:45:26.479 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:26.528 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:26 +0000 (0:00:00.079) 0:05:11.598 *********** 2020-06-12T17:45:26.560 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:26.594 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:26 +0000 (0:00:00.065) 0:05:11.664 *********** 2020-06-12T17:45:26.595 INFO:teuthology.task.ansible.out: 2020-06-12T17:45:26.628 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-06-12T17:45:26.630 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T17:45:26.662 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:26 +0000 (0:00:00.068) 0:05:11.733 *********** 2020-06-12T17:45:26.915 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-06-12T17:45:26.922 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005633", "end": "2020-06-12 17:45:26.875289", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-06-12 17:45:26.869656", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T17:45:27.124 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003158", "end": "2020-06-12 17:45:27.089458", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-06-12 17:45:27.086300", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T17:45:27.334 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002952", "end": "2020-06-12 17:45:27.294873", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-06-12 17:45:27.291921", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-06-12T17:45:27.530 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003314", "end": "2020-06-12 17:45:27.494391", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-06-12 17:45:27.491077", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T17:45:27.564 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:27 +0000 (0:00:00.902) 0:05:12.635 *********** 2020-06-12T17:45:27.593 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-06-12T17:45:27.648 INFO:teuthology.task.ansible.out:Friday 12 June 2020 17:45:27 +0000 (0:00:00.083) 0:05:12.718 *********** 2020-06-12T17:45:27.867 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-06-12T17:45:27.869 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-06-12T17:45:27.974 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-06-12T17:45:27.977 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** 2020-06-12T17:45:27.978 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2020-06-12T17:45:27.980 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* smithi038.front.sepia.ceph.com : ok=128 changed=41 unreachable=0 failed=0 skipped=161 rescued=0 ignored=4 smithi150.front.sepia.ceph.com : ok=128 changed=41 unreachable=0 failed=0 skipped=161 rescued=0 ignored=4 2020-06-12T17:45:27.980 INFO:teuthology.task.ansible.out: Friday 12 June 2020 17:45:27 +0000 (0:00:00.332) 0:05:13.051 *********** =============================================================================== 2020-06-12T17:45:27.982 INFO:teuthology.task.ansible.out:common : nrpe - Ensure SELinux policy is up to date -------------------- 33.67s users : Update authorized_keys using the keys repo --------------------- 33.25s users : Create all admin users with sudo access. ----------------------- 31.41s common : nrpe - Remove SELinux policy package --------------------------- 7.65s common : Get list of enabled RHSM repos --------------------------------- 7.24s common : nrpe - Load SELinux policy package ----------------------------- 7.00s users : Remove revoked users -------------------------------------------- 5.24s testnode : Ensure ceph dependency packages are not present. ------------- 4.43s common : Register with subscription-manager. ---------------------------- 4.03s common : Install Kerberos Packages (RedHat) ----------------------------- 2.69s users : Update authorized_keys for each user with literal keys ---------- 2.47s common : nrpe - Install SELinux dependencies ---------------------------- 2.35s common : Make sure smartmontools is installed --------------------------- 1.85s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 1.74s Gathering Facts --------------------------------------------------------- 1.67s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 1.55s common : Check for epel ------------------------------------------------- 1.28s testnode : Install packages via pip ------------------------------------- 1.27s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 1.25s testnode : Enable copr repos -------------------------------------------- 1.15s 2020-06-12T17:45:28.380 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi038.front.sepia.ceph.com'), Remote(name='ubuntu@smithi150.front.sepia.ceph.com')] 2020-06-12T17:45:28.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-06-12T17:45:28.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T17:45:28.461 INFO:teuthology.orchestra.run.smithi038:> true 2020-06-12T17:45:28.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-06-12T17:45:28.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T17:45:28.619 INFO:teuthology.orchestra.run.smithi150:> true 2020-06-12T17:45:28.707 INFO:teuthology.run_tasks:Running task clock... 2020-06-12T17:45:28.720 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-06-12T17:45:28.720 INFO:teuthology.orchestra.run:Running command with timeout 60 2020-06-12T17:45:28.721 INFO:teuthology.orchestra.run.smithi038:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-06-12T17:45:28.762 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-06-12T17:45:28.784 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-06-12T17:45:28.834 INFO:teuthology.orchestra.run.smithi038.stderr:sudo: ntpd: command not found 2020-06-12T17:45:28.851 INFO:teuthology.orchestra.run.smithi038.stdout:506 Cannot talk to daemon 2020-06-12T17:45:28.873 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-06-12T17:45:28.893 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-06-12T17:45:28.961 INFO:teuthology.orchestra.run.smithi038.stderr:bash: ntpq: command not found 2020-06-12T17:45:28.964 INFO:teuthology.orchestra.run.smithi038.stdout:210 Number of sources = 4 2020-06-12T17:45:28.964 INFO:teuthology.orchestra.run.smithi038.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-06-12T17:45:28.964 INFO:teuthology.orchestra.run.smithi038.stdout:=============================================================================== 2020-06-12T17:45:28.964 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-06-12T17:45:28.965 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-06-12T17:45:28.965 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-06-12T17:45:28.965 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-06-12T17:45:28.965 INFO:teuthology.orchestra.run:Running command with timeout 60 2020-06-12T17:45:28.966 INFO:teuthology.orchestra.run.smithi150:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-06-12T17:45:29.005 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-06-12T17:45:29.025 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-06-12T17:45:29.073 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: ntpd: command not found 2020-06-12T17:45:29.087 INFO:teuthology.orchestra.run.smithi150.stdout:506 Cannot talk to daemon 2020-06-12T17:45:29.105 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-06-12T17:45:29.124 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-06-12T17:45:29.189 INFO:teuthology.orchestra.run.smithi150.stderr:bash: ntpq: command not found 2020-06-12T17:45:29.191 INFO:teuthology.orchestra.run.smithi150.stdout:210 Number of sources = 4 2020-06-12T17:45:29.191 INFO:teuthology.orchestra.run.smithi150.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-06-12T17:45:29.192 INFO:teuthology.orchestra.run.smithi150.stdout:=============================================================================== 2020-06-12T17:45:29.192 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-06-12T17:45:29.192 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-06-12T17:45:29.192 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-06-12T17:45:29.192 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-06-12T17:45:29.193 INFO:teuthology.run_tasks:Running task install... 2020-06-12T17:45:29.208 DEBUG:teuthology.task.install:project ceph 2020-06-12T17:45:29.209 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '91d24f498556f86f6d1318d2efd5210c35b36762'}} 2020-06-12T17:45:29.210 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': '91d24f498556f86f6d1318d2efd5210c35b36762'} 2020-06-12T17:45:29.210 INFO:teuthology.task.install:Using flavor: basic 2020-06-12T17:45:29.216 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-06-12T17:45:29.217 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2020-06-12T17:45:29.217 INFO:teuthology.orchestra.run.smithi038:> sudo lsb_release -is 2020-06-12T17:45:29.259 INFO:teuthology.orchestra.run.smithi038.stdout:RedHatEnterprise 2020-06-12T17:45:29.260 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-06-12T17:45:29.261 INFO:teuthology.orchestra.run.smithi150:> sudo lsb_release -is 2020-06-12T17:45:29.261 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'tag': None, 'sha1': '91d24f498556f86f6d1318d2efd5210c35b36762', 'debuginfo': None, 'flavor': 'basic', 'downgrade_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'exclude_packages': [], 'extras': None, 'wait_for_package': False, 'project': 'ceph', 'packages': {}, 'install_ceph_packages': True, 'repos_only': False} 2020-06-12T17:45:29.262 INFO:teuthology.orchestra.run.smithi038:> sudo lsb_release -is 2020-06-12T17:45:29.298 INFO:teuthology.orchestra.run.smithi150.stdout:RedHatEnterprise 2020-06-12T17:45:29.300 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-06-12T17:45:29.300 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'tag': None, 'sha1': '91d24f498556f86f6d1318d2efd5210c35b36762', 'debuginfo': None, 'flavor': 'basic', 'downgrade_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'exclude_packages': [], 'extras': None, 'wait_for_package': False, 'project': 'ceph', 'packages': {}, 'install_ceph_packages': True, 'repos_only': False} 2020-06-12T17:45:29.301 INFO:teuthology.orchestra.run.smithi150:> sudo lsb_release -is 2020-06-12T17:45:29.340 INFO:teuthology.orchestra.run.smithi038.stdout:RedHatEnterprise 2020-06-12T17:45:29.341 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-06-12T17:45:29.342 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=91d24f498556f86f6d1318d2efd5210c35b36762 2020-06-12T17:45:29.381 INFO:teuthology.orchestra.run.smithi150.stdout:RedHatEnterprise 2020-06-12T17:45:29.382 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-06-12T17:45:29.383 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=91d24f498556f86f6d1318d2efd5210c35b36762 2020-06-12T17:45:29.515 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/centos/8/flavors/default/ 2020-06-12T17:45:29.516 INFO:teuthology.task.install.rpm:Package version is 15.2.3-196.g91d24f4 2020-06-12T17:45:29.558 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/centos/8/flavors/default/ 2020-06-12T17:45:29.559 INFO:teuthology.task.install.rpm:Package version is 15.2.3-196.g91d24f4 2020-06-12T17:45:29.662 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-06-12T17:45:29.663 INFO:teuthology.orchestra.run.smithi038:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-06-12T17:45:29.683 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-06-12T17:45:29.683 INFO:teuthology.orchestra.run.smithi150:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-06-12T17:45:29.708 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2020-06-12T17:45:29.709 INFO:teuthology.orchestra.run.smithi038:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/91d24f498556f86f6d1318d2efd5210c35b36762/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-06-12T17:45:29.728 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2020-06-12T17:45:29.729 INFO:teuthology.orchestra.run.smithi150:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/91d24f498556f86f6d1318d2efd5210c35b36762/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-06-12T17:45:29.781 INFO:teuthology.orchestra.run.smithi038:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-06-12T17:45:29.796 INFO:teuthology.orchestra.run.smithi150:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-06-12T17:45:29.868 INFO:teuthology.orchestra.run.smithi038:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-06-12T17:45:29.876 INFO:teuthology.orchestra.run.smithi150:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-06-12T17:45:29.899 INFO:teuthology.orchestra.run.smithi038.stdout:check_obsoletes = 1 2020-06-12T17:45:29.901 INFO:teuthology.orchestra.run.smithi038:> sudo yum clean all 2020-06-12T17:45:29.942 INFO:teuthology.orchestra.run.smithi150.stdout:check_obsoletes = 1 2020-06-12T17:45:29.944 INFO:teuthology.orchestra.run.smithi150:> sudo yum clean all 2020-06-12T17:45:30.297 INFO:teuthology.orchestra.run.smithi038.stdout:Updating Subscription Management repositories. 2020-06-12T17:45:30.317 INFO:teuthology.orchestra.run.smithi150.stdout:Updating Subscription Management repositories. 2020-06-12T17:45:30.882 INFO:teuthology.orchestra.run.smithi038.stdout:50 files removed 2020-06-12T17:45:30.888 INFO:teuthology.orchestra.run.smithi150.stdout:50 files removed 2020-06-12T17:45:30.926 INFO:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-06-12T17:45:30.931 INFO:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-06-12T17:45:31.275 INFO:teuthology.orchestra.run.smithi150.stdout:Updating Subscription Management repositories. 2020-06-12T17:45:31.298 INFO:teuthology.orchestra.run.smithi038.stdout:Updating Subscription Management repositories. 2020-06-12T17:45:32.080 INFO:teuthology.orchestra.run.smithi150.stdout:ceph packages for x86_64 281 kB/s | 69 kB 00:00 2020-06-12T17:45:32.117 INFO:teuthology.orchestra.run.smithi038.stdout:ceph packages for x86_64 276 kB/s | 69 kB 00:00 2020-06-12T17:45:32.314 INFO:teuthology.orchestra.run.smithi150.stdout:ceph noarch packages 69 kB/s | 14 kB 00:00 2020-06-12T17:45:32.357 INFO:teuthology.orchestra.run.smithi038.stdout:ceph noarch packages 68 kB/s | 14 kB 00:00 2020-06-12T17:45:32.540 INFO:teuthology.orchestra.run.smithi150.stdout:ceph source packages 6.9 kB/s | 1.4 kB 00:00 2020-06-12T17:45:32.586 INFO:teuthology.orchestra.run.smithi038.stdout:ceph source packages 6.9 kB/s | 1.4 kB 00:00 2020-06-12T17:45:32.652 INFO:teuthology.orchestra.run.smithi150.stdout:Copr repo for ceph-el8 owned by ktdreyer 508 kB/s | 47 kB 00:00 2020-06-12T17:45:32.701 INFO:teuthology.orchestra.run.smithi038.stdout:Copr repo for ceph-el8 owned by ktdreyer 508 kB/s | 47 kB 00:00 2020-06-12T17:45:33.003 INFO:teuthology.orchestra.run.smithi150.stdout:Extra Packages for Enterprise Linux 21 MB/s | 6.9 MB 00:00 2020-06-12T17:45:33.100 INFO:teuthology.orchestra.run.smithi038.stdout:Extra Packages for Enterprise Linux 19 MB/s | 6.9 MB 00:00 2020-06-12T17:45:34.339 INFO:teuthology.orchestra.run.smithi150.stdout:lab-extras 4.1 MB/s | 20 kB 00:00 2020-06-12T17:45:34.560 INFO:teuthology.orchestra.run.smithi038.stdout:lab-extras 4.2 MB/s | 20 kB 00:00 2020-06-12T17:45:34.581 INFO:teuthology.orchestra.run.smithi150.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 93 MB/s | 18 MB 00:00 2020-06-12T17:45:34.845 INFO:teuthology.orchestra.run.smithi038.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 79 MB/s | 19 MB 00:00 2020-06-12T17:45:37.358 INFO:teuthology.orchestra.run.smithi150.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 97 MB/s | 19 MB 00:00 2020-06-12T17:45:37.761 INFO:teuthology.orchestra.run.smithi038.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 73 MB/s | 18 MB 00:00 2020-06-12T17:45:41.558 INFO:teuthology.orchestra.run.smithi150.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-06-12T17:45:41.559 INFO:teuthology.orchestra.run.smithi150.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-06-12T17:45:41.564 INFO:teuthology.orchestra.run.smithi150.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-06-12T17:45:41.565 INFO:teuthology.orchestra.run.smithi150.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-06-12T17:45:41.567 INFO:teuthology.orchestra.run.smithi150.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-06-12T17:45:41.567 INFO:teuthology.orchestra.run.smithi150.stdout:Package xfsprogs-5.0.0-2.el8.x86_64 is already installed. 2020-06-12T17:45:41.842 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2020-06-12T17:45:41.877 INFO:teuthology.orchestra.run.smithi150.stdout:====================================================================================================================================== 2020-06-12T17:45:41.878 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2020-06-12T17:45:41.878 INFO:teuthology.orchestra.run.smithi150.stdout:====================================================================================================================================== 2020-06-12T17:45:41.878 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2020-06-12T17:45:41.878 INFO:teuthology.orchestra.run.smithi150.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2020-06-12T17:45:41.878 INFO:teuthology.orchestra.run.smithi150.stdout: ceph x86_64 2:15.2.3-196.g91d24f4.el8 ceph 6.4 k 2020-06-12T17:45:41.879 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base x86_64 2:15.2.3-196.g91d24f4.el8 ceph 5.5 M 2020-06-12T17:45:41.879 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse x86_64 2:15.2.3-196.g91d24f4.el8 ceph 574 k 2020-06-12T17:45:41.879 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache x86_64 2:15.2.3-196.g91d24f4.el8 ceph 203 k 2020-06-12T17:45:41.879 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr x86_64 2:15.2.3-196.g91d24f4.el8 ceph 1.4 M 2020-06-12T17:45:41.879 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm noarch 2:15.2.3-196.g91d24f4.el8 ceph-noarch 45 k 2020-06-12T17:45:41.880 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard noarch 2:15.2.3-196.g91d24f4.el8 ceph-noarch 3.4 M 2020-06-12T17:45:41.880 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local noarch 2:15.2.3-196.g91d24f4.el8 ceph-noarch 8.6 M 2020-06-12T17:45:41.880 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook noarch 2:15.2.3-196.g91d24f4.el8 ceph-noarch 27 k 2020-06-12T17:45:41.880 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw x86_64 2:15.2.3-196.g91d24f4.el8 ceph 9.8 M 2020-06-12T17:45:41.880 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test x86_64 2:15.2.3-196.g91d24f4.el8 ceph 42 M 2020-06-12T17:45:41.881 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm x86_64 2:15.2.3-196.g91d24f4.el8 ceph 46 k 2020-06-12T17:45:41.881 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf-devel x86_64 0.178-7.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2020-06-12T17:45:41.881 INFO:teuthology.orchestra.run.smithi150.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2020-06-12T17:45:41.881 INFO:teuthology.orchestra.run.smithi150.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2020-06-12T17:45:41.882 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel x86_64 2:15.2.3-196.g91d24f4.el8 ceph 22 k 2020-06-12T17:45:41.882 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2 x86_64 2:15.2.3-196.g91d24f4.el8 ceph 509 k 2020-06-12T17:45:41.882 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel x86_64 2:15.2.3-196.g91d24f4.el8 ceph 141 k 2020-06-12T17:45:41.882 INFO:teuthology.orchestra.run.smithi150.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2020-06-12T17:45:41.882 INFO:teuthology.orchestra.run.smithi150.stdout: libuuid-devel x86_64 2.32.1-22.el8 rhel-8-for-x86_64-baseos-rpms 95 k 2020-06-12T17:45:41.883 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-devel x86_64 1:1.1.1c-15.el8 rhel-8-for-x86_64-baseos-rpms 2.3 M 2020-06-12T17:45:41.883 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs x86_64 2:15.2.3-196.g91d24f4.el8 ceph 162 k 2020-06-12T17:45:41.883 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados x86_64 2:15.2.3-196.g91d24f4.el8 ceph 351 k 2020-06-12T17:45:41.883 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd x86_64 2:15.2.3-196.g91d24f4.el8 ceph 331 k 2020-06-12T17:45:41.883 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw x86_64 2:15.2.3-196.g91d24f4.el8 ceph 113 k 2020-06-12T17:45:41.884 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse x86_64 2:15.2.3-196.g91d24f4.el8 ceph 72 k 2020-06-12T17:45:41.884 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror x86_64 2:15.2.3-196.g91d24f4.el8 ceph 2.7 M 2020-06-12T17:45:41.884 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd x86_64 2:15.2.3-196.g91d24f4.el8 ceph 141 k 2020-06-12T17:45:41.884 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs-devel x86_64 5.0.0-2.el8 rhel-8-for-x86_64-baseos-rpms 69 k 2020-06-12T17:45:41.884 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrading: 2020-06-12T17:45:41.885 INFO:teuthology.orchestra.run.smithi150.stdout: librados2 x86_64 2:15.2.3-196.g91d24f4.el8 ceph 3.5 M 2020-06-12T17:45:41.885 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1 x86_64 2:15.2.3-196.g91d24f4.el8 ceph 1.9 M 2020-06-12T17:45:41.885 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2020-06-12T17:45:41.885 INFO:teuthology.orchestra.run.smithi150.stdout: automake noarch 1.16.1-6.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2020-06-12T17:45:41.885 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common x86_64 2:15.2.3-196.g91d24f4.el8 ceph 21 M 2020-06-12T17:45:41.886 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards noarch 2:15.2.3-196.g91d24f4.el8 ceph-noarch 22 k 2020-06-12T17:45:41.886 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds x86_64 2:15.2.3-196.g91d24f4.el8 ceph 2.0 M 2020-06-12T17:45:41.886 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core noarch 2:15.2.3-196.g91d24f4.el8 ceph-noarch 165 k 2020-06-12T17:45:41.886 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon x86_64 2:15.2.3-196.g91d24f4.el8 ceph 4.4 M 2020-06-12T17:45:41.887 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd x86_64 2:15.2.3-196.g91d24f4.el8 ceph 17 M 2020-06-12T17:45:41.887 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts noarch 2:15.2.3-196.g91d24f4.el8 ceph-noarch 8.7 k 2020-06-12T17:45:41.887 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux x86_64 2:15.2.3-196.g91d24f4.el8 ceph 25 k 2020-06-12T17:45:41.887 INFO:teuthology.orchestra.run.smithi150.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2020-06-12T17:45:41.887 INFO:teuthology.orchestra.run.smithi150.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2020-06-12T17:45:41.888 INFO:teuthology.orchestra.run.smithi150.stdout: fuse-common x86_64 3.2.1-12.el8 rhel-8-for-x86_64-baseos-rpms 21 k 2020-06-12T17:45:41.888 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-06-12T17:45:41.888 INFO:teuthology.orchestra.run.smithi150.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2020-06-12T17:45:41.888 INFO:teuthology.orchestra.run.smithi150.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2020-06-12T17:45:41.888 INFO:teuthology.orchestra.run.smithi150.stdout: krb5-devel x86_64 1.17-18.el8 rhel-8-for-x86_64-baseos-rpms 549 k 2020-06-12T17:45:41.889 INFO:teuthology.orchestra.run.smithi150.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-06-12T17:45:41.889 INFO:teuthology.orchestra.run.smithi150.stdout: libcom_err-devel x86_64 1.44.6-3.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2020-06-12T17:45:41.889 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran x86_64 8.3.1-5.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2020-06-12T17:45:41.889 INFO:teuthology.orchestra.run.smithi150.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-06-12T17:45:41.889 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath x86_64 8.3.1-5.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2020-06-12T17:45:41.890 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq x86_64 0.9.0-1.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2020-06-12T17:45:41.890 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1 x86_64 2:15.2.3-196.g91d24f4.el8 ceph 377 k 2020-06-12T17:45:41.890 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2020-06-12T17:45:41.890 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2 x86_64 2:15.2.3-196.g91d24f4.el8 ceph 6.2 M 2020-06-12T17:45:41.890 INFO:teuthology.orchestra.run.smithi150.stdout: libselinux-devel x86_64 2.9-2.1.el8 rhel-8-for-x86_64-baseos-rpms 199 k 2020-06-12T17:45:41.891 INFO:teuthology.orchestra.run.smithi150.stdout: libsepol-devel x86_64 2.9-1.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2020-06-12T17:45:41.891 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-06-12T17:45:41.891 INFO:teuthology.orchestra.run.smithi150.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2020-06-12T17:45:41.891 INFO:teuthology.orchestra.run.smithi150.stdout: libxslt x86_64 1.1.32-4.el8 rhel-8-for-x86_64-baseos-rpms 249 k 2020-06-12T17:45:41.891 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2020-06-12T17:45:41.892 INFO:teuthology.orchestra.run.smithi150.stdout: oniguruma x86_64 6.8.2-1.el8 rhel-8-for-x86_64-appstream-rpms 188 k 2020-06-12T17:45:41.892 INFO:teuthology.orchestra.run.smithi150.stdout: openblas x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2020-06-12T17:45:41.892 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-threads x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2020-06-12T17:45:41.892 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-devel x86_64 10.32-1.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2020-06-12T17:45:41.892 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-utf16 x86_64 10.32-1.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2020-06-12T17:45:41.893 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-utf32 x86_64 10.32-1.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2020-06-12T17:45:41.893 INFO:teuthology.orchestra.run.smithi150.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2020-06-12T17:45:41.893 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2020-06-12T17:45:41.893 INFO:teuthology.orchestra.run.smithi150.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2020-06-12T17:45:41.893 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-06-12T17:45:41.894 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse x86_64 2:15.2.3-196.g91d24f4.el8 ceph 40 k 2020-06-12T17:45:41.894 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common x86_64 2:15.2.3-196.g91d24f4.el8 ceph 64 k 2020-06-12T17:45:41.894 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-06-12T17:45:41.894 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot noarch 8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-06-12T17:45:41.894 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy noarch 18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-06-12T17:45:41.895 INFO:teuthology.orchestra.run.smithi150.stdout: python3-execnet noarch 1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-06-12T17:45:41.895 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-06-12T17:45:41.895 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco noarch 6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-06-12T17:45:41.895 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools noarch 2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-06-12T17:45:41.895 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-06-12T17:45:41.895 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2020-06-12T17:45:41.896 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-06-12T17:45:41.896 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes noarch 11.0.0-2.el8 epel 1.2 M 2020-06-12T17:45:41.896 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils noarch 0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-06-12T17:45:41.896 INFO:teuthology.orchestra.run.smithi150.stdout: python3-lxml x86_64 4.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2020-06-12T17:45:41.896 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2020-06-12T17:45:41.897 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2020-06-12T17:45:41.897 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools noarch 7.2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-06-12T17:45:41.897 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2020-06-12T17:45:41.897 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2020-06-12T17:45:41.897 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2020-06-12T17:45:41.898 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan noarch 1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-06-12T17:45:41.898 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend noarch 2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-06-12T17:45:41.898 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2020-06-12T17:45:41.898 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2020-06-12T17:45:41.898 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2020-06-12T17:45:41.899 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2020-06-12T17:45:41.899 INFO:teuthology.orchestra.run.smithi150.stdout: python3-remoto noarch 1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-06-12T17:45:41.899 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru noarch 0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-06-12T17:45:41.899 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-06-12T17:45:41.899 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes noarch 2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-06-12T17:45:41.900 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa noarch 3.4.2-12.el8 epel 73 k 2020-06-12T17:45:41.900 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2020-06-12T17:45:41.900 INFO:teuthology.orchestra.run.smithi150.stdout: python3-simplegeneric noarch 0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-06-12T17:45:41.900 INFO:teuthology.orchestra.run.smithi150.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-06-12T17:45:41.900 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora noarch 1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-06-12T17:45:41.901 INFO:teuthology.orchestra.run.smithi150.stdout: python3-trustme noarch 0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-06-12T17:45:41.901 INFO:teuthology.orchestra.run.smithi150.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2020-06-12T17:45:41.901 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webencodings noarch 0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-06-12T17:45:41.901 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2020-06-12T17:45:41.901 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-06-12T17:45:41.901 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2020-06-12T17:45:41.902 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2020-06-12T17:45:41.902 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile noarch 2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-06-12T17:45:41.902 INFO:teuthology.orchestra.run.smithi150.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2020-06-12T17:45:41.902 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-06-12T17:45:41.902 INFO:teuthology.orchestra.run.smithi150.stdout: zlib-devel x86_64 1.2.11-10.el8 rhel-8-for-x86_64-baseos-rpms 56 k 2020-06-12T17:45:41.903 INFO:teuthology.orchestra.run.smithi150.stdout:Installing weak dependencies: 2020-06-12T17:45:41.903 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2020-06-12T17:45:41.903 INFO:teuthology.orchestra.run.smithi150.stdout: python3-html5lib noarch 1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2020-06-12T17:45:41.903 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:45:41.903 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2020-06-12T17:45:41.904 INFO:teuthology.orchestra.run.smithi150.stdout:====================================================================================================================================== 2020-06-12T17:45:41.904 INFO:teuthology.orchestra.run.smithi150.stdout:Install 120 Packages 2020-06-12T17:45:41.904 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrade 2 Packages 2020-06-12T17:45:41.904 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:45:41.905 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 176 M 2020-06-12T17:45:41.905 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2020-06-12T17:45:41.995 INFO:teuthology.orchestra.run.smithi150.stdout:(1/122): ceph-15.2.3-196.g91d24f4.el8.x86_64.rp 63 kB/s | 6.4 kB 00:00 2020-06-12T17:45:42.137 INFO:teuthology.orchestra.run.smithi150.stdout:(2/122): ceph-fuse-15.2.3-196.g91d24f4.el8.x86_ 4.0 MB/s | 574 kB 00:00 2020-06-12T17:45:42.165 INFO:teuthology.orchestra.run.smithi150.stdout:(3/122): ceph-immutable-object-cache-15.2.3-196 6.4 MB/s | 203 kB 00:00 2020-06-12T17:45:42.364 INFO:teuthology.orchestra.run.smithi038.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-06-12T17:45:42.365 INFO:teuthology.orchestra.run.smithi038.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-06-12T17:45:42.370 INFO:teuthology.orchestra.run.smithi038.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-06-12T17:45:42.371 INFO:teuthology.orchestra.run.smithi038.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-06-12T17:45:42.373 INFO:teuthology.orchestra.run.smithi038.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-06-12T17:45:42.373 INFO:teuthology.orchestra.run.smithi038.stdout:Package xfsprogs-5.0.0-2.el8.x86_64 is already installed. 2020-06-12T17:45:42.406 INFO:teuthology.orchestra.run.smithi150.stdout:(4/122): ceph-mds-15.2.3-196.g91d24f4.el8.x86_6 8.5 MB/s | 2.0 MB 00:00 2020-06-12T17:45:42.594 INFO:teuthology.orchestra.run.smithi150.stdout:(5/122): ceph-base-15.2.3-196.g91d24f4.el8.x86_ 7.8 MB/s | 5.5 MB 00:00 2020-06-12T17:45:42.599 INFO:teuthology.orchestra.run.smithi150.stdout:(6/122): ceph-mgr-15.2.3-196.g91d24f4.el8.x86_6 7.3 MB/s | 1.4 MB 00:00 2020-06-12T17:45:42.656 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2020-06-12T17:45:42.674 INFO:teuthology.orchestra.run.smithi038.stdout:====================================================================================================================================== 2020-06-12T17:45:42.674 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2020-06-12T17:45:42.675 INFO:teuthology.orchestra.run.smithi038.stdout:====================================================================================================================================== 2020-06-12T17:45:42.675 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2020-06-12T17:45:42.675 INFO:teuthology.orchestra.run.smithi038.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2020-06-12T17:45:42.675 INFO:teuthology.orchestra.run.smithi038.stdout: ceph x86_64 2:15.2.3-196.g91d24f4.el8 ceph 6.4 k 2020-06-12T17:45:42.675 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base x86_64 2:15.2.3-196.g91d24f4.el8 ceph 5.5 M 2020-06-12T17:45:42.676 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse x86_64 2:15.2.3-196.g91d24f4.el8 ceph 574 k 2020-06-12T17:45:42.676 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache x86_64 2:15.2.3-196.g91d24f4.el8 ceph 203 k 2020-06-12T17:45:42.676 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr x86_64 2:15.2.3-196.g91d24f4.el8 ceph 1.4 M 2020-06-12T17:45:42.676 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-cephadm noarch 2:15.2.3-196.g91d24f4.el8 ceph-noarch 45 k 2020-06-12T17:45:42.676 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard noarch 2:15.2.3-196.g91d24f4.el8 ceph-noarch 3.4 M 2020-06-12T17:45:42.677 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local noarch 2:15.2.3-196.g91d24f4.el8 ceph-noarch 8.6 M 2020-06-12T17:45:42.677 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook noarch 2:15.2.3-196.g91d24f4.el8 ceph-noarch 27 k 2020-06-12T17:45:42.677 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw x86_64 2:15.2.3-196.g91d24f4.el8 ceph 9.8 M 2020-06-12T17:45:42.677 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test x86_64 2:15.2.3-196.g91d24f4.el8 ceph 42 M 2020-06-12T17:45:42.677 INFO:teuthology.orchestra.run.smithi038.stdout: cephadm x86_64 2:15.2.3-196.g91d24f4.el8 ceph 46 k 2020-06-12T17:45:42.678 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libelf-devel x86_64 0.178-7.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2020-06-12T17:45:42.678 INFO:teuthology.orchestra.run.smithi038.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2020-06-12T17:45:42.678 INFO:teuthology.orchestra.run.smithi038.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2020-06-12T17:45:42.678 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel x86_64 2:15.2.3-196.g91d24f4.el8 ceph 22 k 2020-06-12T17:45:42.678 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2 x86_64 2:15.2.3-196.g91d24f4.el8 ceph 509 k 2020-06-12T17:45:42.679 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel x86_64 2:15.2.3-196.g91d24f4.el8 ceph 141 k 2020-06-12T17:45:42.679 INFO:teuthology.orchestra.run.smithi038.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2020-06-12T17:45:42.679 INFO:teuthology.orchestra.run.smithi038.stdout: libuuid-devel x86_64 2.32.1-22.el8 rhel-8-for-x86_64-baseos-rpms 95 k 2020-06-12T17:45:42.679 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-devel x86_64 1:1.1.1c-15.el8 rhel-8-for-x86_64-baseos-rpms 2.3 M 2020-06-12T17:45:42.679 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs x86_64 2:15.2.3-196.g91d24f4.el8 ceph 162 k 2020-06-12T17:45:42.680 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados x86_64 2:15.2.3-196.g91d24f4.el8 ceph 351 k 2020-06-12T17:45:42.680 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd x86_64 2:15.2.3-196.g91d24f4.el8 ceph 331 k 2020-06-12T17:45:42.680 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw x86_64 2:15.2.3-196.g91d24f4.el8 ceph 113 k 2020-06-12T17:45:42.680 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse x86_64 2:15.2.3-196.g91d24f4.el8 ceph 72 k 2020-06-12T17:45:42.680 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror x86_64 2:15.2.3-196.g91d24f4.el8 ceph 2.7 M 2020-06-12T17:45:42.680 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd x86_64 2:15.2.3-196.g91d24f4.el8 ceph 141 k 2020-06-12T17:45:42.681 INFO:teuthology.orchestra.run.smithi038.stdout: xfsprogs-devel x86_64 5.0.0-2.el8 rhel-8-for-x86_64-baseos-rpms 69 k 2020-06-12T17:45:42.681 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrading: 2020-06-12T17:45:42.681 INFO:teuthology.orchestra.run.smithi038.stdout: librados2 x86_64 2:15.2.3-196.g91d24f4.el8 ceph 3.5 M 2020-06-12T17:45:42.681 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1 x86_64 2:15.2.3-196.g91d24f4.el8 ceph 1.9 M 2020-06-12T17:45:42.682 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2020-06-12T17:45:42.682 INFO:teuthology.orchestra.run.smithi038.stdout: automake noarch 1.16.1-6.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2020-06-12T17:45:42.682 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common x86_64 2:15.2.3-196.g91d24f4.el8 ceph 21 M 2020-06-12T17:45:42.682 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards noarch 2:15.2.3-196.g91d24f4.el8 ceph-noarch 22 k 2020-06-12T17:45:42.682 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds x86_64 2:15.2.3-196.g91d24f4.el8 ceph 2.0 M 2020-06-12T17:45:42.683 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core noarch 2:15.2.3-196.g91d24f4.el8 ceph-noarch 165 k 2020-06-12T17:45:42.683 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon x86_64 2:15.2.3-196.g91d24f4.el8 ceph 4.4 M 2020-06-12T17:45:42.683 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd x86_64 2:15.2.3-196.g91d24f4.el8 ceph 17 M 2020-06-12T17:45:42.683 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-prometheus-alerts noarch 2:15.2.3-196.g91d24f4.el8 ceph-noarch 8.7 k 2020-06-12T17:45:42.683 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux x86_64 2:15.2.3-196.g91d24f4.el8 ceph 25 k 2020-06-12T17:45:42.684 INFO:teuthology.orchestra.run.smithi038.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2020-06-12T17:45:42.684 INFO:teuthology.orchestra.run.smithi038.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2020-06-12T17:45:42.684 INFO:teuthology.orchestra.run.smithi038.stdout: fuse-common x86_64 3.2.1-12.el8 rhel-8-for-x86_64-baseos-rpms 21 k 2020-06-12T17:45:42.684 INFO:teuthology.orchestra.run.smithi038.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-06-12T17:45:42.684 INFO:teuthology.orchestra.run.smithi038.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2020-06-12T17:45:42.684 INFO:teuthology.orchestra.run.smithi038.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2020-06-12T17:45:42.685 INFO:teuthology.orchestra.run.smithi038.stdout: krb5-devel x86_64 1.17-18.el8 rhel-8-for-x86_64-baseos-rpms 549 k 2020-06-12T17:45:42.685 INFO:teuthology.orchestra.run.smithi038.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-06-12T17:45:42.685 INFO:teuthology.orchestra.run.smithi038.stdout: libcom_err-devel x86_64 1.44.6-3.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2020-06-12T17:45:42.685 INFO:teuthology.orchestra.run.smithi038.stdout: libgfortran x86_64 8.3.1-5.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2020-06-12T17:45:42.685 INFO:teuthology.orchestra.run.smithi038.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-06-12T17:45:42.686 INFO:teuthology.orchestra.run.smithi038.stdout: libquadmath x86_64 8.3.1-5.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2020-06-12T17:45:42.686 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq x86_64 0.9.0-1.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2020-06-12T17:45:42.686 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1 x86_64 2:15.2.3-196.g91d24f4.el8 ceph 377 k 2020-06-12T17:45:42.686 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2020-06-12T17:45:42.686 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2 x86_64 2:15.2.3-196.g91d24f4.el8 ceph 6.2 M 2020-06-12T17:45:42.687 INFO:teuthology.orchestra.run.smithi038.stdout: libselinux-devel x86_64 2.9-2.1.el8 rhel-8-for-x86_64-baseos-rpms 199 k 2020-06-12T17:45:42.687 INFO:teuthology.orchestra.run.smithi038.stdout: libsepol-devel x86_64 2.9-1.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2020-06-12T17:45:42.687 INFO:teuthology.orchestra.run.smithi038.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-06-12T17:45:42.687 INFO:teuthology.orchestra.run.smithi038.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2020-06-12T17:45:42.687 INFO:teuthology.orchestra.run.smithi038.stdout: libxslt x86_64 1.1.32-4.el8 rhel-8-for-x86_64-baseos-rpms 249 k 2020-06-12T17:45:42.688 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2020-06-12T17:45:42.688 INFO:teuthology.orchestra.run.smithi038.stdout: oniguruma x86_64 6.8.2-1.el8 rhel-8-for-x86_64-appstream-rpms 188 k 2020-06-12T17:45:42.688 INFO:teuthology.orchestra.run.smithi038.stdout: openblas x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2020-06-12T17:45:42.688 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-threads x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2020-06-12T17:45:42.688 INFO:teuthology.orchestra.run.smithi038.stdout: pcre2-devel x86_64 10.32-1.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2020-06-12T17:45:42.689 INFO:teuthology.orchestra.run.smithi038.stdout: pcre2-utf16 x86_64 10.32-1.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2020-06-12T17:45:42.689 INFO:teuthology.orchestra.run.smithi038.stdout: pcre2-utf32 x86_64 10.32-1.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2020-06-12T17:45:42.689 INFO:teuthology.orchestra.run.smithi038.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2020-06-12T17:45:42.689 INFO:teuthology.orchestra.run.smithi038.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2020-06-12T17:45:42.689 INFO:teuthology.orchestra.run.smithi038.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2020-06-12T17:45:42.690 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-06-12T17:45:42.690 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse x86_64 2:15.2.3-196.g91d24f4.el8 ceph 40 k 2020-06-12T17:45:42.690 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common x86_64 2:15.2.3-196.g91d24f4.el8 ceph 64 k 2020-06-12T17:45:42.690 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-06-12T17:45:42.691 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot noarch 8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-06-12T17:45:42.691 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy noarch 18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-06-12T17:45:42.691 INFO:teuthology.orchestra.run.smithi038.stdout: python3-execnet noarch 1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-06-12T17:45:42.691 INFO:teuthology.orchestra.run.smithi038.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-06-12T17:45:42.692 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco noarch 6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-06-12T17:45:42.692 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-functools noarch 2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-06-12T17:45:42.692 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-06-12T17:45:42.692 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2020-06-12T17:45:42.692 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-06-12T17:45:42.693 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes noarch 11.0.0-2.el8 epel 1.2 M 2020-06-12T17:45:42.693 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils noarch 0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-06-12T17:45:42.693 INFO:teuthology.orchestra.run.smithi038.stdout: python3-lxml x86_64 4.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2020-06-12T17:45:42.693 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2020-06-12T17:45:42.693 INFO:teuthology.orchestra.run.smithi038.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2020-06-12T17:45:42.694 INFO:teuthology.orchestra.run.smithi038.stdout: python3-more-itertools noarch 7.2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-06-12T17:45:42.694 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2020-06-12T17:45:42.694 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2020-06-12T17:45:42.694 INFO:teuthology.orchestra.run.smithi038.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2020-06-12T17:45:42.694 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan noarch 1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-06-12T17:45:42.695 INFO:teuthology.orchestra.run.smithi038.stdout: python3-portend noarch 2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-06-12T17:45:42.695 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2020-06-12T17:45:42.695 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2020-06-12T17:45:42.695 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2020-06-12T17:45:42.695 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2020-06-12T17:45:42.696 INFO:teuthology.orchestra.run.smithi038.stdout: python3-remoto noarch 1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-06-12T17:45:42.696 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze-lru noarch 0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-06-12T17:45:42.696 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-06-12T17:45:42.696 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes noarch 2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-06-12T17:45:42.696 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa noarch 3.4.2-12.el8 epel 73 k 2020-06-12T17:45:42.697 INFO:teuthology.orchestra.run.smithi038.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2020-06-12T17:45:42.697 INFO:teuthology.orchestra.run.smithi038.stdout: python3-simplegeneric noarch 0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-06-12T17:45:42.697 INFO:teuthology.orchestra.run.smithi038.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-06-12T17:45:42.697 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora noarch 1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-06-12T17:45:42.697 INFO:teuthology.orchestra.run.smithi038.stdout: python3-trustme noarch 0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-06-12T17:45:42.698 INFO:teuthology.orchestra.run.smithi038.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2020-06-12T17:45:42.698 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webencodings noarch 0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-06-12T17:45:42.698 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2020-06-12T17:45:42.698 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-06-12T17:45:42.699 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2020-06-12T17:45:42.699 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2020-06-12T17:45:42.699 INFO:teuthology.orchestra.run.smithi038.stdout: python3-zc-lockfile noarch 2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-06-12T17:45:42.699 INFO:teuthology.orchestra.run.smithi038.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2020-06-12T17:45:42.700 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-06-12T17:45:42.700 INFO:teuthology.orchestra.run.smithi038.stdout: zlib-devel x86_64 1.2.11-10.el8 rhel-8-for-x86_64-baseos-rpms 56 k 2020-06-12T17:45:42.700 INFO:teuthology.orchestra.run.smithi038.stdout:Installing weak dependencies: 2020-06-12T17:45:42.700 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2020-06-12T17:45:42.700 INFO:teuthology.orchestra.run.smithi038.stdout: python3-html5lib noarch 1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2020-06-12T17:45:42.701 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:45:42.701 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2020-06-12T17:45:42.701 INFO:teuthology.orchestra.run.smithi038.stdout:====================================================================================================================================== 2020-06-12T17:45:42.701 INFO:teuthology.orchestra.run.smithi038.stdout:Install 120 Packages 2020-06-12T17:45:42.701 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrade 2 Packages 2020-06-12T17:45:42.702 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:45:42.702 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 176 M 2020-06-12T17:45:42.703 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2020-06-12T17:45:42.965 INFO:teuthology.orchestra.run.smithi038.stdout:(1/122): ceph-15.2.3-196.g91d24f4.el8.x86_64.rp 24 kB/s | 6.4 kB 00:00 2020-06-12T17:45:43.043 INFO:teuthology.orchestra.run.smithi150.stdout:(7/122): ceph-mon-15.2.3-196.g91d24f4.el8.x86_6 9.7 MB/s | 4.4 MB 00:00 2020-06-12T17:45:43.773 INFO:teuthology.orchestra.run.smithi038.stdout:(2/122): ceph-fuse-15.2.3-196.g91d24f4.el8.x86_ 710 kB/s | 574 kB 00:00 2020-06-12T17:45:44.043 INFO:teuthology.orchestra.run.smithi038.stdout:(3/122): ceph-immutable-object-cache-15.2.3-196 753 kB/s | 203 kB 00:00 2020-06-12T17:45:44.201 INFO:teuthology.orchestra.run.smithi150.stdout:(8/122): ceph-common-15.2.3-196.g91d24f4.el8.x8 9.0 MB/s | 21 MB 00:02 2020-06-12T17:45:44.240 INFO:teuthology.orchestra.run.smithi150.stdout:(9/122): ceph-radosgw-15.2.3-196.g91d24f4.el8.x 8.2 MB/s | 9.8 MB 00:01 2020-06-12T17:45:44.241 INFO:teuthology.orchestra.run.smithi150.stdout:(10/122): ceph-selinux-15.2.3-196.g91d24f4.el8. 620 kB/s | 25 kB 00:00 2020-06-12T17:45:44.299 INFO:teuthology.orchestra.run.smithi150.stdout:(11/122): cephadm-15.2.3-196.g91d24f4.el8.x86_6 794 kB/s | 46 kB 00:00 2020-06-12T17:45:44.351 INFO:teuthology.orchestra.run.smithi150.stdout:(12/122): libcephfs-devel-15.2.3-196.g91d24f4.e 421 kB/s | 22 kB 00:00 2020-06-12T17:45:44.422 INFO:teuthology.orchestra.run.smithi150.stdout:(13/122): libcephfs2-15.2.3-196.g91d24f4.el8.x8 7.0 MB/s | 509 kB 00:00 2020-06-12T17:45:44.480 INFO:teuthology.orchestra.run.smithi150.stdout:(14/122): librados-devel-15.2.3-196.g91d24f4.el 2.4 MB/s | 141 kB 00:00 2020-06-12T17:45:44.548 INFO:teuthology.orchestra.run.smithi150.stdout:(15/122): libradosstriper1-15.2.3-196.g91d24f4. 5.4 MB/s | 377 kB 00:00 2020-06-12T17:45:44.653 INFO:teuthology.orchestra.run.smithi150.stdout:(16/122): ceph-osd-15.2.3-196.g91d24f4.el8.x86_ 8.1 MB/s | 17 MB 00:02 2020-06-12T17:45:44.714 INFO:teuthology.orchestra.run.smithi150.stdout:(17/122): python3-ceph-argparse-15.2.3-196.g91d 650 kB/s | 40 kB 00:00 2020-06-12T17:45:44.777 INFO:teuthology.orchestra.run.smithi150.stdout:(18/122): python3-ceph-common-15.2.3-196.g91d24 1.0 MB/s | 64 kB 00:00 2020-06-12T17:45:44.847 INFO:teuthology.orchestra.run.smithi150.stdout:(19/122): python3-cephfs-15.2.3-196.g91d24f4.el 2.3 MB/s | 162 kB 00:00 2020-06-12T17:45:44.922 INFO:teuthology.orchestra.run.smithi150.stdout:(20/122): python3-rados-15.2.3-196.g91d24f4.el8 4.6 MB/s | 351 kB 00:00 2020-06-12T17:45:44.997 INFO:teuthology.orchestra.run.smithi150.stdout:(21/122): python3-rbd-15.2.3-196.g91d24f4.el8.x 4.3 MB/s | 331 kB 00:00 2020-06-12T17:45:45.064 INFO:teuthology.orchestra.run.smithi150.stdout:(22/122): python3-rgw-15.2.3-196.g91d24f4.el8.x 1.6 MB/s | 113 kB 00:00 2020-06-12T17:45:45.134 INFO:teuthology.orchestra.run.smithi150.stdout:(23/122): rbd-fuse-15.2.3-196.g91d24f4.el8.x86_ 1.1 MB/s | 72 kB 00:00 2020-06-12T17:45:45.159 INFO:teuthology.orchestra.run.smithi150.stdout:(24/122): librgw2-15.2.3-196.g91d24f4.el8.x86_6 10 MB/s | 6.2 MB 00:00 2020-06-12T17:45:45.228 INFO:teuthology.orchestra.run.smithi150.stdout:(25/122): rbd-nbd-15.2.3-196.g91d24f4.el8.x86_6 2.0 MB/s | 141 kB 00:00 2020-06-12T17:45:45.289 INFO:teuthology.orchestra.run.smithi150.stdout:(26/122): ceph-grafana-dashboards-15.2.3-196.g9 365 kB/s | 22 kB 00:00 2020-06-12T17:45:45.353 INFO:teuthology.orchestra.run.smithi150.stdout:(27/122): ceph-mgr-cephadm-15.2.3-196.g91d24f4. 717 kB/s | 45 kB 00:00 2020-06-12T17:45:45.475 INFO:teuthology.orchestra.run.smithi150.stdout:(28/122): rbd-mirror-15.2.3-196.g91d24f4.el8.x8 7.9 MB/s | 2.7 MB 00:00 2020-06-12T17:45:45.603 INFO:teuthology.orchestra.run.smithi038.stdout:(4/122): ceph-mds-15.2.3-196.g91d24f4.el8.x86_6 1.3 MB/s | 2.0 MB 00:01 2020-06-12T17:45:45.859 INFO:teuthology.orchestra.run.smithi150.stdout:(29/122): ceph-mgr-dashboard-15.2.3-196.g91d24f 6.6 MB/s | 3.4 MB 00:00 2020-06-12T17:45:45.918 INFO:teuthology.orchestra.run.smithi150.stdout:(30/122): ceph-mgr-modules-core-15.2.3-196.g91d 2.7 MB/s | 165 kB 00:00 2020-06-12T17:45:45.972 INFO:teuthology.orchestra.run.smithi150.stdout:(31/122): ceph-mgr-rook-15.2.3-196.g91d24f4.el8 504 kB/s | 27 kB 00:00 2020-06-12T17:45:46.026 INFO:teuthology.orchestra.run.smithi150.stdout:(32/122): ceph-prometheus-alerts-15.2.3-196.g91 163 kB/s | 8.7 kB 00:00 2020-06-12T17:45:46.088 INFO:teuthology.orchestra.run.smithi150.stdout:(33/122): python3-cheroot-8.2.1-1.el8.noarch.rp 2.3 MB/s | 145 kB 00:00 2020-06-12T17:45:46.110 INFO:teuthology.orchestra.run.smithi150.stdout:(34/122): python3-cherrypy-18.4.0-1.el8.noarch. 17 MB/s | 385 kB 00:00 2020-06-12T17:45:46.128 INFO:teuthology.orchestra.run.smithi150.stdout:(35/122): python3-execnet-1.7.1-1.el8.2.noarch. 20 MB/s | 356 kB 00:00 2020-06-12T17:45:46.142 INFO:teuthology.orchestra.run.smithi150.stdout:(36/122): python3-jaraco-6.2-6.el8.noarch.rpm 823 kB/s | 11 kB 00:00 2020-06-12T17:45:46.154 INFO:teuthology.orchestra.run.smithi150.stdout:(37/122): python3-jaraco-functools-2.0-4.el8.no 1.4 MB/s | 18 kB 00:00 2020-06-12T17:45:46.164 INFO:teuthology.orchestra.run.smithi150.stdout:(38/122): python3-logutils-0.3.5-11.el8.noarch. 5.2 MB/s | 49 kB 00:00 2020-06-12T17:45:46.178 INFO:teuthology.orchestra.run.smithi150.stdout:(39/122): python3-more-itertools-7.2.0-4.el8.no 6.0 MB/s | 59 kB 00:00 2020-06-12T17:45:46.186 INFO:teuthology.orchestra.run.smithi150.stdout:(40/122): python3-pecan-1.3.2-9.el8.noarch.rpm 22 MB/s | 283 kB 00:00 2020-06-12T17:45:46.195 INFO:teuthology.orchestra.run.smithi150.stdout:(41/122): python3-portend-2.6-1.el8.noarch.rpm 1.8 MB/s | 16 kB 00:00 2020-06-12T17:45:46.206 INFO:teuthology.orchestra.run.smithi150.stdout:(42/122): python3-remoto-1.1.4-4.el8.noarch.rpm 4.6 MB/s | 48 kB 00:00 2020-06-12T17:45:46.217 INFO:teuthology.orchestra.run.smithi150.stdout:(43/122): python3-repoze-lru-0.7-6.el8.noarch.r 3.1 MB/s | 34 kB 00:00 2020-06-12T17:45:46.228 INFO:teuthology.orchestra.run.smithi150.stdout:(44/122): python3-routes-2.4.1-12.el8.noarch.rp 16 MB/s | 197 kB 00:00 2020-06-12T17:45:46.251 INFO:teuthology.orchestra.run.smithi150.stdout:(45/122): python3-simplegeneric-0.8.1-17.el8.no 845 kB/s | 19 kB 00:00 2020-06-12T17:45:46.260 INFO:teuthology.orchestra.run.smithi150.stdout:(46/122): python3-singledispatch-3.4.0.3-18.el8 2.8 MB/s | 24 kB 00:00 2020-06-12T17:45:46.270 INFO:teuthology.orchestra.run.smithi150.stdout:(47/122): python3-tempora-1.14.1-5.el8.noarch.r 3.0 MB/s | 30 kB 00:00 2020-06-12T17:45:46.278 INFO:teuthology.orchestra.run.smithi150.stdout:(48/122): python3-trustme-0.5.2-4.el8.noarch.rp 3.1 MB/s | 27 kB 00:00 2020-06-12T17:45:46.287 INFO:teuthology.orchestra.run.smithi150.stdout:(49/122): python3-zc-lockfile-2.0-2.el8.noarch. 2.6 MB/s | 23 kB 00:00 2020-06-12T17:45:46.392 INFO:teuthology.orchestra.run.smithi150.stdout:(50/122): ceph-mgr-diskprediction-local-15.2.3- 9.4 MB/s | 8.6 MB 00:00 2020-06-12T17:45:46.393 INFO:teuthology.orchestra.run.smithi150.stdout:(51/122): fmt-6.2.1-1.el8.x86_64.rpm 1.1 MB/s | 116 kB 00:00 2020-06-12T17:45:46.431 INFO:teuthology.orchestra.run.smithi150.stdout:(52/122): leveldb-1.22-1.el8.x86_64.rpm 4.7 MB/s | 181 kB 00:00 2020-06-12T17:45:46.450 INFO:teuthology.orchestra.run.smithi150.stdout:(53/122): liboath-2.6.2-3.el8.x86_64.rpm 3.0 MB/s | 59 kB 00:00 2020-06-12T17:45:46.470 INFO:teuthology.orchestra.run.smithi150.stdout:(54/122): libunwind-1.3.1-3.el8.x86_64.rpm 3.8 MB/s | 75 kB 00:00 2020-06-12T17:45:46.489 INFO:teuthology.orchestra.run.smithi150.stdout:(55/122): python3-apipkg-1.5-6.el8.noarch.rpm 1.1 MB/s | 21 kB 00:00 2020-06-12T17:45:46.507 INFO:teuthology.orchestra.run.smithi150.stdout:(56/122): gperftools-libs-2.7-6.el8.x86_64.rpm 2.7 MB/s | 315 kB 00:00 2020-06-12T17:45:46.508 INFO:teuthology.orchestra.run.smithi150.stdout:(57/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.2 MB/s | 44 kB 00:00 2020-06-12T17:45:46.529 INFO:teuthology.orchestra.run.smithi150.stdout:(58/122): python3-beautifulsoup4-4.6.3-2.el8.1. 9.0 MB/s | 185 kB 00:00 2020-06-12T17:45:46.529 INFO:teuthology.orchestra.run.smithi150.stdout:(59/122): python3-cachetools-3.1.1-4.el8.noarch 1.6 MB/s | 33 kB 00:00 2020-06-12T17:45:46.539 INFO:teuthology.orchestra.run.smithi038.stdout:(5/122): ceph-mgr-15.2.3-196.g91d24f4.el8.x86_6 1.5 MB/s | 1.4 MB 00:00 2020-06-12T17:45:46.548 INFO:teuthology.orchestra.run.smithi150.stdout:(60/122): python3-certifi-2018.10.15-7.el8.noar 812 kB/s | 16 kB 00:00 2020-06-12T17:45:46.549 INFO:teuthology.orchestra.run.smithi150.stdout:(61/122): python3-cssselect-0.9.2-10.el8.noarch 1.9 MB/s | 40 kB 00:00 2020-06-12T17:45:46.568 INFO:teuthology.orchestra.run.smithi150.stdout:(62/122): python3-google-auth-1.1.1-10.el8.noar 4.0 MB/s | 81 kB 00:00 2020-06-12T17:45:46.588 INFO:teuthology.orchestra.run.smithi150.stdout:(63/122): python3-rsa-3.4.2-12.el8.noarch.rpm 3.7 MB/s | 73 kB 00:00 2020-06-12T17:45:46.609 INFO:teuthology.orchestra.run.smithi150.stdout:(64/122): python3-waitress-1.2.1-2.el8.1.noarch 11 MB/s | 241 kB 00:00 2020-06-12T17:45:46.626 INFO:teuthology.orchestra.run.smithi150.stdout:(65/122): python3-kubernetes-11.0.0-2.el8.noarc 15 MB/s | 1.2 MB 00:00 2020-06-12T17:45:46.630 INFO:teuthology.orchestra.run.smithi150.stdout:(66/122): python3-webob-1.8.5-1.el8.1.noarch.rp 12 MB/s | 251 kB 00:00 2020-06-12T17:45:46.649 INFO:teuthology.orchestra.run.smithi150.stdout:(67/122): python3-websocket-client-0.56.0-5.el8 3.1 MB/s | 61 kB 00:00 2020-06-12T17:45:46.650 INFO:teuthology.orchestra.run.smithi150.stdout:(68/122): python3-webtest-2.0.33-1.el8.noarch.r 4.3 MB/s | 85 kB 00:00 2020-06-12T17:45:46.667 INFO:teuthology.orchestra.run.smithi150.stdout:(69/122): xmlstarlet-1.6.1-11.el8.x86_64.rpm 3.0 MB/s | 69 kB 00:00 2020-06-12T17:45:46.690 INFO:teuthology.orchestra.run.smithi150.stdout:(70/122): automake-1.16.1-6.el8.noarch.rpm 18 MB/s | 713 kB 00:00 2020-06-12T17:45:46.702 INFO:teuthology.orchestra.run.smithi150.stdout:(71/122): python3-webencodings-0.5.1-6.el8.noar 787 kB/s | 27 kB 00:00 2020-06-12T17:45:46.729 INFO:teuthology.orchestra.run.smithi150.stdout:(72/122): python3-lxml-4.2.3-1.el8.x86_64.rpm 43 MB/s | 1.5 MB 00:00 2020-06-12T17:45:46.731 INFO:teuthology.orchestra.run.smithi150.stdout:(73/122): jq-1.5-12.el8.x86_64.rpm 5.4 MB/s | 161 kB 00:00 2020-06-12T17:45:46.754 INFO:teuthology.orchestra.run.smithi150.stdout:(74/122): python3-werkzeug-0.12.2-4.el8.noarch. 18 MB/s | 457 kB 00:00 2020-06-12T17:45:46.762 INFO:teuthology.orchestra.run.smithi150.stdout:(75/122): python3-mako-1.0.6-13.el8.noarch.rpm 5.0 MB/s | 157 kB 00:00 2020-06-12T17:45:46.775 INFO:teuthology.orchestra.run.smithi150.stdout:(76/122): python3-jsonpatch-1.21-2.el8.noarch.r 1.2 MB/s | 27 kB 00:00 2020-06-12T17:45:46.786 INFO:teuthology.orchestra.run.smithi150.stdout:(77/122): python3-jsonpointer-1.10-11.el8.noarc 833 kB/s | 20 kB 00:00 2020-06-12T17:45:46.801 INFO:teuthology.orchestra.run.smithi150.stdout:(78/122): python3-html5lib-0.999999999-6.el8.no 9.8 MB/s | 214 kB 00:00 2020-06-12T17:45:46.812 INFO:teuthology.orchestra.run.smithi150.stdout:(79/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 4.8 MB/s | 126 kB 00:00 2020-06-12T17:45:46.825 INFO:teuthology.orchestra.run.smithi150.stdout:(80/122): python3-pytz-2017.2-9.el8.noarch.rpm 2.7 MB/s | 54 kB 00:00 2020-06-12T17:45:46.837 INFO:teuthology.orchestra.run.smithi150.stdout:(81/122): python3-pyasn1-modules-0.3.7-6.el8.no 4.4 MB/s | 110 kB 00:00 2020-06-12T17:45:46.848 INFO:teuthology.orchestra.run.smithi150.stdout:(82/122): python3-prettytable-0.7.2-14.el8.noar 1.9 MB/s | 44 kB 00:00 2020-06-12T17:45:46.860 INFO:teuthology.orchestra.run.smithi150.stdout:(83/122): oniguruma-6.8.2-1.el8.x86_64.rpm 7.8 MB/s | 188 kB 00:00 2020-06-12T17:45:46.873 INFO:teuthology.orchestra.run.smithi150.stdout:(84/122): python3-markupsafe-0.23-19.el8.x86_64 1.5 MB/s | 39 kB 00:00 2020-06-12T17:45:46.886 INFO:teuthology.orchestra.run.smithi150.stdout:(85/122): flex-2.6.1-9.el8.x86_64.rpm 13 MB/s | 320 kB 00:00 2020-06-12T17:45:46.899 INFO:teuthology.orchestra.run.smithi150.stdout:(86/122): librdkafka-0.11.4-1.el8.x86_64.rpm 14 MB/s | 353 kB 00:00 2020-06-12T17:45:46.919 INFO:teuthology.orchestra.run.smithi150.stdout:(87/122): bison-3.0.4-10.el8.x86_64.rpm 23 MB/s | 688 kB 00:00 2020-06-12T17:45:46.934 INFO:teuthology.orchestra.run.smithi150.stdout:(88/122): libtool-2.4.6-25.el8.x86_64.rpm 22 MB/s | 709 kB 00:00 2020-06-12T17:45:46.959 INFO:teuthology.orchestra.run.smithi150.stdout:(89/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 12 MB/s | 259 kB 00:00 2020-06-12T17:45:46.981 INFO:teuthology.orchestra.run.smithi150.stdout:(90/122): python3-numpy-1.14.3-9.el8.x86_64.rpm 61 MB/s | 3.7 MB 00:00 2020-06-12T17:45:46.983 INFO:teuthology.orchestra.run.smithi150.stdout:(91/122): python3-numpy-f2py-1.14.3-9.el8.x86_6 8.0 MB/s | 225 kB 00:00 2020-06-12T17:45:47.057 INFO:teuthology.orchestra.run.smithi150.stdout:(92/122): openblas-threads-0.3.3-5.el8.x86_64.r 68 MB/s | 4.4 MB 00:00 2020-06-12T17:45:47.109 INFO:teuthology.orchestra.run.smithi150.stdout:(93/122): openblas-0.3.3-5.el8.x86_64.rpm 76 MB/s | 4.3 MB 00:00 2020-06-12T17:45:47.238 INFO:teuthology.orchestra.run.smithi150.stdout:(94/122): python3-scipy-1.0.0-20.module+el8.1.0 57 MB/s | 15 MB 00:00 2020-06-12T17:45:47.241 INFO:teuthology.orchestra.run.smithi150.stdout:(95/122): socat-1.7.3.3-2.el8.x86_64.rpm 2.2 MB/s | 302 kB 00:00 2020-06-12T17:45:47.258 INFO:teuthology.orchestra.run.smithi150.stdout:(96/122): libverto-devel-0.3.0-5.el8.x86_64.rpm 899 kB/s | 18 kB 00:00 2020-06-12T17:45:47.277 INFO:teuthology.orchestra.run.smithi150.stdout:(97/122): pcre2-utf32-10.32-1.el8.x86_64.rpm 6.9 MB/s | 220 kB 00:00 2020-06-12T17:45:47.285 INFO:teuthology.orchestra.run.smithi150.stdout:(98/122): zlib-devel-1.2.11-10.el8.x86_64.rpm 2.1 MB/s | 56 kB 00:00 2020-06-12T17:45:47.302 INFO:teuthology.orchestra.run.smithi150.stdout:(99/122): python3-requests-oauthlib-1.0.0-1.el8 1.7 MB/s | 43 kB 00:00 2020-06-12T17:45:47.310 INFO:teuthology.orchestra.run.smithi150.stdout:(100/122): fuse-2.9.7-12.el8.x86_64.rpm 3.2 MB/s | 83 kB 00:00 2020-06-12T17:45:47.327 INFO:teuthology.orchestra.run.smithi150.stdout:(101/122): keyutils-libs-devel-1.5.10-6.el8.x86 1.9 MB/s | 48 kB 00:00 2020-06-12T17:45:47.333 INFO:teuthology.orchestra.run.smithi150.stdout:(102/122): python3-jwt-1.6.1-2.el8.noarch.rpm 1.8 MB/s | 43 kB 00:00 2020-06-12T17:45:47.355 INFO:teuthology.orchestra.run.smithi150.stdout:(103/122): pcre2-devel-10.32-1.el8.x86_64.rpm 21 MB/s | 605 kB 00:00 2020-06-12T17:45:47.362 INFO:teuthology.orchestra.run.smithi150.stdout:(104/122): librabbitmq-0.9.0-1.el8.x86_64.rpm 1.6 MB/s | 47 kB 00:00 2020-06-12T17:45:47.380 INFO:teuthology.orchestra.run.smithi150.stdout:(105/122): python3-oauthlib-2.1.0-1.el8.noarch. 6.0 MB/s | 155 kB 00:00 2020-06-12T17:45:47.388 INFO:teuthology.orchestra.run.smithi150.stdout:(106/122): fuse-common-3.2.1-12.el8.x86_64.rpm 827 kB/s | 21 kB 00:00 2020-06-12T17:45:47.407 INFO:teuthology.orchestra.run.smithi150.stdout:(107/122): pcre2-utf16-10.32-1.el8.x86_64.rpm 8.4 MB/s | 229 kB 00:00 2020-06-12T17:45:47.415 INFO:teuthology.orchestra.run.smithi150.stdout:(108/122): libsepol-devel-2.9-1.el8.x86_64.rpm 3.1 MB/s | 86 kB 00:00 2020-06-12T17:45:47.427 INFO:teuthology.orchestra.run.smithi150.stdout:(109/122): libselinux-devel-2.9-2.1.el8.x86_64. 9.5 MB/s | 199 kB 00:00 2020-06-12T17:45:47.430 INFO:teuthology.orchestra.run.smithi038.stdout:(6/122): ceph-common-15.2.3-196.g91d24f4.el8.x8 4.4 MB/s | 21 MB 00:04 2020-06-12T17:45:47.445 INFO:teuthology.orchestra.run.smithi150.stdout:(110/122): libaio-devel-0.3.112-1.el8.x86_64.rp 634 kB/s | 19 kB 00:00 2020-06-12T17:45:47.452 INFO:teuthology.orchestra.run.smithi150.stdout:(111/122): libcom_err-devel-1.44.6-3.el8.x86_64 1.5 MB/s | 38 kB 00:00 2020-06-12T17:45:47.465 INFO:teuthology.orchestra.run.smithi150.stdout:(112/122): libuuid-devel-2.32.1-22.el8.x86_64.r 4.6 MB/s | 95 kB 00:00 2020-06-12T17:45:47.492 INFO:teuthology.orchestra.run.smithi150.stdout:(113/122): krb5-devel-1.17-18.el8.x86_64.rpm 20 MB/s | 549 kB 00:00 2020-06-12T17:45:47.499 INFO:teuthology.orchestra.run.smithi150.stdout:(114/122): openssl-devel-1.1.1c-15.el8.x86_64.r 49 MB/s | 2.3 MB 00:00 2020-06-12T17:45:47.522 INFO:teuthology.orchestra.run.smithi150.stdout:(115/122): libxslt-1.1.32-4.el8.x86_64.rpm 8.2 MB/s | 249 kB 00:00 2020-06-12T17:45:47.529 INFO:teuthology.orchestra.run.smithi150.stdout:(116/122): libquadmath-8.3.1-5.el8.x86_64.rpm 6.4 MB/s | 169 kB 00:00 2020-06-12T17:45:47.541 INFO:teuthology.orchestra.run.smithi150.stdout:(117/122): xfsprogs-devel-5.0.0-2.el8.x86_64.rp 3.5 MB/s | 69 kB 00:00 2020-06-12T17:45:47.553 INFO:teuthology.orchestra.run.smithi150.stdout:(118/122): elfutils-libelf-devel-0.178-7.el8.x8 2.5 MB/s | 58 kB 00:00 2020-06-12T17:45:47.567 INFO:teuthology.orchestra.run.smithi150.stdout:(119/122): libgfortran-8.3.1-5.el8.x86_64.rpm 24 MB/s | 639 kB 00:00 2020-06-12T17:45:47.726 INFO:teuthology.orchestra.run.smithi038.stdout:(7/122): ceph-base-15.2.3-196.g91d24f4.el8.x86_ 1.1 MB/s | 5.5 MB 00:05 2020-06-12T17:45:47.985 INFO:teuthology.orchestra.run.smithi150.stdout:(120/122): ceph-test-15.2.3-196.g91d24f4.el8.x8 11 MB/s | 42 MB 00:03 2020-06-12T17:45:48.064 INFO:teuthology.orchestra.run.smithi150.stdout:(121/122): librbd1-15.2.3-196.g91d24f4.el8.x86_ 3.9 MB/s | 1.9 MB 00:00 2020-06-12T17:45:48.096 INFO:teuthology.orchestra.run.smithi038.stdout:(8/122): ceph-mon-15.2.3-196.g91d24f4.el8.x86_6 2.8 MB/s | 4.4 MB 00:01 2020-06-12T17:45:48.126 INFO:teuthology.orchestra.run.smithi038.stdout:(9/122): ceph-selinux-15.2.3-196.g91d24f4.el8.x 826 kB/s | 25 kB 00:00 2020-06-12T17:45:48.127 INFO:teuthology.orchestra.run.smithi150.stdout:(122/122): librados2-15.2.3-196.g91d24f4.el8.x8 6.2 MB/s | 3.5 MB 00:00 2020-06-12T17:45:48.131 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2020-06-12T17:45:48.131 INFO:teuthology.orchestra.run.smithi150.stdout:Total 28 MB/s | 176 MB 00:06 2020-06-12T17:45:48.133 INFO:teuthology.orchestra.run.smithi150.stderr:warning: /var/cache/dnf/copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8-0161c520b1c9fbf7/packages/python3-cheroot-8.2.1-1.el8.noarch.rpm: Header V3 RSA/SHA1 Signature, key ID 2a8a41ec: NOKEY 2020-06-12T17:45:48.182 INFO:teuthology.orchestra.run.smithi150.stdout:Copr repo for ceph-el8 owned by ktdreyer 20 kB/s | 1.0 kB 00:00 2020-06-12T17:45:48.290 INFO:teuthology.orchestra.run.smithi150.stderr:Importing GPG key 0x2A8A41EC: 2020-06-12T17:45:48.290 INFO:teuthology.orchestra.run.smithi150.stderr: Userid : "ktdreyer_ceph-el8 (None) " 2020-06-12T17:45:48.290 INFO:teuthology.orchestra.run.smithi150.stderr: Fingerprint: 64D3 346F FD63 5D2D B5D0 5873 1014 BDBE 2A8A 41EC 2020-06-12T17:45:48.291 INFO:teuthology.orchestra.run.smithi150.stderr: From : https://download.copr.fedorainfracloud.org/results/ktdreyer/ceph-el8/pubkey.gpg 2020-06-12T17:45:48.402 INFO:teuthology.orchestra.run.smithi150.stdout:Key imported successfully 2020-06-12T17:45:48.466 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2020-06-12T17:45:48.578 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2020-06-12T17:45:48.578 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2020-06-12T17:45:48.827 INFO:teuthology.orchestra.run.smithi038.stdout:(10/122): ceph-osd-15.2.3-196.g91d24f4.el8.x86_ 12 MB/s | 17 MB 00:01 2020-06-12T17:45:48.853 INFO:teuthology.orchestra.run.smithi038.stdout:(11/122): cephadm-15.2.3-196.g91d24f4.el8.x86_6 1.8 MB/s | 46 kB 00:00 2020-06-12T17:45:48.876 INFO:teuthology.orchestra.run.smithi038.stdout:(12/122): libcephfs-devel-15.2.3-196.g91d24f4.e 936 kB/s | 22 kB 00:00 2020-06-12T17:45:48.925 INFO:teuthology.orchestra.run.smithi038.stdout:(13/122): libcephfs2-15.2.3-196.g91d24f4.el8.x8 10 MB/s | 509 kB 00:00 2020-06-12T17:45:48.950 INFO:teuthology.orchestra.run.smithi038.stdout:(14/122): librados-devel-15.2.3-196.g91d24f4.el 5.6 MB/s | 141 kB 00:00 2020-06-12T17:45:48.977 INFO:teuthology.orchestra.run.smithi038.stdout:(15/122): libradosstriper1-15.2.3-196.g91d24f4. 14 MB/s | 377 kB 00:00 2020-06-12T17:45:49.381 INFO:teuthology.orchestra.run.smithi038.stdout:(16/122): librgw2-15.2.3-196.g91d24f4.el8.x86_6 15 MB/s | 6.2 MB 00:00 2020-06-12T17:45:49.407 INFO:teuthology.orchestra.run.smithi038.stdout:(17/122): python3-ceph-argparse-15.2.3-196.g91d 1.5 MB/s | 40 kB 00:00 2020-06-12T17:45:49.431 INFO:teuthology.orchestra.run.smithi038.stdout:(18/122): python3-ceph-common-15.2.3-196.g91d24 2.6 MB/s | 64 kB 00:00 2020-06-12T17:45:49.456 INFO:teuthology.orchestra.run.smithi038.stdout:(19/122): python3-cephfs-15.2.3-196.g91d24f4.el 6.4 MB/s | 162 kB 00:00 2020-06-12T17:45:49.483 INFO:teuthology.orchestra.run.smithi038.stdout:(20/122): python3-rados-15.2.3-196.g91d24f4.el8 13 MB/s | 351 kB 00:00 2020-06-12T17:45:49.511 INFO:teuthology.orchestra.run.smithi038.stdout:(21/122): python3-rbd-15.2.3-196.g91d24f4.el8.x 12 MB/s | 331 kB 00:00 2020-06-12T17:45:49.535 INFO:teuthology.orchestra.run.smithi038.stdout:(22/122): python3-rgw-15.2.3-196.g91d24f4.el8.x 4.6 MB/s | 113 kB 00:00 2020-06-12T17:45:49.559 INFO:teuthology.orchestra.run.smithi038.stdout:(23/122): rbd-fuse-15.2.3-196.g91d24f4.el8.x86_ 3.0 MB/s | 72 kB 00:00 2020-06-12T17:45:49.750 INFO:teuthology.orchestra.run.smithi038.stdout:(24/122): rbd-mirror-15.2.3-196.g91d24f4.el8.x8 14 MB/s | 2.7 MB 00:00 2020-06-12T17:45:49.775 INFO:teuthology.orchestra.run.smithi038.stdout:(25/122): rbd-nbd-15.2.3-196.g91d24f4.el8.x86_6 5.5 MB/s | 141 kB 00:00 2020-06-12T17:45:49.799 INFO:teuthology.orchestra.run.smithi038.stdout:(26/122): ceph-grafana-dashboards-15.2.3-196.g9 958 kB/s | 22 kB 00:00 2020-06-12T17:45:49.803 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2020-06-12T17:45:49.806 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2020-06-12T17:45:49.822 INFO:teuthology.orchestra.run.smithi038.stdout:(27/122): ceph-mgr-cephadm-15.2.3-196.g91d24f4. 1.9 MB/s | 45 kB 00:00 2020-06-12T17:45:50.006 INFO:teuthology.orchestra.run.smithi038.stdout:(28/122): ceph-radosgw-15.2.3-196.g91d24f4.el8. 4.3 MB/s | 9.8 MB 00:02 2020-06-12T17:45:50.067 INFO:teuthology.orchestra.run.smithi038.stdout:(29/122): ceph-mgr-dashboard-15.2.3-196.g91d24f 14 MB/s | 3.4 MB 00:00 2020-06-12T17:45:50.093 INFO:teuthology.orchestra.run.smithi038.stdout:(30/122): ceph-mgr-modules-core-15.2.3-196.g91d 6.3 MB/s | 165 kB 00:00 2020-06-12T17:45:50.116 INFO:teuthology.orchestra.run.smithi038.stdout:(31/122): ceph-mgr-rook-15.2.3-196.g91d24f4.el8 1.1 MB/s | 27 kB 00:00 2020-06-12T17:45:50.139 INFO:teuthology.orchestra.run.smithi038.stdout:(32/122): ceph-prometheus-alerts-15.2.3-196.g91 380 kB/s | 8.7 kB 00:00 2020-06-12T17:45:50.200 INFO:teuthology.orchestra.run.smithi038.stdout:(33/122): python3-cheroot-8.2.1-1.el8.noarch.rp 2.4 MB/s | 145 kB 00:00 2020-06-12T17:45:50.221 INFO:teuthology.orchestra.run.smithi038.stdout:(34/122): python3-cherrypy-18.4.0-1.el8.noarch. 18 MB/s | 385 kB 00:00 2020-06-12T17:45:50.235 INFO:teuthology.orchestra.run.smithi038.stdout:(35/122): python3-execnet-1.7.1-1.el8.2.noarch. 25 MB/s | 356 kB 00:00 2020-06-12T17:45:50.244 INFO:teuthology.orchestra.run.smithi038.stdout:(36/122): python3-jaraco-6.2-6.el8.noarch.rpm 1.3 MB/s | 11 kB 00:00 2020-06-12T17:45:50.252 INFO:teuthology.orchestra.run.smithi038.stdout:(37/122): python3-jaraco-functools-2.0-4.el8.no 2.1 MB/s | 18 kB 00:00 2020-06-12T17:45:50.262 INFO:teuthology.orchestra.run.smithi038.stdout:(38/122): python3-logutils-0.3.5-11.el8.noarch. 5.0 MB/s | 49 kB 00:00 2020-06-12T17:45:50.271 INFO:teuthology.orchestra.run.smithi038.stdout:(39/122): python3-more-itertools-7.2.0-4.el8.no 6.4 MB/s | 59 kB 00:00 2020-06-12T17:45:50.284 INFO:teuthology.orchestra.run.smithi038.stdout:(40/122): python3-pecan-1.3.2-9.el8.noarch.rpm 23 MB/s | 283 kB 00:00 2020-06-12T17:45:50.304 INFO:teuthology.orchestra.run.smithi038.stdout:(41/122): python3-portend-2.6-1.el8.noarch.rpm 815 kB/s | 16 kB 00:00 2020-06-12T17:45:50.313 INFO:teuthology.orchestra.run.smithi038.stdout:(42/122): python3-remoto-1.1.4-4.el8.noarch.rpm 5.2 MB/s | 48 kB 00:00 2020-06-12T17:45:50.329 INFO:teuthology.orchestra.run.smithi038.stdout:(43/122): python3-repoze-lru-0.7-6.el8.noarch.r 2.0 MB/s | 34 kB 00:00 2020-06-12T17:45:50.342 INFO:teuthology.orchestra.run.smithi038.stdout:(44/122): python3-routes-2.4.1-12.el8.noarch.rp 15 MB/s | 197 kB 00:00 2020-06-12T17:45:50.351 INFO:teuthology.orchestra.run.smithi038.stdout:(45/122): python3-simplegeneric-0.8.1-17.el8.no 2.2 MB/s | 19 kB 00:00 2020-06-12T17:45:50.361 INFO:teuthology.orchestra.run.smithi038.stdout:(46/122): python3-singledispatch-3.4.0.3-18.el8 2.3 MB/s | 24 kB 00:00 2020-06-12T17:45:50.371 INFO:teuthology.orchestra.run.smithi038.stdout:(47/122): python3-tempora-1.14.1-5.el8.noarch.r 3.1 MB/s | 30 kB 00:00 2020-06-12T17:45:50.379 INFO:teuthology.orchestra.run.smithi038.stdout:(48/122): python3-trustme-0.5.2-4.el8.noarch.rp 3.1 MB/s | 27 kB 00:00 2020-06-12T17:45:50.389 INFO:teuthology.orchestra.run.smithi038.stdout:(49/122): python3-zc-lockfile-2.0-2.el8.noarch. 2.5 MB/s | 23 kB 00:00 2020-06-12T17:45:50.467 INFO:teuthology.orchestra.run.smithi038.stdout:(50/122): fmt-6.2.1-1.el8.x86_64.rpm 1.5 MB/s | 116 kB 00:00 2020-06-12T17:45:50.499 INFO:teuthology.orchestra.run.smithi038.stdout:(51/122): gperftools-libs-2.7-6.el8.x86_64.rpm 9.5 MB/s | 315 kB 00:00 2020-06-12T17:45:50.516 INFO:teuthology.orchestra.run.smithi038.stdout:(52/122): leveldb-1.22-1.el8.x86_64.rpm 11 MB/s | 181 kB 00:00 2020-06-12T17:45:50.532 INFO:teuthology.orchestra.run.smithi038.stdout:(53/122): liboath-2.6.2-3.el8.x86_64.rpm 3.6 MB/s | 59 kB 00:00 2020-06-12T17:45:50.555 INFO:teuthology.orchestra.run.smithi038.stdout:(54/122): libunwind-1.3.1-3.el8.x86_64.rpm 4.5 MB/s | 75 kB 00:00 2020-06-12T17:45:50.564 INFO:teuthology.orchestra.run.smithi038.stdout:(55/122): python3-apipkg-1.5-6.el8.noarch.rpm 1.3 MB/s | 21 kB 00:00 2020-06-12T17:45:50.583 INFO:teuthology.orchestra.run.smithi038.stdout:(56/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.7 MB/s | 44 kB 00:00 2020-06-12T17:45:50.597 INFO:teuthology.orchestra.run.smithi038.stdout:(57/122): python3-beautifulsoup4-4.6.3-2.el8.1. 11 MB/s | 185 kB 00:00 2020-06-12T17:45:50.613 INFO:teuthology.orchestra.run.smithi038.stdout:(58/122): python3-cachetools-3.1.1-4.el8.noarch 2.1 MB/s | 33 kB 00:00 2020-06-12T17:45:50.629 INFO:teuthology.orchestra.run.smithi038.stdout:(59/122): python3-certifi-2018.10.15-7.el8.noar 1.0 MB/s | 16 kB 00:00 2020-06-12T17:45:50.645 INFO:teuthology.orchestra.run.smithi038.stdout:(60/122): python3-cssselect-0.9.2-10.el8.noarch 2.5 MB/s | 40 kB 00:00 2020-06-12T17:45:50.661 INFO:teuthology.orchestra.run.smithi038.stdout:(61/122): python3-google-auth-1.1.1-10.el8.noar 4.9 MB/s | 81 kB 00:00 2020-06-12T17:45:50.726 INFO:teuthology.orchestra.run.smithi038.stdout:(62/122): python3-kubernetes-11.0.0-2.el8.noarc 18 MB/s | 1.2 MB 00:00 2020-06-12T17:45:50.742 INFO:teuthology.orchestra.run.smithi038.stdout:(63/122): python3-rsa-3.4.2-12.el8.noarch.rpm 4.3 MB/s | 73 kB 00:00 2020-06-12T17:45:50.760 INFO:teuthology.orchestra.run.smithi038.stdout:(64/122): python3-waitress-1.2.1-2.el8.1.noarch 13 MB/s | 241 kB 00:00 2020-06-12T17:45:50.777 INFO:teuthology.orchestra.run.smithi038.stdout:(65/122): python3-webob-1.8.5-1.el8.1.noarch.rp 14 MB/s | 251 kB 00:00 2020-06-12T17:45:50.794 INFO:teuthology.orchestra.run.smithi038.stdout:(66/122): python3-websocket-client-0.56.0-5.el8 3.8 MB/s | 61 kB 00:00 2020-06-12T17:45:50.810 INFO:teuthology.orchestra.run.smithi038.stdout:(67/122): python3-webtest-2.0.33-1.el8.noarch.r 5.2 MB/s | 85 kB 00:00 2020-06-12T17:45:50.826 INFO:teuthology.orchestra.run.smithi038.stdout:(68/122): xmlstarlet-1.6.1-11.el8.x86_64.rpm 4.2 MB/s | 69 kB 00:00 2020-06-12T17:45:50.867 INFO:teuthology.orchestra.run.smithi038.stdout:(69/122): libverto-devel-0.3.0-5.el8.x86_64.rpm 436 kB/s | 18 kB 00:00 2020-06-12T17:45:50.896 INFO:teuthology.orchestra.run.smithi038.stdout:(70/122): pcre2-utf32-10.32-1.el8.x86_64.rpm 7.4 MB/s | 220 kB 00:00 2020-06-12T17:45:50.923 INFO:teuthology.orchestra.run.smithi038.stdout:(71/122): zlib-devel-1.2.11-10.el8.x86_64.rpm 2.1 MB/s | 56 kB 00:00 2020-06-12T17:45:50.949 INFO:teuthology.orchestra.run.smithi038.stdout:(72/122): python3-requests-oauthlib-1.0.0-1.el8 1.6 MB/s | 43 kB 00:00 2020-06-12T17:45:50.974 INFO:teuthology.orchestra.run.smithi038.stdout:(73/122): fuse-2.9.7-12.el8.x86_64.rpm 3.2 MB/s | 83 kB 00:00 2020-06-12T17:45:50.999 INFO:teuthology.orchestra.run.smithi038.stdout:(74/122): keyutils-libs-devel-1.5.10-6.el8.x86_ 1.8 MB/s | 48 kB 00:00 2020-06-12T17:45:51.024 INFO:teuthology.orchestra.run.smithi038.stdout:(75/122): python3-jwt-1.6.1-2.el8.noarch.rpm 1.7 MB/s | 43 kB 00:00 2020-06-12T17:45:51.053 INFO:teuthology.orchestra.run.smithi038.stdout:(76/122): pcre2-devel-10.32-1.el8.x86_64.rpm 21 MB/s | 605 kB 00:00 2020-06-12T17:45:51.078 INFO:teuthology.orchestra.run.smithi038.stdout:(77/122): librabbitmq-0.9.0-1.el8.x86_64.rpm 1.9 MB/s | 47 kB 00:00 2020-06-12T17:45:51.104 INFO:teuthology.orchestra.run.smithi038.stdout:(78/122): python3-oauthlib-2.1.0-1.el8.noarch.r 5.8 MB/s | 155 kB 00:00 2020-06-12T17:45:51.128 INFO:teuthology.orchestra.run.smithi038.stdout:(79/122): fuse-common-3.2.1-12.el8.x86_64.rpm 866 kB/s | 21 kB 00:00 2020-06-12T17:45:51.154 INFO:teuthology.orchestra.run.smithi038.stdout:(80/122): pcre2-utf16-10.32-1.el8.x86_64.rpm 8.7 MB/s | 229 kB 00:00 2020-06-12T17:45:51.179 INFO:teuthology.orchestra.run.smithi038.stdout:(81/122): libsepol-devel-2.9-1.el8.x86_64.rpm 3.4 MB/s | 86 kB 00:00 2020-06-12T17:45:51.205 INFO:teuthology.orchestra.run.smithi038.stdout:(82/122): libselinux-devel-2.9-2.1.el8.x86_64.r 7.7 MB/s | 199 kB 00:00 2020-06-12T17:45:51.230 INFO:teuthology.orchestra.run.smithi038.stdout:(83/122): libaio-devel-0.3.112-1.el8.x86_64.rpm 733 kB/s | 19 kB 00:00 2020-06-12T17:45:51.258 INFO:teuthology.orchestra.run.smithi038.stdout:(84/122): libcom_err-devel-1.44.6-3.el8.x86_64. 1.4 MB/s | 38 kB 00:00 2020-06-12T17:45:51.282 INFO:teuthology.orchestra.run.smithi038.stdout:(85/122): libuuid-devel-2.32.1-22.el8.x86_64.rp 3.7 MB/s | 95 kB 00:00 2020-06-12T17:45:51.327 INFO:teuthology.orchestra.run.smithi038.stdout:(86/122): ceph-mgr-diskprediction-local-15.2.3- 6.5 MB/s | 8.6 MB 00:01 2020-06-12T17:45:51.366 INFO:teuthology.orchestra.run.smithi038.stdout:(87/122): openssl-devel-1.1.1c-15.el8.x86_64.rp 27 MB/s | 2.3 MB 00:00 2020-06-12T17:45:51.377 INFO:teuthology.orchestra.run.smithi038.stdout:(88/122): krb5-devel-1.17-18.el8.x86_64.rpm 11 MB/s | 549 kB 00:00 2020-06-12T17:45:51.394 INFO:teuthology.orchestra.run.smithi038.stdout:(89/122): libxslt-1.1.32-4.el8.x86_64.rpm 8.7 MB/s | 249 kB 00:00 2020-06-12T17:45:51.412 INFO:teuthology.orchestra.run.smithi038.stdout:(90/122): libquadmath-8.3.1-5.el8.x86_64.rpm 4.7 MB/s | 169 kB 00:00 2020-06-12T17:45:51.428 INFO:teuthology.orchestra.run.smithi038.stdout:(91/122): xfsprogs-devel-5.0.0-2.el8.x86_64.rpm 2.5 MB/s | 69 kB 00:00 2020-06-12T17:45:51.444 INFO:teuthology.orchestra.run.smithi038.stdout:(92/122): elfutils-libelf-devel-0.178-7.el8.x86 1.8 MB/s | 58 kB 00:00 2020-06-12T17:45:51.471 INFO:teuthology.orchestra.run.smithi038.stdout:(93/122): libgfortran-8.3.1-5.el8.x86_64.rpm 15 MB/s | 639 kB 00:00 2020-06-12T17:45:51.494 INFO:teuthology.orchestra.run.smithi038.stdout:(94/122): automake-1.16.1-6.el8.noarch.rpm 14 MB/s | 713 kB 00:00 2020-06-12T17:45:51.503 INFO:teuthology.orchestra.run.smithi038.stdout:(95/122): python3-webencodings-0.5.1-6.el8.noar 840 kB/s | 27 kB 00:00 2020-06-12T17:45:51.536 INFO:teuthology.orchestra.run.smithi038.stdout:(96/122): python3-lxml-4.2.3-1.el8.x86_64.rpm 35 MB/s | 1.5 MB 00:00 2020-06-12T17:45:51.538 INFO:teuthology.orchestra.run.smithi038.stdout:(97/122): jq-1.5-12.el8.x86_64.rpm 4.5 MB/s | 161 kB 00:00 2020-06-12T17:45:51.572 INFO:teuthology.orchestra.run.smithi038.stdout:(98/122): python3-werkzeug-0.12.2-4.el8.noarch. 13 MB/s | 457 kB 00:00 2020-06-12T17:45:51.582 INFO:teuthology.orchestra.run.smithi038.stdout:(99/122): python3-mako-1.0.6-13.el8.noarch.rpm 3.5 MB/s | 157 kB 00:00 2020-06-12T17:45:51.597 INFO:teuthology.orchestra.run.smithi038.stdout:(100/122): python3-jsonpatch-1.21-2.el8.noarch. 1.0 MB/s | 27 kB 00:00 2020-06-12T17:45:51.613 INFO:teuthology.orchestra.run.smithi038.stdout:(101/122): python3-jsonpointer-1.10-11.el8.noar 660 kB/s | 20 kB 00:00 2020-06-12T17:45:51.630 INFO:teuthology.orchestra.run.smithi038.stdout:(102/122): python3-html5lib-0.999999999-6.el8.n 6.4 MB/s | 214 kB 00:00 2020-06-12T17:45:51.646 INFO:teuthology.orchestra.run.smithi038.stdout:(103/122): python3-pyasn1-0.3.7-6.el8.noarch.rp 3.7 MB/s | 126 kB 00:00 2020-06-12T17:45:51.662 INFO:teuthology.orchestra.run.smithi038.stdout:(104/122): python3-pytz-2017.2-9.el8.noarch.rpm 1.7 MB/s | 54 kB 00:00 2020-06-12T17:45:51.680 INFO:teuthology.orchestra.run.smithi038.stdout:(105/122): python3-pyasn1-modules-0.3.7-6.el8.n 3.4 MB/s | 110 kB 00:00 2020-06-12T17:45:51.696 INFO:teuthology.orchestra.run.smithi038.stdout:(106/122): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2020-06-12T17:45:51.713 INFO:teuthology.orchestra.run.smithi038.stdout:(107/122): oniguruma-6.8.2-1.el8.x86_64.rpm 5.2 MB/s | 188 kB 00:00 2020-06-12T17:45:51.729 INFO:teuthology.orchestra.run.smithi038.stdout:(108/122): python3-markupsafe-0.23-19.el8.x86_6 1.2 MB/s | 39 kB 00:00 2020-06-12T17:45:51.747 INFO:teuthology.orchestra.run.smithi038.stdout:(109/122): flex-2.6.1-9.el8.x86_64.rpm 9.4 MB/s | 320 kB 00:00 2020-06-12T17:45:51.766 INFO:teuthology.orchestra.run.smithi038.stdout:(110/122): librdkafka-0.11.4-1.el8.x86_64.rpm 9.2 MB/s | 353 kB 00:00 2020-06-12T17:45:51.794 INFO:teuthology.orchestra.run.smithi038.stdout:(111/122): bison-3.0.4-10.el8.x86_64.rpm 17 MB/s | 688 kB 00:00 2020-06-12T17:45:51.817 INFO:teuthology.orchestra.run.smithi038.stdout:(112/122): libtool-2.4.6-25.el8.x86_64.rpm 16 MB/s | 709 kB 00:00 2020-06-12T17:45:51.845 INFO:teuthology.orchestra.run.smithi038.stdout:(113/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 8.9 MB/s | 259 kB 00:00 2020-06-12T17:45:51.876 INFO:teuthology.orchestra.run.smithi038.stdout:(114/122): python3-numpy-1.14.3-9.el8.x86_64.rp 46 MB/s | 3.7 MB 00:00 2020-06-12T17:45:51.878 INFO:teuthology.orchestra.run.smithi038.stdout:(115/122): python3-numpy-f2py-1.14.3-9.el8.x86_ 6.7 MB/s | 225 kB 00:00 2020-06-12T17:45:51.958 INFO:teuthology.orchestra.run.smithi038.stdout:(116/122): openblas-threads-0.3.3-5.el8.x86_64. 55 MB/s | 4.4 MB 00:00 2020-06-12T17:45:52.023 INFO:teuthology.orchestra.run.smithi038.stdout:(117/122): openblas-0.3.3-5.el8.x86_64.rpm 66 MB/s | 4.3 MB 00:00 2020-06-12T17:45:52.148 INFO:teuthology.orchestra.run.smithi038.stdout:(118/122): python3-scipy-1.0.0-20.module+el8.1. 53 MB/s | 15 MB 00:00 2020-06-12T17:45:52.151 INFO:teuthology.orchestra.run.smithi038.stdout:(119/122): socat-1.7.3.3-2.el8.x86_64.rpm 2.3 MB/s | 302 kB 00:00 2020-06-12T17:45:52.403 INFO:teuthology.orchestra.run.smithi038.stdout:(120/122): librbd1-15.2.3-196.g91d24f4.el8.x86_ 7.6 MB/s | 1.9 MB 00:00 2020-06-12T17:45:52.673 INFO:teuthology.orchestra.run.smithi038.stdout:(121/122): librados2-15.2.3-196.g91d24f4.el8.x8 6.8 MB/s | 3.5 MB 00:00 2020-06-12T17:45:53.800 INFO:teuthology.orchestra.run.smithi038.stdout:(122/122): ceph-test-15.2.3-196.g91d24f4.el8.x8 7.4 MB/s | 42 MB 00:05 2020-06-12T17:45:53.800 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2020-06-12T17:45:53.800 INFO:teuthology.orchestra.run.smithi038.stdout:Total 16 MB/s | 176 MB 00:11 2020-06-12T17:45:53.801 INFO:teuthology.orchestra.run.smithi038.stderr:warning: /var/cache/dnf/copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8-0161c520b1c9fbf7/packages/python3-cheroot-8.2.1-1.el8.noarch.rpm: Header V3 RSA/SHA1 Signature, key ID 2a8a41ec: NOKEY 2020-06-12T17:45:53.848 INFO:teuthology.orchestra.run.smithi038.stdout:Copr repo for ceph-el8 owned by ktdreyer 22 kB/s | 1.0 kB 00:00 2020-06-12T17:45:54.021 INFO:teuthology.orchestra.run.smithi038.stderr:Importing GPG key 0x2A8A41EC: 2020-06-12T17:45:54.022 INFO:teuthology.orchestra.run.smithi038.stderr: Userid : "ktdreyer_ceph-el8 (None) " 2020-06-12T17:45:54.022 INFO:teuthology.orchestra.run.smithi038.stderr: Fingerprint: 64D3 346F FD63 5D2D B5D0 5873 1014 BDBE 2A8A 41EC 2020-06-12T17:45:54.022 INFO:teuthology.orchestra.run.smithi038.stderr: From : https://download.copr.fedorainfracloud.org/results/ktdreyer/ceph-el8/pubkey.gpg 2020-06-12T17:45:54.138 INFO:teuthology.orchestra.run.smithi038.stdout:Key imported successfully 2020-06-12T17:45:54.209 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2020-06-12T17:45:54.288 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2020-06-12T17:45:54.334 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2020-06-12T17:45:54.335 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2020-06-12T17:45:54.483 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/124 2020-06-12T17:45:54.651 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/124 2020-06-12T17:45:54.790 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : leveldb-1.22-1.el8.x86_64 3/124 2020-06-12T17:45:54.982 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 4/124 2020-06-12T17:45:55.143 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/124 2020-06-12T17:45:55.560 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/124 2020-06-12T17:45:55.663 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2020-06-12T17:45:55.666 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2020-06-12T17:45:55.760 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librados2-2:15.2.3-196.g91d24f4.el8.x86_64 6/124 2020-06-12T17:45:56.001 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-2:15.2.3-196.g91d24f4.el8.x86_64 6/124 2020-06-12T17:45:56.201 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librbd1-2:15.2.3-196.g91d24f4.el8.x86_64 7/124 2020-06-12T17:45:56.301 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-2:15.2.3-196.g91d24f4.el8.x86_64 7/124 2020-06-12T17:45:56.484 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs2-2:15.2.3-196.g91d24f4.el8.x86_64 8/124 2020-06-12T17:45:56.567 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephfs2-2:15.2.3-196.g91d24f4.el8.x86_64 8/124 2020-06-12T17:45:56.761 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rados-2:15.2.3-196.g91d24f4.el8.x86_64 9/124 2020-06-12T17:45:56.959 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 10/124 2020-06-12T17:45:57.556 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 10/124 2020-06-12T17:45:57.742 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librgw2-2:15.2.3-196.g91d24f4.el8.x86_64 11/124 2020-06-12T17:45:57.834 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librgw2-2:15.2.3-196.g91d24f4.el8.x86_64 11/124 2020-06-12T17:45:58.050 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/124 2020-06-12T17:45:58.217 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libradosstriper1-2:15.2.3-196.g91d24f4.el8.x86_6 13/124 2020-06-12T17:45:58.306 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libradosstriper1-2:15.2.3-196.g91d24f4.el8.x86_6 13/124 2020-06-12T17:45:58.459 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libquadmath-8.3.1-5.el8.x86_64 14/124 2020-06-12T17:45:58.615 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libquadmath-8.3.1-5.el8.x86_64 14/124 2020-06-12T17:45:58.850 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libgfortran-8.3.1-5.el8.x86_64 15/124 2020-06-12T17:45:59.372 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libgfortran-8.3.1-5.el8.x86_64 15/124 2020-06-12T17:45:59.551 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 16/124 2020-06-12T17:46:00.056 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 16/124 2020-06-12T17:46:00.259 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-0.3.3-5.el8.x86_64 17/124 2020-06-12T17:46:00.486 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2020-06-12T17:46:00.633 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/124 2020-06-12T17:46:00.854 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/124 2020-06-12T17:46:00.983 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 17/124 2020-06-12T17:46:01.067 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : leveldb-1.22-1.el8.x86_64 3/124 2020-06-12T17:46:01.269 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/124 2020-06-12T17:46:01.575 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 18/124 2020-06-12T17:46:01.681 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/124 2020-06-12T17:46:01.829 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libxslt-1.1.32-4.el8.x86_64 19/124 2020-06-12T17:46:01.869 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : librados2-2:15.2.3-196.g91d24f4.el8.x86_64 5/124 2020-06-12T17:46:01.976 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 20/124 2020-06-12T17:46:02.191 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-2:15.2.3-196.g91d24f4.el8.x86_64 5/124 2020-06-12T17:46:02.215 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 21/124 2020-06-12T17:46:02.361 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : librbd1-2:15.2.3-196.g91d24f4.el8.x86_64 6/124 2020-06-12T17:46:02.451 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/124 2020-06-12T17:46:02.484 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-2:15.2.3-196.g91d24f4.el8.x86_64 6/124 2020-06-12T17:46:02.619 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs2-2:15.2.3-196.g91d24f4.el8.x86_64 7/124 2020-06-12T17:46:02.687 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 23/124 2020-06-12T17:46:02.743 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephfs2-2:15.2.3-196.g91d24f4.el8.x86_64 7/124 2020-06-12T17:46:02.880 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-more-itertools-7.2.0-4.el8.noarch 24/124 2020-06-12T17:46:02.952 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rados-2:15.2.3-196.g91d24f4.el8.x86_64 8/124 2020-06-12T17:46:03.035 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-argparse-2:15.2.3-196.g91d24f4.el8. 25/124 2020-06-12T17:46:03.094 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 9/124 2020-06-12T17:46:03.150 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 9/124 2020-06-12T17:46:03.250 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cephfs-2:15.2.3-196.g91d24f4.el8.x86_64 26/124 2020-06-12T17:46:03.481 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 27/124 2020-06-12T17:46:03.662 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 28/124 2020-06-12T17:46:03.882 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 29/124 2020-06-12T17:46:03.943 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 10/124 2020-06-12T17:46:04.075 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 30/124 2020-06-12T17:46:04.102 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librgw2-2:15.2.3-196.g91d24f4.el8.x86_64 11/124 2020-06-12T17:46:04.220 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librgw2-2:15.2.3-196.g91d24f4.el8.x86_64 11/124 2020-06-12T17:46:04.462 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/124 2020-06-12T17:46:04.752 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libradosstriper1-2:15.2.3-196.g91d24f4.el8.x86_6 13/124 2020-06-12T17:46:04.915 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libradosstriper1-2:15.2.3-196.g91d24f4.el8.x86_6 13/124 2020-06-12T17:46:05.136 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 14/124 2020-06-12T17:46:05.302 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libquadmath-8.3.1-5.el8.x86_64 15/124 2020-06-12T17:46:05.446 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libquadmath-8.3.1-5.el8.x86_64 15/124 2020-06-12T17:46:05.702 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libgfortran-8.3.1-5.el8.x86_64 16/124 2020-06-12T17:46:06.082 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 30/124 2020-06-12T17:46:06.253 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libgfortran-8.3.1-5.el8.x86_64 16/124 2020-06-12T17:46:06.408 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 31/124 2020-06-12T17:46:06.427 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 17/124 2020-06-12T17:46:06.677 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 32/124 2020-06-12T17:46:06.995 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 17/124 2020-06-12T17:46:07.427 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 33/124 2020-06-12T17:46:07.666 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rgw-2:15.2.3-196.g91d24f4.el8.x86_64 34/124 2020-06-12T17:46:07.840 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rbd-2:15.2.3-196.g91d24f4.el8.x86_64 35/124 2020-06-12T17:46:07.910 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openblas-0.3.3-5.el8.x86_64 18/124 2020-06-12T17:46:08.025 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librados-devel-2:15.2.3-196.g91d24f4.el8.x86_64 36/124 2020-06-12T17:46:08.163 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libuuid-devel-2.32.1-22.el8.x86_64 37/124 2020-06-12T17:46:08.337 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 38/124 2020-06-12T17:46:08.529 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 39/124 2020-06-12T17:46:08.666 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 18/124 2020-06-12T17:46:08.723 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 40/124 2020-06-12T17:46:08.724 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 41/124 2020-06-12T17:46:08.724 INFO:teuthology.orchestra.run.smithi150.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-06-12T17:46:08.724 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:46:09.062 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 19/124 2020-06-12T17:46:09.098 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : fuse-2.9.7-12.el8.x86_64 42/124 2020-06-12T17:46:09.271 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 43/124 2020-06-12T17:46:09.290 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libxslt-1.1.32-4.el8.x86_64 20/124 2020-06-12T17:46:09.442 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/124 2020-06-12T17:46:09.599 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 44/124 2020-06-12T17:46:09.662 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 22/124 2020-06-12T17:46:09.862 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 45/124 2020-06-12T17:46:09.890 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 23/124 2020-06-12T17:46:10.060 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 46/124 2020-06-12T17:46:10.082 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-more-itertools-7.2.0-4.el8.noarch 24/124 2020-06-12T17:46:10.213 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ceph-argparse-2:15.2.3-196.g91d24f4.el8. 25/124 2020-06-12T17:46:10.257 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 47/124 2020-06-12T17:46:10.494 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cephfs-2:15.2.3-196.g91d24f4.el8.x86_64 26/124 2020-06-12T17:46:10.502 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : krb5-devel-1.17-18.el8.x86_64 48/124 2020-06-12T17:46:10.695 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 27/124 2020-06-12T17:46:10.696 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 49/124 2020-06-12T17:46:10.901 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 28/124 2020-06-12T17:46:10.938 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 50/124 2020-06-12T17:46:11.136 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 29/124 2020-06-12T17:46:11.166 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 51/124 2020-06-12T17:46:11.343 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 30/124 2020-06-12T17:46:11.357 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 52/124 2020-06-12T17:46:11.446 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 52/124 2020-06-12T17:46:11.657 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : jq-1.5-12.el8.x86_64 53/124 2020-06-12T17:46:11.823 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 54/124 2020-06-12T17:46:12.039 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 55/124 2020-06-12T17:46:12.216 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 56/124 2020-06-12T17:46:12.656 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 57/124 2020-06-12T17:46:12.959 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 58/124 2020-06-12T17:46:13.211 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 59/124 2020-06-12T17:46:13.428 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : automake-1.16.1-6.el8.noarch 60/124 2020-06-12T17:46:13.454 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 30/124 2020-06-12T17:46:13.732 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/124 2020-06-12T17:46:13.829 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 31/124 2020-06-12T17:46:13.926 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 62/124 2020-06-12T17:46:14.263 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 32/124 2020-06-12T17:46:14.316 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 63/124 2020-06-12T17:46:14.472 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 33/124 2020-06-12T17:46:14.651 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 64/124 2020-06-12T17:46:14.694 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rgw-2:15.2.3-196.g91d24f4.el8.x86_64 34/124 2020-06-12T17:46:14.867 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rbd-2:15.2.3-196.g91d24f4.el8.x86_64 35/124 2020-06-12T17:46:14.891 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/124 2020-06-12T17:46:15.084 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librados-devel-2:15.2.3-196.g91d24f4.el8.x86_64 36/124 2020-06-12T17:46:15.097 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/124 2020-06-12T17:46:15.297 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 67/124 2020-06-12T17:46:15.326 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 37/124 2020-06-12T17:46:15.520 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 68/124 2020-06-12T17:46:15.595 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 38/124 2020-06-12T17:46:15.852 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 39/124 2020-06-12T17:46:16.059 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 40/124 2020-06-12T17:46:16.148 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 40/124 2020-06-12T17:46:16.336 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : jq-1.5-12.el8.x86_64 41/124 2020-06-12T17:46:16.520 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 42/124 2020-06-12T17:46:16.699 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 69/124 2020-06-12T17:46:16.735 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 43/124 2020-06-12T17:46:16.960 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 44/124 2020-06-12T17:46:16.976 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 70/124 2020-06-12T17:46:17.165 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 45/124 2020-06-12T17:46:17.232 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 71/124 2020-06-12T17:46:17.459 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 46/124 2020-06-12T17:46:17.514 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 72/124 2020-06-12T17:46:17.736 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 47/124 2020-06-12T17:46:17.812 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 73/124 2020-06-12T17:46:17.975 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : automake-1.16.1-6.el8.noarch 48/124 2020-06-12T17:46:18.058 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 74/124 2020-06-12T17:46:18.088 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libuuid-devel-2.32.1-22.el8.x86_64 49/124 2020-06-12T17:46:18.252 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 50/124 2020-06-12T17:46:18.368 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 75/124 2020-06-12T17:46:18.497 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 51/124 2020-06-12T17:46:18.623 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 76/124 2020-06-12T17:46:18.712 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 52/124 2020-06-12T17:46:18.712 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 53/124 2020-06-12T17:46:18.713 INFO:teuthology.orchestra.run.smithi038.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-06-12T17:46:18.713 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:46:18.824 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 77/124 2020-06-12T17:46:19.024 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 78/124 2020-06-12T17:46:19.067 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : fuse-2.9.7-12.el8.x86_64 54/124 2020-06-12T17:46:19.196 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 79/124 2020-06-12T17:46:19.239 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 55/124 2020-06-12T17:46:19.428 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 80/124 2020-06-12T17:46:19.554 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 56/124 2020-06-12T17:46:19.628 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 81/124 2020-06-12T17:46:19.870 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 57/124 2020-06-12T17:46:19.915 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 82/124 2020-06-12T17:46:20.094 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 58/124 2020-06-12T17:46:20.220 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 83/124 2020-06-12T17:46:20.311 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 59/124 2020-06-12T17:46:20.459 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 84/124 2020-06-12T17:46:20.530 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : krb5-devel-1.17-18.el8.x86_64 60/124 2020-06-12T17:46:20.629 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 85/124 2020-06-12T17:46:20.855 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/124 2020-06-12T17:46:20.891 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 86/124 2020-06-12T17:46:21.070 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 62/124 2020-06-12T17:46:21.144 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 87/124 2020-06-12T17:46:21.346 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 88/124 2020-06-12T17:46:21.442 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 63/124 2020-06-12T17:46:21.660 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-portend-2.6-1.el8.noarch 89/124 2020-06-12T17:46:21.811 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 64/124 2020-06-12T17:46:21.966 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 90/124 2020-06-12T17:46:22.061 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/124 2020-06-12T17:46:22.128 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-prometheus-alerts-2:15.2.3-196.g91d24f4.el8 91/124 2020-06-12T17:46:22.283 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/124 2020-06-12T17:46:22.358 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-grafana-dashboards-2:15.2.3-196.g91d24f4.el 92/124 2020-06-12T17:46:22.458 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 67/124 2020-06-12T17:46:22.548 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-common-2:15.2.3-196.g91d24f4.el8.x8 93/124 2020-06-12T17:46:22.694 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 68/124 2020-06-12T17:46:23.878 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 69/124 2020-06-12T17:46:24.202 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 70/124 2020-06-12T17:46:24.474 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 71/124 2020-06-12T17:46:24.756 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 72/124 2020-06-12T17:46:25.176 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 73/124 2020-06-12T17:46:25.434 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 74/124 2020-06-12T17:46:25.690 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 75/124 2020-06-12T17:46:25.715 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:15.2.3-196.g91d24f4.el8.x86_64 94/124 2020-06-12T17:46:25.919 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 76/124 2020-06-12T17:46:25.981 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-common-2:15.2.3-196.g91d24f4.el8.x86_64 94/124 2020-06-12T17:46:26.152 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 77/124 2020-06-12T17:46:26.316 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 78/124 2020-06-12T17:46:26.505 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 79/124 2020-06-12T17:46:26.656 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:15.2.3-196.g91d24f4.el8.x86_64 94/124 2020-06-12T17:46:26.738 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 80/124 2020-06-12T17:46:26.981 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 81/124 2020-06-12T17:46:26.995 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-base-2:15.2.3-196.g91d24f4.el8.x86_64 95/124 2020-06-12T17:46:27.070 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-base-2:15.2.3-196.g91d24f4.el8.x86_64 95/124 2020-06-12T17:46:27.230 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-selinux-2:15.2.3-196.g91d24f4.el8.x86_64 96/124 2020-06-12T17:46:27.257 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 82/124 2020-06-12T17:46:27.591 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 83/124 2020-06-12T17:46:27.861 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 84/124 2020-06-12T17:46:28.048 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 85/124 2020-06-12T17:46:28.310 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 86/124 2020-06-12T17:46:28.580 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 87/124 2020-06-12T17:46:28.798 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 88/124 2020-06-12T17:46:29.108 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-portend-2.6-1.el8.noarch 89/124 2020-06-12T17:46:29.359 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 90/124 2020-06-12T17:46:29.565 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-prometheus-alerts-2:15.2.3-196.g91d24f4.el8 91/124 2020-06-12T17:46:29.794 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-grafana-dashboards-2:15.2.3-196.g91d24f4.el 92/124 2020-06-12T17:46:29.958 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ceph-common-2:15.2.3-196.g91d24f4.el8.x8 93/124 2020-06-12T17:46:33.587 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-2:15.2.3-196.g91d24f4.el8.x86_64 94/124 2020-06-12T17:46:33.882 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-common-2:15.2.3-196.g91d24f4.el8.x86_64 94/124 2020-06-12T17:46:34.711 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-2:15.2.3-196.g91d24f4.el8.x86_64 94/124 2020-06-12T17:46:35.052 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-base-2:15.2.3-196.g91d24f4.el8.x86_64 95/124 2020-06-12T17:46:35.161 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-base-2:15.2.3-196.g91d24f4.el8.x86_64 95/124 2020-06-12T17:46:35.290 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-selinux-2:15.2.3-196.g91d24f4.el8.x86_64 96/124 2020-06-12T17:46:43.885 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-selinux-2:15.2.3-196.g91d24f4.el8.x86_64 96/124 2020-06-12T17:46:43.886 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /sys 2020-06-12T17:46:43.886 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /proc 2020-06-12T17:46:43.886 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /dev 2020-06-12T17:46:43.886 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /run 2020-06-12T17:46:43.887 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /mnt 2020-06-12T17:46:43.887 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /var/tmp 2020-06-12T17:46:43.887 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /home 2020-06-12T17:46:43.887 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /tmp 2020-06-12T17:46:43.887 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /dev 2020-06-12T17:46:43.888 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:46:44.237 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mds-2:15.2.3-196.g91d24f4.el8.x86_64 97/124 2020-06-12T17:46:44.620 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mds-2:15.2.3-196.g91d24f4.el8.x86_64 97/124 2020-06-12T17:46:44.828 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mon-2:15.2.3-196.g91d24f4.el8.x86_64 98/124 2020-06-12T17:46:46.241 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mon-2:15.2.3-196.g91d24f4.el8.x86_64 98/124 2020-06-12T17:46:46.461 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-osd-2:15.2.3-196.g91d24f4.el8.x86_64 99/124 2020-06-12T17:46:46.485 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-osd-2:15.2.3-196.g91d24f4.el8.x86_64 99/124 2020-06-12T17:46:47.734 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cephadm-2:15.2.3-196.g91d24f4.el8.x86_64 100/124 2020-06-12T17:46:47.894 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephadm-2:15.2.3-196.g91d24f4.el8.x86_64 100/124 2020-06-12T17:46:48.094 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-cephadm-2:15.2.3-196.g91d24f4.el8.noarc 101/124 2020-06-12T17:46:48.975 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.2.3-196.g91d24f4.el8.noarc 101/124 2020-06-12T17:46:49.258 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-dashboard-2:15.2.3-196.g91d24f4.el8.noa 102/124 2020-06-12T17:46:50.300 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.2.3-196.g91d24f4.el8.noa 102/124 2020-06-12T17:46:50.492 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-diskprediction-local-2:15.2.3-196.g91d2 103/124 2020-06-12T17:46:50.558 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.2.3-196.g91d2 103/124 2020-06-12T17:46:51.100 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-modules-core-2:15.2.3-196.g91d24f4.el8. 104/124 2020-06-12T17:46:51.375 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-2:15.2.3-196.g91d24f4.el8.x86_64 105/124 2020-06-12T17:46:51.402 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-2:15.2.3-196.g91d24f4.el8.x86_64 105/124 2020-06-12T17:46:51.577 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-rook-2:15.2.3-196.g91d24f4.el8.noarch 106/124 2020-06-12T17:46:51.589 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-rook-2:15.2.3-196.g91d24f4.el8.noarch 106/124 2020-06-12T17:46:52.590 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-2:15.2.3-196.g91d24f4.el8.x86_64 107/124 2020-06-12T17:46:52.655 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-selinux-2:15.2.3-196.g91d24f4.el8.x86_64 96/124 2020-06-12T17:46:52.656 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /sys 2020-06-12T17:46:52.656 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /proc 2020-06-12T17:46:52.656 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /dev 2020-06-12T17:46:52.656 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /run 2020-06-12T17:46:52.657 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /mnt 2020-06-12T17:46:52.657 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /var/tmp 2020-06-12T17:46:52.657 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /home 2020-06-12T17:46:52.657 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /tmp 2020-06-12T17:46:52.657 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /dev 2020-06-12T17:46:52.658 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:46:52.769 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-radosgw-2:15.2.3-196.g91d24f4.el8.x86_64 108/124 2020-06-12T17:46:53.029 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mds-2:15.2.3-196.g91d24f4.el8.x86_64 97/124 2020-06-12T17:46:53.097 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-radosgw-2:15.2.3-196.g91d24f4.el8.x86_64 108/124 2020-06-12T17:46:53.277 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-mirror-2:15.2.3-196.g91d24f4.el8.x86_64 109/124 2020-06-12T17:46:53.439 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mds-2:15.2.3-196.g91d24f4.el8.x86_64 97/124 2020-06-12T17:46:53.629 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mon-2:15.2.3-196.g91d24f4.el8.x86_64 98/124 2020-06-12T17:46:55.142 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mon-2:15.2.3-196.g91d24f4.el8.x86_64 98/124 2020-06-12T17:46:55.354 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-osd-2:15.2.3-196.g91d24f4.el8.x86_64 99/124 2020-06-12T17:46:55.381 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-osd-2:15.2.3-196.g91d24f4.el8.x86_64 99/124 2020-06-12T17:46:56.798 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: cephadm-2:15.2.3-196.g91d24f4.el8.x86_64 100/124 2020-06-12T17:46:56.960 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephadm-2:15.2.3-196.g91d24f4.el8.x86_64 100/124 2020-06-12T17:46:57.178 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-cephadm-2:15.2.3-196.g91d24f4.el8.noarc 101/124 2020-06-12T17:46:57.337 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: rbd-mirror-2:15.2.3-196.g91d24f4.el8.x86_64 109/124 2020-06-12T17:46:57.948 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-test-2:15.2.3-196.g91d24f4.el8.x86_64 110/124 2020-06-12T17:46:58.110 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.2.3-196.g91d24f4.el8.noarc 101/124 2020-06-12T17:46:58.134 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libtool-2.4.6-25.el8.x86_64 111/124 2020-06-12T17:46:58.399 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-dashboard-2:15.2.3-196.g91d24f4.el8.noa 102/124 2020-06-12T17:46:58.854 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 111/124 2020-06-12T17:46:59.142 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openssl-devel-1:1.1.1c-15.el8.x86_64 112/124 2020-06-12T17:46:59.313 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-fuse-2:15.2.3-196.g91d24f4.el8.x86_64 113/124 2020-06-12T17:46:59.509 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.2.3-196.g91d24f4.el8.noa 102/124 2020-06-12T17:46:59.512 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xfsprogs-devel-5.0.0-2.el8.x86_64 114/124 2020-06-12T17:46:59.655 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs-devel-2:15.2.3-196.g91d24f4.el8.x86_64 115/124 2020-06-12T17:46:59.703 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-diskprediction-local-2:15.2.3-196.g91d2 103/124 2020-06-12T17:46:59.780 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.2.3-196.g91d2 103/124 2020-06-12T17:46:59.842 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : elfutils-libelf-devel-0.178-7.el8.x86_64 116/124 2020-06-12T17:47:00.007 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-fuse-2:15.2.3-196.g91d24f4.el8.x86_64 117/124 2020-06-12T17:47:00.139 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-modules-core-2:15.2.3-196.g91d24f4.el8. 104/124 2020-06-12T17:47:00.170 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-nbd-2:15.2.3-196.g91d24f4.el8.x86_64 118/124 2020-06-12T17:47:00.324 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-2:15.2.3-196.g91d24f4.el8.x86_64 105/124 2020-06-12T17:47:00.355 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-2:15.2.3-196.g91d24f4.el8.x86_64 105/124 2020-06-12T17:47:00.368 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-immutable-object-cache-2:15.2.3-196.g91d24f 119/124 2020-06-12T17:47:00.391 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.3-196.g91d24f 119/124 2020-06-12T17:47:00.511 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-rook-2:15.2.3-196.g91d24f4.el8.noarch 106/124 2020-06-12T17:47:00.527 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-rook-2:15.2.3-196.g91d24f4.el8.noarch 106/124 2020-06-12T17:47:00.595 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/124 2020-06-12T17:47:00.817 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : bison-3.0.4-10.el8.x86_64 121/124 2020-06-12T17:47:00.873 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 121/124 2020-06-12T17:47:01.120 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flex-2.6.1-9.el8.x86_64 122/124 2020-06-12T17:47:01.130 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 122/124 2020-06-12T17:47:01.131 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 123/124 2020-06-12T17:47:01.329 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 123/124 2020-06-12T17:47:01.329 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 124/124 2020-06-12T17:47:01.586 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-2:15.2.3-196.g91d24f4.el8.x86_64 107/124 2020-06-12T17:47:01.761 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-radosgw-2:15.2.3-196.g91d24f4.el8.x86_64 108/124 2020-06-12T17:47:02.128 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 124/124 2020-06-12T17:47:02.128 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-2:15.2.3-196.g91d24f4.el8.x86_64 1/124 2020-06-12T17:47:02.128 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-base-2:15.2.3-196.g91d24f4.el8.x86_64 2/124 2020-06-12T17:47:02.129 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-common-2:15.2.3-196.g91d24f4.el8.x86_64 3/124 2020-06-12T17:47:02.129 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-fuse-2:15.2.3-196.g91d24f4.el8.x86_64 4/124 2020-06-12T17:47:02.129 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-immutable-object-cache-2:15.2.3-196.g91d24f 5/124 2020-06-12T17:47:02.129 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mds-2:15.2.3-196.g91d24f4.el8.x86_64 6/124 2020-06-12T17:47:02.129 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-2:15.2.3-196.g91d24f4.el8.x86_64 7/124 2020-06-12T17:47:02.130 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mon-2:15.2.3-196.g91d24f4.el8.x86_64 8/124 2020-06-12T17:47:02.130 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-osd-2:15.2.3-196.g91d24f4.el8.x86_64 9/124 2020-06-12T17:47:02.130 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-radosgw-2:15.2.3-196.g91d24f4.el8.x86_64 10/124 2020-06-12T17:47:02.130 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-selinux-2:15.2.3-196.g91d24f4.el8.x86_64 11/124 2020-06-12T17:47:02.131 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-test-2:15.2.3-196.g91d24f4.el8.x86_64 12/124 2020-06-12T17:47:02.131 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephadm-2:15.2.3-196.g91d24f4.el8.x86_64 13/124 2020-06-12T17:47:02.132 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs-devel-2:15.2.3-196.g91d24f4.el8.x86_64 14/124 2020-06-12T17:47:02.132 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs2-2:15.2.3-196.g91d24f4.el8.x86_64 15/124 2020-06-12T17:47:02.132 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados-devel-2:15.2.3-196.g91d24f4.el8.x86_64 16/124 2020-06-12T17:47:02.132 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libradosstriper1-2:15.2.3-196.g91d24f4.el8.x86_6 17/124 2020-06-12T17:47:02.132 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librgw2-2:15.2.3-196.g91d24f4.el8.x86_64 18/124 2020-06-12T17:47:02.133 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-argparse-2:15.2.3-196.g91d24f4.el8. 19/124 2020-06-12T17:47:02.133 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-common-2:15.2.3-196.g91d24f4.el8.x8 20/124 2020-06-12T17:47:02.133 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cephfs-2:15.2.3-196.g91d24f4.el8.x86_64 21/124 2020-06-12T17:47:02.133 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rados-2:15.2.3-196.g91d24f4.el8.x86_64 22/124 2020-06-12T17:47:02.133 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rbd-2:15.2.3-196.g91d24f4.el8.x86_64 23/124 2020-06-12T17:47:02.133 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rgw-2:15.2.3-196.g91d24f4.el8.x86_64 24/124 2020-06-12T17:47:02.134 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-fuse-2:15.2.3-196.g91d24f4.el8.x86_64 25/124 2020-06-12T17:47:02.134 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-mirror-2:15.2.3-196.g91d24f4.el8.x86_64 26/124 2020-06-12T17:47:02.139 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-nbd-2:15.2.3-196.g91d24f4.el8.x86_64 27/124 2020-06-12T17:47:02.139 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-grafana-dashboards-2:15.2.3-196.g91d24f4.el 28/124 2020-06-12T17:47:02.139 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-cephadm-2:15.2.3-196.g91d24f4.el8.noarc 29/124 2020-06-12T17:47:02.139 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-dashboard-2:15.2.3-196.g91d24f4.el8.noa 30/124 2020-06-12T17:47:02.139 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.2.3-196.g91d2 31/124 2020-06-12T17:47:02.140 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-modules-core-2:15.2.3-196.g91d24f4.el8. 32/124 2020-06-12T17:47:02.140 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-rook-2:15.2.3-196.g91d24f4.el8.noarch 33/124 2020-06-12T17:47:02.140 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-prometheus-alerts-2:15.2.3-196.g91d24f4.el8 34/124 2020-06-12T17:47:02.140 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 35/124 2020-06-12T17:47:02.140 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 36/124 2020-06-12T17:47:02.141 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 37/124 2020-06-12T17:47:02.141 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 38/124 2020-06-12T17:47:02.141 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 39/124 2020-06-12T17:47:02.141 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 40/124 2020-06-12T17:47:02.141 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-more-itertools-7.2.0-4.el8.noarch 41/124 2020-06-12T17:47:02.141 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 42/124 2020-06-12T17:47:02.142 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-portend-2.6-1.el8.noarch 43/124 2020-06-12T17:47:02.142 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 44/124 2020-06-12T17:47:02.142 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 45/124 2020-06-12T17:47:02.142 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 46/124 2020-06-12T17:47:02.142 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 47/124 2020-06-12T17:47:02.143 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 48/124 2020-06-12T17:47:02.143 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 49/124 2020-06-12T17:47:02.143 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 50/124 2020-06-12T17:47:02.143 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 51/124 2020-06-12T17:47:02.144 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 52/124 2020-06-12T17:47:02.144 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 53/124 2020-06-12T17:47:02.144 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : leveldb-1.22-1.el8.x86_64 54/124 2020-06-12T17:47:02.144 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 55/124 2020-06-12T17:47:02.144 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 56/124 2020-06-12T17:47:02.145 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 57/124 2020-06-12T17:47:02.145 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 58/124 2020-06-12T17:47:02.145 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 59/124 2020-06-12T17:47:02.145 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 60/124 2020-06-12T17:47:02.145 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 61/124 2020-06-12T17:47:02.146 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 62/124 2020-06-12T17:47:02.146 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 63/124 2020-06-12T17:47:02.146 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 64/124 2020-06-12T17:47:02.146 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 65/124 2020-06-12T17:47:02.146 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 66/124 2020-06-12T17:47:02.147 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/124 2020-06-12T17:47:02.147 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/124 2020-06-12T17:47:02.147 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/124 2020-06-12T17:47:02.147 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 70/124 2020-06-12T17:47:02.147 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : automake-1.16.1-6.el8.noarch 71/124 2020-06-12T17:47:02.148 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 72/124 2020-06-12T17:47:02.148 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 73/124 2020-06-12T17:47:02.148 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : jq-1.5-12.el8.x86_64 74/124 2020-06-12T17:47:02.148 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 75/124 2020-06-12T17:47:02.148 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 76/124 2020-06-12T17:47:02.148 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 77/124 2020-06-12T17:47:02.149 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 78/124 2020-06-12T17:47:02.149 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 79/124 2020-06-12T17:47:02.149 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 80/124 2020-06-12T17:47:02.149 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 81/124 2020-06-12T17:47:02.149 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 82/124 2020-06-12T17:47:02.150 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 83/124 2020-06-12T17:47:02.150 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 84/124 2020-06-12T17:47:02.150 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 85/124 2020-06-12T17:47:02.150 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flex-2.6.1-9.el8.x86_64 86/124 2020-06-12T17:47:02.150 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 87/124 2020-06-12T17:47:02.151 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : bison-3.0.4-10.el8.x86_64 88/124 2020-06-12T17:47:02.151 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 89/124 2020-06-12T17:47:02.151 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 90/124 2020-06-12T17:47:02.151 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 91/124 2020-06-12T17:47:02.151 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 92/124 2020-06-12T17:47:02.151 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 93/124 2020-06-12T17:47:02.152 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 94/124 2020-06-12T17:47:02.152 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 95/124 2020-06-12T17:47:02.152 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 96/124 2020-06-12T17:47:02.152 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 97/124 2020-06-12T17:47:02.152 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 98/124 2020-06-12T17:47:02.153 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 99/124 2020-06-12T17:47:02.153 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 100/124 2020-06-12T17:47:02.153 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 101/124 2020-06-12T17:47:02.153 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 102/124 2020-06-12T17:47:02.153 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 103/124 2020-06-12T17:47:02.154 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 104/124 2020-06-12T17:47:02.154 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 105/124 2020-06-12T17:47:02.154 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 106/124 2020-06-12T17:47:02.154 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 107/124 2020-06-12T17:47:02.155 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 108/124 2020-06-12T17:47:02.155 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 109/124 2020-06-12T17:47:02.155 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 110/124 2020-06-12T17:47:02.156 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 111/124 2020-06-12T17:47:02.156 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 112/124 2020-06-12T17:47:02.156 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libuuid-devel-2.32.1-22.el8.x86_64 113/124 2020-06-12T17:47:02.157 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-devel-1:1.1.1c-15.el8.x86_64 114/124 2020-06-12T17:47:02.157 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : krb5-devel-1.17-18.el8.x86_64 115/124 2020-06-12T17:47:02.157 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libxslt-1.1.32-4.el8.x86_64 116/124 2020-06-12T17:47:02.157 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libquadmath-8.3.1-5.el8.x86_64 117/124 2020-06-12T17:47:02.158 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xfsprogs-devel-5.0.0-2.el8.x86_64 118/124 2020-06-12T17:47:02.158 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : elfutils-libelf-devel-0.178-7.el8.x86_64 119/124 2020-06-12T17:47:02.158 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libgfortran-8.3.1-5.el8.x86_64 120/124 2020-06-12T17:47:02.158 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-2:15.2.3-196.g91d24f4.el8.x86_64 121/124 2020-06-12T17:47:02.158 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 122/124 2020-06-12T17:47:02.159 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-2:15.2.3-196.g91d24f4.el8.x86_64 123/124 2020-06-12T17:47:02.159 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-radosgw-2:15.2.3-196.g91d24f4.el8.x86_64 108/124 2020-06-12T17:47:02.311 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-mirror-2:15.2.3-196.g91d24f4.el8.x86_64 109/124 2020-06-12T17:47:03.624 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 124/124 2020-06-12T17:47:03.625 INFO:teuthology.orchestra.run.smithi150.stdout:Installed products updated. 2020-06-12T17:47:05.698 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:05.699 INFO:teuthology.orchestra.run.smithi150.stdout:Upgraded: 2020-06-12T17:47:05.699 INFO:teuthology.orchestra.run.smithi150.stdout: librados2-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.699 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.700 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:05.700 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2020-06-12T17:47:05.700 INFO:teuthology.orchestra.run.smithi150.stdout: automake-1.16.1-6.el8.noarch 2020-06-12T17:47:05.700 INFO:teuthology.orchestra.run.smithi150.stdout: bison-3.0.4-10.el8.x86_64 2020-06-12T17:47:05.700 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.701 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.701 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.701 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.701 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards-2:15.2.3-196.g91d24f4.el8.noarch 2020-06-12T17:47:05.701 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.702 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.702 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.702 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm-2:15.2.3-196.g91d24f4.el8.noarch 2020-06-12T17:47:05.702 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard-2:15.2.3-196.g91d24f4.el8.noarch 2020-06-12T17:47:05.702 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local-2:15.2.3-196.g91d24f4.el8.noarch 2020-06-12T17:47:05.702 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core-2:15.2.3-196.g91d24f4.el8.noarch 2020-06-12T17:47:05.703 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook-2:15.2.3-196.g91d24f4.el8.noarch 2020-06-12T17:47:05.703 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.703 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.703 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts-2:15.2.3-196.g91d24f4.el8.noarch 2020-06-12T17:47:05.703 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.704 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.704 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.704 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.704 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf-devel-0.178-7.el8.x86_64 2020-06-12T17:47:05.704 INFO:teuthology.orchestra.run.smithi150.stdout: flex-2.6.1-9.el8.x86_64 2020-06-12T17:47:05.706 INFO:teuthology.orchestra.run.smithi150.stdout: fmt-6.2.1-1.el8.x86_64 2020-06-12T17:47:05.706 INFO:teuthology.orchestra.run.smithi150.stdout: fuse-2.9.7-12.el8.x86_64 2020-06-12T17:47:05.706 INFO:teuthology.orchestra.run.smithi150.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-06-12T17:47:05.706 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-06-12T17:47:05.707 INFO:teuthology.orchestra.run.smithi150.stdout: jq-1.5-12.el8.x86_64 2020-06-12T17:47:05.707 INFO:teuthology.orchestra.run.smithi150.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-06-12T17:47:05.707 INFO:teuthology.orchestra.run.smithi150.stdout: krb5-devel-1.17-18.el8.x86_64 2020-06-12T17:47:05.707 INFO:teuthology.orchestra.run.smithi150.stdout: leveldb-1.22-1.el8.x86_64 2020-06-12T17:47:05.707 INFO:teuthology.orchestra.run.smithi150.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-06-12T17:47:05.708 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.708 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.708 INFO:teuthology.orchestra.run.smithi150.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-06-12T17:47:05.708 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran-8.3.1-5.el8.x86_64 2020-06-12T17:47:05.708 INFO:teuthology.orchestra.run.smithi150.stdout: liboath-2.6.2-3.el8.x86_64 2020-06-12T17:47:05.709 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath-8.3.1-5.el8.x86_64 2020-06-12T17:47:05.709 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-06-12T17:47:05.709 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.709 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.709 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-06-12T17:47:05.710 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.710 INFO:teuthology.orchestra.run.smithi150.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-06-12T17:47:05.710 INFO:teuthology.orchestra.run.smithi150.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-06-12T17:47:05.710 INFO:teuthology.orchestra.run.smithi150.stdout: libtool-2.4.6-25.el8.x86_64 2020-06-12T17:47:05.710 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind-1.3.1-3.el8.x86_64 2020-06-12T17:47:05.710 INFO:teuthology.orchestra.run.smithi150.stdout: libuuid-devel-2.32.1-22.el8.x86_64 2020-06-12T17:47:05.711 INFO:teuthology.orchestra.run.smithi150.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-06-12T17:47:05.711 INFO:teuthology.orchestra.run.smithi150.stdout: libxslt-1.1.32-4.el8.x86_64 2020-06-12T17:47:05.711 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-06-12T17:47:05.711 INFO:teuthology.orchestra.run.smithi150.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-06-12T17:47:05.711 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-0.3.3-5.el8.x86_64 2020-06-12T17:47:05.712 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-threads-0.3.3-5.el8.x86_64 2020-06-12T17:47:05.712 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-devel-1:1.1.1c-15.el8.x86_64 2020-06-12T17:47:05.712 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-06-12T17:47:05.712 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-06-12T17:47:05.712 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-06-12T17:47:05.713 INFO:teuthology.orchestra.run.smithi150.stdout: python3-apipkg-1.5-6.el8.noarch 2020-06-12T17:47:05.713 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-06-12T17:47:05.713 INFO:teuthology.orchestra.run.smithi150.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-06-12T17:47:05.713 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-06-12T17:47:05.713 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.714 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.714 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.715 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-06-12T17:47:05.715 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-06-12T17:47:05.715 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-06-12T17:47:05.715 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-06-12T17:47:05.715 INFO:teuthology.orchestra.run.smithi150.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-06-12T17:47:05.716 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-06-12T17:47:05.716 INFO:teuthology.orchestra.run.smithi150.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-06-12T17:47:05.716 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-6.2-6.el8.noarch 2020-06-12T17:47:05.716 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-06-12T17:47:05.717 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-06-12T17:47:05.717 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-06-12T17:47:05.717 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-06-12T17:47:05.717 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-06-12T17:47:05.717 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-06-12T17:47:05.718 INFO:teuthology.orchestra.run.smithi150.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-06-12T17:47:05.718 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako-1.0.6-13.el8.noarch 2020-06-12T17:47:05.718 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-06-12T17:47:05.718 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools-7.2.0-4.el8.noarch 2020-06-12T17:47:05.718 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-06-12T17:47:05.719 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-06-12T17:47:05.719 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-06-12T17:47:05.719 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-06-12T17:47:05.719 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend-2.6-1.el8.noarch 2020-06-12T17:47:05.719 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-06-12T17:47:05.719 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-06-12T17:47:05.720 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-06-12T17:47:05.720 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz-2017.2-9.el8.noarch 2020-06-12T17:47:05.720 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.720 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.720 INFO:teuthology.orchestra.run.smithi150.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-06-12T17:47:05.721 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-06-12T17:47:05.721 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-06-12T17:47:05.721 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.721 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes-2.4.1-12.el8.noarch 2020-06-12T17:47:05.721 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-06-12T17:47:05.722 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2020-06-12T17:47:05.722 INFO:teuthology.orchestra.run.smithi150.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-06-12T17:47:05.722 INFO:teuthology.orchestra.run.smithi150.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-06-12T17:47:05.722 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-06-12T17:47:05.722 INFO:teuthology.orchestra.run.smithi150.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-06-12T17:47:05.723 INFO:teuthology.orchestra.run.smithi150.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-06-12T17:47:05.723 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-06-12T17:47:05.723 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-06-12T17:47:05.723 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-06-12T17:47:05.723 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-06-12T17:47:05.723 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-06-12T17:47:05.724 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-06-12T17:47:05.724 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.724 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.724 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:05.724 INFO:teuthology.orchestra.run.smithi150.stdout: socat-1.7.3.3-2.el8.x86_64 2020-06-12T17:47:05.725 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs-devel-5.0.0-2.el8.x86_64 2020-06-12T17:47:05.725 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-06-12T17:47:05.725 INFO:teuthology.orchestra.run.smithi150.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-06-12T17:47:05.725 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:05.726 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2020-06-12T17:47:05.938 DEBUG:teuthology.parallel:result is None 2020-06-12T17:47:06.474 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: rbd-mirror-2:15.2.3-196.g91d24f4.el8.x86_64 109/124 2020-06-12T17:47:07.482 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-test-2:15.2.3-196.g91d24f4.el8.x86_64 110/124 2020-06-12T17:47:07.763 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openssl-devel-1:1.1.1c-15.el8.x86_64 111/124 2020-06-12T17:47:07.973 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-fuse-2:15.2.3-196.g91d24f4.el8.x86_64 112/124 2020-06-12T17:47:08.187 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xfsprogs-devel-5.0.0-2.el8.x86_64 113/124 2020-06-12T17:47:08.360 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libtool-2.4.6-25.el8.x86_64 114/124 2020-06-12T17:47:08.375 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 114/124 2020-06-12T17:47:08.565 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs-devel-2:15.2.3-196.g91d24f4.el8.x86_64 115/124 2020-06-12T17:47:08.734 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : elfutils-libelf-devel-0.178-7.el8.x86_64 116/124 2020-06-12T17:47:08.900 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-fuse-2:15.2.3-196.g91d24f4.el8.x86_64 117/124 2020-06-12T17:47:09.545 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-nbd-2:15.2.3-196.g91d24f4.el8.x86_64 118/124 2020-06-12T17:47:09.727 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-immutable-object-cache-2:15.2.3-196.g91d24f 119/124 2020-06-12T17:47:09.872 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.3-196.g91d24f 119/124 2020-06-12T17:47:10.077 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : bison-3.0.4-10.el8.x86_64 120/124 2020-06-12T17:47:10.143 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 120/124 2020-06-12T17:47:10.375 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/124 2020-06-12T17:47:10.390 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/124 2020-06-12T17:47:10.537 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 122/124 2020-06-12T17:47:10.537 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 123/124 2020-06-12T17:47:10.697 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 123/124 2020-06-12T17:47:10.697 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 124/124 2020-06-12T17:47:11.534 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 124/124 2020-06-12T17:47:11.535 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-2:15.2.3-196.g91d24f4.el8.x86_64 1/124 2020-06-12T17:47:11.535 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-base-2:15.2.3-196.g91d24f4.el8.x86_64 2/124 2020-06-12T17:47:11.535 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-common-2:15.2.3-196.g91d24f4.el8.x86_64 3/124 2020-06-12T17:47:11.535 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-fuse-2:15.2.3-196.g91d24f4.el8.x86_64 4/124 2020-06-12T17:47:11.536 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-immutable-object-cache-2:15.2.3-196.g91d24f 5/124 2020-06-12T17:47:11.536 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mds-2:15.2.3-196.g91d24f4.el8.x86_64 6/124 2020-06-12T17:47:11.536 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-2:15.2.3-196.g91d24f4.el8.x86_64 7/124 2020-06-12T17:47:11.536 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mon-2:15.2.3-196.g91d24f4.el8.x86_64 8/124 2020-06-12T17:47:11.536 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-osd-2:15.2.3-196.g91d24f4.el8.x86_64 9/124 2020-06-12T17:47:11.537 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-radosgw-2:15.2.3-196.g91d24f4.el8.x86_64 10/124 2020-06-12T17:47:11.537 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-selinux-2:15.2.3-196.g91d24f4.el8.x86_64 11/124 2020-06-12T17:47:11.537 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-test-2:15.2.3-196.g91d24f4.el8.x86_64 12/124 2020-06-12T17:47:11.537 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephadm-2:15.2.3-196.g91d24f4.el8.x86_64 13/124 2020-06-12T17:47:11.537 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs-devel-2:15.2.3-196.g91d24f4.el8.x86_64 14/124 2020-06-12T17:47:11.538 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs2-2:15.2.3-196.g91d24f4.el8.x86_64 15/124 2020-06-12T17:47:11.538 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados-devel-2:15.2.3-196.g91d24f4.el8.x86_64 16/124 2020-06-12T17:47:11.538 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libradosstriper1-2:15.2.3-196.g91d24f4.el8.x86_6 17/124 2020-06-12T17:47:11.538 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librgw2-2:15.2.3-196.g91d24f4.el8.x86_64 18/124 2020-06-12T17:47:11.538 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ceph-argparse-2:15.2.3-196.g91d24f4.el8. 19/124 2020-06-12T17:47:11.539 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ceph-common-2:15.2.3-196.g91d24f4.el8.x8 20/124 2020-06-12T17:47:11.539 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cephfs-2:15.2.3-196.g91d24f4.el8.x86_64 21/124 2020-06-12T17:47:11.539 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rados-2:15.2.3-196.g91d24f4.el8.x86_64 22/124 2020-06-12T17:47:11.539 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rbd-2:15.2.3-196.g91d24f4.el8.x86_64 23/124 2020-06-12T17:47:11.539 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rgw-2:15.2.3-196.g91d24f4.el8.x86_64 24/124 2020-06-12T17:47:11.540 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-fuse-2:15.2.3-196.g91d24f4.el8.x86_64 25/124 2020-06-12T17:47:11.540 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-mirror-2:15.2.3-196.g91d24f4.el8.x86_64 26/124 2020-06-12T17:47:11.540 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-nbd-2:15.2.3-196.g91d24f4.el8.x86_64 27/124 2020-06-12T17:47:11.540 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-grafana-dashboards-2:15.2.3-196.g91d24f4.el 28/124 2020-06-12T17:47:11.540 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-cephadm-2:15.2.3-196.g91d24f4.el8.noarc 29/124 2020-06-12T17:47:11.541 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-dashboard-2:15.2.3-196.g91d24f4.el8.noa 30/124 2020-06-12T17:47:11.541 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.2.3-196.g91d2 31/124 2020-06-12T17:47:11.541 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-modules-core-2:15.2.3-196.g91d24f4.el8. 32/124 2020-06-12T17:47:11.541 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-rook-2:15.2.3-196.g91d24f4.el8.noarch 33/124 2020-06-12T17:47:11.541 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-prometheus-alerts-2:15.2.3-196.g91d24f4.el8 34/124 2020-06-12T17:47:11.542 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 35/124 2020-06-12T17:47:11.542 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 36/124 2020-06-12T17:47:11.542 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 37/124 2020-06-12T17:47:11.542 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 38/124 2020-06-12T17:47:11.542 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 39/124 2020-06-12T17:47:11.543 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 40/124 2020-06-12T17:47:11.543 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-more-itertools-7.2.0-4.el8.noarch 41/124 2020-06-12T17:47:11.543 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 42/124 2020-06-12T17:47:11.543 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-portend-2.6-1.el8.noarch 43/124 2020-06-12T17:47:11.543 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 44/124 2020-06-12T17:47:11.543 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 45/124 2020-06-12T17:47:11.544 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 46/124 2020-06-12T17:47:11.544 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 47/124 2020-06-12T17:47:11.544 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 48/124 2020-06-12T17:47:11.544 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 49/124 2020-06-12T17:47:11.544 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 50/124 2020-06-12T17:47:11.545 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 51/124 2020-06-12T17:47:11.545 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 52/124 2020-06-12T17:47:11.545 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 53/124 2020-06-12T17:47:11.545 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : leveldb-1.22-1.el8.x86_64 54/124 2020-06-12T17:47:11.546 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 55/124 2020-06-12T17:47:11.546 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 56/124 2020-06-12T17:47:11.546 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 57/124 2020-06-12T17:47:11.546 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 58/124 2020-06-12T17:47:11.546 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 59/124 2020-06-12T17:47:11.547 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 60/124 2020-06-12T17:47:11.547 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 61/124 2020-06-12T17:47:11.547 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 62/124 2020-06-12T17:47:11.547 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 63/124 2020-06-12T17:47:11.547 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 64/124 2020-06-12T17:47:11.547 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 65/124 2020-06-12T17:47:11.548 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 66/124 2020-06-12T17:47:11.548 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/124 2020-06-12T17:47:11.548 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/124 2020-06-12T17:47:11.548 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/124 2020-06-12T17:47:11.548 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 70/124 2020-06-12T17:47:11.549 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 71/124 2020-06-12T17:47:11.549 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 72/124 2020-06-12T17:47:11.549 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 73/124 2020-06-12T17:47:11.549 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 74/124 2020-06-12T17:47:11.549 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 75/124 2020-06-12T17:47:11.550 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/124 2020-06-12T17:47:11.550 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 77/124 2020-06-12T17:47:11.550 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 78/124 2020-06-12T17:47:11.550 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 79/124 2020-06-12T17:47:11.550 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 80/124 2020-06-12T17:47:11.551 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 81/124 2020-06-12T17:47:11.551 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 82/124 2020-06-12T17:47:11.551 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 83/124 2020-06-12T17:47:11.551 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 84/124 2020-06-12T17:47:11.551 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 85/124 2020-06-12T17:47:11.551 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 86/124 2020-06-12T17:47:11.552 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libuuid-devel-2.32.1-22.el8.x86_64 87/124 2020-06-12T17:47:11.552 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-devel-1:1.1.1c-15.el8.x86_64 88/124 2020-06-12T17:47:11.552 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : krb5-devel-1.17-18.el8.x86_64 89/124 2020-06-12T17:47:11.552 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libxslt-1.1.32-4.el8.x86_64 90/124 2020-06-12T17:47:11.552 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libquadmath-8.3.1-5.el8.x86_64 91/124 2020-06-12T17:47:11.553 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xfsprogs-devel-5.0.0-2.el8.x86_64 92/124 2020-06-12T17:47:11.553 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : elfutils-libelf-devel-0.178-7.el8.x86_64 93/124 2020-06-12T17:47:11.553 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libgfortran-8.3.1-5.el8.x86_64 94/124 2020-06-12T17:47:11.553 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : automake-1.16.1-6.el8.noarch 95/124 2020-06-12T17:47:11.553 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 96/124 2020-06-12T17:47:11.553 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 97/124 2020-06-12T17:47:11.554 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : jq-1.5-12.el8.x86_64 98/124 2020-06-12T17:47:11.554 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/124 2020-06-12T17:47:11.554 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 100/124 2020-06-12T17:47:11.554 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 101/124 2020-06-12T17:47:11.554 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 102/124 2020-06-12T17:47:11.555 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 103/124 2020-06-12T17:47:11.555 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 104/124 2020-06-12T17:47:11.555 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 105/124 2020-06-12T17:47:11.555 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 106/124 2020-06-12T17:47:11.555 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 107/124 2020-06-12T17:47:11.556 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 108/124 2020-06-12T17:47:11.556 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 109/124 2020-06-12T17:47:11.556 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flex-2.6.1-9.el8.x86_64 110/124 2020-06-12T17:47:11.557 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 111/124 2020-06-12T17:47:11.557 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : bison-3.0.4-10.el8.x86_64 112/124 2020-06-12T17:47:11.557 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 113/124 2020-06-12T17:47:11.557 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 114/124 2020-06-12T17:47:11.558 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 115/124 2020-06-12T17:47:11.558 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 116/124 2020-06-12T17:47:11.558 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 117/124 2020-06-12T17:47:11.559 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 118/124 2020-06-12T17:47:11.559 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 119/124 2020-06-12T17:47:11.560 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 120/124 2020-06-12T17:47:11.560 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-2:15.2.3-196.g91d24f4.el8.x86_64 121/124 2020-06-12T17:47:11.560 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 122/124 2020-06-12T17:47:11.561 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-2:15.2.3-196.g91d24f4.el8.x86_64 123/124 2020-06-12T17:47:13.093 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 124/124 2020-06-12T17:47:13.093 INFO:teuthology.orchestra.run.smithi038.stdout:Installed products updated. 2020-06-12T17:47:15.320 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:15.321 INFO:teuthology.orchestra.run.smithi038.stdout:Upgraded: 2020-06-12T17:47:15.321 INFO:teuthology.orchestra.run.smithi038.stdout: librados2-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.321 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.321 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:15.322 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2020-06-12T17:47:15.322 INFO:teuthology.orchestra.run.smithi038.stdout: automake-1.16.1-6.el8.noarch 2020-06-12T17:47:15.322 INFO:teuthology.orchestra.run.smithi038.stdout: bison-3.0.4-10.el8.x86_64 2020-06-12T17:47:15.322 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.322 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.323 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.323 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.323 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards-2:15.2.3-196.g91d24f4.el8.noarch 2020-06-12T17:47:15.323 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.323 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.324 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.324 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-cephadm-2:15.2.3-196.g91d24f4.el8.noarch 2020-06-12T17:47:15.324 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard-2:15.2.3-196.g91d24f4.el8.noarch 2020-06-12T17:47:15.324 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local-2:15.2.3-196.g91d24f4.el8.noarch 2020-06-12T17:47:15.324 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core-2:15.2.3-196.g91d24f4.el8.noarch 2020-06-12T17:47:15.325 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook-2:15.2.3-196.g91d24f4.el8.noarch 2020-06-12T17:47:15.325 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.325 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.325 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-prometheus-alerts-2:15.2.3-196.g91d24f4.el8.noarch 2020-06-12T17:47:15.325 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.325 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.326 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.326 INFO:teuthology.orchestra.run.smithi038.stdout: cephadm-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.326 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libelf-devel-0.178-7.el8.x86_64 2020-06-12T17:47:15.326 INFO:teuthology.orchestra.run.smithi038.stdout: flex-2.6.1-9.el8.x86_64 2020-06-12T17:47:15.326 INFO:teuthology.orchestra.run.smithi038.stdout: fmt-6.2.1-1.el8.x86_64 2020-06-12T17:47:15.327 INFO:teuthology.orchestra.run.smithi038.stdout: fuse-2.9.7-12.el8.x86_64 2020-06-12T17:47:15.327 INFO:teuthology.orchestra.run.smithi038.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-06-12T17:47:15.327 INFO:teuthology.orchestra.run.smithi038.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-06-12T17:47:15.327 INFO:teuthology.orchestra.run.smithi038.stdout: jq-1.5-12.el8.x86_64 2020-06-12T17:47:15.327 INFO:teuthology.orchestra.run.smithi038.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-06-12T17:47:15.328 INFO:teuthology.orchestra.run.smithi038.stdout: krb5-devel-1.17-18.el8.x86_64 2020-06-12T17:47:15.328 INFO:teuthology.orchestra.run.smithi038.stdout: leveldb-1.22-1.el8.x86_64 2020-06-12T17:47:15.328 INFO:teuthology.orchestra.run.smithi038.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-06-12T17:47:15.328 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.328 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.329 INFO:teuthology.orchestra.run.smithi038.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-06-12T17:47:15.329 INFO:teuthology.orchestra.run.smithi038.stdout: libgfortran-8.3.1-5.el8.x86_64 2020-06-12T17:47:15.329 INFO:teuthology.orchestra.run.smithi038.stdout: liboath-2.6.2-3.el8.x86_64 2020-06-12T17:47:15.329 INFO:teuthology.orchestra.run.smithi038.stdout: libquadmath-8.3.1-5.el8.x86_64 2020-06-12T17:47:15.330 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-06-12T17:47:15.330 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.330 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.330 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-06-12T17:47:15.330 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.331 INFO:teuthology.orchestra.run.smithi038.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-06-12T17:47:15.331 INFO:teuthology.orchestra.run.smithi038.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-06-12T17:47:15.331 INFO:teuthology.orchestra.run.smithi038.stdout: libtool-2.4.6-25.el8.x86_64 2020-06-12T17:47:15.331 INFO:teuthology.orchestra.run.smithi038.stdout: libunwind-1.3.1-3.el8.x86_64 2020-06-12T17:47:15.331 INFO:teuthology.orchestra.run.smithi038.stdout: libuuid-devel-2.32.1-22.el8.x86_64 2020-06-12T17:47:15.332 INFO:teuthology.orchestra.run.smithi038.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-06-12T17:47:15.332 INFO:teuthology.orchestra.run.smithi038.stdout: libxslt-1.1.32-4.el8.x86_64 2020-06-12T17:47:15.332 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-06-12T17:47:15.332 INFO:teuthology.orchestra.run.smithi038.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-06-12T17:47:15.332 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-0.3.3-5.el8.x86_64 2020-06-12T17:47:15.333 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-threads-0.3.3-5.el8.x86_64 2020-06-12T17:47:15.333 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-devel-1:1.1.1c-15.el8.x86_64 2020-06-12T17:47:15.333 INFO:teuthology.orchestra.run.smithi038.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-06-12T17:47:15.333 INFO:teuthology.orchestra.run.smithi038.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-06-12T17:47:15.333 INFO:teuthology.orchestra.run.smithi038.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-06-12T17:47:15.333 INFO:teuthology.orchestra.run.smithi038.stdout: python3-apipkg-1.5-6.el8.noarch 2020-06-12T17:47:15.334 INFO:teuthology.orchestra.run.smithi038.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-06-12T17:47:15.334 INFO:teuthology.orchestra.run.smithi038.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-06-12T17:47:15.334 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-06-12T17:47:15.334 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.334 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.335 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.335 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-06-12T17:47:15.335 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-06-12T17:47:15.335 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-06-12T17:47:15.335 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-06-12T17:47:15.335 INFO:teuthology.orchestra.run.smithi038.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-06-12T17:47:15.336 INFO:teuthology.orchestra.run.smithi038.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-06-12T17:47:15.336 INFO:teuthology.orchestra.run.smithi038.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-06-12T17:47:15.336 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-6.2-6.el8.noarch 2020-06-12T17:47:15.337 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-06-12T17:47:15.337 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-06-12T17:47:15.337 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-06-12T17:47:15.337 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-06-12T17:47:15.338 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-06-12T17:47:15.338 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-06-12T17:47:15.338 INFO:teuthology.orchestra.run.smithi038.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-06-12T17:47:15.338 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako-1.0.6-13.el8.noarch 2020-06-12T17:47:15.338 INFO:teuthology.orchestra.run.smithi038.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-06-12T17:47:15.339 INFO:teuthology.orchestra.run.smithi038.stdout: python3-more-itertools-7.2.0-4.el8.noarch 2020-06-12T17:47:15.339 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-06-12T17:47:15.339 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-06-12T17:47:15.339 INFO:teuthology.orchestra.run.smithi038.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-06-12T17:47:15.339 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-06-12T17:47:15.340 INFO:teuthology.orchestra.run.smithi038.stdout: python3-portend-2.6-1.el8.noarch 2020-06-12T17:47:15.340 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-06-12T17:47:15.340 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-06-12T17:47:15.340 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-06-12T17:47:15.340 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pytz-2017.2-9.el8.noarch 2020-06-12T17:47:15.341 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.341 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.341 INFO:teuthology.orchestra.run.smithi038.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-06-12T17:47:15.341 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-06-12T17:47:15.341 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-06-12T17:47:15.342 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.342 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes-2.4.1-12.el8.noarch 2020-06-12T17:47:15.342 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-06-12T17:47:15.342 INFO:teuthology.orchestra.run.smithi038.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2020-06-12T17:47:15.342 INFO:teuthology.orchestra.run.smithi038.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-06-12T17:47:15.343 INFO:teuthology.orchestra.run.smithi038.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-06-12T17:47:15.343 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-06-12T17:47:15.343 INFO:teuthology.orchestra.run.smithi038.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-06-12T17:47:15.344 INFO:teuthology.orchestra.run.smithi038.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-06-12T17:47:15.344 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-06-12T17:47:15.344 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-06-12T17:47:15.344 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-06-12T17:47:15.345 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-06-12T17:47:15.345 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-06-12T17:47:15.345 INFO:teuthology.orchestra.run.smithi038.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-06-12T17:47:15.345 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.345 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.346 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd-2:15.2.3-196.g91d24f4.el8.x86_64 2020-06-12T17:47:15.346 INFO:teuthology.orchestra.run.smithi038.stdout: socat-1.7.3.3-2.el8.x86_64 2020-06-12T17:47:15.346 INFO:teuthology.orchestra.run.smithi038.stdout: xfsprogs-devel-5.0.0-2.el8.x86_64 2020-06-12T17:47:15.346 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-06-12T17:47:15.346 INFO:teuthology.orchestra.run.smithi038.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-06-12T17:47:15.347 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:15.355 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2020-06-12T17:47:15.550 DEBUG:teuthology.parallel:result is None 2020-06-12T17:47:15.551 INFO:teuthology.orchestra.run.smithi038:> sudo lsb_release -is 2020-06-12T17:47:15.605 INFO:teuthology.orchestra.run.smithi038.stdout:RedHatEnterprise 2020-06-12T17:47:15.606 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-06-12T17:47:15.607 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=91d24f498556f86f6d1318d2efd5210c35b36762 2020-06-12T17:47:15.788 INFO:teuthology.orchestra.run.smithi038:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-06-12T17:47:15.808 INFO:teuthology.orchestra.run.smithi038.stdout:15.2.3-196.g91d24f4.el8 2020-06-12T17:47:15.809 INFO:teuthology.packaging:The installed version of ceph is 15.2.3-196.g91d24f4.el8 2020-06-12T17:47:15.809 INFO:teuthology.task.install:The correct ceph version 15.2.3-196.g91d24f4 is installed. 2020-06-12T17:47:15.810 INFO:teuthology.orchestra.run.smithi150:> sudo lsb_release -is 2020-06-12T17:47:15.863 INFO:teuthology.orchestra.run.smithi150.stdout:RedHatEnterprise 2020-06-12T17:47:15.864 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-06-12T17:47:15.865 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=91d24f498556f86f6d1318d2efd5210c35b36762 2020-06-12T17:47:16.038 INFO:teuthology.orchestra.run.smithi150:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-06-12T17:47:16.063 INFO:teuthology.orchestra.run.smithi150.stdout:15.2.3-196.g91d24f4.el8 2020-06-12T17:47:16.064 INFO:teuthology.packaging:The installed version of ceph is 15.2.3-196.g91d24f4.el8 2020-06-12T17:47:16.064 INFO:teuthology.task.install:The correct ceph version 15.2.3-196.g91d24f4 is installed. 2020-06-12T17:47:16.065 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-06-12T17:47:16.065 INFO:teuthology.orchestra.run.smithi038:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-06-12T17:47:16.101 INFO:teuthology.orchestra.run.smithi150:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-06-12T17:47:16.134 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-06-12T17:47:16.135 INFO:teuthology.orchestra.run.smithi038:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-06-12T17:47:16.174 INFO:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-06-12T17:47:16.245 INFO:teuthology.orchestra.run.smithi150:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-06-12T17:47:16.276 INFO:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-06-12T17:47:16.345 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-06-12T17:47:16.346 INFO:teuthology.orchestra.run.smithi038:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-06-12T17:47:16.390 INFO:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-06-12T17:47:16.461 INFO:teuthology.orchestra.run.smithi150:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-06-12T17:47:16.507 INFO:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-06-12T17:47:16.575 INFO:teuthology.run_tasks:Running task ceph... 2020-06-12T17:47:16.660 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-06-12T17:47:16.661 INFO:teuthology.orchestra.run.smithi038:> sudo chmod 777 /var/log/ceph 2020-06-12T17:47:16.664 INFO:teuthology.orchestra.run.smithi150:> sudo chmod 777 /var/log/ceph 2020-06-12T17:47:16.693 INFO:tasks.ceph:Disabling ceph logrotate... 2020-06-12T17:47:16.694 INFO:teuthology.orchestra.run.smithi038:> sudo rm -f -- /etc/logrotate.d/ceph 2020-06-12T17:47:16.736 INFO:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/logrotate.d/ceph 2020-06-12T17:47:16.764 INFO:tasks.ceph:Creating extra log directories... 2020-06-12T17:47:16.764 INFO:teuthology.orchestra.run.smithi038:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-06-12T17:47:16.806 INFO:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-06-12T17:47:16.835 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2020-06-12T17:47:16.835 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2020-06-12T17:47:16.836 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2020-06-12T17:47:16.836 INFO:teuthology.orchestra.run.smithi038:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-06-12T17:47:16.920 INFO:teuthology.orchestra.run.smithi038:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-06-12T17:47:17.041 INFO:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-06-12T17:47:17.072 INFO:teuthology.orchestra.run.smithi150:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-06-12T17:47:17.117 INFO:teuthology.orchestra.run.smithi150:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-06-12T17:47:17.229 INFO:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-06-12T17:47:17.262 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-06-12T17:47:17.262 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': ''}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2020-06-12T17:47:17.263 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/kchai-2020-06-12_17:27:13-fs-octopus-distro-basic-smithi/5142799', 'branch': 'octopus', 'description': 'fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-ec-root.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_latest.yaml} tasks/volumes.yaml}', 'email': 'tchaikov@gmail.com', 'first_in_suite': False, 'job_id': '5142799', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'kchai-2020-06-12_17:27:13-fs-octopus-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.1', 'overrides': {'admin_socket': {'branch': 'octopus'}, 'ceph': {'cephfs_ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': ''}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '91d24f498556f86f6d1318d2efd5210c35b36762'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'sha1': '91d24f498556f86f6d1318d2efd5210c35b36762'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'octopus-py3', 'sha1': '7b96008319793b6b4f7dacea0de024bbac590889'}}, 'owner': 'scheduled_kchai@teuthology', 'priority': 90, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.1'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.2', 'client.3']], 'sha1': '91d24f498556f86f6d1318d2efd5210c35b36762', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'octopus-py3', 'suite_path': '/home/teuthworker/src/github.com_tchaikov_ceph_octopus-py3/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/tchaikov/ceph.git', 'suite_sha1': '7b96008319793b6b4f7dacea0de024bbac590889', 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': '91d24f498556f86f6d1318d2efd5210c35b36762'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_volumes']}}], 'teuthology_branch': 'master', 'tube': 'smithi', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.27834', 'targets': {'smithi038.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCv7yp7C2yCa31nPdnmf5TyaWDG1raO4Kf3PyMgKJmgdLNw1KoiDl4MPyaGJ9/Xdnb00Cw9cN80CET8zIlLNdj97h3xn8FibnrVmwnA/+vaUwSw7wi+fkOnDuxtisGEplyoW8nb5zXOE7kNh3OL7vtSniYGKzb3nu5dC41IITncnONTLRdFdzMYDRYbR8USkNyjZGXSmUkBKP8kxC6rnhmmbkLJqKIB6wXrFMQzcqPx17xgu7HTIQf3EC+gTdJoGaU2BU+jTJ5QH3TTMyw09YX/lQd7gH6NrVxXnBd2C+lmb2P47ThuOeGQ/kptC1/aYLF4vvLCwA1PSVLkRNP4IxHlbCk7KRUxXJproZpavqA+fixO28gqFJWMQb/S01HF/lhSMue6k9Q14+sDTm4dqgxjpNBaGzzeMrGvMBpzIgvOaMRDUCaX5HByqqfc0uypowVxSWNnwj4Jz/QDhr9M0m7yRtgjTE7TcYdQaDwoZtd63Ngjfl7McVOgOcRktcSLSs8=', 'smithi150.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VR5fZNwkNG76K7a8RuptCG0MI0zRFYUGR1ErDoFWJ2e71r8r550o1iAZLy1rJw/U6elIVyCozZYMkwcIH1bi4W9Lkn6vJDJKed/gDyIoR82APvBe5eBtLkvm43gYO3Qhq/t0D83mfEdmKxlnbYbSoFCIoeZ0PyffJy15nc3f4NsOafVSWLEBOWJ4ggRK+oyrEJLSnGYUcu9jSDuMBRflN1HysNmOrZ9EOGQcpOVQ0RtcYe/qs20mLpgJJduKqj9CzjI58MMG27DzM3Sa5E3V8GBsku0Q4JMsNUqW2surMFCwKXrtPf8awGs6WBNzgVZ1LNOLJr9VSh+74i+SswzZ1w04lmzYQ9jLtwR+p11UNRTWq6xN9f0KKeHzl5Gu/CCt4wFWymATgxxkQvVENLWzEW7HHtD0yE99NCkHTJnpTs5QIqx3rtNskaS79/6aROQFnTBkVVP75OYAeIB0uwJ5qmsb9x/M1InkOO4+7756Obow/FbdJvWCUZ5PuDwvcyk='}} 2020-06-12T17:47:17.264 INFO:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-06-12T17:47:17.267 INFO:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-06-12T17:47:17.316 INFO:teuthology.orchestra.run.smithi038:> sudo install -d -m0777 -- /var/run/ceph 2020-06-12T17:47:17.321 INFO:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/run/ceph 2020-06-12T17:47:17.408 DEBUG:teuthology.orchestra.remote:smithi038:/scratch_devs is 72B 2020-06-12T17:47:17.461 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-06-12T17:47:17.462 INFO:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-06-12T17:47:17.476 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-06-12T17:47:17.476 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-12T17:47:17.477 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 6h/6d Inode: 101764 Links: 1 2020-06-12T17:47:17.477 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-12T17:47:17.477 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2020-06-12T17:47:17.477 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2020-06-12 17:47:11.170049767 +0000 2020-06-12T17:47:17.477 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2020-06-12 17:45:16.486191571 +0000 2020-06-12T17:47:17.478 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2020-06-12 17:45:16.486191571 +0000 2020-06-12T17:47:17.478 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: - 2020-06-12T17:47:17.494 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:47:17.494 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:47:17.495 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000317389 s, 1.6 MB/s 2020-06-12T17:47:17.496 INFO:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-06-12T17:47:17.551 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-06-12T17:47:17.552 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-12T17:47:17.552 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 6h/6d Inode: 99315 Links: 1 2020-06-12T17:47:17.552 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-12T17:47:17.552 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2020-06-12T17:47:17.553 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2020-06-12 17:47:11.170049767 +0000 2020-06-12T17:47:17.553 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2020-06-12 17:45:16.819185316 +0000 2020-06-12T17:47:17.553 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2020-06-12 17:45:16.819185316 +0000 2020-06-12T17:47:17.553 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: - 2020-06-12T17:47:17.567 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:47:17.567 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:47:17.568 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000264924 s, 1.9 MB/s 2020-06-12T17:47:17.570 INFO:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-06-12T17:47:17.625 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-06-12T17:47:17.625 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-12T17:47:17.626 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 6h/6d Inode: 102683 Links: 1 2020-06-12T17:47:17.626 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-12T17:47:17.626 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2020-06-12T17:47:17.626 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2020-06-12 17:47:11.170049767 +0000 2020-06-12T17:47:17.626 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2020-06-12 17:45:17.195178253 +0000 2020-06-12T17:47:17.627 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2020-06-12 17:45:17.195178253 +0000 2020-06-12T17:47:17.627 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: - 2020-06-12T17:47:17.641 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:47:17.642 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:47:17.642 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000257819 s, 2.0 MB/s 2020-06-12T17:47:17.644 INFO:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-06-12T17:47:17.698 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-06-12T17:47:17.699 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-12T17:47:17.699 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 6h/6d Inode: 104578 Links: 1 2020-06-12T17:47:17.699 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-12T17:47:17.699 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2020-06-12T17:47:17.700 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2020-06-12 17:47:11.170049767 +0000 2020-06-12T17:47:17.700 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2020-06-12 17:45:17.555171491 +0000 2020-06-12T17:47:17.700 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2020-06-12 17:45:17.555171491 +0000 2020-06-12T17:47:17.700 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: - 2020-06-12T17:47:17.719 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:47:17.719 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:47:17.719 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000248043 s, 2.1 MB/s 2020-06-12T17:47:17.720 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-06-12T17:47:17.737 DEBUG:teuthology.orchestra.remote:smithi150:/scratch_devs is 72B 2020-06-12T17:47:17.791 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-06-12T17:47:17.792 INFO:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-06-12T17:47:17.814 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-06-12T17:47:17.814 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-12T17:47:17.814 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 103466 Links: 1 2020-06-12T17:47:17.815 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-12T17:47:17.815 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2020-06-12T17:47:17.815 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2020-06-12 17:47:01.797705333 +0000 2020-06-12T17:47:17.815 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2020-06-12 17:45:06.020514344 +0000 2020-06-12T17:47:17.815 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2020-06-12 17:45:06.020514344 +0000 2020-06-12T17:47:17.816 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2020-06-12T17:47:17.825 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2020-06-12T17:47:17.825 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2020-06-12T17:47:17.825 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000234379 s, 2.2 MB/s 2020-06-12T17:47:17.827 INFO:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-06-12T17:47:17.881 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-06-12T17:47:17.882 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-12T17:47:17.882 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 100545 Links: 1 2020-06-12T17:47:17.882 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-12T17:47:17.882 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2020-06-12T17:47:17.882 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2020-06-12 17:47:01.797705333 +0000 2020-06-12T17:47:17.883 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2020-06-12 17:45:06.353507722 +0000 2020-06-12T17:47:17.883 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2020-06-12 17:45:06.353507722 +0000 2020-06-12T17:47:17.883 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2020-06-12T17:47:17.894 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2020-06-12T17:47:17.895 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2020-06-12T17:47:17.895 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000197591 s, 2.6 MB/s 2020-06-12T17:47:17.897 INFO:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-06-12T17:47:17.951 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-06-12T17:47:17.951 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-12T17:47:17.952 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 100605 Links: 1 2020-06-12T17:47:17.952 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-12T17:47:17.952 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2020-06-12T17:47:17.952 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2020-06-12 17:47:01.797705333 +0000 2020-06-12T17:47:17.952 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2020-06-12 17:45:06.675501320 +0000 2020-06-12T17:47:17.953 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2020-06-12 17:45:06.675501320 +0000 2020-06-12T17:47:17.953 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2020-06-12T17:47:17.964 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2020-06-12T17:47:17.964 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2020-06-12T17:47:17.964 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000158465 s, 3.2 MB/s 2020-06-12T17:47:17.969 INFO:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-06-12T17:47:18.023 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-06-12T17:47:18.024 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-12T17:47:18.024 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 104636 Links: 1 2020-06-12T17:47:18.025 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-12T17:47:18.025 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2020-06-12T17:47:18.025 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2020-06-12 17:47:01.798705313 +0000 2020-06-12T17:47:18.025 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2020-06-12 17:45:07.010494659 +0000 2020-06-12T17:47:18.026 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2020-06-12 17:45:07.010494659 +0000 2020-06-12T17:47:18.026 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2020-06-12T17:47:18.036 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2020-06-12T17:47:18.037 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2020-06-12T17:47:18.037 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000168394 s, 3.0 MB/s 2020-06-12T17:47:18.039 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-06-12T17:47:18.039 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi038.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2020-06-12T17:47:18.040 INFO:tasks.ceph:Generating config... 2020-06-12T17:47:18.041 INFO:tasks.ceph:[client] client mount timeout = 600 2020-06-12T17:47:18.042 INFO:tasks.ceph:[client] debug client = 20 2020-06-12T17:47:18.042 INFO:tasks.ceph:[client] debug ms = 1 2020-06-12T17:47:18.042 INFO:tasks.ceph:[client] pid file = 2020-06-12T17:47:18.043 INFO:tasks.ceph:[mds] debug mds = 20 2020-06-12T17:47:18.043 INFO:tasks.ceph:[mds] debug ms = 1 2020-06-12T17:47:18.043 INFO:tasks.ceph:[mds] mds bal frag = True 2020-06-12T17:47:18.043 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2020-06-12T17:47:18.044 INFO:tasks.ceph:[mds] mds bal merge size = 5 2020-06-12T17:47:18.044 INFO:tasks.ceph:[mds] mds bal split bits = 3 2020-06-12T17:47:18.045 INFO:tasks.ceph:[mds] mds bal split size = 100 2020-06-12T17:47:18.052 INFO:tasks.ceph:[mds] mds debug frag = True 2020-06-12T17:47:18.052 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2020-06-12T17:47:18.052 INFO:tasks.ceph:[mds] mds op complaint time = 180 2020-06-12T17:47:18.053 INFO:tasks.ceph:[mds] mds verify scatter = True 2020-06-12T17:47:18.053 INFO:tasks.ceph:[mds] osd op complaint time = 180 2020-06-12T17:47:18.053 INFO:tasks.ceph:[mgr] debug mgr = 20 2020-06-12T17:47:18.053 INFO:tasks.ceph:[mgr] debug ms = 1 2020-06-12T17:47:18.054 INFO:tasks.ceph:[mon] debug mon = 20 2020-06-12T17:47:18.054 INFO:tasks.ceph:[mon] debug ms = 1 2020-06-12T17:47:18.054 INFO:tasks.ceph:[mon] debug paxos = 20 2020-06-12T17:47:18.055 INFO:tasks.ceph:[mon] mon op complaint time = 120 2020-06-12T17:47:18.055 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-06-12T17:47:18.055 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-06-12T17:47:18.055 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-06-12T17:47:18.056 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-06-12T17:47:18.056 INFO:tasks.ceph:[osd] debug filestore = 20 2020-06-12T17:47:18.056 INFO:tasks.ceph:[osd] debug journal = 20 2020-06-12T17:47:18.056 INFO:tasks.ceph:[osd] debug ms = 20 2020-06-12T17:47:18.057 INFO:tasks.ceph:[osd] debug osd = 25 2020-06-12T17:47:18.057 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-06-12T17:47:18.057 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-06-12T17:47:18.058 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-06-12T17:47:18.058 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-06-12T17:47:18.059 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-06-12T17:47:18.059 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-06-12T17:47:18.060 INFO:tasks.ceph:[osd] osd op complaint time = 180 2020-06-12T17:47:18.060 INFO:tasks.ceph:Setting up mon.a... 2020-06-12T17:47:18.060 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-06-12T17:47:18.114 INFO:teuthology.orchestra.run.smithi038.stdout:creating /etc/ceph/ceph.keyring 2020-06-12T17:47:18.116 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-06-12T17:47:18.162 INFO:teuthology.orchestra.run.smithi038:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-06-12T17:47:18.193 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.38'), ('mon.b', '172.21.15.150'), ('mon.c', '[v2:172.21.15.150:3301,v1:172.21.15.150:6790]')] 2020-06-12T17:47:18.194 INFO:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.38 --add b 172.21.15.150 --addv c '[v2:172.21.15.150:3301,v1:172.21.15.150:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2020-06-12T17:47:18.271 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-06-12T17:47:18.271 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: generated fsid 8e42a2e7-b187-42c4-a73f-8f812ee62352 2020-06-12T17:47:18.272 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 0 2020-06-12T17:47:18.272 INFO:teuthology.orchestra.run.smithi038.stdout:fsid 8e42a2e7-b187-42c4-a73f-8f812ee62352 2020-06-12T17:47:18.272 INFO:teuthology.orchestra.run.smithi038.stdout:last_changed 2020-06-12T17:47:18.268736+0000 2020-06-12T17:47:18.272 INFO:teuthology.orchestra.run.smithi038.stdout:created 2020-06-12T17:47:18.268736+0000 2020-06-12T17:47:18.272 INFO:teuthology.orchestra.run.smithi038.stdout:min_mon_release 0 (unknown) 2020-06-12T17:47:18.272 INFO:teuthology.orchestra.run.smithi038.stdout:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2020-06-12T17:47:18.273 INFO:teuthology.orchestra.run.smithi038.stdout:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2020-06-12T17:47:18.273 INFO:teuthology.orchestra.run.smithi038.stdout:2: [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] mon.c 2020-06-12T17:47:18.273 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-06-12T17:47:18.274 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8e42a2e7-b187-42c4-a73f-8f812ee62352... 2020-06-12T17:47:18.276 INFO:teuthology.orchestra.run.smithi038:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-06-12T17:47:18.316 INFO:teuthology.orchestra.run.smithi150:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-06-12T17:47:18.369 INFO:teuthology.orchestra.run.smithi150.stdout:[global] 2020-06-12T17:47:18.370 INFO:teuthology.orchestra.run.smithi150.stdout: chdir = "" 2020-06-12T17:47:18.370 INFO:teuthology.orchestra.run.smithi150.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-06-12T17:47:18.370 INFO:teuthology.orchestra.run.smithi150.stdout: auth supported = cephx 2020-06-12T17:47:18.370 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:18.370 INFO:teuthology.orchestra.run.smithi150.stdout: filestore xattr use omap = true 2020-06-12T17:47:18.371 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:18.371 INFO:teuthology.orchestra.run.smithi150.stdout: mon clock drift allowed = 1.000 2020-06-12T17:47:18.371 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:18.371 INFO:teuthology.orchestra.run.smithi150.stdout: osd crush chooseleaf type = 0 2020-06-12T17:47:18.371 INFO:teuthology.orchestra.run.smithi150.stdout: auth debug = true 2020-06-12T17:47:18.372 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:18.372 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on old message = true 2020-06-12T17:47:18.372 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on bug = true 2020-06-12T17:47:18.372 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:18.372 INFO:teuthology.orchestra.run.smithi150.stdout: mon max pg per osd = 10000 # >= luminous 2020-06-12T17:47:18.372 INFO:teuthology.orchestra.run.smithi150.stdout: mon pg warn max object skew = 0 2020-06-12T17:47:18.373 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:18.373 INFO:teuthology.orchestra.run.smithi150.stdout: # disable pg_autoscaler by default for new pools 2020-06-12T17:47:18.373 INFO:teuthology.orchestra.run.smithi150.stdout: osd_pool_default_pg_autoscale_mode = off 2020-06-12T17:47:18.373 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:18.373 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default size = 2 2020-06-12T17:47:18.374 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:18.374 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow primary affinity = true 2020-06-12T17:47:18.374 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow pg remap = true 2020-06-12T17:47:18.374 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on legacy crush tunables = false 2020-06-12T17:47:18.374 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on crush straw calc version zero = false 2020-06-12T17:47:18.375 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on no sortbitwise = false 2020-06-12T17:47:18.375 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on osd down out interval zero = false 2020-06-12T17:47:18.375 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on too few osds = false 2020-06-12T17:47:18.375 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-06-12T17:47:18.375 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_no_redundancy = false 2020-06-12T17:47:18.375 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:18.376 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-06-12T17:47:18.376 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:18.376 INFO:teuthology.orchestra.run.smithi150.stdout: osd default data pool replay window = 5 2020-06-12T17:47:18.377 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:18.377 INFO:teuthology.orchestra.run.smithi150.stdout: mon allow pool delete = true 2020-06-12T17:47:18.377 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:18.378 INFO:teuthology.orchestra.run.smithi150.stdout: mon cluster log file level = debug 2020-06-12T17:47:18.378 INFO:teuthology.orchestra.run.smithi150.stdout: debug asserts on shutdown = true 2020-06-12T17:47:18.378 INFO:teuthology.orchestra.run.smithi150.stdout: mon host = "172.21.15.38,172.21.15.150,[v2:172.21.15.150:3301,v1:172.21.15.150:6790]" 2020-06-12T17:47:18.378 INFO:teuthology.orchestra.run.smithi150.stdout: fsid = 8e42a2e7-b187-42c4-a73f-8f812ee62352 2020-06-12T17:47:18.379 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:18.379 INFO:teuthology.orchestra.run.smithi150.stdout:[osd] 2020-06-12T17:47:18.379 INFO:teuthology.orchestra.run.smithi150.stdout: osd journal size = 100 2020-06-12T17:47:18.379 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:18.380 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub load threshold = 5.0 2020-06-12T17:47:18.380 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub max interval = 600 2020-06-12T17:47:18.380 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:18.380 INFO:teuthology.orchestra.run.smithi150.stdout: osd recover clone overlap = true 2020-06-12T17:47:18.380 INFO:teuthology.orchestra.run.smithi150.stdout: osd recovery max chunk = 1048576 2020-06-12T17:47:18.381 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:18.381 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug shutdown = true 2020-06-12T17:47:18.381 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug op order = true 2020-06-12T17:47:18.381 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug verify stray on activate = true 2020-06-12T17:47:18.381 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:18.382 INFO:teuthology.orchestra.run.smithi150.stdout: osd open classes on start = true 2020-06-12T17:47:18.383 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug pg log writeout = true 2020-06-12T17:47:18.383 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:18.383 INFO:teuthology.orchestra.run.smithi150.stdout: osd deep scrub update digest min age = 30 2020-06-12T17:47:18.384 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:18.384 INFO:teuthology.orchestra.run.smithi150.stdout: osd map max advance = 10 2020-06-12T17:47:18.384 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:18.384 INFO:teuthology.orchestra.run.smithi150.stdout: journal zero on create = true 2020-06-12T17:47:18.385 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:18.385 INFO:teuthology.orchestra.run.smithi150.stdout: filestore ondisk finisher threads = 3 2020-06-12T17:47:18.385 INFO:teuthology.orchestra.run.smithi150.stdout: filestore apply finisher threads = 3 2020-06-12T17:47:18.385 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:18.385 INFO:teuthology.orchestra.run.smithi150.stdout: bdev debug aio = true 2020-06-12T17:47:18.386 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug misdirected ops = true 2020-06-12T17:47:18.386 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore block size = 96636764160 2020-06-12T17:47:18.386 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore fsck on mount = True 2020-06-12T17:47:18.386 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluefs = 20 2020-06-12T17:47:18.386 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluestore = 20 2020-06-12T17:47:18.387 INFO:teuthology.orchestra.run.smithi150.stdout: debug filestore = 20 2020-06-12T17:47:18.387 INFO:teuthology.orchestra.run.smithi150.stdout: debug journal = 20 2020-06-12T17:47:18.387 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 20 2020-06-12T17:47:18.387 INFO:teuthology.orchestra.run.smithi150.stdout: debug osd = 25 2020-06-12T17:47:18.387 INFO:teuthology.orchestra.run.smithi150.stdout: debug rocksdb = 10 2020-06-12T17:47:18.388 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd backfillfull_ratio = 0.85 2020-06-12T17:47:18.388 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd full ratio = 0.9 2020-06-12T17:47:18.388 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd nearfull ratio = 0.8 2020-06-12T17:47:18.388 INFO:teuthology.orchestra.run.smithi150.stdout: osd failsafe full ratio = 0.95 2020-06-12T17:47:18.388 INFO:teuthology.orchestra.run.smithi150.stdout: osd objectstore = bluestore 2020-06-12T17:47:18.389 INFO:teuthology.orchestra.run.smithi150.stdout: osd op complaint time = 180 2020-06-12T17:47:18.389 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:18.389 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr] 2020-06-12T17:47:18.389 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2020-06-12T17:47:18.390 INFO:teuthology.orchestra.run.smithi150.stdout: debug mgr = 20 2020-06-12T17:47:18.390 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2020-06-12T17:47:18.390 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2020-06-12T17:47:18.390 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2020-06-12T17:47:18.390 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2020-06-12T17:47:18.390 INFO:teuthology.orchestra.run.smithi150.stdout: mgr/telemetry/nag = false 2020-06-12T17:47:18.391 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:18.391 INFO:teuthology.orchestra.run.smithi150.stdout:[mon] 2020-06-12T17:47:18.391 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2020-06-12T17:47:18.391 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2020-06-12T17:47:18.391 INFO:teuthology.orchestra.run.smithi150.stdout: debug paxos = 20 2020-06-12T17:47:18.392 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2020-06-12T17:47:18.392 INFO:teuthology.orchestra.run.smithi150.stdout: mon data avail warn = 5 2020-06-12T17:47:18.392 INFO:teuthology.orchestra.run.smithi150.stdout: mon mgr mkfs grace = 240 2020-06-12T17:47:18.392 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2020-06-12T17:47:18.392 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd reporter subtree level = osd 2020-06-12T17:47:18.393 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd prime pg temp = true 2020-06-12T17:47:18.393 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2020-06-12T17:47:18.393 INFO:teuthology.orchestra.run.smithi150.stdout: mon op complaint time = 120 2020-06-12T17:47:18.393 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-06-12T17:47:18.393 INFO:teuthology.orchestra.run.smithi150.stdout:[client] 2020-06-12T17:47:18.394 INFO:teuthology.orchestra.run.smithi150.stdout: rgw cache enabled = true 2020-06-12T17:47:18.394 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable ops log = true 2020-06-12T17:47:18.394 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable usage log = true 2020-06-12T17:47:18.394 INFO:teuthology.orchestra.run.smithi150.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-06-12T17:47:18.394 INFO:teuthology.orchestra.run.smithi150.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-06-12T17:47:18.395 INFO:teuthology.orchestra.run.smithi150.stdout: client mount timeout = 600 2020-06-12T17:47:18.395 INFO:teuthology.orchestra.run.smithi150.stdout: debug client = 20 2020-06-12T17:47:18.395 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2020-06-12T17:47:18.395 INFO:teuthology.orchestra.run.smithi150.stdout: pid file = "" 2020-06-12T17:47:18.395 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.a] 2020-06-12T17:47:18.396 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.b] 2020-06-12T17:47:18.396 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.c] 2020-06-12T17:47:18.396 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.a] 2020-06-12T17:47:18.396 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.b] 2020-06-12T17:47:18.397 INFO:teuthology.orchestra.run.smithi150.stdout:[mds] 2020-06-12T17:47:18.397 INFO:teuthology.orchestra.run.smithi150.stdout: debug mds = 20 2020-06-12T17:47:18.397 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2020-06-12T17:47:18.397 INFO:teuthology.orchestra.run.smithi150.stdout: mds bal frag = True 2020-06-12T17:47:18.397 INFO:teuthology.orchestra.run.smithi150.stdout: mds bal fragment size max = 10000 2020-06-12T17:47:18.397 INFO:teuthology.orchestra.run.smithi150.stdout: mds bal merge size = 5 2020-06-12T17:47:18.398 INFO:teuthology.orchestra.run.smithi150.stdout: mds bal split bits = 3 2020-06-12T17:47:18.398 INFO:teuthology.orchestra.run.smithi150.stdout: mds bal split size = 100 2020-06-12T17:47:18.398 INFO:teuthology.orchestra.run.smithi150.stdout: mds debug frag = True 2020-06-12T17:47:18.398 INFO:teuthology.orchestra.run.smithi150.stdout: mds debug scatterstat = True 2020-06-12T17:47:18.398 INFO:teuthology.orchestra.run.smithi150.stdout: mds op complaint time = 180 2020-06-12T17:47:18.399 INFO:teuthology.orchestra.run.smithi150.stdout: mds verify scatter = True 2020-06-12T17:47:18.399 INFO:teuthology.orchestra.run.smithi150.stdout: osd op complaint time = 180 2020-06-12T17:47:18.400 INFO:teuthology.orchestra.run.smithi038.stdout:[global] 2020-06-12T17:47:18.400 INFO:teuthology.orchestra.run.smithi038.stdout: chdir = "" 2020-06-12T17:47:18.401 INFO:teuthology.orchestra.run.smithi038.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-06-12T17:47:18.401 INFO:teuthology.orchestra.run.smithi038.stdout: auth supported = cephx 2020-06-12T17:47:18.401 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:18.401 INFO:teuthology.orchestra.run.smithi038.stdout: filestore xattr use omap = true 2020-06-12T17:47:18.402 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:18.402 INFO:teuthology.orchestra.run.smithi038.stdout: mon clock drift allowed = 1.000 2020-06-12T17:47:18.402 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:18.402 INFO:teuthology.orchestra.run.smithi038.stdout: osd crush chooseleaf type = 0 2020-06-12T17:47:18.402 INFO:teuthology.orchestra.run.smithi038.stdout: auth debug = true 2020-06-12T17:47:18.403 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:18.403 INFO:teuthology.orchestra.run.smithi038.stdout: ms die on old message = true 2020-06-12T17:47:18.403 INFO:teuthology.orchestra.run.smithi038.stdout: ms die on bug = true 2020-06-12T17:47:18.403 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:18.403 INFO:teuthology.orchestra.run.smithi038.stdout: mon max pg per osd = 10000 # >= luminous 2020-06-12T17:47:18.404 INFO:teuthology.orchestra.run.smithi038.stdout: mon pg warn max object skew = 0 2020-06-12T17:47:18.404 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:18.404 INFO:teuthology.orchestra.run.smithi038.stdout: # disable pg_autoscaler by default for new pools 2020-06-12T17:47:18.404 INFO:teuthology.orchestra.run.smithi038.stdout: osd_pool_default_pg_autoscale_mode = off 2020-06-12T17:47:18.404 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:18.405 INFO:teuthology.orchestra.run.smithi038.stdout: osd pool default size = 2 2020-06-12T17:47:18.405 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:18.405 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd allow primary affinity = true 2020-06-12T17:47:18.405 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd allow pg remap = true 2020-06-12T17:47:18.405 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on legacy crush tunables = false 2020-06-12T17:47:18.405 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on crush straw calc version zero = false 2020-06-12T17:47:18.406 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on no sortbitwise = false 2020-06-12T17:47:18.406 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on osd down out interval zero = false 2020-06-12T17:47:18.406 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on too few osds = false 2020-06-12T17:47:18.406 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-06-12T17:47:18.406 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_pool_no_redundancy = false 2020-06-12T17:47:18.407 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:18.407 INFO:teuthology.orchestra.run.smithi038.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-06-12T17:47:18.407 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:18.407 INFO:teuthology.orchestra.run.smithi038.stdout: osd default data pool replay window = 5 2020-06-12T17:47:18.407 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:18.407 INFO:teuthology.orchestra.run.smithi038.stdout: mon allow pool delete = true 2020-06-12T17:47:18.408 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:18.408 INFO:teuthology.orchestra.run.smithi038.stdout: mon cluster log file level = debug 2020-06-12T17:47:18.408 INFO:teuthology.orchestra.run.smithi038.stdout: debug asserts on shutdown = true 2020-06-12T17:47:18.408 INFO:teuthology.orchestra.run.smithi038.stdout: mon host = "172.21.15.38,172.21.15.150,[v2:172.21.15.150:3301,v1:172.21.15.150:6790]" 2020-06-12T17:47:18.408 INFO:teuthology.orchestra.run.smithi038.stdout: fsid = 8e42a2e7-b187-42c4-a73f-8f812ee62352 2020-06-12T17:47:18.409 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:18.409 INFO:teuthology.orchestra.run.smithi038.stdout:[osd] 2020-06-12T17:47:18.409 INFO:teuthology.orchestra.run.smithi038.stdout: osd journal size = 100 2020-06-12T17:47:18.409 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:18.410 INFO:teuthology.orchestra.run.smithi038.stdout: osd scrub load threshold = 5.0 2020-06-12T17:47:18.410 INFO:teuthology.orchestra.run.smithi038.stdout: osd scrub max interval = 600 2020-06-12T17:47:18.410 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:18.410 INFO:teuthology.orchestra.run.smithi038.stdout: osd recover clone overlap = true 2020-06-12T17:47:18.411 INFO:teuthology.orchestra.run.smithi038.stdout: osd recovery max chunk = 1048576 2020-06-12T17:47:18.411 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:18.411 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug shutdown = true 2020-06-12T17:47:18.411 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug op order = true 2020-06-12T17:47:18.412 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug verify stray on activate = true 2020-06-12T17:47:18.412 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:18.412 INFO:teuthology.orchestra.run.smithi038.stdout: osd open classes on start = true 2020-06-12T17:47:18.412 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug pg log writeout = true 2020-06-12T17:47:18.413 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:18.413 INFO:teuthology.orchestra.run.smithi038.stdout: osd deep scrub update digest min age = 30 2020-06-12T17:47:18.413 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:18.413 INFO:teuthology.orchestra.run.smithi038.stdout: osd map max advance = 10 2020-06-12T17:47:18.413 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:18.414 INFO:teuthology.orchestra.run.smithi038.stdout: journal zero on create = true 2020-06-12T17:47:18.414 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:18.414 INFO:teuthology.orchestra.run.smithi038.stdout: filestore ondisk finisher threads = 3 2020-06-12T17:47:18.414 INFO:teuthology.orchestra.run.smithi038.stdout: filestore apply finisher threads = 3 2020-06-12T17:47:18.414 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:18.415 INFO:teuthology.orchestra.run.smithi038.stdout: bdev debug aio = true 2020-06-12T17:47:18.415 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug misdirected ops = true 2020-06-12T17:47:18.415 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore block size = 96636764160 2020-06-12T17:47:18.415 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore fsck on mount = True 2020-06-12T17:47:18.415 INFO:teuthology.orchestra.run.smithi038.stdout: debug bluefs = 20 2020-06-12T17:47:18.415 INFO:teuthology.orchestra.run.smithi038.stdout: debug bluestore = 20 2020-06-12T17:47:18.417 INFO:teuthology.orchestra.run.smithi038.stdout: debug filestore = 20 2020-06-12T17:47:18.417 INFO:teuthology.orchestra.run.smithi038.stdout: debug journal = 20 2020-06-12T17:47:18.417 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 20 2020-06-12T17:47:18.417 INFO:teuthology.orchestra.run.smithi038.stdout: debug osd = 25 2020-06-12T17:47:18.417 INFO:teuthology.orchestra.run.smithi038.stdout: debug rocksdb = 10 2020-06-12T17:47:18.418 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd backfillfull_ratio = 0.85 2020-06-12T17:47:18.418 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd full ratio = 0.9 2020-06-12T17:47:18.418 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd nearfull ratio = 0.8 2020-06-12T17:47:18.418 INFO:teuthology.orchestra.run.smithi038.stdout: osd failsafe full ratio = 0.95 2020-06-12T17:47:18.419 INFO:teuthology.orchestra.run.smithi038.stdout: osd objectstore = bluestore 2020-06-12T17:47:18.419 INFO:teuthology.orchestra.run.smithi038.stdout: osd op complaint time = 180 2020-06-12T17:47:18.419 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:18.419 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr] 2020-06-12T17:47:18.419 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2020-06-12T17:47:18.420 INFO:teuthology.orchestra.run.smithi038.stdout: debug mgr = 20 2020-06-12T17:47:18.420 INFO:teuthology.orchestra.run.smithi038.stdout: debug mon = 20 2020-06-12T17:47:18.420 INFO:teuthology.orchestra.run.smithi038.stdout: debug auth = 20 2020-06-12T17:47:18.421 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min pgs per osd = 4 2020-06-12T17:47:18.422 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min bytes per osd = 10 2020-06-12T17:47:18.422 INFO:teuthology.orchestra.run.smithi038.stdout: mgr/telemetry/nag = false 2020-06-12T17:47:18.422 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:18.423 INFO:teuthology.orchestra.run.smithi038.stdout:[mon] 2020-06-12T17:47:18.423 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2020-06-12T17:47:18.423 INFO:teuthology.orchestra.run.smithi038.stdout: debug mon = 20 2020-06-12T17:47:18.423 INFO:teuthology.orchestra.run.smithi038.stdout: debug paxos = 20 2020-06-12T17:47:18.423 INFO:teuthology.orchestra.run.smithi038.stdout: debug auth = 20 2020-06-12T17:47:18.424 INFO:teuthology.orchestra.run.smithi038.stdout: mon data avail warn = 5 2020-06-12T17:47:18.424 INFO:teuthology.orchestra.run.smithi038.stdout: mon mgr mkfs grace = 240 2020-06-12T17:47:18.424 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min pgs per osd = 4 2020-06-12T17:47:18.424 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd reporter subtree level = osd 2020-06-12T17:47:18.424 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd prime pg temp = true 2020-06-12T17:47:18.425 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min bytes per osd = 10 2020-06-12T17:47:18.425 INFO:teuthology.orchestra.run.smithi038.stdout: mon op complaint time = 120 2020-06-12T17:47:18.425 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:47:18.425 INFO:teuthology.orchestra.run.smithi038.stdout:[client] 2020-06-12T17:47:18.425 INFO:teuthology.orchestra.run.smithi038.stdout: rgw cache enabled = true 2020-06-12T17:47:18.425 INFO:teuthology.orchestra.run.smithi038.stdout: rgw enable ops log = true 2020-06-12T17:47:18.426 INFO:teuthology.orchestra.run.smithi038.stdout: rgw enable usage log = true 2020-06-12T17:47:18.426 INFO:teuthology.orchestra.run.smithi038.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-06-12T17:47:18.426 INFO:teuthology.orchestra.run.smithi038.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-06-12T17:47:18.426 INFO:teuthology.orchestra.run.smithi038.stdout: client mount timeout = 600 2020-06-12T17:47:18.426 INFO:teuthology.orchestra.run.smithi038.stdout: debug client = 20 2020-06-12T17:47:18.427 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2020-06-12T17:47:18.427 INFO:teuthology.orchestra.run.smithi038.stdout: pid file = "" 2020-06-12T17:47:18.427 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.a] 2020-06-12T17:47:18.427 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.b] 2020-06-12T17:47:18.427 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.c] 2020-06-12T17:47:18.427 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.a] 2020-06-12T17:47:18.428 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.b] 2020-06-12T17:47:18.428 INFO:teuthology.orchestra.run.smithi038.stdout:[mds] 2020-06-12T17:47:18.428 INFO:teuthology.orchestra.run.smithi038.stdout: debug mds = 20 2020-06-12T17:47:18.428 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2020-06-12T17:47:18.428 INFO:teuthology.orchestra.run.smithi038.stdout: mds bal frag = True 2020-06-12T17:47:18.429 INFO:teuthology.orchestra.run.smithi038.stdout: mds bal fragment size max = 10000 2020-06-12T17:47:18.429 INFO:teuthology.orchestra.run.smithi038.stdout: mds bal merge size = 5 2020-06-12T17:47:18.429 INFO:teuthology.orchestra.run.smithi038.stdout: mds bal split bits = 3 2020-06-12T17:47:18.429 INFO:teuthology.orchestra.run.smithi038.stdout: mds bal split size = 100 2020-06-12T17:47:18.429 INFO:teuthology.orchestra.run.smithi038.stdout: mds debug frag = True 2020-06-12T17:47:18.429 INFO:teuthology.orchestra.run.smithi038.stdout: mds debug scatterstat = True 2020-06-12T17:47:18.430 INFO:teuthology.orchestra.run.smithi038.stdout: mds op complaint time = 180 2020-06-12T17:47:18.430 INFO:teuthology.orchestra.run.smithi038.stdout: mds verify scatter = True 2020-06-12T17:47:18.430 INFO:teuthology.orchestra.run.smithi038.stdout: osd op complaint time = 180 2020-06-12T17:47:18.430 INFO:tasks.ceph:Creating admin key on mon.a... 2020-06-12T17:47:18.431 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-06-12T17:47:18.486 INFO:tasks.ceph:Copying monmap to all nodes... 2020-06-12T17:47:18.504 DEBUG:teuthology.orchestra.remote:smithi038:/etc/ceph/ceph.keyring is 206B 2020-06-12T17:47:18.596 DEBUG:teuthology.orchestra.remote:smithi038:/home/ubuntu/cephtest/ceph.monmap is 379B 2020-06-12T17:47:18.644 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi038.front.sepia.ceph.com 2020-06-12T17:47:18.645 INFO:teuthology.orchestra.run.smithi038:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-06-12T17:47:18.707 INFO:teuthology.orchestra.run.smithi038:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-06-12T17:47:18.792 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi150.front.sepia.ceph.com 2020-06-12T17:47:18.792 INFO:teuthology.orchestra.run.smithi150:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-06-12T17:47:18.882 INFO:teuthology.orchestra.run.smithi150:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-06-12T17:47:18.926 INFO:tasks.ceph:Setting up mon nodes... 2020-06-12T17:47:18.927 INFO:tasks.ceph:Setting up mgr nodes... 2020-06-12T17:47:18.927 INFO:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-06-12T17:47:18.989 INFO:teuthology.orchestra.run.smithi038.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-06-12T17:47:18.991 INFO:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-06-12T17:47:19.118 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-06-12T17:47:19.120 INFO:tasks.ceph:Setting up mds nodes... 2020-06-12T17:47:19.121 INFO:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2020-06-12T17:47:19.182 INFO:teuthology.orchestra.run.smithi038.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2020-06-12T17:47:19.184 INFO:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2020-06-12T17:47:19.215 INFO:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2020-06-12T17:47:19.276 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2020-06-12T17:47:19.279 INFO:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2020-06-12T17:47:19.308 INFO:tasks.ceph_client:Setting up client nodes... 2020-06-12T17:47:19.309 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-06-12T17:47:19.353 INFO:teuthology.orchestra.run.smithi038.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-06-12T17:47:19.372 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2020-06-12T17:47:19.416 INFO:teuthology.orchestra.run.smithi038.stdout:creating /etc/ceph/ceph.client.1.keyring 2020-06-12T17:47:19.435 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2020-06-12T17:47:19.476 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.client.2.keyring 2020-06-12T17:47:19.492 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2020-06-12T17:47:19.572 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.client.3.keyring 2020-06-12T17:47:19.587 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-06-12T17:47:19.588 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi038.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2020-06-12T17:47:19.588 INFO:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-06-12T17:47:19.619 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-06-12T17:47:19.620 INFO:tasks.ceph:role: osd.0 2020-06-12T17:47:19.620 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi038.front.sepia.ceph.com 2020-06-12T17:47:19.620 INFO:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-06-12T17:47:21.021 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-06-12T17:47:21.022 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2020-06-12T17:47:21.022 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-06-12T17:47:21.022 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 2020-06-12T17:47:21.023 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-06-12T17:47:21.023 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2020-06-12T17:47:21.023 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-06-12T17:47:21.023 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-06-12T17:47:21.023 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-06-12T17:47:21.024 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-06-12T17:47:21.025 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2020-06-12T17:47:21.025 INFO:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2020-06-12T17:47:21.080 INFO:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-06-12T17:47:21.118 INFO:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-06-12T17:47:21.194 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-06-12T17:47:21.194 INFO:tasks.ceph:role: osd.1 2020-06-12T17:47:21.194 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi038.front.sepia.ceph.com 2020-06-12T17:47:21.195 INFO:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-06-12T17:47:22.592 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-06-12T17:47:22.593 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2020-06-12T17:47:22.593 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-06-12T17:47:22.593 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 2020-06-12T17:47:22.594 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-06-12T17:47:22.594 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2020-06-12T17:47:22.594 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-06-12T17:47:22.595 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-06-12T17:47:22.595 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-06-12T17:47:22.595 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-06-12T17:47:22.597 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2020-06-12T17:47:22.598 INFO:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2020-06-12T17:47:22.648 INFO:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-06-12T17:47:22.684 INFO:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-06-12T17:47:22.756 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-06-12T17:47:22.757 INFO:tasks.ceph:role: osd.2 2020-06-12T17:47:22.757 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi038.front.sepia.ceph.com 2020-06-12T17:47:22.758 INFO:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-06-12T17:47:24.151 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-06-12T17:47:24.152 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2020-06-12T17:47:24.152 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-06-12T17:47:24.152 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 2020-06-12T17:47:24.152 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-06-12T17:47:24.153 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2020-06-12T17:47:24.153 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-06-12T17:47:24.153 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-06-12T17:47:24.153 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-06-12T17:47:24.153 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-06-12T17:47:24.155 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2020-06-12T17:47:24.155 INFO:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2020-06-12T17:47:24.206 INFO:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-06-12T17:47:24.243 INFO:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-06-12T17:47:24.315 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-06-12T17:47:24.315 INFO:tasks.ceph:role: osd.3 2020-06-12T17:47:24.316 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi038.front.sepia.ceph.com 2020-06-12T17:47:24.316 INFO:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-06-12T17:47:25.708 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-06-12T17:47:25.708 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2020-06-12T17:47:25.709 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-06-12T17:47:25.709 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 2020-06-12T17:47:25.709 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-06-12T17:47:25.709 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2020-06-12T17:47:25.709 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-06-12T17:47:25.710 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-06-12T17:47:25.710 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-06-12T17:47:25.710 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-06-12T17:47:25.711 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2020-06-12T17:47:25.711 INFO:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2020-06-12T17:47:25.761 INFO:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-06-12T17:47:25.797 INFO:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-06-12T17:47:25.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:25.882+0000 7fdae2849ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-06-12T17:47:25.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:25.883+0000 7fdae2849ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-06-12T17:47:25.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:25.883+0000 7fdae2849ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-06-12T17:47:25.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:25.883+0000 7fdae2849ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-06-12T17:47:25.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:25.883+0000 7fdae2849ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-06-12T17:47:25.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:25.883+0000 7fdae2849ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-06-12T17:47:25.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:25.909+0000 7fdae2849ec0 -1 freelist read_size_meta_from_db missing size meta in DB 2020-06-12T17:47:28.233 INFO:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-06-12T17:47:28.269 INFO:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-06-12T17:47:28.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:28.358+0000 7fcbaadb4ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-06-12T17:47:28.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:28.359+0000 7fcbaadb4ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-06-12T17:47:28.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:28.359+0000 7fcbaadb4ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-06-12T17:47:28.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:28.359+0000 7fcbaadb4ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-06-12T17:47:28.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:28.359+0000 7fcbaadb4ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-06-12T17:47:28.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:28.360+0000 7fcbaadb4ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-06-12T17:47:28.401 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:28.398+0000 7fcbaadb4ec0 -1 freelist read_size_meta_from_db missing size meta in DB 2020-06-12T17:47:30.728 INFO:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-06-12T17:47:30.764 INFO:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-06-12T17:47:30.860 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:30.856+0000 7f8962629ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-06-12T17:47:30.861 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:30.857+0000 7f8962629ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-06-12T17:47:30.861 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:30.857+0000 7f8962629ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-06-12T17:47:30.861 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:30.857+0000 7f8962629ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-06-12T17:47:30.861 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:30.857+0000 7f8962629ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-06-12T17:47:30.862 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:30.857+0000 7f8962629ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-06-12T17:47:30.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:30.887+0000 7f8962629ec0 -1 freelist read_size_meta_from_db missing size meta in DB 2020-06-12T17:47:33.204 INFO:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-06-12T17:47:33.241 INFO:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-06-12T17:47:33.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:33.330+0000 7f62773cbec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-06-12T17:47:33.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:33.330+0000 7f62773cbec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-06-12T17:47:33.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:33.330+0000 7f62773cbec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-06-12T17:47:33.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:33.330+0000 7f62773cbec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-06-12T17:47:33.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:33.330+0000 7f62773cbec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-06-12T17:47:33.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:33.331+0000 7f62773cbec0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-06-12T17:47:33.354 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:33.350+0000 7f62773cbec0 -1 freelist read_size_meta_from_db missing size meta in DB 2020-06-12T17:47:35.687 INFO:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-06-12T17:47:35.723 INFO:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-06-12T17:47:35.756 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-06-12T17:47:35.757 INFO:tasks.ceph:role: osd.4 2020-06-12T17:47:35.757 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com 2020-06-12T17:47:35.757 INFO:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-06-12T17:47:36.293 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-06-12T17:47:36.293 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2020-06-12T17:47:36.293 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-06-12T17:47:36.294 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 2020-06-12T17:47:36.294 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-06-12T17:47:36.294 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2020-06-12T17:47:36.294 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-06-12T17:47:36.294 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-06-12T17:47:36.295 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-06-12T17:47:36.295 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-06-12T17:47:36.296 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2020-06-12T17:47:36.296 INFO:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2020-06-12T17:47:36.413 INFO:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-06-12T17:47:36.448 INFO:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-06-12T17:47:36.517 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-06-12T17:47:36.517 INFO:tasks.ceph:role: osd.5 2020-06-12T17:47:36.518 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com 2020-06-12T17:47:36.518 INFO:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-06-12T17:47:37.033 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-06-12T17:47:37.033 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2020-06-12T17:47:37.034 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-06-12T17:47:37.034 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 2020-06-12T17:47:37.034 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-06-12T17:47:37.034 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2020-06-12T17:47:37.034 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-06-12T17:47:37.035 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-06-12T17:47:37.035 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-06-12T17:47:37.035 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-06-12T17:47:37.036 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2020-06-12T17:47:37.036 INFO:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2020-06-12T17:47:37.087 INFO:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-06-12T17:47:37.119 INFO:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-06-12T17:47:37.187 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-06-12T17:47:37.188 INFO:tasks.ceph:role: osd.6 2020-06-12T17:47:37.188 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com 2020-06-12T17:47:37.189 INFO:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-06-12T17:47:37.727 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-06-12T17:47:37.728 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2020-06-12T17:47:37.728 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-06-12T17:47:37.728 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 2020-06-12T17:47:37.728 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-06-12T17:47:37.729 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2020-06-12T17:47:37.729 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-06-12T17:47:37.729 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-06-12T17:47:37.729 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-06-12T17:47:37.729 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-06-12T17:47:37.730 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2020-06-12T17:47:37.731 INFO:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2020-06-12T17:47:37.795 INFO:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-06-12T17:47:37.826 INFO:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-06-12T17:47:37.893 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-06-12T17:47:37.893 INFO:tasks.ceph:role: osd.7 2020-06-12T17:47:37.894 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com 2020-06-12T17:47:37.894 INFO:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-06-12T17:47:38.441 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-06-12T17:47:38.442 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2020-06-12T17:47:38.442 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-06-12T17:47:38.442 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 2020-06-12T17:47:38.443 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-06-12T17:47:38.443 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2020-06-12T17:47:38.443 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-06-12T17:47:38.443 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-06-12T17:47:38.443 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-06-12T17:47:38.443 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-06-12T17:47:38.444 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2020-06-12T17:47:38.445 INFO:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2020-06-12T17:47:38.557 INFO:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-06-12T17:47:38.588 INFO:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-06-12T17:47:38.670 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:38.666+0000 7fc18cb6cec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-06-12T17:47:38.674 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:38.670+0000 7fc18cb6cec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-06-12T17:47:38.674 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:38.670+0000 7fc18cb6cec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-06-12T17:47:38.675 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:38.670+0000 7fc18cb6cec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-06-12T17:47:38.675 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:38.670+0000 7fc18cb6cec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-06-12T17:47:38.681 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:38.677+0000 7fc18cb6cec0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2020-06-12T17:47:38.710 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:38.706+0000 7fc18cb6cec0 -1 freelist read_size_meta_from_db missing size meta in DB 2020-06-12T17:47:41.015 INFO:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-06-12T17:47:41.090 INFO:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-06-12T17:47:41.179 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:41.174+0000 7fdc7bed6ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-06-12T17:47:41.179 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:41.174+0000 7fdc7bed6ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-06-12T17:47:41.180 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:41.174+0000 7fdc7bed6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-06-12T17:47:41.180 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:41.174+0000 7fdc7bed6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-06-12T17:47:41.180 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:41.174+0000 7fdc7bed6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-06-12T17:47:41.181 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:41.175+0000 7fdc7bed6ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2020-06-12T17:47:41.190 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:41.186+0000 7fdc7bed6ec0 -1 freelist read_size_meta_from_db missing size meta in DB 2020-06-12T17:47:43.523 INFO:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-06-12T17:47:43.555 INFO:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-06-12T17:47:43.645 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:43.640+0000 7f1ff1cd0ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-06-12T17:47:43.646 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:43.641+0000 7f1ff1cd0ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-06-12T17:47:43.646 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:43.641+0000 7f1ff1cd0ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-06-12T17:47:43.647 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:43.641+0000 7f1ff1cd0ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-06-12T17:47:43.647 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:43.641+0000 7f1ff1cd0ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-06-12T17:47:43.647 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:43.641+0000 7f1ff1cd0ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2020-06-12T17:47:43.660 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:43.655+0000 7f1ff1cd0ec0 -1 freelist read_size_meta_from_db missing size meta in DB 2020-06-12T17:47:45.987 INFO:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-06-12T17:47:46.019 INFO:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-06-12T17:47:46.108 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:46.104+0000 7fdbeb5d8ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-06-12T17:47:46.109 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:46.105+0000 7fdbeb5d8ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-06-12T17:47:46.109 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:46.105+0000 7fdbeb5d8ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-06-12T17:47:46.109 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:46.105+0000 7fdbeb5d8ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-06-12T17:47:46.109 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:46.105+0000 7fdbeb5d8ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-06-12T17:47:46.110 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:46.105+0000 7fdbeb5d8ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2020-06-12T17:47:46.123 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:46.120+0000 7fdbeb5d8ec0 -1 freelist read_size_meta_from_db missing size meta in DB 2020-06-12T17:47:47.265 INFO:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-06-12T17:47:47.268 INFO:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-06-12T17:47:48.447 INFO:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-06-12T17:47:48.479 INFO:tasks.ceph:Reading keys from all nodes... 2020-06-12T17:47:48.479 INFO:teuthology.orchestra.run.smithi038:> mktemp 2020-06-12T17:47:48.497 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.aozWSxLMCc 2020-06-12T17:47:48.498 INFO:teuthology.orchestra.run.smithi038:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.aozWSxLMCc 2020-06-12T17:47:48.575 INFO:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.aozWSxLMCc 2020-06-12T17:47:48.713 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.aozWSxLMCc is 56B 2020-06-12T17:47:48.768 INFO:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.aozWSxLMCc 2020-06-12T17:47:48.785 INFO:teuthology.orchestra.run.smithi038:> mktemp 2020-06-12T17:47:48.839 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.wxxX72ZrUl 2020-06-12T17:47:48.840 INFO:teuthology.orchestra.run.smithi038:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.wxxX72ZrUl 2020-06-12T17:47:48.912 INFO:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.wxxX72ZrUl 2020-06-12T17:47:49.041 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.wxxX72ZrUl is 56B 2020-06-12T17:47:49.089 INFO:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.wxxX72ZrUl 2020-06-12T17:47:49.104 INFO:teuthology.orchestra.run.smithi038:> mktemp 2020-06-12T17:47:49.157 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.amCwL0rdOE 2020-06-12T17:47:49.158 INFO:teuthology.orchestra.run.smithi038:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.amCwL0rdOE 2020-06-12T17:47:49.228 INFO:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.amCwL0rdOE 2020-06-12T17:47:49.355 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.amCwL0rdOE is 56B 2020-06-12T17:47:49.402 INFO:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.amCwL0rdOE 2020-06-12T17:47:49.417 INFO:teuthology.orchestra.run.smithi038:> mktemp 2020-06-12T17:47:49.470 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.JD8iPrdp7M 2020-06-12T17:47:49.471 INFO:teuthology.orchestra.run.smithi038:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.JD8iPrdp7M 2020-06-12T17:47:49.541 INFO:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.JD8iPrdp7M 2020-06-12T17:47:49.670 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.JD8iPrdp7M is 56B 2020-06-12T17:47:49.723 INFO:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.JD8iPrdp7M 2020-06-12T17:47:49.737 INFO:teuthology.orchestra.run.smithi038:> mktemp 2020-06-12T17:47:49.790 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.m5gPvIW7yK 2020-06-12T17:47:49.791 INFO:teuthology.orchestra.run.smithi038:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.m5gPvIW7yK 2020-06-12T17:47:49.861 INFO:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.m5gPvIW7yK 2020-06-12T17:47:49.989 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.m5gPvIW7yK is 56B 2020-06-12T17:47:50.037 INFO:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.m5gPvIW7yK 2020-06-12T17:47:50.051 INFO:teuthology.orchestra.run.smithi038:> mktemp 2020-06-12T17:47:50.105 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.TvO1UQAh6Q 2020-06-12T17:47:50.105 INFO:teuthology.orchestra.run.smithi038:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.TvO1UQAh6Q 2020-06-12T17:47:50.178 INFO:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.TvO1UQAh6Q 2020-06-12T17:47:50.305 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.TvO1UQAh6Q is 56B 2020-06-12T17:47:50.353 INFO:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.TvO1UQAh6Q 2020-06-12T17:47:50.367 INFO:teuthology.orchestra.run.smithi150:> mktemp 2020-06-12T17:47:50.412 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.o280asmY4B 2020-06-12T17:47:50.412 INFO:teuthology.orchestra.run.smithi150:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.o280asmY4B 2020-06-12T17:47:50.483 INFO:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.o280asmY4B 2020-06-12T17:47:50.611 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.o280asmY4B is 56B 2020-06-12T17:47:50.667 INFO:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.o280asmY4B 2020-06-12T17:47:50.683 INFO:teuthology.orchestra.run.smithi150:> mktemp 2020-06-12T17:47:50.736 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.faToksk7Tj 2020-06-12T17:47:50.737 INFO:teuthology.orchestra.run.smithi150:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.faToksk7Tj 2020-06-12T17:47:50.805 INFO:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.faToksk7Tj 2020-06-12T17:47:50.930 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.faToksk7Tj is 56B 2020-06-12T17:47:50.978 INFO:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.faToksk7Tj 2020-06-12T17:47:50.993 INFO:teuthology.orchestra.run.smithi150:> mktemp 2020-06-12T17:47:51.050 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.10vplal1tp 2020-06-12T17:47:51.051 INFO:teuthology.orchestra.run.smithi150:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.10vplal1tp 2020-06-12T17:47:51.118 INFO:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.10vplal1tp 2020-06-12T17:47:51.241 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.10vplal1tp is 56B 2020-06-12T17:47:51.296 INFO:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.10vplal1tp 2020-06-12T17:47:51.310 INFO:teuthology.orchestra.run.smithi150:> mktemp 2020-06-12T17:47:51.364 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.obZFSHHD1L 2020-06-12T17:47:51.364 INFO:teuthology.orchestra.run.smithi150:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.obZFSHHD1L 2020-06-12T17:47:51.431 INFO:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.obZFSHHD1L 2020-06-12T17:47:51.554 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.obZFSHHD1L is 56B 2020-06-12T17:47:51.602 INFO:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.obZFSHHD1L 2020-06-12T17:47:51.616 INFO:teuthology.orchestra.run.smithi150:> mktemp 2020-06-12T17:47:51.668 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.FSr7Focobq 2020-06-12T17:47:51.669 INFO:teuthology.orchestra.run.smithi150:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.FSr7Focobq 2020-06-12T17:47:51.735 INFO:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.FSr7Focobq 2020-06-12T17:47:51.859 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.FSr7Focobq is 56B 2020-06-12T17:47:51.907 INFO:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.FSr7Focobq 2020-06-12T17:47:51.921 INFO:teuthology.orchestra.run.smithi150:> mktemp 2020-06-12T17:47:51.973 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.S7Iqbu0gWe 2020-06-12T17:47:51.974 INFO:teuthology.orchestra.run.smithi150:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.S7Iqbu0gWe 2020-06-12T17:47:52.040 INFO:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.S7Iqbu0gWe 2020-06-12T17:47:52.163 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.S7Iqbu0gWe is 56B 2020-06-12T17:47:52.211 INFO:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.S7Iqbu0gWe 2020-06-12T17:47:52.244 DEBUG:teuthology.orchestra.remote:smithi038:/etc/ceph/ceph.client.0.keyring is 59B 2020-06-12T17:47:52.337 DEBUG:teuthology.orchestra.remote:smithi038:/etc/ceph/ceph.client.1.keyring is 59B 2020-06-12T17:47:52.401 DEBUG:teuthology.orchestra.remote:smithi150:/etc/ceph/ceph.client.2.keyring is 59B 2020-06-12T17:47:52.495 DEBUG:teuthology.orchestra.remote:smithi150:/etc/ceph/ceph.client.3.keyring is 59B 2020-06-12T17:47:52.542 INFO:tasks.ceph:Adding keys to all mons... 2020-06-12T17:47:52.543 INFO:teuthology.orchestra.run.smithi038:> sudo tee -a /etc/ceph/ceph.keyring 2020-06-12T17:47:52.545 INFO:teuthology.orchestra.run.smithi150:> sudo tee -a /etc/ceph/ceph.keyring 2020-06-12T17:47:52.587 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr.y] 2020-06-12T17:47:52.588 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCmv+NeS5XPOhAA8VbBJ/BMbE/kLdyZ9Mix2A== 2020-06-12T17:47:52.588 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.a] 2020-06-12T17:47:52.588 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCnv+NetUq6ChAAYQPBJ6S6dadZWggx+9xYDQ== 2020-06-12T17:47:52.588 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.0] 2020-06-12T17:47:52.588 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCtv+Ne1LupNBAACyqpp1WZsLzp9tX4zLQmiA== 2020-06-12T17:47:52.589 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.1] 2020-06-12T17:47:52.589 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCwv+NeRJdxFRAAF4eLPnEDtcXAx56CnrLluw== 2020-06-12T17:47:52.589 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.2] 2020-06-12T17:47:52.589 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCyv+NeQCkeMxAAXktIztrjtSbO+U8YmYcVfA== 2020-06-12T17:47:52.589 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.3] 2020-06-12T17:47:52.590 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQC1v+NewhXBExAAtae8v030uE3T0NXlXB0+uQ== 2020-06-12T17:47:52.590 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr.x] 2020-06-12T17:47:52.590 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCnv+NeDlTtBhAACH1rQaHupywTQmzzGRw0AQ== 2020-06-12T17:47:52.590 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.b] 2020-06-12T17:47:52.590 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCnv+NeAbhcEBAAwKupqvC/x6/SoCyea1LQdQ== 2020-06-12T17:47:52.590 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.4] 2020-06-12T17:47:52.591 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQC6v+Ne7VbXJxAA0Wg1onQBsrtr8j12+tjBCQ== 2020-06-12T17:47:52.591 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.5] 2020-06-12T17:47:52.591 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQC9v+Nei1mDChAAVUM5OnwEF97d5TOz719e5Q== 2020-06-12T17:47:52.591 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.6] 2020-06-12T17:47:52.591 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQC/v+NeTzdNJhAAWKB++wt8tsIdFCBrVDah8Q== 2020-06-12T17:47:52.592 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.7] 2020-06-12T17:47:52.592 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQDCv+NePy1PBhAAl/KCl4V5HGerrNqtUcuWZA== 2020-06-12T17:47:52.592 INFO:teuthology.orchestra.run.smithi038.stdout:[client.0] 2020-06-12T17:47:52.592 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCnv+Ne3nDsFBAASnLDV+jcHoQr6RsEIg0Anw== 2020-06-12T17:47:52.592 INFO:teuthology.orchestra.run.smithi038.stdout:[client.1] 2020-06-12T17:47:52.593 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCnv+NeOayqGBAAhRj+GpsCNRN1FNDwoYl73A== 2020-06-12T17:47:52.593 INFO:teuthology.orchestra.run.smithi038.stdout:[client.2] 2020-06-12T17:47:52.593 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCnv+NejrhEHBAAIrSYVLX1dapoRSBxrjYY8A== 2020-06-12T17:47:52.593 INFO:teuthology.orchestra.run.smithi038.stdout:[client.3] 2020-06-12T17:47:52.593 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCnv+NeQwX1IRAAMO/lpYu2RZqyL0d2iOIiFQ== 2020-06-12T17:47:52.595 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.y] 2020-06-12T17:47:52.595 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCmv+NeS5XPOhAA8VbBJ/BMbE/kLdyZ9Mix2A== 2020-06-12T17:47:52.595 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.a] 2020-06-12T17:47:52.595 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCnv+NetUq6ChAAYQPBJ6S6dadZWggx+9xYDQ== 2020-06-12T17:47:52.596 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.0] 2020-06-12T17:47:52.596 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCtv+Ne1LupNBAACyqpp1WZsLzp9tX4zLQmiA== 2020-06-12T17:47:52.596 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.1] 2020-06-12T17:47:52.596 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCwv+NeRJdxFRAAF4eLPnEDtcXAx56CnrLluw== 2020-06-12T17:47:52.596 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.2] 2020-06-12T17:47:52.597 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCyv+NeQCkeMxAAXktIztrjtSbO+U8YmYcVfA== 2020-06-12T17:47:52.597 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.3] 2020-06-12T17:47:52.597 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQC1v+NewhXBExAAtae8v030uE3T0NXlXB0+uQ== 2020-06-12T17:47:52.597 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.x] 2020-06-12T17:47:52.597 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCnv+NeDlTtBhAACH1rQaHupywTQmzzGRw0AQ== 2020-06-12T17:47:52.598 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.b] 2020-06-12T17:47:52.598 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCnv+NeAbhcEBAAwKupqvC/x6/SoCyea1LQdQ== 2020-06-12T17:47:52.598 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.4] 2020-06-12T17:47:52.598 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQC6v+Ne7VbXJxAA0Wg1onQBsrtr8j12+tjBCQ== 2020-06-12T17:47:52.598 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.5] 2020-06-12T17:47:52.598 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQC9v+Nei1mDChAAVUM5OnwEF97d5TOz719e5Q== 2020-06-12T17:47:52.599 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.6] 2020-06-12T17:47:52.599 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQC/v+NeTzdNJhAAWKB++wt8tsIdFCBrVDah8Q== 2020-06-12T17:47:52.599 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.7] 2020-06-12T17:47:52.599 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDCv+NePy1PBhAAl/KCl4V5HGerrNqtUcuWZA== 2020-06-12T17:47:52.599 INFO:teuthology.orchestra.run.smithi150.stdout:[client.0] 2020-06-12T17:47:52.600 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCnv+Ne3nDsFBAASnLDV+jcHoQr6RsEIg0Anw== 2020-06-12T17:47:52.600 INFO:teuthology.orchestra.run.smithi150.stdout:[client.1] 2020-06-12T17:47:52.600 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCnv+NeOayqGBAAhRj+GpsCNRN1FNDwoYl73A== 2020-06-12T17:47:52.600 INFO:teuthology.orchestra.run.smithi150.stdout:[client.2] 2020-06-12T17:47:52.600 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCnv+NejrhEHBAAIrSYVLX1dapoRSBxrjYY8A== 2020-06-12T17:47:52.601 INFO:teuthology.orchestra.run.smithi150.stdout:[client.3] 2020-06-12T17:47:52.601 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCnv+NeQwX1IRAAMO/lpYu2RZqyL0d2iOIiFQ== 2020-06-12T17:47:52.601 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-06-12T17:47:52.638 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-06-12T17:47:52.694 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-06-12T17:47:52.697 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-06-12T17:47:52.754 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T17:47:52.757 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T17:47:52.807 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T17:47:52.810 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T17:47:52.860 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T17:47:52.862 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T17:47:52.912 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T17:47:52.914 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T17:47:52.964 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-06-12T17:47:52.967 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-06-12T17:47:53.017 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-06-12T17:47:53.028 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-06-12T17:47:53.080 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T17:47:53.083 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T17:47:53.133 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T17:47:53.136 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T17:47:53.186 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T17:47:53.189 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T17:47:53.240 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T17:47:53.243 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T17:47:53.327 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-06-12T17:47:53.335 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-06-12T17:47:53.385 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-06-12T17:47:53.388 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-06-12T17:47:53.440 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-06-12T17:47:53.443 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-06-12T17:47:53.497 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-06-12T17:47:53.500 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-06-12T17:47:53.552 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-06-12T17:47:53.553 INFO:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-06-12T17:47:53.584 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-06-12T17:47:53.692 INFO:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-06-12T17:47:53.723 INFO:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-06-12T17:47:53.751 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-06-12T17:47:53.845 INFO:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-06-12T17:47:53.872 INFO:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-06-12T17:47:53.940 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-06-12T17:47:54.033 INFO:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-06-12T17:47:54.061 INFO:teuthology.orchestra.run.smithi038:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-06-12T17:47:54.063 INFO:teuthology.orchestra.run.smithi150:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-06-12T17:47:54.115 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-06-12T17:47:54.115 INFO:tasks.ceph.mon.a:Restarting daemon 2020-06-12T17:47:54.116 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-06-12T17:47:54.119 INFO:tasks.ceph.mon.a:Started 2020-06-12T17:47:54.119 INFO:tasks.ceph.mon.b:Restarting daemon 2020-06-12T17:47:54.120 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-06-12T17:47:54.157 INFO:tasks.ceph.mon.b:Started 2020-06-12T17:47:54.158 INFO:tasks.ceph.mon.c:Restarting daemon 2020-06-12T17:47:54.159 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-06-12T17:47:54.161 INFO:tasks.ceph.mon.c:Started 2020-06-12T17:47:54.161 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-06-12T17:47:54.162 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-06-12T17:47:54.162 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-06-12T17:47:54.165 INFO:tasks.ceph.mgr.y:Started 2020-06-12T17:47:54.165 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-06-12T17:47:54.166 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-06-12T17:47:54.169 INFO:tasks.ceph.mgr.x:Started 2020-06-12T17:47:54.170 INFO:tasks.ceph:Setting crush tunables to default 2020-06-12T17:47:54.170 INFO:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph osd crush tunables default 2020-06-12T17:47:54.502 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.294+0000 7fbc3fd14700 1 Processor -- start 2020-06-12T17:47:54.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.294+0000 7fbc3fd14700 1 -- start start 2020-06-12T17:47:54.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.295+0000 7fbc3fd14700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbc38152580 0x7fbc380b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:47:54.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.295+0000 7fbc3fd14700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc380b26b0 0x7fbc380663f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:47:54.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.295+0000 7fbc3fd14700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbc38066850 0x7fbc38065020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:47:54.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.295+0000 7fbc3fd14700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3805ab90 con 0x7fbc38152580 2020-06-12T17:47:54.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.295+0000 7fbc3fd14700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc380648b0 con 0x7fbc38066850 2020-06-12T17:47:54.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.295+0000 7fbc3fd14700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc38064b50 con 0x7fbc380b26b0 2020-06-12T17:47:54.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.295+0000 7fbc3e2b1700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbc38152580 0x7fbc380b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:54.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.295+0000 7fbc3e2b1700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbc38152580 0x7fbc380b3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34914/0 (socket says 172.21.15.38:34914) 2020-06-12T17:47:54.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.295+0000 7fbc3e2b1700 1 -- 172.21.15.38:0/3127719011 learned_addr learned my addr 172.21.15.38:0/3127719011 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:47:54.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.295+0000 7fbc3e2b1700 1 -- 172.21.15.38:0/3127719011 >> v2:172.21.15.38:3300/0 conn(0x7fbc38152580 msgr2=0x7fbc380b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-06-12T17:47:54.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.295+0000 7fbc3e2b1700 1 -- 172.21.15.38:0/3127719011 >> v2:172.21.15.38:3300/0 conn(0x7fbc38152580 msgr2=0x7fbc380b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-06-12T17:47:54.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.295+0000 7fbc3e2b1700 1 --2- 172.21.15.38:0/3127719011 >> v2:172.21.15.38:3300/0 conn(0x7fbc38152580 0x7fbc380b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-06-12T17:47:54.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.295+0000 7fbc3dab0700 1 --2- 172.21.15.38:0/3127719011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc380b26b0 0x7fbc380663f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:54.506 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.295+0000 7fbc3eab2700 1 --2- 172.21.15.38:0/3127719011 >> v2:172.21.15.150:3300/0 conn(0x7fbc38066850 0x7fbc38065020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:54.506 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.295+0000 7fbc3e2b1700 1 --2- 172.21.15.38:0/3127719011 >> v2:172.21.15.38:3300/0 conn(0x7fbc38152580 0x7fbc380b3c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-06-12T17:47:54.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.295+0000 7fbc3dab0700 1 -- 172.21.15.38:0/3127719011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc380b26b0 msgr2=0x7fbc380663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-06-12T17:47:54.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.295+0000 7fbc3dab0700 1 -- 172.21.15.38:0/3127719011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc380b26b0 msgr2=0x7fbc380663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-06-12T17:47:54.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.295+0000 7fbc3dab0700 1 --2- 172.21.15.38:0/3127719011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc380b26b0 0x7fbc380663f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-06-12T17:47:54.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.295+0000 7fbc3eab2700 1 -- 172.21.15.38:0/3127719011 >> v2:172.21.15.150:3300/0 conn(0x7fbc38066850 msgr2=0x7fbc38065020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-06-12T17:47:54.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.295+0000 7fbc3eab2700 1 -- 172.21.15.38:0/3127719011 >> v2:172.21.15.150:3300/0 conn(0x7fbc38066850 msgr2=0x7fbc38065020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-06-12T17:47:54.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.295+0000 7fbc3dab0700 1 --2- 172.21.15.38:0/3127719011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc380b26b0 0x7fbc380663f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-06-12T17:47:54.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.295+0000 7fbc3eab2700 1 --2- 172.21.15.38:0/3127719011 >> v2:172.21.15.150:3300/0 conn(0x7fbc38066850 0x7fbc38065020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-06-12T17:47:54.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.295+0000 7fbc3eab2700 1 --2- 172.21.15.38:0/3127719011 >> v2:172.21.15.150:3300/0 conn(0x7fbc38066850 0x7fbc38065020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-06-12T17:47:54.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.496+0000 7fbc3e2b1700 1 --2- 172.21.15.38:0/3127719011 >> v2:172.21.15.38:3300/0 conn(0x7fbc38152580 0x7fbc380b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:54.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.496+0000 7fbc3eab2700 1 --2- 172.21.15.38:0/3127719011 >> v2:172.21.15.150:3300/0 conn(0x7fbc38066850 0x7fbc38065020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:54.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.496+0000 7fbc3dab0700 1 --2- 172.21.15.38:0/3127719011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc380b26b0 0x7fbc380663f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:54.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.496+0000 7fbc3e2b1700 1 -- 172.21.15.38:0/3127719011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc380b26b0 msgr2=0x7fbc380663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:47:54.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.496+0000 7fbc3e2b1700 1 --2- 172.21.15.38:0/3127719011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc380b26b0 0x7fbc380663f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:47:54.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.496+0000 7fbc3e2b1700 1 -- 172.21.15.38:0/3127719011 >> v2:172.21.15.150:3300/0 conn(0x7fbc38066850 msgr2=0x7fbc38065020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:47:54.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.496+0000 7fbc3e2b1700 1 --2- 172.21.15.38:0/3127719011 >> v2:172.21.15.150:3300/0 conn(0x7fbc38066850 0x7fbc38065020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:47:54.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.496+0000 7fbc3e2b1700 1 -- 172.21.15.38:0/3127719011 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc38064df0 con 0x7fbc38152580 2020-06-12T17:47:54.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.496+0000 7fbc3e2b1700 1 --2- 172.21.15.38:0/3127719011 >> v2:172.21.15.38:3300/0 conn(0x7fbc38152580 0x7fbc380b3c00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbc34002f30 tx=0x7fbc34007e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:54.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.496+0000 7fbc3e2b1700 1 --2- 172.21.15.38:0/3127719011 >> v2:172.21.15.38:3300/0 conn(0x7fbc38152580 0x7fbc380b3c00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbc34002f30 tx=0x7fbc34007e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:54.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.496+0000 7fbc3e2b1700 1 --2- 172.21.15.38:0/3127719011 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc38152580 0x7fbc380b3c00 secure :-1 s=READY pgs=8 cs=0 l=1 rx=0x7fbc34002f30 tx=0x7fbc34007e90).ready entity=mon.0 client_cookie=1fbb26f6f10a0a99 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:47:54.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.496+0000 7fbc3e2b1700 1 --2- 172.21.15.38:0/3127719011 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc38152580 0x7fbc380b3c00 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fbc34002f30 tx=0x7fbc34007e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:54.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.496+0000 7fbc3d2af700 1 -- 172.21.15.38:0/3127719011 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc34051e90 con 0x7fbc38152580 2020-06-12T17:47:54.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.496+0000 7fbc3e2b1700 1 --2- 172.21.15.38:0/3127719011 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc38152580 0x7fbc380b3c00 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fbc34002f30 tx=0x7fbc34007e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:54.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.496+0000 7fbc3e2b1700 1 --2- 172.21.15.38:0/3127719011 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc38152580 0x7fbc380b3c00 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fbc34002f30 tx=0x7fbc34007e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:54.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.496+0000 7fbc3d2af700 1 -- 172.21.15.38:0/3127719011 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc34008c20 con 0x7fbc38152580 2020-06-12T17:47:54.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.496+0000 7fbc3d2af700 1 -- 172.21.15.38:0/3127719011 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc34053160 con 0x7fbc38152580 2020-06-12T17:47:54.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.496+0000 7fbc3fd14700 1 -- 172.21.15.38:0/3127719011 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc38152580 msgr2=0x7fbc380b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:54.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.496+0000 7fbc3fd14700 1 --2- 172.21.15.38:0/3127719011 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc38152580 0x7fbc380b3c00 secure :-1 s=READY pgs=8 cs=0 l=1 rx=0x7fbc34002f30 tx=0x7fbc34007e90).stop 2020-06-12T17:47:54.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.497+0000 7fbc3fd14700 1 -- 172.21.15.38:0/3127719011 shutdown_connections 2020-06-12T17:47:54.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.497+0000 7fbc3fd14700 1 --2- 172.21.15.38:0/3127719011 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc38152580 0x7fbc380b3c00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:54.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.497+0000 7fbc3fd14700 1 --2- 172.21.15.38:0/3127719011 >> v2:172.21.15.150:3300/0 conn(0x7fbc38066850 0x7fbc38065020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:47:54.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.497+0000 7fbc3fd14700 1 --2- 172.21.15.38:0/3127719011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc380b26b0 0x7fbc380663f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:47:54.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.497+0000 7fbc3fd14700 1 -- 172.21.15.38:0/3127719011 >> 172.21.15.38:0/3127719011 conn(0x7fbc380b4cc0 msgr2=0x7fbc380b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:47:54.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.497+0000 7fbc3fd14700 1 -- 172.21.15.38:0/3127719011 shutdown_connections 2020-06-12T17:47:54.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.497+0000 7fbc3fd14700 1 -- 172.21.15.38:0/3127719011 wait complete. 2020-06-12T17:47:54.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.498+0000 7fbc3fd14700 1 Processor -- start 2020-06-12T17:47:54.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.499+0000 7fbc3fd14700 1 -- start start 2020-06-12T17:47:54.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.499+0000 7fbc3fd14700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbc380b26b0 0x7fbc380b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:47:54.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.499+0000 7fbc3fd14700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbc38152580 0x7fbc380b6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:47:54.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.499+0000 7fbc3fd14700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc381303f0 con 0x7fbc38066850 2020-06-12T17:47:54.520 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.499+0000 7fbc3fd14700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3812ff00 con 0x7fbc380b26b0 2020-06-12T17:47:54.520 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.499+0000 7fbc3fd14700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc38130690 con 0x7fbc38152580 2020-06-12T17:47:54.520 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.499+0000 7fbc3e2b1700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fbc38066850 0x7fbc3813f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:36756/0 (socket says 172.21.15.38:36756) 2020-06-12T17:47:54.520 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.499+0000 7fbc3e2b1700 1 -- 172.21.15.38:0/3764428066 learned_addr learned my addr 172.21.15.38:0/3764428066 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:47:54.520 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.499+0000 7fbc3dab0700 1 --2- 172.21.15.38:0/3764428066 >> v2:172.21.15.38:3300/0 conn(0x7fbc380b26b0 0x7fbc380b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:54.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.499+0000 7fbc3eab2700 1 --2- 172.21.15.38:0/3764428066 >> v2:172.21.15.150:3300/0 conn(0x7fbc38152580 0x7fbc380b6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:54.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.500+0000 7fbc2effd700 1 -- 172.21.15.38:0/3764428066 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226160445 0 0) 0x7fbc381303f0 con 0x7fbc38066850 2020-06-12T17:47:54.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.500+0000 7fbc2effd700 1 -- 172.21.15.38:0/3764428066 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc20003230 con 0x7fbc38066850 2020-06-12T17:47:54.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.500+0000 7fbc3eab2700 1 -- 172.21.15.38:0/3764428066 >> v2:172.21.15.38:3300/0 conn(0x7fbc380b26b0 msgr2=0x7fbc380b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:54.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.500+0000 7fbc3eab2700 1 --2- 172.21.15.38:0/3764428066 >> v2:172.21.15.38:3300/0 conn(0x7fbc380b26b0 0x7fbc380b60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:54.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.500+0000 7fbc3eab2700 1 -- 172.21.15.38:0/3764428066 >> v1:172.21.15.38:6789/0 conn(0x7fbc38066850 legacy=0x7fbc3813f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:54.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.500+0000 7fbc3eab2700 1 -- 172.21.15.38:0/3764428066 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc38130930 con 0x7fbc38152580 2020-06-12T17:47:54.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.500+0000 7fbc3eab2700 1 --2- 172.21.15.38:0/3764428066 >> v2:172.21.15.150:3300/0 conn(0x7fbc38152580 0x7fbc380b6540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbc300032b0 tx=0x7fbc30008210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:54.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.500+0000 7fbc3eab2700 1 --2- 172.21.15.38:0/3764428066 >> v2:172.21.15.150:3300/0 conn(0x7fbc38152580 0x7fbc380b6540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbc300032b0 tx=0x7fbc30008210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:54.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.500+0000 7fbc3eab2700 1 --2- 172.21.15.38:0/3764428066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc38152580 0x7fbc380b6540 secure :-1 s=READY pgs=8 cs=0 l=1 rx=0x7fbc300032b0 tx=0x7fbc30008210).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:47:54.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.500+0000 7fbc3eab2700 1 --2- 172.21.15.38:0/3764428066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc38152580 0x7fbc380b6540 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fbc300032b0 tx=0x7fbc30008210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:54.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.500+0000 7fbc2effd700 1 -- 172.21.15.38:0/3764428066 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc30005a40 con 0x7fbc38152580 2020-06-12T17:47:54.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.500+0000 7fbc3eab2700 1 --2- 172.21.15.38:0/3764428066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc38152580 0x7fbc380b6540 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fbc300032b0 tx=0x7fbc30008210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:54.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.500+0000 7fbc3fd14700 1 -- 172.21.15.38:0/3764428066 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc38130bd0 con 0x7fbc38152580 2020-06-12T17:47:54.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.500+0000 7fbc2effd700 1 -- 172.21.15.38:0/3764428066 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc30005ba0 con 0x7fbc38152580 2020-06-12T17:47:54.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.500+0000 7fbc3eab2700 1 --2- 172.21.15.38:0/3764428066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc38152580 0x7fbc380b6540 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fbc300032b0 tx=0x7fbc30008210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:54.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.500+0000 7fbc2effd700 1 -- 172.21.15.38:0/3764428066 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc3000ca10 con 0x7fbc38152580 2020-06-12T17:47:54.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.500+0000 7fbc3fd14700 1 -- 172.21.15.38:0/3764428066 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc3812eb10 con 0x7fbc38152580 2020-06-12T17:47:54.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.500+0000 7fbc3eab2700 1 --2- 172.21.15.38:0/3764428066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc38152580 0x7fbc380b6540 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fbc300032b0 tx=0x7fbc30008210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:54.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.500+0000 7fbc2effd700 1 -- 172.21.15.38:0/3764428066 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) v1 ==== 360+0+0 (secure 0 0 0) 0x7fbc30007360 con 0x7fbc38152580 2020-06-12T17:47:54.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.500+0000 7fbc3eab2700 1 --2- 172.21.15.38:0/3764428066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc38152580 0x7fbc380b6540 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fbc300032b0 tx=0x7fbc30008210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:54.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.500+0000 7fbc2effd700 1 -- 172.21.15.38:0/3764428066 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fbc3000edb0 con 0x7fbc38152580 2020-06-12T17:47:54.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.501+0000 7fbc3fd14700 1 -- 172.21.15.38:0/3764428066 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc38056c30 con 0x7fbc38152580 2020-06-12T17:47:54.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.503+0000 7fbc3eab2700 1 --2- 172.21.15.38:0/3764428066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc38152580 0x7fbc380b6540 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fbc300032b0 tx=0x7fbc30008210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:54.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.503+0000 7fbc2effd700 1 -- 172.21.15.38:0/3764428066 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67700 (secure 0 0 0) 0x7fbc30010190 con 0x7fbc38152580 2020-06-12T17:47:54.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.584+0000 7fbc3fd14700 1 -- 172.21.15.38:0/3764428066 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fbc3805a5e0 con 0x7fbc38152580 2020-06-12T17:47:54.592 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.588+0000 7fbc3eab2700 1 --2- 172.21.15.38:0/3764428066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc38152580 0x7fbc380b6540 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fbc300032b0 tx=0x7fbc30008210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:54.592 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.588+0000 7fbc2effd700 1 -- 172.21.15.38:0/3764428066 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fbc300103b0 con 0x7fbc38152580 2020-06-12T17:47:54.593 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.589+0000 7fbc3fd14700 1 -- 172.21.15.38:0/3764428066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc38152580 msgr2=0x7fbc380b6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:54.593 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.589+0000 7fbc3fd14700 1 --2- 172.21.15.38:0/3764428066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc38152580 0x7fbc380b6540 secure :-1 s=READY pgs=8 cs=0 l=1 rx=0x7fbc300032b0 tx=0x7fbc30008210).stop 2020-06-12T17:47:54.593 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.589+0000 7fbc3fd14700 1 -- 172.21.15.38:0/3764428066 shutdown_connections 2020-06-12T17:47:54.593 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.589+0000 7fbc3fd14700 1 --2- 172.21.15.38:0/3764428066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc38152580 0x7fbc380b6540 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:54.594 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.589+0000 7fbc3fd14700 1 --2- 172.21.15.38:0/3764428066 >> v2:172.21.15.38:3300/0 conn(0x7fbc380b26b0 0x7fbc380b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:54.594 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.589+0000 7fbc3fd14700 1 -- 172.21.15.38:0/3764428066 >> 172.21.15.38:0/3764428066 conn(0x7fbc380b4cc0 msgr2=0x7fbc380b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:47:54.594 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.589+0000 7fbc3fd14700 1 -- 172.21.15.38:0/3764428066 shutdown_connections 2020-06-12T17:47:54.594 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:47:54.589+0000 7fbc3fd14700 1 -- 172.21.15.38:0/3764428066 wait complete. 2020-06-12T17:47:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:adjusted tunables profile to default 2020-06-12T17:47:54.603 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-06-12T17:47:54.603 INFO:teuthology.orchestra.run.smithi038:> mktemp 2020-06-12T17:47:54.617 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.gdQXOxpmoG 2020-06-12T17:47:54.618 INFO:teuthology.orchestra.run.smithi038:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.gdQXOxpmoG 2020-06-12T17:47:54.690 INFO:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.gdQXOxpmoG 2020-06-12T17:47:54.820 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.gdQXOxpmoG is 37B 2020-06-12T17:47:54.879 INFO:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.gdQXOxpmoG 2020-06-12T17:47:54.893 INFO:teuthology.orchestra.run.smithi038:> mktemp 2020-06-12T17:47:54.947 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.ASZA2r5nng 2020-06-12T17:47:54.948 INFO:teuthology.orchestra.run.smithi038:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.ASZA2r5nng 2020-06-12T17:47:55.018 INFO:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.ASZA2r5nng 2020-06-12T17:47:55.145 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.ASZA2r5nng is 37B 2020-06-12T17:47:55.193 INFO:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.ASZA2r5nng 2020-06-12T17:47:55.208 INFO:teuthology.orchestra.run.smithi038:> mktemp 2020-06-12T17:47:55.262 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.57UMrd0ruA 2020-06-12T17:47:55.262 INFO:teuthology.orchestra.run.smithi038:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.57UMrd0ruA 2020-06-12T17:47:55.333 INFO:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.57UMrd0ruA 2020-06-12T17:47:55.461 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.57UMrd0ruA is 37B 2020-06-12T17:47:55.508 INFO:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.57UMrd0ruA 2020-06-12T17:47:55.552 INFO:teuthology.orchestra.run.smithi038:> mktemp 2020-06-12T17:47:55.606 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.8WaMY5fVMt 2020-06-12T17:47:55.608 INFO:teuthology.orchestra.run.smithi038:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.8WaMY5fVMt 2020-06-12T17:47:55.678 INFO:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.8WaMY5fVMt 2020-06-12T17:47:55.806 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.8WaMY5fVMt is 37B 2020-06-12T17:47:55.853 INFO:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.8WaMY5fVMt 2020-06-12T17:47:55.869 INFO:teuthology.orchestra.run.smithi150:> mktemp 2020-06-12T17:47:55.884 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.Kwi7K6vbZw 2020-06-12T17:47:55.884 INFO:teuthology.orchestra.run.smithi150:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.Kwi7K6vbZw 2020-06-12T17:47:55.952 INFO:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.Kwi7K6vbZw 2020-06-12T17:47:56.077 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.Kwi7K6vbZw is 37B 2020-06-12T17:47:56.123 INFO:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.Kwi7K6vbZw 2020-06-12T17:47:56.138 INFO:teuthology.orchestra.run.smithi150:> mktemp 2020-06-12T17:47:56.191 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.hfJ72mfECz 2020-06-12T17:47:56.192 INFO:teuthology.orchestra.run.smithi150:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.hfJ72mfECz 2020-06-12T17:47:56.260 INFO:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.hfJ72mfECz 2020-06-12T17:47:56.385 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.hfJ72mfECz is 37B 2020-06-12T17:47:56.432 INFO:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.hfJ72mfECz 2020-06-12T17:47:56.447 INFO:teuthology.orchestra.run.smithi150:> mktemp 2020-06-12T17:47:56.500 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.nRMI4nlQw8 2020-06-12T17:47:56.501 INFO:teuthology.orchestra.run.smithi150:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.nRMI4nlQw8 2020-06-12T17:47:56.568 INFO:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.nRMI4nlQw8 2020-06-12T17:47:56.693 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.nRMI4nlQw8 is 37B 2020-06-12T17:47:56.745 INFO:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.nRMI4nlQw8 2020-06-12T17:47:56.759 INFO:teuthology.orchestra.run.smithi150:> mktemp 2020-06-12T17:47:56.812 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.K6P5QVXlZz 2020-06-12T17:47:56.812 INFO:teuthology.orchestra.run.smithi150:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.K6P5QVXlZz 2020-06-12T17:47:56.880 INFO:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.K6P5QVXlZz 2020-06-12T17:47:57.003 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.K6P5QVXlZz is 37B 2020-06-12T17:47:57.050 INFO:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.K6P5QVXlZz 2020-06-12T17:47:57.065 INFO:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 44ac3dea-67b4-4b9a-bc18-ac511710afe1 0 2020-06-12T17:47:57.216 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.209+0000 7f48e7037700 1 Processor -- start 2020-06-12T17:47:57.216 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.210+0000 7f48e7037700 1 -- start start 2020-06-12T17:47:57.217 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.210+0000 7f48e7037700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48e0152580 0x7f48e00b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:47:57.217 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.210+0000 7f48e7037700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f48e00b26b0 0x7f48e00663f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:47:57.217 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.210+0000 7f48e7037700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e005ab90 con 0x7f48e0066850 2020-06-12T17:47:57.217 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.210+0000 7f48e7037700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e00648b0 con 0x7f48e00b26b0 2020-06-12T17:47:57.218 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.210+0000 7f48e7037700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e0064b50 con 0x7f48e0152580 2020-06-12T17:47:57.218 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.211+0000 7f48e4dd3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f48e00b26b0 0x7f48e00663f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:57.218 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.211+0000 7f48e55d4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48e0152580 0x7f48e00b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:57.218 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.211+0000 7f48e4dd3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f48e00b26b0 0x7f48e00663f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:48904/0 (socket says 172.21.15.150:48904) 2020-06-12T17:47:57.218 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.211+0000 7f48e4dd3700 1 -- 172.21.15.150:0/4063628633 learned_addr learned my addr 172.21.15.150:0/4063628633 (peer_addr_for_me v2:172.21.15.150:0/0) 2020-06-12T17:47:57.219 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.211+0000 7f48e4dd3700 1 -- 172.21.15.150:0/4063628633 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48e0152580 msgr2=0x7f48e00b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:47:57.219 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.211+0000 7f48e4dd3700 1 --2- 172.21.15.150:0/4063628633 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48e0152580 0x7f48e00b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:47:57.219 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.211+0000 7f48e4dd3700 1 -- 172.21.15.150:0/4063628633 >> v1:172.21.15.150:6789/0 conn(0x7f48e0066850 legacy=0x7f48e0065020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:57.219 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.211+0000 7f48e4dd3700 1 -- 172.21.15.150:0/4063628633 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e0064df0 con 0x7f48e00b26b0 2020-06-12T17:47:57.219 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.211+0000 7f48e55d4700 1 --2- 172.21.15.150:0/4063628633 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48e0152580 0x7f48e00b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:47:57.220 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.211+0000 7f48e4dd3700 1 --2- 172.21.15.150:0/4063628633 >> v2:172.21.15.150:3300/0 conn(0x7f48e00b26b0 0x7f48e00663f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f48dc002f30 tx=0x7f48dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.220 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.211+0000 7f48e4dd3700 1 --2- 172.21.15.150:0/4063628633 >> v2:172.21.15.150:3300/0 conn(0x7f48e00b26b0 0x7f48e00663f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f48dc002f30 tx=0x7f48dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.220 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.211+0000 7f48e4dd3700 1 --2- 172.21.15.150:0/4063628633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48e00b26b0 0x7f48e00663f0 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f48dc002f30 tx=0x7f48dc007e60).ready entity=mon.1 client_cookie=99c992b61a5a358c server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:47:57.220 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.211+0000 7f48e4dd3700 1 --2- 172.21.15.150:0/4063628633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48e00b26b0 0x7f48e00663f0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f48dc002f30 tx=0x7f48dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.220 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.211+0000 7f48d7fff700 1 -- 172.21.15.150:0/4063628633 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48dc011630 con 0x7f48e00b26b0 2020-06-12T17:47:57.221 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.211+0000 7f48e4dd3700 1 --2- 172.21.15.150:0/4063628633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48e00b26b0 0x7f48e00663f0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f48dc002f30 tx=0x7f48dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.221 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.211+0000 7f48e4dd3700 1 --2- 172.21.15.150:0/4063628633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48e00b26b0 0x7f48e00663f0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f48dc002f30 tx=0x7f48dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.221 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.211+0000 7f48d7fff700 1 -- 172.21.15.150:0/4063628633 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48dc011790 con 0x7f48e00b26b0 2020-06-12T17:47:57.221 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.211+0000 7f48d7fff700 1 -- 172.21.15.150:0/4063628633 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48dc011bb0 con 0x7f48e00b26b0 2020-06-12T17:47:57.221 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.211+0000 7f48e7037700 1 -- 172.21.15.150:0/4063628633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48e00b26b0 msgr2=0x7f48e00663f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:57.222 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.211+0000 7f48e7037700 1 --2- 172.21.15.150:0/4063628633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48e00b26b0 0x7f48e00663f0 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f48dc002f30 tx=0x7f48dc007e60).stop 2020-06-12T17:47:57.222 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.212+0000 7f48e7037700 1 -- 172.21.15.150:0/4063628633 shutdown_connections 2020-06-12T17:47:57.222 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.212+0000 7f48e7037700 1 --2- 172.21.15.150:0/4063628633 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48e0152580 0x7f48e00b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:47:57.222 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.212+0000 7f48e7037700 1 --2- 172.21.15.150:0/4063628633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48e00b26b0 0x7f48e00663f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:57.222 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.212+0000 7f48e7037700 1 -- 172.21.15.150:0/4063628633 >> 172.21.15.150:0/4063628633 conn(0x7f48e00b4cc0 msgr2=0x7f48e00b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:47:57.223 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.212+0000 7f48e7037700 1 -- 172.21.15.150:0/4063628633 shutdown_connections 2020-06-12T17:47:57.223 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.212+0000 7f48e7037700 1 -- 172.21.15.150:0/4063628633 wait complete. 2020-06-12T17:47:57.226 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.213+0000 7f48e7037700 1 Processor -- start 2020-06-12T17:47:57.226 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.213+0000 7f48e7037700 1 -- start start 2020-06-12T17:47:57.226 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.214+0000 7f48e7037700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f48e0066850 0x7f48e01552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:47:57.226 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.214+0000 7f48e7037700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f48e0152580 0x7f48e012ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:47:57.227 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.214+0000 7f48e7037700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e0131730 con 0x7f48e00b26b0 2020-06-12T17:47:57.227 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.214+0000 7f48e7037700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e012f160 con 0x7f48e0152580 2020-06-12T17:47:57.227 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.214+0000 7f48e7037700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e00ac470 con 0x7f48e0066850 2020-06-12T17:47:57.227 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.214+0000 7f48e55d4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f48e0066850 0x7f48e01552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:57.227 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.214+0000 7f48e55d4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f48e0066850 0x7f48e01552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:48908/0 (socket says 172.21.15.150:48908) 2020-06-12T17:47:57.228 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.214+0000 7f48e55d4700 1 -- 172.21.15.150:0/4215240276 learned_addr learned my addr 172.21.15.150:0/4215240276 (peer_addr_for_me v2:172.21.15.150:0/0) 2020-06-12T17:47:57.228 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.214+0000 7f48e5dd5700 1 --2- 172.21.15.150:0/4215240276 >> v2:172.21.15.38:3300/0 conn(0x7f48e0152580 0x7f48e012ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:57.228 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.214+0000 7f48e55d4700 1 -- 172.21.15.150:0/4215240276 >> v2:172.21.15.38:3300/0 conn(0x7f48e0152580 msgr2=0x7f48e012ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:57.228 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.214+0000 7f48e55d4700 1 --2- 172.21.15.150:0/4215240276 >> v2:172.21.15.38:3300/0 conn(0x7f48e0152580 0x7f48e012ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:57.228 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.214+0000 7f48e55d4700 1 -- 172.21.15.150:0/4215240276 >> v1:172.21.15.38:6789/0 conn(0x7f48e00b26b0 legacy=0x7f48e0152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:57.228 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.214+0000 7f48e55d4700 1 -- 172.21.15.150:0/4215240276 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e0131490 con 0x7f48e0066850 2020-06-12T17:47:57.229 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.215+0000 7f48e55d4700 1 --2- 172.21.15.150:0/4215240276 >> v2:172.21.15.150:3300/0 conn(0x7f48e0066850 0x7f48e01552f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f48d0002ef0 tx=0x7f48d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.229 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.215+0000 7f48e55d4700 1 --2- 172.21.15.150:0/4215240276 >> v2:172.21.15.150:3300/0 conn(0x7f48e0066850 0x7f48e01552f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f48d0002ef0 tx=0x7f48d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.229 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.215+0000 7f48e55d4700 1 --2- 172.21.15.150:0/4215240276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48e0066850 0x7f48e01552f0 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7f48d0002ef0 tx=0x7f48d0007e60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:47:57.229 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.215+0000 7f48e55d4700 1 --2- 172.21.15.150:0/4215240276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48e0066850 0x7f48e01552f0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f48d0002ef0 tx=0x7f48d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.230 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.215+0000 7f48e55d4700 1 --2- 172.21.15.150:0/4215240276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48e0066850 0x7f48e01552f0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f48d0002ef0 tx=0x7f48d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.230 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.215+0000 7f48d5ffb700 1 -- 172.21.15.150:0/4215240276 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48d0007540 con 0x7f48e0066850 2020-06-12T17:47:57.230 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.215+0000 7f48e55d4700 1 --2- 172.21.15.150:0/4215240276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48e0066850 0x7f48e01552f0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f48d0002ef0 tx=0x7f48d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.230 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.215+0000 7f48d5ffb700 1 -- 172.21.15.150:0/4215240276 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d0005a60 con 0x7f48e0066850 2020-06-12T17:47:57.231 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.215+0000 7f48d5ffb700 1 -- 172.21.15.150:0/4215240276 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48d0005e80 con 0x7f48e0066850 2020-06-12T17:47:57.231 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.215+0000 7f48e7037700 1 -- 172.21.15.150:0/4215240276 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e013edd0 con 0x7f48e0066850 2020-06-12T17:47:57.231 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.215+0000 7f48e7037700 1 -- 172.21.15.150:0/4215240276 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e0153070 con 0x7f48e0066850 2020-06-12T17:47:57.231 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.215+0000 7f48e55d4700 1 --2- 172.21.15.150:0/4215240276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48e0066850 0x7f48e01552f0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f48d0002ef0 tx=0x7f48d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.231 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.215+0000 7f48d5ffb700 1 -- 172.21.15.150:0/4215240276 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) v1 ==== 360+0+0 (secure 0 0 0) 0x7f48d000e600 con 0x7f48e0066850 2020-06-12T17:47:57.232 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.215+0000 7f48e55d4700 1 --2- 172.21.15.150:0/4215240276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48e0066850 0x7f48e01552f0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f48d0002ef0 tx=0x7f48d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.232 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.215+0000 7f48d5ffb700 1 -- 172.21.15.150:0/4215240276 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f48d0012b90 con 0x7f48e0066850 2020-06-12T17:47:57.232 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.216+0000 7f48e7037700 1 -- 172.21.15.150:0/4215240276 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e0056c30 con 0x7f48e0066850 2020-06-12T17:47:57.232 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.218+0000 7f48e55d4700 1 --2- 172.21.15.150:0/4215240276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48e0066850 0x7f48e01552f0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f48d0002ef0 tx=0x7f48d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.232 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.218+0000 7f48d5ffb700 1 -- 172.21.15.150:0/4215240276 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67700 (secure 0 0 0) 0x7f48d0012e30 con 0x7f48e0066850 2020-06-12T17:47:57.307 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.304+0000 7f48e7037700 1 -- 172.21.15.150:0/4215240276 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "44ac3dea-67b4-4b9a-bc18-ac511710afe1", "id": 0} v 0) v1 -- 0x7f48e005a5e0 con 0x7f48e0066850 2020-06-12T17:47:57.313 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.310+0000 7f48e55d4700 1 --2- 172.21.15.150:0/4215240276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48e0066850 0x7f48e01552f0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f48d0002ef0 tx=0x7f48d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.313 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.310+0000 7f48d5ffb700 1 -- 172.21.15.150:0/4215240276 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "44ac3dea-67b4-4b9a-bc18-ac511710afe1", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f48d000b1e0 con 0x7f48e0066850 2020-06-12T17:47:57.314 INFO:teuthology.orchestra.run.smithi150.stdout:0 2020-06-12T17:47:57.314 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.311+0000 7f48e7037700 1 -- 172.21.15.150:0/4215240276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48e0066850 msgr2=0x7f48e01552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:57.315 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.311+0000 7f48e7037700 1 --2- 172.21.15.150:0/4215240276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48e0066850 0x7f48e01552f0 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7f48d0002ef0 tx=0x7f48d0007e60).stop 2020-06-12T17:47:57.315 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.311+0000 7f48e7037700 1 -- 172.21.15.150:0/4215240276 shutdown_connections 2020-06-12T17:47:57.315 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.311+0000 7f48e7037700 1 --2- 172.21.15.150:0/4215240276 >> v2:172.21.15.38:3300/0 conn(0x7f48e0152580 0x7f48e012ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:57.315 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.311+0000 7f48e7037700 1 --2- 172.21.15.150:0/4215240276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48e0066850 0x7f48e01552f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:57.316 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.311+0000 7f48e7037700 1 -- 172.21.15.150:0/4215240276 >> 172.21.15.150:0/4215240276 conn(0x7f48e00b4cc0 msgr2=0x7f48e0061500 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:47:57.316 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.311+0000 7f48e7037700 1 -- 172.21.15.150:0/4215240276 shutdown_connections 2020-06-12T17:47:57.316 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.311+0000 7f48e7037700 1 -- 172.21.15.150:0/4215240276 wait complete. 2020-06-12T17:47:57.324 INFO:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 561f7ced-3fff-4364-8619-6e4ecbc9d256 1 2020-06-12T17:47:57.435 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.428+0000 7fd96b373700 1 Processor -- start 2020-06-12T17:47:57.435 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.428+0000 7fd96b373700 1 -- start start 2020-06-12T17:47:57.435 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.429+0000 7fd96b373700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd964152580 0x7fd9640b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:47:57.435 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.429+0000 7fd96b373700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd9640b26b0 0x7fd9640663f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:47:57.436 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.429+0000 7fd96b373700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd96405ab90 con 0x7fd964066850 2020-06-12T17:47:57.436 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.429+0000 7fd96b373700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9640648b0 con 0x7fd9640b26b0 2020-06-12T17:47:57.436 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.429+0000 7fd96b373700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd964064b50 con 0x7fd964152580 2020-06-12T17:47:57.436 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.429+0000 7fd969910700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd964152580 0x7fd9640b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:57.436 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.429+0000 7fd969910700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd964152580 0x7fd9640b3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:48914/0 (socket says 172.21.15.150:48914) 2020-06-12T17:47:57.437 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.429+0000 7fd969910700 1 -- 172.21.15.150:0/2184744779 learned_addr learned my addr 172.21.15.150:0/2184744779 (peer_addr_for_me v2:172.21.15.150:0/0) 2020-06-12T17:47:57.437 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.429+0000 7fd96910f700 1 --2- 172.21.15.150:0/2184744779 >> v2:172.21.15.38:3300/0 conn(0x7fd9640b26b0 0x7fd9640663f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:57.437 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.429+0000 7fd969910700 1 -- 172.21.15.150:0/2184744779 >> v2:172.21.15.38:3300/0 conn(0x7fd9640b26b0 msgr2=0x7fd9640663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:47:57.437 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.429+0000 7fd969910700 1 --2- 172.21.15.150:0/2184744779 >> v2:172.21.15.38:3300/0 conn(0x7fd9640b26b0 0x7fd9640663f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:47:57.437 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.429+0000 7fd969910700 1 -- 172.21.15.150:0/2184744779 >> v1:172.21.15.38:6789/0 conn(0x7fd964066850 legacy=0x7fd964065020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:57.438 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.429+0000 7fd969910700 1 -- 172.21.15.150:0/2184744779 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd964064df0 con 0x7fd964152580 2020-06-12T17:47:57.438 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.430+0000 7fd969910700 1 --2- 172.21.15.150:0/2184744779 >> v2:172.21.15.150:3300/0 conn(0x7fd964152580 0x7fd9640b3c00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd9640b2f60 tx=0x7fd954007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.438 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.430+0000 7fd969910700 1 --2- 172.21.15.150:0/2184744779 >> v2:172.21.15.150:3300/0 conn(0x7fd964152580 0x7fd9640b3c00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd9640b2f60 tx=0x7fd954007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.438 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.430+0000 7fd969910700 1 --2- 172.21.15.150:0/2184744779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd964152580 0x7fd9640b3c00 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7fd9640b2f60 tx=0x7fd954007e60).ready entity=mon.1 client_cookie=1da11e2382ff40ce server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:47:57.438 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.430+0000 7fd969910700 1 --2- 172.21.15.150:0/2184744779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd964152580 0x7fd9640b3c00 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7fd9640b2f60 tx=0x7fd954007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.439 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.430+0000 7fd96890e700 1 -- 172.21.15.150:0/2184744779 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9540115f0 con 0x7fd964152580 2020-06-12T17:47:57.439 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.430+0000 7fd969910700 1 --2- 172.21.15.150:0/2184744779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd964152580 0x7fd9640b3c00 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7fd9640b2f60 tx=0x7fd954007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.439 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.430+0000 7fd96890e700 1 -- 172.21.15.150:0/2184744779 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd954011750 con 0x7fd964152580 2020-06-12T17:47:57.439 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.430+0000 7fd969910700 1 --2- 172.21.15.150:0/2184744779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd964152580 0x7fd9640b3c00 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7fd9640b2f60 tx=0x7fd954007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.439 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.430+0000 7fd96890e700 1 -- 172.21.15.150:0/2184744779 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd954011b70 con 0x7fd964152580 2020-06-12T17:47:57.439 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.430+0000 7fd96b373700 1 -- 172.21.15.150:0/2184744779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd964152580 msgr2=0x7fd9640b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:57.440 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.430+0000 7fd96b373700 1 --2- 172.21.15.150:0/2184744779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd964152580 0x7fd9640b3c00 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7fd9640b2f60 tx=0x7fd954007e60).stop 2020-06-12T17:47:57.440 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.430+0000 7fd96b373700 1 -- 172.21.15.150:0/2184744779 shutdown_connections 2020-06-12T17:47:57.440 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.430+0000 7fd96b373700 1 --2- 172.21.15.150:0/2184744779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd964152580 0x7fd9640b3c00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:57.440 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.430+0000 7fd96b373700 1 --2- 172.21.15.150:0/2184744779 >> v2:172.21.15.38:3300/0 conn(0x7fd9640b26b0 0x7fd9640663f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:47:57.440 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.430+0000 7fd96b373700 1 -- 172.21.15.150:0/2184744779 >> 172.21.15.150:0/2184744779 conn(0x7fd9640b4cc0 msgr2=0x7fd9640b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:47:57.441 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.430+0000 7fd96b373700 1 -- 172.21.15.150:0/2184744779 shutdown_connections 2020-06-12T17:47:57.441 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.430+0000 7fd96b373700 1 -- 172.21.15.150:0/2184744779 wait complete. 2020-06-12T17:47:57.441 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.432+0000 7fd96b373700 1 Processor -- start 2020-06-12T17:47:57.441 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.432+0000 7fd96b373700 1 -- start start 2020-06-12T17:47:57.444 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.432+0000 7fd96b373700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd964066850 0x7fd9640b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:47:57.444 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.432+0000 7fd96b373700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9640b26b0 0x7fd964152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:47:57.445 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.432+0000 7fd96b373700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9640b1c40 con 0x7fd964152580 2020-06-12T17:47:57.445 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.432+0000 7fd96b373700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd964152fc0 con 0x7fd964066850 2020-06-12T17:47:57.445 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.432+0000 7fd96b373700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96411e970 con 0x7fd9640b26b0 2020-06-12T17:47:57.445 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.432+0000 7fd969910700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd964066850 0x7fd9640b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:57.445 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.432+0000 7fd96910f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9640b26b0 0x7fd964152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:57.446 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.432+0000 7fd969910700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd964066850 0x7fd9640b1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:48920/0 (socket says 172.21.15.150:48920) 2020-06-12T17:47:57.446 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.432+0000 7fd96910f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9640b26b0 0x7fd964152b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:41870/0 (socket says 172.21.15.150:41870) 2020-06-12T17:47:57.446 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.432+0000 7fd969910700 1 -- 172.21.15.150:0/2445986072 learned_addr learned my addr 172.21.15.150:0/2445986072 (peer_addr_for_me v2:172.21.15.150:0/0) 2020-06-12T17:47:57.446 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.433+0000 7fd96910f700 1 -- 172.21.15.150:0/2445986072 >> v2:172.21.15.150:3300/0 conn(0x7fd964066850 msgr2=0x7fd9640b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:57.446 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.433+0000 7fd96910f700 1 --2- 172.21.15.150:0/2445986072 >> v2:172.21.15.150:3300/0 conn(0x7fd964066850 0x7fd9640b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:57.447 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.433+0000 7fd96910f700 1 -- 172.21.15.150:0/2445986072 >> v1:172.21.15.38:6789/0 conn(0x7fd964152580 legacy=0x7fd9640b8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:57.447 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.433+0000 7fd96910f700 1 -- 172.21.15.150:0/2445986072 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96411ec10 con 0x7fd9640b26b0 2020-06-12T17:47:57.447 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.433+0000 7fd969910700 1 --2- 172.21.15.150:0/2445986072 >> v2:172.21.15.150:3300/0 conn(0x7fd964066850 0x7fd9640b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:47:57.447 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.433+0000 7fd96910f700 1 --2- 172.21.15.150:0/2445986072 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9640b26b0 0x7fd964152b60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd9640ae1a0 tx=0x7fd960007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.447 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.433+0000 7fd96910f700 1 --2- 172.21.15.150:0/2445986072 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9640b26b0 0x7fd964152b60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd9640ae1a0 tx=0x7fd960007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.447 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.433+0000 7fd96910f700 1 --2- 172.21.15.150:0/2445986072 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9640b26b0 0x7fd964152b60 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7fd9640ae1a0 tx=0x7fd960007e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:47:57.448 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.433+0000 7fd96910f700 1 --2- 172.21.15.150:0/2445986072 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9640b26b0 0x7fd964152b60 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fd9640ae1a0 tx=0x7fd960007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.448 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.433+0000 7fd96910f700 1 --2- 172.21.15.150:0/2445986072 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9640b26b0 0x7fd964152b60 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fd9640ae1a0 tx=0x7fd960007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.448 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.433+0000 7fd95a7fc700 1 -- 172.21.15.150:0/2445986072 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd960007530 con 0x7fd9640b26b0 2020-06-12T17:47:57.449 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.433+0000 7fd96910f700 1 --2- 172.21.15.150:0/2445986072 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9640b26b0 0x7fd964152b60 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fd9640ae1a0 tx=0x7fd960007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.449 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.433+0000 7fd95a7fc700 1 -- 172.21.15.150:0/2445986072 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9600147b0 con 0x7fd9640b26b0 2020-06-12T17:47:57.449 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.433+0000 7fd96b373700 1 -- 172.21.15.150:0/2445986072 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9640b18c0 con 0x7fd9640b26b0 2020-06-12T17:47:57.449 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.433+0000 7fd95a7fc700 1 -- 172.21.15.150:0/2445986072 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd960014bd0 con 0x7fd9640b26b0 2020-06-12T17:47:57.449 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.433+0000 7fd96910f700 1 --2- 172.21.15.150:0/2445986072 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9640b26b0 0x7fd964152b60 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fd9640ae1a0 tx=0x7fd960007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.450 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.433+0000 7fd95a7fc700 1 -- 172.21.15.150:0/2445986072 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) v1 ==== 360+0+0 (secure 0 0 0) 0x7fd9600058a0 con 0x7fd9640b26b0 2020-06-12T17:47:57.450 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.433+0000 7fd96b373700 1 -- 172.21.15.150:0/2445986072 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96411e260 con 0x7fd9640b26b0 2020-06-12T17:47:57.450 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.433+0000 7fd96910f700 1 --2- 172.21.15.150:0/2445986072 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9640b26b0 0x7fd964152b60 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fd9640ae1a0 tx=0x7fd960007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.450 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.433+0000 7fd95a7fc700 1 -- 172.21.15.150:0/2445986072 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7fd9600108c0 con 0x7fd9640b26b0 2020-06-12T17:47:57.450 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.434+0000 7fd96b373700 1 -- 172.21.15.150:0/2445986072 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96411eda0 con 0x7fd9640b26b0 2020-06-12T17:47:57.451 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.438+0000 7fd96910f700 1 --2- 172.21.15.150:0/2445986072 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9640b26b0 0x7fd964152b60 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fd9640ae1a0 tx=0x7fd960007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.451 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.438+0000 7fd95a7fc700 1 -- 172.21.15.150:0/2445986072 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67700 (secure 0 0 0) 0x7fd960010a80 con 0x7fd9640b26b0 2020-06-12T17:47:57.528 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.524+0000 7fd96b373700 1 -- 172.21.15.150:0/2445986072 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "561f7ced-3fff-4364-8619-6e4ecbc9d256", "id": 1} v 0) v1 -- 0x7fd964056c30 con 0x7fd9640b26b0 2020-06-12T17:47:57.533 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.529+0000 7fd96910f700 1 --2- 172.21.15.150:0/2445986072 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9640b26b0 0x7fd964152b60 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fd9640ae1a0 tx=0x7fd960007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.533 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.529+0000 7fd95a7fc700 1 -- 172.21.15.150:0/2445986072 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "561f7ced-3fff-4364-8619-6e4ecbc9d256", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd960010c20 con 0x7fd9640b26b0 2020-06-12T17:47:57.533 INFO:teuthology.orchestra.run.smithi150.stdout:1 2020-06-12T17:47:57.534 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.530+0000 7fd96b373700 1 -- 172.21.15.150:0/2445986072 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9640b26b0 msgr2=0x7fd964152b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:57.535 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.530+0000 7fd96b373700 1 --2- 172.21.15.150:0/2445986072 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9640b26b0 0x7fd964152b60 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7fd9640ae1a0 tx=0x7fd960007e60).stop 2020-06-12T17:47:57.535 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.530+0000 7fd96b373700 1 -- 172.21.15.150:0/2445986072 shutdown_connections 2020-06-12T17:47:57.535 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.530+0000 7fd96b373700 1 --2- 172.21.15.150:0/2445986072 >> v2:172.21.15.150:3300/0 conn(0x7fd964066850 0x7fd9640b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:57.535 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.530+0000 7fd96b373700 1 --2- 172.21.15.150:0/2445986072 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9640b26b0 0x7fd964152b60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:57.535 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.530+0000 7fd96b373700 1 -- 172.21.15.150:0/2445986072 >> 172.21.15.150:0/2445986072 conn(0x7fd9640b4cc0 msgr2=0x7fd964064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:47:57.536 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.531+0000 7fd96b373700 1 -- 172.21.15.150:0/2445986072 shutdown_connections 2020-06-12T17:47:57.536 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.531+0000 7fd96b373700 1 -- 172.21.15.150:0/2445986072 wait complete. 2020-06-12T17:47:57.546 INFO:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 0bb3c806-07af-49f5-b492-d0e33f2de37c 2 2020-06-12T17:47:57.659 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.652+0000 7f3fb7b2b700 1 Processor -- start 2020-06-12T17:47:57.659 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.652+0000 7f3fb7b2b700 1 -- start start 2020-06-12T17:47:57.659 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.653+0000 7f3fb7b2b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3fb00b26b0 0x7f3fb00b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:47:57.659 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.653+0000 7f3fb7b2b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 0x7f3fb0061c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:47:57.660 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.653+0000 7f3fb7b2b700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb005ab90 con 0x7f3fb0152580 2020-06-12T17:47:57.660 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.653+0000 7f3fb7b2b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb00648b0 con 0x7f3fb00b26b0 2020-06-12T17:47:57.660 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.653+0000 7f3fb7b2b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb0064b50 con 0x7f3fb00617a0 2020-06-12T17:47:57.660 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.653+0000 7f3fb68c9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 0x7f3fb0061c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:57.660 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.653+0000 7f3fb68c9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 0x7f3fb0061c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:41912/0 (socket says 172.21.15.150:41912) 2020-06-12T17:47:57.661 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.653+0000 7f3fb68c9700 1 -- 172.21.15.150:0/897646511 learned_addr learned my addr 172.21.15.150:0/897646511 (peer_addr_for_me v2:172.21.15.150:0/0) 2020-06-12T17:47:57.661 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.653+0000 7f3fb58c7700 1 --2- 172.21.15.150:0/897646511 >> v2:172.21.15.150:3300/0 conn(0x7f3fb00b26b0 0x7f3fb00b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:57.661 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.653+0000 7f3fb68c9700 1 -- 172.21.15.150:0/897646511 >> v2:172.21.15.150:3300/0 conn(0x7f3fb00b26b0 msgr2=0x7f3fb00b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:47:57.661 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.653+0000 7f3fb68c9700 1 --2- 172.21.15.150:0/897646511 >> v2:172.21.15.150:3300/0 conn(0x7f3fb00b26b0 0x7f3fb00b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:47:57.661 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.653+0000 7f3fb68c9700 1 -- 172.21.15.150:0/897646511 >> v1:172.21.15.38:6789/0 conn(0x7f3fb0152580 legacy=0x7f3fb00663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:57.662 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.653+0000 7f3fb68c9700 1 -- 172.21.15.150:0/897646511 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb0064df0 con 0x7f3fb00617a0 2020-06-12T17:47:57.662 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.654+0000 7f3fb68c9700 1 --2- 172.21.15.150:0/897646511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 0x7f3fb0061c20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3fa80032b0 tx=0x7f3fa80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.662 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.654+0000 7f3fb68c9700 1 --2- 172.21.15.150:0/897646511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 0x7f3fb0061c20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3fa80032b0 tx=0x7f3fa80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.662 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.654+0000 7f3fb68c9700 1 --2- 172.21.15.150:0/897646511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 0x7f3fb0061c20 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7f3fa80032b0 tx=0x7f3fa80081e0).ready entity=mon.2 client_cookie=41e8eed5bf8d946b server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:47:57.662 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.654+0000 7f3fb68c9700 1 --2- 172.21.15.150:0/897646511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 0x7f3fb0061c20 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f3fa80032b0 tx=0x7f3fa80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.663 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.654+0000 7f3fb68c9700 1 --2- 172.21.15.150:0/897646511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 0x7f3fb0061c20 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f3fa80032b0 tx=0x7f3fa80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.663 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.654+0000 7f3fb50c6700 1 -- 172.21.15.150:0/897646511 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fa8011ea0 con 0x7f3fb00617a0 2020-06-12T17:47:57.663 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.654+0000 7f3fb68c9700 1 --2- 172.21.15.150:0/897646511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 0x7f3fb0061c20 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f3fa80032b0 tx=0x7f3fa80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.663 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.654+0000 7f3fb50c6700 1 -- 172.21.15.150:0/897646511 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa800a160 con 0x7f3fb00617a0 2020-06-12T17:47:57.663 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.654+0000 7f3fb50c6700 1 -- 172.21.15.150:0/897646511 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fa800a580 con 0x7f3fb00617a0 2020-06-12T17:47:57.664 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.654+0000 7f3fb7b2b700 1 -- 172.21.15.150:0/897646511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 msgr2=0x7f3fb0061c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:57.664 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.654+0000 7f3fb7b2b700 1 --2- 172.21.15.150:0/897646511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 0x7f3fb0061c20 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7f3fa80032b0 tx=0x7f3fa80081e0).stop 2020-06-12T17:47:57.664 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.654+0000 7f3fb7b2b700 1 -- 172.21.15.150:0/897646511 shutdown_connections 2020-06-12T17:47:57.664 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.654+0000 7f3fb7b2b700 1 --2- 172.21.15.150:0/897646511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 0x7f3fb0061c20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:57.664 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.654+0000 7f3fb7b2b700 1 --2- 172.21.15.150:0/897646511 >> v2:172.21.15.150:3300/0 conn(0x7f3fb00b26b0 0x7f3fb00b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:47:57.665 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.654+0000 7f3fb7b2b700 1 -- 172.21.15.150:0/897646511 >> 172.21.15.150:0/897646511 conn(0x7f3fb00b4cc0 msgr2=0x7f3fb00b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:47:57.665 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.654+0000 7f3fb7b2b700 1 -- 172.21.15.150:0/897646511 shutdown_connections 2020-06-12T17:47:57.665 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.654+0000 7f3fb7b2b700 1 -- 172.21.15.150:0/897646511 wait complete. 2020-06-12T17:47:57.665 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.655+0000 7f3fb7b2b700 1 Processor -- start 2020-06-12T17:47:57.665 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.656+0000 7f3fb7b2b700 1 -- start start 2020-06-12T17:47:57.668 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.656+0000 7f3fb7b2b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 0x7f3fb01550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:47:57.668 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.656+0000 7f3fb7b2b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3fb0152580 0x7f3fb00add00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:47:57.668 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.656+0000 7f3fb7b2b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb00b1380 con 0x7f3fb00b26b0 2020-06-12T17:47:57.669 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.656+0000 7f3fb7b2b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb00b1620 con 0x7f3fb0152580 2020-06-12T17:47:57.669 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.656+0000 7f3fb7b2b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb00ac320 con 0x7f3fb00617a0 2020-06-12T17:47:57.669 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.656+0000 7f3fb68c9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3fb0152580 0x7f3fb00add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:57.669 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.656+0000 7f3fb60c8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 0x7f3fb01550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:57.669 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.656+0000 7f3fb58c7700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f3fb00b26b0 0x7f3fb00b1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:40348/0 (socket says 172.21.15.150:40348) 2020-06-12T17:47:57.670 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.656+0000 7f3fb58c7700 1 -- 172.21.15.150:0/1818132265 learned_addr learned my addr 172.21.15.150:0/1818132265 (peer_addr_for_me v1:172.21.15.150:0/0) 2020-06-12T17:47:57.670 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.657+0000 7f3fb60c8700 1 -- 172.21.15.150:0/1818132265 >> v2:172.21.15.150:3300/0 conn(0x7f3fb0152580 msgr2=0x7f3fb00add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:57.670 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.657+0000 7f3fb60c8700 1 --2- 172.21.15.150:0/1818132265 >> v2:172.21.15.150:3300/0 conn(0x7f3fb0152580 0x7f3fb00add00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:57.670 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.657+0000 7f3fb60c8700 1 -- 172.21.15.150:0/1818132265 >> v1:172.21.15.150:6789/0 conn(0x7f3fb00b26b0 legacy=0x7f3fb00b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:57.670 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.657+0000 7f3fa6ffd700 1 -- 172.21.15.150:0/1818132265 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427498026 0 0) 0x7f3fb00b1380 con 0x7f3fb00b26b0 2020-06-12T17:47:57.671 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.657+0000 7f3fb60c8700 1 -- 172.21.15.150:0/1818132265 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb00b1060 con 0x7f3fb00617a0 2020-06-12T17:47:57.671 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.657+0000 7f3fb68c9700 1 --2- 172.21.15.150:0/1818132265 >> v2:172.21.15.150:3300/0 conn(0x7f3fb0152580 0x7f3fb00add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:47:57.671 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.657+0000 7f3fb60c8700 1 --2- 172.21.15.150:0/1818132265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 0x7f3fb01550d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3fb00b5900 tx=0x7f3fac001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.671 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.657+0000 7f3fb60c8700 1 --2- 172.21.15.150:0/1818132265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 0x7f3fb01550d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3fb00b5900 tx=0x7f3fac001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.671 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.657+0000 7f3fb60c8700 1 --2- 172.21.15.150:0/1818132265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 0x7f3fb01550d0 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7f3fb00b5900 tx=0x7f3fac001760).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:47:57.672 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.657+0000 7f3fb60c8700 1 --2- 172.21.15.150:0/1818132265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 0x7f3fb01550d0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f3fb00b5900 tx=0x7f3fac001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.672 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.657+0000 7f3fa6ffd700 1 -- 172.21.15.150:0/1818132265 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fac006bc0 con 0x7f3fb00617a0 2020-06-12T17:47:57.672 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.657+0000 7f3fb60c8700 1 --2- 172.21.15.150:0/1818132265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 0x7f3fb01550d0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f3fb00b5900 tx=0x7f3fac001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.672 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.657+0000 7f3fb60c8700 1 --2- 172.21.15.150:0/1818132265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 0x7f3fb01550d0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f3fb00b5900 tx=0x7f3fac001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.672 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.657+0000 7f3fa6ffd700 1 -- 172.21.15.150:0/1818132265 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fac006d60 con 0x7f3fb00617a0 2020-06-12T17:47:57.673 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.657+0000 7f3fb7b2b700 1 -- 172.21.15.150:0/1818132265 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb00ac7c0 con 0x7f3fb00617a0 2020-06-12T17:47:57.673 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.657+0000 7f3fa6ffd700 1 -- 172.21.15.150:0/1818132265 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fac011040 con 0x7f3fb00617a0 2020-06-12T17:47:57.673 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.657+0000 7f3fb7b2b700 1 -- 172.21.15.150:0/1818132265 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb00acc60 con 0x7f3fb00617a0 2020-06-12T17:47:57.673 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.657+0000 7f3fb60c8700 1 --2- 172.21.15.150:0/1818132265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 0x7f3fb01550d0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f3fb00b5900 tx=0x7f3fac001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.673 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.658+0000 7f3fb60c8700 1 --2- 172.21.15.150:0/1818132265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 0x7f3fb01550d0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f3fb00b5900 tx=0x7f3fac001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.673 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.658+0000 7f3fa6ffd700 1 -- 172.21.15.150:0/1818132265 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 2) v1 ==== 29658+0+0 (secure 0 0 0) 0x7f3fac0112b0 con 0x7f3fb00617a0 2020-06-12T17:47:57.674 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.658+0000 7f3fa6ffd700 1 -- 172.21.15.150:0/1818132265 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f3fac0343b0 con 0x7f3fb00617a0 2020-06-12T17:47:57.674 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.658+0000 7f3fb7b2b700 1 -- 172.21.15.150:0/1818132265 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb00ad340 con 0x7f3fb00617a0 2020-06-12T17:47:57.674 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.660+0000 7f3fb60c8700 1 --2- 172.21.15.150:0/1818132265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 0x7f3fb01550d0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f3fb00b5900 tx=0x7f3fac001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.674 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.660+0000 7f3fa6ffd700 1 -- 172.21.15.150:0/1818132265 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67700 (secure 0 0 0) 0x7f3fac003740 con 0x7f3fb00617a0 2020-06-12T17:47:57.747 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.744+0000 7f3fb7b2b700 1 -- 172.21.15.150:0/1818132265 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0bb3c806-07af-49f5-b492-d0e33f2de37c", "id": 2} v 0) v1 -- 0x7f3fb0056c30 con 0x7f3fb00617a0 2020-06-12T17:47:57.751 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.748+0000 7f3fb60c8700 1 --2- 172.21.15.150:0/1818132265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 0x7f3fb01550d0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f3fb00b5900 tx=0x7f3fac001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.751 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.748+0000 7f3fa6ffd700 1 -- 172.21.15.150:0/1818132265 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0bb3c806-07af-49f5-b492-d0e33f2de37c", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3fac003350 con 0x7f3fb00617a0 2020-06-12T17:47:57.751 INFO:teuthology.orchestra.run.smithi150.stdout:2 2020-06-12T17:47:57.752 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.749+0000 7f3fb7b2b700 1 -- 172.21.15.150:0/1818132265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 msgr2=0x7f3fb01550d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:57.753 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.749+0000 7f3fb7b2b700 1 --2- 172.21.15.150:0/1818132265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 0x7f3fb01550d0 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7f3fb00b5900 tx=0x7f3fac001760).stop 2020-06-12T17:47:57.753 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.749+0000 7f3fb7b2b700 1 -- 172.21.15.150:0/1818132265 shutdown_connections 2020-06-12T17:47:57.753 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.749+0000 7f3fb7b2b700 1 --2- 172.21.15.150:0/1818132265 >> v2:172.21.15.150:3300/0 conn(0x7f3fb0152580 0x7f3fb00add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:57.753 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.749+0000 7f3fb7b2b700 1 --2- 172.21.15.150:0/1818132265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3fb00617a0 0x7f3fb01550d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:57.754 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.749+0000 7f3fb7b2b700 1 -- 172.21.15.150:0/1818132265 >> 172.21.15.150:0/1818132265 conn(0x7f3fb00b4cc0 msgr2=0x7f3fb0061b80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:47:57.754 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.749+0000 7f3fb7b2b700 1 -- 172.21.15.150:0/1818132265 shutdown_connections 2020-06-12T17:47:57.754 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.749+0000 7f3fb7b2b700 1 -- 172.21.15.150:0/1818132265 wait complete. 2020-06-12T17:47:57.762 INFO:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 7f6a1e75-7b11-456e-8a4b-510b16226800 3 2020-06-12T17:47:57.869 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.863+0000 7f04e0978700 1 Processor -- start 2020-06-12T17:47:57.870 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.863+0000 7f04e0978700 1 -- start start 2020-06-12T17:47:57.870 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.864+0000 7f04e0978700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04dc152580 0x7f04dc0b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:47:57.870 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.864+0000 7f04e0978700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04dc05ab90 con 0x7f04dc0617a0 2020-06-12T17:47:57.870 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.864+0000 7f04e0978700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04dc0648b0 con 0x7f04dc0b26b0 2020-06-12T17:47:57.870 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.864+0000 7f04e0978700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc064b50 con 0x7f04dc152580 2020-06-12T17:47:57.871 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.864+0000 7f04dad9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04dc152580 0x7f04dc0b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:57.871 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.864+0000 7f04da59c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f04dc0b26b0 0x7f04dc0663f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:40354/0 (socket says 172.21.15.150:40354) 2020-06-12T17:47:57.871 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.864+0000 7f04dad9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04dc152580 0x7f04dc0b3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:41922/0 (socket says 172.21.15.150:41922) 2020-06-12T17:47:57.871 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.864+0000 7f04da59c700 1 -- 172.21.15.150:0/2791958010 learned_addr learned my addr 172.21.15.150:0/2791958010 (peer_addr_for_me v1:172.21.15.150:0/0) 2020-06-12T17:47:57.871 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.864+0000 7f04d9d9b700 1 -- 172.21.15.150:0/2791958010 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1483867260 0 0) 0x7f04dc0648b0 con 0x7f04dc0b26b0 2020-06-12T17:47:57.872 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.864+0000 7f04dad9d700 1 -- 172.21.15.150:0/2791958010 >> v1:172.21.15.150:6789/0 conn(0x7f04dc0b26b0 legacy=0x7f04dc0663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:57.872 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.864+0000 7f04dad9d700 1 -- 172.21.15.150:0/2791958010 >> v1:172.21.15.38:6789/0 conn(0x7f04dc0617a0 legacy=0x7f04dc061bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:47:57.872 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.864+0000 7f04dad9d700 1 -- 172.21.15.150:0/2791958010 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04dc064df0 con 0x7f04dc152580 2020-06-12T17:47:57.872 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.864+0000 7f04dad9d700 1 --2- 172.21.15.150:0/2791958010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04dc152580 0x7f04dc0b3c00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f04dc0b5940 tx=0x7f04cc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.872 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.865+0000 7f04dad9d700 1 --2- 172.21.15.150:0/2791958010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04dc152580 0x7f04dc0b3c00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f04dc0b5940 tx=0x7f04cc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.873 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.865+0000 7f04dad9d700 1 --2- 172.21.15.150:0/2791958010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04dc152580 0x7f04dc0b3c00 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7f04dc0b5940 tx=0x7f04cc007e60).ready entity=mon.2 client_cookie=6dedb267e9028311 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:47:57.873 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.865+0000 7f04dad9d700 1 --2- 172.21.15.150:0/2791958010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04dc152580 0x7f04dc0b3c00 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f04dc0b5940 tx=0x7f04cc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.873 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.865+0000 7f04d9d9b700 1 -- 172.21.15.150:0/2791958010 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04cc011430 con 0x7f04dc152580 2020-06-12T17:47:57.873 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.865+0000 7f04dad9d700 1 --2- 172.21.15.150:0/2791958010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04dc152580 0x7f04dc0b3c00 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f04dc0b5940 tx=0x7f04cc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.873 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.865+0000 7f04dad9d700 1 --2- 172.21.15.150:0/2791958010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04dc152580 0x7f04dc0b3c00 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f04dc0b5940 tx=0x7f04cc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.874 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.865+0000 7f04d9d9b700 1 -- 172.21.15.150:0/2791958010 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04cc011590 con 0x7f04dc152580 2020-06-12T17:47:57.874 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.865+0000 7f04d9d9b700 1 -- 172.21.15.150:0/2791958010 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04cc011970 con 0x7f04dc152580 2020-06-12T17:47:57.874 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.865+0000 7f04e0978700 1 -- 172.21.15.150:0/2791958010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04dc152580 msgr2=0x7f04dc0b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:57.874 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.865+0000 7f04e0978700 1 --2- 172.21.15.150:0/2791958010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04dc152580 0x7f04dc0b3c00 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7f04dc0b5940 tx=0x7f04cc007e60).stop 2020-06-12T17:47:57.874 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.865+0000 7f04e0978700 1 -- 172.21.15.150:0/2791958010 shutdown_connections 2020-06-12T17:47:57.874 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.865+0000 7f04e0978700 1 --2- 172.21.15.150:0/2791958010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04dc152580 0x7f04dc0b3c00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:57.875 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.865+0000 7f04e0978700 1 -- 172.21.15.150:0/2791958010 >> 172.21.15.150:0/2791958010 conn(0x7f04dc0b4cc0 msgr2=0x7f04dc0b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:47:57.875 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.865+0000 7f04e0978700 1 -- 172.21.15.150:0/2791958010 shutdown_connections 2020-06-12T17:47:57.875 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.865+0000 7f04e0978700 1 -- 172.21.15.150:0/2791958010 wait complete. 2020-06-12T17:47:57.878 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.866+0000 7f04e0978700 1 Processor -- start 2020-06-12T17:47:57.878 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.866+0000 7f04e0978700 1 -- start start 2020-06-12T17:47:57.878 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.867+0000 7f04e0978700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f04dc0b26b0 0x7f04dc0acb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:47:57.879 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.867+0000 7f04e0978700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f04dc152580 0x7f04dc065300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:47:57.879 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.867+0000 7f04e0978700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04dc0ac610 con 0x7f04dc0617a0 2020-06-12T17:47:57.879 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.867+0000 7f04e0978700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04dc0ae990 con 0x7f04dc0b26b0 2020-06-12T17:47:57.879 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.867+0000 7f04e0978700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04dc0aec30 con 0x7f04dc152580 2020-06-12T17:47:57.879 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.867+0000 7f04dad9d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f04dc0617a0 0x7f04dc0af0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:40360/0 (socket says 172.21.15.150:40360) 2020-06-12T17:47:57.880 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.867+0000 7f04dad9d700 1 -- 172.21.15.150:0/836219948 learned_addr learned my addr 172.21.15.150:0/836219948 (peer_addr_for_me v1:172.21.15.150:0/0) 2020-06-12T17:47:57.880 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.867+0000 7f04db59e700 1 --2- 172.21.15.150:0/836219948 >> v2:172.21.15.150:3300/0 conn(0x7f04dc152580 0x7f04dc065300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:57.880 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.867+0000 7f04da59c700 1 --2- 172.21.15.150:0/836219948 >> v2:172.21.15.38:3300/0 conn(0x7f04dc0b26b0 0x7f04dc0acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:57.880 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.867+0000 7f04cb7fe700 1 -- 172.21.15.150:0/836219948 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2351406032 0 0) 0x7f04dc0ac610 con 0x7f04dc0617a0 2020-06-12T17:47:57.880 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.867+0000 7f04cb7fe700 1 -- 172.21.15.150:0/836219948 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04c0003230 con 0x7f04dc0617a0 2020-06-12T17:47:57.880 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.867+0000 7f04db59e700 1 -- 172.21.15.150:0/836219948 >> v2:172.21.15.38:3300/0 conn(0x7f04dc0b26b0 msgr2=0x7f04dc0acb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:57.881 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.867+0000 7f04db59e700 1 --2- 172.21.15.150:0/836219948 >> v2:172.21.15.38:3300/0 conn(0x7f04dc0b26b0 0x7f04dc0acb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:57.881 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.867+0000 7f04db59e700 1 -- 172.21.15.150:0/836219948 >> v1:172.21.15.150:6789/0 conn(0x7f04dc0617a0 legacy=0x7f04dc0af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:57.881 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.867+0000 7f04db59e700 1 -- 172.21.15.150:0/836219948 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04dc0af7e0 con 0x7f04dc152580 2020-06-12T17:47:57.881 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.867+0000 7f04db59e700 1 --2- 172.21.15.150:0/836219948 >> v2:172.21.15.150:3300/0 conn(0x7f04dc152580 0x7f04dc065300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f04d40022d0 tx=0x7f04d4002a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.881 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.868+0000 7f04db59e700 1 --2- 172.21.15.150:0/836219948 >> v2:172.21.15.150:3300/0 conn(0x7f04dc152580 0x7f04dc065300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f04d40022d0 tx=0x7f04d4002a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.882 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.868+0000 7f04db59e700 1 --2- 172.21.15.150:0/836219948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04dc152580 0x7f04dc065300 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f04d40022d0 tx=0x7f04d4002a10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:47:57.882 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.868+0000 7f04db59e700 1 --2- 172.21.15.150:0/836219948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04dc152580 0x7f04dc065300 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f04d40022d0 tx=0x7f04d4002a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.882 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.868+0000 7f04cb7fe700 1 -- 172.21.15.150:0/836219948 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04d4008160 con 0x7f04dc152580 2020-06-12T17:47:57.882 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.868+0000 7f04db59e700 1 --2- 172.21.15.150:0/836219948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04dc152580 0x7f04dc065300 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f04d40022d0 tx=0x7f04d4002a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.882 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.868+0000 7f04cb7fe700 1 -- 172.21.15.150:0/836219948 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d40082c0 con 0x7f04dc152580 2020-06-12T17:47:57.883 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.868+0000 7f04db59e700 1 --2- 172.21.15.150:0/836219948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04dc152580 0x7f04dc065300 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f04d40022d0 tx=0x7f04d4002a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.883 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.868+0000 7f04e0978700 1 -- 172.21.15.150:0/836219948 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04dc1375a0 con 0x7f04dc152580 2020-06-12T17:47:57.883 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.868+0000 7f04cb7fe700 1 -- 172.21.15.150:0/836219948 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04d40086e0 con 0x7f04dc152580 2020-06-12T17:47:57.883 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.868+0000 7f04e0978700 1 -- 172.21.15.150:0/836219948 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04dc132b60 con 0x7f04dc152580 2020-06-12T17:47:57.883 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.868+0000 7f04db59e700 1 --2- 172.21.15.150:0/836219948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04dc152580 0x7f04dc065300 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f04d40022d0 tx=0x7f04d4002a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.884 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.868+0000 7f04cb7fe700 1 -- 172.21.15.150:0/836219948 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 2) v1 ==== 29658+0+0 (secure 0 0 0) 0x7f04d40089a0 con 0x7f04dc152580 2020-06-12T17:47:57.884 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.868+0000 7f04db59e700 1 --2- 172.21.15.150:0/836219948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04dc152580 0x7f04dc065300 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f04d40022d0 tx=0x7f04d4002a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.884 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.869+0000 7f04cb7fe700 1 -- 172.21.15.150:0/836219948 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1475+0+0 (secure 0 0 0) 0x7f04d40347e0 con 0x7f04dc152580 2020-06-12T17:47:57.884 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.869+0000 7f04e0978700 1 -- 172.21.15.150:0/836219948 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04dc056c30 con 0x7f04dc152580 2020-06-12T17:47:57.884 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.871+0000 7f04db59e700 1 --2- 172.21.15.150:0/836219948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04dc152580 0x7f04dc065300 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f04d40022d0 tx=0x7f04d4002a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.884 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.871+0000 7f04cb7fe700 1 -- 172.21.15.150:0/836219948 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67700 (secure 0 0 0) 0x7f04d4008c30 con 0x7f04dc152580 2020-06-12T17:47:57.958 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.955+0000 7f04e0978700 1 -- 172.21.15.150:0/836219948 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7f6a1e75-7b11-456e-8a4b-510b16226800", "id": 3} v 0) v1 -- 0x7f04dc0b5980 con 0x7f04dc152580 2020-06-12T17:47:57.964 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.960+0000 7f04db59e700 1 --2- 172.21.15.150:0/836219948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04dc152580 0x7f04dc065300 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f04d40022d0 tx=0x7f04d4002a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:57.964 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.960+0000 7f04cb7fe700 1 -- 172.21.15.150:0/836219948 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7f6a1e75-7b11-456e-8a4b-510b16226800", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f04d4003df0 con 0x7f04dc152580 2020-06-12T17:47:57.964 INFO:teuthology.orchestra.run.smithi150.stdout:3 2020-06-12T17:47:57.965 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.961+0000 7f04e0978700 1 -- 172.21.15.150:0/836219948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04dc152580 msgr2=0x7f04dc065300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:57.967 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.961+0000 7f04e0978700 1 --2- 172.21.15.150:0/836219948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04dc152580 0x7f04dc065300 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f04d40022d0 tx=0x7f04d4002a10).stop 2020-06-12T17:47:57.967 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.961+0000 7f04e0978700 1 -- 172.21.15.150:0/836219948 shutdown_connections 2020-06-12T17:47:57.967 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.961+0000 7f04e0978700 1 --2- 172.21.15.150:0/836219948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04dc152580 0x7f04dc065300 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:57.967 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.961+0000 7f04e0978700 1 --2- 172.21.15.150:0/836219948 >> v2:172.21.15.38:3300/0 conn(0x7f04dc0b26b0 0x7f04dc0acb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:57.967 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.961+0000 7f04e0978700 1 -- 172.21.15.150:0/836219948 >> 172.21.15.150:0/836219948 conn(0x7f04dc0b4cc0 msgr2=0x7f04dc062320 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:47:57.968 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.962+0000 7f04e0978700 1 -- 172.21.15.150:0/836219948 shutdown_connections 2020-06-12T17:47:57.968 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:57.962+0000 7f04e0978700 1 -- 172.21.15.150:0/836219948 wait complete. 2020-06-12T17:47:57.975 INFO:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 0eca0272-8cfd-469c-a32d-e29730dc0e1d 4 2020-06-12T17:47:58.083 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.077+0000 7f1c119a9700 1 Processor -- start 2020-06-12T17:47:58.084 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.077+0000 7f1c119a9700 1 -- start start 2020-06-12T17:47:58.084 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.078+0000 7f1c119a9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1c0c0b26b0 0x7f1c0c0b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:47:58.084 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.078+0000 7f1c119a9700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0c05ab90 con 0x7f1c0c152580 2020-06-12T17:47:58.084 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.078+0000 7f1c119a9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0c0648b0 con 0x7f1c0c0617a0 2020-06-12T17:47:58.084 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.078+0000 7f1c119a9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c0c064b50 con 0x7f1c0c0b26b0 2020-06-12T17:47:58.085 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.078+0000 7f1c0affd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1c0c0b26b0 0x7f1c0c0b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:58.085 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.078+0000 7f1c0bfff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f1c0c0617a0 0x7f1c0c061c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:40370/0 (socket says 172.21.15.150:40370) 2020-06-12T17:47:58.085 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.078+0000 7f1c0bfff700 1 -- 172.21.15.150:0/771741126 learned_addr learned my addr 172.21.15.150:0/771741126 (peer_addr_for_me v1:172.21.15.150:0/0) 2020-06-12T17:47:58.085 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.078+0000 7f1c0affd700 1 -- 172.21.15.150:0/771741126 >> v1:172.21.15.150:6789/0 conn(0x7f1c0c0617a0 legacy=0x7f1c0c061c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:58.085 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.078+0000 7f1c0affd700 1 -- 172.21.15.150:0/771741126 >> v1:172.21.15.38:6789/0 conn(0x7f1c0c152580 legacy=0x7f1c0c0663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:58.086 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.078+0000 7f1c0a7fc700 1 -- 172.21.15.150:0/771741126 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2732046135 0 0) 0x7f1c0c0648b0 con 0x7f1c0c0617a0 2020-06-12T17:47:58.086 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.079+0000 7f1c0affd700 1 -- 172.21.15.150:0/771741126 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c064df0 con 0x7f1c0c0b26b0 2020-06-12T17:47:58.086 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.079+0000 7f1c0affd700 1 --2- 172.21.15.150:0/771741126 >> v2:172.21.15.150:3300/0 conn(0x7f1c0c0b26b0 0x7f1c0c0b3c00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1c00002f30 tx=0x7f1c00007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.086 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.079+0000 7f1c0affd700 1 --2- 172.21.15.150:0/771741126 >> v2:172.21.15.150:3300/0 conn(0x7f1c0c0b26b0 0x7f1c0c0b3c00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1c00002f30 tx=0x7f1c00007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.086 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.079+0000 7f1c0affd700 1 --2- 172.21.15.150:0/771741126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c0c0b26b0 0x7f1c0c0b3c00 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7f1c00002f30 tx=0x7f1c00007e60).ready entity=mon.1 client_cookie=fe9c093e71d97ede server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:47:58.087 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.079+0000 7f1c0affd700 1 --2- 172.21.15.150:0/771741126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c0c0b26b0 0x7f1c0c0b3c00 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f1c00002f30 tx=0x7f1c00007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.087 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.079+0000 7f1c0a7fc700 1 -- 172.21.15.150:0/771741126 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c00011430 con 0x7f1c0c0b26b0 2020-06-12T17:47:58.087 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.079+0000 7f1c0affd700 1 --2- 172.21.15.150:0/771741126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c0c0b26b0 0x7f1c0c0b3c00 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f1c00002f30 tx=0x7f1c00007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.087 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.079+0000 7f1c0a7fc700 1 -- 172.21.15.150:0/771741126 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c00011590 con 0x7f1c0c0b26b0 2020-06-12T17:47:58.087 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.079+0000 7f1c0affd700 1 --2- 172.21.15.150:0/771741126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c0c0b26b0 0x7f1c0c0b3c00 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f1c00002f30 tx=0x7f1c00007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.087 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.079+0000 7f1c0a7fc700 1 -- 172.21.15.150:0/771741126 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c000118f0 con 0x7f1c0c0b26b0 2020-06-12T17:47:58.088 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.079+0000 7f1c119a9700 1 -- 172.21.15.150:0/771741126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c0c0b26b0 msgr2=0x7f1c0c0b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:58.088 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.079+0000 7f1c119a9700 1 --2- 172.21.15.150:0/771741126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c0c0b26b0 0x7f1c0c0b3c00 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7f1c00002f30 tx=0x7f1c00007e60).stop 2020-06-12T17:47:58.088 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.079+0000 7f1c119a9700 1 -- 172.21.15.150:0/771741126 shutdown_connections 2020-06-12T17:47:58.088 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.079+0000 7f1c119a9700 1 --2- 172.21.15.150:0/771741126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c0c0b26b0 0x7f1c0c0b3c00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:58.088 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.079+0000 7f1c119a9700 1 -- 172.21.15.150:0/771741126 >> 172.21.15.150:0/771741126 conn(0x7f1c0c0b4cc0 msgr2=0x7f1c0c0b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:47:58.089 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.079+0000 7f1c119a9700 1 -- 172.21.15.150:0/771741126 shutdown_connections 2020-06-12T17:47:58.089 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.079+0000 7f1c119a9700 1 -- 172.21.15.150:0/771741126 wait complete. 2020-06-12T17:47:58.092 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.080+0000 7f1c119a9700 1 Processor -- start 2020-06-12T17:47:58.092 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.081+0000 7f1c119a9700 1 -- start start 2020-06-12T17:47:58.092 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.081+0000 7f1c119a9700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1c0c152580 0x7f1c0c0ac3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:47:58.092 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.081+0000 7f1c119a9700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0c0af4f0 con 0x7f1c0c0b26b0 2020-06-12T17:47:58.092 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.081+0000 7f1c119a9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0c0af790 con 0x7f1c0c0617a0 2020-06-12T17:47:58.093 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.081+0000 7f1c119a9700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c0c0afed0 con 0x7f1c0c152580 2020-06-12T17:47:58.093 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.081+0000 7f1c0b7fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f1c0c0617a0 0x7f1c0c0aed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:40374/0 (socket says 172.21.15.150:40374) 2020-06-12T17:47:58.093 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.081+0000 7f1c0b7fe700 1 -- 172.21.15.150:0/825409241 learned_addr learned my addr 172.21.15.150:0/825409241 (peer_addr_for_me v1:172.21.15.150:0/0) 2020-06-12T17:47:58.093 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.081+0000 7f1c0bfff700 1 --2- 172.21.15.150:0/825409241 >> v2:172.21.15.38:3300/0 conn(0x7f1c0c152580 0x7f1c0c0ac3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:58.093 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.082+0000 7f1bf3fff700 1 -- 172.21.15.150:0/825409241 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566777770 0 0) 0x7f1c0c0af790 con 0x7f1c0c0617a0 2020-06-12T17:47:58.094 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.082+0000 7f1bf3fff700 1 -- 172.21.15.150:0/825409241 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bec003230 con 0x7f1c0c0617a0 2020-06-12T17:47:58.094 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.082+0000 7f1bf3fff700 1 -- 172.21.15.150:0/825409241 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3372202856 0 0) 0x7f1bec003230 con 0x7f1c0c0617a0 2020-06-12T17:47:58.094 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.082+0000 7f1c0bfff700 1 -- 172.21.15.150:0/825409241 >> v1:172.21.15.150:6789/0 conn(0x7f1c0c0617a0 legacy=0x7f1c0c0aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:58.094 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.082+0000 7f1c0bfff700 1 -- 172.21.15.150:0/825409241 >> v1:172.21.15.38:6789/0 conn(0x7f1c0c0b26b0 legacy=0x7f1c0c129ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:58.094 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.082+0000 7f1c0bfff700 1 -- 172.21.15.150:0/825409241 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c0afa30 con 0x7f1c0c152580 2020-06-12T17:47:58.095 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.082+0000 7f1c0bfff700 1 --2- 172.21.15.150:0/825409241 >> v2:172.21.15.38:3300/0 conn(0x7f1c0c152580 0x7f1c0c0ac3b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1c00007ed0 tx=0x7f1c04001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.095 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.082+0000 7f1c0bfff700 1 --2- 172.21.15.150:0/825409241 >> v2:172.21.15.38:3300/0 conn(0x7f1c0c152580 0x7f1c0c0ac3b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1c00007ed0 tx=0x7f1c04001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.095 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.082+0000 7f1c0bfff700 1 --2- 172.21.15.150:0/825409241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c0c152580 0x7f1c0c0ac3b0 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7f1c00007ed0 tx=0x7f1c04001960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:47:58.095 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.082+0000 7f1c0bfff700 1 --2- 172.21.15.150:0/825409241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c0c152580 0x7f1c0c0ac3b0 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f1c00007ed0 tx=0x7f1c04001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.095 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.082+0000 7f1bf3fff700 1 -- 172.21.15.150:0/825409241 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bfc0018d0 con 0x7f1c0c152580 2020-06-12T17:47:58.097 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.082+0000 7f1c0bfff700 1 --2- 172.21.15.150:0/825409241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c0c152580 0x7f1c0c0ac3b0 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f1c00007ed0 tx=0x7f1c04001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.097 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.082+0000 7f1bf3fff700 1 -- 172.21.15.150:0/825409241 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c04005b30 con 0x7f1c0c152580 2020-06-12T17:47:58.097 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.082+0000 7f1c0bfff700 1 --2- 172.21.15.150:0/825409241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c0c152580 0x7f1c0c0ac3b0 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f1c00007ed0 tx=0x7f1c04001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.097 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.082+0000 7f1c119a9700 1 -- 172.21.15.150:0/825409241 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c0c12a1f0 con 0x7f1c0c152580 2020-06-12T17:47:58.097 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.082+0000 7f1bf3fff700 1 -- 172.21.15.150:0/825409241 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c04005e90 con 0x7f1c0c152580 2020-06-12T17:47:58.098 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.082+0000 7f1c119a9700 1 -- 172.21.15.150:0/825409241 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c0c0ad0e0 con 0x7f1c0c152580 2020-06-12T17:47:58.098 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.083+0000 7f1c0bfff700 1 --2- 172.21.15.150:0/825409241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c0c152580 0x7f1c0c0ac3b0 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f1c00007ed0 tx=0x7f1c04001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.098 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.083+0000 7f1bf3fff700 1 -- 172.21.15.150:0/825409241 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 2) v1 ==== 29658+0+0 (secure 0 0 0) 0x7f1c04012550 con 0x7f1c0c152580 2020-06-12T17:47:58.098 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.083+0000 7f1c0bfff700 1 --2- 172.21.15.150:0/825409241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c0c152580 0x7f1c0c0ac3b0 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f1c00007ed0 tx=0x7f1c04001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.098 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.083+0000 7f1bf3fff700 1 -- 172.21.15.150:0/825409241 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1614+0+0 (secure 0 0 0) 0x7f1c04033c70 con 0x7f1c0c152580 2020-06-12T17:47:58.099 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.083+0000 7f1c119a9700 1 -- 172.21.15.150:0/825409241 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c0c056c30 con 0x7f1c0c152580 2020-06-12T17:47:58.099 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.085+0000 7f1c0bfff700 1 --2- 172.21.15.150:0/825409241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c0c152580 0x7f1c0c0ac3b0 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f1c00007ed0 tx=0x7f1c04001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.100 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.086+0000 7f1bf3fff700 1 -- 172.21.15.150:0/825409241 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67700 (secure 0 0 0) 0x7f1c04008150 con 0x7f1c0c152580 2020-06-12T17:47:58.173 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.169+0000 7f1c119a9700 1 -- 172.21.15.150:0/825409241 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0eca0272-8cfd-469c-a32d-e29730dc0e1d", "id": 4} v 0) v1 -- 0x7f1c0c05a5e0 con 0x7f1c0c152580 2020-06-12T17:47:58.178 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.174+0000 7f1c0bfff700 1 --2- 172.21.15.150:0/825409241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c0c152580 0x7f1c0c0ac3b0 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f1c00007ed0 tx=0x7f1c04001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.178 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.174+0000 7f1bf3fff700 1 -- 172.21.15.150:0/825409241 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0eca0272-8cfd-469c-a32d-e29730dc0e1d", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1c04011e60 con 0x7f1c0c152580 2020-06-12T17:47:58.178 INFO:teuthology.orchestra.run.smithi150.stdout:4 2020-06-12T17:47:58.179 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.175+0000 7f1c119a9700 1 -- 172.21.15.150:0/825409241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c0c152580 msgr2=0x7f1c0c0ac3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:58.179 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.175+0000 7f1c119a9700 1 --2- 172.21.15.150:0/825409241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c0c152580 0x7f1c0c0ac3b0 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7f1c00007ed0 tx=0x7f1c04001960).stop 2020-06-12T17:47:58.180 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.175+0000 7f1c119a9700 1 -- 172.21.15.150:0/825409241 shutdown_connections 2020-06-12T17:47:58.180 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.175+0000 7f1c119a9700 1 --2- 172.21.15.150:0/825409241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c0c152580 0x7f1c0c0ac3b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:58.180 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.175+0000 7f1c119a9700 1 -- 172.21.15.150:0/825409241 >> 172.21.15.150:0/825409241 conn(0x7f1c0c0b4cc0 msgr2=0x7f1c0c066050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:47:58.180 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.175+0000 7f1c119a9700 1 -- 172.21.15.150:0/825409241 shutdown_connections 2020-06-12T17:47:58.180 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.175+0000 7f1c119a9700 1 -- 172.21.15.150:0/825409241 wait complete. 2020-06-12T17:47:58.188 INFO:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 69d6a7dc-a55a-4ebc-8479-8bb921ddfb65 5 2020-06-12T17:47:58.295 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.289+0000 7f9afb20f700 1 Processor -- start 2020-06-12T17:47:58.296 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.289+0000 7f9afb20f700 1 -- start start 2020-06-12T17:47:58.296 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.290+0000 7f9afb20f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9af4152580 0x7f9af40b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:47:58.296 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.290+0000 7f9afb20f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9af40617a0 0x7f9af4061c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:47:58.296 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.290+0000 7f9afb20f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af405ab90 con 0x7f9af40b26b0 2020-06-12T17:47:58.297 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.290+0000 7f9afb20f700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af40648b0 con 0x7f9af40617a0 2020-06-12T17:47:58.297 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.290+0000 7f9afb20f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af4064b50 con 0x7f9af4152580 2020-06-12T17:47:58.297 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.290+0000 7f9af97ac700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9af4152580 0x7f9af40b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:58.297 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.290+0000 7f9af8fab700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f9af40b26b0 0x7f9af40663f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:40378/0 (socket says 172.21.15.150:40378) 2020-06-12T17:47:58.297 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.290+0000 7f9af8fab700 1 -- 172.21.15.150:0/2350496582 learned_addr learned my addr 172.21.15.150:0/2350496582 (peer_addr_for_me v1:172.21.15.150:0/0) 2020-06-12T17:47:58.298 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.290+0000 7f9af9fad700 1 --2- 172.21.15.150:0/2350496582 >> v2:172.21.15.38:3300/0 conn(0x7f9af40617a0 0x7f9af4061c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:58.298 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.291+0000 7f9af97ac700 1 -- 172.21.15.150:0/2350496582 >> v2:172.21.15.38:3300/0 conn(0x7f9af40617a0 msgr2=0x7f9af4061c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:47:58.298 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.291+0000 7f9af97ac700 1 --2- 172.21.15.150:0/2350496582 >> v2:172.21.15.38:3300/0 conn(0x7f9af40617a0 0x7f9af4061c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:47:58.298 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.291+0000 7f9af97ac700 1 -- 172.21.15.150:0/2350496582 >> v1:172.21.15.150:6789/0 conn(0x7f9af40b26b0 legacy=0x7f9af40663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:58.298 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.291+0000 7f9af97ac700 1 -- 172.21.15.150:0/2350496582 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af4064df0 con 0x7f9af4152580 2020-06-12T17:47:58.299 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.291+0000 7f9aebfff700 1 -- 172.21.15.150:0/2350496582 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3921392915 0 0) 0x7f9af405ab90 con 0x7f9af40b26b0 2020-06-12T17:47:58.299 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.291+0000 7f9af97ac700 1 --2- 172.21.15.150:0/2350496582 >> v2:172.21.15.150:3300/0 conn(0x7f9af4152580 0x7f9af40b3c00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9af40b2f60 tx=0x7f9af0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.299 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.291+0000 7f9af97ac700 1 --2- 172.21.15.150:0/2350496582 >> v2:172.21.15.150:3300/0 conn(0x7f9af4152580 0x7f9af40b3c00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9af40b2f60 tx=0x7f9af0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.299 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.291+0000 7f9af97ac700 1 --2- 172.21.15.150:0/2350496582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9af4152580 0x7f9af40b3c00 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f9af40b2f60 tx=0x7f9af0007e60).ready entity=mon.1 client_cookie=f3d29444bcc1f72f server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:47:58.299 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.291+0000 7f9af97ac700 1 --2- 172.21.15.150:0/2350496582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9af4152580 0x7f9af40b3c00 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f9af40b2f60 tx=0x7f9af0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.300 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.291+0000 7f9aebfff700 1 -- 172.21.15.150:0/2350496582 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9af00113f0 con 0x7f9af4152580 2020-06-12T17:47:58.300 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.291+0000 7f9af97ac700 1 --2- 172.21.15.150:0/2350496582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9af4152580 0x7f9af40b3c00 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f9af40b2f60 tx=0x7f9af0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.300 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.291+0000 7f9af97ac700 1 --2- 172.21.15.150:0/2350496582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9af4152580 0x7f9af40b3c00 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f9af40b2f60 tx=0x7f9af0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.301 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.291+0000 7f9aebfff700 1 -- 172.21.15.150:0/2350496582 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af0011550 con 0x7f9af4152580 2020-06-12T17:47:58.301 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.291+0000 7f9aebfff700 1 -- 172.21.15.150:0/2350496582 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9af0011930 con 0x7f9af4152580 2020-06-12T17:47:58.302 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.291+0000 7f9afb20f700 1 -- 172.21.15.150:0/2350496582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9af4152580 msgr2=0x7f9af40b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:58.302 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.291+0000 7f9afb20f700 1 --2- 172.21.15.150:0/2350496582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9af4152580 0x7f9af40b3c00 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f9af40b2f60 tx=0x7f9af0007e60).stop 2020-06-12T17:47:58.302 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.291+0000 7f9afb20f700 1 -- 172.21.15.150:0/2350496582 shutdown_connections 2020-06-12T17:47:58.302 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.291+0000 7f9afb20f700 1 --2- 172.21.15.150:0/2350496582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9af4152580 0x7f9af40b3c00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:58.303 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.291+0000 7f9afb20f700 1 --2- 172.21.15.150:0/2350496582 >> v2:172.21.15.38:3300/0 conn(0x7f9af40617a0 0x7f9af4061c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:47:58.303 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.291+0000 7f9afb20f700 1 -- 172.21.15.150:0/2350496582 >> 172.21.15.150:0/2350496582 conn(0x7f9af40b4cc0 msgr2=0x7f9af40b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:47:58.303 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.291+0000 7f9afb20f700 1 -- 172.21.15.150:0/2350496582 shutdown_connections 2020-06-12T17:47:58.303 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.291+0000 7f9afb20f700 1 -- 172.21.15.150:0/2350496582 wait complete. 2020-06-12T17:47:58.306 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.293+0000 7f9afb20f700 1 Processor -- start 2020-06-12T17:47:58.307 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.293+0000 7f9afb20f700 1 -- start start 2020-06-12T17:47:58.307 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.293+0000 7f9afb20f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9af40617a0 0x7f9af414f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:47:58.307 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.293+0000 7f9afb20f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9af4152580 0x7f9af41554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:47:58.307 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.293+0000 7f9afb20f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af406fff0 con 0x7f9af40b26b0 2020-06-12T17:47:58.308 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.293+0000 7f9afb20f700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af40b1530 con 0x7f9af40617a0 2020-06-12T17:47:58.308 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.293+0000 7f9afb20f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af40b17d0 con 0x7f9af4152580 2020-06-12T17:47:58.308 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.293+0000 7f9af9fad700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9af4152580 0x7f9af41554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:58.308 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.293+0000 7f9af8fab700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f9af40b26b0 0x7f9af4120fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:40384/0 (socket says 172.21.15.150:40384) 2020-06-12T17:47:58.308 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.293+0000 7f9af8fab700 1 -- 172.21.15.150:0/4018365151 learned_addr learned my addr 172.21.15.150:0/4018365151 (peer_addr_for_me v1:172.21.15.150:0/0) 2020-06-12T17:47:58.309 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.294+0000 7f9af97ac700 1 --2- 172.21.15.150:0/4018365151 >> v2:172.21.15.38:3300/0 conn(0x7f9af40617a0 0x7f9af414f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:58.309 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.294+0000 7f9ae9ffb700 1 -- 172.21.15.150:0/4018365151 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1339374018 0 0) 0x7f9af406fff0 con 0x7f9af40b26b0 2020-06-12T17:47:58.309 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.294+0000 7f9ae9ffb700 1 -- 172.21.15.150:0/4018365151 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ad4003230 con 0x7f9af40b26b0 2020-06-12T17:47:58.309 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.294+0000 7f9af9fad700 1 -- 172.21.15.150:0/4018365151 >> v2:172.21.15.38:3300/0 conn(0x7f9af40617a0 msgr2=0x7f9af414f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:58.309 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.294+0000 7f9af9fad700 1 --2- 172.21.15.150:0/4018365151 >> v2:172.21.15.38:3300/0 conn(0x7f9af40617a0 0x7f9af414f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:58.310 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.294+0000 7f9af9fad700 1 -- 172.21.15.150:0/4018365151 >> v1:172.21.15.150:6789/0 conn(0x7f9af40b26b0 legacy=0x7f9af4120fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:58.310 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.294+0000 7f9af9fad700 1 -- 172.21.15.150:0/4018365151 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af40b1a70 con 0x7f9af4152580 2020-06-12T17:47:58.310 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.294+0000 7f9af9fad700 1 --2- 172.21.15.150:0/4018365151 >> v2:172.21.15.150:3300/0 conn(0x7f9af4152580 0x7f9af41554d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9aec0032b0 tx=0x7f9aec00e390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.310 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.294+0000 7f9af9fad700 1 --2- 172.21.15.150:0/4018365151 >> v2:172.21.15.150:3300/0 conn(0x7f9af4152580 0x7f9af41554d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9aec0032b0 tx=0x7f9aec00e390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.310 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.294+0000 7f9af9fad700 1 --2- 172.21.15.150:0/4018365151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9af4152580 0x7f9af41554d0 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f9aec0032b0 tx=0x7f9aec00e390).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:47:58.311 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.294+0000 7f9af9fad700 1 --2- 172.21.15.150:0/4018365151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9af4152580 0x7f9af41554d0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f9aec0032b0 tx=0x7f9aec00e390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.311 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.294+0000 7f9af9fad700 1 --2- 172.21.15.150:0/4018365151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9af4152580 0x7f9af41554d0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f9aec0032b0 tx=0x7f9aec00e390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.311 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.294+0000 7f9ae9ffb700 1 -- 172.21.15.150:0/4018365151 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9aec005e20 con 0x7f9af4152580 2020-06-12T17:47:58.311 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.294+0000 7f9af9fad700 1 --2- 172.21.15.150:0/4018365151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9af4152580 0x7f9af41554d0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f9aec0032b0 tx=0x7f9aec00e390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.311 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.294+0000 7f9ae9ffb700 1 -- 172.21.15.150:0/4018365151 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aec0127c0 con 0x7f9af4152580 2020-06-12T17:47:58.312 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.294+0000 7f9afb20f700 1 -- 172.21.15.150:0/4018365151 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af4152960 con 0x7f9af4152580 2020-06-12T17:47:58.312 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.294+0000 7f9ae9ffb700 1 -- 172.21.15.150:0/4018365151 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9aec012b60 con 0x7f9af4152580 2020-06-12T17:47:58.312 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.294+0000 7f9afb20f700 1 -- 172.21.15.150:0/4018365151 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af40b8840 con 0x7f9af4152580 2020-06-12T17:47:58.312 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.294+0000 7f9af9fad700 1 --2- 172.21.15.150:0/4018365151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9af4152580 0x7f9af41554d0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f9aec0032b0 tx=0x7f9aec00e390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.312 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.295+0000 7f9ae9ffb700 1 -- 172.21.15.150:0/4018365151 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 2) v1 ==== 29658+0+0 (secure 0 0 0) 0x7f9aec010170 con 0x7f9af4152580 2020-06-12T17:47:58.313 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.295+0000 7f9af9fad700 1 --2- 172.21.15.150:0/4018365151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9af4152580 0x7f9af41554d0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f9aec0032b0 tx=0x7f9aec00e390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.313 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.295+0000 7f9ae9ffb700 1 -- 172.21.15.150:0/4018365151 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1729+0+0 (secure 0 0 0) 0x7f9aec034990 con 0x7f9af4152580 2020-06-12T17:47:58.313 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.295+0000 7f9afb20f700 1 -- 172.21.15.150:0/4018365151 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af4056c30 con 0x7f9af4152580 2020-06-12T17:47:58.313 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.297+0000 7f9af9fad700 1 --2- 172.21.15.150:0/4018365151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9af4152580 0x7f9af41554d0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f9aec0032b0 tx=0x7f9aec00e390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.313 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.297+0000 7f9ae9ffb700 1 -- 172.21.15.150:0/4018365151 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67700 (secure 0 0 0) 0x7f9aec0066c0 con 0x7f9af4152580 2020-06-12T17:47:58.385 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.381+0000 7f9afb20f700 1 -- 172.21.15.150:0/4018365151 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "69d6a7dc-a55a-4ebc-8479-8bb921ddfb65", "id": 5} v 0) v1 -- 0x7f9af405a5e0 con 0x7f9af4152580 2020-06-12T17:47:58.389 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.386+0000 7f9af9fad700 1 --2- 172.21.15.150:0/4018365151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9af4152580 0x7f9af41554d0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f9aec0032b0 tx=0x7f9aec00e390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.390 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.386+0000 7f9ae9ffb700 1 -- 172.21.15.150:0/4018365151 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "69d6a7dc-a55a-4ebc-8479-8bb921ddfb65", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9aec006070 con 0x7f9af4152580 2020-06-12T17:47:58.390 INFO:teuthology.orchestra.run.smithi150.stdout:5 2020-06-12T17:47:58.391 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.387+0000 7f9afb20f700 1 -- 172.21.15.150:0/4018365151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9af4152580 msgr2=0x7f9af41554d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:58.391 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.387+0000 7f9afb20f700 1 --2- 172.21.15.150:0/4018365151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9af4152580 0x7f9af41554d0 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f9aec0032b0 tx=0x7f9aec00e390).stop 2020-06-12T17:47:58.391 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.387+0000 7f9afb20f700 1 -- 172.21.15.150:0/4018365151 shutdown_connections 2020-06-12T17:47:58.392 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.387+0000 7f9afb20f700 1 --2- 172.21.15.150:0/4018365151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9af4152580 0x7f9af41554d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:58.392 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.387+0000 7f9afb20f700 1 --2- 172.21.15.150:0/4018365151 >> v2:172.21.15.38:3300/0 conn(0x7f9af40617a0 0x7f9af414f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:58.392 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.387+0000 7f9afb20f700 1 -- 172.21.15.150:0/4018365151 >> 172.21.15.150:0/4018365151 conn(0x7f9af40b4cc0 msgr2=0x7f9af4061b80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:47:58.392 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.387+0000 7f9afb20f700 1 -- 172.21.15.150:0/4018365151 shutdown_connections 2020-06-12T17:47:58.392 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.387+0000 7f9afb20f700 1 -- 172.21.15.150:0/4018365151 wait complete. 2020-06-12T17:47:58.400 INFO:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new f0d320f8-c2f0-40bb-b713-526246cf97b4 6 2020-06-12T17:47:58.507 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.501+0000 7f59c9d6e700 1 Processor -- start 2020-06-12T17:47:58.508 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.501+0000 7f59c9d6e700 1 -- start start 2020-06-12T17:47:58.508 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.502+0000 7f59c9d6e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 0x7f59c40b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:47:58.508 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.502+0000 7f59c9d6e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c405ab90 con 0x7f59c40617a0 2020-06-12T17:47:58.508 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.502+0000 7f59c9d6e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c40648b0 con 0x7f59c40b26b0 2020-06-12T17:47:58.508 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.502+0000 7f59c9d6e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4064b50 con 0x7f59c4152580 2020-06-12T17:47:58.509 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.502+0000 7f59c3fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 0x7f59c40b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:58.509 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.502+0000 7f59c37fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f59c40b26b0 0x7f59c40663f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:40388/0 (socket says 172.21.15.150:40388) 2020-06-12T17:47:58.509 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.502+0000 7f59c37fe700 1 -- 172.21.15.150:0/1314576068 learned_addr learned my addr 172.21.15.150:0/1314576068 (peer_addr_for_me v1:172.21.15.150:0/0) 2020-06-12T17:47:58.509 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.502+0000 7f59c2ffd700 1 -- 172.21.15.150:0/1314576068 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 272874231 0 0) 0x7f59c40648b0 con 0x7f59c40b26b0 2020-06-12T17:47:58.510 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.502+0000 7f59c3fff700 1 -- 172.21.15.150:0/1314576068 >> v1:172.21.15.150:6789/0 conn(0x7f59c40b26b0 legacy=0x7f59c40663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:58.510 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.502+0000 7f59c3fff700 1 -- 172.21.15.150:0/1314576068 >> v1:172.21.15.38:6789/0 conn(0x7f59c40617a0 legacy=0x7f59c4061bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:58.510 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.502+0000 7f59c3fff700 1 -- 172.21.15.150:0/1314576068 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c4064df0 con 0x7f59c4152580 2020-06-12T17:47:58.510 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.502+0000 7f59c3fff700 1 --2- 172.21.15.150:0/1314576068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 0x7f59c40b3c00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f59b4002f30 tx=0x7f59b4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.510 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.502+0000 7f59c3fff700 1 --2- 172.21.15.150:0/1314576068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 0x7f59c40b3c00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f59b4002f30 tx=0x7f59b4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.511 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.502+0000 7f59c3fff700 1 --2- 172.21.15.150:0/1314576068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 0x7f59c40b3c00 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7f59b4002f30 tx=0x7f59b4007e60).ready entity=mon.2 client_cookie=5b3e4715be62328d server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:47:58.511 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.502+0000 7f59c3fff700 1 --2- 172.21.15.150:0/1314576068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 0x7f59c40b3c00 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7f59b4002f30 tx=0x7f59b4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.511 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.502+0000 7f59c2ffd700 1 -- 172.21.15.150:0/1314576068 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59b4011470 con 0x7f59c4152580 2020-06-12T17:47:58.511 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.502+0000 7f59c3fff700 1 --2- 172.21.15.150:0/1314576068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 0x7f59c40b3c00 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7f59b4002f30 tx=0x7f59b4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.511 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.502+0000 7f59c2ffd700 1 -- 172.21.15.150:0/1314576068 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b40115d0 con 0x7f59c4152580 2020-06-12T17:47:58.511 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.502+0000 7f59c3fff700 1 --2- 172.21.15.150:0/1314576068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 0x7f59c40b3c00 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7f59b4002f30 tx=0x7f59b4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.512 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.502+0000 7f59c2ffd700 1 -- 172.21.15.150:0/1314576068 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59b40119f0 con 0x7f59c4152580 2020-06-12T17:47:58.512 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.502+0000 7f59c9d6e700 1 -- 172.21.15.150:0/1314576068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 msgr2=0x7f59c40b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:58.512 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.502+0000 7f59c9d6e700 1 --2- 172.21.15.150:0/1314576068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 0x7f59c40b3c00 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7f59b4002f30 tx=0x7f59b4007e60).stop 2020-06-12T17:47:58.512 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.503+0000 7f59c9d6e700 1 -- 172.21.15.150:0/1314576068 shutdown_connections 2020-06-12T17:47:58.512 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.503+0000 7f59c9d6e700 1 --2- 172.21.15.150:0/1314576068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 0x7f59c40b3c00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:58.513 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.503+0000 7f59c9d6e700 1 -- 172.21.15.150:0/1314576068 >> 172.21.15.150:0/1314576068 conn(0x7f59c40b4cc0 msgr2=0x7f59c40b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:47:58.513 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.503+0000 7f59c9d6e700 1 -- 172.21.15.150:0/1314576068 shutdown_connections 2020-06-12T17:47:58.513 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.503+0000 7f59c9d6e700 1 -- 172.21.15.150:0/1314576068 wait complete. 2020-06-12T17:47:58.516 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.504+0000 7f59c9d6e700 1 Processor -- start 2020-06-12T17:47:58.516 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.505+0000 7f59c9d6e700 1 -- start start 2020-06-12T17:47:58.517 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.505+0000 7f59c9d6e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f59c40617a0 0x7f59c412e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:47:58.517 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.505+0000 7f59c9d6e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 0x7f59c40b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:47:58.517 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.505+0000 7f59c9d6e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c40b7870 con 0x7f59c40b26b0 2020-06-12T17:47:58.517 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.505+0000 7f59c9d6e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c40b3c30 con 0x7f59c40617a0 2020-06-12T17:47:58.517 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.505+0000 7f59c9d6e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c413e5d0 con 0x7f59c4152580 2020-06-12T17:47:58.518 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.505+0000 7f59c8b0c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 0x7f59c40b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:58.518 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.505+0000 7f59c8b0c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 0x7f59c40b37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:41964/0 (socket says 172.21.15.150:41964) 2020-06-12T17:47:58.518 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.505+0000 7f59c8b0c700 1 -- 172.21.15.150:0/261526263 learned_addr learned my addr 172.21.15.150:0/261526263 (peer_addr_for_me v2:172.21.15.150:0/0) 2020-06-12T17:47:58.518 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.505+0000 7f59c3fff700 1 --2- 172.21.15.150:0/261526263 >> v2:172.21.15.38:3300/0 conn(0x7f59c40617a0 0x7f59c412e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:58.518 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.505+0000 7f59c8b0c700 1 -- 172.21.15.150:0/261526263 >> v2:172.21.15.38:3300/0 conn(0x7f59c40617a0 msgr2=0x7f59c412e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:58.518 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.505+0000 7f59c8b0c700 1 --2- 172.21.15.150:0/261526263 >> v2:172.21.15.38:3300/0 conn(0x7f59c40617a0 0x7f59c412e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:58.519 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.506+0000 7f59c8b0c700 1 -- 172.21.15.150:0/261526263 >> v1:172.21.15.38:6789/0 conn(0x7f59c40b26b0 legacy=0x7f59c40b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:58.519 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.506+0000 7f59c8b0c700 1 -- 172.21.15.150:0/261526263 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c40b75d0 con 0x7f59c4152580 2020-06-12T17:47:58.519 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.506+0000 7f59c8b0c700 1 --2- 172.21.15.150:0/261526263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 0x7f59c40b37d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f59c40b42e0 tx=0x7f59bc001b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.519 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.506+0000 7f59c8b0c700 1 --2- 172.21.15.150:0/261526263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 0x7f59c40b37d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f59c40b42e0 tx=0x7f59bc001b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.519 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.506+0000 7f59c8b0c700 1 --2- 172.21.15.150:0/261526263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 0x7f59c40b37d0 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f59c40b42e0 tx=0x7f59bc001b00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:47:58.520 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.506+0000 7f59c8b0c700 1 --2- 172.21.15.150:0/261526263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 0x7f59c40b37d0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f59c40b42e0 tx=0x7f59bc001b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.520 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.506+0000 7f59c8b0c700 1 --2- 172.21.15.150:0/261526263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 0x7f59c40b37d0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f59c40b42e0 tx=0x7f59bc001b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.520 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.506+0000 7f59c8b0c700 1 --2- 172.21.15.150:0/261526263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 0x7f59c40b37d0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f59c40b42e0 tx=0x7f59bc001b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.520 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.506+0000 7f59c0ff9700 1 -- 172.21.15.150:0/261526263 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59bc0122d0 con 0x7f59c4152580 2020-06-12T17:47:58.520 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.506+0000 7f59c0ff9700 1 -- 172.21.15.150:0/261526263 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59bc012430 con 0x7f59c4152580 2020-06-12T17:47:58.521 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.506+0000 7f59c9d6e700 1 -- 172.21.15.150:0/261526263 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c412fd40 con 0x7f59c4152580 2020-06-12T17:47:58.521 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.506+0000 7f59c0ff9700 1 -- 172.21.15.150:0/261526263 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59bc012810 con 0x7f59c4152580 2020-06-12T17:47:58.521 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.506+0000 7f59c9d6e700 1 -- 172.21.15.150:0/261526263 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c40b7290 con 0x7f59c4152580 2020-06-12T17:47:58.521 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.506+0000 7f59c8b0c700 1 --2- 172.21.15.150:0/261526263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 0x7f59c40b37d0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f59c40b42e0 tx=0x7f59bc001b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.521 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.507+0000 7f59c0ff9700 1 -- 172.21.15.150:0/261526263 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 2) v1 ==== 29658+0+0 (secure 0 0 0) 0x7f59bc012a80 con 0x7f59c4152580 2020-06-12T17:47:58.522 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.507+0000 7f59c8b0c700 1 --2- 172.21.15.150:0/261526263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 0x7f59c40b37d0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f59c40b42e0 tx=0x7f59bc001b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.522 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.507+0000 7f59c0ff9700 1 -- 172.21.15.150:0/261526263 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1844+0+0 (secure 0 0 0) 0x7f59bc034a60 con 0x7f59c4152580 2020-06-12T17:47:58.522 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.507+0000 7f59c9d6e700 1 -- 172.21.15.150:0/261526263 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c4056c30 con 0x7f59c4152580 2020-06-12T17:47:58.522 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.509+0000 7f59c8b0c700 1 --2- 172.21.15.150:0/261526263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 0x7f59c40b37d0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f59c40b42e0 tx=0x7f59bc001b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.522 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.509+0000 7f59c0ff9700 1 -- 172.21.15.150:0/261526263 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67700 (secure 0 0 0) 0x7f59bc012d10 con 0x7f59c4152580 2020-06-12T17:47:58.541 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.538+0000 7f59c8b0c700 1 --2- 172.21.15.150:0/261526263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 0x7f59c40b37d0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f59c40b42e0 tx=0x7f59bc001b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.542 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.539+0000 7f59c0ff9700 1 -- 172.21.15.150:0/261526263 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mgrmap(e 3) v1 ==== 59405+0+0 (secure 0 0 0) 0x7f59bc0091b0 con 0x7f59c4152580 2020-06-12T17:47:58.542 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.539+0000 7f59c0ff9700 1 --2- 172.21.15.150:0/261526263 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f59a404da10 0x7f59a404fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:47:58.543 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.540+0000 7f59c3fff700 1 --2- 172.21.15.150:0/261526263 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f59a404da10 0x7f59a404fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:58.544 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.540+0000 7f59c3fff700 1 --2- 172.21.15.150:0/261526263 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f59a404da10 0x7f59a404fe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f59b4002f30 tx=0x7f59b4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.544 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.540+0000 7f59c3fff700 1 --2- 172.21.15.150:0/261526263 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f59a404da10 0x7f59a404fe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f59b4002f30 tx=0x7f59b4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.544 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.540+0000 7f59c3fff700 1 --2- 172.21.15.150:0/261526263 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f59a404da10 0x7f59a404fe20 secure :-1 s=READY pgs=4 cs=0 l=1 rx=0x7f59b4002f30 tx=0x7f59b4007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:47:58.600 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.597+0000 7f59c9d6e700 1 -- 172.21.15.150:0/261526263 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f0d320f8-c2f0-40bb-b713-526246cf97b4", "id": 6} v 0) v1 -- 0x7f59c405a5e0 con 0x7f59c4152580 2020-06-12T17:47:58.606 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.603+0000 7f59c8b0c700 1 --2- 172.21.15.150:0/261526263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 0x7f59c40b37d0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f59c40b42e0 tx=0x7f59bc001b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.606 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.603+0000 7f59c0ff9700 1 -- 172.21.15.150:0/261526263 <== mon.2 v2:172.21.15.150:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f0d320f8-c2f0-40bb-b713-526246cf97b4", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f59bc03ee00 con 0x7f59c4152580 2020-06-12T17:47:58.607 INFO:teuthology.orchestra.run.smithi150.stdout:6 2020-06-12T17:47:58.608 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.604+0000 7f59c9d6e700 1 -- 172.21.15.150:0/261526263 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f59a404da10 msgr2=0x7f59a404fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:58.608 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.604+0000 7f59c9d6e700 1 --2- 172.21.15.150:0/261526263 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f59a404da10 0x7f59a404fe20 secure :-1 s=READY pgs=4 cs=0 l=1 rx=0x7f59b4002f30 tx=0x7f59b4007e60).stop 2020-06-12T17:47:58.608 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.604+0000 7f59c9d6e700 1 -- 172.21.15.150:0/261526263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 msgr2=0x7f59c40b37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:58.608 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.604+0000 7f59c9d6e700 1 --2- 172.21.15.150:0/261526263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 0x7f59c40b37d0 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f59c40b42e0 tx=0x7f59bc001b00).stop 2020-06-12T17:47:58.609 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.604+0000 7f59c9d6e700 1 -- 172.21.15.150:0/261526263 shutdown_connections 2020-06-12T17:47:58.609 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.604+0000 7f59c9d6e700 1 --2- 172.21.15.150:0/261526263 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f59a404da10 0x7f59a404fe20 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:58.609 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.604+0000 7f59c9d6e700 1 --2- 172.21.15.150:0/261526263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59c4152580 0x7f59c40b37d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:58.609 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.604+0000 7f59c9d6e700 1 --2- 172.21.15.150:0/261526263 >> v2:172.21.15.38:3300/0 conn(0x7f59c40617a0 0x7f59c412e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:58.609 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.604+0000 7f59c9d6e700 1 -- 172.21.15.150:0/261526263 >> 172.21.15.150:0/261526263 conn(0x7f59c40b4cc0 msgr2=0x7f59c4131850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:47:58.610 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.604+0000 7f59c9d6e700 1 -- 172.21.15.150:0/261526263 shutdown_connections 2020-06-12T17:47:58.610 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.604+0000 7f59c9d6e700 1 -- 172.21.15.150:0/261526263 wait complete. 2020-06-12T17:47:58.617 INFO:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 970b7d02-a189-41b2-96e5-a5a5a57c6476 7 2020-06-12T17:47:58.726 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.718+0000 7f9c21f15700 1 Processor -- start 2020-06-12T17:47:58.726 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.718+0000 7f9c21f15700 1 -- start start 2020-06-12T17:47:58.726 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.719+0000 7f9c21f15700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9c1c0b26b0 0x7f9c1c0b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:47:58.726 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.719+0000 7f9c21f15700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c1c05ab90 con 0x7f9c1c152580 2020-06-12T17:47:58.727 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.719+0000 7f9c21f15700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c1c0648b0 con 0x7f9c1c0617a0 2020-06-12T17:47:58.727 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.719+0000 7f9c21f15700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c1c064b50 con 0x7f9c1c0b26b0 2020-06-12T17:47:58.727 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.719+0000 7f9c20cb3700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f9c1c0617a0 0x7f9c1c061c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:40414/0 (socket says 172.21.15.150:40414) 2020-06-12T17:47:58.727 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.719+0000 7f9c20cb3700 1 -- 172.21.15.150:0/2848291885 learned_addr learned my addr 172.21.15.150:0/2848291885 (peer_addr_for_me v1:172.21.15.150:0/0) 2020-06-12T17:47:58.727 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.719+0000 7f9c13fff700 1 --2- 172.21.15.150:0/2848291885 >> v2:172.21.15.38:3300/0 conn(0x7f9c1c0b26b0 0x7f9c1c0b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:58.728 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.719+0000 7f9c1b7fe700 1 -- 172.21.15.150:0/2848291885 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3977677253 0 0) 0x7f9c1c0648b0 con 0x7f9c1c0617a0 2020-06-12T17:47:58.728 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.719+0000 7f9c1b7fe700 1 -- 172.21.15.150:0/2848291885 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c08003230 con 0x7f9c1c0617a0 2020-06-12T17:47:58.728 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1b7fe700 1 -- 172.21.15.150:0/2848291885 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 636253682 0 0) 0x7f9c08003230 con 0x7f9c1c0617a0 2020-06-12T17:47:58.728 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1b7fe700 1 -- 172.21.15.150:0/2848291885 >> v2:172.21.15.38:3300/0 conn(0x7f9c1c0b26b0 msgr2=0x7f9c1c0b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:47:58.728 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1b7fe700 1 --2- 172.21.15.150:0/2848291885 >> v2:172.21.15.38:3300/0 conn(0x7f9c1c0b26b0 0x7f9c1c0b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:47:58.729 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1b7fe700 1 -- 172.21.15.150:0/2848291885 >> v1:172.21.15.38:6789/0 conn(0x7f9c1c152580 legacy=0x7f9c1c0663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:58.729 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1b7fe700 1 -- 172.21.15.150:0/2848291885 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1c064df0 con 0x7f9c1c0617a0 2020-06-12T17:47:58.729 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1b7fe700 1 -- 172.21.15.150:0/2848291885 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f9c14001a50 con 0x7f9c1c0617a0 2020-06-12T17:47:58.729 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1b7fe700 1 -- 172.21.15.150:0/2848291885 >> v1:172.21.15.150:6789/0 conn(0x7f9c1c0617a0 legacy=0x7f9c1c061c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:58.729 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1b7fe700 1 --2- 172.21.15.150:0/2848291885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c08003720 0x7f9c08003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:47:58.730 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1b7fe700 1 --2- 172.21.15.150:0/2848291885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c08004020 0x7f9c080044f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:47:58.730 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1b7fe700 1 --2- 172.21.15.150:0/2848291885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c08004a60 0x7f9c08004f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:47:58.730 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1b7fe700 1 -- 172.21.15.150:0/2848291885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c064b50 con 0x7f9c08004020 2020-06-12T17:47:58.730 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1b7fe700 1 -- 172.21.15.150:0/2848291885 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0804f840 con 0x7f9c08004a60 2020-06-12T17:47:58.730 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1b7fe700 1 -- 172.21.15.150:0/2848291885 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0804fa00 con 0x7f9c08003720 2020-06-12T17:47:58.731 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c20cb3700 1 --2- 172.21.15.150:0/2848291885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c08004a60 0x7f9c08004f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:58.731 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1bfff700 1 --2- 172.21.15.150:0/2848291885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c08003720 0x7f9c08003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:58.731 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c13fff700 1 --2- 172.21.15.150:0/2848291885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c08004020 0x7f9c080044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:58.731 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1bfff700 1 -- 172.21.15.150:0/2848291885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c08004a60 msgr2=0x7f9c08004f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:47:58.731 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1bfff700 1 --2- 172.21.15.150:0/2848291885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c08004a60 0x7f9c08004f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:47:58.732 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1bfff700 1 -- 172.21.15.150:0/2848291885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c08004020 msgr2=0x7f9c080044f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:47:58.732 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1bfff700 1 --2- 172.21.15.150:0/2848291885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c08004020 0x7f9c080044f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:47:58.732 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1bfff700 1 -- 172.21.15.150:0/2848291885 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c08003230 con 0x7f9c08003720 2020-06-12T17:47:58.732 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c20cb3700 1 --2- 172.21.15.150:0/2848291885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c08004a60 0x7f9c08004f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:47:58.732 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c20cb3700 1 -- 172.21.15.150:0/2848291885 reap_dead start 2020-06-12T17:47:58.732 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1bfff700 1 --2- 172.21.15.150:0/2848291885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c08003720 0x7f9c08003b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9c0c000fe0 tx=0x7f9c0c0018e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.733 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1bfff700 1 --2- 172.21.15.150:0/2848291885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c08003720 0x7f9c08003b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9c0c000fe0 tx=0x7f9c0c0018e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.733 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1bfff700 1 --2- 172.21.15.150:0/2848291885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c08003720 0x7f9c08003b00 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7f9c0c000fe0 tx=0x7f9c0c0018e0).ready entity=mon.2 client_cookie=f13e543b212253a5 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:47:58.733 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1bfff700 1 --2- 172.21.15.150:0/2848291885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c08003720 0x7f9c08003b00 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f9c0c000fe0 tx=0x7f9c0c0018e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.733 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1b7fe700 1 -- 172.21.15.150:0/2848291885 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c0c003540 con 0x7f9c08003720 2020-06-12T17:47:58.733 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1bfff700 1 --2- 172.21.15.150:0/2848291885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c08003720 0x7f9c08003b00 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f9c0c000fe0 tx=0x7f9c0c0018e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.734 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1b7fe700 1 -- 172.21.15.150:0/2848291885 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0c0036a0 con 0x7f9c08003720 2020-06-12T17:47:58.734 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1bfff700 1 --2- 172.21.15.150:0/2848291885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c08003720 0x7f9c08003b00 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f9c0c000fe0 tx=0x7f9c0c0018e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.734 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c1b7fe700 1 -- 172.21.15.150:0/2848291885 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c0c003a80 con 0x7f9c08003720 2020-06-12T17:47:58.734 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c21f15700 1 -- 172.21.15.150:0/2848291885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c08003720 msgr2=0x7f9c08003b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:58.734 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.720+0000 7f9c21f15700 1 --2- 172.21.15.150:0/2848291885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c08003720 0x7f9c08003b00 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7f9c0c000fe0 tx=0x7f9c0c0018e0).stop 2020-06-12T17:47:58.735 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.721+0000 7f9c21f15700 1 -- 172.21.15.150:0/2848291885 shutdown_connections 2020-06-12T17:47:58.735 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.721+0000 7f9c21f15700 1 --2- 172.21.15.150:0/2848291885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c08003720 0x7f9c08003b00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:58.735 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.721+0000 7f9c21f15700 1 -- 172.21.15.150:0/2848291885 >> 172.21.15.150:0/2848291885 conn(0x7f9c1c0b4cc0 msgr2=0x7f9c1c0b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:47:58.735 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.721+0000 7f9c21f15700 1 -- 172.21.15.150:0/2848291885 shutdown_connections 2020-06-12T17:47:58.735 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.721+0000 7f9c21f15700 1 -- 172.21.15.150:0/2848291885 wait complete. 2020-06-12T17:47:58.736 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.722+0000 7f9c21f15700 1 Processor -- start 2020-06-12T17:47:58.736 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.722+0000 7f9c21f15700 1 -- start start 2020-06-12T17:47:58.739 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.723+0000 7f9c21f15700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9c08003720 0x7f9c1c0b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:47:58.739 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.723+0000 7f9c21f15700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9c1c0b2fa0 0x7f9c1c0b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:47:58.740 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.723+0000 7f9c21f15700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c1c0b12a0 con 0x7f9c1c128cb0 2020-06-12T17:47:58.740 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.723+0000 7f9c21f15700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c1c13c150 con 0x7f9c08003720 2020-06-12T17:47:58.740 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.723+0000 7f9c21f15700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c1c1405b0 con 0x7f9c1c0b2fa0 2020-06-12T17:47:58.740 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.723+0000 7f9c13fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9c1c0b2fa0 0x7f9c1c0b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:58.740 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.723+0000 7f9c13fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9c1c0b2fa0 0x7f9c1c0b3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:49048/0 (socket says 172.21.15.150:49048) 2020-06-12T17:47:58.741 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.723+0000 7f9c20cb3700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f9c1c128cb0 0x7f9c1c129100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:40428/0 (socket says 172.21.15.150:40428) 2020-06-12T17:47:58.741 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.723+0000 7f9c13fff700 1 -- 172.21.15.150:0/342018950 learned_addr learned my addr 172.21.15.150:0/342018950 (peer_addr_for_me v2:172.21.15.150:0/0) 2020-06-12T17:47:58.741 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.723+0000 7f9c1bfff700 1 --2- 172.21.15.150:0/342018950 >> v2:172.21.15.38:3300/0 conn(0x7f9c08003720 0x7f9c1c0b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:58.741 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.723+0000 7f9c13fff700 1 -- 172.21.15.150:0/342018950 >> v2:172.21.15.38:3300/0 conn(0x7f9c08003720 msgr2=0x7f9c1c0b0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:58.741 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.723+0000 7f9c197fa700 1 -- 172.21.15.150:0/342018950 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886680599 0 0) 0x7f9c1c0b12a0 con 0x7f9c1c128cb0 2020-06-12T17:47:58.742 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.723+0000 7f9c13fff700 1 --2- 172.21.15.150:0/342018950 >> v2:172.21.15.38:3300/0 conn(0x7f9c08003720 0x7f9c1c0b0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:58.742 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.723+0000 7f9c13fff700 1 -- 172.21.15.150:0/342018950 >> v1:172.21.15.150:6789/0 conn(0x7f9c1c128cb0 legacy=0x7f9c1c129100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:58.742 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.723+0000 7f9c13fff700 1 -- 172.21.15.150:0/342018950 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1c128810 con 0x7f9c1c0b2fa0 2020-06-12T17:47:58.742 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.723+0000 7f9c13fff700 1 --2- 172.21.15.150:0/342018950 >> v2:172.21.15.150:3300/0 conn(0x7f9c1c0b2fa0 0x7f9c1c0b3420 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9c04002f30 tx=0x7f9c04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.742 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.723+0000 7f9c13fff700 1 --2- 172.21.15.150:0/342018950 >> v2:172.21.15.150:3300/0 conn(0x7f9c1c0b2fa0 0x7f9c1c0b3420 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9c04002f30 tx=0x7f9c04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.743 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.723+0000 7f9c13fff700 1 --2- 172.21.15.150:0/342018950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c1c0b2fa0 0x7f9c1c0b3420 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f9c04002f30 tx=0x7f9c04007e60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:47:58.743 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.723+0000 7f9c13fff700 1 --2- 172.21.15.150:0/342018950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c1c0b2fa0 0x7f9c1c0b3420 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f9c04002f30 tx=0x7f9c04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.743 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.723+0000 7f9c197fa700 1 -- 172.21.15.150:0/342018950 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c04005e90 con 0x7f9c1c0b2fa0 2020-06-12T17:47:58.743 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.723+0000 7f9c13fff700 1 --2- 172.21.15.150:0/342018950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c1c0b2fa0 0x7f9c1c0b3420 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f9c04002f30 tx=0x7f9c04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.743 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.723+0000 7f9c13fff700 1 --2- 172.21.15.150:0/342018950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c1c0b2fa0 0x7f9c1c0b3420 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f9c04002f30 tx=0x7f9c04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.744 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.723+0000 7f9c197fa700 1 -- 172.21.15.150:0/342018950 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c04007160 con 0x7f9c1c0b2fa0 2020-06-12T17:47:58.744 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.723+0000 7f9c21f15700 1 -- 172.21.15.150:0/342018950 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c1c0aec10 con 0x7f9c1c0b2fa0 2020-06-12T17:47:58.744 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.723+0000 7f9c197fa700 1 -- 172.21.15.150:0/342018950 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c04007540 con 0x7f9c1c0b2fa0 2020-06-12T17:47:58.744 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.723+0000 7f9c21f15700 1 -- 172.21.15.150:0/342018950 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c1c0af070 con 0x7f9c1c0b2fa0 2020-06-12T17:47:58.744 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.724+0000 7f9c13fff700 1 --2- 172.21.15.150:0/342018950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c1c0b2fa0 0x7f9c1c0b3420 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f9c04002f30 tx=0x7f9c04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.745 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.724+0000 7f9c13fff700 1 --2- 172.21.15.150:0/342018950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c1c0b2fa0 0x7f9c1c0b3420 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f9c04002f30 tx=0x7f9c04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.745 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.724+0000 7f9c197fa700 1 -- 172.21.15.150:0/342018950 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 3) v1 ==== 59405+0+0 (secure 0 0 0) 0x7f9c04008410 con 0x7f9c1c0b2fa0 2020-06-12T17:47:58.745 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.724+0000 7f9c21f15700 1 -- 172.21.15.150:0/342018950 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c1c140720 con 0x7f9c1c0b2fa0 2020-06-12T17:47:58.745 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.725+0000 7f9c197fa700 1 --2- 172.21.15.150:0/342018950 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9c0004d410 0x7f9c0004f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:47:58.745 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.725+0000 7f9c197fa700 1 -- 172.21.15.150:0/342018950 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1959+0+0 (secure 0 0 0) 0x7f9c04060bb0 con 0x7f9c1c0b2fa0 2020-06-12T17:47:58.745 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.725+0000 7f9c1bfff700 1 --2- 172.21.15.150:0/342018950 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9c0004d410 0x7f9c0004f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:58.746 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.725+0000 7f9c1bfff700 1 --2- 172.21.15.150:0/342018950 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9c0004d410 0x7f9c0004f8d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9c0c000fe0 tx=0x7f9c0c0018e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.746 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.725+0000 7f9c1bfff700 1 --2- 172.21.15.150:0/342018950 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9c0004d410 0x7f9c0004f8d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9c0c000fe0 tx=0x7f9c0c0018e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.746 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.725+0000 7f9c1bfff700 1 --2- 172.21.15.150:0/342018950 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9c0004d410 0x7f9c0004f8d0 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f9c0c000fe0 tx=0x7f9c0c0018e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:47:58.746 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.728+0000 7f9c13fff700 1 --2- 172.21.15.150:0/342018950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c1c0b2fa0 0x7f9c1c0b3420 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f9c04002f30 tx=0x7f9c04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.746 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.728+0000 7f9c197fa700 1 -- 172.21.15.150:0/342018950 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f9c1c140720 con 0x7f9c1c0b2fa0 2020-06-12T17:47:58.887 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.883+0000 7f9c21f15700 1 -- 172.21.15.150:0/342018950 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "970b7d02-a189-41b2-96e5-a5a5a57c6476", "id": 7} v 0) v1 -- 0x7f9c1c1406f0 con 0x7f9c1c0b2fa0 2020-06-12T17:47:58.893 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.889+0000 7f9c13fff700 1 --2- 172.21.15.150:0/342018950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c1c0b2fa0 0x7f9c1c0b3420 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f9c04002f30 tx=0x7f9c04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:58.893 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.889+0000 7f9c197fa700 1 -- 172.21.15.150:0/342018950 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "970b7d02-a189-41b2-96e5-a5a5a57c6476", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9c0403c3f0 con 0x7f9c1c0b2fa0 2020-06-12T17:47:58.893 INFO:teuthology.orchestra.run.smithi150.stdout:7 2020-06-12T17:47:58.895 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.892+0000 7f9c21f15700 1 -- 172.21.15.150:0/342018950 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9c0004d410 msgr2=0x7f9c0004f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:58.896 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.892+0000 7f9c21f15700 1 --2- 172.21.15.150:0/342018950 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9c0004d410 0x7f9c0004f8d0 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f9c0c000fe0 tx=0x7f9c0c0018e0).stop 2020-06-12T17:47:58.896 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.892+0000 7f9c21f15700 1 -- 172.21.15.150:0/342018950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c1c0b2fa0 msgr2=0x7f9c1c0b3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:58.896 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.892+0000 7f9c21f15700 1 --2- 172.21.15.150:0/342018950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c1c0b2fa0 0x7f9c1c0b3420 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f9c04002f30 tx=0x7f9c04007e60).stop 2020-06-12T17:47:58.896 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.892+0000 7f9c21f15700 1 -- 172.21.15.150:0/342018950 shutdown_connections 2020-06-12T17:47:58.896 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.892+0000 7f9c21f15700 1 --2- 172.21.15.150:0/342018950 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9c0004d410 0x7f9c0004f8d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:58.897 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.892+0000 7f9c21f15700 1 --2- 172.21.15.150:0/342018950 >> v2:172.21.15.38:3300/0 conn(0x7f9c08003720 0x7f9c1c0b0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:58.897 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.892+0000 7f9c21f15700 1 --2- 172.21.15.150:0/342018950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c1c0b2fa0 0x7f9c1c0b3420 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:58.897 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.892+0000 7f9c21f15700 1 -- 172.21.15.150:0/342018950 >> 172.21.15.150:0/342018950 conn(0x7f9c1c0b4cc0 msgr2=0x7f9c1c064ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:47:58.897 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.892+0000 7f9c21f15700 1 -- 172.21.15.150:0/342018950 shutdown_connections 2020-06-12T17:47:58.897 INFO:teuthology.orchestra.run.smithi150.stderr:2020-06-12T17:47:58.892+0000 7f9c21f15700 1 -- 172.21.15.150:0/342018950 wait complete. 2020-06-12T17:47:58.905 INFO:tasks.ceph.osd.0:Restarting daemon 2020-06-12T17:47:58.905 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-06-12T17:47:58.908 INFO:tasks.ceph.osd.0:Started 2020-06-12T17:47:58.908 INFO:tasks.ceph.osd.1:Restarting daemon 2020-06-12T17:47:58.909 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-06-12T17:47:58.911 INFO:tasks.ceph.osd.1:Started 2020-06-12T17:47:58.911 INFO:tasks.ceph.osd.2:Restarting daemon 2020-06-12T17:47:58.912 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-06-12T17:47:58.914 INFO:tasks.ceph.osd.2:Started 2020-06-12T17:47:58.914 INFO:tasks.ceph.osd.3:Restarting daemon 2020-06-12T17:47:58.915 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-06-12T17:47:58.917 INFO:tasks.ceph.osd.3:Started 2020-06-12T17:47:58.917 INFO:tasks.ceph.osd.4:Restarting daemon 2020-06-12T17:47:58.918 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-06-12T17:47:58.920 INFO:tasks.ceph.osd.4:Started 2020-06-12T17:47:58.920 INFO:tasks.ceph.osd.5:Restarting daemon 2020-06-12T17:47:58.921 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-06-12T17:47:58.922 INFO:tasks.ceph.osd.5:Started 2020-06-12T17:47:58.923 INFO:tasks.ceph.osd.6:Restarting daemon 2020-06-12T17:47:58.923 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-06-12T17:47:58.925 INFO:tasks.ceph.osd.6:Started 2020-06-12T17:47:58.925 INFO:tasks.ceph.osd.7:Restarting daemon 2020-06-12T17:47:58.926 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-06-12T17:47:58.927 INFO:tasks.ceph.osd.7:Started 2020-06-12T17:47:58.928 INFO:tasks.ceph:Waiting for OSDs to come up 2020-06-12T17:47:59.514 INFO:tasks.ceph.osd.4.smithi150.stderr:2020-06-12T17:47:59.510+0000 7fb286810ec0 -1 Falling back to public interface 2020-06-12T17:47:59.521 INFO:tasks.ceph.osd.7.smithi150.stderr:2020-06-12T17:47:59.518+0000 7f11241a5ec0 -1 Falling back to public interface 2020-06-12T17:47:59.522 INFO:tasks.ceph.osd.5.smithi150.stderr:2020-06-12T17:47:59.518+0000 7f5604296ec0 -1 Falling back to public interface 2020-06-12T17:47:59.523 INFO:tasks.ceph.osd.6.smithi150.stderr:2020-06-12T17:47:59.520+0000 7f5e5afefec0 -1 Falling back to public interface 2020-06-12T17:47:59.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2020-06-12T17:47:59.522+0000 7f4354cd8ec0 -1 Falling back to public interface 2020-06-12T17:47:59.537 INFO:tasks.ceph.osd.3.smithi038.stderr:2020-06-12T17:47:59.533+0000 7f924d88fec0 -1 Falling back to public interface 2020-06-12T17:47:59.540 INFO:tasks.ceph.osd.0.smithi038.stderr:2020-06-12T17:47:59.536+0000 7fd327b51ec0 -1 Falling back to public interface 2020-06-12T17:47:59.551 INFO:tasks.ceph.osd.2.smithi038.stderr:2020-06-12T17:47:59.548+0000 7fbc1ddfcec0 -1 Falling back to public interface 2020-06-12T17:47:59.740 INFO:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-06-12T17:47:59.858 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.851+0000 7f3085016700 1 Processor -- start 2020-06-12T17:47:59.859 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.851+0000 7f3085016700 1 -- start start 2020-06-12T17:47:59.859 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.851+0000 7f3085016700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3080060e30 0x7f30800b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:47:59.859 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.851+0000 7f3085016700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3080153600 con 0x7f308005b740 2020-06-12T17:47:59.860 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.851+0000 7f3085016700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30801538a0 con 0x7f308005abc0 2020-06-12T17:47:59.860 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.851+0000 7f3085016700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3080153b40 con 0x7f3080060e30 2020-06-12T17:47:59.860 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.852+0000 7f3084815700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f308005b740 0x7f3080152310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:36796/0 (socket says 172.21.15.38:36796) 2020-06-12T17:47:59.860 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.852+0000 7f3084815700 1 -- 172.21.15.38:0/2349310694 learned_addr learned my addr 172.21.15.38:0/2349310694 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:47:59.860 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.852+0000 7f307f59e700 1 --2- 172.21.15.38:0/2349310694 >> v2:172.21.15.150:3300/0 conn(0x7f3080060e30 0x7f30800b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:59.861 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.852+0000 7f307e59c700 1 -- 172.21.15.38:0/2349310694 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751036458 0 0) 0x7f3080153600 con 0x7f308005b740 2020-06-12T17:47:59.861 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.852+0000 7f307e59c700 1 -- 172.21.15.38:0/2349310694 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3068003230 con 0x7f308005b740 2020-06-12T17:47:59.861 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.852+0000 7f307e59c700 1 -- 172.21.15.38:0/2349310694 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 792345284 0 0) 0x7f30801538a0 con 0x7f308005abc0 2020-06-12T17:47:59.861 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.852+0000 7f307e59c700 1 -- 172.21.15.38:0/2349310694 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3080153600 con 0x7f308005abc0 2020-06-12T17:47:59.861 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.852+0000 7f307f59e700 1 -- 172.21.15.38:0/2349310694 >> v1:172.21.15.150:6789/0 conn(0x7f308005abc0 legacy=0x7f308005b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:59.862 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.852+0000 7f307f59e700 1 -- 172.21.15.38:0/2349310694 >> v1:172.21.15.38:6789/0 conn(0x7f308005b740 legacy=0x7f3080152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:59.862 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.852+0000 7f307f59e700 1 -- 172.21.15.38:0/2349310694 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3080061210 con 0x7f3080060e30 2020-06-12T17:47:59.862 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.852+0000 7f307f59e700 1 --2- 172.21.15.38:0/2349310694 >> v2:172.21.15.150:3300/0 conn(0x7f3080060e30 0x7f30800b44e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3070002f30 tx=0x7f3070007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:59.862 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.852+0000 7f307f59e700 1 --2- 172.21.15.38:0/2349310694 >> v2:172.21.15.150:3300/0 conn(0x7f3080060e30 0x7f30800b44e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3070002f30 tx=0x7f3070007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:59.863 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.852+0000 7f307f59e700 1 --2- 172.21.15.38:0/2349310694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3080060e30 0x7f30800b44e0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f3070002f30 tx=0x7f3070007e60).ready entity=mon.1 client_cookie=45f0df7379fa003a server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:47:59.863 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.852+0000 7f307f59e700 1 --2- 172.21.15.38:0/2349310694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3080060e30 0x7f30800b44e0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f3070002f30 tx=0x7f3070007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:59.863 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.852+0000 7f307e59c700 1 -- 172.21.15.38:0/2349310694 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30700114c0 con 0x7f3080060e30 2020-06-12T17:47:59.863 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.852+0000 7f307f59e700 1 --2- 172.21.15.38:0/2349310694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3080060e30 0x7f30800b44e0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f3070002f30 tx=0x7f3070007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:59.863 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.853+0000 7f307f59e700 1 --2- 172.21.15.38:0/2349310694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3080060e30 0x7f30800b44e0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f3070002f30 tx=0x7f3070007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:59.864 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.853+0000 7f307e59c700 1 -- 172.21.15.38:0/2349310694 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3070011620 con 0x7f3080060e30 2020-06-12T17:47:59.864 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.853+0000 7f307e59c700 1 -- 172.21.15.38:0/2349310694 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3070011980 con 0x7f3080060e30 2020-06-12T17:47:59.864 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.853+0000 7f3085016700 1 -- 172.21.15.38:0/2349310694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3080060e30 msgr2=0x7f30800b44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:59.864 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.853+0000 7f3085016700 1 --2- 172.21.15.38:0/2349310694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3080060e30 0x7f30800b44e0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f3070002f30 tx=0x7f3070007e60).stop 2020-06-12T17:47:59.864 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.853+0000 7f3085016700 1 -- 172.21.15.38:0/2349310694 shutdown_connections 2020-06-12T17:47:59.865 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.853+0000 7f3085016700 1 --2- 172.21.15.38:0/2349310694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3080060e30 0x7f30800b44e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:59.865 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.853+0000 7f3085016700 1 -- 172.21.15.38:0/2349310694 >> 172.21.15.38:0/2349310694 conn(0x7f30800b8280 msgr2=0x7f30800b8690 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:47:59.865 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.853+0000 7f3085016700 1 -- 172.21.15.38:0/2349310694 shutdown_connections 2020-06-12T17:47:59.865 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.853+0000 7f3085016700 1 -- 172.21.15.38:0/2349310694 wait complete. 2020-06-12T17:47:59.865 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.855+0000 7f3085016700 1 Processor -- start 2020-06-12T17:47:59.866 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.855+0000 7f3085016700 1 -- start start 2020-06-12T17:47:59.868 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.856+0000 7f3085016700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f308005abc0 0x7f3080152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:47:59.869 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.856+0000 7f3085016700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3080060e30 0x7f308012b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:47:59.869 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.856+0000 7f3085016700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30801528c0 con 0x7f308005b740 2020-06-12T17:47:59.869 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.856+0000 7f3085016700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30800b0850 con 0x7f308005abc0 2020-06-12T17:47:59.869 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.856+0000 7f3085016700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30801568e0 con 0x7f3080060e30 2020-06-12T17:47:59.870 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.856+0000 7f3084815700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3080060e30 0x7f308012b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:59.870 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.856+0000 7f307f59e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f308005abc0 0x7f3080152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:59.870 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.856+0000 7f3084815700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3080060e30 0x7f308012b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:54442/0 (socket says 172.21.15.38:54442) 2020-06-12T17:47:59.870 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.856+0000 7f3084815700 1 -- 172.21.15.38:0/2931092864 learned_addr learned my addr 172.21.15.38:0/2931092864 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:47:59.870 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.856+0000 7f307ed9d700 1 --1- 172.21.15.38:0/2931092864 >> v1:172.21.15.38:6789/0 conn(0x7f308005b740 0x7f3080156040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:36802/0 (socket says 172.21.15.38:36802) 2020-06-12T17:47:59.871 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.856+0000 7f307f59e700 1 -- 172.21.15.38:0/2931092864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3080060e30 msgr2=0x7f308012b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:59.871 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.856+0000 7f3067fff700 1 -- 172.21.15.38:0/2931092864 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1617637003 0 0) 0x7f3080153600 con 0x7f308005b740 2020-06-12T17:47:59.871 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.856+0000 7f307f59e700 1 --2- 172.21.15.38:0/2931092864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3080060e30 0x7f308012b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:47:59.871 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.856+0000 7f307f59e700 1 -- 172.21.15.38:0/2931092864 >> v1:172.21.15.38:6789/0 conn(0x7f308005b740 legacy=0x7f3080156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:47:59.871 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.856+0000 7f307f59e700 1 -- 172.21.15.38:0/2931092864 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3080156b80 con 0x7f308005abc0 2020-06-12T17:47:59.872 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.856+0000 7f3084815700 1 --2- 172.21.15.38:0/2931092864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3080060e30 0x7f308012b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:47:59.872 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.856+0000 7f307f59e700 1 --2- 172.21.15.38:0/2931092864 >> v2:172.21.15.38:3300/0 conn(0x7f308005abc0 0x7f3080152460 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3070002f30 tx=0x7f3070007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:59.872 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.856+0000 7f307f59e700 1 --2- 172.21.15.38:0/2931092864 >> v2:172.21.15.38:3300/0 conn(0x7f308005abc0 0x7f3080152460 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3070002f30 tx=0x7f3070007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:59.872 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.856+0000 7f307f59e700 1 --2- 172.21.15.38:0/2931092864 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f308005abc0 0x7f3080152460 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f3070002f30 tx=0x7f3070007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:47:59.873 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.857+0000 7f307f59e700 1 --2- 172.21.15.38:0/2931092864 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f308005abc0 0x7f3080152460 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f3070002f30 tx=0x7f3070007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:59.873 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.857+0000 7f307f59e700 1 --2- 172.21.15.38:0/2931092864 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f308005abc0 0x7f3080152460 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f3070002f30 tx=0x7f3070007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:59.873 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.857+0000 7f3067fff700 1 -- 172.21.15.38:0/2931092864 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3070011850 con 0x7f308005abc0 2020-06-12T17:47:59.873 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.857+0000 7f307f59e700 1 --2- 172.21.15.38:0/2931092864 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f308005abc0 0x7f3080152460 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f3070002f30 tx=0x7f3070007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:59.873 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.857+0000 7f3067fff700 1 -- 172.21.15.38:0/2931092864 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30700119b0 con 0x7f308005abc0 2020-06-12T17:47:59.874 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.857+0000 7f3085016700 1 -- 172.21.15.38:0/2931092864 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3080156e20 con 0x7f308005abc0 2020-06-12T17:47:59.874 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.857+0000 7f3085016700 1 -- 172.21.15.38:0/2931092864 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3080122ed0 con 0x7f308005abc0 2020-06-12T17:47:59.879 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.857+0000 7f3067fff700 1 -- 172.21.15.38:0/2931092864 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3070007340 con 0x7f308005abc0 2020-06-12T17:47:59.880 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.858+0000 7f3085016700 1 -- 172.21.15.38:0/2931092864 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3080056c30 con 0x7f308005abc0 2020-06-12T17:47:59.880 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.859+0000 7f307f59e700 1 --2- 172.21.15.38:0/2931092864 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f308005abc0 0x7f3080152460 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f3070002f30 tx=0x7f3070007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:59.880 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.860+0000 7f3067fff700 1 -- 172.21.15.38:0/2931092864 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 3) v1 ==== 59405+0+0 (secure 0 0 0) 0x7f30700056c0 con 0x7f308005abc0 2020-06-12T17:47:59.880 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.860+0000 7f3067fff700 1 --2- 172.21.15.38:0/2931092864 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f306004d3d0 0x7f306004f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:47:59.881 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.860+0000 7f307ed9d700 1 --2- 172.21.15.38:0/2931092864 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f306004d3d0 0x7f306004f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:47:59.881 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.860+0000 7f307ed9d700 1 --2- 172.21.15.38:0/2931092864 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f306004d3d0 0x7f306004f890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f30740023a0 tx=0x7f30740026f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:59.881 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.860+0000 7f307ed9d700 1 --2- 172.21.15.38:0/2931092864 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f306004d3d0 0x7f306004f890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f30740023a0 tx=0x7f30740026f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:59.881 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.860+0000 7f307ed9d700 1 --2- 172.21.15.38:0/2931092864 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f306004d3d0 0x7f306004f890 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f30740023a0 tx=0x7f30740026f0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:47:59.882 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.865+0000 7f307f59e700 1 --2- 172.21.15.38:0/2931092864 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f308005abc0 0x7f3080152460 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f3070002f30 tx=0x7f3070007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:59.882 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.865+0000 7f3067fff700 1 -- 172.21.15.38:0/2931092864 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2074+0+0 (secure 0 0 0) 0x7f3070007880 con 0x7f308005abc0 2020-06-12T17:47:59.883 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.866+0000 7f307f59e700 1 --2- 172.21.15.38:0/2931092864 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f308005abc0 0x7f3080152460 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f3070002f30 tx=0x7f3070007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:47:59.883 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:47:59.866+0000 7f3067fff700 1 -- 172.21.15.38:0/2931092864 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f307003d220 con 0x7f308005abc0 2020-06-12T17:48:00.021 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:00.018+0000 7f3085016700 1 -- 172.21.15.38:0/2931092864 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f308005f200 con 0x7f308005abc0 2020-06-12T17:48:00.022 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:00.018+0000 7f307f59e700 1 --2- 172.21.15.38:0/2931092864 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f308005abc0 0x7f3080152460 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f3070002f30 tx=0x7f3070007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:00.022 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:00.018+0000 7f3067fff700 1 -- 172.21.15.38:0/2931092864 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+8274 (secure 0 0 0) 0x7f3070040840 con 0x7f308005abc0 2020-06-12T17:48:00.023 INFO:teuthology.misc.health.smithi038.stdout: 2020-06-12T17:48:00.023 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":10,"fsid":"8e42a2e7-b187-42c4-a73f-8f812ee62352","created":"2020-06-12T17:47:54.434340+0000","modified":"2020-06-12T17:47:58.885534+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-06-12T17:47:57.558119+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"6","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"44ac3dea-67b4-4b9a-bc18-ac511710afe1","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"561f7ced-3fff-4364-8619-6e4ecbc9d256","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0bb3c806-07af-49f5-b492-d0e33f2de37c","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7f6a1e75-7b11-456e-8a4b-510b16226800","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0eca0272-8cfd-469c-a32d-e29730dc0e1d","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"69d6a7dc-a55a-4ebc-8479-8bb921ddfb65","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f0d320f8-c2f0-40bb-b713-526246cf97b4","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"970b7d02-a189-41b2-96e5-a5a5a57c6476","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T17:48:00.024 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:00.020+0000 7f3085016700 1 -- 172.21.15.38:0/2931092864 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f306004d3d0 msgr2=0x7f306004f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:00.024 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:00.020+0000 7f3085016700 1 --2- 172.21.15.38:0/2931092864 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f306004d3d0 0x7f306004f890 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f30740023a0 tx=0x7f30740026f0).stop 2020-06-12T17:48:00.025 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:00.020+0000 7f3085016700 1 -- 172.21.15.38:0/2931092864 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f308005abc0 msgr2=0x7f3080152460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:00.025 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:00.020+0000 7f3085016700 1 --2- 172.21.15.38:0/2931092864 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f308005abc0 0x7f3080152460 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f3070002f30 tx=0x7f3070007e60).stop 2020-06-12T17:48:00.025 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:00.020+0000 7f3085016700 1 -- 172.21.15.38:0/2931092864 shutdown_connections 2020-06-12T17:48:00.025 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:00.020+0000 7f3085016700 1 --2- 172.21.15.38:0/2931092864 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f306004d3d0 0x7f306004f890 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:00.025 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:00.020+0000 7f3085016700 1 --2- 172.21.15.38:0/2931092864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3080060e30 0x7f308012b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:00.026 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:00.020+0000 7f3085016700 1 --2- 172.21.15.38:0/2931092864 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f308005abc0 0x7f3080152460 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:00.026 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:00.020+0000 7f3085016700 1 -- 172.21.15.38:0/2931092864 >> 172.21.15.38:0/2931092864 conn(0x7f30800b8280 msgr2=0x7f30800b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:00.026 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:00.020+0000 7f3085016700 1 -- 172.21.15.38:0/2931092864 shutdown_connections 2020-06-12T17:48:00.026 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:00.020+0000 7f3085016700 1 -- 172.21.15.38:0/2931092864 wait complete. 2020-06-12T17:48:00.033 DEBUG:teuthology.misc:0 of 8 OSDs are up 2020-06-12T17:48:00.584 INFO:tasks.ceph.osd.4.smithi150.stderr:2020-06-12T17:48:00.580+0000 7fb286810ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-06-12T17:48:00.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2020-06-12T17:48:00.605+0000 7f4354cd8ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-06-12T17:48:00.610 INFO:tasks.ceph.osd.5.smithi150.stderr:2020-06-12T17:48:00.607+0000 7f5604296ec0 -1 osd.5 0 log_to_monitors {default=true} 2020-06-12T17:48:00.616 INFO:tasks.ceph.osd.7.smithi150.stderr:2020-06-12T17:48:00.613+0000 7f11241a5ec0 -1 osd.7 0 log_to_monitors {default=true} 2020-06-12T17:48:00.619 INFO:tasks.ceph.osd.0.smithi038.stderr:2020-06-12T17:48:00.616+0000 7fd327b51ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-06-12T17:48:00.623 INFO:tasks.ceph.osd.6.smithi150.stderr:2020-06-12T17:48:00.620+0000 7f5e5afefec0 -1 osd.6 0 log_to_monitors {default=true} 2020-06-12T17:48:00.624 INFO:tasks.ceph.osd.3.smithi038.stderr:2020-06-12T17:48:00.621+0000 7f924d88fec0 -1 osd.3 0 log_to_monitors {default=true} 2020-06-12T17:48:00.636 INFO:tasks.ceph.osd.2.smithi038.stderr:2020-06-12T17:48:00.633+0000 7fbc1ddfcec0 -1 osd.2 0 log_to_monitors {default=true} 2020-06-12T17:48:02.387 INFO:tasks.ceph.osd.0.smithi038.stderr:2020-06-12T17:48:02.384+0000 7fd3100cc700 -1 osd.0 0 waiting for initial osdmap 2020-06-12T17:48:02.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2020-06-12T17:48:02.384+0000 7f433d253700 -1 osd.1 0 waiting for initial osdmap 2020-06-12T17:48:02.389 INFO:tasks.ceph.osd.5.smithi150.stderr:2020-06-12T17:48:02.384+0000 7f55ec811700 -1 osd.5 0 waiting for initial osdmap 2020-06-12T17:48:02.389 INFO:tasks.ceph.osd.6.smithi150.stderr:2020-06-12T17:48:02.385+0000 7f5e4356a700 -1 osd.6 0 waiting for initial osdmap 2020-06-12T17:48:02.389 INFO:tasks.ceph.osd.4.smithi150.stderr:2020-06-12T17:48:02.385+0000 7fb26ed8b700 -1 osd.4 0 waiting for initial osdmap 2020-06-12T17:48:02.390 INFO:tasks.ceph.osd.7.smithi150.stderr:2020-06-12T17:48:02.387+0000 7f110c720700 -1 osd.7 0 waiting for initial osdmap 2020-06-12T17:48:02.391 INFO:tasks.ceph.osd.2.smithi038.stderr:2020-06-12T17:48:02.387+0000 7fbc06377700 -1 osd.2 0 waiting for initial osdmap 2020-06-12T17:48:02.391 INFO:tasks.ceph.osd.3.smithi038.stderr:2020-06-12T17:48:02.388+0000 7f9235e0a700 -1 osd.3 0 waiting for initial osdmap 2020-06-12T17:48:06.841 INFO:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-06-12T17:48:06.961 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.954+0000 7fb44659e700 1 Processor -- start 2020-06-12T17:48:06.962 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.954+0000 7fb44659e700 1 -- start start 2020-06-12T17:48:06.962 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.955+0000 7fb44659e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb44014c9f0 0x7fb440156800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:06.962 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.955+0000 7fb44659e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb4400b5bf0 0x7fb440024ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:06.963 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.955+0000 7fb44659e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb440024f10 0x7fb440061e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:06.963 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.955+0000 7fb44659e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb44014cdd0 con 0x7fb4400b5bf0 2020-06-12T17:48:06.963 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.955+0000 7fb44659e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb440025ce0 con 0x7fb440024f10 2020-06-12T17:48:06.963 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.955+0000 7fb44659e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb440156d50 con 0x7fb44014c9f0 2020-06-12T17:48:06.963 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.955+0000 7fb44559c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb4400b5bf0 0x7fb440024ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:06.964 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.955+0000 7fb44559c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb4400b5bf0 0x7fb440024ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35212/0 (socket says 172.21.15.38:35212) 2020-06-12T17:48:06.964 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.955+0000 7fb44559c700 1 -- 172.21.15.38:0/2800345143 learned_addr learned my addr 172.21.15.38:0/2800345143 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:06.964 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.955+0000 7fb447800700 1 --2- 172.21.15.38:0/2800345143 >> v2:172.21.15.150:3300/0 conn(0x7fb440024f10 0x7fb440061e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:06.964 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.955+0000 7fb445d9d700 1 --2- 172.21.15.38:0/2800345143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb44014c9f0 0x7fb440156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:06.964 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.955+0000 7fb44559c700 1 -- 172.21.15.38:0/2800345143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb44014c9f0 msgr2=0x7fb440156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:06.965 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.955+0000 7fb44559c700 1 --2- 172.21.15.38:0/2800345143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb44014c9f0 0x7fb440156800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:06.965 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.955+0000 7fb44559c700 1 -- 172.21.15.38:0/2800345143 >> v2:172.21.15.150:3300/0 conn(0x7fb440024f10 msgr2=0x7fb440061e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:06.965 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.955+0000 7fb44559c700 1 --2- 172.21.15.38:0/2800345143 >> v2:172.21.15.150:3300/0 conn(0x7fb440024f10 0x7fb440061e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:06.965 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.955+0000 7fb44559c700 1 -- 172.21.15.38:0/2800345143 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4400631f0 con 0x7fb4400b5bf0 2020-06-12T17:48:06.965 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.955+0000 7fb445d9d700 1 --2- 172.21.15.38:0/2800345143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb44014c9f0 0x7fb440156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:48:06.966 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.955+0000 7fb447800700 1 --2- 172.21.15.38:0/2800345143 >> v2:172.21.15.150:3300/0 conn(0x7fb440024f10 0x7fb440061e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:48:06.966 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.955+0000 7fb44559c700 1 --2- 172.21.15.38:0/2800345143 >> v2:172.21.15.38:3300/0 conn(0x7fb4400b5bf0 0x7fb440024ab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb430002f30 tx=0x7fb430007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:06.966 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.956+0000 7fb44559c700 1 --2- 172.21.15.38:0/2800345143 >> v2:172.21.15.38:3300/0 conn(0x7fb4400b5bf0 0x7fb440024ab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb430002f30 tx=0x7fb430007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:06.966 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.956+0000 7fb44559c700 1 --2- 172.21.15.38:0/2800345143 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4400b5bf0 0x7fb440024ab0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7fb430002f30 tx=0x7fb430007e60).ready entity=mon.0 client_cookie=2281e91473d34279 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:06.966 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.956+0000 7fb44559c700 1 --2- 172.21.15.38:0/2800345143 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4400b5bf0 0x7fb440024ab0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fb430002f30 tx=0x7fb430007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:06.967 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.956+0000 7fb44559c700 1 --2- 172.21.15.38:0/2800345143 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4400b5bf0 0x7fb440024ab0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fb430002f30 tx=0x7fb430007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:06.967 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.956+0000 7fb444d9b700 1 -- 172.21.15.38:0/2800345143 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4300116e0 con 0x7fb4400b5bf0 2020-06-12T17:48:06.967 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.956+0000 7fb44559c700 1 --2- 172.21.15.38:0/2800345143 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4400b5bf0 0x7fb440024ab0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fb430002f30 tx=0x7fb430007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:06.967 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.956+0000 7fb444d9b700 1 -- 172.21.15.38:0/2800345143 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb430011840 con 0x7fb4400b5bf0 2020-06-12T17:48:06.967 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.956+0000 7fb444d9b700 1 -- 172.21.15.38:0/2800345143 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb430011be0 con 0x7fb4400b5bf0 2020-06-12T17:48:06.968 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.956+0000 7fb44659e700 1 -- 172.21.15.38:0/2800345143 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4400b5bf0 msgr2=0x7fb440024ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:06.968 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.956+0000 7fb44659e700 1 --2- 172.21.15.38:0/2800345143 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4400b5bf0 0x7fb440024ab0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7fb430002f30 tx=0x7fb430007e60).stop 2020-06-12T17:48:06.968 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.956+0000 7fb44659e700 1 -- 172.21.15.38:0/2800345143 shutdown_connections 2020-06-12T17:48:06.968 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.956+0000 7fb44659e700 1 --2- 172.21.15.38:0/2800345143 >> v2:172.21.15.150:3300/0 conn(0x7fb440024f10 0x7fb440061e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:06.968 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.956+0000 7fb44659e700 1 --2- 172.21.15.38:0/2800345143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb44014c9f0 0x7fb440156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:06.968 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.956+0000 7fb44659e700 1 --2- 172.21.15.38:0/2800345143 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4400b5bf0 0x7fb440024ab0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:06.969 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.956+0000 7fb44659e700 1 -- 172.21.15.38:0/2800345143 >> 172.21.15.38:0/2800345143 conn(0x7fb4400b96c0 msgr2=0x7fb4400b9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:06.969 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.956+0000 7fb44659e700 1 -- 172.21.15.38:0/2800345143 shutdown_connections 2020-06-12T17:48:06.969 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.956+0000 7fb44659e700 1 -- 172.21.15.38:0/2800345143 wait complete. 2020-06-12T17:48:06.978 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.958+0000 7fb44659e700 1 Processor -- start 2020-06-12T17:48:06.979 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.958+0000 7fb44659e700 1 -- start start 2020-06-12T17:48:06.979 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.958+0000 7fb44659e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb4400b5bf0 0x7fb44014fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:06.981 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.958+0000 7fb44659e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb44014c9f0 0x7fb4400b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:06.981 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.958+0000 7fb44659e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb44014f3c0 con 0x7fb440024f10 2020-06-12T17:48:06.982 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.958+0000 7fb44659e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb44014f660 con 0x7fb44014c9f0 2020-06-12T17:48:06.982 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.958+0000 7fb44659e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb44014f900 con 0x7fb4400b5bf0 2020-06-12T17:48:06.982 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.958+0000 7fb447800700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb44014c9f0 0x7fb4400b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:06.982 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.958+0000 7fb447800700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb44014c9f0 0x7fb4400b4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35218/0 (socket says 172.21.15.38:35218) 2020-06-12T17:48:06.982 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.958+0000 7fb447800700 1 -- 172.21.15.38:0/1598960799 learned_addr learned my addr 172.21.15.38:0/1598960799 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:06.983 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.959+0000 7fb447800700 1 -- 172.21.15.38:0/1598960799 >> v2:172.21.15.150:3300/0 conn(0x7fb4400b5bf0 msgr2=0x7fb44014fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:06.983 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.959+0000 7fb44559c700 1 --2- 172.21.15.38:0/1598960799 >> v2:172.21.15.150:3300/0 conn(0x7fb4400b5bf0 0x7fb44014fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:06.983 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.959+0000 7fb447800700 1 --2- 172.21.15.38:0/1598960799 >> v2:172.21.15.150:3300/0 conn(0x7fb4400b5bf0 0x7fb44014fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:06.983 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.959+0000 7fb447800700 1 -- 172.21.15.38:0/1598960799 >> v1:172.21.15.150:6789/0 conn(0x7fb440024f10 legacy=0x7fb4400aef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:06.983 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.959+0000 7fb447800700 1 -- 172.21.15.38:0/1598960799 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44014f040 con 0x7fb44014c9f0 2020-06-12T17:48:06.984 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.959+0000 7fb447800700 1 --2- 172.21.15.38:0/1598960799 >> v2:172.21.15.38:3300/0 conn(0x7fb44014c9f0 0x7fb4400b4cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb4400ae360 tx=0x7fb4380081f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:06.984 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.959+0000 7fb447800700 1 --2- 172.21.15.38:0/1598960799 >> v2:172.21.15.38:3300/0 conn(0x7fb44014c9f0 0x7fb4400b4cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb4400ae360 tx=0x7fb4380081f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:06.984 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.959+0000 7fb447800700 1 --2- 172.21.15.38:0/1598960799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb44014c9f0 0x7fb4400b4cd0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7fb4400ae360 tx=0x7fb4380081f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:06.984 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.959+0000 7fb447800700 1 --2- 172.21.15.38:0/1598960799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb44014c9f0 0x7fb4400b4cd0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fb4400ae360 tx=0x7fb4380081f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:06.984 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.959+0000 7fb4367fc700 1 -- 172.21.15.38:0/1598960799 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb438007350 con 0x7fb44014c9f0 2020-06-12T17:48:06.985 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.959+0000 7fb447800700 1 --2- 172.21.15.38:0/1598960799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb44014c9f0 0x7fb4400b4cd0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fb4400ae360 tx=0x7fb4380081f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:06.985 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.959+0000 7fb447800700 1 --2- 172.21.15.38:0/1598960799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb44014c9f0 0x7fb4400b4cd0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fb4400ae360 tx=0x7fb4380081f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:06.985 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.959+0000 7fb4367fc700 1 -- 172.21.15.38:0/1598960799 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4380074b0 con 0x7fb44014c9f0 2020-06-12T17:48:06.985 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.959+0000 7fb44659e700 1 -- 172.21.15.38:0/1598960799 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44014d9e0 con 0x7fb44014c9f0 2020-06-12T17:48:06.985 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.959+0000 7fb4367fc700 1 -- 172.21.15.38:0/1598960799 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4380078d0 con 0x7fb44014c9f0 2020-06-12T17:48:06.988 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.959+0000 7fb44659e700 1 -- 172.21.15.38:0/1598960799 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44013c080 con 0x7fb44014c9f0 2020-06-12T17:48:06.989 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.960+0000 7fb447800700 1 --2- 172.21.15.38:0/1598960799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb44014c9f0 0x7fb4400b4cd0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fb4400ae360 tx=0x7fb4380081f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:06.989 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.960+0000 7fb4367fc700 1 -- 172.21.15.38:0/1598960799 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fb438012430 con 0x7fb44014c9f0 2020-06-12T17:48:06.989 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.960+0000 7fb447800700 1 --2- 172.21.15.38:0/1598960799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb44014c9f0 0x7fb4400b4cd0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fb4400ae360 tx=0x7fb4380081f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:06.989 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.960+0000 7fb44659e700 1 -- 172.21.15.38:0/1598960799 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb440056c30 con 0x7fb44014c9f0 2020-06-12T17:48:06.990 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.960+0000 7fb4367fc700 1 --2- 172.21.15.38:0/1598960799 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb42804d680 0x7fb42804fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:06.990 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.961+0000 7fb4367fc700 1 -- 172.21.15.38:0/1598960799 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4900+0+0 (secure 0 0 0) 0x7fb438061180 con 0x7fb44014c9f0 2020-06-12T17:48:06.990 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.961+0000 7fb445d9d700 1 --2- 172.21.15.38:0/1598960799 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb42804d680 0x7fb42804fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:06.990 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.961+0000 7fb445d9d700 1 --2- 172.21.15.38:0/1598960799 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb42804d680 0x7fb42804fb40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb440062640 tx=0x7fb43c009b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:06.990 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.961+0000 7fb445d9d700 1 --2- 172.21.15.38:0/1598960799 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb42804d680 0x7fb42804fb40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb440062640 tx=0x7fb43c009b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:06.991 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.961+0000 7fb445d9d700 1 --2- 172.21.15.38:0/1598960799 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb42804d680 0x7fb42804fb40 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7fb440062640 tx=0x7fb43c009b60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:06.991 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.964+0000 7fb447800700 1 --2- 172.21.15.38:0/1598960799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb44014c9f0 0x7fb4400b4cd0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fb4400ae360 tx=0x7fb4380081f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:06.991 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:06.964+0000 7fb4367fc700 1 -- 172.21.15.38:0/1598960799 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fb43803c8e0 con 0x7fb44014c9f0 2020-06-12T17:48:07.120 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:07.116+0000 7fb44659e700 1 -- 172.21.15.38:0/1598960799 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb44014f1d0 con 0x7fb44014c9f0 2020-06-12T17:48:07.121 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:07.117+0000 7fb447800700 1 --2- 172.21.15.38:0/1598960799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb44014c9f0 0x7fb4400b4cd0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fb4400ae360 tx=0x7fb4380081f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.122 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:07.117+0000 7fb4367fc700 1 -- 172.21.15.38:0/1598960799 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11853 (secure 0 0 0) 0x7fb43803ff00 con 0x7fb44014c9f0 2020-06-12T17:48:07.122 INFO:teuthology.misc.health.smithi038.stdout: 2020-06-12T17:48:07.122 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":15,"fsid":"8e42a2e7-b187-42c4-a73f-8f812ee62352","created":"2020-06-12T17:47:54.434340+0000","modified":"2020-06-12T17:48:05.412611+0000","last_up_change":"2020-06-12T17:48:03.388718+0000","last_in_change":"2020-06-12T17:48:03.388718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-06-12T17:47:57.558119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"44ac3dea-67b4-4b9a-bc18-ac511710afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":31038},{"type":"v1","addr":"172.21.15.38:6816","nonce":31038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":31038},{"type":"v1","addr":"172.21.15.38:6819","nonce":31038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":31038},{"type":"v1","addr":"172.21.15.38:6823","nonce":31038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":31038},{"type":"v1","addr":"172.21.15.38:6821","nonce":31038}]},"public_addr":"172.21.15.38:6816/31038","cluster_addr":"172.21.15.38:6819/31038","heartbeat_back_addr":"172.21.15.38:6823/31038","heartbeat_front_addr":"172.21.15.38:6821/31038","state":["exists","up"]},{"osd":1,"uuid":"561f7ced-3fff-4364-8619-6e4ecbc9d256","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":31036},{"type":"v1","addr":"172.21.15.38:6801","nonce":31036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":31036},{"type":"v1","addr":"172.21.15.38:6803","nonce":31036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":31036},{"type":"v1","addr":"172.21.15.38:6807","nonce":31036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":31036},{"type":"v1","addr":"172.21.15.38:6805","nonce":31036}]},"public_addr":"172.21.15.38:6801/31036","cluster_addr":"172.21.15.38:6803/31036","heartbeat_back_addr":"172.21.15.38:6807/31036","heartbeat_front_addr":"172.21.15.38:6805/31036","state":["exists","up"]},{"osd":2,"uuid":"0bb3c806-07af-49f5-b492-d0e33f2de37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":31053},{"type":"v1","addr":"172.21.15.38:6825","nonce":31053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":31053},{"type":"v1","addr":"172.21.15.38:6827","nonce":31053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":31053},{"type":"v1","addr":"172.21.15.38:6831","nonce":31053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":31053},{"type":"v1","addr":"172.21.15.38:6829","nonce":31053}]},"public_addr":"172.21.15.38:6825/31053","cluster_addr":"172.21.15.38:6827/31053","heartbeat_back_addr":"172.21.15.38:6831/31053","heartbeat_front_addr":"172.21.15.38:6829/31053","state":["exists","up"]},{"osd":3,"uuid":"7f6a1e75-7b11-456e-8a4b-510b16226800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":31037},{"type":"v1","addr":"172.21.15.38:6809","nonce":31037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":31037},{"type":"v1","addr":"172.21.15.38:6811","nonce":31037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6815","nonce":31037},{"type":"v1","addr":"172.21.15.38:6817","nonce":31037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":31037},{"type":"v1","addr":"172.21.15.38:6813","nonce":31037}]},"public_addr":"172.21.15.38:6809/31037","cluster_addr":"172.21.15.38:6811/31037","heartbeat_back_addr":"172.21.15.38:6817/31037","heartbeat_front_addr":"172.21.15.38:6813/31037","state":["exists","up"]},{"osd":4,"uuid":"0eca0272-8cfd-469c-a32d-e29730dc0e1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":31294},{"type":"v1","addr":"172.21.15.150:6803","nonce":31294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":31294},{"type":"v1","addr":"172.21.15.150:6805","nonce":31294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":31294},{"type":"v1","addr":"172.21.15.150:6809","nonce":31294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":31294},{"type":"v1","addr":"172.21.15.150:6807","nonce":31294}]},"public_addr":"172.21.15.150:6803/31294","cluster_addr":"172.21.15.150:6805/31294","heartbeat_back_addr":"172.21.15.150:6809/31294","heartbeat_front_addr":"172.21.15.150:6807/31294","state":["exists","up"]},{"osd":5,"uuid":"69d6a7dc-a55a-4ebc-8479-8bb921ddfb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":31295},{"type":"v1","addr":"172.21.15.150:6813","nonce":31295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":31295},{"type":"v1","addr":"172.21.15.150:6816","nonce":31295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":31295},{"type":"v1","addr":"172.21.15.150:6828","nonce":31295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6819","nonce":31295},{"type":"v1","addr":"172.21.15.150:6822","nonce":31295}]},"public_addr":"172.21.15.150:6813/31295","cluster_addr":"172.21.15.150:6816/31295","heartbeat_back_addr":"172.21.15.150:6828/31295","heartbeat_front_addr":"172.21.15.150:6822/31295","state":["exists","up"]},{"osd":6,"uuid":"f0d320f8-c2f0-40bb-b713-526246cf97b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":31297},{"type":"v1","addr":"172.21.15.150:6820","nonce":31297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6823","nonce":31297},{"type":"v1","addr":"172.21.15.150:6827","nonce":31297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":31297},{"type":"v1","addr":"172.21.15.150:6833","nonce":31297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":31297},{"type":"v1","addr":"172.21.15.150:6831","nonce":31297}]},"public_addr":"172.21.15.150:6820/31297","cluster_addr":"172.21.15.150:6827/31297","heartbeat_back_addr":"172.21.15.150:6833/31297","heartbeat_front_addr":"172.21.15.150:6831/31297","state":["exists","up"]},{"osd":7,"uuid":"970b7d02-a189-41b2-96e5-a5a5a57c6476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":31296},{"type":"v1","addr":"172.21.15.150:6812","nonce":31296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":31296},{"type":"v1","addr":"172.21.15.150:6818","nonce":31296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":31296},{"type":"v1","addr":"172.21.15.150:6829","nonce":31296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":31296},{"type":"v1","addr":"172.21.15.150:6824","nonce":31296}]},"public_addr":"172.21.15.150:6812/31296","cluster_addr":"172.21.15.150:6818/31296","heartbeat_back_addr":"172.21.15.150:6829/31296","heartbeat_front_addr":"172.21.15.150:6824/31296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.664300+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.644253+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.651120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.584978+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.561149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.661778+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T17:48:07.123 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:07.118+0000 7fb44659e700 1 -- 172.21.15.38:0/1598960799 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb42804d680 msgr2=0x7fb42804fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:07.124 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:07.118+0000 7fb44659e700 1 --2- 172.21.15.38:0/1598960799 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb42804d680 0x7fb42804fb40 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7fb440062640 tx=0x7fb43c009b60).stop 2020-06-12T17:48:07.124 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:07.118+0000 7fb44659e700 1 -- 172.21.15.38:0/1598960799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb44014c9f0 msgr2=0x7fb4400b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:07.124 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:07.118+0000 7fb44659e700 1 --2- 172.21.15.38:0/1598960799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb44014c9f0 0x7fb4400b4cd0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7fb4400ae360 tx=0x7fb4380081f0).stop 2020-06-12T17:48:07.124 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:07.118+0000 7fb44659e700 1 -- 172.21.15.38:0/1598960799 shutdown_connections 2020-06-12T17:48:07.124 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:07.118+0000 7fb44659e700 1 --2- 172.21.15.38:0/1598960799 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb42804d680 0x7fb42804fb40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:07.125 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:07.118+0000 7fb44659e700 1 --2- 172.21.15.38:0/1598960799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb44014c9f0 0x7fb4400b4cd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:07.125 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:07.118+0000 7fb44659e700 1 --2- 172.21.15.38:0/1598960799 >> v2:172.21.15.150:3300/0 conn(0x7fb4400b5bf0 0x7fb44014fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:07.125 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:07.118+0000 7fb44659e700 1 -- 172.21.15.38:0/1598960799 >> 172.21.15.38:0/1598960799 conn(0x7fb4400b96c0 msgr2=0x7fb44007f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:07.125 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:07.118+0000 7fb44659e700 1 -- 172.21.15.38:0/1598960799 shutdown_connections 2020-06-12T17:48:07.125 INFO:teuthology.misc.health.smithi038.stderr:2020-06-12T17:48:07.118+0000 7fb44659e700 1 -- 172.21.15.38:0/1598960799 wait complete. 2020-06-12T17:48:07.132 DEBUG:teuthology.misc:8 of 8 OSDs are up 2020-06-12T17:48:07.133 INFO:tasks.ceph:Creating RBD pool 2020-06-12T17:48:07.133 INFO:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph osd pool create rbd 8 2020-06-12T17:48:07.249 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.242+0000 7fe36e726700 1 Processor -- start 2020-06-12T17:48:07.250 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.242+0000 7fe36e726700 1 -- start start 2020-06-12T17:48:07.250 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.243+0000 7fe36e726700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe36805bc10 0x7fe36815d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:07.250 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.243+0000 7fe36e726700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3680ace40 con 0x7fe3681527c0 2020-06-12T17:48:07.250 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.243+0000 7fe36e726700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3680ad0e0 con 0x7fe3681523e0 2020-06-12T17:48:07.251 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.243+0000 7fe36e726700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3680af0c0 con 0x7fe36805bc10 2020-06-12T17:48:07.251 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.243+0000 7fe36d4c4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe36805bc10 0x7fe36815d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:07.251 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.243+0000 7fe36d4c4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe36805bc10 0x7fe36815d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35228/0 (socket says 172.21.15.38:35228) 2020-06-12T17:48:07.251 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.243+0000 7fe36d4c4700 1 -- 172.21.15.38:0/2862031165 learned_addr learned my addr 172.21.15.38:0/2862031165 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:07.251 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.243+0000 7fe367fff700 1 --1- 172.21.15.38:0/2862031165 >> v1:172.21.15.38:6789/0 conn(0x7fe3681527c0 0x7fe3680ae9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37040/0 (socket says 172.21.15.38:37040) 2020-06-12T17:48:07.252 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.243+0000 7fe36d4c4700 1 -- 172.21.15.38:0/2862031165 >> v1:172.21.15.150:6789/0 conn(0x7fe3681523e0 legacy=0x7fe3680b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:07.252 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.244+0000 7fe36d4c4700 1 -- 172.21.15.38:0/2862031165 >> v1:172.21.15.38:6789/0 conn(0x7fe3681527c0 legacy=0x7fe3680ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:07.252 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.244+0000 7fe36d4c4700 1 -- 172.21.15.38:0/2862031165 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3680af200 con 0x7fe36805bc10 2020-06-12T17:48:07.252 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.244+0000 7fe3677fe700 1 -- 172.21.15.38:0/2862031165 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1083693415 0 0) 0x7fe3680ace40 con 0x7fe3681527c0 2020-06-12T17:48:07.252 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.244+0000 7fe36d4c4700 1 --2- 172.21.15.38:0/2862031165 >> v2:172.21.15.38:3300/0 conn(0x7fe36805bc10 0x7fe36815d320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe3600032b0 tx=0x7fe3600081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.253 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.244+0000 7fe36d4c4700 1 --2- 172.21.15.38:0/2862031165 >> v2:172.21.15.38:3300/0 conn(0x7fe36805bc10 0x7fe36815d320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe3600032b0 tx=0x7fe3600081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.253 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.244+0000 7fe36d4c4700 1 --2- 172.21.15.38:0/2862031165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe36805bc10 0x7fe36815d320 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fe3600032b0 tx=0x7fe3600081e0).ready entity=mon.0 client_cookie=c754d8fb09928682 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:07.253 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.244+0000 7fe36d4c4700 1 --2- 172.21.15.38:0/2862031165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe36805bc10 0x7fe36815d320 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fe3600032b0 tx=0x7fe3600081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.253 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.244+0000 7fe3677fe700 1 -- 172.21.15.38:0/2862031165 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe36000a160 con 0x7fe36805bc10 2020-06-12T17:48:07.253 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.244+0000 7fe36d4c4700 1 --2- 172.21.15.38:0/2862031165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe36805bc10 0x7fe36815d320 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fe3600032b0 tx=0x7fe3600081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.254 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.244+0000 7fe3677fe700 1 -- 172.21.15.38:0/2862031165 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36000a2c0 con 0x7fe36805bc10 2020-06-12T17:48:07.254 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.244+0000 7fe36d4c4700 1 --2- 172.21.15.38:0/2862031165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe36805bc10 0x7fe36815d320 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fe3600032b0 tx=0x7fe3600081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.254 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.244+0000 7fe3677fe700 1 -- 172.21.15.38:0/2862031165 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe36000a660 con 0x7fe36805bc10 2020-06-12T17:48:07.254 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.244+0000 7fe36e726700 1 -- 172.21.15.38:0/2862031165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe36805bc10 msgr2=0x7fe36815d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:07.254 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.244+0000 7fe36e726700 1 --2- 172.21.15.38:0/2862031165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe36805bc10 0x7fe36815d320 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fe3600032b0 tx=0x7fe3600081e0).stop 2020-06-12T17:48:07.255 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.244+0000 7fe36e726700 1 -- 172.21.15.38:0/2862031165 shutdown_connections 2020-06-12T17:48:07.255 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.244+0000 7fe36e726700 1 --2- 172.21.15.38:0/2862031165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe36805bc10 0x7fe36815d320 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:07.255 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.244+0000 7fe36e726700 1 -- 172.21.15.38:0/2862031165 >> 172.21.15.38:0/2862031165 conn(0x7fe3680b8200 msgr2=0x7fe3680b8610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:07.255 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.244+0000 7fe36e726700 1 -- 172.21.15.38:0/2862031165 shutdown_connections 2020-06-12T17:48:07.255 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.244+0000 7fe36e726700 1 -- 172.21.15.38:0/2862031165 wait complete. 2020-06-12T17:48:07.268 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.246+0000 7fe36e726700 1 Processor -- start 2020-06-12T17:48:07.268 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.246+0000 7fe36e726700 1 -- start start 2020-06-12T17:48:07.268 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.246+0000 7fe36e726700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe3681523e0 0x7fe368065910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:07.269 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.246+0000 7fe36e726700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe3681527c0 0x7fe368065d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:07.269 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.246+0000 7fe36e726700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3680714b0 con 0x7fe36805bc10 2020-06-12T17:48:07.269 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.246+0000 7fe36e726700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe368131800 con 0x7fe3681523e0 2020-06-12T17:48:07.269 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.246+0000 7fe36e726700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe368071720 con 0x7fe3681527c0 2020-06-12T17:48:07.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.247+0000 7fe367fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe3681523e0 0x7fe368065910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:07.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.247+0000 7fe367fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe3681523e0 0x7fe368065910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35232/0 (socket says 172.21.15.38:35232) 2020-06-12T17:48:07.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.247+0000 7fe367fff700 1 -- 172.21.15.38:0/2781496714 learned_addr learned my addr 172.21.15.38:0/2781496714 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:07.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.247+0000 7fe36d4c4700 1 --2- 172.21.15.38:0/2781496714 >> v2:172.21.15.150:3300/0 conn(0x7fe3681527c0 0x7fe368065d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:07.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.247+0000 7fe367fff700 1 -- 172.21.15.38:0/2781496714 >> v2:172.21.15.150:3300/0 conn(0x7fe3681527c0 msgr2=0x7fe368065d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:07.271 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.247+0000 7fe367fff700 1 --2- 172.21.15.38:0/2781496714 >> v2:172.21.15.150:3300/0 conn(0x7fe3681527c0 0x7fe368065d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:07.271 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.247+0000 7fe367fff700 1 -- 172.21.15.38:0/2781496714 >> v1:172.21.15.150:6789/0 conn(0x7fe36805bc10 legacy=0x7fe368070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:07.271 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.247+0000 7fe367fff700 1 -- 172.21.15.38:0/2781496714 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3680719c0 con 0x7fe3681523e0 2020-06-12T17:48:07.271 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.247+0000 7fe367fff700 1 --2- 172.21.15.38:0/2781496714 >> v2:172.21.15.38:3300/0 conn(0x7fe3681523e0 0x7fe368065910 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe35c000b80 tx=0x7fe35c0018f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.271 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.247+0000 7fe367fff700 1 --2- 172.21.15.38:0/2781496714 >> v2:172.21.15.38:3300/0 conn(0x7fe3681523e0 0x7fe368065910 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe35c000b80 tx=0x7fe35c0018f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.272 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.247+0000 7fe367fff700 1 --2- 172.21.15.38:0/2781496714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3681523e0 0x7fe368065910 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7fe35c000b80 tx=0x7fe35c0018f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:07.272 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.247+0000 7fe367fff700 1 --2- 172.21.15.38:0/2781496714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3681523e0 0x7fe368065910 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fe35c000b80 tx=0x7fe35c0018f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.272 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.247+0000 7fe3657fa700 1 -- 172.21.15.38:0/2781496714 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe35c00ca10 con 0x7fe3681523e0 2020-06-12T17:48:07.272 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.247+0000 7fe367fff700 1 --2- 172.21.15.38:0/2781496714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3681523e0 0x7fe368065910 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fe35c000b80 tx=0x7fe35c0018f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.272 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.247+0000 7fe3657fa700 1 -- 172.21.15.38:0/2781496714 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35c00cb70 con 0x7fe3681523e0 2020-06-12T17:48:07.273 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.247+0000 7fe367fff700 1 --2- 172.21.15.38:0/2781496714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3681523e0 0x7fe368065910 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fe35c000b80 tx=0x7fe35c0018f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.273 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.247+0000 7fe36e726700 1 -- 172.21.15.38:0/2781496714 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe368124b50 con 0x7fe3681523e0 2020-06-12T17:48:07.273 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.247+0000 7fe3657fa700 1 -- 172.21.15.38:0/2781496714 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe35c00d0c0 con 0x7fe3681523e0 2020-06-12T17:48:07.273 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.247+0000 7fe36e726700 1 -- 172.21.15.38:0/2781496714 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3681332b0 con 0x7fe3681523e0 2020-06-12T17:48:07.273 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.248+0000 7fe367fff700 1 --2- 172.21.15.38:0/2781496714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3681523e0 0x7fe368065910 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fe35c000b80 tx=0x7fe35c0018f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.274 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.248+0000 7fe36e726700 1 -- 172.21.15.38:0/2781496714 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe368056c30 con 0x7fe3681523e0 2020-06-12T17:48:07.274 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.248+0000 7fe3657fa700 1 -- 172.21.15.38:0/2781496714 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe35c0054b0 con 0x7fe3681523e0 2020-06-12T17:48:07.274 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.248+0000 7fe367fff700 1 --2- 172.21.15.38:0/2781496714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3681523e0 0x7fe368065910 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fe35c000b80 tx=0x7fe35c0018f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.274 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.249+0000 7fe3657fa700 1 --2- 172.21.15.38:0/2781496714 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe34804d650 0x7fe34804fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:07.274 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.249+0000 7fe3657fa700 1 -- 172.21.15.38:0/2781496714 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4900+0+0 (secure 0 0 0) 0x7fe35c0609f0 con 0x7fe3681523e0 2020-06-12T17:48:07.275 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.249+0000 7fe36ccc3700 1 --2- 172.21.15.38:0/2781496714 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe34804d650 0x7fe34804fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:07.275 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.249+0000 7fe36ccc3700 1 --2- 172.21.15.38:0/2781496714 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe34804d650 0x7fe34804fb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe368071c90 tx=0x7fe358002400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.275 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.249+0000 7fe36ccc3700 1 --2- 172.21.15.38:0/2781496714 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe34804d650 0x7fe34804fb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe368071c90 tx=0x7fe358002400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.275 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.249+0000 7fe36ccc3700 1 --2- 172.21.15.38:0/2781496714 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe34804d650 0x7fe34804fb10 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7fe368071c90 tx=0x7fe358002400).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:07.275 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.252+0000 7fe367fff700 1 --2- 172.21.15.38:0/2781496714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3681523e0 0x7fe368065910 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fe35c000b80 tx=0x7fe35c0018f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.276 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.252+0000 7fe3657fa700 1 -- 172.21.15.38:0/2781496714 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fe35c03c0d0 con 0x7fe3681523e0 2020-06-12T17:48:07.407 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.403+0000 7fe36e726700 1 -- 172.21.15.38:0/2781496714 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fe368132ed0 con 0x7fe3681523e0 2020-06-12T17:48:07.445 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.441+0000 7fe367fff700 1 --2- 172.21.15.38:0/2781496714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3681523e0 0x7fe368065910 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fe35c000b80 tx=0x7fe35c0018f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.445 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.441+0000 7fe3657fa700 1 -- 172.21.15.38:0/2781496714 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7fe35c0100b0 con 0x7fe3681523e0 2020-06-12T17:48:07.447 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.442+0000 7fe36e726700 1 -- 172.21.15.38:0/2781496714 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe34804d650 msgr2=0x7fe34804fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:07.447 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.442+0000 7fe36e726700 1 --2- 172.21.15.38:0/2781496714 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe34804d650 0x7fe34804fb10 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7fe368071c90 tx=0x7fe358002400).stop 2020-06-12T17:48:07.448 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.442+0000 7fe36e726700 1 -- 172.21.15.38:0/2781496714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3681523e0 msgr2=0x7fe368065910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:07.448 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.442+0000 7fe36e726700 1 --2- 172.21.15.38:0/2781496714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3681523e0 0x7fe368065910 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7fe35c000b80 tx=0x7fe35c0018f0).stop 2020-06-12T17:48:07.448 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.443+0000 7fe36e726700 1 -- 172.21.15.38:0/2781496714 shutdown_connections 2020-06-12T17:48:07.448 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.443+0000 7fe36e726700 1 --2- 172.21.15.38:0/2781496714 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe34804d650 0x7fe34804fb10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:07.448 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.443+0000 7fe36e726700 1 --2- 172.21.15.38:0/2781496714 >> v2:172.21.15.150:3300/0 conn(0x7fe3681527c0 0x7fe368065d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:07.449 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.443+0000 7fe36e726700 1 --2- 172.21.15.38:0/2781496714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3681523e0 0x7fe368065910 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:07.449 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.443+0000 7fe36e726700 1 -- 172.21.15.38:0/2781496714 >> 172.21.15.38:0/2781496714 conn(0x7fe3680b8200 msgr2=0x7fe368151c30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:07.449 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.443+0000 7fe36e726700 1 -- 172.21.15.38:0/2781496714 shutdown_connections 2020-06-12T17:48:07.449 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.443+0000 7fe36e726700 1 -- 172.21.15.38:0/2781496714 wait complete. 2020-06-12T17:48:07.450 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'rbd' created 2020-06-12T17:48:07.457 INFO:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-06-12T17:48:07.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.568+0000 7f5dc6ad0700 1 Processor -- start 2020-06-12T17:48:07.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.568+0000 7f5dc6ad0700 1 -- start start 2020-06-12T17:48:07.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.568+0000 7f5dc6ad0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc01523e0 0x7f5dc01527c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:07.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.568+0000 7f5dc6ad0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5dc00b3ca0 0x7f5dc00ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:07.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.568+0000 7f5dc6ad0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dc00ace40 con 0x7f5dc00aee10 2020-06-12T17:48:07.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.569+0000 7f5dc6ad0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc00ad0e0 con 0x7f5dc00b3ca0 2020-06-12T17:48:07.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.569+0000 7f5dc6ad0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc00b4100 con 0x7f5dc01523e0 2020-06-12T17:48:07.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.569+0000 7f5dc506d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc01523e0 0x7f5dc01527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:07.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.569+0000 7f5dc506d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc01523e0 0x7f5dc01527c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:54696/0 (socket says 172.21.15.38:54696) 2020-06-12T17:48:07.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.569+0000 7f5dc506d700 1 -- 172.21.15.38:0/3411756722 learned_addr learned my addr 172.21.15.38:0/3411756722 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:07.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.569+0000 7f5dc506d700 1 -- 172.21.15.38:0/3411756722 >> v2:172.21.15.150:3300/0 conn(0x7f5dc00b3ca0 msgr2=0x7f5dc00ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:07.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.569+0000 7f5dc506d700 1 --2- 172.21.15.38:0/3411756722 >> v2:172.21.15.150:3300/0 conn(0x7f5dc00b3ca0 0x7f5dc00ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:07.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.569+0000 7f5dc506d700 1 -- 172.21.15.38:0/3411756722 >> v1:172.21.15.150:6789/0 conn(0x7f5dc00aee10 legacy=0x7f5dc01561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:07.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.569+0000 7f5dc506d700 1 -- 172.21.15.38:0/3411756722 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc00b4270 con 0x7f5dc01523e0 2020-06-12T17:48:07.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.569+0000 7f5dc506d700 1 --2- 172.21.15.38:0/3411756722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc01523e0 0x7f5dc01527c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5dc00ad700 tx=0x7f5db0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.569+0000 7f5dc506d700 1 --2- 172.21.15.38:0/3411756722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc01523e0 0x7f5dc01527c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5dc00ad700 tx=0x7f5db0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.569+0000 7f5dc506d700 1 --2- 172.21.15.38:0/3411756722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc01523e0 0x7f5dc01527c0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f5dc00ad700 tx=0x7f5db0007e60).ready entity=mon.2 client_cookie=4f0dd28aecbeded server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:07.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.569+0000 7f5dc506d700 1 --2- 172.21.15.38:0/3411756722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc01523e0 0x7f5dc01527c0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f5dc00ad700 tx=0x7f5db0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.569+0000 7f5dbffff700 1 -- 172.21.15.38:0/3411756722 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5db00116a0 con 0x7f5dc01523e0 2020-06-12T17:48:07.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.570+0000 7f5dc506d700 1 --2- 172.21.15.38:0/3411756722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc01523e0 0x7f5dc01527c0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f5dc00ad700 tx=0x7f5db0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.570+0000 7f5dbffff700 1 -- 172.21.15.38:0/3411756722 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db0011800 con 0x7f5dc01523e0 2020-06-12T17:48:07.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.570+0000 7f5dc506d700 1 --2- 172.21.15.38:0/3411756722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc01523e0 0x7f5dc01527c0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f5dc00ad700 tx=0x7f5db0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.570+0000 7f5dbffff700 1 -- 172.21.15.38:0/3411756722 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5db0011c20 con 0x7f5dc01523e0 2020-06-12T17:48:07.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.570+0000 7f5dc6ad0700 1 -- 172.21.15.38:0/3411756722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc01523e0 msgr2=0x7f5dc01527c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:07.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.570+0000 7f5dc6ad0700 1 --2- 172.21.15.38:0/3411756722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc01523e0 0x7f5dc01527c0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f5dc00ad700 tx=0x7f5db0007e60).stop 2020-06-12T17:48:07.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.570+0000 7f5dc6ad0700 1 -- 172.21.15.38:0/3411756722 shutdown_connections 2020-06-12T17:48:07.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.570+0000 7f5dc6ad0700 1 --2- 172.21.15.38:0/3411756722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc01523e0 0x7f5dc01527c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:07.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.570+0000 7f5dc6ad0700 1 --2- 172.21.15.38:0/3411756722 >> v2:172.21.15.150:3300/0 conn(0x7f5dc00b3ca0 0x7f5dc00ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:07.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.570+0000 7f5dc6ad0700 1 -- 172.21.15.38:0/3411756722 >> 172.21.15.38:0/3411756722 conn(0x7f5dc00b8200 msgr2=0x7f5dc00b8610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:07.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.570+0000 7f5dc6ad0700 1 -- 172.21.15.38:0/3411756722 shutdown_connections 2020-06-12T17:48:07.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.570+0000 7f5dc6ad0700 1 -- 172.21.15.38:0/3411756722 wait complete. 2020-06-12T17:48:07.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.571+0000 7f5dc6ad0700 1 Processor -- start 2020-06-12T17:48:07.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.571+0000 7f5dc6ad0700 1 -- start start 2020-06-12T17:48:07.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.572+0000 7f5dc6ad0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5dc00aee10 0x7f5dc00635d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:07.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.572+0000 7f5dc6ad0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc00b3ca0 0x7f5dc0139790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:07.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.572+0000 7f5dc6ad0700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5dc01523e0 0x7f5dc0127380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:07.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.572+0000 7f5dc6ad0700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc0139d50 con 0x7f5dc01523e0 2020-06-12T17:48:07.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.572+0000 7f5dc6ad0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc01277e0 con 0x7f5dc00aee10 2020-06-12T17:48:07.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.572+0000 7f5dc6ad0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc011b4b0 con 0x7f5dc00b3ca0 2020-06-12T17:48:07.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.572+0000 7f5dc586e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5dc01523e0 0x7f5dc0127380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:07.588 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.572+0000 7f5dc586e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5dc01523e0 0x7f5dc0127380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35246/0 (socket says 172.21.15.38:35246) 2020-06-12T17:48:07.588 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.572+0000 7f5dc586e700 1 -- 172.21.15.38:0/4007680938 learned_addr learned my addr 172.21.15.38:0/4007680938 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:07.588 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.572+0000 7f5dc506d700 1 --2- 172.21.15.38:0/4007680938 >> v2:172.21.15.150:3300/0 conn(0x7f5dc00aee10 0x7f5dc00635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:07.588 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.572+0000 7f5dc486c700 1 --2- 172.21.15.38:0/4007680938 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc00b3ca0 0x7f5dc0139790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:07.588 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.573+0000 7f5dc586e700 1 -- 172.21.15.38:0/4007680938 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc00b3ca0 msgr2=0x7f5dc0139790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:07.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.573+0000 7f5dc586e700 1 --2- 172.21.15.38:0/4007680938 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc00b3ca0 0x7f5dc0139790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:07.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.573+0000 7f5dc586e700 1 -- 172.21.15.38:0/4007680938 >> v2:172.21.15.150:3300/0 conn(0x7f5dc00aee10 msgr2=0x7f5dc00635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:07.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.573+0000 7f5dc586e700 1 --2- 172.21.15.38:0/4007680938 >> v2:172.21.15.150:3300/0 conn(0x7f5dc00aee10 0x7f5dc00635d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:07.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.573+0000 7f5dc586e700 1 -- 172.21.15.38:0/4007680938 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc011b750 con 0x7f5dc01523e0 2020-06-12T17:48:07.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.573+0000 7f5dc586e700 1 --2- 172.21.15.38:0/4007680938 >> v2:172.21.15.38:3300/0 conn(0x7f5dc01523e0 0x7f5dc0127380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5db80032c0 tx=0x7f5db8008000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.590 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.573+0000 7f5dc586e700 1 --2- 172.21.15.38:0/4007680938 >> v2:172.21.15.38:3300/0 conn(0x7f5dc01523e0 0x7f5dc0127380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5db80032c0 tx=0x7f5db8008000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.590 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.573+0000 7f5dc586e700 1 --2- 172.21.15.38:0/4007680938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5dc01523e0 0x7f5dc0127380 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f5db80032c0 tx=0x7f5db8008000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:07.590 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.573+0000 7f5dc586e700 1 --2- 172.21.15.38:0/4007680938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5dc01523e0 0x7f5dc0127380 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f5db80032c0 tx=0x7f5db8008000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.590 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.573+0000 7f5dbdffb700 1 -- 172.21.15.38:0/4007680938 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5db8008bd0 con 0x7f5dc01523e0 2020-06-12T17:48:07.591 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.573+0000 7f5dc586e700 1 --2- 172.21.15.38:0/4007680938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5dc01523e0 0x7f5dc0127380 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f5db80032c0 tx=0x7f5db8008000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.591 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.573+0000 7f5dbdffb700 1 -- 172.21.15.38:0/4007680938 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db8008d30 con 0x7f5dc01523e0 2020-06-12T17:48:07.591 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.573+0000 7f5dc6ad0700 1 -- 172.21.15.38:0/4007680938 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc005b940 con 0x7f5dc01523e0 2020-06-12T17:48:07.591 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.573+0000 7f5dc586e700 1 --2- 172.21.15.38:0/4007680938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5dc01523e0 0x7f5dc0127380 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f5db80032c0 tx=0x7f5db8008000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.591 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.573+0000 7f5dbdffb700 1 -- 172.21.15.38:0/4007680938 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5db8007350 con 0x7f5dc01523e0 2020-06-12T17:48:07.591 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.573+0000 7f5dc6ad0700 1 -- 172.21.15.38:0/4007680938 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc011bdb0 con 0x7f5dc01523e0 2020-06-12T17:48:07.592 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.574+0000 7f5dc586e700 1 --2- 172.21.15.38:0/4007680938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5dc01523e0 0x7f5dc0127380 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f5db80032c0 tx=0x7f5db8008000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.592 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.574+0000 7f5dc6ad0700 1 -- 172.21.15.38:0/4007680938 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc011b8e0 con 0x7f5dc01523e0 2020-06-12T17:48:07.592 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.574+0000 7f5dbdffb700 1 -- 172.21.15.38:0/4007680938 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f5db80075d0 con 0x7f5dc01523e0 2020-06-12T17:48:07.592 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.574+0000 7f5dc586e700 1 --2- 172.21.15.38:0/4007680938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5dc01523e0 0x7f5dc0127380 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f5db80032c0 tx=0x7f5db8008000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.592 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.574+0000 7f5dbdffb700 1 --2- 172.21.15.38:0/4007680938 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5da004d610 0x7f5da004fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:07.593 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.574+0000 7f5dbdffb700 1 -- 172.21.15.38:0/4007680938 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5242+0+0 (secure 0 0 0) 0x7f5db8060ed0 con 0x7f5dc01523e0 2020-06-12T17:48:07.593 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.575+0000 7f5dc506d700 1 --2- 172.21.15.38:0/4007680938 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5da004d610 0x7f5da004fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:07.593 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.575+0000 7f5dc506d700 1 --2- 172.21.15.38:0/4007680938 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5da004d610 0x7f5da004fad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5dc00ad700 tx=0x7f5db0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.593 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.575+0000 7f5dc506d700 1 --2- 172.21.15.38:0/4007680938 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5da004d610 0x7f5da004fad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5dc00ad700 tx=0x7f5db0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.594 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.575+0000 7f5dc506d700 1 --2- 172.21.15.38:0/4007680938 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5da004d610 0x7f5da004fad0 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f5dc00ad700 tx=0x7f5db0007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:07.594 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.578+0000 7f5dc586e700 1 --2- 172.21.15.38:0/4007680938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5dc01523e0 0x7f5dc0127380 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f5db80032c0 tx=0x7f5db8008000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:07.594 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.578+0000 7f5dbdffb700 1 -- 172.21.15.38:0/4007680938 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f5db803c610 con 0x7f5dc01523e0 2020-06-12T17:48:07.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:07.735+0000 7f5dc6ad0700 1 -- 172.21.15.38:0/4007680938 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5dc0056c30 con 0x7f5dc01523e0 2020-06-12T17:48:08.451 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.447+0000 7f5dc586e700 1 --2- 172.21.15.38:0/4007680938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5dc01523e0 0x7f5dc0127380 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f5db80032c0 tx=0x7f5db8008000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.452 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.447+0000 7f5dbdffb700 1 -- 172.21.15.38:0/4007680938 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7f5db803fc30 con 0x7f5dc01523e0 2020-06-12T17:48:08.455 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.450+0000 7f5dc6ad0700 1 -- 172.21.15.38:0/4007680938 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5da004d610 msgr2=0x7f5da004fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:08.455 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.450+0000 7f5dc6ad0700 1 --2- 172.21.15.38:0/4007680938 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5da004d610 0x7f5da004fad0 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f5dc00ad700 tx=0x7f5db0007e60).stop 2020-06-12T17:48:08.455 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.450+0000 7f5dc6ad0700 1 -- 172.21.15.38:0/4007680938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5dc01523e0 msgr2=0x7f5dc0127380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:08.455 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.450+0000 7f5dc6ad0700 1 --2- 172.21.15.38:0/4007680938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5dc01523e0 0x7f5dc0127380 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f5db80032c0 tx=0x7f5db8008000).stop 2020-06-12T17:48:08.456 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.450+0000 7f5dc6ad0700 1 -- 172.21.15.38:0/4007680938 shutdown_connections 2020-06-12T17:48:08.456 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.450+0000 7f5dc6ad0700 1 --2- 172.21.15.38:0/4007680938 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5da004d610 0x7f5da004fad0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:08.456 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.450+0000 7f5dc6ad0700 1 --2- 172.21.15.38:0/4007680938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5dc01523e0 0x7f5dc0127380 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:08.456 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.450+0000 7f5dc6ad0700 1 --2- 172.21.15.38:0/4007680938 >> v2:172.21.15.150:3300/0 conn(0x7f5dc00aee10 0x7f5dc00635d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:08.456 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.450+0000 7f5dc6ad0700 1 --2- 172.21.15.38:0/4007680938 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5dc00b3ca0 0x7f5dc0139790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:08.457 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.450+0000 7f5dc6ad0700 1 -- 172.21.15.38:0/4007680938 >> 172.21.15.38:0/4007680938 conn(0x7f5dc00b8200 msgr2=0x7f5dc0127c70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:08.457 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.450+0000 7f5dc6ad0700 1 -- 172.21.15.38:0/4007680938 shutdown_connections 2020-06-12T17:48:08.457 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.450+0000 7f5dc6ad0700 1 -- 172.21.15.38:0/4007680938 wait complete. 2020-06-12T17:48:08.457 INFO:teuthology.orchestra.run.smithi038.stderr:enabled application 'rbd' on pool 'rbd' 2020-06-12T17:48:08.469 INFO:tasks.ceph:Setting up CephFS filesystem... 2020-06-12T17:48:08.470 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-12T17:48:08.603 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.590+0000 7f393c66e700 1 Processor -- start 2020-06-12T17:48:08.604 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.590+0000 7f393c66e700 1 -- start start 2020-06-12T17:48:08.604 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.591+0000 7f393c66e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f393409bee0 0x7f39340b3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:08.604 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.591+0000 7f393c66e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f39340b38f0 0x7f39340b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:08.604 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.591+0000 7f393c66e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39340b2dc0 con 0x7f3934061a80 2020-06-12T17:48:08.605 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.591+0000 7f393c66e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f393409e560 con 0x7f393409bee0 2020-06-12T17:48:08.605 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.591+0000 7f393c66e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39340b29d0 con 0x7f39340b38f0 2020-06-12T17:48:08.605 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.591+0000 7f3939c09700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f393409bee0 0x7f39340b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:08.605 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.591+0000 7f393a40a700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f3934061a80 0x7f3934142350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37066/0 (socket says 172.21.15.38:37066) 2020-06-12T17:48:08.606 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.591+0000 7f393a40a700 1 -- 172.21.15.38:0/108458974 learned_addr learned my addr 172.21.15.38:0/108458974 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:08.606 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.591+0000 7f393ac0b700 1 --2- 172.21.15.38:0/108458974 >> v2:172.21.15.150:3300/0 conn(0x7f39340b38f0 0x7f39340b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:08.606 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.592+0000 7f3939c09700 1 -- 172.21.15.38:0/108458974 >> v2:172.21.15.150:3300/0 conn(0x7f39340b38f0 msgr2=0x7f39340b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:08.606 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.592+0000 7f3939c09700 1 --2- 172.21.15.38:0/108458974 >> v2:172.21.15.150:3300/0 conn(0x7f39340b38f0 0x7f39340b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:08.606 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.592+0000 7f3939c09700 1 -- 172.21.15.38:0/108458974 >> v1:172.21.15.38:6789/0 conn(0x7f3934061a80 legacy=0x7f3934142350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:08.607 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.592+0000 7f3939408700 1 -- 172.21.15.38:0/108458974 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3810626045 0 0) 0x7f39340b2dc0 con 0x7f3934061a80 2020-06-12T17:48:08.607 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.592+0000 7f3939c09700 1 -- 172.21.15.38:0/108458974 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39340b2ff0 con 0x7f393409bee0 2020-06-12T17:48:08.607 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.592+0000 7f393ac0b700 1 --2- 172.21.15.38:0/108458974 >> v2:172.21.15.150:3300/0 conn(0x7f39340b38f0 0x7f39340b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:08.607 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.592+0000 7f3939c09700 1 --2- 172.21.15.38:0/108458974 >> v2:172.21.15.38:3300/0 conn(0x7f393409bee0 0x7f39340b3490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3930002f30 tx=0x7f3930007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.607 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.592+0000 7f3939c09700 1 --2- 172.21.15.38:0/108458974 >> v2:172.21.15.38:3300/0 conn(0x7f393409bee0 0x7f39340b3490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3930002f30 tx=0x7f3930007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.608 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.592+0000 7f3939c09700 1 --2- 172.21.15.38:0/108458974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f393409bee0 0x7f39340b3490 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f3930002f30 tx=0x7f3930007e60).ready entity=mon.0 client_cookie=cd765e25f6680c3a server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:08.608 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.592+0000 7f3939c09700 1 --2- 172.21.15.38:0/108458974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f393409bee0 0x7f39340b3490 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f3930002f30 tx=0x7f3930007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.608 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.592+0000 7f3939408700 1 -- 172.21.15.38:0/108458974 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3930011430 con 0x7f393409bee0 2020-06-12T17:48:08.608 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.592+0000 7f3939c09700 1 --2- 172.21.15.38:0/108458974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f393409bee0 0x7f39340b3490 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f3930002f30 tx=0x7f3930007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.608 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.592+0000 7f3939c09700 1 --2- 172.21.15.38:0/108458974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f393409bee0 0x7f39340b3490 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f3930002f30 tx=0x7f3930007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.609 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.592+0000 7f3939408700 1 -- 172.21.15.38:0/108458974 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3930011590 con 0x7f393409bee0 2020-06-12T17:48:08.609 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.592+0000 7f3939408700 1 -- 172.21.15.38:0/108458974 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3930011930 con 0x7f393409bee0 2020-06-12T17:48:08.609 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.592+0000 7f393c66e700 1 -- 172.21.15.38:0/108458974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f393409bee0 msgr2=0x7f39340b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:08.609 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.592+0000 7f393c66e700 1 --2- 172.21.15.38:0/108458974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f393409bee0 0x7f39340b3490 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f3930002f30 tx=0x7f3930007e60).stop 2020-06-12T17:48:08.609 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.593+0000 7f393c66e700 1 -- 172.21.15.38:0/108458974 shutdown_connections 2020-06-12T17:48:08.610 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.593+0000 7f393c66e700 1 --2- 172.21.15.38:0/108458974 >> v2:172.21.15.150:3300/0 conn(0x7f39340b38f0 0x7f39340b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:08.610 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.593+0000 7f393c66e700 1 --2- 172.21.15.38:0/108458974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f393409bee0 0x7f39340b3490 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:08.610 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.593+0000 7f393c66e700 1 -- 172.21.15.38:0/108458974 >> 172.21.15.38:0/108458974 conn(0x7f39340b8420 msgr2=0x7f39340b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:08.610 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.593+0000 7f393c66e700 1 -- 172.21.15.38:0/108458974 shutdown_connections 2020-06-12T17:48:08.610 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.593+0000 7f393c66e700 1 -- 172.21.15.38:0/108458974 wait complete. 2020-06-12T17:48:08.611 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.594+0000 7f393c66e700 1 Processor -- start 2020-06-12T17:48:08.611 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.594+0000 7f393c66e700 1 -- start start 2020-06-12T17:48:08.611 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.594+0000 7f393c66e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3934061a80 0x7f39340ad540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:08.611 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.594+0000 7f393c66e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f393409bee0 0x7f3934145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:08.611 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.594+0000 7f393c66e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3934145aa0 con 0x7f39340b38f0 2020-06-12T17:48:08.611 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.594+0000 7f393c66e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39340638d0 con 0x7f3934061a80 2020-06-12T17:48:08.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.594+0000 7f393c66e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3934063b70 con 0x7f393409bee0 2020-06-12T17:48:08.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.594+0000 7f393a40a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3934061a80 0x7f39340ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:08.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.594+0000 7f393a40a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3934061a80 0x7f39340ad540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35256/0 (socket says 172.21.15.38:35256) 2020-06-12T17:48:08.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.594+0000 7f393a40a700 1 -- 172.21.15.38:0/512405525 learned_addr learned my addr 172.21.15.38:0/512405525 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:08.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.595+0000 7f3939c09700 1 --2- 172.21.15.38:0/512405525 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f393409bee0 0x7f3934145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:08.613 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.595+0000 7f393a40a700 1 -- 172.21.15.38:0/512405525 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f393409bee0 msgr2=0x7f3934145640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:08.613 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.595+0000 7f393a40a700 1 --2- 172.21.15.38:0/512405525 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f393409bee0 0x7f3934145640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:08.613 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.595+0000 7f393a40a700 1 -- 172.21.15.38:0/512405525 >> v1:172.21.15.150:6789/0 conn(0x7f39340b38f0 legacy=0x7f39341515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:08.613 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.595+0000 7f393a40a700 1 -- 172.21.15.38:0/512405525 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3934063e10 con 0x7f3934061a80 2020-06-12T17:48:08.613 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.595+0000 7f3939c09700 1 --2- 172.21.15.38:0/512405525 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f393409bee0 0x7f3934145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:08.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.595+0000 7f393a40a700 1 --2- 172.21.15.38:0/512405525 >> v2:172.21.15.38:3300/0 conn(0x7f3934061a80 0x7f39340ad540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3928000b80 tx=0x7f39280016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.595+0000 7f393a40a700 1 --2- 172.21.15.38:0/512405525 >> v2:172.21.15.38:3300/0 conn(0x7f3934061a80 0x7f39340ad540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3928000b80 tx=0x7f39280016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.595+0000 7f393a40a700 1 --2- 172.21.15.38:0/512405525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3934061a80 0x7f39340ad540 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f3928000b80 tx=0x7f39280016e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:08.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.595+0000 7f393a40a700 1 --2- 172.21.15.38:0/512405525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3934061a80 0x7f39340ad540 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f3928000b80 tx=0x7f39280016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.595+0000 7f393a40a700 1 --2- 172.21.15.38:0/512405525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3934061a80 0x7f39340ad540 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f3928000b80 tx=0x7f39280016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.595+0000 7f39277fe700 1 -- 172.21.15.38:0/512405525 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3928005ca0 con 0x7f3934061a80 2020-06-12T17:48:08.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.595+0000 7f393a40a700 1 --2- 172.21.15.38:0/512405525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3934061a80 0x7f39340ad540 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f3928000b80 tx=0x7f39280016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.595+0000 7f39277fe700 1 -- 172.21.15.38:0/512405525 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3928005e00 con 0x7f3934061a80 2020-06-12T17:48:08.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.595+0000 7f393c66e700 1 -- 172.21.15.38:0/512405525 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39340640b0 con 0x7f3934061a80 2020-06-12T17:48:08.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.595+0000 7f39277fe700 1 -- 172.21.15.38:0/512405525 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39280062b0 con 0x7f3934061a80 2020-06-12T17:48:08.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.595+0000 7f393c66e700 1 -- 172.21.15.38:0/512405525 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3934063530 con 0x7f3934061a80 2020-06-12T17:48:08.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.596+0000 7f393a40a700 1 --2- 172.21.15.38:0/512405525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3934061a80 0x7f39340ad540 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f3928000b80 tx=0x7f39280016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.596+0000 7f393a40a700 1 --2- 172.21.15.38:0/512405525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3934061a80 0x7f39340ad540 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f3928000b80 tx=0x7f39280016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.596+0000 7f39277fe700 1 -- 172.21.15.38:0/512405525 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f3928006520 con 0x7f3934061a80 2020-06-12T17:48:08.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.596+0000 7f393c66e700 1 -- 172.21.15.38:0/512405525 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3934056c30 con 0x7f3934061a80 2020-06-12T17:48:08.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.596+0000 7f39277fe700 1 --2- 172.21.15.38:0/512405525 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f391404d4a0 0x7f391404f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:08.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.596+0000 7f39277fe700 1 -- 172.21.15.38:0/512405525 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f3928060fc0 con 0x7f3934061a80 2020-06-12T17:48:08.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.597+0000 7f3939c09700 1 --2- 172.21.15.38:0/512405525 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f391404d4a0 0x7f391404f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:08.622 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.597+0000 7f3939c09700 1 --2- 172.21.15.38:0/512405525 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f391404d4a0 0x7f391404f960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3930002f30 tx=0x7f3930007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.622 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.597+0000 7f3939c09700 1 --2- 172.21.15.38:0/512405525 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f391404d4a0 0x7f391404f960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3930002f30 tx=0x7f3930007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.622 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.597+0000 7f3939c09700 1 --2- 172.21.15.38:0/512405525 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f391404d4a0 0x7f391404f960 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7f3930002f30 tx=0x7f3930007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:08.623 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.600+0000 7f393a40a700 1 --2- 172.21.15.38:0/512405525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3934061a80 0x7f39340ad540 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f3928000b80 tx=0x7f39280016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.623 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.600+0000 7f39277fe700 1 -- 172.21.15.38:0/512405525 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f392803c680 con 0x7f3934061a80 2020-06-12T17:48:08.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.753+0000 7f393c66e700 1 -- 172.21.15.38:0/512405525 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39340b44d0 con 0x7f3934061a80 2020-06-12T17:48:08.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.754+0000 7f393a40a700 1 --2- 172.21.15.38:0/512405525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3934061a80 0x7f39340ad540 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f3928000b80 tx=0x7f39280016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.754+0000 7f39277fe700 1 -- 172.21.15.38:0/512405525 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13239 (secure 0 0 0) 0x7f392803fca0 con 0x7f3934061a80 2020-06-12T17:48:08.759 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:08.760 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":17,"fsid":"8e42a2e7-b187-42c4-a73f-8f812ee62352","created":"2020-06-12T17:47:54.434340+0000","modified":"2020-06-12T17:48:08.440588+0000","last_up_change":"2020-06-12T17:48:03.388718+0000","last_in_change":"2020-06-12T17:48:03.388718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-06-12T17:47:57.558119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-06-12T17:48:07.419264+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"44ac3dea-67b4-4b9a-bc18-ac511710afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":31038},{"type":"v1","addr":"172.21.15.38:6816","nonce":31038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":31038},{"type":"v1","addr":"172.21.15.38:6819","nonce":31038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":31038},{"type":"v1","addr":"172.21.15.38:6823","nonce":31038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":31038},{"type":"v1","addr":"172.21.15.38:6821","nonce":31038}]},"public_addr":"172.21.15.38:6816/31038","cluster_addr":"172.21.15.38:6819/31038","heartbeat_back_addr":"172.21.15.38:6823/31038","heartbeat_front_addr":"172.21.15.38:6821/31038","state":["exists","up"]},{"osd":1,"uuid":"561f7ced-3fff-4364-8619-6e4ecbc9d256","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":31036},{"type":"v1","addr":"172.21.15.38:6801","nonce":31036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":31036},{"type":"v1","addr":"172.21.15.38:6803","nonce":31036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":31036},{"type":"v1","addr":"172.21.15.38:6807","nonce":31036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":31036},{"type":"v1","addr":"172.21.15.38:6805","nonce":31036}]},"public_addr":"172.21.15.38:6801/31036","cluster_addr":"172.21.15.38:6803/31036","heartbeat_back_addr":"172.21.15.38:6807/31036","heartbeat_front_addr":"172.21.15.38:6805/31036","state":["exists","up"]},{"osd":2,"uuid":"0bb3c806-07af-49f5-b492-d0e33f2de37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":31053},{"type":"v1","addr":"172.21.15.38:6825","nonce":31053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":31053},{"type":"v1","addr":"172.21.15.38:6827","nonce":31053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":31053},{"type":"v1","addr":"172.21.15.38:6831","nonce":31053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":31053},{"type":"v1","addr":"172.21.15.38:6829","nonce":31053}]},"public_addr":"172.21.15.38:6825/31053","cluster_addr":"172.21.15.38:6827/31053","heartbeat_back_addr":"172.21.15.38:6831/31053","heartbeat_front_addr":"172.21.15.38:6829/31053","state":["exists","up"]},{"osd":3,"uuid":"7f6a1e75-7b11-456e-8a4b-510b16226800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":31037},{"type":"v1","addr":"172.21.15.38:6809","nonce":31037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":31037},{"type":"v1","addr":"172.21.15.38:6811","nonce":31037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6815","nonce":31037},{"type":"v1","addr":"172.21.15.38:6817","nonce":31037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":31037},{"type":"v1","addr":"172.21.15.38:6813","nonce":31037}]},"public_addr":"172.21.15.38:6809/31037","cluster_addr":"172.21.15.38:6811/31037","heartbeat_back_addr":"172.21.15.38:6817/31037","heartbeat_front_addr":"172.21.15.38:6813/31037","state":["exists","up"]},{"osd":4,"uuid":"0eca0272-8cfd-469c-a32d-e29730dc0e1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":31294},{"type":"v1","addr":"172.21.15.150:6803","nonce":31294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":31294},{"type":"v1","addr":"172.21.15.150:6805","nonce":31294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":31294},{"type":"v1","addr":"172.21.15.150:6809","nonce":31294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":31294},{"type":"v1","addr":"172.21.15.150:6807","nonce":31294}]},"public_addr":"172.21.15.150:6803/31294","cluster_addr":"172.21.15.150:6805/31294","heartbeat_back_addr":"172.21.15.150:6809/31294","heartbeat_front_addr":"172.21.15.150:6807/31294","state":["exists","up"]},{"osd":5,"uuid":"69d6a7dc-a55a-4ebc-8479-8bb921ddfb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":31295},{"type":"v1","addr":"172.21.15.150:6813","nonce":31295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":31295},{"type":"v1","addr":"172.21.15.150:6816","nonce":31295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":31295},{"type":"v1","addr":"172.21.15.150:6828","nonce":31295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6819","nonce":31295},{"type":"v1","addr":"172.21.15.150:6822","nonce":31295}]},"public_addr":"172.21.15.150:6813/31295","cluster_addr":"172.21.15.150:6816/31295","heartbeat_back_addr":"172.21.15.150:6828/31295","heartbeat_front_addr":"172.21.15.150:6822/31295","state":["exists","up"]},{"osd":6,"uuid":"f0d320f8-c2f0-40bb-b713-526246cf97b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":31297},{"type":"v1","addr":"172.21.15.150:6820","nonce":31297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6823","nonce":31297},{"type":"v1","addr":"172.21.15.150:6827","nonce":31297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":31297},{"type":"v1","addr":"172.21.15.150:6833","nonce":31297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":31297},{"type":"v1","addr":"172.21.15.150:6831","nonce":31297}]},"public_addr":"172.21.15.150:6820/31297","cluster_addr":"172.21.15.150:6827/31297","heartbeat_back_addr":"172.21.15.150:6833/31297","heartbeat_front_addr":"172.21.15.150:6831/31297","state":["exists","up"]},{"osd":7,"uuid":"970b7d02-a189-41b2-96e5-a5a5a57c6476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":31296},{"type":"v1","addr":"172.21.15.150:6812","nonce":31296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":31296},{"type":"v1","addr":"172.21.15.150:6818","nonce":31296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":31296},{"type":"v1","addr":"172.21.15.150:6829","nonce":31296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":31296},{"type":"v1","addr":"172.21.15.150:6824","nonce":31296}]},"public_addr":"172.21.15.150:6812/31296","cluster_addr":"172.21.15.150:6818/31296","heartbeat_back_addr":"172.21.15.150:6829/31296","heartbeat_front_addr":"172.21.15.150:6824/31296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.664300+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.644253+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.651120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.584978+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.561149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.661778+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T17:48:08.761 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.755+0000 7f393c66e700 1 -- 172.21.15.38:0/512405525 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f391404d4a0 msgr2=0x7f391404f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:08.761 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.755+0000 7f393c66e700 1 --2- 172.21.15.38:0/512405525 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f391404d4a0 0x7f391404f960 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7f3930002f30 tx=0x7f3930007e60).stop 2020-06-12T17:48:08.761 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.756+0000 7f393c66e700 1 -- 172.21.15.38:0/512405525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3934061a80 msgr2=0x7f39340ad540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:08.761 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.756+0000 7f393c66e700 1 --2- 172.21.15.38:0/512405525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3934061a80 0x7f39340ad540 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f3928000b80 tx=0x7f39280016e0).stop 2020-06-12T17:48:08.762 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.756+0000 7f393c66e700 1 -- 172.21.15.38:0/512405525 shutdown_connections 2020-06-12T17:48:08.762 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.756+0000 7f393c66e700 1 --2- 172.21.15.38:0/512405525 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f391404d4a0 0x7f391404f960 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:08.762 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.756+0000 7f393c66e700 1 --2- 172.21.15.38:0/512405525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3934061a80 0x7f39340ad540 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:08.762 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.756+0000 7f393c66e700 1 --2- 172.21.15.38:0/512405525 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f393409bee0 0x7f3934145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:08.762 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.756+0000 7f393c66e700 1 -- 172.21.15.38:0/512405525 >> 172.21.15.38:0/512405525 conn(0x7f39340b8420 msgr2=0x7f39340b3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:08.763 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.756+0000 7f393c66e700 1 -- 172.21.15.38:0/512405525 shutdown_connections 2020-06-12T17:48:08.763 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.756+0000 7f393c66e700 1 -- 172.21.15.38:0/512405525 wait complete. 2020-06-12T17:48:08.771 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-06-12T17:47:57.558119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-06-12T17:48:07.419264+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-06-12T17:48:08.772 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-06-12T17:48:08.897 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.884+0000 7f18ef456700 1 Processor -- start 2020-06-12T17:48:08.898 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.884+0000 7f18ef456700 1 -- start start 2020-06-12T17:48:08.898 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.885+0000 7f18ef456700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f18e80a2460 0x7f18e80a2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:08.898 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.885+0000 7f18ef456700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e805f7a0 con 0x7f18e8146060 2020-06-12T17:48:08.899 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.885+0000 7f18ef456700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e805fa40 con 0x7f18e813fc90 2020-06-12T17:48:08.899 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.885+0000 7f18ef456700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e805f2b0 con 0x7f18e80a2460 2020-06-12T17:48:08.899 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.885+0000 7f18ed1f2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f18e80a2460 0x7f18e80a2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:08.899 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.885+0000 7f18ec9f1700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f18e8146060 0x7f18e809d8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37080/0 (socket says 172.21.15.38:37080) 2020-06-12T17:48:08.899 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.885+0000 7f18ed1f2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f18e80a2460 0x7f18e80a2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35264/0 (socket says 172.21.15.38:35264) 2020-06-12T17:48:08.900 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.885+0000 7f18ec9f1700 1 -- 172.21.15.38:0/2366353347 learned_addr learned my addr 172.21.15.38:0/2366353347 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:08.900 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.886+0000 7f18ed1f2700 1 -- 172.21.15.38:0/2366353347 >> v1:172.21.15.150:6789/0 conn(0x7f18e813fc90 legacy=0x7f18e805fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:08.900 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.886+0000 7f18ed1f2700 1 -- 172.21.15.38:0/2366353347 >> v1:172.21.15.38:6789/0 conn(0x7f18e8146060 legacy=0x7f18e809d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:08.900 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.886+0000 7f18d7fff700 1 -- 172.21.15.38:0/2366353347 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 700529432 0 0) 0x7f18e805f7a0 con 0x7f18e8146060 2020-06-12T17:48:08.900 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.886+0000 7f18ed1f2700 1 -- 172.21.15.38:0/2366353347 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e809dfc0 con 0x7f18e80a2460 2020-06-12T17:48:08.901 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.886+0000 7f18ed1f2700 1 --2- 172.21.15.38:0/2366353347 >> v2:172.21.15.38:3300/0 conn(0x7f18e80a2460 0x7f18e80a2840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f18d8002f30 tx=0x7f18d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.901 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.886+0000 7f18ed1f2700 1 --2- 172.21.15.38:0/2366353347 >> v2:172.21.15.38:3300/0 conn(0x7f18e80a2460 0x7f18e80a2840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f18d8002f30 tx=0x7f18d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.901 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.886+0000 7f18ed1f2700 1 --2- 172.21.15.38:0/2366353347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e80a2460 0x7f18e80a2840 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f18d8002f30 tx=0x7f18d8007e60).ready entity=mon.0 client_cookie=4b59b3fcaf0a556 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:08.901 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.886+0000 7f18ed1f2700 1 --2- 172.21.15.38:0/2366353347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e80a2460 0x7f18e80a2840 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f18d8002f30 tx=0x7f18d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.901 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.886+0000 7f18d7fff700 1 -- 172.21.15.38:0/2366353347 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18d8011430 con 0x7f18e80a2460 2020-06-12T17:48:08.902 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.886+0000 7f18ed1f2700 1 --2- 172.21.15.38:0/2366353347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e80a2460 0x7f18e80a2840 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f18d8002f30 tx=0x7f18d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.902 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.886+0000 7f18ed1f2700 1 --2- 172.21.15.38:0/2366353347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e80a2460 0x7f18e80a2840 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f18d8002f30 tx=0x7f18d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.902 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.886+0000 7f18d7fff700 1 -- 172.21.15.38:0/2366353347 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d8011590 con 0x7f18e80a2460 2020-06-12T17:48:08.903 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.886+0000 7f18d7fff700 1 -- 172.21.15.38:0/2366353347 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18d80118f0 con 0x7f18e80a2460 2020-06-12T17:48:08.903 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.886+0000 7f18ef456700 1 -- 172.21.15.38:0/2366353347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e80a2460 msgr2=0x7f18e80a2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:08.903 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.886+0000 7f18ef456700 1 --2- 172.21.15.38:0/2366353347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e80a2460 0x7f18e80a2840 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f18d8002f30 tx=0x7f18d8007e60).stop 2020-06-12T17:48:08.903 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.886+0000 7f18ef456700 1 -- 172.21.15.38:0/2366353347 shutdown_connections 2020-06-12T17:48:08.903 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.886+0000 7f18ef456700 1 --2- 172.21.15.38:0/2366353347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e80a2460 0x7f18e80a2840 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:08.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.886+0000 7f18ef456700 1 -- 172.21.15.38:0/2366353347 >> 172.21.15.38:0/2366353347 conn(0x7f18e805b450 msgr2=0x7f18e805b860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:08.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.887+0000 7f18ef456700 1 -- 172.21.15.38:0/2366353347 shutdown_connections 2020-06-12T17:48:08.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.887+0000 7f18ef456700 1 -- 172.21.15.38:0/2366353347 wait complete. 2020-06-12T17:48:08.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.887+0000 7f18ef456700 1 Processor -- start 2020-06-12T17:48:08.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.888+0000 7f18ef456700 1 -- start start 2020-06-12T17:48:08.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.888+0000 7f18ef456700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18e80a2460 0x7f18e8153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:08.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.888+0000 7f18ef456700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f18e8146060 0x7f18e8152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:08.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.888+0000 7f18ef456700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e809fe70 con 0x7f18e813fc90 2020-06-12T17:48:08.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.888+0000 7f18ef456700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e80a0110 con 0x7f18e8146060 2020-06-12T17:48:08.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.888+0000 7f18ef456700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e80a15c0 con 0x7f18e80a2460 2020-06-12T17:48:08.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.888+0000 7f18ed9f3700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f18e8146060 0x7f18e8152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:08.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.888+0000 7f18ec9f1700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f18e813fc90 0x7f18e8156de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37086/0 (socket says 172.21.15.38:37086) 2020-06-12T17:48:08.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.888+0000 7f18ec9f1700 1 -- 172.21.15.38:0/3979610249 learned_addr learned my addr 172.21.15.38:0/3979610249 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:08.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.888+0000 7f18ed1f2700 1 --2- 172.21.15.38:0/3979610249 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18e80a2460 0x7f18e8153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:08.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.889+0000 7f18ed9f3700 1 -- 172.21.15.38:0/3979610249 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18e80a2460 msgr2=0x7f18e8153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:08.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.889+0000 7f18ed9f3700 1 --2- 172.21.15.38:0/3979610249 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18e80a2460 0x7f18e8153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:08.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.889+0000 7f18ed9f3700 1 -- 172.21.15.38:0/3979610249 >> v1:172.21.15.38:6789/0 conn(0x7f18e813fc90 legacy=0x7f18e8156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:08.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.889+0000 7f18d67fc700 1 -- 172.21.15.38:0/3979610249 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 740354448 0 0) 0x7f18e809fe70 con 0x7f18e813fc90 2020-06-12T17:48:08.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.889+0000 7f18ed9f3700 1 -- 172.21.15.38:0/3979610249 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e8143710 con 0x7f18e8146060 2020-06-12T17:48:08.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.889+0000 7f18ed1f2700 1 --2- 172.21.15.38:0/3979610249 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18e80a2460 0x7f18e8153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:48:08.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.889+0000 7f18ed9f3700 1 --2- 172.21.15.38:0/3979610249 >> v2:172.21.15.38:3300/0 conn(0x7f18e8146060 0x7f18e8152920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f18e0001360 tx=0x7f18e0001b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.889+0000 7f18ed9f3700 1 --2- 172.21.15.38:0/3979610249 >> v2:172.21.15.38:3300/0 conn(0x7f18e8146060 0x7f18e8152920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f18e0001360 tx=0x7f18e0001b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.889+0000 7f18ed9f3700 1 --2- 172.21.15.38:0/3979610249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e8146060 0x7f18e8152920 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f18e0001360 tx=0x7f18e0001b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:08.909 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.889+0000 7f18ed9f3700 1 --2- 172.21.15.38:0/3979610249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e8146060 0x7f18e8152920 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f18e0001360 tx=0x7f18e0001b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.909 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.889+0000 7f18d67fc700 1 -- 172.21.15.38:0/3979610249 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18e00101c0 con 0x7f18e8146060 2020-06-12T17:48:08.909 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.889+0000 7f18ed9f3700 1 --2- 172.21.15.38:0/3979610249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e8146060 0x7f18e8152920 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f18e0001360 tx=0x7f18e0001b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.909 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.889+0000 7f18ed9f3700 1 --2- 172.21.15.38:0/3979610249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e8146060 0x7f18e8152920 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f18e0001360 tx=0x7f18e0001b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.909 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.889+0000 7f18d67fc700 1 -- 172.21.15.38:0/3979610249 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e0010360 con 0x7f18e8146060 2020-06-12T17:48:08.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.889+0000 7f18ef456700 1 -- 172.21.15.38:0/3979610249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e8140ec0 con 0x7f18e8146060 2020-06-12T17:48:08.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.889+0000 7f18d67fc700 1 -- 172.21.15.38:0/3979610249 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18e0010740 con 0x7f18e8146060 2020-06-12T17:48:08.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.889+0000 7f18ef456700 1 -- 172.21.15.38:0/3979610249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e8157730 con 0x7f18e8146060 2020-06-12T17:48:08.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.889+0000 7f18ed9f3700 1 --2- 172.21.15.38:0/3979610249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e8146060 0x7f18e8152920 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f18e0001360 tx=0x7f18e0001b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.890+0000 7f18d67fc700 1 -- 172.21.15.38:0/3979610249 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f18e0006860 con 0x7f18e8146060 2020-06-12T17:48:08.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.890+0000 7f18ed9f3700 1 --2- 172.21.15.38:0/3979610249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e8146060 0x7f18e8152920 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f18e0001360 tx=0x7f18e0001b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.890+0000 7f18ef456700 1 -- 172.21.15.38:0/3979610249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e8056c30 con 0x7f18e8146060 2020-06-12T17:48:08.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.890+0000 7f18d67fc700 1 --2- 172.21.15.38:0/3979610249 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f18c804d470 0x7f18c804f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:08.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.890+0000 7f18d67fc700 1 -- 172.21.15.38:0/3979610249 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f18e00610d0 con 0x7f18e8146060 2020-06-12T17:48:08.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.890+0000 7f18ed1f2700 1 --2- 172.21.15.38:0/3979610249 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f18c804d470 0x7f18c804f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:08.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.891+0000 7f18ed1f2700 1 --2- 172.21.15.38:0/3979610249 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f18c804d470 0x7f18c804f930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f18d8002f30 tx=0x7f18d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.891+0000 7f18ed1f2700 1 --2- 172.21.15.38:0/3979610249 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f18c804d470 0x7f18c804f930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f18d8002f30 tx=0x7f18d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.891+0000 7f18ed1f2700 1 --2- 172.21.15.38:0/3979610249 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f18c804d470 0x7f18c804f930 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f18d8002f30 tx=0x7f18d8007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:08.913 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.894+0000 7f18ed9f3700 1 --2- 172.21.15.38:0/3979610249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e8146060 0x7f18e8152920 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f18e0001360 tx=0x7f18e0001b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:08.913 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:08.894+0000 7f18d67fc700 1 -- 172.21.15.38:0/3979610249 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f18e003c890 con 0x7f18e8146060 2020-06-12T17:48:09.048 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.044+0000 7f18ef456700 1 -- 172.21.15.38:0/3979610249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f18e805a5e0 con 0x7f18e8146060 2020-06-12T17:48:09.049 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.044+0000 7f18ed9f3700 1 --2- 172.21.15.38:0/3979610249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e8146060 0x7f18e8152920 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f18e0001360 tx=0x7f18e0001b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.049 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.044+0000 7f18d67fc700 1 -- 172.21.15.38:0/3979610249 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7f18e003feb0 con 0x7f18e8146060 2020-06-12T17:48:09.050 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2020-06-12T17:48:09.051 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.045+0000 7f18ef456700 1 -- 172.21.15.38:0/3979610249 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f18c804d470 msgr2=0x7f18c804f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:09.051 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.045+0000 7f18ef456700 1 --2- 172.21.15.38:0/3979610249 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f18c804d470 0x7f18c804f930 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f18d8002f30 tx=0x7f18d8007e60).stop 2020-06-12T17:48:09.051 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.045+0000 7f18ef456700 1 -- 172.21.15.38:0/3979610249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e8146060 msgr2=0x7f18e8152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:09.051 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.045+0000 7f18ef456700 1 --2- 172.21.15.38:0/3979610249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e8146060 0x7f18e8152920 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f18e0001360 tx=0x7f18e0001b50).stop 2020-06-12T17:48:09.052 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.045+0000 7f18ef456700 1 -- 172.21.15.38:0/3979610249 shutdown_connections 2020-06-12T17:48:09.052 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.046+0000 7f18ef456700 1 --2- 172.21.15.38:0/3979610249 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f18c804d470 0x7f18c804f930 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:09.052 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.046+0000 7f18ef456700 1 --2- 172.21.15.38:0/3979610249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e8146060 0x7f18e8152920 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:09.052 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.046+0000 7f18ef456700 1 --2- 172.21.15.38:0/3979610249 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18e80a2460 0x7f18e8153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:09.052 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.046+0000 7f18ef456700 1 -- 172.21.15.38:0/3979610249 >> 172.21.15.38:0/3979610249 conn(0x7f18e805b450 msgr2=0x7f18e806a440 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:09.053 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.046+0000 7f18ef456700 1 -- 172.21.15.38:0/3979610249 shutdown_connections 2020-06-12T17:48:09.053 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.046+0000 7f18ef456700 1 -- 172.21.15.38:0/3979610249 wait complete. 2020-06-12T17:48:09.062 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-06-12T17:48:09.179 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.175+0000 7f81aee4e700 1 Processor -- start 2020-06-12T17:48:09.180 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.175+0000 7f81aee4e700 1 -- start start 2020-06-12T17:48:09.183 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.175+0000 7f81aee4e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f81a809dd30 0x7f81a8066b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:09.183 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.175+0000 7f81aee4e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a81438f0 0x7f81a80b3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:09.184 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.175+0000 7f81aee4e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a8147550 con 0x7f81a809b190 2020-06-12T17:48:09.184 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.175+0000 7f81aee4e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a8067380 con 0x7f81a809dd30 2020-06-12T17:48:09.185 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.175+0000 7f81aee4e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a809e110 con 0x7f81a81438f0 2020-06-12T17:48:09.185 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.176+0000 7f81ad3eb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a81438f0 0x7f81a80b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:09.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.176+0000 7f81acbea700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f81a809dd30 0x7f81a8066b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:09.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.176+0000 7f81acbea700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f81a809dd30 0x7f81a8066b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:44752/0 (socket says 172.21.15.38:44752) 2020-06-12T17:48:09.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.176+0000 7f81ad3eb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a81438f0 0x7f81a80b3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:54734/0 (socket says 172.21.15.38:54734) 2020-06-12T17:48:09.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.176+0000 7f81acbea700 1 -- 172.21.15.38:0/2732492736 learned_addr learned my addr 172.21.15.38:0/2732492736 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:09.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.176+0000 7f81a7fff700 1 --1- 172.21.15.38:0/2732492736 >> v1:172.21.15.150:6789/0 conn(0x7f81a809b190 0x7f81a81431e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:57824/0 (socket says 172.21.15.38:57824) 2020-06-12T17:48:09.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.176+0000 7f81a77fe700 1 -- 172.21.15.38:0/2732492736 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2563647099 0 0) 0x7f81a8147550 con 0x7f81a809b190 2020-06-12T17:48:09.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.176+0000 7f81a77fe700 1 -- 172.21.15.38:0/2732492736 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8194003230 con 0x7f81a809b190 2020-06-12T17:48:09.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.176+0000 7f81ad3eb700 1 -- 172.21.15.38:0/2732492736 >> v2:172.21.15.150:3300/0 conn(0x7f81a809dd30 msgr2=0x7f81a8066b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:09.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.176+0000 7f81ad3eb700 1 --2- 172.21.15.38:0/2732492736 >> v2:172.21.15.150:3300/0 conn(0x7f81a809dd30 0x7f81a8066b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:09.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.176+0000 7f81ad3eb700 1 -- 172.21.15.38:0/2732492736 >> v1:172.21.15.150:6789/0 conn(0x7f81a809b190 legacy=0x7f81a81431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:09.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.176+0000 7f81ad3eb700 1 -- 172.21.15.38:0/2732492736 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a8067000 con 0x7f81a81438f0 2020-06-12T17:48:09.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.176+0000 7f81ad3eb700 1 --2- 172.21.15.38:0/2732492736 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a81438f0 0x7f81a80b3230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f81a00032b0 tx=0x7f81a00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.176+0000 7f81ad3eb700 1 --2- 172.21.15.38:0/2732492736 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a81438f0 0x7f81a80b3230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f81a00032b0 tx=0x7f81a00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.176+0000 7f81ad3eb700 1 --2- 172.21.15.38:0/2732492736 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a81438f0 0x7f81a80b3230 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7f81a00032b0 tx=0x7f81a00081e0).ready entity=mon.2 client_cookie=fe65d71da6885fc2 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:09.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.177+0000 7f81ad3eb700 1 --2- 172.21.15.38:0/2732492736 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a81438f0 0x7f81a80b3230 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f81a00032b0 tx=0x7f81a00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.192 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.177+0000 7f81a77fe700 1 -- 172.21.15.38:0/2732492736 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81a0011d30 con 0x7f81a81438f0 2020-06-12T17:48:09.192 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.177+0000 7f81ad3eb700 1 --2- 172.21.15.38:0/2732492736 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a81438f0 0x7f81a80b3230 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f81a00032b0 tx=0x7f81a00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.193 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.177+0000 7f81ad3eb700 1 --2- 172.21.15.38:0/2732492736 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a81438f0 0x7f81a80b3230 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f81a00032b0 tx=0x7f81a00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.193 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.177+0000 7f81a77fe700 1 -- 172.21.15.38:0/2732492736 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a0011e90 con 0x7f81a81438f0 2020-06-12T17:48:09.193 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.177+0000 7f81a77fe700 1 -- 172.21.15.38:0/2732492736 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81a000a350 con 0x7f81a81438f0 2020-06-12T17:48:09.193 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.177+0000 7f81aee4e700 1 -- 172.21.15.38:0/2732492736 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a81438f0 msgr2=0x7f81a80b3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:09.194 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.177+0000 7f81aee4e700 1 --2- 172.21.15.38:0/2732492736 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a81438f0 0x7f81a80b3230 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7f81a00032b0 tx=0x7f81a00081e0).stop 2020-06-12T17:48:09.194 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.177+0000 7f81aee4e700 1 -- 172.21.15.38:0/2732492736 shutdown_connections 2020-06-12T17:48:09.194 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.177+0000 7f81aee4e700 1 --2- 172.21.15.38:0/2732492736 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a81438f0 0x7f81a80b3230 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:09.194 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.177+0000 7f81aee4e700 1 --2- 172.21.15.38:0/2732492736 >> v2:172.21.15.150:3300/0 conn(0x7f81a809dd30 0x7f81a8066b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:09.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.177+0000 7f81aee4e700 1 -- 172.21.15.38:0/2732492736 >> 172.21.15.38:0/2732492736 conn(0x7f81a80b5a20 msgr2=0x7f81a805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:09.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.177+0000 7f81aee4e700 1 -- 172.21.15.38:0/2732492736 shutdown_connections 2020-06-12T17:48:09.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.177+0000 7f81aee4e700 1 -- 172.21.15.38:0/2732492736 wait complete. 2020-06-12T17:48:09.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.178+0000 7f81aee4e700 1 Processor -- start 2020-06-12T17:48:09.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.178+0000 7f81aee4e700 1 -- start start 2020-06-12T17:48:09.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.179+0000 7f81aee4e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a809b190 0x7f81a8146340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:09.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.179+0000 7f81aee4e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f81a809dd30 0x7f81a808f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:09.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.179+0000 7f81aee4e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f81a81438f0 0x7f81a8150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:09.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.179+0000 7f81aee4e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a81467a0 con 0x7f81a809dd30 2020-06-12T17:48:09.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.179+0000 7f81aee4e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a808f520 con 0x7f81a81438f0 2020-06-12T17:48:09.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.179+0000 7f81aee4e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a8151590 con 0x7f81a809b190 2020-06-12T17:48:09.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.179+0000 7f81a7fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f81a809dd30 0x7f81a808f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:09.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.179+0000 7f81a7fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f81a809dd30 0x7f81a808f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35282/0 (socket says 172.21.15.38:35282) 2020-06-12T17:48:09.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.179+0000 7f81a7fff700 1 -- 172.21.15.38:0/745392051 learned_addr learned my addr 172.21.15.38:0/745392051 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:09.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.179+0000 7f81ad3eb700 1 --2- 172.21.15.38:0/745392051 >> v2:172.21.15.150:3300/0 conn(0x7f81a81438f0 0x7f81a8150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:09.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.179+0000 7f81acbea700 1 --2- 172.21.15.38:0/745392051 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a809b190 0x7f81a8146340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:09.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.179+0000 7f81a7fff700 1 -- 172.21.15.38:0/745392051 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a809b190 msgr2=0x7f81a8146340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:09.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.179+0000 7f81a7fff700 1 --2- 172.21.15.38:0/745392051 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a809b190 0x7f81a8146340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:09.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.179+0000 7f81a7fff700 1 -- 172.21.15.38:0/745392051 >> v2:172.21.15.150:3300/0 conn(0x7f81a81438f0 msgr2=0x7f81a8150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:09.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.179+0000 7f81a7fff700 1 --2- 172.21.15.38:0/745392051 >> v2:172.21.15.150:3300/0 conn(0x7f81a81438f0 0x7f81a8150560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:09.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.179+0000 7f81a7fff700 1 -- 172.21.15.38:0/745392051 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a8151830 con 0x7f81a809dd30 2020-06-12T17:48:09.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.179+0000 7f81a7fff700 1 --2- 172.21.15.38:0/745392051 >> v2:172.21.15.38:3300/0 conn(0x7f81a809dd30 0x7f81a808f0c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f819c0010d0 tx=0x7f819c001890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.180+0000 7f81a7fff700 1 --2- 172.21.15.38:0/745392051 >> v2:172.21.15.38:3300/0 conn(0x7f81a809dd30 0x7f81a808f0c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f819c0010d0 tx=0x7f819c001890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.180+0000 7f81a7fff700 1 --2- 172.21.15.38:0/745392051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81a809dd30 0x7f81a808f0c0 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f819c0010d0 tx=0x7f819c001890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:09.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.180+0000 7f81a7fff700 1 --2- 172.21.15.38:0/745392051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81a809dd30 0x7f81a808f0c0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f819c0010d0 tx=0x7f819c001890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.180+0000 7f81a5ffb700 1 -- 172.21.15.38:0/745392051 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f819c010440 con 0x7f81a809dd30 2020-06-12T17:48:09.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.180+0000 7f81a7fff700 1 --2- 172.21.15.38:0/745392051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81a809dd30 0x7f81a808f0c0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f819c0010d0 tx=0x7f819c001890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.180+0000 7f81aee4e700 1 -- 172.21.15.38:0/745392051 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a8064d20 con 0x7f81a809dd30 2020-06-12T17:48:09.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.180+0000 7f81a5ffb700 1 -- 172.21.15.38:0/745392051 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819c00ca50 con 0x7f81a809dd30 2020-06-12T17:48:09.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.180+0000 7f81a7fff700 1 --2- 172.21.15.38:0/745392051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81a809dd30 0x7f81a808f0c0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f819c0010d0 tx=0x7f819c001890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.180+0000 7f81a5ffb700 1 -- 172.21.15.38:0/745392051 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f819c00ce30 con 0x7f81a809dd30 2020-06-12T17:48:09.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.180+0000 7f81aee4e700 1 -- 172.21.15.38:0/745392051 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a8152130 con 0x7f81a809dd30 2020-06-12T17:48:09.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.180+0000 7f81a7fff700 1 --2- 172.21.15.38:0/745392051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81a809dd30 0x7f81a808f0c0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f819c0010d0 tx=0x7f819c001890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.181+0000 7f81aee4e700 1 -- 172.21.15.38:0/745392051 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a8056c30 con 0x7f81a809dd30 2020-06-12T17:48:09.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.181+0000 7f81a5ffb700 1 -- 172.21.15.38:0/745392051 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f819c005520 con 0x7f81a809dd30 2020-06-12T17:48:09.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.181+0000 7f81a7fff700 1 --2- 172.21.15.38:0/745392051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81a809dd30 0x7f81a808f0c0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f819c0010d0 tx=0x7f819c001890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.181+0000 7f81a5ffb700 1 --2- 172.21.15.38:0/745392051 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f818804d6a0 0x7f818804fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:09.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.181+0000 7f81a5ffb700 1 -- 172.21.15.38:0/745392051 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f819c060920 con 0x7f81a809dd30 2020-06-12T17:48:09.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.181+0000 7f81acbea700 1 --2- 172.21.15.38:0/745392051 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f818804d6a0 0x7f818804fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:09.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.181+0000 7f81acbea700 1 --2- 172.21.15.38:0/745392051 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f818804d6a0 0x7f818804fb60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8198002f30 tx=0x7f8198007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.182+0000 7f81acbea700 1 --2- 172.21.15.38:0/745392051 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f818804d6a0 0x7f818804fb60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8198002f30 tx=0x7f8198007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.182+0000 7f81acbea700 1 --2- 172.21.15.38:0/745392051 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f818804d6a0 0x7f818804fb60 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f8198002f30 tx=0x7f8198007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:09.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.184+0000 7f81a7fff700 1 --2- 172.21.15.38:0/745392051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81a809dd30 0x7f81a808f0c0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f819c0010d0 tx=0x7f819c001890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.184+0000 7f81a5ffb700 1 -- 172.21.15.38:0/745392051 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f819c03c060 con 0x7f81a809dd30 2020-06-12T17:48:09.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.335+0000 7f81aee4e700 1 -- 172.21.15.38:0/745392051 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f81a805a5e0 con 0x7f81a809dd30 2020-06-12T17:48:09.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.336+0000 7f81a7fff700 1 --2- 172.21.15.38:0/745392051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81a809dd30 0x7f81a808f0c0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f819c0010d0 tx=0x7f819c001890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.336+0000 7f81a5ffb700 1 -- 172.21.15.38:0/745392051 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f819c0100b0 con 0x7f81a809dd30 2020-06-12T17:48:09.341 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:09.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.337+0000 7f81aee4e700 1 -- 172.21.15.38:0/745392051 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f818804d6a0 msgr2=0x7f818804fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:09.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.337+0000 7f81aee4e700 1 --2- 172.21.15.38:0/745392051 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f818804d6a0 0x7f818804fb60 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f8198002f30 tx=0x7f8198007e60).stop 2020-06-12T17:48:09.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.337+0000 7f81aee4e700 1 -- 172.21.15.38:0/745392051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81a809dd30 msgr2=0x7f81a808f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:09.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.337+0000 7f81aee4e700 1 --2- 172.21.15.38:0/745392051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81a809dd30 0x7f81a808f0c0 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f819c0010d0 tx=0x7f819c001890).stop 2020-06-12T17:48:09.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.337+0000 7f81aee4e700 1 -- 172.21.15.38:0/745392051 shutdown_connections 2020-06-12T17:48:09.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.337+0000 7f81aee4e700 1 --2- 172.21.15.38:0/745392051 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f818804d6a0 0x7f818804fb60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:09.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.337+0000 7f81aee4e700 1 --2- 172.21.15.38:0/745392051 >> v2:172.21.15.150:3300/0 conn(0x7f81a81438f0 0x7f81a8150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:09.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.337+0000 7f81aee4e700 1 --2- 172.21.15.38:0/745392051 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a809b190 0x7f81a8146340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:09.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.337+0000 7f81aee4e700 1 --2- 172.21.15.38:0/745392051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81a809dd30 0x7f81a808f0c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:09.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.337+0000 7f81aee4e700 1 -- 172.21.15.38:0/745392051 >> 172.21.15.38:0/745392051 conn(0x7f81a80b5a20 msgr2=0x7f81a80b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:09.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.337+0000 7f81aee4e700 1 -- 172.21.15.38:0/745392051 shutdown_connections 2020-06-12T17:48:09.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.337+0000 7f81aee4e700 1 -- 172.21.15.38:0/745392051 wait complete. 2020-06-12T17:48:09.352 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-06-12T17:48:09.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.464+0000 7f568fc54700 1 Processor -- start 2020-06-12T17:48:09.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.464+0000 7f568fc54700 1 -- start start 2020-06-12T17:48:09.472 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.465+0000 7f568fc54700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56880b49e0 0x7f568805b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:09.472 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.465+0000 7f568fc54700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f568809b920 con 0x7f5688145b00 2020-06-12T17:48:09.473 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.465+0000 7f568fc54700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5688067250 con 0x7f56880623f0 2020-06-12T17:48:09.473 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.465+0000 7f568fc54700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568805bb20 con 0x7f56880b49e0 2020-06-12T17:48:09.473 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.465+0000 7f568e1f1700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f5688145b00 0x7f5688145f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37108/0 (socket says 172.21.15.38:37108) 2020-06-12T17:48:09.473 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.465+0000 7f568e1f1700 1 -- 172.21.15.38:0/561133592 learned_addr learned my addr 172.21.15.38:0/561133592 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:09.473 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.465+0000 7f568c9ee700 1 -- 172.21.15.38:0/561133592 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3402626301 0 0) 0x7f568809b920 con 0x7f5688145b00 2020-06-12T17:48:09.474 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.465+0000 7f568c9ee700 1 -- 172.21.15.38:0/561133592 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5670003230 con 0x7f5688145b00 2020-06-12T17:48:09.474 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.465+0000 7f568d1ef700 1 --2- 172.21.15.38:0/561133592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56880b49e0 0x7f568805b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:09.474 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568c9ee700 1 -- 172.21.15.38:0/561133592 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 887231205 0 0) 0x7f5670003230 con 0x7f5688145b00 2020-06-12T17:48:09.474 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568c9ee700 1 -- 172.21.15.38:0/561133592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56880b49e0 msgr2=0x7f568805b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:09.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568c9ee700 1 --2- 172.21.15.38:0/561133592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56880b49e0 0x7f568805b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:09.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568c9ee700 1 -- 172.21.15.38:0/561133592 >> v1:172.21.15.150:6789/0 conn(0x7f56880623f0 legacy=0x7f568813c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:09.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568c9ee700 1 -- 172.21.15.38:0/561133592 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568809bb80 con 0x7f5688145b00 2020-06-12T17:48:09.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568c9ee700 1 -- 172.21.15.38:0/561133592 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f5680001a50 con 0x7f5688145b00 2020-06-12T17:48:09.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568c9ee700 1 -- 172.21.15.38:0/561133592 >> v1:172.21.15.38:6789/0 conn(0x7f5688145b00 legacy=0x7f5688145f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:09.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568c9ee700 1 --2- 172.21.15.38:0/561133592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56880b49e0 0x7f5670003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:09.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568c9ee700 1 --2- 172.21.15.38:0/561133592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5670003bb0 0x7f5670004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:09.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568c9ee700 1 --2- 172.21.15.38:0/561133592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56700045e0 0x7f5670004a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:09.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568c9ee700 1 -- 172.21.15.38:0/561133592 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568805bb20 con 0x7f5670003bb0 2020-06-12T17:48:09.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568c9ee700 1 -- 172.21.15.38:0/561133592 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5670005010 con 0x7f56700045e0 2020-06-12T17:48:09.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568c9ee700 1 -- 172.21.15.38:0/561133592 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56700051d0 con 0x7f56880b49e0 2020-06-12T17:48:09.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568d1ef700 1 --2- 172.21.15.38:0/561133592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5670003bb0 0x7f5670004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:09.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568d9f0700 1 --2- 172.21.15.38:0/561133592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56880b49e0 0x7f5670003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:09.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568e1f1700 1 --2- 172.21.15.38:0/561133592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56700045e0 0x7f5670004a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:09.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568d1ef700 1 -- 172.21.15.38:0/561133592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56880b49e0 msgr2=0x7f5670003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:09.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568d1ef700 1 --2- 172.21.15.38:0/561133592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56880b49e0 0x7f5670003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:09.478 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568d1ef700 1 -- 172.21.15.38:0/561133592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56700045e0 msgr2=0x7f5670004a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:09.478 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568d1ef700 1 --2- 172.21.15.38:0/561133592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56700045e0 0x7f5670004a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:09.478 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568d1ef700 1 -- 172.21.15.38:0/561133592 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5670003230 con 0x7f5670003bb0 2020-06-12T17:48:09.478 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568d1ef700 1 --2- 172.21.15.38:0/561133592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5670003bb0 0x7f5670004010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5684002f30 tx=0x7f5684007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.478 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568d1ef700 1 --2- 172.21.15.38:0/561133592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5670003bb0 0x7f5670004010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5684002f30 tx=0x7f5684007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.479 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568d1ef700 1 --2- 172.21.15.38:0/561133592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5670003bb0 0x7f5670004010 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f5684002f30 tx=0x7f5684007e60).ready entity=mon.0 client_cookie=a3e84dd640fdb72d server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:09.479 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568d1ef700 1 --2- 172.21.15.38:0/561133592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5670003bb0 0x7f5670004010 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f5684002f30 tx=0x7f5684007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.479 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568d1ef700 1 --2- 172.21.15.38:0/561133592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5670003bb0 0x7f5670004010 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f5684002f30 tx=0x7f5684007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.479 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568c9ee700 1 -- 172.21.15.38:0/561133592 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5684008d30 con 0x7f5670003bb0 2020-06-12T17:48:09.479 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568d1ef700 1 --2- 172.21.15.38:0/561133592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5670003bb0 0x7f5670004010 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f5684002f30 tx=0x7f5684007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568c9ee700 1 -- 172.21.15.38:0/561133592 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5684008e90 con 0x7f5670003bb0 2020-06-12T17:48:09.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568c9ee700 1 -- 172.21.15.38:0/561133592 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5684010a30 con 0x7f5670003bb0 2020-06-12T17:48:09.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568fc54700 1 -- 172.21.15.38:0/561133592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5670003bb0 msgr2=0x7f5670004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:09.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568fc54700 1 --2- 172.21.15.38:0/561133592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5670003bb0 0x7f5670004010 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f5684002f30 tx=0x7f5684007e60).stop 2020-06-12T17:48:09.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.466+0000 7f568e1f1700 1 -- 172.21.15.38:0/561133592 reap_dead start 2020-06-12T17:48:09.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.467+0000 7f568fc54700 1 -- 172.21.15.38:0/561133592 shutdown_connections 2020-06-12T17:48:09.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.467+0000 7f568fc54700 1 -- 172.21.15.38:0/561133592 >> 172.21.15.38:0/561133592 conn(0x7f56880b8420 msgr2=0x7f56880b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:09.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.467+0000 7f568fc54700 1 -- 172.21.15.38:0/561133592 shutdown_connections 2020-06-12T17:48:09.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.467+0000 7f568fc54700 1 -- 172.21.15.38:0/561133592 wait complete. 2020-06-12T17:48:09.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.468+0000 7f568fc54700 1 Processor -- start 2020-06-12T17:48:09.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.468+0000 7f568fc54700 1 -- start start 2020-06-12T17:48:09.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.469+0000 7f568fc54700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f568813e190 0x7f568813c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:09.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.469+0000 7f568fc54700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f56880659c0 0x7f5688065df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:09.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.469+0000 7f568fc54700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5688145520 con 0x7f568813c700 2020-06-12T17:48:09.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.469+0000 7f568fc54700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5688145750 con 0x7f568813e190 2020-06-12T17:48:09.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.469+0000 7f568fc54700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5688064e10 con 0x7f56880659c0 2020-06-12T17:48:09.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.469+0000 7f568d9f0700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f568813e190 0x7f568813c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:09.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.469+0000 7f568d1ef700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f568813c700 0x7f56880652b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37118/0 (socket says 172.21.15.38:37118) 2020-06-12T17:48:09.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.469+0000 7f568d1ef700 1 -- 172.21.15.38:0/2290088755 learned_addr learned my addr 172.21.15.38:0/2290088755 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:09.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.469+0000 7f568e1f1700 1 --2- 172.21.15.38:0/2290088755 >> v2:172.21.15.150:3300/0 conn(0x7f56880659c0 0x7f5688065df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:09.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.469+0000 7f568d9f0700 1 -- 172.21.15.38:0/2290088755 >> v2:172.21.15.150:3300/0 conn(0x7f56880659c0 msgr2=0x7f5688065df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:09.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.469+0000 7f568d9f0700 1 --2- 172.21.15.38:0/2290088755 >> v2:172.21.15.150:3300/0 conn(0x7f56880659c0 0x7f5688065df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:09.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.469+0000 7f568d9f0700 1 -- 172.21.15.38:0/2290088755 >> v1:172.21.15.38:6789/0 conn(0x7f568813c700 legacy=0x7f56880652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:09.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.469+0000 7f5676ffd700 1 -- 172.21.15.38:0/2290088755 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1640600688 0 0) 0x7f5688145520 con 0x7f568813c700 2020-06-12T17:48:09.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.469+0000 7f568d9f0700 1 -- 172.21.15.38:0/2290088755 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568813e570 con 0x7f568813e190 2020-06-12T17:48:09.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.469+0000 7f568d9f0700 1 --2- 172.21.15.38:0/2290088755 >> v2:172.21.15.38:3300/0 conn(0x7f568813e190 0x7f568813c010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f56880673e0 tx=0x7f5678001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.469+0000 7f568d9f0700 1 --2- 172.21.15.38:0/2290088755 >> v2:172.21.15.38:3300/0 conn(0x7f568813e190 0x7f568813c010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f56880673e0 tx=0x7f5678001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.469+0000 7f568d9f0700 1 --2- 172.21.15.38:0/2290088755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f568813e190 0x7f568813c010 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f56880673e0 tx=0x7f5678001840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:09.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.469+0000 7f568d9f0700 1 --2- 172.21.15.38:0/2290088755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f568813e190 0x7f568813c010 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f56880673e0 tx=0x7f5678001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.469+0000 7f5676ffd700 1 -- 172.21.15.38:0/2290088755 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5678001e60 con 0x7f568813e190 2020-06-12T17:48:09.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.469+0000 7f568d9f0700 1 --2- 172.21.15.38:0/2290088755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f568813e190 0x7f568813c010 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f56880673e0 tx=0x7f5678001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.469+0000 7f568d9f0700 1 --2- 172.21.15.38:0/2290088755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f568813e190 0x7f568813c010 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f56880673e0 tx=0x7f5678001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.469+0000 7f5676ffd700 1 -- 172.21.15.38:0/2290088755 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567800c810 con 0x7f568813e190 2020-06-12T17:48:09.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.469+0000 7f568fc54700 1 -- 172.21.15.38:0/2290088755 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5688066e20 con 0x7f568813e190 2020-06-12T17:48:09.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.469+0000 7f5676ffd700 1 -- 172.21.15.38:0/2290088755 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f567800cb70 con 0x7f568813e190 2020-06-12T17:48:09.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.469+0000 7f568fc54700 1 -- 172.21.15.38:0/2290088755 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5688142780 con 0x7f568813e190 2020-06-12T17:48:09.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.470+0000 7f568d9f0700 1 --2- 172.21.15.38:0/2290088755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f568813e190 0x7f568813c010 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f56880673e0 tx=0x7f5678001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.470+0000 7f5676ffd700 1 -- 172.21.15.38:0/2290088755 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f56780064e0 con 0x7f568813e190 2020-06-12T17:48:09.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.470+0000 7f568d9f0700 1 --2- 172.21.15.38:0/2290088755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f568813e190 0x7f568813c010 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f56880673e0 tx=0x7f5678001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.470+0000 7f568fc54700 1 -- 172.21.15.38:0/2290088755 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5688145890 con 0x7f568813e190 2020-06-12T17:48:09.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.471+0000 7f5676ffd700 1 --2- 172.21.15.38:0/2290088755 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f566804d390 0x7f566804f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:09.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.471+0000 7f5676ffd700 1 -- 172.21.15.38:0/2290088755 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f5678060d40 con 0x7f568813e190 2020-06-12T17:48:09.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.471+0000 7f568d1ef700 1 --2- 172.21.15.38:0/2290088755 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f566804d390 0x7f566804f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:09.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.471+0000 7f568d1ef700 1 --2- 172.21.15.38:0/2290088755 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f566804d390 0x7f566804f850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5684002ed0 tx=0x7f5684007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.471+0000 7f568d1ef700 1 --2- 172.21.15.38:0/2290088755 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f566804d390 0x7f566804f850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5684002ed0 tx=0x7f5684007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.471+0000 7f568d1ef700 1 --2- 172.21.15.38:0/2290088755 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f566804d390 0x7f566804f850 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f5684002ed0 tx=0x7f5684007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:09.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.474+0000 7f568d9f0700 1 --2- 172.21.15.38:0/2290088755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f568813e190 0x7f568813c010 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f56880673e0 tx=0x7f5678001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.474+0000 7f5676ffd700 1 -- 172.21.15.38:0/2290088755 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f567803c4a0 con 0x7f568813e190 2020-06-12T17:48:09.635 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.626+0000 7f568fc54700 1 -- 172.21.15.38:0/2290088755 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5688056c30 con 0x7f568813e190 2020-06-12T17:48:09.635 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.626+0000 7f568d9f0700 1 --2- 172.21.15.38:0/2290088755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f568813e190 0x7f568813c010 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f56880673e0 tx=0x7f5678001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.635 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.626+0000 7f5676ffd700 1 -- 172.21.15.38:0/2290088755 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+143 (secure 0 0 0) 0x7f567803fac0 con 0x7f568813e190 2020-06-12T17:48:09.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.627+0000 7f568fc54700 1 -- 172.21.15.38:0/2290088755 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f566804d390 msgr2=0x7f566804f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:09.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.627+0000 7f568fc54700 1 --2- 172.21.15.38:0/2290088755 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f566804d390 0x7f566804f850 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f5684002ed0 tx=0x7f5684007e60).stop 2020-06-12T17:48:09.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.627+0000 7f568fc54700 1 -- 172.21.15.38:0/2290088755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f568813e190 msgr2=0x7f568813c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:09.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.627+0000 7f568fc54700 1 --2- 172.21.15.38:0/2290088755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f568813e190 0x7f568813c010 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f56880673e0 tx=0x7f5678001840).stop 2020-06-12T17:48:09.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.627+0000 7f568fc54700 1 -- 172.21.15.38:0/2290088755 shutdown_connections 2020-06-12T17:48:09.637 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.627+0000 7f568fc54700 1 --2- 172.21.15.38:0/2290088755 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f566804d390 0x7f566804f850 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:09.637 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.627+0000 7f568fc54700 1 --2- 172.21.15.38:0/2290088755 >> v2:172.21.15.150:3300/0 conn(0x7f56880659c0 0x7f5688065df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:09.637 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.627+0000 7f568fc54700 1 --2- 172.21.15.38:0/2290088755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f568813e190 0x7f568813c010 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:09.637 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.627+0000 7f568fc54700 1 -- 172.21.15.38:0/2290088755 >> 172.21.15.38:0/2290088755 conn(0x7f56880b8420 msgr2=0x7f56880616c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:09.637 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.627+0000 7f568fc54700 1 -- 172.21.15.38:0/2290088755 shutdown_connections 2020-06-12T17:48:09.638 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.627+0000 7f568fc54700 1 -- 172.21.15.38:0/2290088755 wait complete. 2020-06-12T17:48:09.638 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:09.638 INFO:teuthology.orchestra.run.smithi038.stdout:[ 2020-06-12T17:48:09.638 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:09.639 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 1, 2020-06-12T17:48:09.639 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": "device_health_metrics" 2020-06-12T17:48:09.639 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:09.639 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:09.639 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 2, 2020-06-12T17:48:09.640 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": "rbd" 2020-06-12T17:48:09.640 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:09.640 INFO:teuthology.orchestra.run.smithi038.stdout:] 2020-06-12T17:48:09.642 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-06-12T17:48:09.643 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-06-12T17:48:09.760 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.755+0000 7fd6aadff700 1 Processor -- start 2020-06-12T17:48:09.760 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.756+0000 7fd6aadff700 1 -- start start 2020-06-12T17:48:09.763 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.756+0000 7fd6aadff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd6a40afb40 0x7fd6a40b4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:09.764 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.756+0000 7fd6aadff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd6a405b8b0 0x7fd6a414c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:09.764 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.756+0000 7fd6aadff700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a4066da0 con 0x7fd6a405b420 2020-06-12T17:48:09.764 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.756+0000 7fd6aadff700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a40b0270 con 0x7fd6a40afb40 2020-06-12T17:48:09.765 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.756+0000 7fd6aadff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a4145b70 con 0x7fd6a405b8b0 2020-06-12T17:48:09.766 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.757+0000 7fd6a9dfd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd6a40afb40 0x7fd6a40b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:09.766 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.757+0000 7fd6a95fc700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd6a405b420 0x7fd6a4142420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37128/0 (socket says 172.21.15.38:37128) 2020-06-12T17:48:09.766 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.757+0000 7fd6a95fc700 1 -- 172.21.15.38:0/1840729882 learned_addr learned my addr 172.21.15.38:0/1840729882 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:09.767 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.757+0000 7fd6aa5fe700 1 --2- 172.21.15.38:0/1840729882 >> v2:172.21.15.150:3300/0 conn(0x7fd6a405b8b0 0x7fd6a414c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:09.767 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.757+0000 7fd6a8dfb700 1 -- 172.21.15.38:0/1840729882 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556040404 0 0) 0x7fd6a4066da0 con 0x7fd6a405b420 2020-06-12T17:48:09.767 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.757+0000 7fd6a8dfb700 1 -- 172.21.15.38:0/1840729882 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd68c003230 con 0x7fd6a405b420 2020-06-12T17:48:09.767 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.757+0000 7fd6a9dfd700 1 -- 172.21.15.38:0/1840729882 >> v2:172.21.15.150:3300/0 conn(0x7fd6a405b8b0 msgr2=0x7fd6a414c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:09.768 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.757+0000 7fd6a9dfd700 1 --2- 172.21.15.38:0/1840729882 >> v2:172.21.15.150:3300/0 conn(0x7fd6a405b8b0 0x7fd6a414c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:09.768 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.757+0000 7fd6a9dfd700 1 -- 172.21.15.38:0/1840729882 >> v1:172.21.15.38:6789/0 conn(0x7fd6a405b420 legacy=0x7fd6a4142420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:09.768 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.757+0000 7fd6a9dfd700 1 -- 172.21.15.38:0/1840729882 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a40aff20 con 0x7fd6a40afb40 2020-06-12T17:48:09.768 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.757+0000 7fd6a9dfd700 1 --2- 172.21.15.38:0/1840729882 >> v2:172.21.15.38:3300/0 conn(0x7fd6a40afb40 0x7fd6a40b4130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd694002f30 tx=0x7fd694007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.757+0000 7fd6a9dfd700 1 --2- 172.21.15.38:0/1840729882 >> v2:172.21.15.38:3300/0 conn(0x7fd6a40afb40 0x7fd6a40b4130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd694002f30 tx=0x7fd694007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.757+0000 7fd6a9dfd700 1 --2- 172.21.15.38:0/1840729882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6a40afb40 0x7fd6a40b4130 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7fd694002f30 tx=0x7fd694007e60).ready entity=mon.0 client_cookie=b96424605592b0c0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:09.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.757+0000 7fd6a9dfd700 1 --2- 172.21.15.38:0/1840729882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6a40afb40 0x7fd6a40b4130 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fd694002f30 tx=0x7fd694007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.757+0000 7fd6a9dfd700 1 --2- 172.21.15.38:0/1840729882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6a40afb40 0x7fd6a40b4130 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fd694002f30 tx=0x7fd694007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.757+0000 7fd6a8dfb700 1 -- 172.21.15.38:0/1840729882 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6940112d0 con 0x7fd6a40afb40 2020-06-12T17:48:09.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.757+0000 7fd6a9dfd700 1 --2- 172.21.15.38:0/1840729882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6a40afb40 0x7fd6a40b4130 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fd694002f30 tx=0x7fd694007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.757+0000 7fd6a8dfb700 1 -- 172.21.15.38:0/1840729882 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd694011430 con 0x7fd6a40afb40 2020-06-12T17:48:09.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.757+0000 7fd6a8dfb700 1 -- 172.21.15.38:0/1840729882 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd694011810 con 0x7fd6a40afb40 2020-06-12T17:48:09.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.757+0000 7fd6aadff700 1 -- 172.21.15.38:0/1840729882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6a40afb40 msgr2=0x7fd6a40b4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:09.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.757+0000 7fd6aadff700 1 --2- 172.21.15.38:0/1840729882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6a40afb40 0x7fd6a40b4130 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7fd694002f30 tx=0x7fd694007e60).stop 2020-06-12T17:48:09.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.758+0000 7fd6aadff700 1 -- 172.21.15.38:0/1840729882 shutdown_connections 2020-06-12T17:48:09.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.758+0000 7fd6aadff700 1 --2- 172.21.15.38:0/1840729882 >> v2:172.21.15.150:3300/0 conn(0x7fd6a405b8b0 0x7fd6a414c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:09.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.758+0000 7fd6aadff700 1 --2- 172.21.15.38:0/1840729882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6a40afb40 0x7fd6a40b4130 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:09.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.758+0000 7fd6aadff700 1 -- 172.21.15.38:0/1840729882 >> 172.21.15.38:0/1840729882 conn(0x7fd6a40b4cc0 msgr2=0x7fd6a40b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:09.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.758+0000 7fd6aadff700 1 -- 172.21.15.38:0/1840729882 shutdown_connections 2020-06-12T17:48:09.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.758+0000 7fd6aadff700 1 -- 172.21.15.38:0/1840729882 wait complete. 2020-06-12T17:48:09.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.759+0000 7fd6aadff700 1 Processor -- start 2020-06-12T17:48:09.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.759+0000 7fd6aadff700 1 -- start start 2020-06-12T17:48:09.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.759+0000 7fd6aadff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a405b420 0x7fd6a413dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:09.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.759+0000 7fd6aadff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd6a40afb40 0x7fd6a40658e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:09.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.759+0000 7fd6aadff700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a413e460 con 0x7fd6a405b8b0 2020-06-12T17:48:09.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.760+0000 7fd6aadff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a413d750 con 0x7fd6a40afb40 2020-06-12T17:48:09.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.760+0000 7fd6aadff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a4066240 con 0x7fd6a405b420 2020-06-12T17:48:09.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.760+0000 7fd6a95fc700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd6a405b8b0 0x7fd6a413ceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:57864/0 (socket says 172.21.15.38:57864) 2020-06-12T17:48:09.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.760+0000 7fd6a95fc700 1 -- 172.21.15.38:0/4272705971 learned_addr learned my addr 172.21.15.38:0/4272705971 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:09.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.760+0000 7fd6a9dfd700 1 --2- 172.21.15.38:0/4272705971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a405b420 0x7fd6a413dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:09.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.760+0000 7fd6aa5fe700 1 --2- 172.21.15.38:0/4272705971 >> v2:172.21.15.150:3300/0 conn(0x7fd6a40afb40 0x7fd6a40658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:09.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.760+0000 7fd692ffd700 1 -- 172.21.15.38:0/4272705971 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1688470047 0 0) 0x7fd6a413e460 con 0x7fd6a405b8b0 2020-06-12T17:48:09.780 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.760+0000 7fd692ffd700 1 -- 172.21.15.38:0/4272705971 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd684002fe0 con 0x7fd6a405b8b0 2020-06-12T17:48:09.780 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.760+0000 7fd6a9dfd700 1 -- 172.21.15.38:0/4272705971 >> v2:172.21.15.150:3300/0 conn(0x7fd6a40afb40 msgr2=0x7fd6a40658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:09.780 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.760+0000 7fd6a9dfd700 1 --2- 172.21.15.38:0/4272705971 >> v2:172.21.15.150:3300/0 conn(0x7fd6a40afb40 0x7fd6a40658e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:09.780 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.760+0000 7fd6a9dfd700 1 -- 172.21.15.38:0/4272705971 >> v1:172.21.15.150:6789/0 conn(0x7fd6a405b8b0 legacy=0x7fd6a413ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:09.780 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.760+0000 7fd6a9dfd700 1 -- 172.21.15.38:0/4272705971 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a4066380 con 0x7fd6a405b420 2020-06-12T17:48:09.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.760+0000 7fd6a9dfd700 1 --2- 172.21.15.38:0/4272705971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a405b420 0x7fd6a413dd50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd694002f30 tx=0x7fd694007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.760+0000 7fd6a9dfd700 1 --2- 172.21.15.38:0/4272705971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a405b420 0x7fd6a413dd50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd694002f30 tx=0x7fd694007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.760+0000 7fd6a9dfd700 1 --2- 172.21.15.38:0/4272705971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a405b420 0x7fd6a413dd50 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7fd694002f30 tx=0x7fd694007e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:09.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.760+0000 7fd6a9dfd700 1 --2- 172.21.15.38:0/4272705971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a405b420 0x7fd6a413dd50 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fd694002f30 tx=0x7fd694007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.760+0000 7fd692ffd700 1 -- 172.21.15.38:0/4272705971 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6940114e0 con 0x7fd6a405b420 2020-06-12T17:48:09.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.760+0000 7fd6a9dfd700 1 --2- 172.21.15.38:0/4272705971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a405b420 0x7fd6a413dd50 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fd694002f30 tx=0x7fd694007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.760+0000 7fd6aadff700 1 -- 172.21.15.38:0/4272705971 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a4066570 con 0x7fd6a405b420 2020-06-12T17:48:09.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.760+0000 7fd692ffd700 1 -- 172.21.15.38:0/4272705971 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd694011640 con 0x7fd6a405b420 2020-06-12T17:48:09.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.760+0000 7fd6a9dfd700 1 --2- 172.21.15.38:0/4272705971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a405b420 0x7fd6a413dd50 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fd694002f30 tx=0x7fd694007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.760+0000 7fd692ffd700 1 -- 172.21.15.38:0/4272705971 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd694007150 con 0x7fd6a405b420 2020-06-12T17:48:09.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.761+0000 7fd6aadff700 1 -- 172.21.15.38:0/4272705971 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a413bb70 con 0x7fd6a405b420 2020-06-12T17:48:09.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.761+0000 7fd6a9dfd700 1 --2- 172.21.15.38:0/4272705971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a405b420 0x7fd6a413dd50 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fd694002f30 tx=0x7fd694007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.762+0000 7fd692ffd700 1 -- 172.21.15.38:0/4272705971 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fd6940073d0 con 0x7fd6a405b420 2020-06-12T17:48:09.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.762+0000 7fd6a9dfd700 1 --2- 172.21.15.38:0/4272705971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a405b420 0x7fd6a413dd50 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fd694002f30 tx=0x7fd694007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.762+0000 7fd6aadff700 1 -- 172.21.15.38:0/4272705971 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a413d5c0 con 0x7fd6a405b420 2020-06-12T17:48:09.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.762+0000 7fd692ffd700 1 --2- 172.21.15.38:0/4272705971 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd68404d8d0 0x7fd68404fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:09.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.762+0000 7fd692ffd700 1 -- 172.21.15.38:0/4272705971 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd694061780 con 0x7fd6a405b420 2020-06-12T17:48:09.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.762+0000 7fd6a95fc700 1 --2- 172.21.15.38:0/4272705971 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd68404d8d0 0x7fd68404fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:09.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.762+0000 7fd6a95fc700 1 --2- 172.21.15.38:0/4272705971 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd68404d8d0 0x7fd68404fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd6a0000fc0 tx=0x7fd6a00015a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.762+0000 7fd6a95fc700 1 --2- 172.21.15.38:0/4272705971 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd68404d8d0 0x7fd68404fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd6a0000fc0 tx=0x7fd6a00015a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.762+0000 7fd6a95fc700 1 --2- 172.21.15.38:0/4272705971 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd68404d8d0 0x7fd68404fd90 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7fd6a0000fc0 tx=0x7fd6a00015a0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:09.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.767+0000 7fd6a9dfd700 1 --2- 172.21.15.38:0/4272705971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a405b420 0x7fd6a413dd50 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fd694002f30 tx=0x7fd694007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:09.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.767+0000 7fd692ffd700 1 -- 172.21.15.38:0/4272705971 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fd6940660c0 con 0x7fd6a405b420 2020-06-12T17:48:09.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:09.917+0000 7fd6aadff700 1 -- 172.21.15.38:0/4272705971 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fd6a4065f80 con 0x7fd6a405b420 2020-06-12T17:48:10.463 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.458+0000 7fd6a9dfd700 1 --2- 172.21.15.38:0/4272705971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a405b420 0x7fd6a413dd50 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fd694002f30 tx=0x7fd694007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:10.463 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.458+0000 7fd692ffd700 1 -- 172.21.15.38:0/4272705971 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v19) v1 ==== 133+0+0 (secure 0 0 0) 0x7fd69403cf80 con 0x7fd6a405b420 2020-06-12T17:48:10.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.461+0000 7fd6aadff700 1 -- 172.21.15.38:0/4272705971 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd68404d8d0 msgr2=0x7fd68404fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:10.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.461+0000 7fd6aadff700 1 --2- 172.21.15.38:0/4272705971 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd68404d8d0 0x7fd68404fd90 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7fd6a0000fc0 tx=0x7fd6a00015a0).stop 2020-06-12T17:48:10.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.461+0000 7fd6aadff700 1 -- 172.21.15.38:0/4272705971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a405b420 msgr2=0x7fd6a413dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:10.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.461+0000 7fd6aadff700 1 --2- 172.21.15.38:0/4272705971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a405b420 0x7fd6a413dd50 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7fd694002f30 tx=0x7fd694007e60).stop 2020-06-12T17:48:10.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.461+0000 7fd6aadff700 1 -- 172.21.15.38:0/4272705971 shutdown_connections 2020-06-12T17:48:10.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.461+0000 7fd6aadff700 1 --2- 172.21.15.38:0/4272705971 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd68404d8d0 0x7fd68404fd90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:10.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.461+0000 7fd6aadff700 1 --2- 172.21.15.38:0/4272705971 >> v2:172.21.15.150:3300/0 conn(0x7fd6a40afb40 0x7fd6a40658e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:10.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.461+0000 7fd6aadff700 1 --2- 172.21.15.38:0/4272705971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6a405b420 0x7fd6a413dd50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:10.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.461+0000 7fd6aadff700 1 -- 172.21.15.38:0/4272705971 >> 172.21.15.38:0/4272705971 conn(0x7fd6a40b4cc0 msgr2=0x7fd6a40b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:10.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.461+0000 7fd6aadff700 1 -- 172.21.15.38:0/4272705971 shutdown_connections 2020-06-12T17:48:10.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.461+0000 7fd6aadff700 1 -- 172.21.15.38:0/4272705971 wait complete. 2020-06-12T17:48:10.468 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' created 2020-06-12T17:48:10.478 INFO:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2020-06-12T17:48:10.479 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd erasure-code-profile set cephfs_data m=2 k=2 crush-failure-domain=osd 2020-06-12T17:48:10.607 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.602+0000 7f913f645700 1 Processor -- start 2020-06-12T17:48:10.607 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.603+0000 7f913f645700 1 -- start start 2020-06-12T17:48:10.610 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.603+0000 7f913f645700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91380a2460 0x7f91380a2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:10.611 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.603+0000 7f913f645700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f913813fc90 0x7f91381400e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:10.611 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.603+0000 7f913f645700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f913805f7a0 con 0x7f9138146060 2020-06-12T17:48:10.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.603+0000 7f913f645700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f913805f2b0 con 0x7f913813fc90 2020-06-12T17:48:10.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.603+0000 7f913f645700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913805fa40 con 0x7f91380a2460 2020-06-12T17:48:10.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.603+0000 7f913dbe2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f913813fc90 0x7f91381400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:10.613 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.603+0000 7f913dbe2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f913813fc90 0x7f91381400e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35322/0 (socket says 172.21.15.38:35322) 2020-06-12T17:48:10.613 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.603+0000 7f913dbe2700 1 -- 172.21.15.38:0/2391786543 learned_addr learned my addr 172.21.15.38:0/2391786543 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:10.614 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.603+0000 7f913cbe0700 1 --1- 172.21.15.38:0/2391786543 >> v1:172.21.15.38:6789/0 conn(0x7f9138146060 0x7f913809d8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37138/0 (socket says 172.21.15.38:37138) 2020-06-12T17:48:10.614 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.604+0000 7f913d3e1700 1 --2- 172.21.15.38:0/2391786543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91380a2460 0x7f91380a2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:10.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.604+0000 7f913dbe2700 1 -- 172.21.15.38:0/2391786543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91380a2460 msgr2=0x7f91380a2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:10.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.604+0000 7f913dbe2700 1 --2- 172.21.15.38:0/2391786543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91380a2460 0x7f91380a2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:10.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.604+0000 7f913dbe2700 1 -- 172.21.15.38:0/2391786543 >> v1:172.21.15.38:6789/0 conn(0x7f9138146060 legacy=0x7f913809d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:10.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.604+0000 7f913dbe2700 1 -- 172.21.15.38:0/2391786543 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913809dfc0 con 0x7f913813fc90 2020-06-12T17:48:10.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.604+0000 7f9127fff700 1 -- 172.21.15.38:0/2391786543 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 572584285 0 0) 0x7f913805f7a0 con 0x7f9138146060 2020-06-12T17:48:10.616 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.604+0000 7f913dbe2700 1 --2- 172.21.15.38:0/2391786543 >> v2:172.21.15.38:3300/0 conn(0x7f913813fc90 0x7f91381400e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f91300032b0 tx=0x7f91300081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:10.616 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.604+0000 7f913dbe2700 1 --2- 172.21.15.38:0/2391786543 >> v2:172.21.15.38:3300/0 conn(0x7f913813fc90 0x7f91381400e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f91300032b0 tx=0x7f91300081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:10.616 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.604+0000 7f913dbe2700 1 --2- 172.21.15.38:0/2391786543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f913813fc90 0x7f91381400e0 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7f91300032b0 tx=0x7f91300081e0).ready entity=mon.0 client_cookie=54f7daace48d1ac3 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:10.616 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.604+0000 7f913dbe2700 1 --2- 172.21.15.38:0/2391786543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f913813fc90 0x7f91381400e0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f91300032b0 tx=0x7f91300081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:10.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.604+0000 7f9127fff700 1 -- 172.21.15.38:0/2391786543 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9130011ea0 con 0x7f913813fc90 2020-06-12T17:48:10.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.604+0000 7f913dbe2700 1 --2- 172.21.15.38:0/2391786543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f913813fc90 0x7f91381400e0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f91300032b0 tx=0x7f91300081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:10.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.604+0000 7f913dbe2700 1 --2- 172.21.15.38:0/2391786543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f913813fc90 0x7f91381400e0 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f91300032b0 tx=0x7f91300081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:10.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.604+0000 7f9127fff700 1 -- 172.21.15.38:0/2391786543 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913000a160 con 0x7f913813fc90 2020-06-12T17:48:10.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.604+0000 7f9127fff700 1 -- 172.21.15.38:0/2391786543 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f913000a540 con 0x7f913813fc90 2020-06-12T17:48:10.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.604+0000 7f913f645700 1 -- 172.21.15.38:0/2391786543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f913813fc90 msgr2=0x7f91381400e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:10.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.604+0000 7f913f645700 1 --2- 172.21.15.38:0/2391786543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f913813fc90 0x7f91381400e0 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7f91300032b0 tx=0x7f91300081e0).stop 2020-06-12T17:48:10.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.605+0000 7f913f645700 1 -- 172.21.15.38:0/2391786543 shutdown_connections 2020-06-12T17:48:10.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.605+0000 7f913f645700 1 --2- 172.21.15.38:0/2391786543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f913813fc90 0x7f91381400e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:10.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.605+0000 7f913f645700 1 --2- 172.21.15.38:0/2391786543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91380a2460 0x7f91380a2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:10.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.605+0000 7f913f645700 1 -- 172.21.15.38:0/2391786543 >> 172.21.15.38:0/2391786543 conn(0x7f913805b450 msgr2=0x7f913805b860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:10.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.605+0000 7f913f645700 1 -- 172.21.15.38:0/2391786543 shutdown_connections 2020-06-12T17:48:10.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.605+0000 7f913f645700 1 -- 172.21.15.38:0/2391786543 wait complete. 2020-06-12T17:48:10.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.606+0000 7f913f645700 1 Processor -- start 2020-06-12T17:48:10.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.606+0000 7f913f645700 1 -- start start 2020-06-12T17:48:10.623 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.607+0000 7f913f645700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f913813fc90 0x7f9138141ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:10.624 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.607+0000 7f913f645700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9138146060 0x7f91380b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:10.624 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.607+0000 7f913f645700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91381421b0 con 0x7f91380a2460 2020-06-12T17:48:10.624 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.607+0000 7f913f645700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91380b5e70 con 0x7f9138146060 2020-06-12T17:48:10.624 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.607+0000 7f913f645700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91381576e0 con 0x7f913813fc90 2020-06-12T17:48:10.625 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.607+0000 7f913d3e1700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f91380a2460 0x7f91380b4180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37142/0 (socket says 172.21.15.38:37142) 2020-06-12T17:48:10.625 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.607+0000 7f913d3e1700 1 -- 172.21.15.38:0/1957705722 learned_addr learned my addr 172.21.15.38:0/1957705722 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:10.625 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.607+0000 7f913dbe2700 1 --2- 172.21.15.38:0/1957705722 >> v2:172.21.15.38:3300/0 conn(0x7f9138146060 0x7f91380b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:10.626 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.607+0000 7f913cbe0700 1 --2- 172.21.15.38:0/1957705722 >> v2:172.21.15.150:3300/0 conn(0x7f913813fc90 0x7f9138141ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:10.626 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.607+0000 7f91267fc700 1 -- 172.21.15.38:0/1957705722 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1707960463 0 0) 0x7f91381421b0 con 0x7f91380a2460 2020-06-12T17:48:10.626 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.607+0000 7f91267fc700 1 -- 172.21.15.38:0/1957705722 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9118002fe0 con 0x7f91380a2460 2020-06-12T17:48:10.626 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.607+0000 7f913dbe2700 1 -- 172.21.15.38:0/1957705722 >> v2:172.21.15.150:3300/0 conn(0x7f913813fc90 msgr2=0x7f9138141ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:10.626 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.607+0000 7f913dbe2700 1 --2- 172.21.15.38:0/1957705722 >> v2:172.21.15.150:3300/0 conn(0x7f913813fc90 0x7f9138141ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:10.627 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.607+0000 7f913dbe2700 1 -- 172.21.15.38:0/1957705722 >> v1:172.21.15.38:6789/0 conn(0x7f91380a2460 legacy=0x7f91380b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:10.627 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.607+0000 7f913dbe2700 1 -- 172.21.15.38:0/1957705722 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91380b6310 con 0x7f9138146060 2020-06-12T17:48:10.627 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.607+0000 7f913dbe2700 1 --2- 172.21.15.38:0/1957705722 >> v2:172.21.15.38:3300/0 conn(0x7f9138146060 0x7f91380b3bc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f91300032b0 tx=0x7f91300081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:10.627 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.607+0000 7f913dbe2700 1 --2- 172.21.15.38:0/1957705722 >> v2:172.21.15.38:3300/0 conn(0x7f9138146060 0x7f91380b3bc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f91300032b0 tx=0x7f91300081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:10.627 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.607+0000 7f913dbe2700 1 --2- 172.21.15.38:0/1957705722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9138146060 0x7f91380b3bc0 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f91300032b0 tx=0x7f91300081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:10.628 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.607+0000 7f913dbe2700 1 --2- 172.21.15.38:0/1957705722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9138146060 0x7f91380b3bc0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f91300032b0 tx=0x7f91300081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:10.628 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.607+0000 7f91267fc700 1 -- 172.21.15.38:0/1957705722 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f913000a5c0 con 0x7f9138146060 2020-06-12T17:48:10.628 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.607+0000 7f913dbe2700 1 --2- 172.21.15.38:0/1957705722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9138146060 0x7f91380b3bc0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f91300032b0 tx=0x7f91300081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:10.628 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.607+0000 7f913dbe2700 1 --2- 172.21.15.38:0/1957705722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9138146060 0x7f91380b3bc0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f91300032b0 tx=0x7f91300081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:10.628 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.607+0000 7f91267fc700 1 -- 172.21.15.38:0/1957705722 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9130005c30 con 0x7f9138146060 2020-06-12T17:48:10.629 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.607+0000 7f913f645700 1 -- 172.21.15.38:0/1957705722 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9138156c40 con 0x7f9138146060 2020-06-12T17:48:10.629 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.607+0000 7f91267fc700 1 -- 172.21.15.38:0/1957705722 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9130007150 con 0x7f9138146060 2020-06-12T17:48:10.629 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.608+0000 7f913f645700 1 -- 172.21.15.38:0/1957705722 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91381570b0 con 0x7f9138146060 2020-06-12T17:48:10.629 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.608+0000 7f913dbe2700 1 --2- 172.21.15.38:0/1957705722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9138146060 0x7f91380b3bc0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f91300032b0 tx=0x7f91300081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:10.629 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.608+0000 7f91267fc700 1 -- 172.21.15.38:0/1957705722 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f91300073c0 con 0x7f9138146060 2020-06-12T17:48:10.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.608+0000 7f913f645700 1 -- 172.21.15.38:0/1957705722 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91381423b0 con 0x7f9138146060 2020-06-12T17:48:10.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.608+0000 7f913dbe2700 1 --2- 172.21.15.38:0/1957705722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9138146060 0x7f91380b3bc0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f91300032b0 tx=0x7f91300081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:10.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.609+0000 7f91267fc700 1 --2- 172.21.15.38:0/1957705722 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f911804d960 0x7f911804fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:10.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.609+0000 7f91267fc700 1 -- 172.21.15.38:0/1957705722 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f9130061a10 con 0x7f9138146060 2020-06-12T17:48:10.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.609+0000 7f913d3e1700 1 --2- 172.21.15.38:0/1957705722 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f911804d960 0x7f911804fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:10.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.609+0000 7f913d3e1700 1 --2- 172.21.15.38:0/1957705722 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f911804d960 0x7f911804fe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9128002f30 tx=0x7f9128007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:10.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.609+0000 7f913d3e1700 1 --2- 172.21.15.38:0/1957705722 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f911804d960 0x7f911804fe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9128002f30 tx=0x7f9128007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:10.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.609+0000 7f913d3e1700 1 --2- 172.21.15.38:0/1957705722 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f911804d960 0x7f911804fe20 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f9128002f30 tx=0x7f9128007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:10.632 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.613+0000 7f913dbe2700 1 --2- 172.21.15.38:0/1957705722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9138146060 0x7f91380b3bc0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f91300032b0 tx=0x7f91300081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:10.632 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.613+0000 7f91267fc700 1 -- 172.21.15.38:0/1957705722 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f913003d230 con 0x7f9138146060 2020-06-12T17:48:10.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:10.777+0000 7f913f645700 1 -- 172.21.15.38:0/1957705722 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f9138056c30 con 0x7f9138146060 2020-06-12T17:48:11.463 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.460+0000 7f913dbe2700 1 --2- 172.21.15.38:0/1957705722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9138146060 0x7f91380b3bc0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f91300032b0 tx=0x7f91300081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:11.464 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.460+0000 7f91267fc700 1 -- 172.21.15.38:0/1957705722 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 154+0+0 (secure 0 0 0) 0x7f9130040850 con 0x7f9138146060 2020-06-12T17:48:11.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.463+0000 7f913f645700 1 -- 172.21.15.38:0/1957705722 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f911804d960 msgr2=0x7f911804fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:11.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.463+0000 7f913f645700 1 --2- 172.21.15.38:0/1957705722 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f911804d960 0x7f911804fe20 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f9128002f30 tx=0x7f9128007e60).stop 2020-06-12T17:48:11.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.463+0000 7f913f645700 1 -- 172.21.15.38:0/1957705722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9138146060 msgr2=0x7f91380b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:11.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.463+0000 7f913f645700 1 --2- 172.21.15.38:0/1957705722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9138146060 0x7f91380b3bc0 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f91300032b0 tx=0x7f91300081e0).stop 2020-06-12T17:48:11.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.463+0000 7f913f645700 1 -- 172.21.15.38:0/1957705722 shutdown_connections 2020-06-12T17:48:11.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.463+0000 7f913f645700 1 --2- 172.21.15.38:0/1957705722 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f911804d960 0x7f911804fe20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:11.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.463+0000 7f913f645700 1 --2- 172.21.15.38:0/1957705722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9138146060 0x7f91380b3bc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:11.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.463+0000 7f913f645700 1 --2- 172.21.15.38:0/1957705722 >> v2:172.21.15.150:3300/0 conn(0x7f913813fc90 0x7f9138141ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:11.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.463+0000 7f913f645700 1 -- 172.21.15.38:0/1957705722 >> 172.21.15.38:0/1957705722 conn(0x7f913805b450 msgr2=0x7f913806a440 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:11.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.463+0000 7f913f645700 1 -- 172.21.15.38:0/1957705722 shutdown_connections 2020-06-12T17:48:11.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.463+0000 7f913f645700 1 -- 172.21.15.38:0/1957705722 wait complete. 2020-06-12T17:48:11.481 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 erasure cephfs_data 2020-06-12T17:48:11.607 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.603+0000 7fc8a8697700 1 Processor -- start 2020-06-12T17:48:11.607 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.603+0000 7fc8a8697700 1 -- start start 2020-06-12T17:48:11.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.604+0000 7fc8a8697700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8a00b2eb0 0x7fc8a014d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:11.613 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.604+0000 7fc8a8697700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a0146d20 con 0x7fc8a0146680 2020-06-12T17:48:11.613 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.604+0000 7fc8a8697700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a0066a80 con 0x7fc8a00ad5b0 2020-06-12T17:48:11.613 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.604+0000 7fc8a8697700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a0146f50 con 0x7fc8a00b2eb0 2020-06-12T17:48:11.613 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.604+0000 7fc8a6433700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc8a0146680 0x7fc8a009d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37150/0 (socket says 172.21.15.38:37150) 2020-06-12T17:48:11.613 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.604+0000 7fc8a6433700 1 -- 172.21.15.38:0/3389968208 learned_addr learned my addr 172.21.15.38:0/3389968208 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:11.614 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.604+0000 7fc8a6c34700 1 --2- 172.21.15.38:0/3389968208 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8a00b2eb0 0x7fc8a014d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:11.614 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.604+0000 7fc8a5431700 1 -- 172.21.15.38:0/3389968208 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2488988258 0 0) 0x7fc8a0146d20 con 0x7fc8a0146680 2020-06-12T17:48:11.614 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.604+0000 7fc8a5431700 1 -- 172.21.15.38:0/3389968208 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc888003230 con 0x7fc8a0146680 2020-06-12T17:48:11.614 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a5431700 1 -- 172.21.15.38:0/3389968208 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1950349816 0 0) 0x7fc8a0066a80 con 0x7fc8a00ad5b0 2020-06-12T17:48:11.614 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a5431700 1 -- 172.21.15.38:0/3389968208 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8a0146d20 con 0x7fc8a00ad5b0 2020-06-12T17:48:11.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a5431700 1 -- 172.21.15.38:0/3389968208 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3796933687 0 0) 0x7fc888003230 con 0x7fc8a0146680 2020-06-12T17:48:11.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a5431700 1 -- 172.21.15.38:0/3389968208 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8a00b2eb0 msgr2=0x7fc8a014d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:11.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a5431700 1 --2- 172.21.15.38:0/3389968208 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8a00b2eb0 0x7fc8a014d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:11.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a5431700 1 -- 172.21.15.38:0/3389968208 >> v1:172.21.15.150:6789/0 conn(0x7fc8a00ad5b0 legacy=0x7fc8a009d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:11.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a5431700 1 -- 172.21.15.38:0/3389968208 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a0146a60 con 0x7fc8a0146680 2020-06-12T17:48:11.616 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a5431700 1 -- 172.21.15.38:0/3389968208 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fc8900016d0 con 0x7fc8a0146680 2020-06-12T17:48:11.616 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a5431700 1 -- 172.21.15.38:0/3389968208 >> v1:172.21.15.38:6789/0 conn(0x7fc8a0146680 legacy=0x7fc8a009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:11.616 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a5431700 1 --2- 172.21.15.38:0/3389968208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8880038e0 0x7fc888003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:11.616 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a5431700 1 --2- 172.21.15.38:0/3389968208 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8a00b2eb0 0x7fc8880044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:11.616 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a5431700 1 --2- 172.21.15.38:0/3389968208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc888004930 0x7fc888004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:11.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a5431700 1 -- 172.21.15.38:0/3389968208 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a0146f50 con 0x7fc8880038e0 2020-06-12T17:48:11.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a5431700 1 -- 172.21.15.38:0/3389968208 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc888005210 con 0x7fc888004930 2020-06-12T17:48:11.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a5431700 1 -- 172.21.15.38:0/3389968208 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88800b720 con 0x7fc8a00b2eb0 2020-06-12T17:48:11.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a6433700 1 --2- 172.21.15.38:0/3389968208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8880038e0 0x7fc888003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:11.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a6c34700 1 --2- 172.21.15.38:0/3389968208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc888004930 0x7fc888004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:11.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a5c32700 1 --2- 172.21.15.38:0/3389968208 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8a00b2eb0 0x7fc8880044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:11.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a6433700 1 -- 172.21.15.38:0/3389968208 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8a00b2eb0 msgr2=0x7fc8880044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:11.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a6433700 1 --2- 172.21.15.38:0/3389968208 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8a00b2eb0 0x7fc8880044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:11.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a6433700 1 -- 172.21.15.38:0/3389968208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc888004930 msgr2=0x7fc888004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:11.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a6433700 1 --2- 172.21.15.38:0/3389968208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc888004930 0x7fc888004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:11.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a6433700 1 -- 172.21.15.38:0/3389968208 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc888003230 con 0x7fc8880038e0 2020-06-12T17:48:11.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a6433700 1 --2- 172.21.15.38:0/3389968208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8880038e0 0x7fc888003ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc8900014a0 tx=0x7fc8a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:11.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a6433700 1 --2- 172.21.15.38:0/3389968208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8880038e0 0x7fc888003ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc8900014a0 tx=0x7fc8a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:11.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a6433700 1 --2- 172.21.15.38:0/3389968208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8880038e0 0x7fc888003ce0 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7fc8900014a0 tx=0x7fc8a0146220).ready entity=mon.0 client_cookie=b7e3f6f8cf4998cb server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:11.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.605+0000 7fc8a6433700 1 --2- 172.21.15.38:0/3389968208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8880038e0 0x7fc888003ce0 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fc8900014a0 tx=0x7fc8a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:11.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.606+0000 7fc8a5431700 1 -- 172.21.15.38:0/3389968208 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc890010e50 con 0x7fc8880038e0 2020-06-12T17:48:11.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.606+0000 7fc8a6433700 1 --2- 172.21.15.38:0/3389968208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8880038e0 0x7fc888003ce0 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fc8900014a0 tx=0x7fc8a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:11.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.606+0000 7fc8a6433700 1 --2- 172.21.15.38:0/3389968208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8880038e0 0x7fc888003ce0 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fc8900014a0 tx=0x7fc8a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:11.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.606+0000 7fc8a5431700 1 -- 172.21.15.38:0/3389968208 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89000ed60 con 0x7fc8880038e0 2020-06-12T17:48:11.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.606+0000 7fc8a5431700 1 -- 172.21.15.38:0/3389968208 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8900057d0 con 0x7fc8880038e0 2020-06-12T17:48:11.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.606+0000 7fc8a8697700 1 -- 172.21.15.38:0/3389968208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8880038e0 msgr2=0x7fc888003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:11.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.606+0000 7fc8a8697700 1 --2- 172.21.15.38:0/3389968208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8880038e0 0x7fc888003ce0 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7fc8900014a0 tx=0x7fc8a0146220).stop 2020-06-12T17:48:11.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.606+0000 7fc8a6c34700 1 -- 172.21.15.38:0/3389968208 reap_dead start 2020-06-12T17:48:11.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.606+0000 7fc8a8697700 1 -- 172.21.15.38:0/3389968208 shutdown_connections 2020-06-12T17:48:11.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.606+0000 7fc8a8697700 1 -- 172.21.15.38:0/3389968208 >> 172.21.15.38:0/3389968208 conn(0x7fc8a00b5a20 msgr2=0x7fc8a005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:11.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.606+0000 7fc8a8697700 1 -- 172.21.15.38:0/3389968208 shutdown_connections 2020-06-12T17:48:11.622 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.606+0000 7fc8a8697700 1 -- 172.21.15.38:0/3389968208 wait complete. 2020-06-12T17:48:11.622 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.607+0000 7fc8a8697700 1 Processor -- start 2020-06-12T17:48:11.622 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.607+0000 7fc8a8697700 1 -- start start 2020-06-12T17:48:11.622 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.608+0000 7fc8a8697700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc8a00b7200 0x7fc8a0062500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:11.622 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.608+0000 7fc8a8697700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc8a00b2360 0x7fc8a0066050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:11.623 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.608+0000 7fc8a8697700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a00b01d0 con 0x7fc8a00aec00 2020-06-12T17:48:11.623 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.608+0000 7fc8a8697700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a00b0470 con 0x7fc8a00b7200 2020-06-12T17:48:11.623 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.608+0000 7fc8a8697700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a00b75e0 con 0x7fc8a00b2360 2020-06-12T17:48:11.623 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.608+0000 7fc8a6433700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc8a00b7200 0x7fc8a0062500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:11.623 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.608+0000 7fc8a6433700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc8a00b7200 0x7fc8a0062500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35348/0 (socket says 172.21.15.38:35348) 2020-06-12T17:48:11.624 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.608+0000 7fc8a6433700 1 -- 172.21.15.38:0/3880886286 learned_addr learned my addr 172.21.15.38:0/3880886286 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:11.624 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.608+0000 7fc8a5c32700 1 --2- 172.21.15.38:0/3880886286 >> v2:172.21.15.150:3300/0 conn(0x7fc8a00b2360 0x7fc8a0066050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:11.624 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.608+0000 7fc8a6433700 1 -- 172.21.15.38:0/3880886286 >> v2:172.21.15.150:3300/0 conn(0x7fc8a00b2360 msgr2=0x7fc8a0066050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:11.624 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.608+0000 7fc8a6433700 1 --2- 172.21.15.38:0/3880886286 >> v2:172.21.15.150:3300/0 conn(0x7fc8a00b2360 0x7fc8a0066050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:11.624 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.608+0000 7fc8a6433700 1 -- 172.21.15.38:0/3880886286 >> v1:172.21.15.150:6789/0 conn(0x7fc8a00aec00 legacy=0x7fc8a00af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:11.625 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.608+0000 7fc8a6433700 1 -- 172.21.15.38:0/3880886286 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a012eb60 con 0x7fc8a00b7200 2020-06-12T17:48:11.625 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.608+0000 7fc8a6433700 1 --2- 172.21.15.38:0/3880886286 >> v2:172.21.15.38:3300/0 conn(0x7fc8a00b7200 0x7fc8a0062500 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc8a00b7b30 tx=0x7fc8a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:11.625 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.608+0000 7fc8a6433700 1 --2- 172.21.15.38:0/3880886286 >> v2:172.21.15.38:3300/0 conn(0x7fc8a00b7200 0x7fc8a0062500 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc8a00b7b30 tx=0x7fc8a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:11.625 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.608+0000 7fc8a6433700 1 --2- 172.21.15.38:0/3880886286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8a00b7200 0x7fc8a0062500 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fc8a00b7b30 tx=0x7fc8a0146220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:11.626 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.608+0000 7fc8a6433700 1 --2- 172.21.15.38:0/3880886286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8a00b7200 0x7fc8a0062500 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fc8a00b7b30 tx=0x7fc8a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:11.626 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.608+0000 7fc8a6433700 1 --2- 172.21.15.38:0/3880886286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8a00b7200 0x7fc8a0062500 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fc8a00b7b30 tx=0x7fc8a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:11.626 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.608+0000 7fc88f7fe700 1 -- 172.21.15.38:0/3880886286 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8900105b0 con 0x7fc8a00b7200 2020-06-12T17:48:11.626 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.608+0000 7fc8a6433700 1 --2- 172.21.15.38:0/3880886286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8a00b7200 0x7fc8a0062500 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fc8a00b7b30 tx=0x7fc8a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:11.626 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.609+0000 7fc88f7fe700 1 -- 172.21.15.38:0/3880886286 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc890010710 con 0x7fc8a00b7200 2020-06-12T17:48:11.627 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.609+0000 7fc8a8697700 1 -- 172.21.15.38:0/3880886286 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a00af740 con 0x7fc8a00b7200 2020-06-12T17:48:11.627 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.609+0000 7fc88f7fe700 1 -- 172.21.15.38:0/3880886286 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc89000c970 con 0x7fc8a00b7200 2020-06-12T17:48:11.627 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.609+0000 7fc8a8697700 1 -- 172.21.15.38:0/3880886286 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a00b0910 con 0x7fc8a00b7200 2020-06-12T17:48:11.629 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.609+0000 7fc8a6433700 1 --2- 172.21.15.38:0/3880886286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8a00b7200 0x7fc8a0062500 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fc8a00b7b30 tx=0x7fc8a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:11.629 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.610+0000 7fc8a8697700 1 -- 172.21.15.38:0/3880886286 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a0056c30 con 0x7fc8a00b7200 2020-06-12T17:48:11.629 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.610+0000 7fc88f7fe700 1 -- 172.21.15.38:0/3880886286 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fc8900011f0 con 0x7fc8a00b7200 2020-06-12T17:48:11.629 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.610+0000 7fc8a6433700 1 --2- 172.21.15.38:0/3880886286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8a00b7200 0x7fc8a0062500 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fc8a00b7b30 tx=0x7fc8a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:11.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.610+0000 7fc88f7fe700 1 --2- 172.21.15.38:0/3880886286 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc88004d740 0x7fc88004fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:11.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.610+0000 7fc88f7fe700 1 -- 172.21.15.38:0/3880886286 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5863+0+0 (secure 0 0 0) 0x7fc890060eb0 con 0x7fc8a00b7200 2020-06-12T17:48:11.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.611+0000 7fc8a5c32700 1 --2- 172.21.15.38:0/3880886286 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc88004d740 0x7fc88004fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:11.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.611+0000 7fc8a5c32700 1 --2- 172.21.15.38:0/3880886286 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc88004d740 0x7fc88004fc00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc89c0010d0 tx=0x7fc89c001a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:11.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.611+0000 7fc8a5c32700 1 --2- 172.21.15.38:0/3880886286 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc88004d740 0x7fc88004fc00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc89c0010d0 tx=0x7fc89c001a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:11.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.611+0000 7fc8a5c32700 1 --2- 172.21.15.38:0/3880886286 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc88004d740 0x7fc88004fc00 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fc89c0010d0 tx=0x7fc89c001a30).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:11.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.614+0000 7fc8a6433700 1 --2- 172.21.15.38:0/3880886286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8a00b7200 0x7fc8a0062500 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fc8a00b7b30 tx=0x7fc8a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:11.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.614+0000 7fc88f7fe700 1 -- 172.21.15.38:0/3880886286 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fc89003c6d0 con 0x7fc8a00b7200 2020-06-12T17:48:11.768 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:11.765+0000 7fc8a8697700 1 -- 172.21.15.38:0/3880886286 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"} v 0) v1 -- 0x7fc8a00b05b0 con 0x7fc8a00b7200 2020-06-12T17:48:12.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:12.608+0000 7fc8a6433700 1 --2- 172.21.15.38:0/3880886286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8a00b7200 0x7fc8a0062500 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fc8a00b7b30 tx=0x7fc8a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:13.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.488+0000 7fc8a6433700 1 --2- 172.21.15.38:0/3880886286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8a00b7200 0x7fc8a0062500 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fc8a00b7b30 tx=0x7fc8a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:13.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.488+0000 7fc88f7fe700 1 -- 172.21.15.38:0/3880886286 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"}]=0 pool 'cephfs_data' created v22) v1 ==== 188+0+0 (secure 0 0 0) 0x7fc89003fcf0 con 0x7fc8a00b7200 2020-06-12T17:48:13.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.492+0000 7fc8a8697700 1 -- 172.21.15.38:0/3880886286 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc88004d740 msgr2=0x7fc88004fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:13.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.492+0000 7fc8a8697700 1 --2- 172.21.15.38:0/3880886286 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc88004d740 0x7fc88004fc00 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fc89c0010d0 tx=0x7fc89c001a30).stop 2020-06-12T17:48:13.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.492+0000 7fc8a8697700 1 -- 172.21.15.38:0/3880886286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8a00b7200 msgr2=0x7fc8a0062500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:13.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.492+0000 7fc8a8697700 1 --2- 172.21.15.38:0/3880886286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8a00b7200 0x7fc8a0062500 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fc8a00b7b30 tx=0x7fc8a0146220).stop 2020-06-12T17:48:13.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.492+0000 7fc8a8697700 1 -- 172.21.15.38:0/3880886286 shutdown_connections 2020-06-12T17:48:13.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.492+0000 7fc8a8697700 1 --2- 172.21.15.38:0/3880886286 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc88004d740 0x7fc88004fc00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:13.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.492+0000 7fc8a8697700 1 --2- 172.21.15.38:0/3880886286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8a00b7200 0x7fc8a0062500 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0x7fc8a00b7b30 tx=0x7fc8a0146220).stop 2020-06-12T17:48:13.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.492+0000 7fc8a8697700 1 --2- 172.21.15.38:0/3880886286 >> v2:172.21.15.150:3300/0 conn(0x7fc8a00b2360 0x7fc8a0066050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:13.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.492+0000 7fc8a8697700 1 -- 172.21.15.38:0/3880886286 >> 172.21.15.38:0/3880886286 conn(0x7fc8a00b5a20 msgr2=0x7fc8a01378d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:13.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.493+0000 7fc8a8697700 1 -- 172.21.15.38:0/3880886286 shutdown_connections 2020-06-12T17:48:13.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.493+0000 7fc8a8697700 1 -- 172.21.15.38:0/3880886286 wait complete. 2020-06-12T17:48:13.501 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' created 2020-06-12T17:48:13.511 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool set cephfs_data allow_ec_overwrites true 2020-06-12T17:48:13.638 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.635+0000 7f1f39521700 1 Processor -- start 2020-06-12T17:48:13.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.635+0000 7f1f39521700 1 -- start start 2020-06-12T17:48:13.641 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.636+0000 7f1f39521700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1f340a2460 0x7f1f340a2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:13.642 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.636+0000 7f1f39521700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1f34146060 0x7f1f3409d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:13.642 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.636+0000 7f1f39521700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3405f7a0 con 0x7f1f3409dd10 2020-06-12T17:48:13.642 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.636+0000 7f1f39521700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3405f2b0 con 0x7f1f340a2460 2020-06-12T17:48:13.642 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.636+0000 7f1f39521700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3405fa40 con 0x7f1f34146060 2020-06-12T17:48:13.643 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.636+0000 7f1f32ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1f340a2460 0x7f1f340a2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:13.643 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.636+0000 7f1f32ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1f340a2460 0x7f1f340a2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35354/0 (socket says 172.21.15.38:35354) 2020-06-12T17:48:13.643 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.636+0000 7f1f32ffd700 1 -- 172.21.15.38:0/1304562388 learned_addr learned my addr 172.21.15.38:0/1304562388 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:13.643 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.636+0000 7f1f2bfff700 1 --2- 172.21.15.38:0/1304562388 >> v2:172.21.15.150:3300/0 conn(0x7f1f34146060 0x7f1f3409d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:13.643 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.636+0000 7f1f32ffd700 1 -- 172.21.15.38:0/1304562388 >> v2:172.21.15.150:3300/0 conn(0x7f1f34146060 msgr2=0x7f1f3409d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:13.644 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.636+0000 7f1f32ffd700 1 --2- 172.21.15.38:0/1304562388 >> v2:172.21.15.150:3300/0 conn(0x7f1f34146060 0x7f1f3409d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:13.644 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.636+0000 7f1f32ffd700 1 -- 172.21.15.38:0/1304562388 >> v1:172.21.15.150:6789/0 conn(0x7f1f3409dd10 legacy=0x7f1f3413fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:13.644 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.636+0000 7f1f32ffd700 1 -- 172.21.15.38:0/1304562388 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f340b7bf0 con 0x7f1f340a2460 2020-06-12T17:48:13.644 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.636+0000 7f1f32ffd700 1 --2- 172.21.15.38:0/1304562388 >> v2:172.21.15.38:3300/0 conn(0x7f1f340a2460 0x7f1f340a2840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1f24002f30 tx=0x7f1f24007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:13.644 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.636+0000 7f1f32ffd700 1 --2- 172.21.15.38:0/1304562388 >> v2:172.21.15.38:3300/0 conn(0x7f1f340a2460 0x7f1f340a2840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1f24002f30 tx=0x7f1f24007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:13.645 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.636+0000 7f1f32ffd700 1 --2- 172.21.15.38:0/1304562388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f340a2460 0x7f1f340a2840 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f1f24002f30 tx=0x7f1f24007e60).ready entity=mon.0 client_cookie=7319567e3c977a60 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:13.645 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.637+0000 7f1f32ffd700 1 --2- 172.21.15.38:0/1304562388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f340a2460 0x7f1f340a2840 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f1f24002f30 tx=0x7f1f24007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:13.645 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.637+0000 7f1f327fc700 1 -- 172.21.15.38:0/1304562388 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f24011630 con 0x7f1f340a2460 2020-06-12T17:48:13.645 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.637+0000 7f1f32ffd700 1 --2- 172.21.15.38:0/1304562388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f340a2460 0x7f1f340a2840 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f1f24002f30 tx=0x7f1f24007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:13.645 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.637+0000 7f1f32ffd700 1 --2- 172.21.15.38:0/1304562388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f340a2460 0x7f1f340a2840 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f1f24002f30 tx=0x7f1f24007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:13.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.637+0000 7f1f327fc700 1 -- 172.21.15.38:0/1304562388 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f24011790 con 0x7f1f340a2460 2020-06-12T17:48:13.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.637+0000 7f1f327fc700 1 -- 172.21.15.38:0/1304562388 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f24011b70 con 0x7f1f340a2460 2020-06-12T17:48:13.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.637+0000 7f1f39521700 1 -- 172.21.15.38:0/1304562388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f340a2460 msgr2=0x7f1f340a2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:13.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.637+0000 7f1f39521700 1 --2- 172.21.15.38:0/1304562388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f340a2460 0x7f1f340a2840 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f1f24002f30 tx=0x7f1f24007e60).stop 2020-06-12T17:48:13.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.637+0000 7f1f39521700 1 -- 172.21.15.38:0/1304562388 shutdown_connections 2020-06-12T17:48:13.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.637+0000 7f1f39521700 1 --2- 172.21.15.38:0/1304562388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f340a2460 0x7f1f340a2840 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:13.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.637+0000 7f1f39521700 1 --2- 172.21.15.38:0/1304562388 >> v2:172.21.15.150:3300/0 conn(0x7f1f34146060 0x7f1f3409d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:13.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.637+0000 7f1f39521700 1 -- 172.21.15.38:0/1304562388 >> 172.21.15.38:0/1304562388 conn(0x7f1f3405b450 msgr2=0x7f1f3405b860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:13.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.637+0000 7f1f39521700 1 -- 172.21.15.38:0/1304562388 shutdown_connections 2020-06-12T17:48:13.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.637+0000 7f1f39521700 1 -- 172.21.15.38:0/1304562388 wait complete. 2020-06-12T17:48:13.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.638+0000 7f1f39521700 1 Processor -- start 2020-06-12T17:48:13.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.638+0000 7f1f39521700 1 -- start start 2020-06-12T17:48:13.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.639+0000 7f1f39521700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f340a2460 0x7f1f340b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:13.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.639+0000 7f1f39521700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f340b6670 con 0x7f1f34146060 2020-06-12T17:48:13.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.639+0000 7f1f39521700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f340b6910 con 0x7f1f3409dd10 2020-06-12T17:48:13.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.639+0000 7f1f39521700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f34143980 con 0x7f1f340a2460 2020-06-12T17:48:13.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.639+0000 7f1f337fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f1f34146060 0x7f1f341407a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37180/0 (socket says 172.21.15.38:37180) 2020-06-12T17:48:13.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.639+0000 7f1f337fe700 1 -- 172.21.15.38:0/4240485675 learned_addr learned my addr 172.21.15.38:0/4240485675 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:13.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.639+0000 7f1f2bfff700 1 --2- 172.21.15.38:0/4240485675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f340a2460 0x7f1f340b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:13.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.639+0000 7f1f30ff9700 1 -- 172.21.15.38:0/4240485675 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 30904916 0 0) 0x7f1f340b6670 con 0x7f1f34146060 2020-06-12T17:48:13.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.639+0000 7f1f30ff9700 1 -- 172.21.15.38:0/4240485675 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f18002fe0 con 0x7f1f34146060 2020-06-12T17:48:13.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.639+0000 7f1f30ff9700 1 -- 172.21.15.38:0/4240485675 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304662612 0 0) 0x7f1f340b6910 con 0x7f1f3409dd10 2020-06-12T17:48:13.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.639+0000 7f1f30ff9700 1 -- 172.21.15.38:0/4240485675 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f340b6670 con 0x7f1f3409dd10 2020-06-12T17:48:13.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.639+0000 7f1f2bfff700 1 -- 172.21.15.38:0/4240485675 >> v1:172.21.15.150:6789/0 conn(0x7f1f3409dd10 legacy=0x7f1f3413d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:13.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.639+0000 7f1f2bfff700 1 -- 172.21.15.38:0/4240485675 >> v1:172.21.15.38:6789/0 conn(0x7f1f34146060 legacy=0x7f1f341407a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:13.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.639+0000 7f1f30ff9700 1 -- 172.21.15.38:0/4240485675 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1541846261 0 0) 0x7f1f18002fe0 con 0x7f1f34146060 2020-06-12T17:48:13.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.639+0000 7f1f2bfff700 1 -- 172.21.15.38:0/4240485675 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f340b6db0 con 0x7f1f340a2460 2020-06-12T17:48:13.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.640+0000 7f1f2bfff700 1 --2- 172.21.15.38:0/4240485675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f340a2460 0x7f1f340b1a30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1f2c0014e0 tx=0x7f1f1c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:13.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.640+0000 7f1f2bfff700 1 --2- 172.21.15.38:0/4240485675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f340a2460 0x7f1f340b1a30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1f2c0014e0 tx=0x7f1f1c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:13.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.640+0000 7f1f2bfff700 1 --2- 172.21.15.38:0/4240485675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f340a2460 0x7f1f340b1a30 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f1f2c0014e0 tx=0x7f1f1c007e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:13.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.640+0000 7f1f2bfff700 1 --2- 172.21.15.38:0/4240485675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f340a2460 0x7f1f340b1a30 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f1f2c0014e0 tx=0x7f1f1c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:13.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.640+0000 7f1f30ff9700 1 -- 172.21.15.38:0/4240485675 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f2c001cc0 con 0x7f1f340a2460 2020-06-12T17:48:13.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.640+0000 7f1f2bfff700 1 --2- 172.21.15.38:0/4240485675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f340a2460 0x7f1f340b1a30 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f1f2c0014e0 tx=0x7f1f1c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:13.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.640+0000 7f1f30ff9700 1 -- 172.21.15.38:0/4240485675 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1c007340 con 0x7f1f340a2460 2020-06-12T17:48:13.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.640+0000 7f1f2bfff700 1 --2- 172.21.15.38:0/4240485675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f340a2460 0x7f1f340b1a30 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f1f2c0014e0 tx=0x7f1f1c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:13.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.640+0000 7f1f39521700 1 -- 172.21.15.38:0/4240485675 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3413db80 con 0x7f1f340a2460 2020-06-12T17:48:13.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.640+0000 7f1f30ff9700 1 -- 172.21.15.38:0/4240485675 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f1c0074b0 con 0x7f1f340a2460 2020-06-12T17:48:13.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.640+0000 7f1f39521700 1 -- 172.21.15.38:0/4240485675 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f340a1b90 con 0x7f1f340a2460 2020-06-12T17:48:13.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.640+0000 7f1f2bfff700 1 --2- 172.21.15.38:0/4240485675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f340a2460 0x7f1f340b1a30 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f1f2c0014e0 tx=0x7f1f1c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:13.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.641+0000 7f1f39521700 1 -- 172.21.15.38:0/4240485675 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f340b6fc0 con 0x7f1f340a2460 2020-06-12T17:48:13.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.641+0000 7f1f30ff9700 1 -- 172.21.15.38:0/4240485675 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f1f1c0058b0 con 0x7f1f340a2460 2020-06-12T17:48:13.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.641+0000 7f1f2bfff700 1 --2- 172.21.15.38:0/4240485675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f340a2460 0x7f1f340b1a30 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f1f2c0014e0 tx=0x7f1f1c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:13.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.641+0000 7f1f30ff9700 1 --2- 172.21.15.38:0/4240485675 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1f1804d9e0 0x7f1f1804fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:13.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.641+0000 7f1f30ff9700 1 -- 172.21.15.38:0/4240485675 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6315+0+0 (secure 0 0 0) 0x7f1f1c00d0c0 con 0x7f1f340a2460 2020-06-12T17:48:13.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.641+0000 7f1f32ffd700 1 --2- 172.21.15.38:0/4240485675 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1f1804d9e0 0x7f1f1804fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:13.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.642+0000 7f1f32ffd700 1 --2- 172.21.15.38:0/4240485675 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1f1804d9e0 0x7f1f1804fea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1f24007ed0 tx=0x7f1f24007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:13.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.642+0000 7f1f32ffd700 1 --2- 172.21.15.38:0/4240485675 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1f1804d9e0 0x7f1f1804fea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1f24007ed0 tx=0x7f1f24007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:13.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.642+0000 7f1f32ffd700 1 --2- 172.21.15.38:0/4240485675 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1f1804d9e0 0x7f1f1804fea0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f1f24007ed0 tx=0x7f1f24007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:13.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.645+0000 7f1f2bfff700 1 --2- 172.21.15.38:0/4240485675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f340a2460 0x7f1f340b1a30 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f1f2c0014e0 tx=0x7f1f1c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:13.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.645+0000 7f1f30ff9700 1 -- 172.21.15.38:0/4240485675 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f1f340b6fc0 con 0x7f1f340a2460 2020-06-12T17:48:13.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:13.799+0000 7f1f39521700 1 -- 172.21.15.38:0/4240485675 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f1f340b6fc0 con 0x7f1f340a2460 2020-06-12T17:48:14.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.489+0000 7f1f2bfff700 1 --2- 172.21.15.38:0/4240485675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f340a2460 0x7f1f340b1a30 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f1f2c0014e0 tx=0x7f1f1c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:14.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.489+0000 7f1f30ff9700 1 -- 172.21.15.38:0/4240485675 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 166+0+0 (secure 0 0 0) 0x7f1f340b6fc0 con 0x7f1f340a2460 2020-06-12T17:48:14.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.492+0000 7f1f39521700 1 -- 172.21.15.38:0/4240485675 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1f1804d9e0 msgr2=0x7f1f1804fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:14.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.492+0000 7f1f39521700 1 --2- 172.21.15.38:0/4240485675 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1f1804d9e0 0x7f1f1804fea0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f1f24007ed0 tx=0x7f1f24007e60).stop 2020-06-12T17:48:14.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.492+0000 7f1f39521700 1 -- 172.21.15.38:0/4240485675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f340a2460 msgr2=0x7f1f340b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:14.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.492+0000 7f1f39521700 1 --2- 172.21.15.38:0/4240485675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f340a2460 0x7f1f340b1a30 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f1f2c0014e0 tx=0x7f1f1c007e60).stop 2020-06-12T17:48:14.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.492+0000 7f1f39521700 1 -- 172.21.15.38:0/4240485675 shutdown_connections 2020-06-12T17:48:14.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.492+0000 7f1f39521700 1 --2- 172.21.15.38:0/4240485675 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1f1804d9e0 0x7f1f1804fea0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:14.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.492+0000 7f1f39521700 1 --2- 172.21.15.38:0/4240485675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f340a2460 0x7f1f340b1a30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:14.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.492+0000 7f1f39521700 1 -- 172.21.15.38:0/4240485675 >> 172.21.15.38:0/4240485675 conn(0x7f1f3405b450 msgr2=0x7f1f3406a440 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:14.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.492+0000 7f1f39521700 1 -- 172.21.15.38:0/4240485675 shutdown_connections 2020-06-12T17:48:14.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.492+0000 7f1f39521700 1 -- 172.21.15.38:0/4240485675 wait complete. 2020-06-12T17:48:14.498 INFO:teuthology.orchestra.run.smithi038.stderr:set pool 4 allow_ec_overwrites to true 2020-06-12T17:48:14.512 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-06-12T17:48:14.643 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.639+0000 7ff54bcef700 1 Processor -- start 2020-06-12T17:48:14.643 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.640+0000 7ff54bcef700 1 -- start start 2020-06-12T17:48:14.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.640+0000 7ff54bcef700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff54405b610 0x7ff54409ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:14.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.640+0000 7ff54bcef700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff544143760 0x7ff5441495b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:14.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.640+0000 7ff54bcef700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff544146590 con 0x7ff544146cd0 2020-06-12T17:48:14.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.640+0000 7ff54bcef700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5441463b0 con 0x7ff544143760 2020-06-12T17:48:14.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.640+0000 7ff54bcef700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff544146830 con 0x7ff54405b610 2020-06-12T17:48:14.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.640+0000 7ff54a28c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff544143760 0x7ff5441495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:14.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.640+0000 7ff54928a700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff544146cd0 0x7ff544143050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37184/0 (socket says 172.21.15.38:37184) 2020-06-12T17:48:14.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.640+0000 7ff54928a700 1 -- 172.21.15.38:0/1993950214 learned_addr learned my addr 172.21.15.38:0/1993950214 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:14.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.641+0000 7ff549a8b700 1 --2- 172.21.15.38:0/1993950214 >> v2:172.21.15.150:3300/0 conn(0x7ff54405b610 0x7ff54409ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:14.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.641+0000 7ff54a28c700 1 -- 172.21.15.38:0/1993950214 >> v2:172.21.15.150:3300/0 conn(0x7ff54405b610 msgr2=0x7ff54409ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:14.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.641+0000 7ff54a28c700 1 --2- 172.21.15.38:0/1993950214 >> v2:172.21.15.150:3300/0 conn(0x7ff54405b610 0x7ff54409ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:14.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.641+0000 7ff54a28c700 1 -- 172.21.15.38:0/1993950214 >> v1:172.21.15.38:6789/0 conn(0x7ff544146cd0 legacy=0x7ff544143050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:14.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.641+0000 7ff548a89700 1 -- 172.21.15.38:0/1993950214 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609376781 0 0) 0x7ff544146590 con 0x7ff544146cd0 2020-06-12T17:48:14.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.641+0000 7ff54a28c700 1 -- 172.21.15.38:0/1993950214 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54405b9f0 con 0x7ff544143760 2020-06-12T17:48:14.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.641+0000 7ff54a28c700 1 --2- 172.21.15.38:0/1993950214 >> v2:172.21.15.38:3300/0 conn(0x7ff544143760 0x7ff5441495b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff534002f30 tx=0x7ff534007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:14.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.641+0000 7ff54a28c700 1 --2- 172.21.15.38:0/1993950214 >> v2:172.21.15.38:3300/0 conn(0x7ff544143760 0x7ff5441495b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff534002f30 tx=0x7ff534007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:14.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.641+0000 7ff54a28c700 1 --2- 172.21.15.38:0/1993950214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff544143760 0x7ff5441495b0 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7ff534002f30 tx=0x7ff534007e60).ready entity=mon.0 client_cookie=366c49c0250b4c9f server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:14.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.641+0000 7ff54a28c700 1 --2- 172.21.15.38:0/1993950214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff544143760 0x7ff5441495b0 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7ff534002f30 tx=0x7ff534007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:14.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.641+0000 7ff548a89700 1 -- 172.21.15.38:0/1993950214 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff534011430 con 0x7ff544143760 2020-06-12T17:48:14.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.641+0000 7ff54a28c700 1 --2- 172.21.15.38:0/1993950214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff544143760 0x7ff5441495b0 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7ff534002f30 tx=0x7ff534007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:14.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.641+0000 7ff548a89700 1 -- 172.21.15.38:0/1993950214 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff534011590 con 0x7ff544143760 2020-06-12T17:48:14.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.641+0000 7ff54a28c700 1 --2- 172.21.15.38:0/1993950214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff544143760 0x7ff5441495b0 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7ff534002f30 tx=0x7ff534007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:14.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.641+0000 7ff548a89700 1 -- 172.21.15.38:0/1993950214 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff534011930 con 0x7ff544143760 2020-06-12T17:48:14.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.641+0000 7ff54bcef700 1 -- 172.21.15.38:0/1993950214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff544143760 msgr2=0x7ff5441495b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:14.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.641+0000 7ff54bcef700 1 --2- 172.21.15.38:0/1993950214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff544143760 0x7ff5441495b0 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7ff534002f30 tx=0x7ff534007e60).stop 2020-06-12T17:48:14.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.642+0000 7ff54bcef700 1 -- 172.21.15.38:0/1993950214 shutdown_connections 2020-06-12T17:48:14.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.642+0000 7ff54bcef700 1 --2- 172.21.15.38:0/1993950214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff544143760 0x7ff5441495b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:14.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.642+0000 7ff54bcef700 1 --2- 172.21.15.38:0/1993950214 >> v2:172.21.15.150:3300/0 conn(0x7ff54405b610 0x7ff54409ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:14.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.642+0000 7ff54bcef700 1 -- 172.21.15.38:0/1993950214 >> 172.21.15.38:0/1993950214 conn(0x7ff544066080 msgr2=0x7ff5440bc830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:14.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.642+0000 7ff54bcef700 1 -- 172.21.15.38:0/1993950214 shutdown_connections 2020-06-12T17:48:14.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.642+0000 7ff54bcef700 1 -- 172.21.15.38:0/1993950214 wait complete. 2020-06-12T17:48:14.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.643+0000 7ff54bcef700 1 Processor -- start 2020-06-12T17:48:14.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.643+0000 7ff54bcef700 1 -- start start 2020-06-12T17:48:14.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.643+0000 7ff54bcef700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff54405b610 0x7ff5440a2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:14.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.643+0000 7ff54bcef700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5441460b0 con 0x7ff544146cd0 2020-06-12T17:48:14.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.643+0000 7ff54bcef700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff544144660 con 0x7ff544143760 2020-06-12T17:48:14.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.643+0000 7ff54bcef700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff544144900 con 0x7ff54405b610 2020-06-12T17:48:14.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.644+0000 7ff54a28c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff544146cd0 0x7ff5441529a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37192/0 (socket says 172.21.15.38:37192) 2020-06-12T17:48:14.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.644+0000 7ff54a28c700 1 -- 172.21.15.38:0/1290827086 learned_addr learned my addr 172.21.15.38:0/1290827086 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:14.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.644+0000 7ff549a8b700 1 --2- 172.21.15.38:0/1290827086 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff54405b610 0x7ff5440a2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:14.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.644+0000 7ff542ffd700 1 -- 172.21.15.38:0/1290827086 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545486714 0 0) 0x7ff5441460b0 con 0x7ff544146cd0 2020-06-12T17:48:14.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.644+0000 7ff542ffd700 1 -- 172.21.15.38:0/1290827086 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff524002fe0 con 0x7ff544146cd0 2020-06-12T17:48:14.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.644+0000 7ff542ffd700 1 -- 172.21.15.38:0/1290827086 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2513664656 0 0) 0x7ff544144660 con 0x7ff544143760 2020-06-12T17:48:14.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.644+0000 7ff542ffd700 1 -- 172.21.15.38:0/1290827086 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5441460b0 con 0x7ff544143760 2020-06-12T17:48:14.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.644+0000 7ff542ffd700 1 -- 172.21.15.38:0/1290827086 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 609235198 0 0) 0x7ff524002fe0 con 0x7ff544146cd0 2020-06-12T17:48:14.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.644+0000 7ff549a8b700 1 -- 172.21.15.38:0/1290827086 >> v1:172.21.15.150:6789/0 conn(0x7ff544143760 legacy=0x7ff544156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:14.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.644+0000 7ff549a8b700 1 -- 172.21.15.38:0/1290827086 >> v1:172.21.15.38:6789/0 conn(0x7ff544146cd0 legacy=0x7ff5441529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:14.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.644+0000 7ff549a8b700 1 -- 172.21.15.38:0/1290827086 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff544145d30 con 0x7ff54405b610 2020-06-12T17:48:14.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.644+0000 7ff549a8b700 1 --2- 172.21.15.38:0/1290827086 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff54405b610 0x7ff5440a2480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff534010200 tx=0x7ff53c00e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:14.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.644+0000 7ff549a8b700 1 --2- 172.21.15.38:0/1290827086 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff54405b610 0x7ff5440a2480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff534010200 tx=0x7ff53c00e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:14.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.644+0000 7ff549a8b700 1 --2- 172.21.15.38:0/1290827086 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff54405b610 0x7ff5440a2480 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7ff534010200 tx=0x7ff53c00e440).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:14.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.644+0000 7ff549a8b700 1 --2- 172.21.15.38:0/1290827086 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff54405b610 0x7ff5440a2480 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7ff534010200 tx=0x7ff53c00e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:14.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.644+0000 7ff542ffd700 1 -- 172.21.15.38:0/1290827086 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff534008e10 con 0x7ff54405b610 2020-06-12T17:48:14.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.644+0000 7ff54bcef700 1 -- 172.21.15.38:0/1290827086 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff544145700 con 0x7ff54405b610 2020-06-12T17:48:14.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.644+0000 7ff549a8b700 1 --2- 172.21.15.38:0/1290827086 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff54405b610 0x7ff5440a2480 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7ff534010200 tx=0x7ff53c00e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:14.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.644+0000 7ff542ffd700 1 -- 172.21.15.38:0/1290827086 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53c005e30 con 0x7ff54405b610 2020-06-12T17:48:14.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.644+0000 7ff549a8b700 1 --2- 172.21.15.38:0/1290827086 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff54405b610 0x7ff5440a2480 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7ff534010200 tx=0x7ff53c00e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:14.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.644+0000 7ff542ffd700 1 -- 172.21.15.38:0/1290827086 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff53c007540 con 0x7ff54405b610 2020-06-12T17:48:14.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.645+0000 7ff54bcef700 1 -- 172.21.15.38:0/1290827086 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff544148930 con 0x7ff54405b610 2020-06-12T17:48:14.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.645+0000 7ff549a8b700 1 --2- 172.21.15.38:0/1290827086 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff54405b610 0x7ff5440a2480 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7ff534010200 tx=0x7ff53c00e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:14.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.646+0000 7ff54bcef700 1 -- 172.21.15.38:0/1290827086 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff544056c30 con 0x7ff54405b610 2020-06-12T17:48:14.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.646+0000 7ff542ffd700 1 -- 172.21.15.38:0/1290827086 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7ff53c007780 con 0x7ff54405b610 2020-06-12T17:48:14.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.646+0000 7ff549a8b700 1 --2- 172.21.15.38:0/1290827086 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff54405b610 0x7ff5440a2480 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7ff534010200 tx=0x7ff53c00e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:14.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.646+0000 7ff542ffd700 1 --2- 172.21.15.38:0/1290827086 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff52404d9c0 0x7ff52404fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:14.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.646+0000 7ff542ffd700 1 -- 172.21.15.38:0/1290827086 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6315+0+0 (secure 0 0 0) 0x7ff53c060c70 con 0x7ff54405b610 2020-06-12T17:48:14.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.646+0000 7ff54928a700 1 --2- 172.21.15.38:0/1290827086 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff52404d9c0 0x7ff52404fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:14.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.647+0000 7ff54928a700 1 --2- 172.21.15.38:0/1290827086 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff52404d9c0 0x7ff52404fe80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff538001030 tx=0x7ff538001570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:14.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.647+0000 7ff54928a700 1 --2- 172.21.15.38:0/1290827086 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff52404d9c0 0x7ff52404fe80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff538001030 tx=0x7ff538001570).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:14.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.647+0000 7ff54928a700 1 --2- 172.21.15.38:0/1290827086 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff52404d9c0 0x7ff52404fe80 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7ff538001030 tx=0x7ff538001570).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:14.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.650+0000 7ff549a8b700 1 --2- 172.21.15.38:0/1290827086 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff54405b610 0x7ff5440a2480 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7ff534010200 tx=0x7ff53c00e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:14.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.650+0000 7ff542ffd700 1 -- 172.21.15.38:0/1290827086 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7ff53c03c470 con 0x7ff54405b610 2020-06-12T17:48:14.853 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.849+0000 7ff54bcef700 1 -- 172.21.15.38:0/1290827086 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7ff54405a5e0 con 0x7ff54405b610 2020-06-12T17:48:14.854 INFO:tasks.ceph.mon.a.smithi038.stderr:2020-06-12T17:48:14.851+0000 7fa8b571e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-06-12T17:48:14.860 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.857+0000 7ff549a8b700 1 --2- 172.21.15.38:0/1290827086 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff54405b610 0x7ff5440a2480 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7ff534010200 tx=0x7ff53c00e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:14.860 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.857+0000 7ff542ffd700 1 -- 172.21.15.38:0/1290827086 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v2) v1 ==== 187+0+0 (secure 0 0 0) 0x7ff53c03fa90 con 0x7ff54405b610 2020-06-12T17:48:14.862 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.859+0000 7ff54bcef700 1 -- 172.21.15.38:0/1290827086 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff52404d9c0 msgr2=0x7ff52404fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:14.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.859+0000 7ff54bcef700 1 --2- 172.21.15.38:0/1290827086 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff52404d9c0 0x7ff52404fe80 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7ff538001030 tx=0x7ff538001570).stop 2020-06-12T17:48:14.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.859+0000 7ff54bcef700 1 -- 172.21.15.38:0/1290827086 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff54405b610 msgr2=0x7ff5440a2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:14.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.859+0000 7ff54bcef700 1 --2- 172.21.15.38:0/1290827086 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff54405b610 0x7ff5440a2480 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7ff534010200 tx=0x7ff53c00e440).stop 2020-06-12T17:48:14.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.859+0000 7ff54bcef700 1 -- 172.21.15.38:0/1290827086 shutdown_connections 2020-06-12T17:48:14.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.859+0000 7ff54bcef700 1 --2- 172.21.15.38:0/1290827086 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff52404d9c0 0x7ff52404fe80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:14.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.859+0000 7ff54bcef700 1 --2- 172.21.15.38:0/1290827086 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff54405b610 0x7ff5440a2480 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:14.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.859+0000 7ff54bcef700 1 -- 172.21.15.38:0/1290827086 >> 172.21.15.38:0/1290827086 conn(0x7ff544066080 msgr2=0x7ff544142290 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:14.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.859+0000 7ff54bcef700 1 -- 172.21.15.38:0/1290827086 shutdown_connections 2020-06-12T17:48:14.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.859+0000 7ff54bcef700 1 -- 172.21.15.38:0/1290827086 wait complete. 2020-06-12T17:48:14.865 INFO:teuthology.orchestra.run.smithi038.stderr:new fs with metadata pool 3 and data pool 4 2020-06-12T17:48:14.872 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-12T17:48:14.988 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.984+0000 7ff0a9fd3700 1 Processor -- start 2020-06-12T17:48:14.989 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.984+0000 7ff0a9fd3700 1 -- start start 2020-06-12T17:48:14.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.985+0000 7ff0a9fd3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0a4143470 0x7ff0a4143850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:14.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.985+0000 7ff0a9fd3700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff0a40a1970 0x7ff0a4146ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:14.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.985+0000 7ff0a9fd3700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a40a0f90 con 0x7ff0a40bcf50 2020-06-12T17:48:15.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.985+0000 7ff0a9fd3700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a40a1230 con 0x7ff0a40a1970 2020-06-12T17:48:15.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.985+0000 7ff0a9fd3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a40a14d0 con 0x7ff0a4143470 2020-06-12T17:48:15.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.985+0000 7ff0a2ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff0a40a1970 0x7ff0a4146ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:15.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.985+0000 7ff0a3fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff0a40bcf50 0x7ff0a409fa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37196/0 (socket says 172.21.15.38:37196) 2020-06-12T17:48:15.001 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.985+0000 7ff0a3fff700 1 -- 172.21.15.38:0/92860691 learned_addr learned my addr 172.21.15.38:0/92860691 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:15.001 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.985+0000 7ff0a37fe700 1 --2- 172.21.15.38:0/92860691 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0a4143470 0x7ff0a4143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:15.001 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.985+0000 7ff0a2ffd700 1 -- 172.21.15.38:0/92860691 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0a4143470 msgr2=0x7ff0a4143850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:15.001 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.985+0000 7ff0a2ffd700 1 --2- 172.21.15.38:0/92860691 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0a4143470 0x7ff0a4143850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:15.002 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.985+0000 7ff0a2ffd700 1 -- 172.21.15.38:0/92860691 >> v1:172.21.15.38:6789/0 conn(0x7ff0a40bcf50 legacy=0x7ff0a409fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:15.002 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.985+0000 7ff0a27fc700 1 -- 172.21.15.38:0/92860691 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28091594 0 0) 0x7ff0a40a0f90 con 0x7ff0a40bcf50 2020-06-12T17:48:15.002 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.985+0000 7ff0a2ffd700 1 -- 172.21.15.38:0/92860691 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a40a0cd0 con 0x7ff0a40a1970 2020-06-12T17:48:15.002 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.985+0000 7ff0a37fe700 1 --2- 172.21.15.38:0/92860691 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0a4143470 0x7ff0a4143850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:48:15.003 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.985+0000 7ff0a2ffd700 1 --2- 172.21.15.38:0/92860691 >> v2:172.21.15.38:3300/0 conn(0x7ff0a40a1970 0x7ff0a4146ae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff098002f30 tx=0x7ff098007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.003 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.985+0000 7ff0a2ffd700 1 --2- 172.21.15.38:0/92860691 >> v2:172.21.15.38:3300/0 conn(0x7ff0a40a1970 0x7ff0a4146ae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff098002f30 tx=0x7ff098007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.003 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.985+0000 7ff0a2ffd700 1 --2- 172.21.15.38:0/92860691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0a40a1970 0x7ff0a4146ae0 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7ff098002f30 tx=0x7ff098007e60).ready entity=mon.0 client_cookie=f847b0f8744c2224 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:15.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.986+0000 7ff0a2ffd700 1 --2- 172.21.15.38:0/92860691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0a40a1970 0x7ff0a4146ae0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7ff098002f30 tx=0x7ff098007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.986+0000 7ff0a27fc700 1 -- 172.21.15.38:0/92860691 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff098011430 con 0x7ff0a40a1970 2020-06-12T17:48:15.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.986+0000 7ff0a2ffd700 1 --2- 172.21.15.38:0/92860691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0a40a1970 0x7ff0a4146ae0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7ff098002f30 tx=0x7ff098007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.986+0000 7ff0a2ffd700 1 --2- 172.21.15.38:0/92860691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0a40a1970 0x7ff0a4146ae0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7ff098002f30 tx=0x7ff098007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.986+0000 7ff0a27fc700 1 -- 172.21.15.38:0/92860691 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff098011590 con 0x7ff0a40a1970 2020-06-12T17:48:15.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.986+0000 7ff0a27fc700 1 -- 172.21.15.38:0/92860691 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff098011970 con 0x7ff0a40a1970 2020-06-12T17:48:15.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.986+0000 7ff0a9fd3700 1 -- 172.21.15.38:0/92860691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0a40a1970 msgr2=0x7ff0a4146ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:15.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.986+0000 7ff0a9fd3700 1 --2- 172.21.15.38:0/92860691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0a40a1970 0x7ff0a4146ae0 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7ff098002f30 tx=0x7ff098007e60).stop 2020-06-12T17:48:15.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.986+0000 7ff0a9fd3700 1 -- 172.21.15.38:0/92860691 shutdown_connections 2020-06-12T17:48:15.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.986+0000 7ff0a9fd3700 1 --2- 172.21.15.38:0/92860691 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0a4143470 0x7ff0a4143850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:15.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.986+0000 7ff0a9fd3700 1 --2- 172.21.15.38:0/92860691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0a40a1970 0x7ff0a4146ae0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:15.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.986+0000 7ff0a9fd3700 1 -- 172.21.15.38:0/92860691 >> 172.21.15.38:0/92860691 conn(0x7ff0a4066040 msgr2=0x7ff0a40bc840 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:15.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.986+0000 7ff0a9fd3700 1 -- 172.21.15.38:0/92860691 shutdown_connections 2020-06-12T17:48:15.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.986+0000 7ff0a9fd3700 1 -- 172.21.15.38:0/92860691 wait complete. 2020-06-12T17:48:15.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.987+0000 7ff0a9fd3700 1 Processor -- start 2020-06-12T17:48:15.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.987+0000 7ff0a9fd3700 1 -- start start 2020-06-12T17:48:15.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.988+0000 7ff0a9fd3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff0a40a1970 0x7ff0a409e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:15.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.988+0000 7ff0a9fd3700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a40b6560 con 0x7ff0a40bcf50 2020-06-12T17:48:15.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.988+0000 7ff0a9fd3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a409e050 con 0x7ff0a4143470 2020-06-12T17:48:15.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.988+0000 7ff0a9fd3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a4149470 con 0x7ff0a40a1970 2020-06-12T17:48:15.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.988+0000 7ff0a2ffd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff0a40bcf50 0x7ff0a4146d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37204/0 (socket says 172.21.15.38:37204) 2020-06-12T17:48:15.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.988+0000 7ff0a2ffd700 1 -- 172.21.15.38:0/3835953848 learned_addr learned my addr 172.21.15.38:0/3835953848 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:15.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.988+0000 7ff0a0ff9700 1 -- 172.21.15.38:0/3835953848 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3546768526 0 0) 0x7ff0a40b6560 con 0x7ff0a40bcf50 2020-06-12T17:48:15.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.988+0000 7ff0a0ff9700 1 -- 172.21.15.38:0/3835953848 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff084002fe0 con 0x7ff0a40bcf50 2020-06-12T17:48:15.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.988+0000 7ff0a37fe700 1 --2- 172.21.15.38:0/3835953848 >> v2:172.21.15.150:3300/0 conn(0x7ff0a40a1970 0x7ff0a409e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:15.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.988+0000 7ff0a0ff9700 1 -- 172.21.15.38:0/3835953848 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 573600419 0 0) 0x7ff084002fe0 con 0x7ff0a40bcf50 2020-06-12T17:48:15.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a0ff9700 1 -- 172.21.15.38:0/3835953848 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff0a40b6560 con 0x7ff0a40bcf50 2020-06-12T17:48:15.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a0ff9700 1 -- 172.21.15.38:0/3835953848 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7ff098008e10 con 0x7ff0a40bcf50 2020-06-12T17:48:15.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a0ff9700 1 -- 172.21.15.38:0/3835953848 >> v2:172.21.15.150:3300/0 conn(0x7ff0a40a1970 msgr2=0x7ff0a409e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:15.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a0ff9700 1 --2- 172.21.15.38:0/3835953848 >> v2:172.21.15.150:3300/0 conn(0x7ff0a40a1970 0x7ff0a409e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:15.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a0ff9700 1 -- 172.21.15.38:0/3835953848 >> v1:172.21.15.150:6789/0 conn(0x7ff0a4143470 legacy=0x7ff0a40b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:15.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a0ff9700 1 -- 172.21.15.38:0/3835953848 >> v1:172.21.15.38:6789/0 conn(0x7ff0a40bcf50 legacy=0x7ff0a4146d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:15.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a0ff9700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0840049b0 0x7ff084004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:15.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a0ff9700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0840052b0 0x7ff0840039c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:15.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a0ff9700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff084003fc0 0x7ff084004440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:15.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a0ff9700 1 -- 172.21.15.38:0/3835953848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a4149470 con 0x7ff0840049b0 2020-06-12T17:48:15.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a0ff9700 1 -- 172.21.15.38:0/3835953848 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08400b930 con 0x7ff0840052b0 2020-06-12T17:48:15.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a0ff9700 1 -- 172.21.15.38:0/3835953848 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08400baf0 con 0x7ff084003fc0 2020-06-12T17:48:15.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a37fe700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0840049b0 0x7ff084004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:15.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a2ffd700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0840052b0 0x7ff0840039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:15.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a3fff700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff084003fc0 0x7ff084004440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:15.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a37fe700 1 -- 172.21.15.38:0/3835953848 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff084003fc0 msgr2=0x7ff084004440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:15.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a37fe700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff084003fc0 0x7ff084004440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:15.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a37fe700 1 -- 172.21.15.38:0/3835953848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0840052b0 msgr2=0x7ff0840039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:15.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a37fe700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0840052b0 0x7ff0840039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:15.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a37fe700 1 -- 172.21.15.38:0/3835953848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a41495b0 con 0x7ff0840049b0 2020-06-12T17:48:15.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a3fff700 1 -- 172.21.15.38:0/3835953848 reap_dead start 2020-06-12T17:48:15.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a9fd3700 1 -- 172.21.15.38:0/3835953848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a40b6130 con 0x7ff0840049b0 2020-06-12T17:48:15.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a2ffd700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0840052b0 0x7ff0840039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:15.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a37fe700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0840049b0 0x7ff084004d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff094002f30 tx=0x7ff09400df50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a9fd3700 1 -- 172.21.15.38:0/3835953848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a409e730 con 0x7ff0840049b0 2020-06-12T17:48:15.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a37fe700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0840049b0 0x7ff084004d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff094002f30 tx=0x7ff09400df50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a37fe700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0840049b0 0x7ff084004d90 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7ff094002f30 tx=0x7ff09400df50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:15.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a37fe700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0840049b0 0x7ff084004d90 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7ff094002f30 tx=0x7ff09400df50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a0ff9700 1 -- 172.21.15.38:0/3835953848 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff094007150 con 0x7ff0840049b0 2020-06-12T17:48:15.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a37fe700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0840049b0 0x7ff084004d90 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7ff094002f30 tx=0x7ff09400df50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a37fe700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0840049b0 0x7ff084004d90 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7ff094002f30 tx=0x7ff09400df50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a0ff9700 1 -- 172.21.15.38:0/3835953848 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0940072b0 con 0x7ff0840049b0 2020-06-12T17:48:15.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.989+0000 7ff0a0ff9700 1 -- 172.21.15.38:0/3835953848 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0940127a0 con 0x7ff0840049b0 2020-06-12T17:48:15.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.990+0000 7ff0a37fe700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0840049b0 0x7ff084004d90 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7ff094002f30 tx=0x7ff09400df50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.990+0000 7ff0a9fd3700 1 -- 172.21.15.38:0/3835953848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff080003340 con 0x7ff0840049b0 2020-06-12T17:48:15.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.990+0000 7ff0a0ff9700 1 -- 172.21.15.38:0/3835953848 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7ff094012900 con 0x7ff0840049b0 2020-06-12T17:48:15.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.990+0000 7ff0a37fe700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0840049b0 0x7ff084004d90 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7ff094002f30 tx=0x7ff09400df50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.991+0000 7ff0a0ff9700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff084051560 0x7ff084053a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:15.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.991+0000 7ff0a0ff9700 1 -- 172.21.15.38:0/3835953848 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff0940612b0 con 0x7ff0840049b0 2020-06-12T17:48:15.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.991+0000 7ff0a2ffd700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff084051560 0x7ff084053a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:15.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.991+0000 7ff0a2ffd700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff084051560 0x7ff084053a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff0980082e0 tx=0x7ff098007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.991+0000 7ff0a2ffd700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff084051560 0x7ff084053a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff0980082e0 tx=0x7ff098007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.991+0000 7ff0a2ffd700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff084051560 0x7ff084053a20 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7ff0980082e0 tx=0x7ff098007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:15.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.994+0000 7ff0a37fe700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0840049b0 0x7ff084004d90 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7ff094002f30 tx=0x7ff09400df50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.020 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:14.994+0000 7ff0a0ff9700 1 -- 172.21.15.38:0/3835953848 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7ff09403cab0 con 0x7ff0840049b0 2020-06-12T17:48:15.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.144+0000 7ff0a9fd3700 1 -- 172.21.15.38:0/3835953848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0800021d0 con 0x7ff0840049b0 2020-06-12T17:48:15.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.145+0000 7ff0a37fe700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0840049b0 0x7ff084004d90 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7ff094002f30 tx=0x7ff09400df50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.145+0000 7ff0a0ff9700 1 -- 172.21.15.38:0/3835953848 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16347 (secure 0 0 0) 0x7ff09400a0d0 con 0x7ff0840049b0 2020-06-12T17:48:15.150 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:15.150 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":24,"fsid":"8e42a2e7-b187-42c4-a73f-8f812ee62352","created":"2020-06-12T17:47:54.434340+0000","modified":"2020-06-12T17:48:14.851712+0000","last_up_change":"2020-06-12T17:48:03.388718+0000","last_in_change":"2020-06-12T17:48:03.388718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-06-12T17:47:57.558119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-06-12T17:48:07.419264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-06-12T17:48:09.934098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-06-12T17:48:12.497229+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"44ac3dea-67b4-4b9a-bc18-ac511710afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":31038},{"type":"v1","addr":"172.21.15.38:6816","nonce":31038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":31038},{"type":"v1","addr":"172.21.15.38:6819","nonce":31038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":31038},{"type":"v1","addr":"172.21.15.38:6823","nonce":31038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":31038},{"type":"v1","addr":"172.21.15.38:6821","nonce":31038}]},"public_addr":"172.21.15.38:6816/31038","cluster_addr":"172.21.15.38:6819/31038","heartbeat_back_addr":"172.21.15.38:6823/31038","heartbeat_front_addr":"172.21.15.38:6821/31038","state":["exists","up"]},{"osd":1,"uuid":"561f7ced-3fff-4364-8619-6e4ecbc9d256","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":31036},{"type":"v1","addr":"172.21.15.38:6801","nonce":31036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":31036},{"type":"v1","addr":"172.21.15.38:6803","nonce":31036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":31036},{"type":"v1","addr":"172.21.15.38:6807","nonce":31036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":31036},{"type":"v1","addr":"172.21.15.38:6805","nonce":31036}]},"public_addr":"172.21.15.38:6801/31036","cluster_addr":"172.21.15.38:6803/31036","heartbeat_back_addr":"172.21.15.38:6807/31036","heartbeat_front_addr":"172.21.15.38:6805/31036","state":["exists","up"]},{"osd":2,"uuid":"0bb3c806-07af-49f5-b492-d0e33f2de37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":31053},{"type":"v1","addr":"172.21.15.38:6825","nonce":31053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":31053},{"type":"v1","addr":"172.21.15.38:6827","nonce":31053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":31053},{"type":"v1","addr":"172.21.15.38:6831","nonce":31053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":31053},{"type":"v1","addr":"172.21.15.38:6829","nonce":31053}]},"public_addr":"172.21.15.38:6825/31053","cluster_addr":"172.21.15.38:6827/31053","heartbeat_back_addr":"172.21.15.38:6831/31053","heartbeat_front_addr":"172.21.15.38:6829/31053","state":["exists","up"]},{"osd":3,"uuid":"7f6a1e75-7b11-456e-8a4b-510b16226800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":31037},{"type":"v1","addr":"172.21.15.38:6809","nonce":31037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":31037},{"type":"v1","addr":"172.21.15.38:6811","nonce":31037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6815","nonce":31037},{"type":"v1","addr":"172.21.15.38:6817","nonce":31037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":31037},{"type":"v1","addr":"172.21.15.38:6813","nonce":31037}]},"public_addr":"172.21.15.38:6809/31037","cluster_addr":"172.21.15.38:6811/31037","heartbeat_back_addr":"172.21.15.38:6817/31037","heartbeat_front_addr":"172.21.15.38:6813/31037","state":["exists","up"]},{"osd":4,"uuid":"0eca0272-8cfd-469c-a32d-e29730dc0e1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":31294},{"type":"v1","addr":"172.21.15.150:6803","nonce":31294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":31294},{"type":"v1","addr":"172.21.15.150:6805","nonce":31294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":31294},{"type":"v1","addr":"172.21.15.150:6809","nonce":31294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":31294},{"type":"v1","addr":"172.21.15.150:6807","nonce":31294}]},"public_addr":"172.21.15.150:6803/31294","cluster_addr":"172.21.15.150:6805/31294","heartbeat_back_addr":"172.21.15.150:6809/31294","heartbeat_front_addr":"172.21.15.150:6807/31294","state":["exists","up"]},{"osd":5,"uuid":"69d6a7dc-a55a-4ebc-8479-8bb921ddfb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":31295},{"type":"v1","addr":"172.21.15.150:6813","nonce":31295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":31295},{"type":"v1","addr":"172.21.15.150:6816","nonce":31295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":31295},{"type":"v1","addr":"172.21.15.150:6828","nonce":31295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6819","nonce":31295},{"type":"v1","addr":"172.21.15.150:6822","nonce":31295}]},"public_addr":"172.21.15.150:6813/31295","cluster_addr":"172.21.15.150:6816/31295","heartbeat_back_addr":"172.21.15.150:6828/31295","heartbeat_front_addr":"172.21.15.150:6822/31295","state":["exists","up"]},{"osd":6,"uuid":"f0d320f8-c2f0-40bb-b713-526246cf97b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":31297},{"type":"v1","addr":"172.21.15.150:6820","nonce":31297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6823","nonce":31297},{"type":"v1","addr":"172.21.15.150:6827","nonce":31297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":31297},{"type":"v1","addr":"172.21.15.150:6833","nonce":31297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":31297},{"type":"v1","addr":"172.21.15.150:6831","nonce":31297}]},"public_addr":"172.21.15.150:6820/31297","cluster_addr":"172.21.15.150:6827/31297","heartbeat_back_addr":"172.21.15.150:6833/31297","heartbeat_front_addr":"172.21.15.150:6831/31297","state":["exists","up"]},{"osd":7,"uuid":"970b7d02-a189-41b2-96e5-a5a5a57c6476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":31296},{"type":"v1","addr":"172.21.15.150:6812","nonce":31296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":31296},{"type":"v1","addr":"172.21.15.150:6818","nonce":31296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":31296},{"type":"v1","addr":"172.21.15.150:6829","nonce":31296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":31296},{"type":"v1","addr":"172.21.15.150:6824","nonce":31296}]},"public_addr":"172.21.15.150:6812/31296","cluster_addr":"172.21.15.150:6818/31296","heartbeat_back_addr":"172.21.15.150:6829/31296","heartbeat_front_addr":"172.21.15.150:6824/31296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.664300+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.644253+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.651120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.584978+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.561149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.661778+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T17:48:15.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.147+0000 7ff0a9fd3700 1 -- 172.21.15.38:0/3835953848 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff084051560 msgr2=0x7ff084053a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:15.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.147+0000 7ff0a9fd3700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff084051560 0x7ff084053a20 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7ff0980082e0 tx=0x7ff098007e60).stop 2020-06-12T17:48:15.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.147+0000 7ff0a9fd3700 1 -- 172.21.15.38:0/3835953848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0840049b0 msgr2=0x7ff084004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:15.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.147+0000 7ff0a9fd3700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0840049b0 0x7ff084004d90 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7ff094002f30 tx=0x7ff09400df50).stop 2020-06-12T17:48:15.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.147+0000 7ff0a9fd3700 1 -- 172.21.15.38:0/3835953848 shutdown_connections 2020-06-12T17:48:15.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.147+0000 7ff0a9fd3700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff084051560 0x7ff084053a20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:15.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.147+0000 7ff0a9fd3700 1 --2- 172.21.15.38:0/3835953848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0840049b0 0x7ff084004d90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:15.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.147+0000 7ff0a9fd3700 1 -- 172.21.15.38:0/3835953848 >> 172.21.15.38:0/3835953848 conn(0x7ff0a4066040 msgr2=0x7ff0a405b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:15.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.147+0000 7ff0a9fd3700 1 -- 172.21.15.38:0/3835953848 shutdown_connections 2020-06-12T17:48:15.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.147+0000 7ff0a9fd3700 1 -- 172.21.15.38:0/3835953848 wait complete. 2020-06-12T17:48:15.161 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-12T17:48:15.275 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.272+0000 7f8424d51700 1 Processor -- start 2020-06-12T17:48:15.276 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.272+0000 7f8424d51700 1 -- start start 2020-06-12T17:48:15.279 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.273+0000 7f8424d51700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f84200b3550 0x7f842005bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:15.279 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.273+0000 7f8424d51700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f842005c380 con 0x7f842009dd30 2020-06-12T17:48:15.279 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.273+0000 7f8424d51700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84200b3b80 con 0x7f8420143480 2020-06-12T17:48:15.279 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.273+0000 7f8424d51700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8420061880 con 0x7f84200b3550 2020-06-12T17:48:15.280 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.273+0000 7f841dd9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f84200b3550 0x7f842005bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:15.280 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.273+0000 7f841e59c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f842009dd30 0x7f8420061d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37216/0 (socket says 172.21.15.38:37216) 2020-06-12T17:48:15.280 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.273+0000 7f841e59c700 1 -- 172.21.15.38:0/2270432086 learned_addr learned my addr 172.21.15.38:0/2270432086 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:15.280 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.273+0000 7f841dd9b700 1 -- 172.21.15.38:0/2270432086 >> v1:172.21.15.150:6789/0 conn(0x7f8420143480 legacy=0x7f84201438a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:15.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.273+0000 7f841dd9b700 1 -- 172.21.15.38:0/2270432086 >> v1:172.21.15.38:6789/0 conn(0x7f842009dd30 legacy=0x7f8420061d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:15.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.273+0000 7f841dd9b700 1 -- 172.21.15.38:0/2270432086 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842009e110 con 0x7f84200b3550 2020-06-12T17:48:15.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.273+0000 7f841d59a700 1 -- 172.21.15.38:0/2270432086 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2397813965 0 0) 0x7f84140010d0 con 0x7f842009dd30 2020-06-12T17:48:15.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.273+0000 7f841dd9b700 1 --2- 172.21.15.38:0/2270432086 >> v2:172.21.15.38:3300/0 conn(0x7f84200b3550 0x7f842005bf20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8410002f30 tx=0x7f8410007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.273+0000 7f841dd9b700 1 --2- 172.21.15.38:0/2270432086 >> v2:172.21.15.38:3300/0 conn(0x7f84200b3550 0x7f842005bf20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8410002f30 tx=0x7f8410007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.282 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.273+0000 7f841dd9b700 1 --2- 172.21.15.38:0/2270432086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84200b3550 0x7f842005bf20 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f8410002f30 tx=0x7f8410007e60).ready entity=mon.0 client_cookie=4e8b8bc69cde520b server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:15.282 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.274+0000 7f841dd9b700 1 --2- 172.21.15.38:0/2270432086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84200b3550 0x7f842005bf20 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f8410002f30 tx=0x7f8410007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.282 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.274+0000 7f841d59a700 1 -- 172.21.15.38:0/2270432086 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8410011430 con 0x7f84200b3550 2020-06-12T17:48:15.282 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.274+0000 7f841dd9b700 1 --2- 172.21.15.38:0/2270432086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84200b3550 0x7f842005bf20 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f8410002f30 tx=0x7f8410007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.274+0000 7f841d59a700 1 -- 172.21.15.38:0/2270432086 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8410011590 con 0x7f84200b3550 2020-06-12T17:48:15.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.274+0000 7f841dd9b700 1 --2- 172.21.15.38:0/2270432086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84200b3550 0x7f842005bf20 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f8410002f30 tx=0x7f8410007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.274+0000 7f8424d51700 1 -- 172.21.15.38:0/2270432086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84200b3550 msgr2=0x7f842005bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:15.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.274+0000 7f841d59a700 1 -- 172.21.15.38:0/2270432086 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84100118f0 con 0x7f84200b3550 2020-06-12T17:48:15.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.274+0000 7f8424d51700 1 --2- 172.21.15.38:0/2270432086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84200b3550 0x7f842005bf20 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f8410002f30 tx=0x7f8410007e60).stop 2020-06-12T17:48:15.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.274+0000 7f8424d51700 1 -- 172.21.15.38:0/2270432086 shutdown_connections 2020-06-12T17:48:15.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.274+0000 7f8424d51700 1 --2- 172.21.15.38:0/2270432086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84200b3550 0x7f842005bf20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:15.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.274+0000 7f8424d51700 1 -- 172.21.15.38:0/2270432086 >> 172.21.15.38:0/2270432086 conn(0x7f84200b8420 msgr2=0x7f84200b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:15.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.274+0000 7f8424d51700 1 -- 172.21.15.38:0/2270432086 shutdown_connections 2020-06-12T17:48:15.285 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.274+0000 7f8424d51700 1 -- 172.21.15.38:0/2270432086 wait complete. 2020-06-12T17:48:15.285 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.275+0000 7f8424d51700 1 Processor -- start 2020-06-12T17:48:15.285 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.275+0000 7f8424d51700 1 -- start start 2020-06-12T17:48:15.288 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.276+0000 7f8424d51700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f84200b3550 0x7f842013c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:15.288 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.276+0000 7f8424d51700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8420143480 0x7f84200b1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:15.289 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.276+0000 7f8424d51700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8420141270 con 0x7f842009dd30 2020-06-12T17:48:15.289 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.276+0000 7f8424d51700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8420140fd0 con 0x7f84200b3550 2020-06-12T17:48:15.289 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.276+0000 7f8424d51700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8420146680 con 0x7f8420143480 2020-06-12T17:48:15.289 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.276+0000 7f841dd9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f84200b3550 0x7f842013c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:15.290 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.276+0000 7f841dd9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f84200b3550 0x7f842013c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35410/0 (socket says 172.21.15.38:35410) 2020-06-12T17:48:15.290 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.276+0000 7f841dd9b700 1 -- 172.21.15.38:0/3333566464 learned_addr learned my addr 172.21.15.38:0/3333566464 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:15.290 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.276+0000 7f841ed9d700 1 --2- 172.21.15.38:0/3333566464 >> v2:172.21.15.150:3300/0 conn(0x7f8420143480 0x7f84200b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:15.290 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.276+0000 7f841dd9b700 1 -- 172.21.15.38:0/3333566464 >> v2:172.21.15.150:3300/0 conn(0x7f8420143480 msgr2=0x7f84200b1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:15.291 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.276+0000 7f841dd9b700 1 --2- 172.21.15.38:0/3333566464 >> v2:172.21.15.150:3300/0 conn(0x7f8420143480 0x7f84200b1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:15.291 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.276+0000 7f841dd9b700 1 -- 172.21.15.38:0/3333566464 >> v1:172.21.15.150:6789/0 conn(0x7f842009dd30 legacy=0x7f842009b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:15.291 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.276+0000 7f841dd9b700 1 -- 172.21.15.38:0/3333566464 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842013c870 con 0x7f84200b3550 2020-06-12T17:48:15.291 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.276+0000 7f841dd9b700 1 --2- 172.21.15.38:0/3333566464 >> v2:172.21.15.38:3300/0 conn(0x7f84200b3550 0x7f842013c410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f84200b27f0 tx=0x7f8410007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.292 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.276+0000 7f841dd9b700 1 --2- 172.21.15.38:0/3333566464 >> v2:172.21.15.38:3300/0 conn(0x7f84200b3550 0x7f842013c410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f84200b27f0 tx=0x7f8410007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.292 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.276+0000 7f841dd9b700 1 --2- 172.21.15.38:0/3333566464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84200b3550 0x7f842013c410 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f84200b27f0 tx=0x7f8410007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:15.292 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.276+0000 7f841dd9b700 1 --2- 172.21.15.38:0/3333566464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84200b3550 0x7f842013c410 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f84200b27f0 tx=0x7f8410007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.299 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.276+0000 7f841dd9b700 1 --2- 172.21.15.38:0/3333566464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84200b3550 0x7f842013c410 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f84200b27f0 tx=0x7f8410007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.276+0000 7f840f7fe700 1 -- 172.21.15.38:0/3333566464 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8410007150 con 0x7f84200b3550 2020-06-12T17:48:15.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.276+0000 7f841dd9b700 1 --2- 172.21.15.38:0/3333566464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84200b3550 0x7f842013c410 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f84200b27f0 tx=0x7f8410007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.276+0000 7f840f7fe700 1 -- 172.21.15.38:0/3333566464 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84100072b0 con 0x7f84200b3550 2020-06-12T17:48:15.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.276+0000 7f8424d51700 1 -- 172.21.15.38:0/3333566464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8420140c80 con 0x7f84200b3550 2020-06-12T17:48:15.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.276+0000 7f840f7fe700 1 -- 172.21.15.38:0/3333566464 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84100056c0 con 0x7f84200b3550 2020-06-12T17:48:15.301 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.277+0000 7f8424d51700 1 -- 172.21.15.38:0/3333566464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f842009d7a0 con 0x7f84200b3550 2020-06-12T17:48:15.301 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.277+0000 7f841dd9b700 1 --2- 172.21.15.38:0/3333566464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84200b3550 0x7f842013c410 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f84200b27f0 tx=0x7f8410007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.301 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.278+0000 7f8424d51700 1 -- 172.21.15.38:0/3333566464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84200b2130 con 0x7f84200b3550 2020-06-12T17:48:15.301 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.278+0000 7f840f7fe700 1 -- 172.21.15.38:0/3333566464 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f8410005930 con 0x7f84200b3550 2020-06-12T17:48:15.301 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.278+0000 7f841dd9b700 1 --2- 172.21.15.38:0/3333566464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84200b3550 0x7f842013c410 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f84200b27f0 tx=0x7f8410007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.302 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.278+0000 7f840f7fe700 1 --2- 172.21.15.38:0/3333566464 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f83fc04d650 0x7f83fc04fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:15.302 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.278+0000 7f840f7fe700 1 -- 172.21.15.38:0/3333566464 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f84100615e0 con 0x7f84200b3550 2020-06-12T17:48:15.302 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.278+0000 7f841e59c700 1 --2- 172.21.15.38:0/3333566464 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f83fc04d650 0x7f83fc04fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:15.302 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.278+0000 7f841e59c700 1 --2- 172.21.15.38:0/3333566464 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f83fc04d650 0x7f83fc04fb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8414000b80 tx=0x7f84140011b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.302 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.278+0000 7f841e59c700 1 --2- 172.21.15.38:0/3333566464 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f83fc04d650 0x7f83fc04fb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8414000b80 tx=0x7f84140011b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.303 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.278+0000 7f841e59c700 1 --2- 172.21.15.38:0/3333566464 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f83fc04d650 0x7f83fc04fb10 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f8414000b80 tx=0x7f84140011b0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:15.303 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.281+0000 7f841dd9b700 1 --2- 172.21.15.38:0/3333566464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84200b3550 0x7f842013c410 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f84200b27f0 tx=0x7f8410007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.303 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.281+0000 7f840f7fe700 1 -- 172.21.15.38:0/3333566464 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f84200b2130 con 0x7f84200b3550 2020-06-12T17:48:15.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.434+0000 7f8424d51700 1 -- 172.21.15.38:0/3333566464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84200b2130 con 0x7f84200b3550 2020-06-12T17:48:15.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.435+0000 7f841dd9b700 1 --2- 172.21.15.38:0/3333566464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84200b3550 0x7f842013c410 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f84200b27f0 tx=0x7f8410007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.435+0000 7f840f7fe700 1 -- 172.21.15.38:0/3333566464 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16347 (secure 0 0 0) 0x7f84200b2130 con 0x7f84200b3550 2020-06-12T17:48:15.440 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:15.440 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":24,"fsid":"8e42a2e7-b187-42c4-a73f-8f812ee62352","created":"2020-06-12T17:47:54.434340+0000","modified":"2020-06-12T17:48:14.851712+0000","last_up_change":"2020-06-12T17:48:03.388718+0000","last_in_change":"2020-06-12T17:48:03.388718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-06-12T17:47:57.558119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-06-12T17:48:07.419264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-06-12T17:48:09.934098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-06-12T17:48:12.497229+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"44ac3dea-67b4-4b9a-bc18-ac511710afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":31038},{"type":"v1","addr":"172.21.15.38:6816","nonce":31038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":31038},{"type":"v1","addr":"172.21.15.38:6819","nonce":31038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":31038},{"type":"v1","addr":"172.21.15.38:6823","nonce":31038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":31038},{"type":"v1","addr":"172.21.15.38:6821","nonce":31038}]},"public_addr":"172.21.15.38:6816/31038","cluster_addr":"172.21.15.38:6819/31038","heartbeat_back_addr":"172.21.15.38:6823/31038","heartbeat_front_addr":"172.21.15.38:6821/31038","state":["exists","up"]},{"osd":1,"uuid":"561f7ced-3fff-4364-8619-6e4ecbc9d256","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":31036},{"type":"v1","addr":"172.21.15.38:6801","nonce":31036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":31036},{"type":"v1","addr":"172.21.15.38:6803","nonce":31036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":31036},{"type":"v1","addr":"172.21.15.38:6807","nonce":31036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":31036},{"type":"v1","addr":"172.21.15.38:6805","nonce":31036}]},"public_addr":"172.21.15.38:6801/31036","cluster_addr":"172.21.15.38:6803/31036","heartbeat_back_addr":"172.21.15.38:6807/31036","heartbeat_front_addr":"172.21.15.38:6805/31036","state":["exists","up"]},{"osd":2,"uuid":"0bb3c806-07af-49f5-b492-d0e33f2de37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":31053},{"type":"v1","addr":"172.21.15.38:6825","nonce":31053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":31053},{"type":"v1","addr":"172.21.15.38:6827","nonce":31053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":31053},{"type":"v1","addr":"172.21.15.38:6831","nonce":31053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":31053},{"type":"v1","addr":"172.21.15.38:6829","nonce":31053}]},"public_addr":"172.21.15.38:6825/31053","cluster_addr":"172.21.15.38:6827/31053","heartbeat_back_addr":"172.21.15.38:6831/31053","heartbeat_front_addr":"172.21.15.38:6829/31053","state":["exists","up"]},{"osd":3,"uuid":"7f6a1e75-7b11-456e-8a4b-510b16226800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":31037},{"type":"v1","addr":"172.21.15.38:6809","nonce":31037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":31037},{"type":"v1","addr":"172.21.15.38:6811","nonce":31037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6815","nonce":31037},{"type":"v1","addr":"172.21.15.38:6817","nonce":31037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":31037},{"type":"v1","addr":"172.21.15.38:6813","nonce":31037}]},"public_addr":"172.21.15.38:6809/31037","cluster_addr":"172.21.15.38:6811/31037","heartbeat_back_addr":"172.21.15.38:6817/31037","heartbeat_front_addr":"172.21.15.38:6813/31037","state":["exists","up"]},{"osd":4,"uuid":"0eca0272-8cfd-469c-a32d-e29730dc0e1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":31294},{"type":"v1","addr":"172.21.15.150:6803","nonce":31294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":31294},{"type":"v1","addr":"172.21.15.150:6805","nonce":31294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":31294},{"type":"v1","addr":"172.21.15.150:6809","nonce":31294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":31294},{"type":"v1","addr":"172.21.15.150:6807","nonce":31294}]},"public_addr":"172.21.15.150:6803/31294","cluster_addr":"172.21.15.150:6805/31294","heartbeat_back_addr":"172.21.15.150:6809/31294","heartbeat_front_addr":"172.21.15.150:6807/31294","state":["exists","up"]},{"osd":5,"uuid":"69d6a7dc-a55a-4ebc-8479-8bb921ddfb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":31295},{"type":"v1","addr":"172.21.15.150:6813","nonce":31295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":31295},{"type":"v1","addr":"172.21.15.150:6816","nonce":31295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":31295},{"type":"v1","addr":"172.21.15.150:6828","nonce":31295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6819","nonce":31295},{"type":"v1","addr":"172.21.15.150:6822","nonce":31295}]},"public_addr":"172.21.15.150:6813/31295","cluster_addr":"172.21.15.150:6816/31295","heartbeat_back_addr":"172.21.15.150:6828/31295","heartbeat_front_addr":"172.21.15.150:6822/31295","state":["exists","up"]},{"osd":6,"uuid":"f0d320f8-c2f0-40bb-b713-526246cf97b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":31297},{"type":"v1","addr":"172.21.15.150:6820","nonce":31297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6823","nonce":31297},{"type":"v1","addr":"172.21.15.150:6827","nonce":31297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":31297},{"type":"v1","addr":"172.21.15.150:6833","nonce":31297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":31297},{"type":"v1","addr":"172.21.15.150:6831","nonce":31297}]},"public_addr":"172.21.15.150:6820/31297","cluster_addr":"172.21.15.150:6827/31297","heartbeat_back_addr":"172.21.15.150:6833/31297","heartbeat_front_addr":"172.21.15.150:6831/31297","state":["exists","up"]},{"osd":7,"uuid":"970b7d02-a189-41b2-96e5-a5a5a57c6476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":31296},{"type":"v1","addr":"172.21.15.150:6812","nonce":31296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":31296},{"type":"v1","addr":"172.21.15.150:6818","nonce":31296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":31296},{"type":"v1","addr":"172.21.15.150:6829","nonce":31296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":31296},{"type":"v1","addr":"172.21.15.150:6824","nonce":31296}]},"public_addr":"172.21.15.150:6812/31296","cluster_addr":"172.21.15.150:6818/31296","heartbeat_back_addr":"172.21.15.150:6829/31296","heartbeat_front_addr":"172.21.15.150:6824/31296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.664300+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.644253+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.651120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.584978+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.561149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.661778+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T17:48:15.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.436+0000 7f8424d51700 1 -- 172.21.15.38:0/3333566464 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f83fc04d650 msgr2=0x7f83fc04fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:15.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.436+0000 7f8424d51700 1 --2- 172.21.15.38:0/3333566464 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f83fc04d650 0x7f83fc04fb10 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f8414000b80 tx=0x7f84140011b0).stop 2020-06-12T17:48:15.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.436+0000 7f8424d51700 1 -- 172.21.15.38:0/3333566464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84200b3550 msgr2=0x7f842013c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:15.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.436+0000 7f8424d51700 1 --2- 172.21.15.38:0/3333566464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84200b3550 0x7f842013c410 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f84200b27f0 tx=0x7f8410007e60).stop 2020-06-12T17:48:15.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.436+0000 7f8424d51700 1 -- 172.21.15.38:0/3333566464 shutdown_connections 2020-06-12T17:48:15.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.436+0000 7f8424d51700 1 --2- 172.21.15.38:0/3333566464 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f83fc04d650 0x7f83fc04fb10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:15.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.436+0000 7f8424d51700 1 --2- 172.21.15.38:0/3333566464 >> v2:172.21.15.150:3300/0 conn(0x7f8420143480 0x7f84200b1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:15.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.436+0000 7f8424d51700 1 --2- 172.21.15.38:0/3333566464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84200b3550 0x7f842013c410 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:15.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.436+0000 7f8424d51700 1 -- 172.21.15.38:0/3333566464 >> 172.21.15.38:0/3333566464 conn(0x7f84200b8420 msgr2=0x7f842005bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:15.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.436+0000 7f8424d51700 1 -- 172.21.15.38:0/3333566464 shutdown_connections 2020-06-12T17:48:15.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.436+0000 7f8424d51700 1 -- 172.21.15.38:0/3333566464 wait complete. 2020-06-12T17:48:15.450 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-06-12T17:48:15.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.565+0000 7f452df9e700 1 Processor -- start 2020-06-12T17:48:15.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.565+0000 7f452df9e700 1 -- start start 2020-06-12T17:48:15.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.566+0000 7f452df9e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f45280afb40 0x7f45280b4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:15.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.566+0000 7f452df9e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f452805b8b0 0x7f452814c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:15.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.566+0000 7f452df9e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4528066da0 con 0x7f452805b420 2020-06-12T17:48:15.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.566+0000 7f452df9e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45280b0270 con 0x7f45280afb40 2020-06-12T17:48:15.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.566+0000 7f452df9e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4528145b70 con 0x7f452805b8b0 2020-06-12T17:48:15.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.566+0000 7f4527fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f452805b420 0x7f4528142420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37230/0 (socket says 172.21.15.38:37230) 2020-06-12T17:48:15.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.566+0000 7f4527fff700 1 -- 172.21.15.38:0/2976873271 learned_addr learned my addr 172.21.15.38:0/2976873271 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:15.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.566+0000 7f452cf9c700 1 --2- 172.21.15.38:0/2976873271 >> v2:172.21.15.150:3300/0 conn(0x7f45280afb40 0x7f45280b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:15.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.566+0000 7f452d79d700 1 --2- 172.21.15.38:0/2976873271 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f452805b8b0 0x7f452814c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:15.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.566+0000 7f45277fe700 1 -- 172.21.15.38:0/2976873271 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1849411844 0 0) 0x7f4528066da0 con 0x7f452805b420 2020-06-12T17:48:15.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f45277fe700 1 -- 172.21.15.38:0/2976873271 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4514003230 con 0x7f452805b420 2020-06-12T17:48:15.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f45277fe700 1 -- 172.21.15.38:0/2976873271 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 824215680 0 0) 0x7f4514003230 con 0x7f452805b420 2020-06-12T17:48:15.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f45277fe700 1 -- 172.21.15.38:0/2976873271 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f452805b8b0 msgr2=0x7f452814c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:15.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f45277fe700 1 --2- 172.21.15.38:0/2976873271 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f452805b8b0 0x7f452814c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:15.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f45277fe700 1 -- 172.21.15.38:0/2976873271 >> v2:172.21.15.150:3300/0 conn(0x7f45280afb40 msgr2=0x7f45280b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:15.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f45277fe700 1 --2- 172.21.15.38:0/2976873271 >> v2:172.21.15.150:3300/0 conn(0x7f45280afb40 0x7f45280b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:15.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f45277fe700 1 -- 172.21.15.38:0/2976873271 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45280aff20 con 0x7f452805b420 2020-06-12T17:48:15.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f45277fe700 1 -- 172.21.15.38:0/2976873271 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f451c0016d0 con 0x7f452805b420 2020-06-12T17:48:15.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f45277fe700 1 -- 172.21.15.38:0/2976873271 >> v1:172.21.15.38:6789/0 conn(0x7f452805b420 legacy=0x7f4528142420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:15.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f45277fe700 1 --2- 172.21.15.38:0/2976873271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4514003720 0x7f4514003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:15.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f45277fe700 1 --2- 172.21.15.38:0/2976873271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4514004060 0x7f4514004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:15.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f45277fe700 1 --2- 172.21.15.38:0/2976873271 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f452805b8b0 0x7f4514004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:15.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f45277fe700 1 -- 172.21.15.38:0/2976873271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45280b0270 con 0x7f4514003720 2020-06-12T17:48:15.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f45277fe700 1 -- 172.21.15.38:0/2976873271 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4528145b70 con 0x7f4514004060 2020-06-12T17:48:15.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f45277fe700 1 -- 172.21.15.38:0/2976873271 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4514004ff0 con 0x7f452805b8b0 2020-06-12T17:48:15.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f452cf9c700 1 --2- 172.21.15.38:0/2976873271 >> v2:172.21.15.150:3300/0 conn(0x7f45280afb40 0x7f45280b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:15.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f452cf9c700 1 --2- 172.21.15.38:0/2976873271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4514003720 0x7f4514003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:15.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f452d79d700 1 --2- 172.21.15.38:0/2976873271 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f452805b8b0 0x7f4514004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:15.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f4527fff700 1 --2- 172.21.15.38:0/2976873271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4514004060 0x7f4514004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:15.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f452cf9c700 1 -- 172.21.15.38:0/2976873271 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f452805b8b0 msgr2=0x7f4514004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:15.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f452cf9c700 1 --2- 172.21.15.38:0/2976873271 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f452805b8b0 0x7f4514004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:15.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f452cf9c700 1 -- 172.21.15.38:0/2976873271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4514004060 msgr2=0x7f4514004530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:15.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f452cf9c700 1 --2- 172.21.15.38:0/2976873271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4514004060 0x7f4514004530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:15.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f452cf9c700 1 -- 172.21.15.38:0/2976873271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4514003230 con 0x7f4514003720 2020-06-12T17:48:15.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f452cf9c700 1 --2- 172.21.15.38:0/2976873271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4514003720 0x7f4514003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4518002f30 tx=0x7f4518007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f452cf9c700 1 --2- 172.21.15.38:0/2976873271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4514003720 0x7f4514003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4518002f30 tx=0x7f4518007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.567+0000 7f452cf9c700 1 --2- 172.21.15.38:0/2976873271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4514003720 0x7f4514003b40 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f4518002f30 tx=0x7f4518007e60).ready entity=mon.0 client_cookie=2304d0cb963d248b server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:15.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.568+0000 7f452cf9c700 1 --2- 172.21.15.38:0/2976873271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4514003720 0x7f4514003b40 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f4518002f30 tx=0x7f4518007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.568+0000 7f452cf9c700 1 --2- 172.21.15.38:0/2976873271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4514003720 0x7f4514003b40 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f4518002f30 tx=0x7f4518007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.568+0000 7f45277fe700 1 -- 172.21.15.38:0/2976873271 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4518013dc0 con 0x7f4514003720 2020-06-12T17:48:15.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.568+0000 7f452cf9c700 1 --2- 172.21.15.38:0/2976873271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4514003720 0x7f4514003b40 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f4518002f30 tx=0x7f4518007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.568+0000 7f45277fe700 1 -- 172.21.15.38:0/2976873271 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451800e490 con 0x7f4514003720 2020-06-12T17:48:15.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.568+0000 7f45277fe700 1 -- 172.21.15.38:0/2976873271 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f451800e7f0 con 0x7f4514003720 2020-06-12T17:48:15.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.568+0000 7f452df9e700 1 -- 172.21.15.38:0/2976873271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4514003720 msgr2=0x7f4514003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:15.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.568+0000 7f452df9e700 1 --2- 172.21.15.38:0/2976873271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4514003720 0x7f4514003b40 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f4518002f30 tx=0x7f4518007e60).stop 2020-06-12T17:48:15.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.568+0000 7f452d79d700 1 -- 172.21.15.38:0/2976873271 reap_dead start 2020-06-12T17:48:15.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.568+0000 7f452df9e700 1 -- 172.21.15.38:0/2976873271 shutdown_connections 2020-06-12T17:48:15.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.568+0000 7f452df9e700 1 -- 172.21.15.38:0/2976873271 >> 172.21.15.38:0/2976873271 conn(0x7f45280b4cc0 msgr2=0x7f45280b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:15.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.568+0000 7f452df9e700 1 -- 172.21.15.38:0/2976873271 shutdown_connections 2020-06-12T17:48:15.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.568+0000 7f452df9e700 1 -- 172.21.15.38:0/2976873271 wait complete. 2020-06-12T17:48:15.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.569+0000 7f452df9e700 1 Processor -- start 2020-06-12T17:48:15.585 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.569+0000 7f452df9e700 1 -- start start 2020-06-12T17:48:15.585 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.570+0000 7f452df9e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4528156ad0 0x7f4528141f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:15.585 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.570+0000 7f452df9e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45281423c0 con 0x7f4528132b00 2020-06-12T17:48:15.585 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.570+0000 7f452df9e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4528142600 con 0x7f4528065ad0 2020-06-12T17:48:15.585 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.570+0000 7f452df9e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45281428a0 con 0x7f4528156ad0 2020-06-12T17:48:15.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.570+0000 7f452d79d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4528132b00 0x7f452813e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37244/0 (socket says 172.21.15.38:37244) 2020-06-12T17:48:15.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.570+0000 7f452d79d700 1 -- 172.21.15.38:0/1575517773 learned_addr learned my addr 172.21.15.38:0/1575517773 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:15.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.570+0000 7f4527fff700 1 --2- 172.21.15.38:0/1575517773 >> v2:172.21.15.150:3300/0 conn(0x7f4528156ad0 0x7f4528141f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:15.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.570+0000 7f4525ffb700 1 -- 172.21.15.38:0/1575517773 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4101141640 0 0) 0x7f4520007f50 con 0x7f4528132b00 2020-06-12T17:48:15.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.570+0000 7f4525ffb700 1 -- 172.21.15.38:0/1575517773 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4508002fe0 con 0x7f4528132b00 2020-06-12T17:48:15.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.570+0000 7f4527fff700 1 -- 172.21.15.38:0/1575517773 >> v1:172.21.15.150:6789/0 conn(0x7f4528065ad0 legacy=0x7f45281323f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:15.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.570+0000 7f4525ffb700 1 -- 172.21.15.38:0/1575517773 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3284415486 0 0) 0x7f4508002fe0 con 0x7f4528132b00 2020-06-12T17:48:15.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.570+0000 7f4527fff700 1 -- 172.21.15.38:0/1575517773 >> v1:172.21.15.38:6789/0 conn(0x7f4528132b00 legacy=0x7f452813e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:15.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.570+0000 7f4527fff700 1 -- 172.21.15.38:0/1575517773 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4528142b40 con 0x7f4528156ad0 2020-06-12T17:48:15.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.571+0000 7f4527fff700 1 --2- 172.21.15.38:0/1575517773 >> v2:172.21.15.150:3300/0 conn(0x7f4528156ad0 0x7f4528141f60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4520008250 tx=0x7f451c00e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.571+0000 7f4527fff700 1 --2- 172.21.15.38:0/1575517773 >> v2:172.21.15.150:3300/0 conn(0x7f4528156ad0 0x7f4528141f60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4520008250 tx=0x7f451c00e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.588 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.571+0000 7f4527fff700 1 --2- 172.21.15.38:0/1575517773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4528156ad0 0x7f4528141f60 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f4520008250 tx=0x7f451c00e960).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:15.588 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.571+0000 7f4527fff700 1 --2- 172.21.15.38:0/1575517773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4528156ad0 0x7f4528141f60 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f4520008250 tx=0x7f451c00e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.588 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.571+0000 7f4525ffb700 1 -- 172.21.15.38:0/1575517773 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4520001810 con 0x7f4528156ad0 2020-06-12T17:48:15.588 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.571+0000 7f4527fff700 1 --2- 172.21.15.38:0/1575517773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4528156ad0 0x7f4528141f60 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f4520008250 tx=0x7f451c00e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.588 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.571+0000 7f4525ffb700 1 -- 172.21.15.38:0/1575517773 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451c00f0c0 con 0x7f4528156ad0 2020-06-12T17:48:15.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.571+0000 7f4527fff700 1 --2- 172.21.15.38:0/1575517773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4528156ad0 0x7f4528141f60 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f4520008250 tx=0x7f451c00e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.571+0000 7f452df9e700 1 -- 172.21.15.38:0/1575517773 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4528065eb0 con 0x7f4528156ad0 2020-06-12T17:48:15.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.571+0000 7f4525ffb700 1 -- 172.21.15.38:0/1575517773 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f451c00f420 con 0x7f4528156ad0 2020-06-12T17:48:15.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.571+0000 7f452df9e700 1 -- 172.21.15.38:0/1575517773 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4528132f70 con 0x7f4528156ad0 2020-06-12T17:48:15.591 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.571+0000 7f4527fff700 1 --2- 172.21.15.38:0/1575517773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4528156ad0 0x7f4528141f60 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f4520008250 tx=0x7f451c00e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.591 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.572+0000 7f452df9e700 1 -- 172.21.15.38:0/1575517773 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4528056c30 con 0x7f4528156ad0 2020-06-12T17:48:15.591 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.572+0000 7f4525ffb700 1 -- 172.21.15.38:0/1575517773 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f451c00c890 con 0x7f4528156ad0 2020-06-12T17:48:15.591 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.572+0000 7f4527fff700 1 --2- 172.21.15.38:0/1575517773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4528156ad0 0x7f4528141f60 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f4520008250 tx=0x7f451c00e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.592 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.572+0000 7f4525ffb700 1 --2- 172.21.15.38:0/1575517773 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f450804d870 0x7f450804fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:15.592 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.572+0000 7f4525ffb700 1 -- 172.21.15.38:0/1575517773 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f451c060ae0 con 0x7f4528156ad0 2020-06-12T17:48:15.592 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.572+0000 7f452cf9c700 1 --2- 172.21.15.38:0/1575517773 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f450804d870 0x7f450804fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:15.592 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.573+0000 7f452cf9c700 1 --2- 172.21.15.38:0/1575517773 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f450804d870 0x7f450804fd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4518002ef0 tx=0x7f4518007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.593 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.573+0000 7f452cf9c700 1 --2- 172.21.15.38:0/1575517773 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f450804d870 0x7f450804fd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4518002ef0 tx=0x7f4518007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.593 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.573+0000 7f452cf9c700 1 --2- 172.21.15.38:0/1575517773 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f450804d870 0x7f450804fd30 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f4518002ef0 tx=0x7f4518007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:15.593 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.576+0000 7f4527fff700 1 --2- 172.21.15.38:0/1575517773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4528156ad0 0x7f4528141f60 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f4520008250 tx=0x7f451c00e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:15.593 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.576+0000 7f4525ffb700 1 -- 172.21.15.38:0/1575517773 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f451c03c1c0 con 0x7f4528156ad0 2020-06-12T17:48:15.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:15.781+0000 7f452df9e700 1 -- 172.21.15.38:0/1575517773 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f452805c460 con 0x7f4528156ad0 2020-06-12T17:48:16.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.521+0000 7f4527fff700 1 --2- 172.21.15.38:0/1575517773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4528156ad0 0x7f4528141f60 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f4520008250 tx=0x7f451c00e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:16.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.521+0000 7f4525ffb700 1 -- 172.21.15.38:0/1575517773 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v3) v1 ==== 118+0+0 (secure 0 0 0) 0x7f451c03f7e0 con 0x7f4528156ad0 2020-06-12T17:48:16.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.523+0000 7f452df9e700 1 -- 172.21.15.38:0/1575517773 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f450804d870 msgr2=0x7f450804fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:16.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.523+0000 7f452df9e700 1 --2- 172.21.15.38:0/1575517773 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f450804d870 0x7f450804fd30 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f4518002ef0 tx=0x7f4518007e60).stop 2020-06-12T17:48:16.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.523+0000 7f452df9e700 1 -- 172.21.15.38:0/1575517773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4528156ad0 msgr2=0x7f4528141f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:16.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.523+0000 7f452df9e700 1 --2- 172.21.15.38:0/1575517773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4528156ad0 0x7f4528141f60 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f4520008250 tx=0x7f451c00e960).stop 2020-06-12T17:48:16.528 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.523+0000 7f452df9e700 1 -- 172.21.15.38:0/1575517773 shutdown_connections 2020-06-12T17:48:16.528 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.523+0000 7f452df9e700 1 --2- 172.21.15.38:0/1575517773 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f450804d870 0x7f450804fd30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:16.528 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.523+0000 7f452df9e700 1 --2- 172.21.15.38:0/1575517773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4528156ad0 0x7f4528141f60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:16.528 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.523+0000 7f452df9e700 1 -- 172.21.15.38:0/1575517773 >> 172.21.15.38:0/1575517773 conn(0x7f45280b4cc0 msgr2=0x7f45280664c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:16.529 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.524+0000 7f452df9e700 1 -- 172.21.15.38:0/1575517773 shutdown_connections 2020-06-12T17:48:16.529 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.524+0000 7f452df9e700 1 -- 172.21.15.38:0/1575517773 wait complete. 2020-06-12T17:48:16.540 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-06-12T17:48:16.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.658+0000 7fd03df7a700 1 Processor -- start 2020-06-12T17:48:16.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.658+0000 7fd03df7a700 1 -- start start 2020-06-12T17:48:16.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.659+0000 7fd03df7a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd03809dd30 0x7fd0380b3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:16.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.659+0000 7fd03df7a700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0380b3b80 con 0x7fd03805bf20 2020-06-12T17:48:16.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.659+0000 7fd03df7a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd038061880 con 0x7fd038143480 2020-06-12T17:48:16.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.659+0000 7fd03df7a700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03805c3d0 con 0x7fd03809dd30 2020-06-12T17:48:16.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.659+0000 7fd0377fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd03809dd30 0x7fd0380b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:16.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.659+0000 7fd02ffff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd03805bf20 0x7fd038061d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37250/0 (socket says 172.21.15.38:37250) 2020-06-12T17:48:16.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.659+0000 7fd02ffff700 1 -- 172.21.15.38:0/3303351105 learned_addr learned my addr 172.21.15.38:0/3303351105 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:16.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.659+0000 7fd0377fe700 1 -- 172.21.15.38:0/3303351105 >> v1:172.21.15.150:6789/0 conn(0x7fd038143480 legacy=0x7fd0381438a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:16.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.659+0000 7fd0377fe700 1 -- 172.21.15.38:0/3303351105 >> v1:172.21.15.38:6789/0 conn(0x7fd03805bf20 legacy=0x7fd038061d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:16.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.659+0000 7fd0377fe700 1 -- 172.21.15.38:0/3303351105 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03809e110 con 0x7fd03809dd30 2020-06-12T17:48:16.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.659+0000 7fd0377fe700 1 --2- 172.21.15.38:0/3303351105 >> v2:172.21.15.38:3300/0 conn(0x7fd03809dd30 0x7fd0380b3550 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd028002f30 tx=0x7fd028007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:16.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.659+0000 7fd0377fe700 1 --2- 172.21.15.38:0/3303351105 >> v2:172.21.15.38:3300/0 conn(0x7fd03809dd30 0x7fd0380b3550 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd028002f30 tx=0x7fd028007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:16.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.659+0000 7fd0377fe700 1 --2- 172.21.15.38:0/3303351105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd03809dd30 0x7fd0380b3550 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7fd028002f30 tx=0x7fd028007e60).ready entity=mon.0 client_cookie=c305b35c4a714520 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:16.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.660+0000 7fd0377fe700 1 --2- 172.21.15.38:0/3303351105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd03809dd30 0x7fd0380b3550 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fd028002f30 tx=0x7fd028007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:16.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.660+0000 7fd0377fe700 1 --2- 172.21.15.38:0/3303351105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd03809dd30 0x7fd0380b3550 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fd028002f30 tx=0x7fd028007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:16.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.660+0000 7fd0377fe700 1 --2- 172.21.15.38:0/3303351105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd03809dd30 0x7fd0380b3550 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fd028002f30 tx=0x7fd028007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:16.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.660+0000 7fd036ffd700 1 -- 172.21.15.38:0/3303351105 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd028011430 con 0x7fd03809dd30 2020-06-12T17:48:16.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.660+0000 7fd036ffd700 1 -- 172.21.15.38:0/3303351105 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd028011590 con 0x7fd03809dd30 2020-06-12T17:48:16.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.660+0000 7fd036ffd700 1 -- 172.21.15.38:0/3303351105 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd028011930 con 0x7fd03809dd30 2020-06-12T17:48:16.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.660+0000 7fd03df7a700 1 -- 172.21.15.38:0/3303351105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd03809dd30 msgr2=0x7fd0380b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:16.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.660+0000 7fd03df7a700 1 --2- 172.21.15.38:0/3303351105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd03809dd30 0x7fd0380b3550 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7fd028002f30 tx=0x7fd028007e60).stop 2020-06-12T17:48:16.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.660+0000 7fd03df7a700 1 -- 172.21.15.38:0/3303351105 shutdown_connections 2020-06-12T17:48:16.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.660+0000 7fd03df7a700 1 --2- 172.21.15.38:0/3303351105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd03809dd30 0x7fd0380b3550 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:16.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.660+0000 7fd03df7a700 1 -- 172.21.15.38:0/3303351105 >> 172.21.15.38:0/3303351105 conn(0x7fd0380b8420 msgr2=0x7fd0380b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:16.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.660+0000 7fd03df7a700 1 -- 172.21.15.38:0/3303351105 shutdown_connections 2020-06-12T17:48:16.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.660+0000 7fd03df7a700 1 -- 172.21.15.38:0/3303351105 wait complete. 2020-06-12T17:48:16.674 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.661+0000 7fd03df7a700 1 Processor -- start 2020-06-12T17:48:16.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.661+0000 7fd03df7a700 1 -- start start 2020-06-12T17:48:16.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.662+0000 7fd03df7a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd03805bf20 0x7fd0381466b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:16.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.662+0000 7fd03df7a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd03809dd30 0x7fd03813ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:16.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.662+0000 7fd03df7a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd038143480 0x7fd038155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:16.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.662+0000 7fd03df7a700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd038063cd0 con 0x7fd038143480 2020-06-12T17:48:16.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.662+0000 7fd03df7a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03813f390 con 0x7fd03809dd30 2020-06-12T17:48:16.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.662+0000 7fd03df7a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd038063790 con 0x7fd03805bf20 2020-06-12T17:48:16.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.662+0000 7fd037fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd038143480 0x7fd038155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:16.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.662+0000 7fd037fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd038143480 0x7fd038155600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35444/0 (socket says 172.21.15.38:35444) 2020-06-12T17:48:16.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.662+0000 7fd037fff700 1 -- 172.21.15.38:0/4234840900 learned_addr learned my addr 172.21.15.38:0/4234840900 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:16.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.662+0000 7fd02ffff700 1 --2- 172.21.15.38:0/4234840900 >> v2:172.21.15.150:3300/0 conn(0x7fd03809dd30 0x7fd03813ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:16.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.662+0000 7fd0377fe700 1 --2- 172.21.15.38:0/4234840900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd03805bf20 0x7fd0381466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:16.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.662+0000 7fd037fff700 1 -- 172.21.15.38:0/4234840900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd03805bf20 msgr2=0x7fd0381466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:16.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.662+0000 7fd037fff700 1 --2- 172.21.15.38:0/4234840900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd03805bf20 0x7fd0381466b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:16.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.662+0000 7fd037fff700 1 -- 172.21.15.38:0/4234840900 >> v2:172.21.15.150:3300/0 conn(0x7fd03809dd30 msgr2=0x7fd03813ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:16.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.662+0000 7fd037fff700 1 --2- 172.21.15.38:0/4234840900 >> v2:172.21.15.150:3300/0 conn(0x7fd03809dd30 0x7fd03813ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:16.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.662+0000 7fd037fff700 1 -- 172.21.15.38:0/4234840900 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd038063a30 con 0x7fd038143480 2020-06-12T17:48:16.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.662+0000 7fd037fff700 1 --2- 172.21.15.38:0/4234840900 >> v2:172.21.15.38:3300/0 conn(0x7fd038143480 0x7fd038155600 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd038060250 tx=0x7fd030001b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:16.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.663+0000 7fd037fff700 1 --2- 172.21.15.38:0/4234840900 >> v2:172.21.15.38:3300/0 conn(0x7fd038143480 0x7fd038155600 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd038060250 tx=0x7fd030001b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:16.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.663+0000 7fd037fff700 1 --2- 172.21.15.38:0/4234840900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd038143480 0x7fd038155600 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7fd038060250 tx=0x7fd030001b10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:16.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.663+0000 7fd037fff700 1 --2- 172.21.15.38:0/4234840900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd038143480 0x7fd038155600 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fd038060250 tx=0x7fd030001b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:16.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.663+0000 7fd037fff700 1 --2- 172.21.15.38:0/4234840900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd038143480 0x7fd038155600 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fd038060250 tx=0x7fd030001b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:16.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.663+0000 7fd0357fa700 1 -- 172.21.15.38:0/4234840900 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0300101c0 con 0x7fd038143480 2020-06-12T17:48:16.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.663+0000 7fd037fff700 1 --2- 172.21.15.38:0/4234840900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd038143480 0x7fd038155600 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fd038060250 tx=0x7fd030001b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:16.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.663+0000 7fd0357fa700 1 -- 172.21.15.38:0/4234840900 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd030010320 con 0x7fd038143480 2020-06-12T17:48:16.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.663+0000 7fd03df7a700 1 -- 172.21.15.38:0/4234840900 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd038155a60 con 0x7fd038143480 2020-06-12T17:48:16.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.663+0000 7fd0357fa700 1 -- 172.21.15.38:0/4234840900 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd030010740 con 0x7fd038143480 2020-06-12T17:48:16.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.663+0000 7fd03df7a700 1 -- 172.21.15.38:0/4234840900 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd038066670 con 0x7fd038143480 2020-06-12T17:48:16.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.663+0000 7fd037fff700 1 --2- 172.21.15.38:0/4234840900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd038143480 0x7fd038155600 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fd038060250 tx=0x7fd030001b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:16.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.664+0000 7fd03df7a700 1 -- 172.21.15.38:0/4234840900 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd038056c30 con 0x7fd038143480 2020-06-12T17:48:16.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.664+0000 7fd0357fa700 1 -- 172.21.15.38:0/4234840900 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fd030006860 con 0x7fd038143480 2020-06-12T17:48:16.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.664+0000 7fd037fff700 1 --2- 172.21.15.38:0/4234840900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd038143480 0x7fd038155600 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fd038060250 tx=0x7fd030001b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:16.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.664+0000 7fd0357fa700 1 --2- 172.21.15.38:0/4234840900 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd01c04d600 0x7fd01c04fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:16.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.664+0000 7fd0357fa700 1 -- 172.21.15.38:0/4234840900 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd0300611d0 con 0x7fd038143480 2020-06-12T17:48:16.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.664+0000 7fd0377fe700 1 --2- 172.21.15.38:0/4234840900 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd01c04d600 0x7fd01c04fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:16.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.665+0000 7fd0377fe700 1 --2- 172.21.15.38:0/4234840900 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd01c04d600 0x7fd01c04fac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd028002f30 tx=0x7fd028007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:16.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.665+0000 7fd0377fe700 1 --2- 172.21.15.38:0/4234840900 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd01c04d600 0x7fd01c04fac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd028002f30 tx=0x7fd028007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:16.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.665+0000 7fd0377fe700 1 --2- 172.21.15.38:0/4234840900 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd01c04d600 0x7fd01c04fac0 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7fd028002f30 tx=0x7fd028007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:16.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.668+0000 7fd037fff700 1 --2- 172.21.15.38:0/4234840900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd038143480 0x7fd038155600 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fd038060250 tx=0x7fd030001b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:16.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.668+0000 7fd0357fa700 1 -- 172.21.15.38:0/4234840900 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fd03003c9f0 con 0x7fd038143480 2020-06-12T17:48:16.874 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.870+0000 7fd03df7a700 1 -- 172.21.15.38:0/4234840900 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd03805a5e0 con 0x7fd038143480 2020-06-12T17:48:16.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.871+0000 7fd037fff700 1 --2- 172.21.15.38:0/4234840900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd038143480 0x7fd038155600 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fd038060250 tx=0x7fd030001b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:16.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.871+0000 7fd0357fa700 1 -- 172.21.15.38:0/4234840900 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1420 (secure 0 0 0) 0x7fd0300090d0 con 0x7fd038143480 2020-06-12T17:48:16.875 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:16.875 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":3,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":3,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-06-12T17:48:14.851844+0000","modified":"2020-06-12T17:48:16.508635+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-06-12T17:48:16.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.872+0000 7fd03df7a700 1 -- 172.21.15.38:0/4234840900 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd01c04d600 msgr2=0x7fd01c04fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.872+0000 7fd03df7a700 1 --2- 172.21.15.38:0/4234840900 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd01c04d600 0x7fd01c04fac0 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7fd028002f30 tx=0x7fd028007e60).stop 2020-06-12T17:48:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.872+0000 7fd03df7a700 1 -- 172.21.15.38:0/4234840900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd038143480 msgr2=0x7fd038155600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.872+0000 7fd03df7a700 1 --2- 172.21.15.38:0/4234840900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd038143480 0x7fd038155600 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7fd038060250 tx=0x7fd030001b10).stop 2020-06-12T17:48:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.872+0000 7fd03df7a700 1 -- 172.21.15.38:0/4234840900 shutdown_connections 2020-06-12T17:48:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.872+0000 7fd03df7a700 1 --2- 172.21.15.38:0/4234840900 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd01c04d600 0x7fd01c04fac0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:16.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.872+0000 7fd03df7a700 1 --2- 172.21.15.38:0/4234840900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd038143480 0x7fd038155600 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:16.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.872+0000 7fd03df7a700 1 --2- 172.21.15.38:0/4234840900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd03805bf20 0x7fd0381466b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:16.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.872+0000 7fd03df7a700 1 --2- 172.21.15.38:0/4234840900 >> v2:172.21.15.150:3300/0 conn(0x7fd03809dd30 0x7fd03813ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:16.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.872+0000 7fd03df7a700 1 -- 172.21.15.38:0/4234840900 >> 172.21.15.38:0/4234840900 conn(0x7fd0380b8420 msgr2=0x7fd0380b4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:16.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.872+0000 7fd03df7a700 1 -- 172.21.15.38:0/4234840900 shutdown_connections 2020-06-12T17:48:16.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.872+0000 7fd03df7a700 1 -- 172.21.15.38:0/4234840900 wait complete. 2020-06-12T17:48:16.880 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 3 2020-06-12T17:48:16.886 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-12T17:48:17.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.996+0000 7fdfb326c700 1 Processor -- start 2020-06-12T17:48:17.001 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.997+0000 7fdfb326c700 1 -- start start 2020-06-12T17:48:17.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.997+0000 7fdfb326c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdfac143470 0x7fdfac143850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:17.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.997+0000 7fdfb326c700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfac0a0f90 con 0x7fdfac0a1970 2020-06-12T17:48:17.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.997+0000 7fdfb326c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfac0a1230 con 0x7fdfac146ae0 2020-06-12T17:48:17.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.997+0000 7fdfb326c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfac0a14d0 con 0x7fdfac143470 2020-06-12T17:48:17.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.997+0000 7fdfb0807700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fdfac0a1970 0x7fdfac0bcf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37264/0 (socket says 172.21.15.38:37264) 2020-06-12T17:48:17.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.997+0000 7fdfb0807700 1 -- 172.21.15.38:0/2390984186 learned_addr learned my addr 172.21.15.38:0/2390984186 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:17.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfb1008700 1 --2- 172.21.15.38:0/2390984186 >> v2:172.21.15.150:3300/0 conn(0x7fdfac143470 0x7fdfac143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfabfff700 1 -- 172.21.15.38:0/2390984186 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430860652 0 0) 0x7fdfac0a0f90 con 0x7fdfac0a1970 2020-06-12T17:48:17.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfabfff700 1 -- 172.21.15.38:0/2390984186 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf98003230 con 0x7fdfac0a1970 2020-06-12T17:48:17.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfabfff700 1 -- 172.21.15.38:0/2390984186 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 549414558 0 0) 0x7fdf98003230 con 0x7fdfac0a1970 2020-06-12T17:48:17.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfabfff700 1 -- 172.21.15.38:0/2390984186 >> v2:172.21.15.150:3300/0 conn(0x7fdfac143470 msgr2=0x7fdfac143850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:17.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfabfff700 1 --2- 172.21.15.38:0/2390984186 >> v2:172.21.15.150:3300/0 conn(0x7fdfac143470 0x7fdfac143850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:17.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfabfff700 1 -- 172.21.15.38:0/2390984186 >> v1:172.21.15.150:6789/0 conn(0x7fdfac146ae0 legacy=0x7fdfac09fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfabfff700 1 -- 172.21.15.38:0/2390984186 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfac0a0cd0 con 0x7fdfac0a1970 2020-06-12T17:48:17.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfabfff700 1 -- 172.21.15.38:0/2390984186 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fdfa00016d0 con 0x7fdfac0a1970 2020-06-12T17:48:17.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfabfff700 1 -- 172.21.15.38:0/2390984186 >> v1:172.21.15.38:6789/0 conn(0x7fdfac0a1970 legacy=0x7fdfac0bcf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfabfff700 1 --2- 172.21.15.38:0/2390984186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf98003720 0x7fdf98003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:17.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfabfff700 1 --2- 172.21.15.38:0/2390984186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf980044d0 0x7fdf98004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:17.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfabfff700 1 --2- 172.21.15.38:0/2390984186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf98004db0 0x7fdf9800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:17.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfabfff700 1 -- 172.21.15.38:0/2390984186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac0a14d0 con 0x7fdf980044d0 2020-06-12T17:48:17.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfabfff700 1 -- 172.21.15.38:0/2390984186 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980041c0 con 0x7fdf98004db0 2020-06-12T17:48:17.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfabfff700 1 -- 172.21.15.38:0/2390984186 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9800bb80 con 0x7fdf98003720 2020-06-12T17:48:17.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfb0807700 1 --2- 172.21.15.38:0/2390984186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf980044d0 0x7fdf98004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfb1809700 1 --2- 172.21.15.38:0/2390984186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf98004db0 0x7fdf9800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfb1008700 1 --2- 172.21.15.38:0/2390984186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf98003720 0x7fdf98003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfb0807700 1 -- 172.21.15.38:0/2390984186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf98003720 msgr2=0x7fdf98003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:17.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfb0807700 1 --2- 172.21.15.38:0/2390984186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf98003720 0x7fdf98003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:17.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfb0807700 1 -- 172.21.15.38:0/2390984186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf98004db0 msgr2=0x7fdf9800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:17.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfb0807700 1 --2- 172.21.15.38:0/2390984186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf98004db0 0x7fdf9800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:17.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfb0807700 1 -- 172.21.15.38:0/2390984186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf98003230 con 0x7fdf980044d0 2020-06-12T17:48:17.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfb1809700 1 --2- 172.21.15.38:0/2390984186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf98004db0 0x7fdf9800b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:17.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfb1809700 1 -- 172.21.15.38:0/2390984186 reap_dead start 2020-06-12T17:48:17.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfb0807700 1 --2- 172.21.15.38:0/2390984186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf980044d0 0x7fdf98004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdfa00013e0 tx=0x7fdfac146060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfb0807700 1 --2- 172.21.15.38:0/2390984186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf980044d0 0x7fdf98004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdfa00013e0 tx=0x7fdfac146060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.998+0000 7fdfb0807700 1 --2- 172.21.15.38:0/2390984186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf980044d0 0x7fdf98004950 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fdfa00013e0 tx=0x7fdfac146060).ready entity=mon.0 client_cookie=d52f239b3edc489d server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.999+0000 7fdfb0807700 1 --2- 172.21.15.38:0/2390984186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf980044d0 0x7fdf98004950 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fdfa00013e0 tx=0x7fdfac146060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.999+0000 7fdfabfff700 1 -- 172.21.15.38:0/2390984186 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfa000ce70 con 0x7fdf980044d0 2020-06-12T17:48:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.999+0000 7fdfb0807700 1 --2- 172.21.15.38:0/2390984186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf980044d0 0x7fdf98004950 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fdfa00013e0 tx=0x7fdfac146060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.999+0000 7fdfabfff700 1 -- 172.21.15.38:0/2390984186 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa000e350 con 0x7fdf980044d0 2020-06-12T17:48:17.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.999+0000 7fdfb0807700 1 --2- 172.21.15.38:0/2390984186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf980044d0 0x7fdf98004950 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fdfa00013e0 tx=0x7fdfac146060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.999+0000 7fdfabfff700 1 -- 172.21.15.38:0/2390984186 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfa000e6f0 con 0x7fdf980044d0 2020-06-12T17:48:17.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.999+0000 7fdfb326c700 1 -- 172.21.15.38:0/2390984186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf980044d0 msgr2=0x7fdf98004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.999+0000 7fdfb326c700 1 --2- 172.21.15.38:0/2390984186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf980044d0 0x7fdf98004950 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fdfa00013e0 tx=0x7fdfac146060).stop 2020-06-12T17:48:17.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.999+0000 7fdfb326c700 1 -- 172.21.15.38:0/2390984186 shutdown_connections 2020-06-12T17:48:17.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.999+0000 7fdfb326c700 1 --2- 172.21.15.38:0/2390984186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf980044d0 0x7fdf98004950 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:17.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.999+0000 7fdfb326c700 1 -- 172.21.15.38:0/2390984186 >> 172.21.15.38:0/2390984186 conn(0x7fdfac066040 msgr2=0x7fdfac0bc840 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:17.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.999+0000 7fdfb326c700 1 -- 172.21.15.38:0/2390984186 shutdown_connections 2020-06-12T17:48:17.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:16.999+0000 7fdfb326c700 1 -- 172.21.15.38:0/2390984186 wait complete. 2020-06-12T17:48:17.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.000+0000 7fdfb326c700 1 Processor -- start 2020-06-12T17:48:17.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.000+0000 7fdfb326c700 1 -- start start 2020-06-12T17:48:17.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.001+0000 7fdfb326c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf980044d0 0x7fdfac09e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:17.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.001+0000 7fdfb326c700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfac153bf0 con 0x7fdfac09ee50 2020-06-12T17:48:17.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.001+0000 7fdfb326c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfac153e90 con 0x7fdfac09d590 2020-06-12T17:48:17.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.001+0000 7fdfb326c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac0b4860 con 0x7fdf980044d0 2020-06-12T17:48:17.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.001+0000 7fdfb0807700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fdfac09ee50 0x7fdfac0b6150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37276/0 (socket says 172.21.15.38:37276) 2020-06-12T17:48:17.020 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.001+0000 7fdfb0807700 1 -- 172.21.15.38:0/4062350633 learned_addr learned my addr 172.21.15.38:0/4062350633 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:17.020 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.001+0000 7fdfb1008700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf980044d0 0x7fdfac09e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.020 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.001+0000 7fdfaa7fc700 1 -- 172.21.15.38:0/4062350633 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1616076595 0 0) 0x7fdfac153bf0 con 0x7fdfac09ee50 2020-06-12T17:48:17.020 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.001+0000 7fdfaa7fc700 1 -- 172.21.15.38:0/4062350633 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf8c002fe0 con 0x7fdfac09ee50 2020-06-12T17:48:17.020 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.001+0000 7fdfaa7fc700 1 -- 172.21.15.38:0/4062350633 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1024919277 0 0) 0x7fdf8c002fe0 con 0x7fdfac09ee50 2020-06-12T17:48:17.021 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.001+0000 7fdfaa7fc700 1 -- 172.21.15.38:0/4062350633 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdfac153bf0 con 0x7fdfac09ee50 2020-06-12T17:48:17.021 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.001+0000 7fdfaa7fc700 1 -- 172.21.15.38:0/4062350633 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3089999493 0 0) 0x7fdfac153e90 con 0x7fdfac09d590 2020-06-12T17:48:17.021 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.001+0000 7fdfaa7fc700 1 -- 172.21.15.38:0/4062350633 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf8c002fe0 con 0x7fdfac09d590 2020-06-12T17:48:17.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.001+0000 7fdfaa7fc700 1 -- 172.21.15.38:0/4062350633 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fdfa000ce70 con 0x7fdfac09ee50 2020-06-12T17:48:17.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.001+0000 7fdfaa7fc700 1 -- 172.21.15.38:0/4062350633 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf980044d0 msgr2=0x7fdfac09e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.001+0000 7fdfaa7fc700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf980044d0 0x7fdfac09e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:17.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.001+0000 7fdfaa7fc700 1 -- 172.21.15.38:0/4062350633 >> v1:172.21.15.150:6789/0 conn(0x7fdfac09d590 legacy=0x7fdfac0b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.001+0000 7fdfaa7fc700 1 -- 172.21.15.38:0/4062350633 >> v1:172.21.15.38:6789/0 conn(0x7fdfac09ee50 legacy=0x7fdfac0b6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.001+0000 7fdfaa7fc700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf8c004b60 0x7fdf8c004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:17.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.001+0000 7fdfaa7fc700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf8c003920 0x7fdf8c003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:17.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.001+0000 7fdfaa7fc700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf8c0041c0 0x7fdf8c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:17.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.001+0000 7fdfaa7fc700 1 -- 172.21.15.38:0/4062350633 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c0047a0 con 0x7fdf8c003920 2020-06-12T17:48:17.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.001+0000 7fdfaa7fc700 1 -- 172.21.15.38:0/4062350633 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c00bbb0 con 0x7fdf8c0041c0 2020-06-12T17:48:17.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.001+0000 7fdfaa7fc700 1 -- 172.21.15.38:0/4062350633 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c00bd70 con 0x7fdf8c004b60 2020-06-12T17:48:17.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.002+0000 7fdfb1008700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf980044d0 0x7fdfac09e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:17.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.002+0000 7fdfb0807700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf8c003920 0x7fdf8c003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.002+0000 7fdfb1809700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf8c0041c0 0x7fdf8c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.002+0000 7fdfb1008700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf8c004b60 0x7fdf8c004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.002+0000 7fdfb0807700 1 -- 172.21.15.38:0/4062350633 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf8c004b60 msgr2=0x7fdf8c004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.002+0000 7fdfb0807700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf8c004b60 0x7fdf8c004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:17.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.002+0000 7fdfb0807700 1 -- 172.21.15.38:0/4062350633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf8c0041c0 msgr2=0x7fdf8c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.002+0000 7fdfb0807700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf8c0041c0 0x7fdf8c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:17.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.002+0000 7fdfb0807700 1 -- 172.21.15.38:0/4062350633 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfac0b4a50 con 0x7fdf8c003920 2020-06-12T17:48:17.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.002+0000 7fdfb326c700 1 -- 172.21.15.38:0/4062350633 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfac0b2970 con 0x7fdf8c003920 2020-06-12T17:48:17.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.002+0000 7fdfb0807700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf8c003920 0x7fdf8c003d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdfa000ba50 tx=0x7fdfac146060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.002+0000 7fdfb0807700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf8c003920 0x7fdf8c003d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdfa000ba50 tx=0x7fdfac146060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.002+0000 7fdfb0807700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf8c003920 0x7fdf8c003d60 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7fdfa000ba50 tx=0x7fdfac146060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:17.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.002+0000 7fdfb0807700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf8c003920 0x7fdf8c003d60 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7fdfa000ba50 tx=0x7fdfac146060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.002+0000 7fdfaa7fc700 1 -- 172.21.15.38:0/4062350633 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfa000b640 con 0x7fdf8c003920 2020-06-12T17:48:17.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.002+0000 7fdfb0807700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf8c003920 0x7fdf8c003d60 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7fdfa000ba50 tx=0x7fdfac146060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.002+0000 7fdfb0807700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf8c003920 0x7fdf8c003d60 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7fdfa000ba50 tx=0x7fdfac146060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.028 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.002+0000 7fdfaa7fc700 1 -- 172.21.15.38:0/4062350633 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa00046e0 con 0x7fdf8c003920 2020-06-12T17:48:17.028 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.002+0000 7fdfb326c700 1 -- 172.21.15.38:0/4062350633 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfac09ead0 con 0x7fdf8c003920 2020-06-12T17:48:17.028 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.002+0000 7fdfaa7fc700 1 -- 172.21.15.38:0/4062350633 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfa0004a40 con 0x7fdf8c003920 2020-06-12T17:48:17.028 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.003+0000 7fdfb0807700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf8c003920 0x7fdf8c003d60 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7fdfa000ba50 tx=0x7fdfac146060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.028 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.003+0000 7fdfaa7fc700 1 -- 172.21.15.38:0/4062350633 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fdfa0004ba0 con 0x7fdf8c003920 2020-06-12T17:48:17.029 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.003+0000 7fdfb0807700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf8c003920 0x7fdf8c003d60 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7fdfa000ba50 tx=0x7fdfac146060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.029 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.003+0000 7fdfb326c700 1 -- 172.21.15.38:0/4062350633 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfac056c30 con 0x7fdf8c003920 2020-06-12T17:48:17.029 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.003+0000 7fdfaa7fc700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdf8c056090 0x7fdf8c058550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:17.030 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.003+0000 7fdfaa7fc700 1 -- 172.21.15.38:0/4062350633 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fdfa0062010 con 0x7fdf8c003920 2020-06-12T17:48:17.030 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.004+0000 7fdfb1008700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdf8c056090 0x7fdf8c058550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.030 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.004+0000 7fdfb1008700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdf8c056090 0x7fdf8c058550 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdfa40032b0 tx=0x7fdfa40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.030 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.004+0000 7fdfb1008700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdf8c056090 0x7fdf8c058550 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdfa40032b0 tx=0x7fdfa40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.030 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.004+0000 7fdfb1008700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdf8c056090 0x7fdf8c058550 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7fdfa40032b0 tx=0x7fdfa40081e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:17.031 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.007+0000 7fdfb0807700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf8c003920 0x7fdf8c003d60 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7fdfa000ba50 tx=0x7fdfac146060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.032 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.007+0000 7fdfaa7fc700 1 -- 172.21.15.38:0/4062350633 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fdfa003d830 con 0x7fdf8c003920 2020-06-12T17:48:17.160 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.157+0000 7fdfb326c700 1 -- 172.21.15.38:0/4062350633 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfac154020 con 0x7fdf8c003920 2020-06-12T17:48:17.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.157+0000 7fdfb0807700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf8c003920 0x7fdf8c003d60 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7fdfa000ba50 tx=0x7fdfac146060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.157+0000 7fdfaa7fc700 1 -- 172.21.15.38:0/4062350633 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16347 (secure 0 0 0) 0x7fdfa0040e50 con 0x7fdf8c003920 2020-06-12T17:48:17.162 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:17.162 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":24,"fsid":"8e42a2e7-b187-42c4-a73f-8f812ee62352","created":"2020-06-12T17:47:54.434340+0000","modified":"2020-06-12T17:48:14.851712+0000","last_up_change":"2020-06-12T17:48:03.388718+0000","last_in_change":"2020-06-12T17:48:03.388718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-06-12T17:47:57.558119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-06-12T17:48:07.419264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-06-12T17:48:09.934098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-06-12T17:48:12.497229+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"44ac3dea-67b4-4b9a-bc18-ac511710afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":31038},{"type":"v1","addr":"172.21.15.38:6816","nonce":31038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":31038},{"type":"v1","addr":"172.21.15.38:6819","nonce":31038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":31038},{"type":"v1","addr":"172.21.15.38:6823","nonce":31038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":31038},{"type":"v1","addr":"172.21.15.38:6821","nonce":31038}]},"public_addr":"172.21.15.38:6816/31038","cluster_addr":"172.21.15.38:6819/31038","heartbeat_back_addr":"172.21.15.38:6823/31038","heartbeat_front_addr":"172.21.15.38:6821/31038","state":["exists","up"]},{"osd":1,"uuid":"561f7ced-3fff-4364-8619-6e4ecbc9d256","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":31036},{"type":"v1","addr":"172.21.15.38:6801","nonce":31036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":31036},{"type":"v1","addr":"172.21.15.38:6803","nonce":31036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":31036},{"type":"v1","addr":"172.21.15.38:6807","nonce":31036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":31036},{"type":"v1","addr":"172.21.15.38:6805","nonce":31036}]},"public_addr":"172.21.15.38:6801/31036","cluster_addr":"172.21.15.38:6803/31036","heartbeat_back_addr":"172.21.15.38:6807/31036","heartbeat_front_addr":"172.21.15.38:6805/31036","state":["exists","up"]},{"osd":2,"uuid":"0bb3c806-07af-49f5-b492-d0e33f2de37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":31053},{"type":"v1","addr":"172.21.15.38:6825","nonce":31053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":31053},{"type":"v1","addr":"172.21.15.38:6827","nonce":31053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":31053},{"type":"v1","addr":"172.21.15.38:6831","nonce":31053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":31053},{"type":"v1","addr":"172.21.15.38:6829","nonce":31053}]},"public_addr":"172.21.15.38:6825/31053","cluster_addr":"172.21.15.38:6827/31053","heartbeat_back_addr":"172.21.15.38:6831/31053","heartbeat_front_addr":"172.21.15.38:6829/31053","state":["exists","up"]},{"osd":3,"uuid":"7f6a1e75-7b11-456e-8a4b-510b16226800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":31037},{"type":"v1","addr":"172.21.15.38:6809","nonce":31037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":31037},{"type":"v1","addr":"172.21.15.38:6811","nonce":31037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6815","nonce":31037},{"type":"v1","addr":"172.21.15.38:6817","nonce":31037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":31037},{"type":"v1","addr":"172.21.15.38:6813","nonce":31037}]},"public_addr":"172.21.15.38:6809/31037","cluster_addr":"172.21.15.38:6811/31037","heartbeat_back_addr":"172.21.15.38:6817/31037","heartbeat_front_addr":"172.21.15.38:6813/31037","state":["exists","up"]},{"osd":4,"uuid":"0eca0272-8cfd-469c-a32d-e29730dc0e1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":31294},{"type":"v1","addr":"172.21.15.150:6803","nonce":31294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":31294},{"type":"v1","addr":"172.21.15.150:6805","nonce":31294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":31294},{"type":"v1","addr":"172.21.15.150:6809","nonce":31294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":31294},{"type":"v1","addr":"172.21.15.150:6807","nonce":31294}]},"public_addr":"172.21.15.150:6803/31294","cluster_addr":"172.21.15.150:6805/31294","heartbeat_back_addr":"172.21.15.150:6809/31294","heartbeat_front_addr":"172.21.15.150:6807/31294","state":["exists","up"]},{"osd":5,"uuid":"69d6a7dc-a55a-4ebc-8479-8bb921ddfb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":31295},{"type":"v1","addr":"172.21.15.150:6813","nonce":31295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":31295},{"type":"v1","addr":"172.21.15.150:6816","nonce":31295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":31295},{"type":"v1","addr":"172.21.15.150:6828","nonce":31295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6819","nonce":31295},{"type":"v1","addr":"172.21.15.150:6822","nonce":31295}]},"public_addr":"172.21.15.150:6813/31295","cluster_addr":"172.21.15.150:6816/31295","heartbeat_back_addr":"172.21.15.150:6828/31295","heartbeat_front_addr":"172.21.15.150:6822/31295","state":["exists","up"]},{"osd":6,"uuid":"f0d320f8-c2f0-40bb-b713-526246cf97b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":31297},{"type":"v1","addr":"172.21.15.150:6820","nonce":31297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6823","nonce":31297},{"type":"v1","addr":"172.21.15.150:6827","nonce":31297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":31297},{"type":"v1","addr":"172.21.15.150:6833","nonce":31297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":31297},{"type":"v1","addr":"172.21.15.150:6831","nonce":31297}]},"public_addr":"172.21.15.150:6820/31297","cluster_addr":"172.21.15.150:6827/31297","heartbeat_back_addr":"172.21.15.150:6833/31297","heartbeat_front_addr":"172.21.15.150:6831/31297","state":["exists","up"]},{"osd":7,"uuid":"970b7d02-a189-41b2-96e5-a5a5a57c6476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":31296},{"type":"v1","addr":"172.21.15.150:6812","nonce":31296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":31296},{"type":"v1","addr":"172.21.15.150:6818","nonce":31296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":31296},{"type":"v1","addr":"172.21.15.150:6829","nonce":31296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":31296},{"type":"v1","addr":"172.21.15.150:6824","nonce":31296}]},"public_addr":"172.21.15.150:6812/31296","cluster_addr":"172.21.15.150:6818/31296","heartbeat_back_addr":"172.21.15.150:6829/31296","heartbeat_front_addr":"172.21.15.150:6824/31296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.664300+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.644253+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.651120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.584978+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.561149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.661778+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T17:48:17.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.159+0000 7fdfb326c700 1 -- 172.21.15.38:0/4062350633 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdf8c056090 msgr2=0x7fdf8c058550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.159+0000 7fdfb326c700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdf8c056090 0x7fdf8c058550 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7fdfa40032b0 tx=0x7fdfa40081e0).stop 2020-06-12T17:48:17.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.159+0000 7fdfb326c700 1 -- 172.21.15.38:0/4062350633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf8c003920 msgr2=0x7fdf8c003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.159+0000 7fdfb326c700 1 --2- 172.21.15.38:0/4062350633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf8c003920 0x7fdf8c003d60 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7fdfa000ba50 tx=0x7fdfac146060).stop 2020-06-12T17:48:17.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.159+0000 7fdfb1809700 1 -- 172.21.15.38:0/4062350633 reap_dead start 2020-06-12T17:48:17.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.159+0000 7fdfb1809700 1 -- 172.21.15.38:0/4062350633 reap_dead start 2020-06-12T17:48:17.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.159+0000 7fdfb326c700 1 -- 172.21.15.38:0/4062350633 shutdown_connections 2020-06-12T17:48:17.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.159+0000 7fdfb326c700 1 -- 172.21.15.38:0/4062350633 >> 172.21.15.38:0/4062350633 conn(0x7fdfac066040 msgr2=0x7fdfac09fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:17.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.159+0000 7fdfb326c700 1 -- 172.21.15.38:0/4062350633 shutdown_connections 2020-06-12T17:48:17.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.159+0000 7fdfb326c700 1 -- 172.21.15.38:0/4062350633 wait complete. 2020-06-12T17:48:17.173 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-06-12T17:48:17.173 INFO:tasks.ceph.mds.a:Restarting daemon 2020-06-12T17:48:17.174 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-06-12T17:48:17.179 INFO:tasks.ceph.mds.a:Started 2020-06-12T17:48:17.179 INFO:tasks.ceph.mds.b:Restarting daemon 2020-06-12T17:48:17.180 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-06-12T17:48:17.182 INFO:tasks.ceph.mds.b:Started 2020-06-12T17:48:17.183 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-12T17:48:17.183 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-06-12T17:48:17.255 INFO:tasks.ceph.mds.a.smithi038.stdout:starting mds.a at 2020-06-12T17:48:17.265 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2020-06-12T17:48:17.299 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.296+0000 7f584f59e700 1 Processor -- start 2020-06-12T17:48:17.299 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.296+0000 7f584f59e700 1 -- start start 2020-06-12T17:48:17.306 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.296+0000 7f584f59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f58500b9da0 0x7f58500668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:17.306 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.296+0000 7f584f59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58500b2800 0x7f5850142040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:17.306 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.297+0000 7f584f59e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58500b2ca0 con 0x7f58501424a0 2020-06-12T17:48:17.306 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.297+0000 7f584f59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58500b2f40 con 0x7f58500b9da0 2020-06-12T17:48:17.307 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.297+0000 7f584f59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58500b31e0 con 0x7f58500b2800 2020-06-12T17:48:17.307 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.297+0000 7f584ed9d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f58501424a0 0x7f58500601b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37302/0 (socket says 172.21.15.38:37302) 2020-06-12T17:48:17.307 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.297+0000 7f584ed9d700 1 -- 172.21.15.38:0/4019989833 learned_addr learned my addr 172.21.15.38:0/4019989833 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:17.307 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.297+0000 7f584d59a700 1 -- 172.21.15.38:0/4019989833 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638454016 0 0) 0x7f58500b2ca0 con 0x7f58501424a0 2020-06-12T17:48:17.307 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.297+0000 7f584dd9b700 1 --2- 172.21.15.38:0/4019989833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58500b2800 0x7f5850142040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.308 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.297+0000 7f584e59c700 1 --2- 172.21.15.38:0/4019989833 >> v2:172.21.15.150:3300/0 conn(0x7f58500b9da0 0x7f58500668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.308 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.297+0000 7f584d59a700 1 -- 172.21.15.38:0/4019989833 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5830003230 con 0x7f58501424a0 2020-06-12T17:48:17.308 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.297+0000 7f584d59a700 1 -- 172.21.15.38:0/4019989833 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4091557853 0 0) 0x7f5830003230 con 0x7f58501424a0 2020-06-12T17:48:17.308 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.297+0000 7f584d59a700 1 -- 172.21.15.38:0/4019989833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58500b2800 msgr2=0x7f5850142040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:17.308 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.297+0000 7f584d59a700 1 --2- 172.21.15.38:0/4019989833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58500b2800 0x7f5850142040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:17.309 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.297+0000 7f584d59a700 1 -- 172.21.15.38:0/4019989833 >> v2:172.21.15.150:3300/0 conn(0x7f58500b9da0 msgr2=0x7f58500668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:17.309 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.297+0000 7f584d59a700 1 --2- 172.21.15.38:0/4019989833 >> v2:172.21.15.150:3300/0 conn(0x7f58500b9da0 0x7f58500668a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:17.309 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.297+0000 7f584d59a700 1 -- 172.21.15.38:0/4019989833 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58500ba180 con 0x7f58501424a0 2020-06-12T17:48:17.309 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.297+0000 7f584d59a700 1 -- 172.21.15.38:0/4019989833 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f58480016d0 con 0x7f58501424a0 2020-06-12T17:48:17.309 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.297+0000 7f584d59a700 1 -- 172.21.15.38:0/4019989833 >> v1:172.21.15.38:6789/0 conn(0x7f58501424a0 legacy=0x7f58500601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.310 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.297+0000 7f584d59a700 1 --2- 172.21.15.38:0/4019989833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5830003720 0x7f5830003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:17.310 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.297+0000 7f584d59a700 1 --2- 172.21.15.38:0/4019989833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58500b2800 0x7f58300044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:17.310 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.297+0000 7f584d59a700 1 --2- 172.21.15.38:0/4019989833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5830004930 0x7f5830004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:17.310 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.297+0000 7f584d59a700 1 -- 172.21.15.38:0/4019989833 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58500b2f40 con 0x7f5830003720 2020-06-12T17:48:17.310 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.297+0000 7f584d59a700 1 -- 172.21.15.38:0/4019989833 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58500b31e0 con 0x7f5830004930 2020-06-12T17:48:17.311 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.297+0000 7f584d59a700 1 -- 172.21.15.38:0/4019989833 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58300040f0 con 0x7f58500b2800 2020-06-12T17:48:17.311 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.297+0000 7f584e59c700 1 --2- 172.21.15.38:0/4019989833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5830003720 0x7f5830003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.311 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.297+0000 7f584dd9b700 1 --2- 172.21.15.38:0/4019989833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58500b2800 0x7f58300044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.311 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.297+0000 7f584ed9d700 1 --2- 172.21.15.38:0/4019989833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5830004930 0x7f5830004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.311 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.298+0000 7f584e59c700 1 -- 172.21.15.38:0/4019989833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58500b2800 msgr2=0x7f58300044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:17.311 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.298+0000 7f584e59c700 1 --2- 172.21.15.38:0/4019989833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58500b2800 0x7f58300044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:17.312 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.298+0000 7f584e59c700 1 -- 172.21.15.38:0/4019989833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5830004930 msgr2=0x7f5830004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:17.312 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.298+0000 7f584e59c700 1 --2- 172.21.15.38:0/4019989833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5830004930 0x7f5830004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:17.312 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.298+0000 7f584e59c700 1 -- 172.21.15.38:0/4019989833 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5830003230 con 0x7f5830003720 2020-06-12T17:48:17.312 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.298+0000 7f584e59c700 1 --2- 172.21.15.38:0/4019989833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5830003720 0x7f5830003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f58400032b0 tx=0x7f58400081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.312 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.298+0000 7f584e59c700 1 --2- 172.21.15.38:0/4019989833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5830003720 0x7f5830003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f58400032b0 tx=0x7f58400081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.313 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.298+0000 7f584e59c700 1 --2- 172.21.15.38:0/4019989833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5830003720 0x7f5830003b40 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f58400032b0 tx=0x7f58400081e0).ready entity=mon.0 client_cookie=9b923c9acd4b40ed server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:17.313 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.298+0000 7f584e59c700 1 --2- 172.21.15.38:0/4019989833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5830003720 0x7f5830003b40 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f58400032b0 tx=0x7f58400081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.313 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.298+0000 7f584e59c700 1 --2- 172.21.15.38:0/4019989833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5830003720 0x7f5830003b40 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f58400032b0 tx=0x7f58400081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.313 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.298+0000 7f584d59a700 1 -- 172.21.15.38:0/4019989833 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58400110c0 con 0x7f5830003720 2020-06-12T17:48:17.313 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.298+0000 7f584e59c700 1 --2- 172.21.15.38:0/4019989833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5830003720 0x7f5830003b40 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f58400032b0 tx=0x7f58400081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.314 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.298+0000 7f584d59a700 1 -- 172.21.15.38:0/4019989833 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5840011220 con 0x7f5830003720 2020-06-12T17:48:17.314 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.298+0000 7f584d59a700 1 -- 172.21.15.38:0/4019989833 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5840011640 con 0x7f5830003720 2020-06-12T17:48:17.314 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.298+0000 7f584f59e700 1 -- 172.21.15.38:0/4019989833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5830003720 msgr2=0x7f5830003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.314 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.298+0000 7f584f59e700 1 --2- 172.21.15.38:0/4019989833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5830003720 0x7f5830003b40 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f58400032b0 tx=0x7f58400081e0).stop 2020-06-12T17:48:17.314 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.298+0000 7f584ed9d700 1 -- 172.21.15.38:0/4019989833 reap_dead start 2020-06-12T17:48:17.315 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.299+0000 7f584f59e700 1 -- 172.21.15.38:0/4019989833 shutdown_connections 2020-06-12T17:48:17.315 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.299+0000 7f584f59e700 1 -- 172.21.15.38:0/4019989833 >> 172.21.15.38:0/4019989833 conn(0x7f585005fa60 msgr2=0x7f58500b9310 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:17.315 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.299+0000 7f584f59e700 1 -- 172.21.15.38:0/4019989833 shutdown_connections 2020-06-12T17:48:17.315 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.299+0000 7f584f59e700 1 -- 172.21.15.38:0/4019989833 wait complete. 2020-06-12T17:48:17.315 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.299+0000 7f584f59e700 1 Processor -- start 2020-06-12T17:48:17.316 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.300+0000 7f584f59e700 1 -- start start 2020-06-12T17:48:17.316 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.300+0000 7f584f59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5850139a70 0x7f58500b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:17.316 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.300+0000 7f584f59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58500b4e90 0x7f5850135f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:17.316 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.300+0000 7f584f59e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f58501363e0 0x7f5850063900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:17.316 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.300+0000 7f584f59e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5850065640 con 0x7f58501363e0 2020-06-12T17:48:17.317 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.300+0000 7f584f59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58500658d0 con 0x7f5850139a70 2020-06-12T17:48:17.317 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.300+0000 7f584f59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5850065b70 con 0x7f58500b4e90 2020-06-12T17:48:17.317 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.300+0000 7f584ed9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f58501363e0 0x7f5850063900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.317 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.300+0000 7f584ed9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f58501363e0 0x7f5850063900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35498/0 (socket says 172.21.15.38:35498) 2020-06-12T17:48:17.317 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.300+0000 7f584ed9d700 1 -- 172.21.15.38:0/4069562396 learned_addr learned my addr 172.21.15.38:0/4069562396 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:17.318 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.300+0000 7f584e59c700 1 --2- 172.21.15.38:0/4069562396 >> v2:172.21.15.150:3300/0 conn(0x7f5850139a70 0x7f58500b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.318 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.300+0000 7f584dd9b700 1 --2- 172.21.15.38:0/4069562396 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58500b4e90 0x7f5850135f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.318 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.301+0000 7f584ed9d700 1 -- 172.21.15.38:0/4069562396 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58500b4e90 msgr2=0x7f5850135f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.318 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.301+0000 7f584ed9d700 1 --2- 172.21.15.38:0/4069562396 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58500b4e90 0x7f5850135f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:17.318 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.301+0000 7f584ed9d700 1 -- 172.21.15.38:0/4069562396 >> v2:172.21.15.150:3300/0 conn(0x7f5850139a70 msgr2=0x7f58500b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.301+0000 7f584ed9d700 1 --2- 172.21.15.38:0/4069562396 >> v2:172.21.15.150:3300/0 conn(0x7f5850139a70 0x7f58500b4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:17.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.301+0000 7f584ed9d700 1 -- 172.21.15.38:0/4069562396 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5850139e50 con 0x7f58501363e0 2020-06-12T17:48:17.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.301+0000 7f584ed9d700 1 --2- 172.21.15.38:0/4069562396 >> v2:172.21.15.38:3300/0 conn(0x7f58501363e0 0x7f5850063900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5848001930 tx=0x7f58500b1e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.301+0000 7f584ed9d700 1 --2- 172.21.15.38:0/4069562396 >> v2:172.21.15.38:3300/0 conn(0x7f58501363e0 0x7f5850063900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5848001930 tx=0x7f58500b1e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.301+0000 7f584ed9d700 1 --2- 172.21.15.38:0/4069562396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58501363e0 0x7f5850063900 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f5848001930 tx=0x7f58500b1e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:17.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.301+0000 7f584ed9d700 1 --2- 172.21.15.38:0/4069562396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58501363e0 0x7f5850063900 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f5848001930 tx=0x7f58500b1e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.301+0000 7f584ed9d700 1 --2- 172.21.15.38:0/4069562396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58501363e0 0x7f5850063900 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f5848001930 tx=0x7f58500b1e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.301+0000 7f58477fe700 1 -- 172.21.15.38:0/4069562396 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f584800cbe0 con 0x7f58501363e0 2020-06-12T17:48:17.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.301+0000 7f584ed9d700 1 --2- 172.21.15.38:0/4069562396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58501363e0 0x7f5850063900 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f5848001930 tx=0x7f58500b1e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.301+0000 7f58477fe700 1 -- 172.21.15.38:0/4069562396 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584800cd40 con 0x7f58501363e0 2020-06-12T17:48:17.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.301+0000 7f584f59e700 1 -- 172.21.15.38:0/4069562396 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5850066010 con 0x7f58501363e0 2020-06-12T17:48:17.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.301+0000 7f58477fe700 1 -- 172.21.15.38:0/4069562396 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58480097a0 con 0x7f58501363e0 2020-06-12T17:48:17.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.301+0000 7f584f59e700 1 -- 172.21.15.38:0/4069562396 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585014ddd0 con 0x7f58501363e0 2020-06-12T17:48:17.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.302+0000 7f584ed9d700 1 --2- 172.21.15.38:0/4069562396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58501363e0 0x7f5850063900 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f5848001930 tx=0x7f58500b1e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.302+0000 7f584ed9d700 1 --2- 172.21.15.38:0/4069562396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58501363e0 0x7f5850063900 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f5848001930 tx=0x7f58500b1e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.302+0000 7f58477fe700 1 -- 172.21.15.38:0/4069562396 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f584800e140 con 0x7f58501363e0 2020-06-12T17:48:17.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.302+0000 7f584f59e700 1 -- 172.21.15.38:0/4069562396 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5850056c30 con 0x7f58501363e0 2020-06-12T17:48:17.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.302+0000 7f58477fe700 1 --2- 172.21.15.38:0/4069562396 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f583404d660 0x7f583404fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:17.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.302+0000 7f58477fe700 1 -- 172.21.15.38:0/4069562396 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f5848060570 con 0x7f58501363e0 2020-06-12T17:48:17.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.303+0000 7f584e59c700 1 --2- 172.21.15.38:0/4069562396 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f583404d660 0x7f583404fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.323 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.303+0000 7f584e59c700 1 --2- 172.21.15.38:0/4069562396 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f583404d660 0x7f583404fb20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f58400032b0 tx=0x7f58400081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.324 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.303+0000 7f584e59c700 1 --2- 172.21.15.38:0/4069562396 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f583404d660 0x7f583404fb20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f58400032b0 tx=0x7f58400081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.324 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.303+0000 7f584e59c700 1 --2- 172.21.15.38:0/4069562396 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f583404d660 0x7f583404fb20 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f58400032b0 tx=0x7f58400081e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:17.324 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.306+0000 7f584ed9d700 1 --2- 172.21.15.38:0/4069562396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58501363e0 0x7f5850063900 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f5848001930 tx=0x7f58500b1e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.325 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.306+0000 7f58477fe700 1 -- 172.21.15.38:0/4069562396 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f584803be00 con 0x7f58501363e0 2020-06-12T17:48:17.384 INFO:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-06-12T17:48:17.387 INFO:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-06-12T17:48:17.462 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.458+0000 7f584f59e700 1 -- 172.21.15.38:0/4069562396 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5850067f60 con 0x7f58501363e0 2020-06-12T17:48:17.463 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.459+0000 7f584ed9d700 1 --2- 172.21.15.38:0/4069562396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58501363e0 0x7f5850063900 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f5848001930 tx=0x7f58500b1e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.463 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.459+0000 7f58477fe700 1 -- 172.21.15.38:0/4069562396 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16347 (secure 0 0 0) 0x7f584803f420 con 0x7f58501363e0 2020-06-12T17:48:17.463 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:17.464 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":24,"fsid":"8e42a2e7-b187-42c4-a73f-8f812ee62352","created":"2020-06-12T17:47:54.434340+0000","modified":"2020-06-12T17:48:14.851712+0000","last_up_change":"2020-06-12T17:48:03.388718+0000","last_in_change":"2020-06-12T17:48:03.388718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-06-12T17:47:57.558119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-06-12T17:48:07.419264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-06-12T17:48:09.934098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-06-12T17:48:12.497229+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"44ac3dea-67b4-4b9a-bc18-ac511710afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":31038},{"type":"v1","addr":"172.21.15.38:6816","nonce":31038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":31038},{"type":"v1","addr":"172.21.15.38:6819","nonce":31038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":31038},{"type":"v1","addr":"172.21.15.38:6823","nonce":31038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":31038},{"type":"v1","addr":"172.21.15.38:6821","nonce":31038}]},"public_addr":"172.21.15.38:6816/31038","cluster_addr":"172.21.15.38:6819/31038","heartbeat_back_addr":"172.21.15.38:6823/31038","heartbeat_front_addr":"172.21.15.38:6821/31038","state":["exists","up"]},{"osd":1,"uuid":"561f7ced-3fff-4364-8619-6e4ecbc9d256","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":31036},{"type":"v1","addr":"172.21.15.38:6801","nonce":31036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":31036},{"type":"v1","addr":"172.21.15.38:6803","nonce":31036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":31036},{"type":"v1","addr":"172.21.15.38:6807","nonce":31036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":31036},{"type":"v1","addr":"172.21.15.38:6805","nonce":31036}]},"public_addr":"172.21.15.38:6801/31036","cluster_addr":"172.21.15.38:6803/31036","heartbeat_back_addr":"172.21.15.38:6807/31036","heartbeat_front_addr":"172.21.15.38:6805/31036","state":["exists","up"]},{"osd":2,"uuid":"0bb3c806-07af-49f5-b492-d0e33f2de37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":31053},{"type":"v1","addr":"172.21.15.38:6825","nonce":31053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":31053},{"type":"v1","addr":"172.21.15.38:6827","nonce":31053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":31053},{"type":"v1","addr":"172.21.15.38:6831","nonce":31053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":31053},{"type":"v1","addr":"172.21.15.38:6829","nonce":31053}]},"public_addr":"172.21.15.38:6825/31053","cluster_addr":"172.21.15.38:6827/31053","heartbeat_back_addr":"172.21.15.38:6831/31053","heartbeat_front_addr":"172.21.15.38:6829/31053","state":["exists","up"]},{"osd":3,"uuid":"7f6a1e75-7b11-456e-8a4b-510b16226800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":31037},{"type":"v1","addr":"172.21.15.38:6809","nonce":31037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":31037},{"type":"v1","addr":"172.21.15.38:6811","nonce":31037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6815","nonce":31037},{"type":"v1","addr":"172.21.15.38:6817","nonce":31037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":31037},{"type":"v1","addr":"172.21.15.38:6813","nonce":31037}]},"public_addr":"172.21.15.38:6809/31037","cluster_addr":"172.21.15.38:6811/31037","heartbeat_back_addr":"172.21.15.38:6817/31037","heartbeat_front_addr":"172.21.15.38:6813/31037","state":["exists","up"]},{"osd":4,"uuid":"0eca0272-8cfd-469c-a32d-e29730dc0e1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":31294},{"type":"v1","addr":"172.21.15.150:6803","nonce":31294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":31294},{"type":"v1","addr":"172.21.15.150:6805","nonce":31294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":31294},{"type":"v1","addr":"172.21.15.150:6809","nonce":31294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":31294},{"type":"v1","addr":"172.21.15.150:6807","nonce":31294}]},"public_addr":"172.21.15.150:6803/31294","cluster_addr":"172.21.15.150:6805/31294","heartbeat_back_addr":"172.21.15.150:6809/31294","heartbeat_front_addr":"172.21.15.150:6807/31294","state":["exists","up"]},{"osd":5,"uuid":"69d6a7dc-a55a-4ebc-8479-8bb921ddfb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":31295},{"type":"v1","addr":"172.21.15.150:6813","nonce":31295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":31295},{"type":"v1","addr":"172.21.15.150:6816","nonce":31295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":31295},{"type":"v1","addr":"172.21.15.150:6828","nonce":31295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6819","nonce":31295},{"type":"v1","addr":"172.21.15.150:6822","nonce":31295}]},"public_addr":"172.21.15.150:6813/31295","cluster_addr":"172.21.15.150:6816/31295","heartbeat_back_addr":"172.21.15.150:6828/31295","heartbeat_front_addr":"172.21.15.150:6822/31295","state":["exists","up"]},{"osd":6,"uuid":"f0d320f8-c2f0-40bb-b713-526246cf97b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":31297},{"type":"v1","addr":"172.21.15.150:6820","nonce":31297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6823","nonce":31297},{"type":"v1","addr":"172.21.15.150:6827","nonce":31297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":31297},{"type":"v1","addr":"172.21.15.150:6833","nonce":31297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":31297},{"type":"v1","addr":"172.21.15.150:6831","nonce":31297}]},"public_addr":"172.21.15.150:6820/31297","cluster_addr":"172.21.15.150:6827/31297","heartbeat_back_addr":"172.21.15.150:6833/31297","heartbeat_front_addr":"172.21.15.150:6831/31297","state":["exists","up"]},{"osd":7,"uuid":"970b7d02-a189-41b2-96e5-a5a5a57c6476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":31296},{"type":"v1","addr":"172.21.15.150:6812","nonce":31296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":31296},{"type":"v1","addr":"172.21.15.150:6818","nonce":31296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":31296},{"type":"v1","addr":"172.21.15.150:6829","nonce":31296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":31296},{"type":"v1","addr":"172.21.15.150:6824","nonce":31296}]},"public_addr":"172.21.15.150:6812/31296","cluster_addr":"172.21.15.150:6818/31296","heartbeat_back_addr":"172.21.15.150:6829/31296","heartbeat_front_addr":"172.21.15.150:6824/31296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.664300+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.644253+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.651120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.584978+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.561149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.661778+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T17:48:17.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.461+0000 7f584f59e700 1 -- 172.21.15.38:0/4069562396 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f583404d660 msgr2=0x7f583404fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.461+0000 7f584f59e700 1 --2- 172.21.15.38:0/4069562396 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f583404d660 0x7f583404fb20 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f58400032b0 tx=0x7f58400081e0).stop 2020-06-12T17:48:17.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.461+0000 7f584f59e700 1 -- 172.21.15.38:0/4069562396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58501363e0 msgr2=0x7f5850063900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.461+0000 7f584f59e700 1 --2- 172.21.15.38:0/4069562396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58501363e0 0x7f5850063900 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f5848001930 tx=0x7f58500b1e20).stop 2020-06-12T17:48:17.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.461+0000 7f584f59e700 1 -- 172.21.15.38:0/4069562396 shutdown_connections 2020-06-12T17:48:17.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.461+0000 7f584f59e700 1 --2- 172.21.15.38:0/4069562396 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f583404d660 0x7f583404fb20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:17.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.461+0000 7f584f59e700 1 --2- 172.21.15.38:0/4069562396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58501363e0 0x7f5850063900 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:17.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.461+0000 7f584f59e700 1 --2- 172.21.15.38:0/4069562396 >> v2:172.21.15.150:3300/0 conn(0x7f5850139a70 0x7f58500b4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:17.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.461+0000 7f584f59e700 1 --2- 172.21.15.38:0/4069562396 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58500b4e90 0x7f5850135f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:17.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.461+0000 7f584f59e700 1 -- 172.21.15.38:0/4069562396 >> 172.21.15.38:0/4069562396 conn(0x7f585005fa60 msgr2=0x7f58500afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:17.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.461+0000 7f584f59e700 1 -- 172.21.15.38:0/4069562396 shutdown_connections 2020-06-12T17:48:17.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.461+0000 7f584f59e700 1 -- 172.21.15.38:0/4069562396 wait complete. 2020-06-12T17:48:17.474 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-06-12T17:47:57.558119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-06-12T17:48:07.419264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-06-12T17:48:09.934098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-06-12T17:48:12.497229+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-06-12T17:48:17.475 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-06-12T17:48:17.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.632+0000 7f473255c700 1 Processor -- start 2020-06-12T17:48:17.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.632+0000 7f473255c700 1 -- start start 2020-06-12T17:48:17.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.633+0000 7f473255c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f472c0b3ac0 0x7f472c09df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:17.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.633+0000 7f473255c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f472c142e90 0x7f472c13bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:17.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.633+0000 7f473255c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f472c09b960 con 0x7f472c13c3a0 2020-06-12T17:48:17.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.633+0000 7f473255c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f472c0b35c0 con 0x7f472c0b3ac0 2020-06-12T17:48:17.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.633+0000 7f473255c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472c09bc00 con 0x7f472c142e90 2020-06-12T17:48:17.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.633+0000 7f472bfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f472c0b3ac0 0x7f472c09df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.633+0000 7f472b7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f472c142e90 0x7f472c13bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.633+0000 7f4730af9700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f472c13c3a0 0x7f472c0b2eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:58066/0 (socket says 172.21.15.38:58066) 2020-06-12T17:48:17.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.633+0000 7f472bfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f472c0b3ac0 0x7f472c09df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:44990/0 (socket says 172.21.15.38:44990) 2020-06-12T17:48:17.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.633+0000 7f472b7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f472c142e90 0x7f472c13bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:54974/0 (socket says 172.21.15.38:54974) 2020-06-12T17:48:17.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.633+0000 7f4730af9700 1 -- 172.21.15.38:0/618910445 learned_addr learned my addr 172.21.15.38:0/618910445 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:17.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.633+0000 7f472b7fe700 1 -- 172.21.15.38:0/618910445 >> v2:172.21.15.150:3300/0 conn(0x7f472c0b3ac0 msgr2=0x7f472c09df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:17.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.633+0000 7f472b7fe700 1 --2- 172.21.15.38:0/618910445 >> v2:172.21.15.150:3300/0 conn(0x7f472c0b3ac0 0x7f472c09df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:17.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.633+0000 7f472b7fe700 1 -- 172.21.15.38:0/618910445 >> v1:172.21.15.150:6789/0 conn(0x7f472c13c3a0 legacy=0x7f472c0b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.633+0000 7f472affd700 1 -- 172.21.15.38:0/618910445 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2479785639 0 0) 0x7f472c09b960 con 0x7f472c13c3a0 2020-06-12T17:48:17.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.634+0000 7f472b7fe700 1 -- 172.21.15.38:0/618910445 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472c0b48f0 con 0x7f472c142e90 2020-06-12T17:48:17.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.634+0000 7f472bfff700 1 --2- 172.21.15.38:0/618910445 >> v2:172.21.15.150:3300/0 conn(0x7f472c0b3ac0 0x7f472c09df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:17.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.634+0000 7f472b7fe700 1 --2- 172.21.15.38:0/618910445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f472c142e90 0x7f472c13bf40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4720002f30 tx=0x7f4720007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.634+0000 7f472b7fe700 1 --2- 172.21.15.38:0/618910445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f472c142e90 0x7f472c13bf40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4720002f30 tx=0x7f4720007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.634+0000 7f472b7fe700 1 --2- 172.21.15.38:0/618910445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f472c142e90 0x7f472c13bf40 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f4720002f30 tx=0x7f4720007e60).ready entity=mon.2 client_cookie=a93d7fe6643ca6eb server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:17.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.634+0000 7f472b7fe700 1 --2- 172.21.15.38:0/618910445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f472c142e90 0x7f472c13bf40 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f4720002f30 tx=0x7f4720007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.634+0000 7f472affd700 1 -- 172.21.15.38:0/618910445 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4720011380 con 0x7f472c142e90 2020-06-12T17:48:17.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.634+0000 7f472b7fe700 1 --2- 172.21.15.38:0/618910445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f472c142e90 0x7f472c13bf40 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f4720002f30 tx=0x7f4720007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.634+0000 7f472affd700 1 -- 172.21.15.38:0/618910445 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47200114e0 con 0x7f472c142e90 2020-06-12T17:48:17.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.634+0000 7f472b7fe700 1 --2- 172.21.15.38:0/618910445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f472c142e90 0x7f472c13bf40 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f4720002f30 tx=0x7f4720007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.634+0000 7f473255c700 1 -- 172.21.15.38:0/618910445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f472c142e90 msgr2=0x7f472c13bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.634+0000 7f472affd700 1 -- 172.21.15.38:0/618910445 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47200118c0 con 0x7f472c142e90 2020-06-12T17:48:17.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.634+0000 7f473255c700 1 --2- 172.21.15.38:0/618910445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f472c142e90 0x7f472c13bf40 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f4720002f30 tx=0x7f4720007e60).stop 2020-06-12T17:48:17.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.634+0000 7f473255c700 1 -- 172.21.15.38:0/618910445 shutdown_connections 2020-06-12T17:48:17.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.634+0000 7f473255c700 1 --2- 172.21.15.38:0/618910445 >> v2:172.21.15.150:3300/0 conn(0x7f472c0b3ac0 0x7f472c09df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:17.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.634+0000 7f473255c700 1 --2- 172.21.15.38:0/618910445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f472c142e90 0x7f472c13bf40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:17.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.634+0000 7f473255c700 1 -- 172.21.15.38:0/618910445 >> 172.21.15.38:0/618910445 conn(0x7f472c0b5a20 msgr2=0x7f472c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:17.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.634+0000 7f473255c700 1 -- 172.21.15.38:0/618910445 shutdown_connections 2020-06-12T17:48:17.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.634+0000 7f473255c700 1 -- 172.21.15.38:0/618910445 wait complete. 2020-06-12T17:48:17.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.635+0000 7f473255c700 1 Processor -- start 2020-06-12T17:48:17.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.635+0000 7f473255c700 1 -- start start 2020-06-12T17:48:17.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.636+0000 7f473255c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f472c13c3a0 0x7f472c0b2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:17.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.636+0000 7f473255c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f472c142e90 0x7f472c066a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:17.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.636+0000 7f473255c700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f472c0b2990 con 0x7f472c0b3ac0 2020-06-12T17:48:17.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.636+0000 7f473255c700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f472c1460c0 con 0x7f472c13c3a0 2020-06-12T17:48:17.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.636+0000 7f473255c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472c0b15a0 con 0x7f472c142e90 2020-06-12T17:48:17.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.636+0000 7f472b7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f472c13c3a0 0x7f472c0b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.636+0000 7f472b7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f472c13c3a0 0x7f472c0b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35522/0 (socket says 172.21.15.38:35522) 2020-06-12T17:48:17.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.636+0000 7f472b7fe700 1 -- 172.21.15.38:0/3587295117 learned_addr learned my addr 172.21.15.38:0/3587295117 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:17.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.636+0000 7f472bfff700 1 --1- 172.21.15.38:0/3587295117 >> v1:172.21.15.38:6789/0 conn(0x7f472c0b3ac0 0x7f472c1459b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37336/0 (socket says 172.21.15.38:37336) 2020-06-12T17:48:17.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.636+0000 7f4730af9700 1 --2- 172.21.15.38:0/3587295117 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f472c142e90 0x7f472c066a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.637+0000 7f472b7fe700 1 -- 172.21.15.38:0/3587295117 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f472c142e90 msgr2=0x7f472c066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.637+0000 7f472b7fe700 1 --2- 172.21.15.38:0/3587295117 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f472c142e90 0x7f472c066a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:17.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.637+0000 7f472b7fe700 1 -- 172.21.15.38:0/3587295117 >> v1:172.21.15.38:6789/0 conn(0x7f472c0b3ac0 legacy=0x7f472c1459b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.637+0000 7f472b7fe700 1 -- 172.21.15.38:0/3587295117 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472c0b1840 con 0x7f472c13c3a0 2020-06-12T17:48:17.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.637+0000 7f47297fa700 1 -- 172.21.15.38:0/3587295117 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 716825377 0 0) 0x7f471c001ec0 con 0x7f472c0b3ac0 2020-06-12T17:48:17.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.637+0000 7f472b7fe700 1 --2- 172.21.15.38:0/3587295117 >> v2:172.21.15.38:3300/0 conn(0x7f472c13c3a0 0x7f472c0b2530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4720002f30 tx=0x7f4720007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.637+0000 7f472b7fe700 1 --2- 172.21.15.38:0/3587295117 >> v2:172.21.15.38:3300/0 conn(0x7f472c13c3a0 0x7f472c0b2530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4720002f30 tx=0x7f4720007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.637+0000 7f472b7fe700 1 --2- 172.21.15.38:0/3587295117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f472c13c3a0 0x7f472c0b2530 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f4720002f30 tx=0x7f4720007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:17.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.637+0000 7f472b7fe700 1 --2- 172.21.15.38:0/3587295117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f472c13c3a0 0x7f472c0b2530 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f4720002f30 tx=0x7f4720007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.637+0000 7f47297fa700 1 -- 172.21.15.38:0/3587295117 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4720011880 con 0x7f472c13c3a0 2020-06-12T17:48:17.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.637+0000 7f472b7fe700 1 --2- 172.21.15.38:0/3587295117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f472c13c3a0 0x7f472c0b2530 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f4720002f30 tx=0x7f4720007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.637+0000 7f47297fa700 1 -- 172.21.15.38:0/3587295117 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4720007150 con 0x7f472c13c3a0 2020-06-12T17:48:17.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.637+0000 7f472b7fe700 1 --2- 172.21.15.38:0/3587295117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f472c13c3a0 0x7f472c0b2530 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f4720002f30 tx=0x7f4720007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.637+0000 7f473255c700 1 -- 172.21.15.38:0/3587295117 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f472c0b1ae0 con 0x7f472c13c3a0 2020-06-12T17:48:17.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.637+0000 7f47297fa700 1 -- 172.21.15.38:0/3587295117 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47200074b0 con 0x7f472c13c3a0 2020-06-12T17:48:17.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.637+0000 7f473255c700 1 -- 172.21.15.38:0/3587295117 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472c1455a0 con 0x7f472c13c3a0 2020-06-12T17:48:17.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.638+0000 7f472b7fe700 1 --2- 172.21.15.38:0/3587295117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f472c13c3a0 0x7f472c0b2530 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f4720002f30 tx=0x7f4720007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.638+0000 7f473255c700 1 -- 172.21.15.38:0/3587295117 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f472c0672d0 con 0x7f472c13c3a0 2020-06-12T17:48:17.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.638+0000 7f47297fa700 1 -- 172.21.15.38:0/3587295117 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f47200080a0 con 0x7f472c13c3a0 2020-06-12T17:48:17.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.638+0000 7f472b7fe700 1 --2- 172.21.15.38:0/3587295117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f472c13c3a0 0x7f472c0b2530 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f4720002f30 tx=0x7f4720007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.638+0000 7f47297fa700 1 --2- 172.21.15.38:0/3587295117 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f470c04d350 0x7f470c04f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:17.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.638+0000 7f47297fa700 1 -- 172.21.15.38:0/3587295117 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f4720061490 con 0x7f472c13c3a0 2020-06-12T17:48:17.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.638+0000 7f472bfff700 1 --2- 172.21.15.38:0/3587295117 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f470c04d350 0x7f470c04f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.639+0000 7f472bfff700 1 --2- 172.21.15.38:0/3587295117 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f470c04d350 0x7f470c04f810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f471c002ef0 tx=0x7f471c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.639+0000 7f472bfff700 1 --2- 172.21.15.38:0/3587295117 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f470c04d350 0x7f470c04f810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f471c002ef0 tx=0x7f471c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.639+0000 7f472bfff700 1 --2- 172.21.15.38:0/3587295117 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f470c04d350 0x7f470c04f810 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f471c002ef0 tx=0x7f471c007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:17.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.642+0000 7f472b7fe700 1 --2- 172.21.15.38:0/3587295117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f472c13c3a0 0x7f472c0b2530 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f4720002f30 tx=0x7f4720007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.642+0000 7f47297fa700 1 -- 172.21.15.38:0/3587295117 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f472003cc90 con 0x7f472c13c3a0 2020-06-12T17:48:17.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.791+0000 7f473255c700 1 -- 172.21.15.38:0/3587295117 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f472c056c30 con 0x7f472c13c3a0 2020-06-12T17:48:17.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.791+0000 7f472b7fe700 1 --2- 172.21.15.38:0/3587295117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f472c13c3a0 0x7f472c0b2530 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f4720002f30 tx=0x7f4720007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.791+0000 7f47297fa700 1 -- 172.21.15.38:0/3587295117 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7f47200402b0 con 0x7f472c13c3a0 2020-06-12T17:48:17.796 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2020-06-12T17:48:17.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.793+0000 7f473255c700 1 -- 172.21.15.38:0/3587295117 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f470c04d350 msgr2=0x7f470c04f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.793+0000 7f473255c700 1 --2- 172.21.15.38:0/3587295117 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f470c04d350 0x7f470c04f810 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f471c002ef0 tx=0x7f471c007e60).stop 2020-06-12T17:48:17.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.793+0000 7f473255c700 1 -- 172.21.15.38:0/3587295117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f472c13c3a0 msgr2=0x7f472c0b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.793+0000 7f473255c700 1 --2- 172.21.15.38:0/3587295117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f472c13c3a0 0x7f472c0b2530 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f4720002f30 tx=0x7f4720007e60).stop 2020-06-12T17:48:17.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.793+0000 7f473255c700 1 -- 172.21.15.38:0/3587295117 shutdown_connections 2020-06-12T17:48:17.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.793+0000 7f473255c700 1 --2- 172.21.15.38:0/3587295117 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f470c04d350 0x7f470c04f810 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:17.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.793+0000 7f473255c700 1 --2- 172.21.15.38:0/3587295117 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f472c142e90 0x7f472c066a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:17.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.793+0000 7f473255c700 1 --2- 172.21.15.38:0/3587295117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f472c13c3a0 0x7f472c0b2530 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:17.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.793+0000 7f473255c700 1 -- 172.21.15.38:0/3587295117 >> 172.21.15.38:0/3587295117 conn(0x7f472c0b5a20 msgr2=0x7f472c0b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:17.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.793+0000 7f473255c700 1 -- 172.21.15.38:0/3587295117 shutdown_connections 2020-06-12T17:48:17.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.793+0000 7f473255c700 1 -- 172.21.15.38:0/3587295117 wait complete. 2020-06-12T17:48:17.807 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-06-12T17:48:17.939 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.922+0000 7f301df1d700 1 Processor -- start 2020-06-12T17:48:17.940 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.922+0000 7f301df1d700 1 -- start start 2020-06-12T17:48:17.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.923+0000 7f301df1d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f30180ad5b0 0x7f30180b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:17.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.923+0000 7f301df1d700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3018146d20 con 0x7f3018146680 2020-06-12T17:48:17.942 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.923+0000 7f301df1d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3018066a80 con 0x7f301809d8d0 2020-06-12T17:48:17.942 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.923+0000 7f301df1d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3018146f50 con 0x7f30180ad5b0 2020-06-12T17:48:17.942 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.923+0000 7f30177fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f3018146680 0x7f301809d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37344/0 (socket says 172.21.15.38:37344) 2020-06-12T17:48:17.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.923+0000 7f30177fe700 1 -- 172.21.15.38:0/2816318860 learned_addr learned my addr 172.21.15.38:0/2816318860 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:17.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.923+0000 7f300ffff700 1 --2- 172.21.15.38:0/2816318860 >> v2:172.21.15.150:3300/0 conn(0x7f30180ad5b0 0x7f30180b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.923+0000 7f3016ffd700 1 -- 172.21.15.38:0/2816318860 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3441551912 0 0) 0x7f3018146d20 con 0x7f3018146680 2020-06-12T17:48:17.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.923+0000 7f3016ffd700 1 -- 172.21.15.38:0/2816318860 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ff8003230 con 0x7f3018146680 2020-06-12T17:48:17.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.923+0000 7f3016ffd700 1 -- 172.21.15.38:0/2816318860 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4190761370 0 0) 0x7f2ff8003230 con 0x7f3018146680 2020-06-12T17:48:17.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.923+0000 7f3016ffd700 1 -- 172.21.15.38:0/2816318860 >> v2:172.21.15.150:3300/0 conn(0x7f30180ad5b0 msgr2=0x7f30180b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:17.946 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.923+0000 7f3016ffd700 1 --2- 172.21.15.38:0/2816318860 >> v2:172.21.15.150:3300/0 conn(0x7f30180ad5b0 0x7f30180b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:17.946 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.923+0000 7f3016ffd700 1 -- 172.21.15.38:0/2816318860 >> v1:172.21.15.150:6789/0 conn(0x7f301809d8d0 legacy=0x7f30181421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.946 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.923+0000 7f3016ffd700 1 -- 172.21.15.38:0/2816318860 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3018146a60 con 0x7f3018146680 2020-06-12T17:48:17.946 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.923+0000 7f3016ffd700 1 -- 172.21.15.38:0/2816318860 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f30080016d0 con 0x7f3018146680 2020-06-12T17:48:17.946 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.923+0000 7f3016ffd700 1 -- 172.21.15.38:0/2816318860 >> v1:172.21.15.38:6789/0 conn(0x7f3018146680 legacy=0x7f301809d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.923+0000 7f3016ffd700 1 --2- 172.21.15.38:0/2816318860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ff8003720 0x7f2ff8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:17.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.923+0000 7f3016ffd700 1 --2- 172.21.15.38:0/2816318860 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ff80044d0 0x7f2ff8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:17.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.923+0000 7f3016ffd700 1 --2- 172.21.15.38:0/2816318860 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff8004db0 0x7f2ff800d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:17.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.923+0000 7f3016ffd700 1 -- 172.21.15.38:0/2816318860 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3018146f50 con 0x7f2ff80044d0 2020-06-12T17:48:17.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.923+0000 7f3016ffd700 1 -- 172.21.15.38:0/2816318860 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff80041c0 con 0x7f2ff8003720 2020-06-12T17:48:17.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.923+0000 7f3016ffd700 1 -- 172.21.15.38:0/2816318860 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff800dd90 con 0x7f2ff8004db0 2020-06-12T17:48:17.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.923+0000 7f300ffff700 1 --2- 172.21.15.38:0/2816318860 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ff80044d0 0x7f2ff8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.923+0000 7f30177fe700 1 --2- 172.21.15.38:0/2816318860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ff8003720 0x7f2ff8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.924+0000 7f3017fff700 1 --2- 172.21.15.38:0/2816318860 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff8004db0 0x7f2ff800d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.924+0000 7f300ffff700 1 -- 172.21.15.38:0/2816318860 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff8004db0 msgr2=0x7f2ff800d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:17.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.924+0000 7f300ffff700 1 --2- 172.21.15.38:0/2816318860 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff8004db0 0x7f2ff800d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:17.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.924+0000 7f300ffff700 1 -- 172.21.15.38:0/2816318860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ff8003720 msgr2=0x7f2ff8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:17.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.924+0000 7f300ffff700 1 --2- 172.21.15.38:0/2816318860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ff8003720 0x7f2ff8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:17.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.924+0000 7f300ffff700 1 -- 172.21.15.38:0/2816318860 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff8003230 con 0x7f2ff80044d0 2020-06-12T17:48:17.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.924+0000 7f3017fff700 1 -- 172.21.15.38:0/2816318860 reap_dead start 2020-06-12T17:48:17.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.924+0000 7f30177fe700 1 --2- 172.21.15.38:0/2816318860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ff8003720 0x7f2ff8003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:17.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.924+0000 7f300ffff700 1 --2- 172.21.15.38:0/2816318860 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ff80044d0 0x7f2ff8004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3000002f30 tx=0x7f3000007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.924+0000 7f300ffff700 1 --2- 172.21.15.38:0/2816318860 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ff80044d0 0x7f2ff8004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3000002f30 tx=0x7f3000007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.924+0000 7f300ffff700 1 --2- 172.21.15.38:0/2816318860 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ff80044d0 0x7f2ff8004950 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f3000002f30 tx=0x7f3000007e60).ready entity=mon.0 client_cookie=99f640f7846fd783 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:17.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.924+0000 7f300ffff700 1 --2- 172.21.15.38:0/2816318860 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ff80044d0 0x7f2ff8004950 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f3000002f30 tx=0x7f3000007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.924+0000 7f3016ffd700 1 -- 172.21.15.38:0/2816318860 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3000008d30 con 0x7f2ff80044d0 2020-06-12T17:48:17.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.924+0000 7f300ffff700 1 --2- 172.21.15.38:0/2816318860 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ff80044d0 0x7f2ff8004950 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f3000002f30 tx=0x7f3000007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.924+0000 7f300ffff700 1 --2- 172.21.15.38:0/2816318860 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ff80044d0 0x7f2ff8004950 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f3000002f30 tx=0x7f3000007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.924+0000 7f3016ffd700 1 -- 172.21.15.38:0/2816318860 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3000008e90 con 0x7f2ff80044d0 2020-06-12T17:48:17.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.924+0000 7f3016ffd700 1 -- 172.21.15.38:0/2816318860 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30000109f0 con 0x7f2ff80044d0 2020-06-12T17:48:17.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.924+0000 7f301df1d700 1 -- 172.21.15.38:0/2816318860 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ff80044d0 msgr2=0x7f2ff8004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.924+0000 7f301df1d700 1 --2- 172.21.15.38:0/2816318860 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ff80044d0 0x7f2ff8004950 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f3000002f30 tx=0x7f3000007e60).stop 2020-06-12T17:48:17.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.924+0000 7f301df1d700 1 -- 172.21.15.38:0/2816318860 shutdown_connections 2020-06-12T17:48:17.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.924+0000 7f301df1d700 1 --2- 172.21.15.38:0/2816318860 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ff80044d0 0x7f2ff8004950 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:17.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.924+0000 7f301df1d700 1 -- 172.21.15.38:0/2816318860 >> 172.21.15.38:0/2816318860 conn(0x7f30180b5a20 msgr2=0x7f301805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:17.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.925+0000 7f301df1d700 1 -- 172.21.15.38:0/2816318860 shutdown_connections 2020-06-12T17:48:17.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.925+0000 7f301df1d700 1 -- 172.21.15.38:0/2816318860 wait complete. 2020-06-12T17:48:17.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.925+0000 7f301df1d700 1 Processor -- start 2020-06-12T17:48:17.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.926+0000 7f301df1d700 1 -- start start 2020-06-12T17:48:17.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.926+0000 7f301df1d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff80044d0 0x7f3018150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:17.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.926+0000 7f301df1d700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f301813a310 con 0x7f3018153440 2020-06-12T17:48:17.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.926+0000 7f301df1d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30181578a0 con 0x7f3018157420 2020-06-12T17:48:17.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.926+0000 7f301df1d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f301813e640 con 0x7f2ff80044d0 2020-06-12T17:48:17.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.926+0000 7f3017fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f3018153440 0x7f3018153850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37360/0 (socket says 172.21.15.38:37360) 2020-06-12T17:48:17.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.926+0000 7f3017fff700 1 -- 172.21.15.38:0/173123142 learned_addr learned my addr 172.21.15.38:0/173123142 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:17.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.926+0000 7f30177fe700 1 --2- 172.21.15.38:0/173123142 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff80044d0 0x7f3018150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.926+0000 7f30157fa700 1 -- 172.21.15.38:0/173123142 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893806706 0 0) 0x7f301813a310 con 0x7f3018153440 2020-06-12T17:48:17.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.926+0000 7f30157fa700 1 -- 172.21.15.38:0/173123142 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ffc002fe0 con 0x7f3018153440 2020-06-12T17:48:17.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.927+0000 7f30157fa700 1 -- 172.21.15.38:0/173123142 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964589571 0 0) 0x7f30181578a0 con 0x7f3018157420 2020-06-12T17:48:17.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.927+0000 7f30177fe700 1 -- 172.21.15.38:0/173123142 >> v1:172.21.15.150:6789/0 conn(0x7f3018157420 legacy=0x7f3018065810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.927+0000 7f30177fe700 1 -- 172.21.15.38:0/173123142 >> v1:172.21.15.38:6789/0 conn(0x7f3018153440 legacy=0x7f3018153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:17.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.927+0000 7f30177fe700 1 -- 172.21.15.38:0/173123142 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301813e8e0 con 0x7f2ff80044d0 2020-06-12T17:48:17.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.927+0000 7f30177fe700 1 --2- 172.21.15.38:0/173123142 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff80044d0 0x7f3018150ae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f30080013e0 tx=0x7f30180aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.927+0000 7f30177fe700 1 --2- 172.21.15.38:0/173123142 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff80044d0 0x7f3018150ae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f30080013e0 tx=0x7f30180aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.927+0000 7f30177fe700 1 --2- 172.21.15.38:0/173123142 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff80044d0 0x7f3018150ae0 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f30080013e0 tx=0x7f30180aec70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:17.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.927+0000 7f30177fe700 1 --2- 172.21.15.38:0/173123142 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff80044d0 0x7f3018150ae0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f30080013e0 tx=0x7f30180aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.927+0000 7f30157fa700 1 -- 172.21.15.38:0/173123142 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3008011dc0 con 0x7f2ff80044d0 2020-06-12T17:48:17.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.927+0000 7f30177fe700 1 --2- 172.21.15.38:0/173123142 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff80044d0 0x7f3018150ae0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f30080013e0 tx=0x7f30180aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.927+0000 7f30177fe700 1 --2- 172.21.15.38:0/173123142 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff80044d0 0x7f3018150ae0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f30080013e0 tx=0x7f30180aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.927+0000 7f30157fa700 1 -- 172.21.15.38:0/173123142 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300800e960 con 0x7f2ff80044d0 2020-06-12T17:48:17.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.927+0000 7f301df1d700 1 -- 172.21.15.38:0/173123142 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f301813eb80 con 0x7f2ff80044d0 2020-06-12T17:48:17.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.927+0000 7f30157fa700 1 -- 172.21.15.38:0/173123142 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f300800ecc0 con 0x7f2ff80044d0 2020-06-12T17:48:17.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.927+0000 7f301df1d700 1 -- 172.21.15.38:0/173123142 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30180b2b40 con 0x7f2ff80044d0 2020-06-12T17:48:17.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.928+0000 7f30177fe700 1 --2- 172.21.15.38:0/173123142 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff80044d0 0x7f3018150ae0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f30080013e0 tx=0x7f30180aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.928+0000 7f301df1d700 1 -- 172.21.15.38:0/173123142 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3018154730 con 0x7f2ff80044d0 2020-06-12T17:48:17.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.928+0000 7f30157fa700 1 -- 172.21.15.38:0/173123142 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f30080044f0 con 0x7f2ff80044d0 2020-06-12T17:48:17.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.928+0000 7f30177fe700 1 --2- 172.21.15.38:0/173123142 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff80044d0 0x7f3018150ae0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f30080013e0 tx=0x7f30180aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.928+0000 7f30157fa700 1 --2- 172.21.15.38:0/173123142 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2ffc04d840 0x7f2ffc04fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:17.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.928+0000 7f30157fa700 1 -- 172.21.15.38:0/173123142 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f3008060c70 con 0x7f2ff80044d0 2020-06-12T17:48:17.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.928+0000 7f300ffff700 1 --2- 172.21.15.38:0/173123142 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2ffc04d840 0x7f2ffc04fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:17.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.929+0000 7f300ffff700 1 --2- 172.21.15.38:0/173123142 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2ffc04d840 0x7f2ffc04fd00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f30000083f0 tx=0x7f3000007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.929+0000 7f300ffff700 1 --2- 172.21.15.38:0/173123142 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2ffc04d840 0x7f2ffc04fd00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f30000083f0 tx=0x7f3000007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.962 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.929+0000 7f300ffff700 1 --2- 172.21.15.38:0/173123142 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2ffc04d840 0x7f2ffc04fd00 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f30000083f0 tx=0x7f3000007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:17.962 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.932+0000 7f30177fe700 1 --2- 172.21.15.38:0/173123142 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff80044d0 0x7f3018150ae0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f30080013e0 tx=0x7f30180aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:17.962 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:17.932+0000 7f30157fa700 1 -- 172.21.15.38:0/173123142 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f300803c350 con 0x7f2ff80044d0 2020-06-12T17:48:18.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.083+0000 7f301df1d700 1 -- 172.21.15.38:0/173123142 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f301813e480 con 0x7f2ff80044d0 2020-06-12T17:48:18.088 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.084+0000 7f30177fe700 1 --2- 172.21.15.38:0/173123142 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff80044d0 0x7f3018150ae0 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7f30080013e0 tx=0x7f30180aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.088 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.084+0000 7f30157fa700 1 -- 172.21.15.38:0/173123142 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f300803f970 con 0x7f2ff80044d0 2020-06-12T17:48:18.088 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:18.089 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.085+0000 7f301df1d700 1 -- 172.21.15.38:0/173123142 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2ffc04d840 msgr2=0x7f2ffc04fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:18.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.085+0000 7f301df1d700 1 --2- 172.21.15.38:0/173123142 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2ffc04d840 0x7f2ffc04fd00 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f30000083f0 tx=0x7f3000007e60).stop 2020-06-12T17:48:18.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.085+0000 7f301df1d700 1 -- 172.21.15.38:0/173123142 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff80044d0 msgr2=0x7f3018150ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:18.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.085+0000 7f301df1d700 1 --2- 172.21.15.38:0/173123142 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff80044d0 0x7f3018150ae0 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7f30080013e0 tx=0x7f30180aec70).stop 2020-06-12T17:48:18.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.086+0000 7f301df1d700 1 -- 172.21.15.38:0/173123142 shutdown_connections 2020-06-12T17:48:18.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.086+0000 7f301df1d700 1 --2- 172.21.15.38:0/173123142 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2ffc04d840 0x7f2ffc04fd00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:18.091 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.086+0000 7f301df1d700 1 --2- 172.21.15.38:0/173123142 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff80044d0 0x7f3018150ae0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:18.091 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.086+0000 7f301df1d700 1 -- 172.21.15.38:0/173123142 >> 172.21.15.38:0/173123142 conn(0x7f30180b5a20 msgr2=0x7f301813db50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:18.091 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.086+0000 7f301df1d700 1 -- 172.21.15.38:0/173123142 shutdown_connections 2020-06-12T17:48:18.091 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.086+0000 7f301df1d700 1 -- 172.21.15.38:0/173123142 wait complete. 2020-06-12T17:48:18.099 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-06-12T17:48:18.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.213+0000 7f829d7a1700 1 Processor -- start 2020-06-12T17:48:18.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.213+0000 7f829d7a1700 1 -- start start 2020-06-12T17:48:18.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.213+0000 7f829d7a1700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f82980b15c0 0x7f82980b2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:18.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.214+0000 7f829d7a1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82980afc20 0x7f82980b0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:18.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.214+0000 7f829d7a1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82980b2900 con 0x7f82980b11e0 2020-06-12T17:48:18.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.214+0000 7f829d7a1700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82980ae7d0 con 0x7f82980b15c0 2020-06-12T17:48:18.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.214+0000 7f829d7a1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82980b1ad0 con 0x7f82980afc20 2020-06-12T17:48:18.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.214+0000 7f82977fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f82980b15c0 0x7f82980b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:18.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.214+0000 7f82977fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f82980b15c0 0x7f82980b2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35548/0 (socket says 172.21.15.38:35548) 2020-06-12T17:48:18.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.214+0000 7f82977fe700 1 -- 172.21.15.38:0/3800963663 learned_addr learned my addr 172.21.15.38:0/3800963663 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:18.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.214+0000 7f829cfa0700 1 --2- 172.21.15.38:0/3800963663 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82980afc20 0x7f82980b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:18.222 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.214+0000 7f82977fe700 1 -- 172.21.15.38:0/3800963663 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82980afc20 msgr2=0x7f82980b0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:18.222 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.214+0000 7f82977fe700 1 --2- 172.21.15.38:0/3800963663 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82980afc20 0x7f82980b0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:18.222 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.214+0000 7f82977fe700 1 -- 172.21.15.38:0/3800963663 >> v1:172.21.15.150:6789/0 conn(0x7f82980b11e0 legacy=0x7f82980ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:18.222 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.214+0000 7f82977fe700 1 -- 172.21.15.38:0/3800963663 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82980b1d70 con 0x7f82980b15c0 2020-06-12T17:48:18.222 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.214+0000 7f82977fe700 1 --2- 172.21.15.38:0/3800963663 >> v2:172.21.15.38:3300/0 conn(0x7f82980b15c0 0x7f82980b2380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f828c002f30 tx=0x7f828c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.214+0000 7f82977fe700 1 --2- 172.21.15.38:0/3800963663 >> v2:172.21.15.38:3300/0 conn(0x7f82980b15c0 0x7f82980b2380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f828c002f30 tx=0x7f828c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.214+0000 7f82977fe700 1 --2- 172.21.15.38:0/3800963663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82980b15c0 0x7f82980b2380 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f828c002f30 tx=0x7f828c007e60).ready entity=mon.0 client_cookie=8089230fd497605e server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:18.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.214+0000 7f82977fe700 1 --2- 172.21.15.38:0/3800963663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82980b15c0 0x7f82980b2380 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f828c002f30 tx=0x7f828c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.214+0000 7f8296ffd700 1 -- 172.21.15.38:0/3800963663 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f828c011630 con 0x7f82980b15c0 2020-06-12T17:48:18.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.214+0000 7f82977fe700 1 --2- 172.21.15.38:0/3800963663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82980b15c0 0x7f82980b2380 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f828c002f30 tx=0x7f828c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.224 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.214+0000 7f82977fe700 1 --2- 172.21.15.38:0/3800963663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82980b15c0 0x7f82980b2380 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f828c002f30 tx=0x7f828c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.224 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.214+0000 7f8296ffd700 1 -- 172.21.15.38:0/3800963663 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c011790 con 0x7f82980b15c0 2020-06-12T17:48:18.224 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.214+0000 7f8296ffd700 1 -- 172.21.15.38:0/3800963663 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f828c011bb0 con 0x7f82980b15c0 2020-06-12T17:48:18.224 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.214+0000 7f829d7a1700 1 -- 172.21.15.38:0/3800963663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82980b15c0 msgr2=0x7f82980b2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:18.224 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.214+0000 7f829d7a1700 1 --2- 172.21.15.38:0/3800963663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82980b15c0 0x7f82980b2380 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f828c002f30 tx=0x7f828c007e60).stop 2020-06-12T17:48:18.225 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.215+0000 7f829d7a1700 1 -- 172.21.15.38:0/3800963663 shutdown_connections 2020-06-12T17:48:18.225 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.215+0000 7f829d7a1700 1 --2- 172.21.15.38:0/3800963663 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82980afc20 0x7f82980b0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:18.225 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.215+0000 7f829d7a1700 1 --2- 172.21.15.38:0/3800963663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82980b15c0 0x7f82980b2380 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:18.225 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.215+0000 7f829d7a1700 1 -- 172.21.15.38:0/3800963663 >> 172.21.15.38:0/3800963663 conn(0x7f82980b4cc0 msgr2=0x7f82980b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:18.225 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.215+0000 7f829d7a1700 1 -- 172.21.15.38:0/3800963663 shutdown_connections 2020-06-12T17:48:18.226 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.215+0000 7f829d7a1700 1 -- 172.21.15.38:0/3800963663 wait complete. 2020-06-12T17:48:18.226 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.216+0000 7f829d7a1700 1 Processor -- start 2020-06-12T17:48:18.226 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.216+0000 7f829d7a1700 1 -- start start 2020-06-12T17:48:18.230 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.217+0000 7f829d7a1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82980b11e0 0x7f82981568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:18.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.217+0000 7f829d7a1700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8298115820 con 0x7f82980b15c0 2020-06-12T17:48:18.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.217+0000 7f829d7a1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8298115ac0 con 0x7f82980afc20 2020-06-12T17:48:18.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.217+0000 7f829d7a1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8298115d60 con 0x7f82980b11e0 2020-06-12T17:48:18.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.217+0000 7f829cfa0700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f82980b15c0 0x7f8298062bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37370/0 (socket says 172.21.15.38:37370) 2020-06-12T17:48:18.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.217+0000 7f829cfa0700 1 -- 172.21.15.38:0/307183670 learned_addr learned my addr 172.21.15.38:0/307183670 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:18.232 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.217+0000 7f82957fa700 1 -- 172.21.15.38:0/307183670 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1355007793 0 0) 0x7f8298115820 con 0x7f82980b15c0 2020-06-12T17:48:18.232 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.217+0000 7f82957fa700 1 -- 172.21.15.38:0/307183670 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8278002fe0 con 0x7f82980b15c0 2020-06-12T17:48:18.232 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.217+0000 7f82977fe700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82980b11e0 0x7f82981568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:18.232 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.217+0000 7f82957fa700 1 -- 172.21.15.38:0/307183670 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3270683713 0 0) 0x7f8278002fe0 con 0x7f82980b15c0 2020-06-12T17:48:18.232 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.217+0000 7f82957fa700 1 -- 172.21.15.38:0/307183670 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8298115820 con 0x7f82980b15c0 2020-06-12T17:48:18.233 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.217+0000 7f82957fa700 1 -- 172.21.15.38:0/307183670 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f8290001810 con 0x7f82980b15c0 2020-06-12T17:48:18.233 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.217+0000 7f82957fa700 1 -- 172.21.15.38:0/307183670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82980b11e0 msgr2=0x7f82981568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:18.233 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.217+0000 7f82957fa700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82980b11e0 0x7f82981568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:18.233 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.217+0000 7f82957fa700 1 -- 172.21.15.38:0/307183670 >> v1:172.21.15.150:6789/0 conn(0x7f82980afc20 legacy=0x7f82981561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:18.233 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.217+0000 7f82957fa700 1 -- 172.21.15.38:0/307183670 >> v1:172.21.15.38:6789/0 conn(0x7f82980b15c0 legacy=0x7f8298062bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:18.234 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.217+0000 7f82957fa700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82780049b0 0x7f8278004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:18.234 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.218+0000 7f82957fa700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8278005260 0x7f8278003960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:18.234 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.218+0000 7f82957fa700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82980b11e0 0x7f8278003f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:18.234 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.218+0000 7f82957fa700 1 -- 172.21.15.38:0/307183670 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8298115d60 con 0x7f8278005260 2020-06-12T17:48:18.234 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.218+0000 7f82957fa700 1 -- 172.21.15.38:0/307183670 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8278004430 con 0x7f82780049b0 2020-06-12T17:48:18.235 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.218+0000 7f82957fa700 1 -- 172.21.15.38:0/307183670 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82780045f0 con 0x7f82980b11e0 2020-06-12T17:48:18.235 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.218+0000 7f82977fe700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8278005260 0x7f8278003960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:18.235 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.218+0000 7f8297fff700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82780049b0 0x7f8278004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:18.236 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.218+0000 7f829cfa0700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82980b11e0 0x7f8278003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:18.236 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.218+0000 7f82977fe700 1 -- 172.21.15.38:0/307183670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82980b11e0 msgr2=0x7f8278003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:18.236 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.218+0000 7f82977fe700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82980b11e0 0x7f8278003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:18.236 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.218+0000 7f82977fe700 1 -- 172.21.15.38:0/307183670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82780049b0 msgr2=0x7f8278004d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:18.237 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.218+0000 7f82977fe700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82780049b0 0x7f8278004d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:18.237 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.218+0000 7f82977fe700 1 -- 172.21.15.38:0/307183670 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8298064440 con 0x7f8278005260 2020-06-12T17:48:18.237 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.218+0000 7f829d7a1700 1 -- 172.21.15.38:0/307183670 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8298064690 con 0x7f8278005260 2020-06-12T17:48:18.237 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.218+0000 7f82977fe700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8278005260 0x7f8278003960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f828c002f30 tx=0x7f828c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.237 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.218+0000 7f829d7a1700 1 -- 172.21.15.38:0/307183670 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8298156b10 con 0x7f8278005260 2020-06-12T17:48:18.238 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.218+0000 7f82977fe700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8278005260 0x7f8278003960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f828c002f30 tx=0x7f828c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.238 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.218+0000 7f82977fe700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8278005260 0x7f8278003960 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f828c002f30 tx=0x7f828c007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:18.238 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.218+0000 7f82977fe700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8278005260 0x7f8278003960 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f828c002f30 tx=0x7f828c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.238 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.218+0000 7f82957fa700 1 -- 172.21.15.38:0/307183670 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f828c007150 con 0x7f8278005260 2020-06-12T17:48:18.238 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.218+0000 7f82977fe700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8278005260 0x7f8278003960 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f828c002f30 tx=0x7f828c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.218+0000 7f82957fa700 1 -- 172.21.15.38:0/307183670 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c0072b0 con 0x7f8278005260 2020-06-12T17:48:18.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.218+0000 7f82977fe700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8278005260 0x7f8278003960 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f828c002f30 tx=0x7f828c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.218+0000 7f82957fa700 1 -- 172.21.15.38:0/307183670 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f828c0056c0 con 0x7f8278005260 2020-06-12T17:48:18.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.219+0000 7f82977fe700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8278005260 0x7f8278003960 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f828c002f30 tx=0x7f828c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.219+0000 7f829d7a1700 1 -- 172.21.15.38:0/307183670 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8274003340 con 0x7f8278005260 2020-06-12T17:48:18.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.219+0000 7f82957fa700 1 -- 172.21.15.38:0/307183670 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f828c005820 con 0x7f8278005260 2020-06-12T17:48:18.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.219+0000 7f82977fe700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8278005260 0x7f8278003960 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f828c002f30 tx=0x7f828c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.220+0000 7f82957fa700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f82780557f0 0x7f8278057cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:18.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.220+0000 7f82957fa700 1 -- 172.21.15.38:0/307183670 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f828c061370 con 0x7f8278005260 2020-06-12T17:48:18.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.220+0000 7f8297fff700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f82780557f0 0x7f8278057cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:18.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.220+0000 7f8297fff700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f82780557f0 0x7f8278057cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8288000e90 tx=0x7f8288007f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.220+0000 7f8297fff700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f82780557f0 0x7f8278057cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8288000e90 tx=0x7f8288007f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.220+0000 7f8297fff700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f82780557f0 0x7f8278057cb0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f8288000e90 tx=0x7f8288007f10).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:18.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.223+0000 7f82977fe700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8278005260 0x7f8278003960 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f828c002f30 tx=0x7f828c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.223+0000 7f82957fa700 1 -- 172.21.15.38:0/307183670 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f828c03cb70 con 0x7f8278005260 2020-06-12T17:48:18.380 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.377+0000 7f829d7a1700 1 -- 172.21.15.38:0/307183670 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8274002200 con 0x7f8278005260 2020-06-12T17:48:18.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.377+0000 7f82977fe700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8278005260 0x7f8278003960 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f828c002f30 tx=0x7f828c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.377+0000 7f82957fa700 1 -- 172.21.15.38:0/307183670 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f828c040190 con 0x7f8278005260 2020-06-12T17:48:18.382 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:18.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.378+0000 7f829d7a1700 1 -- 172.21.15.38:0/307183670 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f82780557f0 msgr2=0x7f8278057cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:18.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.378+0000 7f829d7a1700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f82780557f0 0x7f8278057cb0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f8288000e90 tx=0x7f8288007f10).stop 2020-06-12T17:48:18.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.378+0000 7f829d7a1700 1 -- 172.21.15.38:0/307183670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8278005260 msgr2=0x7f8278003960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:18.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.378+0000 7f829d7a1700 1 --2- 172.21.15.38:0/307183670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8278005260 0x7f8278003960 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f828c002f30 tx=0x7f828c007e60).stop 2020-06-12T17:48:18.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.378+0000 7f829cfa0700 1 -- 172.21.15.38:0/307183670 reap_dead start 2020-06-12T17:48:18.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.378+0000 7f829cfa0700 1 -- 172.21.15.38:0/307183670 reap_dead start 2020-06-12T17:48:18.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.379+0000 7f829d7a1700 1 -- 172.21.15.38:0/307183670 shutdown_connections 2020-06-12T17:48:18.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.379+0000 7f829d7a1700 1 -- 172.21.15.38:0/307183670 >> 172.21.15.38:0/307183670 conn(0x7f82980b4cc0 msgr2=0x7f82980b89f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:18.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.379+0000 7f829d7a1700 1 -- 172.21.15.38:0/307183670 shutdown_connections 2020-06-12T17:48:18.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.379+0000 7f829d7a1700 1 -- 172.21.15.38:0/307183670 wait complete. 2020-06-12T17:48:18.393 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-06-12T17:48:18.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.506+0000 7fb3c54a4700 1 Processor -- start 2020-06-12T17:48:18.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.506+0000 7fb3c54a4700 1 -- start start 2020-06-12T17:48:18.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.507+0000 7fb3c54a4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb3c00b11e0 0x7fb3c00b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:18.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.507+0000 7fb3c54a4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3c00b2380 0x7fb3c00ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:18.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.507+0000 7fb3c54a4700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c00b2900 con 0x7fb3c00ae520 2020-06-12T17:48:18.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.507+0000 7fb3c54a4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c00b1ad0 con 0x7fb3c00b11e0 2020-06-12T17:48:18.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.507+0000 7fb3c54a4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00b1d70 con 0x7fb3c00b2380 2020-06-12T17:48:18.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.507+0000 7fb3c4ca3700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb3c00ae520 0x7fb3c00afc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37386/0 (socket says 172.21.15.38:37386) 2020-06-12T17:48:18.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.507+0000 7fb3c4ca3700 1 -- 172.21.15.38:0/3995176415 learned_addr learned my addr 172.21.15.38:0/3995176415 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:18.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3bf7fe700 1 --2- 172.21.15.38:0/3995176415 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3c00b2380 0x7fb3c00ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:18.517 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3bffff700 1 --2- 172.21.15.38:0/3995176415 >> v2:172.21.15.150:3300/0 conn(0x7fb3c00b11e0 0x7fb3c00b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:18.517 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3beffd700 1 -- 172.21.15.38:0/3995176415 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 695448151 0 0) 0x7fb3c00b2900 con 0x7fb3c00ae520 2020-06-12T17:48:18.517 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3beffd700 1 -- 172.21.15.38:0/3995176415 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3ac003230 con 0x7fb3c00ae520 2020-06-12T17:48:18.517 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3beffd700 1 -- 172.21.15.38:0/3995176415 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4188501212 0 0) 0x7fb3ac003230 con 0x7fb3c00ae520 2020-06-12T17:48:18.517 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3beffd700 1 -- 172.21.15.38:0/3995176415 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3c00b2380 msgr2=0x7fb3c00ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:18.518 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3beffd700 1 --2- 172.21.15.38:0/3995176415 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3c00b2380 0x7fb3c00ae0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:18.518 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3beffd700 1 -- 172.21.15.38:0/3995176415 >> v2:172.21.15.150:3300/0 conn(0x7fb3c00b11e0 msgr2=0x7fb3c00b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:18.518 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3beffd700 1 --2- 172.21.15.38:0/3995176415 >> v2:172.21.15.150:3300/0 conn(0x7fb3c00b11e0 0x7fb3c00b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:18.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3beffd700 1 -- 172.21.15.38:0/3995176415 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c00b0330 con 0x7fb3c00ae520 2020-06-12T17:48:18.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3beffd700 1 -- 172.21.15.38:0/3995176415 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fb3b8001a50 con 0x7fb3c00ae520 2020-06-12T17:48:18.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3beffd700 1 -- 172.21.15.38:0/3995176415 >> v1:172.21.15.38:6789/0 conn(0x7fb3c00ae520 legacy=0x7fb3c00afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:18.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3beffd700 1 --2- 172.21.15.38:0/3995176415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3ac003720 0x7fb3ac003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:18.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3beffd700 1 --2- 172.21.15.38:0/3995176415 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3ac004060 0x7fb3ac004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:18.520 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3beffd700 1 --2- 172.21.15.38:0/3995176415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3ac004a50 0x7fb3ac004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:18.520 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3beffd700 1 -- 172.21.15.38:0/3995176415 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00b1ad0 con 0x7fb3ac004a50 2020-06-12T17:48:18.520 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3beffd700 1 -- 172.21.15.38:0/3995176415 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00b1d70 con 0x7fb3ac003720 2020-06-12T17:48:18.520 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3beffd700 1 -- 172.21.15.38:0/3995176415 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac00b860 con 0x7fb3ac004060 2020-06-12T17:48:18.520 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3bf7fe700 1 --2- 172.21.15.38:0/3995176415 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3c00b2380 0x7fb3c00ae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:18.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3bffff700 1 --2- 172.21.15.38:0/3995176415 >> v2:172.21.15.150:3300/0 conn(0x7fb3c00b11e0 0x7fb3c00b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:18.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3c4ca3700 1 --2- 172.21.15.38:0/3995176415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3ac004a50 0x7fb3ac004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:18.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3bffff700 1 --2- 172.21.15.38:0/3995176415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3ac003720 0x7fb3ac003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:18.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3bf7fe700 1 --2- 172.21.15.38:0/3995176415 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3ac004060 0x7fb3ac004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:18.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3c4ca3700 1 -- 172.21.15.38:0/3995176415 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3ac004060 msgr2=0x7fb3ac004530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:18.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3c4ca3700 1 --2- 172.21.15.38:0/3995176415 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3ac004060 0x7fb3ac004530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:18.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3c4ca3700 1 -- 172.21.15.38:0/3995176415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3ac003720 msgr2=0x7fb3ac003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:18.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3c4ca3700 1 --2- 172.21.15.38:0/3995176415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3ac003720 0x7fb3ac003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:18.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3c4ca3700 1 -- 172.21.15.38:0/3995176415 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ac003230 con 0x7fb3ac004a50 2020-06-12T17:48:18.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.508+0000 7fb3c4ca3700 1 --2- 172.21.15.38:0/3995176415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3ac004a50 0x7fb3ac004ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb3b8001760 tx=0x7fb3b800ec50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.509+0000 7fb3c4ca3700 1 --2- 172.21.15.38:0/3995176415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3ac004a50 0x7fb3ac004ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb3b8001760 tx=0x7fb3b800ec50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.509+0000 7fb3c4ca3700 1 --2- 172.21.15.38:0/3995176415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3ac004a50 0x7fb3ac004ed0 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7fb3b8001760 tx=0x7fb3b800ec50).ready entity=mon.0 client_cookie=bb445bf71cd50953 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:18.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.509+0000 7fb3c4ca3700 1 --2- 172.21.15.38:0/3995176415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3ac004a50 0x7fb3ac004ed0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fb3b8001760 tx=0x7fb3b800ec50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.509+0000 7fb3beffd700 1 -- 172.21.15.38:0/3995176415 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3b800e540 con 0x7fb3ac004a50 2020-06-12T17:48:18.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.509+0000 7fb3c4ca3700 1 --2- 172.21.15.38:0/3995176415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3ac004a50 0x7fb3ac004ed0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fb3b8001760 tx=0x7fb3b800ec50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.509+0000 7fb3c4ca3700 1 --2- 172.21.15.38:0/3995176415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3ac004a50 0x7fb3ac004ed0 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fb3b8001760 tx=0x7fb3b800ec50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.509+0000 7fb3beffd700 1 -- 172.21.15.38:0/3995176415 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b800e6a0 con 0x7fb3ac004a50 2020-06-12T17:48:18.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.509+0000 7fb3beffd700 1 -- 172.21.15.38:0/3995176415 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3b800ea00 con 0x7fb3ac004a50 2020-06-12T17:48:18.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.509+0000 7fb3c54a4700 1 -- 172.21.15.38:0/3995176415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3ac004a50 msgr2=0x7fb3ac004ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:18.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.509+0000 7fb3c54a4700 1 --2- 172.21.15.38:0/3995176415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3ac004a50 0x7fb3ac004ed0 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7fb3b8001760 tx=0x7fb3b800ec50).stop 2020-06-12T17:48:18.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.509+0000 7fb3c4ca3700 1 -- 172.21.15.38:0/3995176415 reap_dead start 2020-06-12T17:48:18.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.509+0000 7fb3c54a4700 1 -- 172.21.15.38:0/3995176415 shutdown_connections 2020-06-12T17:48:18.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.509+0000 7fb3c54a4700 1 -- 172.21.15.38:0/3995176415 >> 172.21.15.38:0/3995176415 conn(0x7fb3c00b4cc0 msgr2=0x7fb3c00b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:18.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.509+0000 7fb3c54a4700 1 -- 172.21.15.38:0/3995176415 shutdown_connections 2020-06-12T17:48:18.528 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.509+0000 7fb3c54a4700 1 -- 172.21.15.38:0/3995176415 wait complete. 2020-06-12T17:48:18.528 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.510+0000 7fb3c54a4700 1 Processor -- start 2020-06-12T17:48:18.528 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.510+0000 7fb3c54a4700 1 -- start start 2020-06-12T17:48:18.531 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.511+0000 7fb3c54a4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb3c0144e30 0x7fb3c0139760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:18.532 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.511+0000 7fb3c54a4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb3c0145210 0x7fb3c013b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:18.532 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.511+0000 7fb3c54a4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c0155600 con 0x7fb3c0137c30 2020-06-12T17:48:18.532 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.511+0000 7fb3c54a4700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c0155830 con 0x7fb3c0144e30 2020-06-12T17:48:18.532 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.511+0000 7fb3c54a4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c0155ad0 con 0x7fb3c0145210 2020-06-12T17:48:18.532 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.511+0000 7fb3bffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb3c0144e30 0x7fb3c0139760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:18.533 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.511+0000 7fb3bffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb3c0144e30 0x7fb3c0139760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35578/0 (socket says 172.21.15.38:35578) 2020-06-12T17:48:18.533 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.511+0000 7fb3bffff700 1 -- 172.21.15.38:0/4231432364 learned_addr learned my addr 172.21.15.38:0/4231432364 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:18.533 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.511+0000 7fb3bf7fe700 1 --2- 172.21.15.38:0/4231432364 >> v2:172.21.15.150:3300/0 conn(0x7fb3c0145210 0x7fb3c013b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:18.533 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.511+0000 7fb3bffff700 1 -- 172.21.15.38:0/4231432364 >> v2:172.21.15.150:3300/0 conn(0x7fb3c0145210 msgr2=0x7fb3c013b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:18.533 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.511+0000 7fb3bffff700 1 --2- 172.21.15.38:0/4231432364 >> v2:172.21.15.150:3300/0 conn(0x7fb3c0145210 0x7fb3c013b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:18.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.511+0000 7fb3bffff700 1 -- 172.21.15.38:0/4231432364 >> v1:172.21.15.150:6789/0 conn(0x7fb3c0137c30 legacy=0x7fb3c0065b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:18.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.511+0000 7fb3bffff700 1 -- 172.21.15.38:0/4231432364 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c00614c0 con 0x7fb3c0144e30 2020-06-12T17:48:18.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.511+0000 7fb3bffff700 1 --2- 172.21.15.38:0/4231432364 >> v2:172.21.15.38:3300/0 conn(0x7fb3c0144e30 0x7fb3c0139760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb3b0007ed0 tx=0x7fb3b0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.512+0000 7fb3bffff700 1 --2- 172.21.15.38:0/4231432364 >> v2:172.21.15.38:3300/0 conn(0x7fb3c0144e30 0x7fb3c0139760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb3b0007ed0 tx=0x7fb3b0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.512+0000 7fb3bffff700 1 --2- 172.21.15.38:0/4231432364 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3c0144e30 0x7fb3c0139760 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7fb3b0007ed0 tx=0x7fb3b0007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:18.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.512+0000 7fb3bffff700 1 --2- 172.21.15.38:0/4231432364 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3c0144e30 0x7fb3c0139760 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fb3b0007ed0 tx=0x7fb3b0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.512+0000 7fb3bd7fa700 1 -- 172.21.15.38:0/4231432364 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3b0007540 con 0x7fb3c0144e30 2020-06-12T17:48:18.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.512+0000 7fb3bffff700 1 --2- 172.21.15.38:0/4231432364 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3c0144e30 0x7fb3c0139760 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fb3b0007ed0 tx=0x7fb3b0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.512+0000 7fb3bffff700 1 --2- 172.21.15.38:0/4231432364 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3c0144e30 0x7fb3c0139760 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fb3b0007ed0 tx=0x7fb3b0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.512+0000 7fb3bd7fa700 1 -- 172.21.15.38:0/4231432364 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b00059c0 con 0x7fb3c0144e30 2020-06-12T17:48:18.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.512+0000 7fb3c54a4700 1 -- 172.21.15.38:0/4231432364 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c01380c0 con 0x7fb3c0144e30 2020-06-12T17:48:18.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.512+0000 7fb3bd7fa700 1 -- 172.21.15.38:0/4231432364 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3b0005da0 con 0x7fb3c0144e30 2020-06-12T17:48:18.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.512+0000 7fb3c54a4700 1 -- 172.21.15.38:0/4231432364 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c0061960 con 0x7fb3c0144e30 2020-06-12T17:48:18.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.512+0000 7fb3bffff700 1 --2- 172.21.15.38:0/4231432364 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3c0144e30 0x7fb3c0139760 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fb3b0007ed0 tx=0x7fb3b0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.513+0000 7fb3c54a4700 1 -- 172.21.15.38:0/4231432364 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c0056c30 con 0x7fb3c0144e30 2020-06-12T17:48:18.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.513+0000 7fb3bd7fa700 1 -- 172.21.15.38:0/4231432364 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fb3b000f250 con 0x7fb3c0144e30 2020-06-12T17:48:18.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.513+0000 7fb3bffff700 1 --2- 172.21.15.38:0/4231432364 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3c0144e30 0x7fb3c0139760 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fb3b0007ed0 tx=0x7fb3b0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.513+0000 7fb3bd7fa700 1 --2- 172.21.15.38:0/4231432364 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb3a004d590 0x7fb3a004fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:18.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.513+0000 7fb3bd7fa700 1 -- 172.21.15.38:0/4231432364 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fb3b0061370 con 0x7fb3c0144e30 2020-06-12T17:48:18.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.513+0000 7fb3bf7fe700 1 --2- 172.21.15.38:0/4231432364 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb3a004d590 0x7fb3a004fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:18.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.513+0000 7fb3bf7fe700 1 --2- 172.21.15.38:0/4231432364 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb3a004d590 0x7fb3a004fa50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb3b4000b20 tx=0x7fb3b4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.514+0000 7fb3bf7fe700 1 --2- 172.21.15.38:0/4231432364 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb3a004d590 0x7fb3a004fa50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb3b4000b20 tx=0x7fb3b4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.514+0000 7fb3bf7fe700 1 --2- 172.21.15.38:0/4231432364 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb3a004d590 0x7fb3a004fa50 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7fb3b4000b20 tx=0x7fb3b4007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:18.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.517+0000 7fb3bffff700 1 --2- 172.21.15.38:0/4231432364 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3c0144e30 0x7fb3c0139760 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fb3b0007ed0 tx=0x7fb3b0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.517+0000 7fb3bd7fa700 1 -- 172.21.15.38:0/4231432364 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fb3b003ca70 con 0x7fb3c0144e30 2020-06-12T17:48:18.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.668+0000 7fb3c54a4700 1 -- 172.21.15.38:0/4231432364 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb3c00b0d70 con 0x7fb3c0144e30 2020-06-12T17:48:18.673 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.669+0000 7fb3bffff700 1 --2- 172.21.15.38:0/4231432364 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3c0144e30 0x7fb3c0139760 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fb3b0007ed0 tx=0x7fb3b0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.673 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.669+0000 7fb3bd7fa700 1 -- 172.21.15.38:0/4231432364 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7fb3b0040090 con 0x7fb3c0144e30 2020-06-12T17:48:18.673 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:18.674 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.670+0000 7fb3c54a4700 1 -- 172.21.15.38:0/4231432364 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb3a004d590 msgr2=0x7fb3a004fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:18.674 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.670+0000 7fb3c54a4700 1 --2- 172.21.15.38:0/4231432364 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb3a004d590 0x7fb3a004fa50 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7fb3b4000b20 tx=0x7fb3b4007e60).stop 2020-06-12T17:48:18.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.670+0000 7fb3c54a4700 1 -- 172.21.15.38:0/4231432364 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3c0144e30 msgr2=0x7fb3c0139760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:18.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.670+0000 7fb3c54a4700 1 --2- 172.21.15.38:0/4231432364 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3c0144e30 0x7fb3c0139760 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7fb3b0007ed0 tx=0x7fb3b0007e60).stop 2020-06-12T17:48:18.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.670+0000 7fb3c54a4700 1 -- 172.21.15.38:0/4231432364 shutdown_connections 2020-06-12T17:48:18.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.670+0000 7fb3c54a4700 1 --2- 172.21.15.38:0/4231432364 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb3a004d590 0x7fb3a004fa50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:18.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.670+0000 7fb3c54a4700 1 --2- 172.21.15.38:0/4231432364 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3c0144e30 0x7fb3c0139760 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:18.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.670+0000 7fb3c54a4700 1 --2- 172.21.15.38:0/4231432364 >> v2:172.21.15.150:3300/0 conn(0x7fb3c0145210 0x7fb3c013b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:18.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.670+0000 7fb3c54a4700 1 -- 172.21.15.38:0/4231432364 >> 172.21.15.38:0/4231432364 conn(0x7fb3c00b4cc0 msgr2=0x7fb3c00b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:18.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.670+0000 7fb3c54a4700 1 -- 172.21.15.38:0/4231432364 shutdown_connections 2020-06-12T17:48:18.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.670+0000 7fb3c54a4700 1 -- 172.21.15.38:0/4231432364 wait complete. 2020-06-12T17:48:18.684 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-06-12T17:48:18.684 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-06-12T17:48:18.684 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mgr dump --format=json 2020-06-12T17:48:18.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.795+0000 7fe102ad8700 1 Processor -- start 2020-06-12T17:48:18.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.795+0000 7fe102ad8700 1 -- start start 2020-06-12T17:48:18.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.796+0000 7fe102ad8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0fc061a80 0x7fe0fc09bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:18.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.796+0000 7fe102ad8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe0fc0b44a0 0x7fe0fc1427b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:18.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.796+0000 7fe102ad8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0fc0b2dc0 con 0x7fe0fc142350 2020-06-12T17:48:18.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.796+0000 7fe102ad8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0fc09e560 con 0x7fe0fc0b44a0 2020-06-12T17:48:18.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.796+0000 7fe102ad8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc0b29d0 con 0x7fe0fc061a80 2020-06-12T17:48:18.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.796+0000 7fe100874700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0fc061a80 0x7fe0fc09bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:18.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.796+0000 7fe101075700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe0fc0b44a0 0x7fe0fc1427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:18.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.796+0000 7fe100874700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0fc061a80 0x7fe0fc09bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:55044/0 (socket says 172.21.15.38:55044) 2020-06-12T17:48:18.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.796+0000 7fe100874700 1 -- 172.21.15.38:0/3360892467 learned_addr learned my addr 172.21.15.38:0/3360892467 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:18.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.796+0000 7fe0fbfff700 1 --1- 172.21.15.38:0/3360892467 >> v1:172.21.15.150:6789/0 conn(0x7fe0fc142350 0x7fe0fc146380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:58134/0 (socket says 172.21.15.38:58134) 2020-06-12T17:48:18.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.797+0000 7fe100874700 1 -- 172.21.15.38:0/3360892467 >> v2:172.21.15.150:3300/0 conn(0x7fe0fc0b44a0 msgr2=0x7fe0fc1427b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:18.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.797+0000 7fe100874700 1 --2- 172.21.15.38:0/3360892467 >> v2:172.21.15.150:3300/0 conn(0x7fe0fc0b44a0 0x7fe0fc1427b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:18.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.797+0000 7fe100874700 1 -- 172.21.15.38:0/3360892467 >> v1:172.21.15.150:6789/0 conn(0x7fe0fc142350 legacy=0x7fe0fc146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:18.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.797+0000 7fe0fb7fe700 1 -- 172.21.15.38:0/3360892467 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3133196097 0 0) 0x7fe0fc0b2dc0 con 0x7fe0fc142350 2020-06-12T17:48:18.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.797+0000 7fe100874700 1 -- 172.21.15.38:0/3360892467 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc0b2ff0 con 0x7fe0fc061a80 2020-06-12T17:48:18.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.797+0000 7fe101075700 1 --2- 172.21.15.38:0/3360892467 >> v2:172.21.15.150:3300/0 conn(0x7fe0fc0b44a0 0x7fe0fc1427b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:18.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.797+0000 7fe100874700 1 --2- 172.21.15.38:0/3360892467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0fc061a80 0x7fe0fc09bee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe0ec002f30 tx=0x7fe0ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.807 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.797+0000 7fe100874700 1 --2- 172.21.15.38:0/3360892467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0fc061a80 0x7fe0fc09bee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe0ec002f30 tx=0x7fe0ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.807 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.797+0000 7fe100874700 1 --2- 172.21.15.38:0/3360892467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0fc061a80 0x7fe0fc09bee0 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7fe0ec002f30 tx=0x7fe0ec007e60).ready entity=mon.2 client_cookie=56dc0654b2d8b344 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:18.807 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.797+0000 7fe100874700 1 --2- 172.21.15.38:0/3360892467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0fc061a80 0x7fe0fc09bee0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fe0ec002f30 tx=0x7fe0ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.808 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.797+0000 7fe0fb7fe700 1 -- 172.21.15.38:0/3360892467 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0ec011630 con 0x7fe0fc061a80 2020-06-12T17:48:18.808 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.797+0000 7fe100874700 1 --2- 172.21.15.38:0/3360892467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0fc061a80 0x7fe0fc09bee0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fe0ec002f30 tx=0x7fe0ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.808 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.797+0000 7fe0fb7fe700 1 -- 172.21.15.38:0/3360892467 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ec011790 con 0x7fe0fc061a80 2020-06-12T17:48:18.808 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.797+0000 7fe100874700 1 --2- 172.21.15.38:0/3360892467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0fc061a80 0x7fe0fc09bee0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7fe0ec002f30 tx=0x7fe0ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.808 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.797+0000 7fe0fb7fe700 1 -- 172.21.15.38:0/3360892467 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0ec011b70 con 0x7fe0fc061a80 2020-06-12T17:48:18.808 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.797+0000 7fe102ad8700 1 -- 172.21.15.38:0/3360892467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0fc061a80 msgr2=0x7fe0fc09bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:18.809 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.797+0000 7fe102ad8700 1 --2- 172.21.15.38:0/3360892467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0fc061a80 0x7fe0fc09bee0 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7fe0ec002f30 tx=0x7fe0ec007e60).stop 2020-06-12T17:48:18.809 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.798+0000 7fe102ad8700 1 -- 172.21.15.38:0/3360892467 shutdown_connections 2020-06-12T17:48:18.809 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.798+0000 7fe102ad8700 1 --2- 172.21.15.38:0/3360892467 >> v2:172.21.15.150:3300/0 conn(0x7fe0fc0b44a0 0x7fe0fc1427b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:18.809 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.798+0000 7fe102ad8700 1 --2- 172.21.15.38:0/3360892467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0fc061a80 0x7fe0fc09bee0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:18.810 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.798+0000 7fe102ad8700 1 -- 172.21.15.38:0/3360892467 >> 172.21.15.38:0/3360892467 conn(0x7fe0fc0b8420 msgr2=0x7fe0fc0b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:18.810 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.798+0000 7fe102ad8700 1 -- 172.21.15.38:0/3360892467 shutdown_connections 2020-06-12T17:48:18.810 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.798+0000 7fe102ad8700 1 -- 172.21.15.38:0/3360892467 wait complete. 2020-06-12T17:48:18.811 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.799+0000 7fe102ad8700 1 Processor -- start 2020-06-12T17:48:18.811 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.799+0000 7fe102ad8700 1 -- start start 2020-06-12T17:48:18.816 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.800+0000 7fe102ad8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe0fc142350 0x7fe0fc0add90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:18.816 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.800+0000 7fe102ad8700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0fc0ae2a0 con 0x7fe0fc0b44a0 2020-06-12T17:48:18.816 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.800+0000 7fe102ad8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0fc0ae540 con 0x7fe0fc061a80 2020-06-12T17:48:18.817 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.800+0000 7fe102ad8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0fc0ae7e0 con 0x7fe0fc142350 2020-06-12T17:48:18.817 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.800+0000 7fe0fbfff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe0fc0b44a0 0x7fe0fc05ab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37410/0 (socket says 172.21.15.38:37410) 2020-06-12T17:48:18.817 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.800+0000 7fe0fbfff700 1 -- 172.21.15.38:0/1743586156 learned_addr learned my addr 172.21.15.38:0/1743586156 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:18.817 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.800+0000 7fe101075700 1 --2- 172.21.15.38:0/1743586156 >> v2:172.21.15.150:3300/0 conn(0x7fe0fc142350 0x7fe0fc0add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:18.818 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.800+0000 7fe0f9ffb700 1 -- 172.21.15.38:0/1743586156 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 833330353 0 0) 0x7fe0fc0ae2a0 con 0x7fe0fc0b44a0 2020-06-12T17:48:18.818 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.800+0000 7fe0f9ffb700 1 -- 172.21.15.38:0/1743586156 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0dc002fe0 con 0x7fe0fc0b44a0 2020-06-12T17:48:18.818 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.800+0000 7fe101075700 1 -- 172.21.15.38:0/1743586156 >> v1:172.21.15.150:6789/0 conn(0x7fe0fc061a80 legacy=0x7fe0fc151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:18.818 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.800+0000 7fe0f9ffb700 1 -- 172.21.15.38:0/1743586156 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552588925 0 0) 0x7fe0fc0ae540 con 0x7fe0fc061a80 2020-06-12T17:48:18.818 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.800+0000 7fe101075700 1 -- 172.21.15.38:0/1743586156 >> v1:172.21.15.38:6789/0 conn(0x7fe0fc0b44a0 legacy=0x7fe0fc05ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:18.819 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.800+0000 7fe101075700 1 -- 172.21.15.38:0/1743586156 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc05b2a0 con 0x7fe0fc142350 2020-06-12T17:48:18.819 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.800+0000 7fe101075700 1 --2- 172.21.15.38:0/1743586156 >> v2:172.21.15.150:3300/0 conn(0x7fe0fc142350 0x7fe0fc0add90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe0f40032b0 tx=0x7fe0f40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.819 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.800+0000 7fe101075700 1 --2- 172.21.15.38:0/1743586156 >> v2:172.21.15.150:3300/0 conn(0x7fe0fc142350 0x7fe0fc0add90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe0f40032b0 tx=0x7fe0f40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.819 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.800+0000 7fe101075700 1 --2- 172.21.15.38:0/1743586156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0fc142350 0x7fe0fc0add90 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fe0f40032b0 tx=0x7fe0f40081e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:18.819 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.800+0000 7fe101075700 1 --2- 172.21.15.38:0/1743586156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0fc142350 0x7fe0fc0add90 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fe0f40032b0 tx=0x7fe0f40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.820 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.800+0000 7fe0f9ffb700 1 -- 172.21.15.38:0/1743586156 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0f4008ad0 con 0x7fe0fc142350 2020-06-12T17:48:18.820 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.800+0000 7fe101075700 1 --2- 172.21.15.38:0/1743586156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0fc142350 0x7fe0fc0add90 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fe0f40032b0 tx=0x7fe0f40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.820 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.800+0000 7fe101075700 1 --2- 172.21.15.38:0/1743586156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0fc142350 0x7fe0fc0add90 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fe0f40032b0 tx=0x7fe0f40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.820 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.800+0000 7fe0f9ffb700 1 -- 172.21.15.38:0/1743586156 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f4008c30 con 0x7fe0fc142350 2020-06-12T17:48:18.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.800+0000 7fe102ad8700 1 -- 172.21.15.38:0/1743586156 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0fc0aec80 con 0x7fe0fc142350 2020-06-12T17:48:18.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.800+0000 7fe0f9ffb700 1 -- 172.21.15.38:0/1743586156 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0f40126b0 con 0x7fe0fc142350 2020-06-12T17:48:18.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.800+0000 7fe102ad8700 1 -- 172.21.15.38:0/1743586156 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0fc065cd0 con 0x7fe0fc142350 2020-06-12T17:48:18.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.801+0000 7fe101075700 1 --2- 172.21.15.38:0/1743586156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0fc142350 0x7fe0fc0add90 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fe0f40032b0 tx=0x7fe0f40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.801+0000 7fe102ad8700 1 -- 172.21.15.38:0/1743586156 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0fc056c30 con 0x7fe0fc142350 2020-06-12T17:48:18.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.802+0000 7fe0f9ffb700 1 -- 172.21.15.38:0/1743586156 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe0f4012810 con 0x7fe0fc142350 2020-06-12T17:48:18.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.802+0000 7fe101075700 1 --2- 172.21.15.38:0/1743586156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0fc142350 0x7fe0fc0add90 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fe0f40032b0 tx=0x7fe0f40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.802+0000 7fe0f9ffb700 1 --2- 172.21.15.38:0/1743586156 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe0dc04d8d0 0x7fe0dc04fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:18.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.802+0000 7fe0f9ffb700 1 -- 172.21.15.38:0/1743586156 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fe0f4061050 con 0x7fe0fc142350 2020-06-12T17:48:18.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.802+0000 7fe100874700 1 --2- 172.21.15.38:0/1743586156 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe0dc04d8d0 0x7fe0dc04fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:18.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.802+0000 7fe100874700 1 --2- 172.21.15.38:0/1743586156 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe0dc04d8d0 0x7fe0dc04fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe0ec007ed0 tx=0x7fe0ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.802+0000 7fe100874700 1 --2- 172.21.15.38:0/1743586156 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe0dc04d8d0 0x7fe0dc04fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe0ec007ed0 tx=0x7fe0ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.802+0000 7fe100874700 1 --2- 172.21.15.38:0/1743586156 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe0dc04d8d0 0x7fe0dc04fd90 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7fe0ec007ed0 tx=0x7fe0ec007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:18.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.806+0000 7fe101075700 1 --2- 172.21.15.38:0/1743586156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0fc142350 0x7fe0fc0add90 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fe0f40032b0 tx=0x7fe0f40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:18.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.806+0000 7fe0f9ffb700 1 -- 172.21.15.38:0/1743586156 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fe0f403c810 con 0x7fe0fc142350 2020-06-12T17:48:18.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.996+0000 7fe102ad8700 1 -- 172.21.15.38:0/1743586156 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe0fc141ee0 con 0x7fe0fc142350 2020-06-12T17:48:19.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.998+0000 7fe101075700 1 --2- 172.21.15.38:0/1743586156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0fc142350 0x7fe0fc0add90 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7fe0f40032b0 tx=0x7fe0f40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:18.998+0000 7fe0f9ffb700 1 -- 172.21.15.38:0/1743586156 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+119894 (secure 0 0 0) 0x7fe0f400f0d0 con 0x7fe0fc142350 2020-06-12T17:48:19.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.000+0000 7fe102ad8700 1 -- 172.21.15.38:0/1743586156 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe0dc04d8d0 msgr2=0x7fe0dc04fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.000+0000 7fe102ad8700 1 --2- 172.21.15.38:0/1743586156 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe0dc04d8d0 0x7fe0dc04fd90 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7fe0ec007ed0 tx=0x7fe0ec007e60).stop 2020-06-12T17:48:19.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.000+0000 7fe102ad8700 1 -- 172.21.15.38:0/1743586156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0fc142350 msgr2=0x7fe0fc0add90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.000+0000 7fe102ad8700 1 --2- 172.21.15.38:0/1743586156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0fc142350 0x7fe0fc0add90 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7fe0f40032b0 tx=0x7fe0f40081e0).stop 2020-06-12T17:48:19.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.000+0000 7fe102ad8700 1 -- 172.21.15.38:0/1743586156 shutdown_connections 2020-06-12T17:48:19.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.000+0000 7fe102ad8700 1 --2- 172.21.15.38:0/1743586156 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe0dc04d8d0 0x7fe0dc04fd90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:19.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.000+0000 7fe102ad8700 1 --2- 172.21.15.38:0/1743586156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0fc142350 0x7fe0fc0add90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:19.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.000+0000 7fe102ad8700 1 -- 172.21.15.38:0/1743586156 >> 172.21.15.38:0/1743586156 conn(0x7fe0fc0b8420 msgr2=0x7fe0fc13e590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:19.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.000+0000 7fe102ad8700 1 -- 172.21.15.38:0/1743586156 shutdown_connections 2020-06-12T17:48:19.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.000+0000 7fe102ad8700 1 -- 172.21.15.38:0/1743586156 wait complete. 2020-06-12T17:48:19.008 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:19.014 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":4,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":30312},{"type":"v1","addr":"172.21.15.150:6801","nonce":30312}]},"active_addr":"172.21.15.150:6801/30312","active_change":"2020-06-12T17:47:57.530882+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":3024917965}]},{"addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":3855428469}]},{"addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":3527367229}]}]}} 2020-06-12T17:48:19.018 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-06-12T17:48:19.018 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-06-12T17:48:19.019 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-12T17:48:19.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.130+0000 7f31db591700 1 Processor -- start 2020-06-12T17:48:19.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.131+0000 7f31db591700 1 -- start start 2020-06-12T17:48:19.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.131+0000 7f31db591700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31d4061a80 0x7f31d409bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:19.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.131+0000 7f31db591700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f31d4142350 0x7f31d41427b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:19.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.131+0000 7f31db591700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d40b2dc0 con 0x7f31d4146380 2020-06-12T17:48:19.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.131+0000 7f31db591700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d409e560 con 0x7f31d4142350 2020-06-12T17:48:19.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.131+0000 7f31db591700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40b29d0 con 0x7f31d4061a80 2020-06-12T17:48:19.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.132+0000 7f31d8b2c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f31d4142350 0x7f31d41427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:19.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.132+0000 7f31d932d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31d4061a80 0x7f31d409bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:19.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.132+0000 7f31d8b2c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f31d4142350 0x7f31d41427b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:45076/0 (socket says 172.21.15.38:45076) 2020-06-12T17:48:19.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.132+0000 7f31d8b2c700 1 -- 172.21.15.38:0/2351621011 learned_addr learned my addr 172.21.15.38:0/2351621011 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:19.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.132+0000 7f31d932d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31d4061a80 0x7f31d409bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:55058/0 (socket says 172.21.15.38:55058) 2020-06-12T17:48:19.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.132+0000 7f31d8b2c700 1 -- 172.21.15.38:0/2351621011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31d4061a80 msgr2=0x7f31d409bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:19.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.132+0000 7f31d8b2c700 1 --2- 172.21.15.38:0/2351621011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31d4061a80 0x7f31d409bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:19.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.132+0000 7f31d8b2c700 1 -- 172.21.15.38:0/2351621011 >> v1:172.21.15.150:6789/0 conn(0x7f31d4146380 legacy=0x7f31d4146810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.132+0000 7f31d8b2c700 1 -- 172.21.15.38:0/2351621011 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d40b2ff0 con 0x7f31d4142350 2020-06-12T17:48:19.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.132+0000 7f31d8b2c700 1 --2- 172.21.15.38:0/2351621011 >> v2:172.21.15.150:3300/0 conn(0x7f31d4142350 0x7f31d41427b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f31c8002f30 tx=0x7f31c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.132+0000 7f31d8b2c700 1 --2- 172.21.15.38:0/2351621011 >> v2:172.21.15.150:3300/0 conn(0x7f31d4142350 0x7f31d41427b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f31c8002f30 tx=0x7f31c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.132+0000 7f31d8b2c700 1 --2- 172.21.15.38:0/2351621011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31d4142350 0x7f31d41427b0 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007e60).ready entity=mon.1 client_cookie=bc92c0ac9b0707a1 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:19.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.132+0000 7f31d8b2c700 1 --2- 172.21.15.38:0/2351621011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31d4142350 0x7f31d41427b0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.132+0000 7f31d3fff700 1 -- 172.21.15.38:0/2351621011 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31c8011630 con 0x7f31d4142350 2020-06-12T17:48:19.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.132+0000 7f31d8b2c700 1 --2- 172.21.15.38:0/2351621011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31d4142350 0x7f31d41427b0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.132+0000 7f31d8b2c700 1 --2- 172.21.15.38:0/2351621011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31d4142350 0x7f31d41427b0 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.132+0000 7f31d3fff700 1 -- 172.21.15.38:0/2351621011 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c8011790 con 0x7f31d4142350 2020-06-12T17:48:19.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.132+0000 7f31d3fff700 1 -- 172.21.15.38:0/2351621011 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31c8011bb0 con 0x7f31d4142350 2020-06-12T17:48:19.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.132+0000 7f31db591700 1 -- 172.21.15.38:0/2351621011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31d4142350 msgr2=0x7f31d41427b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.132+0000 7f31db591700 1 --2- 172.21.15.38:0/2351621011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31d4142350 0x7f31d41427b0 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007e60).stop 2020-06-12T17:48:19.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.133+0000 7f31db591700 1 -- 172.21.15.38:0/2351621011 shutdown_connections 2020-06-12T17:48:19.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.133+0000 7f31db591700 1 --2- 172.21.15.38:0/2351621011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31d4061a80 0x7f31d409bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:19.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.133+0000 7f31db591700 1 --2- 172.21.15.38:0/2351621011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31d4142350 0x7f31d41427b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:19.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.133+0000 7f31db591700 1 -- 172.21.15.38:0/2351621011 >> 172.21.15.38:0/2351621011 conn(0x7f31d40b8420 msgr2=0x7f31d40b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:19.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.133+0000 7f31db591700 1 -- 172.21.15.38:0/2351621011 shutdown_connections 2020-06-12T17:48:19.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.133+0000 7f31db591700 1 -- 172.21.15.38:0/2351621011 wait complete. 2020-06-12T17:48:19.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.134+0000 7f31db591700 1 Processor -- start 2020-06-12T17:48:19.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.134+0000 7f31db591700 1 -- start start 2020-06-12T17:48:19.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.134+0000 7f31db591700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f31d4142350 0x7f31d40ad750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:19.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.134+0000 7f31db591700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f31d4146380 0x7f31d40b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:19.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.135+0000 7f31db591700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d40b0060 con 0x7f31d4061a80 2020-06-12T17:48:19.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.135+0000 7f31db591700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d40b0300 con 0x7f31d4146380 2020-06-12T17:48:19.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.135+0000 7f31db591700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d4065920 con 0x7f31d4142350 2020-06-12T17:48:19.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.135+0000 7f31d8b2c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f31d4142350 0x7f31d40ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:19.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.135+0000 7f31d9b2e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f31d4146380 0x7f31d40b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:19.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.135+0000 7f31d8b2c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f31d4142350 0x7f31d40ad750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:45084/0 (socket says 172.21.15.38:45084) 2020-06-12T17:48:19.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.135+0000 7f31d8b2c700 1 -- 172.21.15.38:0/2450733164 learned_addr learned my addr 172.21.15.38:0/2450733164 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:19.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.135+0000 7f31d27fc700 1 -- 172.21.15.38:0/2450733164 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537039768 0 0) 0x7f31d40b0060 con 0x7f31d4061a80 2020-06-12T17:48:19.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.135+0000 7f31d8b2c700 1 -- 172.21.15.38:0/2450733164 >> v2:172.21.15.38:3300/0 conn(0x7f31d4146380 msgr2=0x7f31d40b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.135+0000 7f31d8b2c700 1 --2- 172.21.15.38:0/2450733164 >> v2:172.21.15.38:3300/0 conn(0x7f31d4146380 0x7f31d40b3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:19.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.135+0000 7f31d8b2c700 1 -- 172.21.15.38:0/2450733164 >> v1:172.21.15.150:6789/0 conn(0x7f31d4061a80 legacy=0x7f31d41412c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.135+0000 7f31d8b2c700 1 -- 172.21.15.38:0/2450733164 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d41419d0 con 0x7f31d4142350 2020-06-12T17:48:19.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.135+0000 7f31d9b2e700 1 --2- 172.21.15.38:0/2450733164 >> v2:172.21.15.38:3300/0 conn(0x7f31d4146380 0x7f31d40b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:19.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.135+0000 7f31d8b2c700 1 --2- 172.21.15.38:0/2450733164 >> v2:172.21.15.150:3300/0 conn(0x7f31d4142350 0x7f31d40ad750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.135+0000 7f31d8b2c700 1 --2- 172.21.15.38:0/2450733164 >> v2:172.21.15.150:3300/0 conn(0x7f31d4142350 0x7f31d40ad750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.135+0000 7f31d8b2c700 1 --2- 172.21.15.38:0/2450733164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31d4142350 0x7f31d40ad750 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007e60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:19.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.135+0000 7f31d8b2c700 1 --2- 172.21.15.38:0/2450733164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31d4142350 0x7f31d40ad750 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.135+0000 7f31d27fc700 1 -- 172.21.15.38:0/2450733164 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31c8011c70 con 0x7f31d4142350 2020-06-12T17:48:19.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.135+0000 7f31d8b2c700 1 --2- 172.21.15.38:0/2450733164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31d4142350 0x7f31d40ad750 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.135+0000 7f31d27fc700 1 -- 172.21.15.38:0/2450733164 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c800f910 con 0x7f31d4142350 2020-06-12T17:48:19.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.135+0000 7f31d8b2c700 1 --2- 172.21.15.38:0/2450733164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31d4142350 0x7f31d40ad750 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.135+0000 7f31db591700 1 -- 172.21.15.38:0/2450733164 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d4141d40 con 0x7f31d4142350 2020-06-12T17:48:19.156 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.135+0000 7f31d27fc700 1 -- 172.21.15.38:0/2450733164 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31c8011e20 con 0x7f31d4142350 2020-06-12T17:48:19.157 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.136+0000 7f31db591700 1 -- 172.21.15.38:0/2450733164 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d40afda0 con 0x7f31d4142350 2020-06-12T17:48:19.157 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.136+0000 7f31d8b2c700 1 --2- 172.21.15.38:0/2450733164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31d4142350 0x7f31d40ad750 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.157 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.136+0000 7f31d27fc700 1 -- 172.21.15.38:0/2450733164 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f31c80056c0 con 0x7f31d4142350 2020-06-12T17:48:19.157 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.136+0000 7f31db591700 1 -- 172.21.15.38:0/2450733164 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d4056c30 con 0x7f31d4142350 2020-06-12T17:48:19.158 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.136+0000 7f31d8b2c700 1 --2- 172.21.15.38:0/2450733164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31d4142350 0x7f31d40ad750 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.158 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.137+0000 7f31d27fc700 1 --2- 172.21.15.38:0/2450733164 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f31b404d350 0x7f31b404f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:19.158 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.137+0000 7f31d27fc700 1 -- 172.21.15.38:0/2450733164 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f31c8061450 con 0x7f31d4142350 2020-06-12T17:48:19.158 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.137+0000 7f31d932d700 1 --2- 172.21.15.38:0/2450733164 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f31b404d350 0x7f31b404f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:19.158 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.137+0000 7f31d932d700 1 --2- 172.21.15.38:0/2450733164 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f31b404d350 0x7f31b404f810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f31cc007ca0 tx=0x7f31cc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.137+0000 7f31d932d700 1 --2- 172.21.15.38:0/2450733164 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f31b404d350 0x7f31b404f810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f31cc007ca0 tx=0x7f31cc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.137+0000 7f31d932d700 1 --2- 172.21.15.38:0/2450733164 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f31b404d350 0x7f31b404f810 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f31cc007ca0 tx=0x7f31cc0081e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:19.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.140+0000 7f31d8b2c700 1 --2- 172.21.15.38:0/2450733164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31d4142350 0x7f31d40ad750 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.140+0000 7f31d27fc700 1 -- 172.21.15.38:0/2450733164 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f31c803cc50 con 0x7f31d4142350 2020-06-12T17:48:19.295 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.292+0000 7f31db591700 1 -- 172.21.15.38:0/2450733164 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31d4065a60 con 0x7f31d4142350 2020-06-12T17:48:19.296 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.293+0000 7f31d8b2c700 1 --2- 172.21.15.38:0/2450733164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31d4142350 0x7f31d40ad750 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.297 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.293+0000 7f31d27fc700 1 -- 172.21.15.38:0/2450733164 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16347 (secure 0 0 0) 0x7f31c8040270 con 0x7f31d4142350 2020-06-12T17:48:19.297 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:19.297 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":24,"fsid":"8e42a2e7-b187-42c4-a73f-8f812ee62352","created":"2020-06-12T17:47:54.434340+0000","modified":"2020-06-12T17:48:14.851712+0000","last_up_change":"2020-06-12T17:48:03.388718+0000","last_in_change":"2020-06-12T17:48:03.388718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-06-12T17:47:57.558119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-06-12T17:48:07.419264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-06-12T17:48:09.934098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-06-12T17:48:12.497229+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"44ac3dea-67b4-4b9a-bc18-ac511710afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":31038},{"type":"v1","addr":"172.21.15.38:6816","nonce":31038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":31038},{"type":"v1","addr":"172.21.15.38:6819","nonce":31038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":31038},{"type":"v1","addr":"172.21.15.38:6823","nonce":31038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":31038},{"type":"v1","addr":"172.21.15.38:6821","nonce":31038}]},"public_addr":"172.21.15.38:6816/31038","cluster_addr":"172.21.15.38:6819/31038","heartbeat_back_addr":"172.21.15.38:6823/31038","heartbeat_front_addr":"172.21.15.38:6821/31038","state":["exists","up"]},{"osd":1,"uuid":"561f7ced-3fff-4364-8619-6e4ecbc9d256","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":31036},{"type":"v1","addr":"172.21.15.38:6801","nonce":31036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":31036},{"type":"v1","addr":"172.21.15.38:6803","nonce":31036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":31036},{"type":"v1","addr":"172.21.15.38:6807","nonce":31036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":31036},{"type":"v1","addr":"172.21.15.38:6805","nonce":31036}]},"public_addr":"172.21.15.38:6801/31036","cluster_addr":"172.21.15.38:6803/31036","heartbeat_back_addr":"172.21.15.38:6807/31036","heartbeat_front_addr":"172.21.15.38:6805/31036","state":["exists","up"]},{"osd":2,"uuid":"0bb3c806-07af-49f5-b492-d0e33f2de37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":31053},{"type":"v1","addr":"172.21.15.38:6825","nonce":31053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":31053},{"type":"v1","addr":"172.21.15.38:6827","nonce":31053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":31053},{"type":"v1","addr":"172.21.15.38:6831","nonce":31053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":31053},{"type":"v1","addr":"172.21.15.38:6829","nonce":31053}]},"public_addr":"172.21.15.38:6825/31053","cluster_addr":"172.21.15.38:6827/31053","heartbeat_back_addr":"172.21.15.38:6831/31053","heartbeat_front_addr":"172.21.15.38:6829/31053","state":["exists","up"]},{"osd":3,"uuid":"7f6a1e75-7b11-456e-8a4b-510b16226800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":31037},{"type":"v1","addr":"172.21.15.38:6809","nonce":31037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":31037},{"type":"v1","addr":"172.21.15.38:6811","nonce":31037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6815","nonce":31037},{"type":"v1","addr":"172.21.15.38:6817","nonce":31037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":31037},{"type":"v1","addr":"172.21.15.38:6813","nonce":31037}]},"public_addr":"172.21.15.38:6809/31037","cluster_addr":"172.21.15.38:6811/31037","heartbeat_back_addr":"172.21.15.38:6817/31037","heartbeat_front_addr":"172.21.15.38:6813/31037","state":["exists","up"]},{"osd":4,"uuid":"0eca0272-8cfd-469c-a32d-e29730dc0e1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":31294},{"type":"v1","addr":"172.21.15.150:6803","nonce":31294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":31294},{"type":"v1","addr":"172.21.15.150:6805","nonce":31294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":31294},{"type":"v1","addr":"172.21.15.150:6809","nonce":31294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":31294},{"type":"v1","addr":"172.21.15.150:6807","nonce":31294}]},"public_addr":"172.21.15.150:6803/31294","cluster_addr":"172.21.15.150:6805/31294","heartbeat_back_addr":"172.21.15.150:6809/31294","heartbeat_front_addr":"172.21.15.150:6807/31294","state":["exists","up"]},{"osd":5,"uuid":"69d6a7dc-a55a-4ebc-8479-8bb921ddfb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":31295},{"type":"v1","addr":"172.21.15.150:6813","nonce":31295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":31295},{"type":"v1","addr":"172.21.15.150:6816","nonce":31295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":31295},{"type":"v1","addr":"172.21.15.150:6828","nonce":31295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6819","nonce":31295},{"type":"v1","addr":"172.21.15.150:6822","nonce":31295}]},"public_addr":"172.21.15.150:6813/31295","cluster_addr":"172.21.15.150:6816/31295","heartbeat_back_addr":"172.21.15.150:6828/31295","heartbeat_front_addr":"172.21.15.150:6822/31295","state":["exists","up"]},{"osd":6,"uuid":"f0d320f8-c2f0-40bb-b713-526246cf97b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":31297},{"type":"v1","addr":"172.21.15.150:6820","nonce":31297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6823","nonce":31297},{"type":"v1","addr":"172.21.15.150:6827","nonce":31297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":31297},{"type":"v1","addr":"172.21.15.150:6833","nonce":31297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":31297},{"type":"v1","addr":"172.21.15.150:6831","nonce":31297}]},"public_addr":"172.21.15.150:6820/31297","cluster_addr":"172.21.15.150:6827/31297","heartbeat_back_addr":"172.21.15.150:6833/31297","heartbeat_front_addr":"172.21.15.150:6831/31297","state":["exists","up"]},{"osd":7,"uuid":"970b7d02-a189-41b2-96e5-a5a5a57c6476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":31296},{"type":"v1","addr":"172.21.15.150:6812","nonce":31296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":31296},{"type":"v1","addr":"172.21.15.150:6818","nonce":31296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":31296},{"type":"v1","addr":"172.21.15.150:6829","nonce":31296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":31296},{"type":"v1","addr":"172.21.15.150:6824","nonce":31296}]},"public_addr":"172.21.15.150:6812/31296","cluster_addr":"172.21.15.150:6818/31296","heartbeat_back_addr":"172.21.15.150:6829/31296","heartbeat_front_addr":"172.21.15.150:6824/31296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.664300+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.644253+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.651120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.584978+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.561149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.661778+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T17:48:19.299 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.294+0000 7f31db591700 1 -- 172.21.15.38:0/2450733164 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f31b404d350 msgr2=0x7f31b404f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.299 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.294+0000 7f31db591700 1 --2- 172.21.15.38:0/2450733164 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f31b404d350 0x7f31b404f810 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f31cc007ca0 tx=0x7f31cc0081e0).stop 2020-06-12T17:48:19.299 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.294+0000 7f31db591700 1 -- 172.21.15.38:0/2450733164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31d4142350 msgr2=0x7f31d40ad750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.294+0000 7f31db591700 1 --2- 172.21.15.38:0/2450733164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31d4142350 0x7f31d40ad750 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007e60).stop 2020-06-12T17:48:19.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.294+0000 7f31db591700 1 -- 172.21.15.38:0/2450733164 shutdown_connections 2020-06-12T17:48:19.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.294+0000 7f31db591700 1 --2- 172.21.15.38:0/2450733164 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f31b404d350 0x7f31b404f810 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:19.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.294+0000 7f31db591700 1 --2- 172.21.15.38:0/2450733164 >> v2:172.21.15.38:3300/0 conn(0x7f31d4146380 0x7f31d40b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:19.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.294+0000 7f31db591700 1 --2- 172.21.15.38:0/2450733164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31d4142350 0x7f31d40ad750 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:19.301 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.294+0000 7f31db591700 1 -- 172.21.15.38:0/2450733164 >> 172.21.15.38:0/2450733164 conn(0x7f31d40b8420 msgr2=0x7f31d41459b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:19.301 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.295+0000 7f31db591700 1 -- 172.21.15.38:0/2450733164 shutdown_connections 2020-06-12T17:48:19.301 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.295+0000 7f31db591700 1 -- 172.21.15.38:0/2450733164 wait complete. 2020-06-12T17:48:19.308 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-06-12T17:48:19.309 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-12T17:48:19.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.420+0000 7f86e8898700 1 Processor -- start 2020-06-12T17:48:19.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.420+0000 7f86e8898700 1 -- start start 2020-06-12T17:48:19.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.421+0000 7f86e8898700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f86e40b8b20 0x7f86e405b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:19.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.421+0000 7f86e8898700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e4146920 con 0x7f86e4140490 2020-06-12T17:48:19.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.421+0000 7f86e8898700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e40af010 con 0x7f86e405b880 2020-06-12T17:48:19.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.421+0000 7f86e8898700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e40af2b0 con 0x7f86e40b8b20 2020-06-12T17:48:19.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.421+0000 7f86e1d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f86e40b8b20 0x7f86e405b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:19.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.421+0000 7f86e1d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f86e40b8b20 0x7f86e405b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35618/0 (socket says 172.21.15.38:35618) 2020-06-12T17:48:19.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.421+0000 7f86e259c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f86e4140490 0x7f86e4146210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37430/0 (socket says 172.21.15.38:37430) 2020-06-12T17:48:19.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.421+0000 7f86e1d9b700 1 -- 172.21.15.38:0/1610819877 learned_addr learned my addr 172.21.15.38:0/1610819877 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:19.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.421+0000 7f86e1d9b700 1 -- 172.21.15.38:0/1610819877 >> v1:172.21.15.150:6789/0 conn(0x7f86e405b880 legacy=0x7f86e4149c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:19.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.421+0000 7f86e1d9b700 1 -- 172.21.15.38:0/1610819877 >> v1:172.21.15.38:6789/0 conn(0x7f86e4140490 legacy=0x7f86e4146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.421+0000 7f86e159a700 1 -- 172.21.15.38:0/1610819877 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034103967 0 0) 0x7f86e4146920 con 0x7f86e4140490 2020-06-12T17:48:19.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.421+0000 7f86e1d9b700 1 -- 172.21.15.38:0/1610819877 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e41497e0 con 0x7f86e40b8b20 2020-06-12T17:48:19.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.421+0000 7f86e1d9b700 1 --2- 172.21.15.38:0/1610819877 >> v2:172.21.15.38:3300/0 conn(0x7f86e40b8b20 0x7f86e405b420 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f86e40b3ec0 tx=0x7f86d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.421+0000 7f86e1d9b700 1 --2- 172.21.15.38:0/1610819877 >> v2:172.21.15.38:3300/0 conn(0x7f86e40b8b20 0x7f86e405b420 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f86e40b3ec0 tx=0x7f86d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.421+0000 7f86e1d9b700 1 --2- 172.21.15.38:0/1610819877 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86e40b8b20 0x7f86e405b420 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f86e40b3ec0 tx=0x7f86d8007e60).ready entity=mon.0 client_cookie=37667f3176b7d4ef server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:19.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.422+0000 7f86e1d9b700 1 --2- 172.21.15.38:0/1610819877 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86e40b8b20 0x7f86e405b420 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f86e40b3ec0 tx=0x7f86d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.422+0000 7f86e159a700 1 -- 172.21.15.38:0/1610819877 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86d80116a0 con 0x7f86e40b8b20 2020-06-12T17:48:19.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.422+0000 7f86e1d9b700 1 --2- 172.21.15.38:0/1610819877 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86e40b8b20 0x7f86e405b420 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f86e40b3ec0 tx=0x7f86d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.422+0000 7f86e159a700 1 -- 172.21.15.38:0/1610819877 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d8011800 con 0x7f86e40b8b20 2020-06-12T17:48:19.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.422+0000 7f86e1d9b700 1 --2- 172.21.15.38:0/1610819877 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86e40b8b20 0x7f86e405b420 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f86e40b3ec0 tx=0x7f86d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.422+0000 7f86e8898700 1 -- 172.21.15.38:0/1610819877 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86e40b8b20 msgr2=0x7f86e405b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.422+0000 7f86e159a700 1 -- 172.21.15.38:0/1610819877 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86d8011be0 con 0x7f86e40b8b20 2020-06-12T17:48:19.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.422+0000 7f86e8898700 1 --2- 172.21.15.38:0/1610819877 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86e40b8b20 0x7f86e405b420 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f86e40b3ec0 tx=0x7f86d8007e60).stop 2020-06-12T17:48:19.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.422+0000 7f86e8898700 1 -- 172.21.15.38:0/1610819877 shutdown_connections 2020-06-12T17:48:19.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.422+0000 7f86e8898700 1 --2- 172.21.15.38:0/1610819877 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86e40b8b20 0x7f86e405b420 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:19.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.422+0000 7f86e8898700 1 -- 172.21.15.38:0/1610819877 >> 172.21.15.38:0/1610819877 conn(0x7f86e40b94e0 msgr2=0x7f86e40b98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:19.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.422+0000 7f86e8898700 1 -- 172.21.15.38:0/1610819877 shutdown_connections 2020-06-12T17:48:19.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.422+0000 7f86e8898700 1 -- 172.21.15.38:0/1610819877 wait complete. 2020-06-12T17:48:19.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.423+0000 7f86e8898700 1 Processor -- start 2020-06-12T17:48:19.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.423+0000 7f86e8898700 1 -- start start 2020-06-12T17:48:19.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.424+0000 7f86e8898700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f86e40b8b20 0x7f86e4156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:19.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.424+0000 7f86e8898700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86e4140490 0x7f86e4143e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:19.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.424+0000 7f86e8898700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e4145a10 con 0x7f86e405b880 2020-06-12T17:48:19.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.424+0000 7f86e8898700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e41443e0 con 0x7f86e40b8b20 2020-06-12T17:48:19.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.424+0000 7f86e8898700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4144680 con 0x7f86e4140490 2020-06-12T17:48:19.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.424+0000 7f86e259c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f86e405b880 0x7f86e4144dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37436/0 (socket says 172.21.15.38:37436) 2020-06-12T17:48:19.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.424+0000 7f86e259c700 1 -- 172.21.15.38:0/514533885 learned_addr learned my addr 172.21.15.38:0/514533885 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:19.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.424+0000 7f86d37fe700 1 -- 172.21.15.38:0/514533885 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2571693707 0 0) 0x7f86e4145a10 con 0x7f86e405b880 2020-06-12T17:48:19.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.424+0000 7f86d37fe700 1 -- 172.21.15.38:0/514533885 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86c0002fe0 con 0x7f86e405b880 2020-06-12T17:48:19.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.424+0000 7f86e2d9d700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86e4140490 0x7f86e4143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:19.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.424+0000 7f86e1d9b700 1 --2- 172.21.15.38:0/514533885 >> v2:172.21.15.150:3300/0 conn(0x7f86e40b8b20 0x7f86e4156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:19.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.424+0000 7f86d37fe700 1 -- 172.21.15.38:0/514533885 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 540533674 0 0) 0x7f86c0002fe0 con 0x7f86e405b880 2020-06-12T17:48:19.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.424+0000 7f86d37fe700 1 -- 172.21.15.38:0/514533885 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f86e4145a10 con 0x7f86e405b880 2020-06-12T17:48:19.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.424+0000 7f86d37fe700 1 -- 172.21.15.38:0/514533885 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f86dc001ca0 con 0x7f86e405b880 2020-06-12T17:48:19.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.424+0000 7f86d37fe700 1 -- 172.21.15.38:0/514533885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86e4140490 msgr2=0x7f86e4143e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.424+0000 7f86d37fe700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86e4140490 0x7f86e4143e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:19.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.424+0000 7f86d37fe700 1 -- 172.21.15.38:0/514533885 >> v2:172.21.15.150:3300/0 conn(0x7f86e40b8b20 msgr2=0x7f86e4156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86d37fe700 1 --2- 172.21.15.38:0/514533885 >> v2:172.21.15.150:3300/0 conn(0x7f86e40b8b20 0x7f86e4156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:19.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86d37fe700 1 -- 172.21.15.38:0/514533885 >> v1:172.21.15.38:6789/0 conn(0x7f86e405b880 legacy=0x7f86e4144dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86d37fe700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86c00049b0 0x7f86c0004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:19.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86d37fe700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86c0003920 0x7f86c0003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:19.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86d37fe700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86e4140490 0x7f86c00041c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:19.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86d37fe700 1 -- 172.21.15.38:0/514533885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e41443e0 con 0x7f86c00049b0 2020-06-12T17:48:19.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86d37fe700 1 -- 172.21.15.38:0/514533885 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4144680 con 0x7f86c0003920 2020-06-12T17:48:19.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86d37fe700 1 -- 172.21.15.38:0/514533885 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c0005520 con 0x7f86e4140490 2020-06-12T17:48:19.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86e1d9b700 1 --2- 172.21.15.38:0/514533885 >> v2:172.21.15.150:3300/0 conn(0x7f86e40b8b20 0x7f86e4156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:19.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86e259c700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86c00049b0 0x7f86c0004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:19.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86e2d9d700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86e4140490 0x7f86c00041c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:19.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86e1d9b700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86c0003920 0x7f86c0003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:19.444 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86e259c700 1 -- 172.21.15.38:0/514533885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86e4140490 msgr2=0x7f86c00041c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.444 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86e259c700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86e4140490 0x7f86c00041c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:19.444 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86e259c700 1 -- 172.21.15.38:0/514533885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86c0003920 msgr2=0x7f86c0003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.444 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86e259c700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86c0003920 0x7f86c0003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:19.444 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86e259c700 1 -- 172.21.15.38:0/514533885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e4144920 con 0x7f86c00049b0 2020-06-12T17:48:19.445 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86e8898700 1 -- 172.21.15.38:0/514533885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e41454d0 con 0x7f86c00049b0 2020-06-12T17:48:19.445 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86e259c700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86c00049b0 0x7f86c0004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f86dc0014b0 tx=0x7f86dc00ed10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.445 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86e2d9d700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86e4140490 0x7f86c00041c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:19.445 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86e8898700 1 -- 172.21.15.38:0/514533885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e41440a0 con 0x7f86c00049b0 2020-06-12T17:48:19.445 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86e259c700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86c00049b0 0x7f86c0004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f86dc0014b0 tx=0x7f86dc00ed10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.446 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86e259c700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86c00049b0 0x7f86c0004dd0 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f86dc0014b0 tx=0x7f86dc00ed10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:19.446 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86e259c700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86c00049b0 0x7f86c0004dd0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f86dc0014b0 tx=0x7f86dc00ed10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.446 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86d37fe700 1 -- 172.21.15.38:0/514533885 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86dc008d90 con 0x7f86c00049b0 2020-06-12T17:48:19.446 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86e259c700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86c00049b0 0x7f86c0004dd0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f86dc0014b0 tx=0x7f86dc00ed10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.446 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86e259c700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86c00049b0 0x7f86c0004dd0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f86dc0014b0 tx=0x7f86dc00ed10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.447 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86d37fe700 1 -- 172.21.15.38:0/514533885 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc00b250 con 0x7f86c00049b0 2020-06-12T17:48:19.447 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.425+0000 7f86d37fe700 1 -- 172.21.15.38:0/514533885 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86dc00b630 con 0x7f86c00049b0 2020-06-12T17:48:19.447 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.426+0000 7f86e259c700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86c00049b0 0x7f86c0004dd0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f86dc0014b0 tx=0x7f86dc00ed10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.447 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.426+0000 7f86e8898700 1 -- 172.21.15.38:0/514533885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e405d2c0 con 0x7f86c00049b0 2020-06-12T17:48:19.447 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.426+0000 7f86d37fe700 1 -- 172.21.15.38:0/514533885 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f86dc00e060 con 0x7f86c00049b0 2020-06-12T17:48:19.448 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.426+0000 7f86e259c700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86c00049b0 0x7f86c0004dd0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f86dc0014b0 tx=0x7f86dc00ed10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.448 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.427+0000 7f86d37fe700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f86c0055770 0x7f86c0057c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:19.448 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.427+0000 7f86d37fe700 1 -- 172.21.15.38:0/514533885 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f86dc061b10 con 0x7f86c00049b0 2020-06-12T17:48:19.448 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.427+0000 7f86e1d9b700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f86c0055770 0x7f86c0057c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:19.448 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.427+0000 7f86e1d9b700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f86c0055770 0x7f86c0057c30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f86e40b3ec0 tx=0x7f86d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.449 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.427+0000 7f86e1d9b700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f86c0055770 0x7f86c0057c30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f86e40b3ec0 tx=0x7f86d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.449 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.427+0000 7f86e1d9b700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f86c0055770 0x7f86c0057c30 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f86e40b3ec0 tx=0x7f86d8007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:19.449 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.430+0000 7f86e259c700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86c00049b0 0x7f86c0004dd0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f86dc0014b0 tx=0x7f86dc00ed10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.449 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.430+0000 7f86d37fe700 1 -- 172.21.15.38:0/514533885 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f86dc03d270 con 0x7f86c00049b0 2020-06-12T17:48:19.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.582+0000 7f86e8898700 1 -- 172.21.15.38:0/514533885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86e409c480 con 0x7f86c00049b0 2020-06-12T17:48:19.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.583+0000 7f86e259c700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86c00049b0 0x7f86c0004dd0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f86dc0014b0 tx=0x7f86dc00ed10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.583+0000 7f86d37fe700 1 -- 172.21.15.38:0/514533885 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16347 (secure 0 0 0) 0x7f86dc040890 con 0x7f86c00049b0 2020-06-12T17:48:19.587 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:19.587 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":24,"fsid":"8e42a2e7-b187-42c4-a73f-8f812ee62352","created":"2020-06-12T17:47:54.434340+0000","modified":"2020-06-12T17:48:14.851712+0000","last_up_change":"2020-06-12T17:48:03.388718+0000","last_in_change":"2020-06-12T17:48:03.388718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-06-12T17:47:57.558119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-06-12T17:48:07.419264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-06-12T17:48:09.934098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-06-12T17:48:12.497229+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"44ac3dea-67b4-4b9a-bc18-ac511710afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":31038},{"type":"v1","addr":"172.21.15.38:6816","nonce":31038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":31038},{"type":"v1","addr":"172.21.15.38:6819","nonce":31038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":31038},{"type":"v1","addr":"172.21.15.38:6823","nonce":31038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":31038},{"type":"v1","addr":"172.21.15.38:6821","nonce":31038}]},"public_addr":"172.21.15.38:6816/31038","cluster_addr":"172.21.15.38:6819/31038","heartbeat_back_addr":"172.21.15.38:6823/31038","heartbeat_front_addr":"172.21.15.38:6821/31038","state":["exists","up"]},{"osd":1,"uuid":"561f7ced-3fff-4364-8619-6e4ecbc9d256","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":31036},{"type":"v1","addr":"172.21.15.38:6801","nonce":31036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":31036},{"type":"v1","addr":"172.21.15.38:6803","nonce":31036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":31036},{"type":"v1","addr":"172.21.15.38:6807","nonce":31036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":31036},{"type":"v1","addr":"172.21.15.38:6805","nonce":31036}]},"public_addr":"172.21.15.38:6801/31036","cluster_addr":"172.21.15.38:6803/31036","heartbeat_back_addr":"172.21.15.38:6807/31036","heartbeat_front_addr":"172.21.15.38:6805/31036","state":["exists","up"]},{"osd":2,"uuid":"0bb3c806-07af-49f5-b492-d0e33f2de37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":31053},{"type":"v1","addr":"172.21.15.38:6825","nonce":31053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":31053},{"type":"v1","addr":"172.21.15.38:6827","nonce":31053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":31053},{"type":"v1","addr":"172.21.15.38:6831","nonce":31053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":31053},{"type":"v1","addr":"172.21.15.38:6829","nonce":31053}]},"public_addr":"172.21.15.38:6825/31053","cluster_addr":"172.21.15.38:6827/31053","heartbeat_back_addr":"172.21.15.38:6831/31053","heartbeat_front_addr":"172.21.15.38:6829/31053","state":["exists","up"]},{"osd":3,"uuid":"7f6a1e75-7b11-456e-8a4b-510b16226800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":31037},{"type":"v1","addr":"172.21.15.38:6809","nonce":31037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":31037},{"type":"v1","addr":"172.21.15.38:6811","nonce":31037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6815","nonce":31037},{"type":"v1","addr":"172.21.15.38:6817","nonce":31037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":31037},{"type":"v1","addr":"172.21.15.38:6813","nonce":31037}]},"public_addr":"172.21.15.38:6809/31037","cluster_addr":"172.21.15.38:6811/31037","heartbeat_back_addr":"172.21.15.38:6817/31037","heartbeat_front_addr":"172.21.15.38:6813/31037","state":["exists","up"]},{"osd":4,"uuid":"0eca0272-8cfd-469c-a32d-e29730dc0e1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":31294},{"type":"v1","addr":"172.21.15.150:6803","nonce":31294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":31294},{"type":"v1","addr":"172.21.15.150:6805","nonce":31294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":31294},{"type":"v1","addr":"172.21.15.150:6809","nonce":31294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":31294},{"type":"v1","addr":"172.21.15.150:6807","nonce":31294}]},"public_addr":"172.21.15.150:6803/31294","cluster_addr":"172.21.15.150:6805/31294","heartbeat_back_addr":"172.21.15.150:6809/31294","heartbeat_front_addr":"172.21.15.150:6807/31294","state":["exists","up"]},{"osd":5,"uuid":"69d6a7dc-a55a-4ebc-8479-8bb921ddfb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":31295},{"type":"v1","addr":"172.21.15.150:6813","nonce":31295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":31295},{"type":"v1","addr":"172.21.15.150:6816","nonce":31295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":31295},{"type":"v1","addr":"172.21.15.150:6828","nonce":31295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6819","nonce":31295},{"type":"v1","addr":"172.21.15.150:6822","nonce":31295}]},"public_addr":"172.21.15.150:6813/31295","cluster_addr":"172.21.15.150:6816/31295","heartbeat_back_addr":"172.21.15.150:6828/31295","heartbeat_front_addr":"172.21.15.150:6822/31295","state":["exists","up"]},{"osd":6,"uuid":"f0d320f8-c2f0-40bb-b713-526246cf97b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":31297},{"type":"v1","addr":"172.21.15.150:6820","nonce":31297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6823","nonce":31297},{"type":"v1","addr":"172.21.15.150:6827","nonce":31297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":31297},{"type":"v1","addr":"172.21.15.150:6833","nonce":31297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":31297},{"type":"v1","addr":"172.21.15.150:6831","nonce":31297}]},"public_addr":"172.21.15.150:6820/31297","cluster_addr":"172.21.15.150:6827/31297","heartbeat_back_addr":"172.21.15.150:6833/31297","heartbeat_front_addr":"172.21.15.150:6831/31297","state":["exists","up"]},{"osd":7,"uuid":"970b7d02-a189-41b2-96e5-a5a5a57c6476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":31296},{"type":"v1","addr":"172.21.15.150:6812","nonce":31296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":31296},{"type":"v1","addr":"172.21.15.150:6818","nonce":31296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":31296},{"type":"v1","addr":"172.21.15.150:6829","nonce":31296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":31296},{"type":"v1","addr":"172.21.15.150:6824","nonce":31296}]},"public_addr":"172.21.15.150:6812/31296","cluster_addr":"172.21.15.150:6818/31296","heartbeat_back_addr":"172.21.15.150:6829/31296","heartbeat_front_addr":"172.21.15.150:6824/31296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.664300+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.644253+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.651120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.584978+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.561149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.661778+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T17:48:19.588 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.584+0000 7f86e8898700 1 -- 172.21.15.38:0/514533885 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f86c0055770 msgr2=0x7f86c0057c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.584+0000 7f86e8898700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f86c0055770 0x7f86c0057c30 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f86e40b3ec0 tx=0x7f86d8007e60).stop 2020-06-12T17:48:19.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.584+0000 7f86e8898700 1 -- 172.21.15.38:0/514533885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86c00049b0 msgr2=0x7f86c0004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.584+0000 7f86e8898700 1 --2- 172.21.15.38:0/514533885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86c00049b0 0x7f86c0004dd0 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f86dc0014b0 tx=0x7f86dc00ed10).stop 2020-06-12T17:48:19.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.584+0000 7f86e2d9d700 1 -- 172.21.15.38:0/514533885 reap_dead start 2020-06-12T17:48:19.590 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.584+0000 7f86e8898700 1 -- 172.21.15.38:0/514533885 shutdown_connections 2020-06-12T17:48:19.590 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.584+0000 7f86e8898700 1 -- 172.21.15.38:0/514533885 >> 172.21.15.38:0/514533885 conn(0x7f86e40b94e0 msgr2=0x7f86e40b5370 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:19.590 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.584+0000 7f86e8898700 1 -- 172.21.15.38:0/514533885 shutdown_connections 2020-06-12T17:48:19.590 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.585+0000 7f86e8898700 1 -- 172.21.15.38:0/514533885 wait complete. 2020-06-12T17:48:19.599 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 flush_pg_stats 2020-06-12T17:48:19.715 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.711+0000 7fa0d7028700 1 Processor -- start 2020-06-12T17:48:19.715 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.711+0000 7fa0d7028700 1 -- start start 2020-06-12T17:48:19.718 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.712+0000 7fa0d7028700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa0d00b9630 0x7fa0d00b6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:19.718 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.712+0000 7fa0d7028700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d005fda0 con 0x7fa0d00a17d0 2020-06-12T17:48:19.718 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.712+0000 7fa0d7028700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d0149830 con 0x7fa0d005ba80 2020-06-12T17:48:19.718 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.712+0000 7fa0d7028700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d00a1c40 con 0x7fa0d00b9630 2020-06-12T17:48:19.719 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.712+0000 7fa0d4dc4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa0d00b9630 0x7fa0d00b6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:19.719 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.712+0000 7fa0d4dc4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa0d00b9630 0x7fa0d00b6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35634/0 (socket says 172.21.15.38:35634) 2020-06-12T17:48:19.719 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.712+0000 7fa0d4dc4700 1 -- 172.21.15.38:0/1455738471 learned_addr learned my addr 172.21.15.38:0/1455738471 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:19.719 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.712+0000 7fa0cffff700 1 --1- 172.21.15.38:0/1455738471 >> v1:172.21.15.38:6789/0 conn(0x7fa0d00a17d0 0x7fa0d005b370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37450/0 (socket says 172.21.15.38:37450) 2020-06-12T17:48:19.719 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.713+0000 7fa0d4dc4700 1 -- 172.21.15.38:0/1455738471 >> v1:172.21.15.150:6789/0 conn(0x7fa0d005ba80 legacy=0x7fa0d01467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:19.720 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.713+0000 7fa0cf7fe700 1 -- 172.21.15.38:0/1455738471 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937272821 0 0) 0x7fa0d005fda0 con 0x7fa0d00a17d0 2020-06-12T17:48:19.720 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.713+0000 7fa0d4dc4700 1 -- 172.21.15.38:0/1455738471 >> v1:172.21.15.38:6789/0 conn(0x7fa0d00a17d0 legacy=0x7fa0d005b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.720 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.713+0000 7fa0d4dc4700 1 -- 172.21.15.38:0/1455738471 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d0149ad0 con 0x7fa0d00b9630 2020-06-12T17:48:19.722 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.713+0000 7fa0d4dc4700 1 --2- 172.21.15.38:0/1455738471 >> v2:172.21.15.38:3300/0 conn(0x7fa0d00b9630 0x7fa0d00b6bc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa0d005c710 tx=0x7fa0c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.722 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.713+0000 7fa0d4dc4700 1 --2- 172.21.15.38:0/1455738471 >> v2:172.21.15.38:3300/0 conn(0x7fa0d00b9630 0x7fa0d00b6bc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa0d005c710 tx=0x7fa0c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.723 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.713+0000 7fa0d4dc4700 1 --2- 172.21.15.38:0/1455738471 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0d00b9630 0x7fa0d00b6bc0 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7fa0d005c710 tx=0x7fa0c0007e60).ready entity=mon.0 client_cookie=83fd6758d326894 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:19.723 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.713+0000 7fa0d4dc4700 1 --2- 172.21.15.38:0/1455738471 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0d00b9630 0x7fa0d00b6bc0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7fa0d005c710 tx=0x7fa0c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.723 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.713+0000 7fa0cf7fe700 1 -- 172.21.15.38:0/1455738471 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0c00116a0 con 0x7fa0d00b9630 2020-06-12T17:48:19.723 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.713+0000 7fa0d4dc4700 1 --2- 172.21.15.38:0/1455738471 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0d00b9630 0x7fa0d00b6bc0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7fa0d005c710 tx=0x7fa0c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.723 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.713+0000 7fa0cf7fe700 1 -- 172.21.15.38:0/1455738471 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c0011800 con 0x7fa0d00b9630 2020-06-12T17:48:19.724 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.713+0000 7fa0d4dc4700 1 --2- 172.21.15.38:0/1455738471 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0d00b9630 0x7fa0d00b6bc0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7fa0d005c710 tx=0x7fa0c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.724 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.713+0000 7fa0d7028700 1 -- 172.21.15.38:0/1455738471 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0d00b9630 msgr2=0x7fa0d00b6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.724 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.713+0000 7fa0cf7fe700 1 -- 172.21.15.38:0/1455738471 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0c0011be0 con 0x7fa0d00b9630 2020-06-12T17:48:19.724 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.713+0000 7fa0d7028700 1 --2- 172.21.15.38:0/1455738471 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0d00b9630 0x7fa0d00b6bc0 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7fa0d005c710 tx=0x7fa0c0007e60).stop 2020-06-12T17:48:19.724 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.714+0000 7fa0d7028700 1 -- 172.21.15.38:0/1455738471 shutdown_connections 2020-06-12T17:48:19.725 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.714+0000 7fa0d7028700 1 --2- 172.21.15.38:0/1455738471 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0d00b9630 0x7fa0d00b6bc0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:19.725 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.714+0000 7fa0d7028700 1 -- 172.21.15.38:0/1455738471 >> 172.21.15.38:0/1455738471 conn(0x7fa0d00655b0 msgr2=0x7fa0d00659c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:19.725 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.714+0000 7fa0d7028700 1 -- 172.21.15.38:0/1455738471 shutdown_connections 2020-06-12T17:48:19.725 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.714+0000 7fa0d7028700 1 -- 172.21.15.38:0/1455738471 wait complete. 2020-06-12T17:48:19.725 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.715+0000 7fa0d7028700 1 Processor -- start 2020-06-12T17:48:19.726 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.715+0000 7fa0d7028700 1 -- start start 2020-06-12T17:48:19.730 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.715+0000 7fa0d7028700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa0d005ba80 0x7fa0d009e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:19.730 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.715+0000 7fa0d7028700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa0d00b9630 0x7fa0d00bba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:19.730 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.715+0000 7fa0d7028700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d00bbeb0 con 0x7fa0d00a17d0 2020-06-12T17:48:19.731 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.715+0000 7fa0d7028700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d0149250 con 0x7fa0d005ba80 2020-06-12T17:48:19.731 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.715+0000 7fa0d7028700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d0157620 con 0x7fa0d00b9630 2020-06-12T17:48:19.731 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.715+0000 7fa0d4dc4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa0d005ba80 0x7fa0d009e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:19.731 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.715+0000 7fa0d4dc4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa0d005ba80 0x7fa0d009e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35642/0 (socket says 172.21.15.38:35642) 2020-06-12T17:48:19.731 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.715+0000 7fa0d4dc4700 1 -- 172.21.15.38:0/1837401652 learned_addr learned my addr 172.21.15.38:0/1837401652 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:19.732 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.716+0000 7fa0d55c5700 1 --2- 172.21.15.38:0/1837401652 >> v2:172.21.15.150:3300/0 conn(0x7fa0d00b9630 0x7fa0d00bba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:19.732 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.716+0000 7fa0d4dc4700 1 -- 172.21.15.38:0/1837401652 >> v2:172.21.15.150:3300/0 conn(0x7fa0d00b9630 msgr2=0x7fa0d00bba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.732 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.716+0000 7fa0d4dc4700 1 --2- 172.21.15.38:0/1837401652 >> v2:172.21.15.150:3300/0 conn(0x7fa0d00b9630 0x7fa0d00bba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:19.732 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.716+0000 7fa0d4dc4700 1 -- 172.21.15.38:0/1837401652 >> v1:172.21.15.38:6789/0 conn(0x7fa0d00a17d0 legacy=0x7fa0d0153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.732 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.716+0000 7fa0cdffb700 1 -- 172.21.15.38:0/1837401652 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207666662 0 0) 0x7fa0c4001260 con 0x7fa0d00a17d0 2020-06-12T17:48:19.733 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.716+0000 7fa0d4dc4700 1 -- 172.21.15.38:0/1837401652 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d0148fb0 con 0x7fa0d005ba80 2020-06-12T17:48:19.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.716+0000 7fa0d55c5700 1 --2- 172.21.15.38:0/1837401652 >> v2:172.21.15.150:3300/0 conn(0x7fa0d00b9630 0x7fa0d00bba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:48:19.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.716+0000 7fa0d4dc4700 1 --2- 172.21.15.38:0/1837401652 >> v2:172.21.15.38:3300/0 conn(0x7fa0d005ba80 0x7fa0d009e330 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa0d005c710 tx=0x7fa0c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.716+0000 7fa0d4dc4700 1 --2- 172.21.15.38:0/1837401652 >> v2:172.21.15.38:3300/0 conn(0x7fa0d005ba80 0x7fa0d009e330 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa0d005c710 tx=0x7fa0c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.716+0000 7fa0d4dc4700 1 --2- 172.21.15.38:0/1837401652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0d005ba80 0x7fa0d009e330 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7fa0d005c710 tx=0x7fa0c0007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:19.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.716+0000 7fa0d4dc4700 1 --2- 172.21.15.38:0/1837401652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0d005ba80 0x7fa0d009e330 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7fa0d005c710 tx=0x7fa0c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.716+0000 7fa0cdffb700 1 -- 172.21.15.38:0/1837401652 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0c0007340 con 0x7fa0d005ba80 2020-06-12T17:48:19.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.716+0000 7fa0d4dc4700 1 --2- 172.21.15.38:0/1837401652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0d005ba80 0x7fa0d009e330 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7fa0d005c710 tx=0x7fa0c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.716+0000 7fa0cdffb700 1 -- 172.21.15.38:0/1837401652 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c00074a0 con 0x7fa0d005ba80 2020-06-12T17:48:19.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.716+0000 7fa0d4dc4700 1 --2- 172.21.15.38:0/1837401652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0d005ba80 0x7fa0d009e330 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7fa0d005c710 tx=0x7fa0c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.716+0000 7fa0d7028700 1 -- 172.21.15.38:0/1837401652 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d009f250 con 0x7fa0d005ba80 2020-06-12T17:48:19.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.716+0000 7fa0cdffb700 1 -- 172.21.15.38:0/1837401652 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0c00058b0 con 0x7fa0d005ba80 2020-06-12T17:48:19.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.716+0000 7fa0d7028700 1 -- 172.21.15.38:0/1837401652 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d0153490 con 0x7fa0d005ba80 2020-06-12T17:48:19.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.717+0000 7fa0d4dc4700 1 --2- 172.21.15.38:0/1837401652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0d005ba80 0x7fa0d009e330 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7fa0d005c710 tx=0x7fa0c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.717+0000 7fa0d7028700 1 -- 172.21.15.38:0/1837401652 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa0d01579a0 con 0x7fa0d005ba80 2020-06-12T17:48:19.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.717+0000 7fa0cdffb700 1 -- 172.21.15.38:0/1837401652 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fa0c0005ab0 con 0x7fa0d005ba80 2020-06-12T17:48:19.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.717+0000 7fa0d4dc4700 1 --2- 172.21.15.38:0/1837401652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0d005ba80 0x7fa0d009e330 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7fa0d005c710 tx=0x7fa0c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.717+0000 7fa0d4dc4700 1 --2- 172.21.15.38:0/1837401652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0d005ba80 0x7fa0d009e330 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7fa0d005c710 tx=0x7fa0c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.717+0000 7fa0cdffb700 1 --2- 172.21.15.38:0/1837401652 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa0b004d3e0 0x7fa0b004f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:19.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.718+0000 7fa0cdffb700 1 -- 172.21.15.38:0/1837401652 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fa0c0061750 con 0x7fa0d005ba80 2020-06-12T17:48:19.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.718+0000 7fa0cdffb700 1 --2- 172.21.15.38:0/1837401652 >> [v2:172.21.15.38:6814/31038,v1:172.21.15.38:6816/31038] conn(0x7fa0b0054580 0x7fa0b00569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:19.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.718+0000 7fa0cdffb700 1 -- 172.21.15.38:0/1837401652 --> [v2:172.21.15.38:6814/31038,v1:172.21.15.38:6816/31038] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa0b0056f60 con 0x7fa0b0054580 2020-06-12T17:48:19.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.718+0000 7fa0cdffb700 1 -- 172.21.15.38:0/1837401652 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0c0062c70 con 0x7fa0d005ba80 2020-06-12T17:48:19.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.718+0000 7fa0cffff700 1 --2- 172.21.15.38:0/1837401652 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa0b004d3e0 0x7fa0b004f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:19.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.718+0000 7fa0d55c5700 1 --2- 172.21.15.38:0/1837401652 >> [v2:172.21.15.38:6814/31038,v1:172.21.15.38:6816/31038] conn(0x7fa0b0054580 0x7fa0b00569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:19.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.718+0000 7fa0cffff700 1 --2- 172.21.15.38:0/1837401652 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa0b004d3e0 0x7fa0b004f8a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa0c4000ee0 tx=0x7fa0c4001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.718+0000 7fa0cffff700 1 --2- 172.21.15.38:0/1837401652 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa0b004d3e0 0x7fa0b004f8a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa0c4000ee0 tx=0x7fa0c4001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.718+0000 7fa0cffff700 1 --2- 172.21.15.38:0/1837401652 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa0b004d3e0 0x7fa0b004f8a0 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7fa0c4000ee0 tx=0x7fa0c4001820).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:19.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.718+0000 7fa0d55c5700 1 --2- 172.21.15.38:0/1837401652 >> [v2:172.21.15.38:6814/31038,v1:172.21.15.38:6816/31038] conn(0x7fa0b0054580 0x7fa0b00569a0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:19.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.719+0000 7fa0cdffb700 1 -- 172.21.15.38:0/1837401652 <== osd.0 v2:172.21.15.38:6814/31038 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7fa0b0056f60 con 0x7fa0b0054580 2020-06-12T17:48:19.740 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.737+0000 7fa0d7028700 1 -- 172.21.15.38:0/1837401652 --> [v2:172.21.15.38:6814/31038,v1:172.21.15.38:6816/31038] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa0d009f3e0 con 0x7fa0b0054580 2020-06-12T17:48:19.741 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.737+0000 7fa0cdffb700 1 -- 172.21.15.38:0/1837401652 <== osd.0 v2:172.21.15.38:6814/31038 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa0d009f3e0 con 0x7fa0b0054580 2020-06-12T17:48:19.742 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.737+0000 7fa0d7028700 1 -- 172.21.15.38:0/1837401652 >> [v2:172.21.15.38:6814/31038,v1:172.21.15.38:6816/31038] conn(0x7fa0b0054580 msgr2=0x7fa0b00569a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.742 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.737+0000 7fa0d7028700 1 --2- 172.21.15.38:0/1837401652 >> [v2:172.21.15.38:6814/31038,v1:172.21.15.38:6816/31038] conn(0x7fa0b0054580 0x7fa0b00569a0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:19.742 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.738+0000 7fa0d7028700 1 -- 172.21.15.38:0/1837401652 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa0b004d3e0 msgr2=0x7fa0b004f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.742 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.738+0000 7fa0d7028700 1 --2- 172.21.15.38:0/1837401652 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa0b004d3e0 0x7fa0b004f8a0 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7fa0c4000ee0 tx=0x7fa0c4001820).stop 2020-06-12T17:48:19.742 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.738+0000 7fa0d7028700 1 -- 172.21.15.38:0/1837401652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0d005ba80 msgr2=0x7fa0d009e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.743 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.738+0000 7fa0d7028700 1 --2- 172.21.15.38:0/1837401652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0d005ba80 0x7fa0d009e330 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7fa0d005c710 tx=0x7fa0c0007e60).stop 2020-06-12T17:48:19.743 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.738+0000 7fa0d55c5700 1 -- 172.21.15.38:0/1837401652 reap_dead start 2020-06-12T17:48:19.743 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.738+0000 7fa0d7028700 1 -- 172.21.15.38:0/1837401652 shutdown_connections 2020-06-12T17:48:19.743 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.738+0000 7fa0d7028700 1 --2- 172.21.15.38:0/1837401652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0d005ba80 0x7fa0d009e330 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:19.743 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.738+0000 7fa0d7028700 1 -- 172.21.15.38:0/1837401652 >> 172.21.15.38:0/1837401652 conn(0x7fa0d00655b0 msgr2=0x7fa0d0143f50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:19.743 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.738+0000 7fa0d7028700 1 -- 172.21.15.38:0/1837401652 shutdown_connections 2020-06-12T17:48:19.744 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.738+0000 7fa0d7028700 1 -- 172.21.15.38:0/1837401652 wait complete. 2020-06-12T17:48:19.751 INFO:teuthology.orchestra.run.smithi038.stdout:55834574853 2020-06-12T17:48:19.751 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 flush_pg_stats 2020-06-12T17:48:19.866 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.863+0000 7f08ee054700 1 Processor -- start 2020-06-12T17:48:19.867 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.863+0000 7f08ee054700 1 -- start start 2020-06-12T17:48:19.869 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.864+0000 7f08ee054700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f08e81401f0 0x7f08e809cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:19.870 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.864+0000 7f08ee054700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f08e80adaf0 0x7f08e8146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:19.870 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.864+0000 7f08ee054700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e80aecd0 con 0x7f08e80b3f40 2020-06-12T17:48:19.870 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.864+0000 7f08ee054700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e809d420 con 0x7f08e80adaf0 2020-06-12T17:48:19.870 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.864+0000 7f08ee054700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e809d6c0 con 0x7f08e81401f0 2020-06-12T17:48:19.871 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.864+0000 7f08e6ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f08e80adaf0 0x7f08e8146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:19.871 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.864+0000 7f08e7fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f08e80b3f40 0x7f08e8143020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37470/0 (socket says 172.21.15.38:37470) 2020-06-12T17:48:19.871 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.864+0000 7f08e7fff700 1 -- 172.21.15.38:0/4244694027 learned_addr learned my addr 172.21.15.38:0/4244694027 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:19.871 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.864+0000 7f08e77fe700 1 --2- 172.21.15.38:0/4244694027 >> v2:172.21.15.150:3300/0 conn(0x7f08e81401f0 0x7f08e809cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:19.871 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.864+0000 7f08e6ffd700 1 -- 172.21.15.38:0/4244694027 >> v2:172.21.15.150:3300/0 conn(0x7f08e81401f0 msgr2=0x7f08e809cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:19.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.864+0000 7f08e6ffd700 1 --2- 172.21.15.38:0/4244694027 >> v2:172.21.15.150:3300/0 conn(0x7f08e81401f0 0x7f08e809cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:19.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.864+0000 7f08e6ffd700 1 -- 172.21.15.38:0/4244694027 >> v1:172.21.15.38:6789/0 conn(0x7f08e80b3f40 legacy=0x7f08e8143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.864+0000 7f08e67fc700 1 -- 172.21.15.38:0/4244694027 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962465574 0 0) 0x7f08e80aecd0 con 0x7f08e80b3f40 2020-06-12T17:48:19.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.864+0000 7f08e6ffd700 1 -- 172.21.15.38:0/4244694027 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e80adf80 con 0x7f08e80adaf0 2020-06-12T17:48:19.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.864+0000 7f08e77fe700 1 --2- 172.21.15.38:0/4244694027 >> v2:172.21.15.150:3300/0 conn(0x7f08e81401f0 0x7f08e809cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:19.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.864+0000 7f08e6ffd700 1 --2- 172.21.15.38:0/4244694027 >> v2:172.21.15.38:3300/0 conn(0x7f08e80adaf0 0x7f08e8146cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f08dc002f30 tx=0x7f08dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.864+0000 7f08e6ffd700 1 --2- 172.21.15.38:0/4244694027 >> v2:172.21.15.38:3300/0 conn(0x7f08e80adaf0 0x7f08e8146cf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f08dc002f30 tx=0x7f08dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.864+0000 7f08e6ffd700 1 --2- 172.21.15.38:0/4244694027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08e80adaf0 0x7f08e8146cf0 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7f08dc002f30 tx=0x7f08dc007e60).ready entity=mon.0 client_cookie=9cf2ab850bed0ffa server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:19.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.865+0000 7f08e6ffd700 1 --2- 172.21.15.38:0/4244694027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08e80adaf0 0x7f08e8146cf0 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f08dc002f30 tx=0x7f08dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.865+0000 7f08e67fc700 1 -- 172.21.15.38:0/4244694027 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08dc011430 con 0x7f08e80adaf0 2020-06-12T17:48:19.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.865+0000 7f08e6ffd700 1 --2- 172.21.15.38:0/4244694027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08e80adaf0 0x7f08e8146cf0 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f08dc002f30 tx=0x7f08dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.874 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.865+0000 7f08e6ffd700 1 --2- 172.21.15.38:0/4244694027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08e80adaf0 0x7f08e8146cf0 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f08dc002f30 tx=0x7f08dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.874 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.865+0000 7f08e67fc700 1 -- 172.21.15.38:0/4244694027 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08dc011590 con 0x7f08e80adaf0 2020-06-12T17:48:19.874 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.865+0000 7f08e67fc700 1 -- 172.21.15.38:0/4244694027 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08dc011930 con 0x7f08e80adaf0 2020-06-12T17:48:19.874 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.865+0000 7f08ee054700 1 -- 172.21.15.38:0/4244694027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08e80adaf0 msgr2=0x7f08e8146cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.865+0000 7f08ee054700 1 --2- 172.21.15.38:0/4244694027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08e80adaf0 0x7f08e8146cf0 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7f08dc002f30 tx=0x7f08dc007e60).stop 2020-06-12T17:48:19.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.865+0000 7f08ee054700 1 -- 172.21.15.38:0/4244694027 shutdown_connections 2020-06-12T17:48:19.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.865+0000 7f08ee054700 1 --2- 172.21.15.38:0/4244694027 >> v2:172.21.15.150:3300/0 conn(0x7f08e81401f0 0x7f08e809cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:19.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.865+0000 7f08ee054700 1 --2- 172.21.15.38:0/4244694027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08e80adaf0 0x7f08e8146cf0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:19.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.865+0000 7f08ee054700 1 -- 172.21.15.38:0/4244694027 >> 172.21.15.38:0/4244694027 conn(0x7f08e80b8410 msgr2=0x7f08e80b8820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:19.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.865+0000 7f08ee054700 1 -- 172.21.15.38:0/4244694027 shutdown_connections 2020-06-12T17:48:19.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.865+0000 7f08ee054700 1 -- 172.21.15.38:0/4244694027 wait complete. 2020-06-12T17:48:19.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.866+0000 7f08ee054700 1 Processor -- start 2020-06-12T17:48:19.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.866+0000 7f08ee054700 1 -- start start 2020-06-12T17:48:19.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.867+0000 7f08ee054700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f08e81401f0 0x7f08e813f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:19.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.867+0000 7f08ee054700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e813fa90 con 0x7f08e80adaf0 2020-06-12T17:48:19.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.867+0000 7f08ee054700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e8144a80 con 0x7f08e80b3f40 2020-06-12T17:48:19.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.867+0000 7f08ee054700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e8144d20 con 0x7f08e81401f0 2020-06-12T17:48:19.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.867+0000 7f08e7fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f08e81401f0 0x7f08e813f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:19.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.867+0000 7f08e77fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f08e80adaf0 0x7f08e80b1800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37472/0 (socket says 172.21.15.38:37472) 2020-06-12T17:48:19.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.867+0000 7f08e77fe700 1 -- 172.21.15.38:0/2496638138 learned_addr learned my addr 172.21.15.38:0/2496638138 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:19.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.867+0000 7f08e4ff9700 1 -- 172.21.15.38:0/2496638138 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55741185 0 0) 0x7f08d8001ec0 con 0x7f08e80adaf0 2020-06-12T17:48:19.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.867+0000 7f08e4ff9700 1 -- 172.21.15.38:0/2496638138 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08c8002fe0 con 0x7f08e80adaf0 2020-06-12T17:48:19.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.867+0000 7f08e7fff700 1 -- 172.21.15.38:0/2496638138 >> v1:172.21.15.150:6789/0 conn(0x7f08e80b3f40 legacy=0x7f08e80b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.867+0000 7f08e7fff700 1 -- 172.21.15.38:0/2496638138 >> v1:172.21.15.38:6789/0 conn(0x7f08e80adaf0 legacy=0x7f08e80b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.867+0000 7f08e7fff700 1 -- 172.21.15.38:0/2496638138 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e81510a0 con 0x7f08e81401f0 2020-06-12T17:48:19.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.867+0000 7f08e7fff700 1 --2- 172.21.15.38:0/2496638138 >> v2:172.21.15.38:3300/0 conn(0x7f08e81401f0 0x7f08e813f630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f08e0001210 tx=0x7f08e0001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.868+0000 7f08e7fff700 1 --2- 172.21.15.38:0/2496638138 >> v2:172.21.15.38:3300/0 conn(0x7f08e81401f0 0x7f08e813f630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f08e0001210 tx=0x7f08e0001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.868+0000 7f08e7fff700 1 --2- 172.21.15.38:0/2496638138 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08e81401f0 0x7f08e813f630 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f08e0001210 tx=0x7f08e0001960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:19.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.868+0000 7f08e7fff700 1 --2- 172.21.15.38:0/2496638138 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08e81401f0 0x7f08e813f630 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f08e0001210 tx=0x7f08e0001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.868+0000 7f08e4ff9700 1 -- 172.21.15.38:0/2496638138 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08e0005e30 con 0x7f08e81401f0 2020-06-12T17:48:19.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.868+0000 7f08e7fff700 1 --2- 172.21.15.38:0/2496638138 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08e81401f0 0x7f08e813f630 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f08e0001210 tx=0x7f08e0001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.868+0000 7f08e4ff9700 1 -- 172.21.15.38:0/2496638138 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e0012410 con 0x7f08e81401f0 2020-06-12T17:48:19.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.868+0000 7f08e7fff700 1 --2- 172.21.15.38:0/2496638138 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08e81401f0 0x7f08e813f630 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f08e0001210 tx=0x7f08e0001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.868+0000 7f08ee054700 1 -- 172.21.15.38:0/2496638138 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e8144030 con 0x7f08e81401f0 2020-06-12T17:48:19.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.868+0000 7f08e4ff9700 1 -- 172.21.15.38:0/2496638138 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08e00127b0 con 0x7f08e81401f0 2020-06-12T17:48:19.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.868+0000 7f08ee054700 1 -- 172.21.15.38:0/2496638138 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e80b2990 con 0x7f08e81401f0 2020-06-12T17:48:19.891 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.868+0000 7f08e7fff700 1 --2- 172.21.15.38:0/2496638138 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08e81401f0 0x7f08e813f630 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f08e0001210 tx=0x7f08e0001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.891 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.869+0000 7f08ee054700 1 -- 172.21.15.38:0/2496638138 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f08e8144e90 con 0x7f08e81401f0 2020-06-12T17:48:19.891 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.869+0000 7f08e4ff9700 1 -- 172.21.15.38:0/2496638138 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f08e00129b0 con 0x7f08e81401f0 2020-06-12T17:48:19.891 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.869+0000 7f08e7fff700 1 --2- 172.21.15.38:0/2496638138 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08e81401f0 0x7f08e813f630 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f08e0001210 tx=0x7f08e0001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.891 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.869+0000 7f08e7fff700 1 --2- 172.21.15.38:0/2496638138 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08e81401f0 0x7f08e813f630 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f08e0001210 tx=0x7f08e0001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.891 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.869+0000 7f08e4ff9700 1 --2- 172.21.15.38:0/2496638138 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f08c804d8a0 0x7f08c804fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:19.892 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.869+0000 7f08e4ff9700 1 -- 172.21.15.38:0/2496638138 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f08e00613c0 con 0x7f08e81401f0 2020-06-12T17:48:19.892 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.869+0000 7f08e4ff9700 1 --2- 172.21.15.38:0/2496638138 >> [v2:172.21.15.38:6800/31036,v1:172.21.15.38:6801/31036] conn(0x7f08c80549d0 0x7f08c8056df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:19.892 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.869+0000 7f08e4ff9700 1 -- 172.21.15.38:0/2496638138 --> [v2:172.21.15.38:6800/31036,v1:172.21.15.38:6801/31036] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f08c80573b0 con 0x7f08c80549d0 2020-06-12T17:48:19.893 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.869+0000 7f08e4ff9700 1 -- 172.21.15.38:0/2496638138 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08e0062860 con 0x7f08e81401f0 2020-06-12T17:48:19.894 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.869+0000 7f08e77fe700 1 --2- 172.21.15.38:0/2496638138 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f08c804d8a0 0x7f08c804fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:19.894 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.869+0000 7f08e6ffd700 1 --2- 172.21.15.38:0/2496638138 >> [v2:172.21.15.38:6800/31036,v1:172.21.15.38:6801/31036] conn(0x7f08c80549d0 0x7f08c8056df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:19.894 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.869+0000 7f08e77fe700 1 --2- 172.21.15.38:0/2496638138 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f08c804d8a0 0x7f08c804fd60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f08d8002f30 tx=0x7f08d8002190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.894 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.870+0000 7f08e77fe700 1 --2- 172.21.15.38:0/2496638138 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f08c804d8a0 0x7f08c804fd60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f08d8002f30 tx=0x7f08d8002190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:19.894 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.870+0000 7f08e77fe700 1 --2- 172.21.15.38:0/2496638138 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f08c804d8a0 0x7f08c804fd60 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f08d8002f30 tx=0x7f08d8002190).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:19.895 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.870+0000 7f08e6ffd700 1 --2- 172.21.15.38:0/2496638138 >> [v2:172.21.15.38:6800/31036,v1:172.21.15.38:6801/31036] conn(0x7f08c80549d0 0x7f08c8056df0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:19.895 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.870+0000 7f08e4ff9700 1 -- 172.21.15.38:0/2496638138 <== osd.1 v2:172.21.15.38:6800/31036 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f08c80573b0 con 0x7f08c80549d0 2020-06-12T17:48:19.896 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.888+0000 7f08ee054700 1 -- 172.21.15.38:0/2496638138 --> [v2:172.21.15.38:6800/31036,v1:172.21.15.38:6801/31036] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f08e8067b20 con 0x7f08c80549d0 2020-06-12T17:48:19.897 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.889+0000 7f08e4ff9700 1 -- 172.21.15.38:0/2496638138 <== osd.1 v2:172.21.15.38:6800/31036 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f08e8067b20 con 0x7f08c80549d0 2020-06-12T17:48:19.897 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.889+0000 7f08ee054700 1 -- 172.21.15.38:0/2496638138 >> [v2:172.21.15.38:6800/31036,v1:172.21.15.38:6801/31036] conn(0x7f08c80549d0 msgr2=0x7f08c8056df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.897 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.889+0000 7f08ee054700 1 --2- 172.21.15.38:0/2496638138 >> [v2:172.21.15.38:6800/31036,v1:172.21.15.38:6801/31036] conn(0x7f08c80549d0 0x7f08c8056df0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:19.897 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.889+0000 7f08ee054700 1 -- 172.21.15.38:0/2496638138 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f08c804d8a0 msgr2=0x7f08c804fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.897 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.889+0000 7f08ee054700 1 --2- 172.21.15.38:0/2496638138 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f08c804d8a0 0x7f08c804fd60 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f08d8002f30 tx=0x7f08d8002190).stop 2020-06-12T17:48:19.898 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.889+0000 7f08ee054700 1 -- 172.21.15.38:0/2496638138 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08e81401f0 msgr2=0x7f08e813f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:19.898 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.889+0000 7f08ee054700 1 --2- 172.21.15.38:0/2496638138 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08e81401f0 0x7f08e813f630 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f08e0001210 tx=0x7f08e0001960).stop 2020-06-12T17:48:19.898 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.889+0000 7f08e7fff700 1 -- 172.21.15.38:0/2496638138 reap_dead start 2020-06-12T17:48:19.898 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.889+0000 7f08ee054700 1 -- 172.21.15.38:0/2496638138 shutdown_connections 2020-06-12T17:48:19.898 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.889+0000 7f08ee054700 1 --2- 172.21.15.38:0/2496638138 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08e81401f0 0x7f08e813f630 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:19.899 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.889+0000 7f08ee054700 1 -- 172.21.15.38:0/2496638138 >> 172.21.15.38:0/2496638138 conn(0x7f08e80b8410 msgr2=0x7f08e8066ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:19.899 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.889+0000 7f08ee054700 1 -- 172.21.15.38:0/2496638138 shutdown_connections 2020-06-12T17:48:19.899 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:19.889+0000 7f08ee054700 1 -- 172.21.15.38:0/2496638138 wait complete. 2020-06-12T17:48:19.902 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2020-06-12T17:48:19.903 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 flush_pg_stats 2020-06-12T17:48:20.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.014+0000 7efc06808700 1 Processor -- start 2020-06-12T17:48:20.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.014+0000 7efc06808700 1 -- start start 2020-06-12T17:48:20.021 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.015+0000 7efc06808700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efc00066eb0 0x7efc000b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:20.021 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.015+0000 7efc06808700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc001424b0 con 0x7efc00143bc0 2020-06-12T17:48:20.021 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.015+0000 7efc06808700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc00067290 con 0x7efc0005b420 2020-06-12T17:48:20.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.015+0000 7efc06808700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc000b4950 con 0x7efc00066eb0 2020-06-12T17:48:20.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.015+0000 7efbfffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efc00066eb0 0x7efc000b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.015+0000 7efc04da5700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7efc00143bc0 0x7efc0009beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37482/0 (socket says 172.21.15.38:37482) 2020-06-12T17:48:20.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.015+0000 7efbfffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efc00066eb0 0x7efc000b44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35666/0 (socket says 172.21.15.38:35666) 2020-06-12T17:48:20.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.015+0000 7efc04da5700 1 -- 172.21.15.38:0/927835785 learned_addr learned my addr 172.21.15.38:0/927835785 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:20.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.016+0000 7efbfffff700 1 -- 172.21.15.38:0/927835785 >> v1:172.21.15.150:6789/0 conn(0x7efc0005b420 legacy=0x7efc0009b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.016+0000 7efbfffff700 1 -- 172.21.15.38:0/927835785 >> v1:172.21.15.38:6789/0 conn(0x7efc00143bc0 legacy=0x7efc0009beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.016+0000 7efbfeffd700 1 -- 172.21.15.38:0/927835785 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2021813498 0 0) 0x7efc001424b0 con 0x7efc00143bc0 2020-06-12T17:48:20.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.016+0000 7efbfffff700 1 -- 172.21.15.38:0/927835785 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0009c5c0 con 0x7efc00066eb0 2020-06-12T17:48:20.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.016+0000 7efbfffff700 1 --2- 172.21.15.38:0/927835785 >> v2:172.21.15.38:3300/0 conn(0x7efc00066eb0 0x7efc000b44f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efbf0002f30 tx=0x7efbf0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.016+0000 7efbfffff700 1 --2- 172.21.15.38:0/927835785 >> v2:172.21.15.38:3300/0 conn(0x7efc00066eb0 0x7efc000b44f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efbf0002f30 tx=0x7efbf0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.016+0000 7efbfffff700 1 --2- 172.21.15.38:0/927835785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc00066eb0 0x7efc000b44f0 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7efbf0002f30 tx=0x7efbf0007e60).ready entity=mon.0 client_cookie=e675f750fbabaef2 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.016+0000 7efbfffff700 1 --2- 172.21.15.38:0/927835785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc00066eb0 0x7efc000b44f0 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7efbf0002f30 tx=0x7efbf0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.016+0000 7efbfeffd700 1 -- 172.21.15.38:0/927835785 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbf0012730 con 0x7efc00066eb0 2020-06-12T17:48:20.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.016+0000 7efbfffff700 1 --2- 172.21.15.38:0/927835785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc00066eb0 0x7efc000b44f0 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7efbf0002f30 tx=0x7efbf0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.016+0000 7efbfffff700 1 --2- 172.21.15.38:0/927835785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc00066eb0 0x7efc000b44f0 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7efbf0002f30 tx=0x7efbf0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.016+0000 7efbfeffd700 1 -- 172.21.15.38:0/927835785 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf0012890 con 0x7efc00066eb0 2020-06-12T17:48:20.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.016+0000 7efbfeffd700 1 -- 172.21.15.38:0/927835785 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbf0012c30 con 0x7efc00066eb0 2020-06-12T17:48:20.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.016+0000 7efc06808700 1 -- 172.21.15.38:0/927835785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc00066eb0 msgr2=0x7efc000b44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.016+0000 7efc06808700 1 --2- 172.21.15.38:0/927835785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc00066eb0 0x7efc000b44f0 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7efbf0002f30 tx=0x7efbf0007e60).stop 2020-06-12T17:48:20.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.016+0000 7efc06808700 1 -- 172.21.15.38:0/927835785 shutdown_connections 2020-06-12T17:48:20.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.016+0000 7efc06808700 1 --2- 172.21.15.38:0/927835785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc00066eb0 0x7efc000b44f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.016+0000 7efc06808700 1 -- 172.21.15.38:0/927835785 >> 172.21.15.38:0/927835785 conn(0x7efc000b8410 msgr2=0x7efc000b8820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:20.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.016+0000 7efc06808700 1 -- 172.21.15.38:0/927835785 shutdown_connections 2020-06-12T17:48:20.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.016+0000 7efc06808700 1 -- 172.21.15.38:0/927835785 wait complete. 2020-06-12T17:48:20.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.017+0000 7efc06808700 1 Processor -- start 2020-06-12T17:48:20.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.017+0000 7efc06808700 1 -- start start 2020-06-12T17:48:20.031 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.018+0000 7efc06808700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efc00143bc0 0x7efc0009a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.031 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.018+0000 7efc06808700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc00065d90 con 0x7efc00066eb0 2020-06-12T17:48:20.032 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.018+0000 7efc06808700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc000b1d70 con 0x7efc0005b420 2020-06-12T17:48:20.032 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.018+0000 7efc06808700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc000b24b0 con 0x7efc00143bc0 2020-06-12T17:48:20.032 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.018+0000 7efbff7fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7efc00066eb0 0x7efc000ad5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37488/0 (socket says 172.21.15.38:37488) 2020-06-12T17:48:20.032 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.018+0000 7efbff7fe700 1 -- 172.21.15.38:0/3195155181 learned_addr learned my addr 172.21.15.38:0/3195155181 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:20.032 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.018+0000 7efc04da5700 1 --2- 172.21.15.38:0/3195155181 >> v2:172.21.15.150:3300/0 conn(0x7efc00143bc0 0x7efc0009a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.033 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.018+0000 7efbfd7fa700 1 -- 172.21.15.38:0/3195155181 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293150943 0 0) 0x7efc00065d90 con 0x7efc00066eb0 2020-06-12T17:48:20.033 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efbfd7fa700 1 -- 172.21.15.38:0/3195155181 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbe0002fe0 con 0x7efc00066eb0 2020-06-12T17:48:20.033 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efbfd7fa700 1 -- 172.21.15.38:0/3195155181 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2320225005 0 0) 0x7efc000b1d70 con 0x7efc0005b420 2020-06-12T17:48:20.033 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efbfd7fa700 1 -- 172.21.15.38:0/3195155181 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc00065d90 con 0x7efc0005b420 2020-06-12T17:48:20.033 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efbfd7fa700 1 -- 172.21.15.38:0/3195155181 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 214711108 0 0) 0x7efbe0002fe0 con 0x7efc00066eb0 2020-06-12T17:48:20.034 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efbfd7fa700 1 -- 172.21.15.38:0/3195155181 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efc000b1d70 con 0x7efc00066eb0 2020-06-12T17:48:20.034 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efbfd7fa700 1 -- 172.21.15.38:0/3195155181 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7efbf40018d0 con 0x7efc00066eb0 2020-06-12T17:48:20.034 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efbfd7fa700 1 -- 172.21.15.38:0/3195155181 >> v2:172.21.15.150:3300/0 conn(0x7efc00143bc0 msgr2=0x7efc0009a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.035 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efbfd7fa700 1 --2- 172.21.15.38:0/3195155181 >> v2:172.21.15.150:3300/0 conn(0x7efc00143bc0 0x7efc0009a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.035 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efbfd7fa700 1 -- 172.21.15.38:0/3195155181 >> v1:172.21.15.150:6789/0 conn(0x7efc0005b420 legacy=0x7efc001415d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.035 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efbfd7fa700 1 -- 172.21.15.38:0/3195155181 >> v1:172.21.15.38:6789/0 conn(0x7efc00066eb0 legacy=0x7efc000ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.035 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efbfd7fa700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efbe0004b20 0x7efbe0004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.035 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efbfd7fa700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efbe0003ab0 0x7efbe0003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.036 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efbfd7fa700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efbe0004350 0x7efbe000b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.036 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efbfd7fa700 1 -- 172.21.15.38:0/3195155181 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbe0004960 con 0x7efbe0003ab0 2020-06-12T17:48:20.036 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efbfd7fa700 1 -- 172.21.15.38:0/3195155181 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbe000bbb0 con 0x7efbe0004350 2020-06-12T17:48:20.036 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efbfd7fa700 1 -- 172.21.15.38:0/3195155181 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbe000bd70 con 0x7efbe0004b20 2020-06-12T17:48:20.036 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efc04da5700 1 --2- 172.21.15.38:0/3195155181 >> v2:172.21.15.150:3300/0 conn(0x7efc00143bc0 0x7efc0009a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:20.036 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efbff7fe700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efbe0003ab0 0x7efbe0003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.037 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efbfffff700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efbe0004b20 0x7efbe0004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.037 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efc04da5700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efbe0004350 0x7efbe000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.037 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efbff7fe700 1 -- 172.21.15.38:0/3195155181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efbe0004b20 msgr2=0x7efbe0004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.037 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efbff7fe700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efbe0004b20 0x7efbe0004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.037 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efbff7fe700 1 -- 172.21.15.38:0/3195155181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efbe0004350 msgr2=0x7efbe000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.038 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efbff7fe700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efbe0004350 0x7efbe000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.038 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efbff7fe700 1 -- 172.21.15.38:0/3195155181 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc000b2010 con 0x7efbe0003ab0 2020-06-12T17:48:20.038 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efc04da5700 1 -- 172.21.15.38:0/3195155181 reap_dead start 2020-06-12T17:48:20.038 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efc06808700 1 -- 172.21.15.38:0/3195155181 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc0009ac00 con 0x7efbe0003ab0 2020-06-12T17:48:20.038 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efbff7fe700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efbe0003ab0 0x7efbe0003ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efc0009c400 tx=0x7efbf400e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.039 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efc06808700 1 -- 172.21.15.38:0/3195155181 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc00065b30 con 0x7efbe0003ab0 2020-06-12T17:48:20.039 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efbff7fe700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efbe0003ab0 0x7efbe0003ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efc0009c400 tx=0x7efbf400e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.039 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.019+0000 7efbff7fe700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efbe0003ab0 0x7efbe0003ef0 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7efc0009c400 tx=0x7efbf400e960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.039 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.020+0000 7efbff7fe700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efbe0003ab0 0x7efbe0003ef0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7efc0009c400 tx=0x7efbf400e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.039 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.020+0000 7efbfd7fa700 1 -- 172.21.15.38:0/3195155181 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbf400ee60 con 0x7efbe0003ab0 2020-06-12T17:48:20.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.020+0000 7efbff7fe700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efbe0003ab0 0x7efbe0003ef0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7efc0009c400 tx=0x7efbf400e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.020+0000 7efbfd7fa700 1 -- 172.21.15.38:0/3195155181 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf40089c0 con 0x7efbe0003ab0 2020-06-12T17:48:20.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.020+0000 7efbff7fe700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efbe0003ab0 0x7efbe0003ef0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7efc0009c400 tx=0x7efbf400e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.020+0000 7efbfd7fa700 1 -- 172.21.15.38:0/3195155181 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efbf4008d20 con 0x7efbe0003ab0 2020-06-12T17:48:20.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.020+0000 7efc06808700 1 -- 172.21.15.38:0/3195155181 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efbdc003580 con 0x7efbe0003ab0 2020-06-12T17:48:20.041 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.020+0000 7efbff7fe700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efbe0003ab0 0x7efbe0003ef0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7efc0009c400 tx=0x7efbf400e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.041 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.021+0000 7efbfd7fa700 1 -- 172.21.15.38:0/3195155181 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7efbf40101a0 con 0x7efbe0003ab0 2020-06-12T17:48:20.041 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.021+0000 7efbff7fe700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efbe0003ab0 0x7efbe0003ef0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7efc0009c400 tx=0x7efbf400e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.041 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.021+0000 7efbff7fe700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efbe0003ab0 0x7efbe0003ef0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7efc0009c400 tx=0x7efbf400e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.041 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.021+0000 7efbfd7fa700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efbe0051770 0x7efbe0053c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.042 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.021+0000 7efbfd7fa700 1 -- 172.21.15.38:0/3195155181 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7efbf4061300 con 0x7efbe0003ab0 2020-06-12T17:48:20.042 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.021+0000 7efbfd7fa700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.38:6824/31053,v1:172.21.15.38:6825/31053] conn(0x7efbe00586b0 0x7efbe005aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.042 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.021+0000 7efbfd7fa700 1 -- 172.21.15.38:0/3195155181 --> [v2:172.21.15.38:6824/31053,v1:172.21.15.38:6825/31053] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efbe005b090 con 0x7efbe00586b0 2020-06-12T17:48:20.042 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.021+0000 7efbfd7fa700 1 -- 172.21.15.38:0/3195155181 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7efbf40627a0 con 0x7efbe0003ab0 2020-06-12T17:48:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.021+0000 7efbfffff700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efbe0051770 0x7efbe0053c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.021+0000 7efc04da5700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.38:6824/31053,v1:172.21.15.38:6825/31053] conn(0x7efbe00586b0 0x7efbe005aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.021+0000 7efbfffff700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efbe0051770 0x7efbe0053c30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efbf0007ed0 tx=0x7efbf0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.021+0000 7efbfffff700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efbe0051770 0x7efbe0053c30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efbf0007ed0 tx=0x7efbf0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.021+0000 7efbfffff700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efbe0051770 0x7efbe0053c30 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7efbf0007ed0 tx=0x7efbf0007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.022+0000 7efc04da5700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.38:6824/31053,v1:172.21.15.38:6825/31053] conn(0x7efbe00586b0 0x7efbe005aad0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.044 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.022+0000 7efbfd7fa700 1 -- 172.21.15.38:0/3195155181 <== osd.2 v2:172.21.15.38:6824/31053 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7efbe005b090 con 0x7efbe00586b0 2020-06-12T17:48:20.045 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.040+0000 7efc06808700 1 -- 172.21.15.38:0/3195155181 --> [v2:172.21.15.38:6824/31053,v1:172.21.15.38:6825/31053] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efbdc002680 con 0x7efbe00586b0 2020-06-12T17:48:20.045 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.041+0000 7efbfd7fa700 1 -- 172.21.15.38:0/3195155181 <== osd.2 v2:172.21.15.38:6824/31053 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efbdc002680 con 0x7efbe00586b0 2020-06-12T17:48:20.046 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.041+0000 7efc06808700 1 -- 172.21.15.38:0/3195155181 >> [v2:172.21.15.38:6824/31053,v1:172.21.15.38:6825/31053] conn(0x7efbe00586b0 msgr2=0x7efbe005aad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.046 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.041+0000 7efc06808700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.38:6824/31053,v1:172.21.15.38:6825/31053] conn(0x7efbe00586b0 0x7efbe005aad0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.046 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.041+0000 7efc06808700 1 -- 172.21.15.38:0/3195155181 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efbe0051770 msgr2=0x7efbe0053c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.046 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.041+0000 7efc06808700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efbe0051770 0x7efbe0053c30 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7efbf0007ed0 tx=0x7efbf0007e60).stop 2020-06-12T17:48:20.046 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.041+0000 7efc06808700 1 -- 172.21.15.38:0/3195155181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efbe0003ab0 msgr2=0x7efbe0003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.047 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.041+0000 7efc06808700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efbe0003ab0 0x7efbe0003ef0 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7efc0009c400 tx=0x7efbf400e960).stop 2020-06-12T17:48:20.047 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.041+0000 7efc06808700 1 -- 172.21.15.38:0/3195155181 shutdown_connections 2020-06-12T17:48:20.047 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.041+0000 7efc06808700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.38:6824/31053,v1:172.21.15.38:6825/31053] conn(0x7efbe00586b0 0x7efbe005aad0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.047 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.041+0000 7efc06808700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efbe0051770 0x7efbe0053c30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.048 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.041+0000 7efc06808700 1 --2- 172.21.15.38:0/3195155181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efbe0003ab0 0x7efbe0003ef0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.048 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.041+0000 7efc06808700 1 -- 172.21.15.38:0/3195155181 >> 172.21.15.38:0/3195155181 conn(0x7efc000b8410 msgr2=0x7efc000b3480 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:20.048 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.041+0000 7efc06808700 1 -- 172.21.15.38:0/3195155181 shutdown_connections 2020-06-12T17:48:20.048 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.041+0000 7efc06808700 1 -- 172.21.15.38:0/3195155181 wait complete. 2020-06-12T17:48:20.054 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2020-06-12T17:48:20.055 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 flush_pg_stats 2020-06-12T17:48:20.170 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.166+0000 7f27d245d700 1 Processor -- start 2020-06-12T17:48:20.170 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.166+0000 7f27d245d700 1 -- start start 2020-06-12T17:48:20.172 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.167+0000 7f27d245d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27cc09cf10 0x7f27cc0adaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:20.173 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.167+0000 7f27d245d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f27cc146cf0 0x7f27cc143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:20.173 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.167+0000 7f27d245d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27cc0aecd0 con 0x7f27cc1401f0 2020-06-12T17:48:20.173 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.167+0000 7f27d245d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27cc09d420 con 0x7f27cc146cf0 2020-06-12T17:48:20.173 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.167+0000 7f27d245d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc09d6c0 con 0x7f27cc09cf10 2020-06-12T17:48:20.174 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.167+0000 7f27d09fa700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f27cc146cf0 0x7f27cc143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.174 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.167+0000 7f27cb7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27cc09cf10 0x7f27cc0adaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.174 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.167+0000 7f27d09fa700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f27cc146cf0 0x7f27cc143020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:45166/0 (socket says 172.21.15.38:45166) 2020-06-12T17:48:20.174 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.167+0000 7f27cbfff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f27cc1401f0 0x7f27cc0b3f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:58234/0 (socket says 172.21.15.38:58234) 2020-06-12T17:48:20.174 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.168+0000 7f27d09fa700 1 -- 172.21.15.38:0/2724856713 learned_addr learned my addr 172.21.15.38:0/2724856713 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:20.175 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.168+0000 7f27d09fa700 1 -- 172.21.15.38:0/2724856713 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27cc09cf10 msgr2=0x7f27cc0adaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:20.175 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.168+0000 7f27d09fa700 1 --2- 172.21.15.38:0/2724856713 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27cc09cf10 0x7f27cc0adaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:20.175 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.168+0000 7f27d09fa700 1 -- 172.21.15.38:0/2724856713 >> v1:172.21.15.150:6789/0 conn(0x7f27cc1401f0 legacy=0x7f27cc0b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.175 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.168+0000 7f27d09fa700 1 -- 172.21.15.38:0/2724856713 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27cc0adf50 con 0x7f27cc146cf0 2020-06-12T17:48:20.175 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.168+0000 7f27caffd700 1 -- 172.21.15.38:0/2724856713 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3247206542 0 0) 0x7f27cc0aecd0 con 0x7f27cc1401f0 2020-06-12T17:48:20.176 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.168+0000 7f27cb7fe700 1 --2- 172.21.15.38:0/2724856713 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27cc09cf10 0x7f27cc0adaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:20.176 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.168+0000 7f27d09fa700 1 --2- 172.21.15.38:0/2724856713 >> v2:172.21.15.150:3300/0 conn(0x7f27cc146cf0 0x7f27cc143020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f27c40032b0 tx=0x7f27c40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.176 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.168+0000 7f27d09fa700 1 --2- 172.21.15.38:0/2724856713 >> v2:172.21.15.150:3300/0 conn(0x7f27cc146cf0 0x7f27cc143020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f27c40032b0 tx=0x7f27c40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.176 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.168+0000 7f27d09fa700 1 --2- 172.21.15.38:0/2724856713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27cc146cf0 0x7f27cc143020 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f27c40032b0 tx=0x7f27c40081e0).ready entity=mon.1 client_cookie=830e7e23ccbef2bc server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.176 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.168+0000 7f27d09fa700 1 --2- 172.21.15.38:0/2724856713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27cc146cf0 0x7f27cc143020 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f27c40032b0 tx=0x7f27c40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.177 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.168+0000 7f27caffd700 1 -- 172.21.15.38:0/2724856713 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27c4011ea0 con 0x7f27cc146cf0 2020-06-12T17:48:20.177 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.168+0000 7f27d09fa700 1 --2- 172.21.15.38:0/2724856713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27cc146cf0 0x7f27cc143020 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f27c40032b0 tx=0x7f27c40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.177 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.168+0000 7f27caffd700 1 -- 172.21.15.38:0/2724856713 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c400a160 con 0x7f27cc146cf0 2020-06-12T17:48:20.177 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.168+0000 7f27d09fa700 1 --2- 172.21.15.38:0/2724856713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27cc146cf0 0x7f27cc143020 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f27c40032b0 tx=0x7f27c40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.177 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.168+0000 7f27caffd700 1 -- 172.21.15.38:0/2724856713 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27c400a540 con 0x7f27cc146cf0 2020-06-12T17:48:20.178 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.168+0000 7f27d245d700 1 -- 172.21.15.38:0/2724856713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27cc146cf0 msgr2=0x7f27cc143020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.178 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.168+0000 7f27d245d700 1 --2- 172.21.15.38:0/2724856713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27cc146cf0 0x7f27cc143020 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f27c40032b0 tx=0x7f27c40081e0).stop 2020-06-12T17:48:20.178 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.169+0000 7f27d245d700 1 -- 172.21.15.38:0/2724856713 shutdown_connections 2020-06-12T17:48:20.178 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.169+0000 7f27d245d700 1 --2- 172.21.15.38:0/2724856713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27cc146cf0 0x7f27cc143020 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.178 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.169+0000 7f27d245d700 1 --2- 172.21.15.38:0/2724856713 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27cc09cf10 0x7f27cc0adaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:20.179 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.169+0000 7f27d245d700 1 -- 172.21.15.38:0/2724856713 >> 172.21.15.38:0/2724856713 conn(0x7f27cc0b8410 msgr2=0x7f27cc0b8820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:20.179 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.169+0000 7f27d245d700 1 -- 172.21.15.38:0/2724856713 shutdown_connections 2020-06-12T17:48:20.179 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.169+0000 7f27d245d700 1 -- 172.21.15.38:0/2724856713 wait complete. 2020-06-12T17:48:20.182 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.170+0000 7f27d245d700 1 Processor -- start 2020-06-12T17:48:20.183 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.170+0000 7f27d245d700 1 -- start start 2020-06-12T17:48:20.183 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.171+0000 7f27d245d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27cc09cf10 0x7f27cc0b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.183 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.171+0000 7f27d245d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f27cc146cf0 0x7f27cc066e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.183 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.171+0000 7f27d245d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27cc154d30 con 0x7f27cc1401f0 2020-06-12T17:48:20.184 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.171+0000 7f27d245d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27cc1522d0 con 0x7f27cc146cf0 2020-06-12T17:48:20.184 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.171+0000 7f27d245d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc154fd0 con 0x7f27cc09cf10 2020-06-12T17:48:20.184 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.171+0000 7f27cbfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27cc09cf10 0x7f27cc0b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.184 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.171+0000 7f27d09fa700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f27cc146cf0 0x7f27cc066e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.184 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.171+0000 7f27d09fa700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f27cc146cf0 0x7f27cc066e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:45172/0 (socket says 172.21.15.38:45172) 2020-06-12T17:48:20.185 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.171+0000 7f27d09fa700 1 -- 172.21.15.38:0/2636217327 learned_addr learned my addr 172.21.15.38:0/2636217327 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:20.185 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.171+0000 7f27cb7fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f27cc1401f0 0x7f27cc066750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:58242/0 (socket says 172.21.15.38:58242) 2020-06-12T17:48:20.185 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.171+0000 7f27cbfff700 1 -- 172.21.15.38:0/2636217327 >> v2:172.21.15.150:3300/0 conn(0x7f27cc146cf0 msgr2=0x7f27cc066e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.185 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.171+0000 7f27cbfff700 1 --2- 172.21.15.38:0/2636217327 >> v2:172.21.15.150:3300/0 conn(0x7f27cc146cf0 0x7f27cc066e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.171+0000 7f27cbfff700 1 -- 172.21.15.38:0/2636217327 >> v1:172.21.15.150:6789/0 conn(0x7f27cc1401f0 legacy=0x7f27cc066750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.171+0000 7f27c97fa700 1 -- 172.21.15.38:0/2636217327 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2270701226 0 0) 0x7f27cc154d30 con 0x7f27cc1401f0 2020-06-12T17:48:20.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.171+0000 7f27cbfff700 1 -- 172.21.15.38:0/2636217327 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27cc155270 con 0x7f27cc09cf10 2020-06-12T17:48:20.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.171+0000 7f27d09fa700 1 --2- 172.21.15.38:0/2636217327 >> v2:172.21.15.150:3300/0 conn(0x7f27cc146cf0 0x7f27cc066e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:20.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.171+0000 7f27cbfff700 1 --2- 172.21.15.38:0/2636217327 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27cc09cf10 0x7f27cc0b0a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f27bc000b80 tx=0x7f27bc001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.172+0000 7f27cbfff700 1 --2- 172.21.15.38:0/2636217327 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27cc09cf10 0x7f27cc0b0a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f27bc000b80 tx=0x7f27bc001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.172+0000 7f27cbfff700 1 --2- 172.21.15.38:0/2636217327 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27cc09cf10 0x7f27cc0b0a20 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f27bc000b80 tx=0x7f27bc001700).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.172+0000 7f27cbfff700 1 --2- 172.21.15.38:0/2636217327 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27cc09cf10 0x7f27cc0b0a20 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f27bc000b80 tx=0x7f27bc001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.172+0000 7f27c97fa700 1 -- 172.21.15.38:0/2636217327 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27bc011570 con 0x7f27cc09cf10 2020-06-12T17:48:20.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.172+0000 7f27cbfff700 1 --2- 172.21.15.38:0/2636217327 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27cc09cf10 0x7f27cc0b0a20 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f27bc000b80 tx=0x7f27bc001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.172+0000 7f27c97fa700 1 -- 172.21.15.38:0/2636217327 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27bc0116d0 con 0x7f27cc09cf10 2020-06-12T17:48:20.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.172+0000 7f27cbfff700 1 --2- 172.21.15.38:0/2636217327 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27cc09cf10 0x7f27cc0b0a20 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f27bc000b80 tx=0x7f27bc001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.172+0000 7f27d245d700 1 -- 172.21.15.38:0/2636217327 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27cc155710 con 0x7f27cc09cf10 2020-06-12T17:48:20.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.172+0000 7f27c97fa700 1 -- 172.21.15.38:0/2636217327 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27bc011ab0 con 0x7f27cc09cf10 2020-06-12T17:48:20.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.172+0000 7f27d245d700 1 -- 172.21.15.38:0/2636217327 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27cc154890 con 0x7f27cc09cf10 2020-06-12T17:48:20.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.172+0000 7f27cbfff700 1 --2- 172.21.15.38:0/2636217327 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27cc09cf10 0x7f27cc0b0a20 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f27bc000b80 tx=0x7f27bc001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.172+0000 7f27d245d700 1 -- 172.21.15.38:0/2636217327 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f27cc155470 con 0x7f27cc09cf10 2020-06-12T17:48:20.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.173+0000 7f27c97fa700 1 -- 172.21.15.38:0/2636217327 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f27bc00b0a0 con 0x7f27cc09cf10 2020-06-12T17:48:20.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.173+0000 7f27cbfff700 1 --2- 172.21.15.38:0/2636217327 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27cc09cf10 0x7f27cc0b0a20 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f27bc000b80 tx=0x7f27bc001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.173+0000 7f27cbfff700 1 --2- 172.21.15.38:0/2636217327 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27cc09cf10 0x7f27cc0b0a20 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f27bc000b80 tx=0x7f27bc001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.173+0000 7f27c97fa700 1 --2- 172.21.15.38:0/2636217327 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f27ac04d340 0x7f27ac04f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.173+0000 7f27c97fa700 1 -- 172.21.15.38:0/2636217327 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f27bc060e20 con 0x7f27cc09cf10 2020-06-12T17:48:20.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.173+0000 7f27c97fa700 1 --2- 172.21.15.38:0/2636217327 >> [v2:172.21.15.38:6808/31037,v1:172.21.15.38:6809/31037] conn(0x7f27ac054450 0x7f27ac056870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.173+0000 7f27c97fa700 1 -- 172.21.15.38:0/2636217327 --> [v2:172.21.15.38:6808/31037,v1:172.21.15.38:6809/31037] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f27ac056e30 con 0x7f27ac054450 2020-06-12T17:48:20.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.173+0000 7f27c97fa700 1 -- 172.21.15.38:0/2636217327 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27bc0622e0 con 0x7f27cc09cf10 2020-06-12T17:48:20.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.173+0000 7f27cb7fe700 1 --2- 172.21.15.38:0/2636217327 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f27ac04d340 0x7f27ac04f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.173+0000 7f27d09fa700 1 --2- 172.21.15.38:0/2636217327 >> [v2:172.21.15.38:6808/31037,v1:172.21.15.38:6809/31037] conn(0x7f27ac054450 0x7f27ac056870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.174+0000 7f27cb7fe700 1 --2- 172.21.15.38:0/2636217327 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f27ac04d340 0x7f27ac04f800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f27c0002ef0 tx=0x7f27c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.174+0000 7f27cb7fe700 1 --2- 172.21.15.38:0/2636217327 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f27ac04d340 0x7f27ac04f800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f27c0002ef0 tx=0x7f27c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.174+0000 7f27cb7fe700 1 --2- 172.21.15.38:0/2636217327 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f27ac04d340 0x7f27ac04f800 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f27c0002ef0 tx=0x7f27c0007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.192 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.174+0000 7f27d09fa700 1 --2- 172.21.15.38:0/2636217327 >> [v2:172.21.15.38:6808/31037,v1:172.21.15.38:6809/31037] conn(0x7f27ac054450 0x7f27ac056870 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.192 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.175+0000 7f27c97fa700 1 -- 172.21.15.38:0/2636217327 <== osd.3 v2:172.21.15.38:6808/31037 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f27ac056e30 con 0x7f27ac054450 2020-06-12T17:48:20.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.193+0000 7f27d245d700 1 -- 172.21.15.38:0/2636217327 --> [v2:172.21.15.38:6808/31037,v1:172.21.15.38:6809/31037] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f27cc154ba0 con 0x7f27ac054450 2020-06-12T17:48:20.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.193+0000 7f27c97fa700 1 -- 172.21.15.38:0/2636217327 <== osd.3 v2:172.21.15.38:6808/31037 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f27cc154ba0 con 0x7f27ac054450 2020-06-12T17:48:20.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.193+0000 7f27d245d700 1 -- 172.21.15.38:0/2636217327 >> [v2:172.21.15.38:6808/31037,v1:172.21.15.38:6809/31037] conn(0x7f27ac054450 msgr2=0x7f27ac056870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.193+0000 7f27d245d700 1 --2- 172.21.15.38:0/2636217327 >> [v2:172.21.15.38:6808/31037,v1:172.21.15.38:6809/31037] conn(0x7f27ac054450 0x7f27ac056870 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.193+0000 7f27d245d700 1 -- 172.21.15.38:0/2636217327 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f27ac04d340 msgr2=0x7f27ac04f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.193+0000 7f27d245d700 1 --2- 172.21.15.38:0/2636217327 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f27ac04d340 0x7f27ac04f800 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f27c0002ef0 tx=0x7f27c0007e60).stop 2020-06-12T17:48:20.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.193+0000 7f27d245d700 1 -- 172.21.15.38:0/2636217327 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27cc09cf10 msgr2=0x7f27cc0b0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.193+0000 7f27d245d700 1 --2- 172.21.15.38:0/2636217327 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27cc09cf10 0x7f27cc0b0a20 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f27bc000b80 tx=0x7f27bc001700).stop 2020-06-12T17:48:20.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.193+0000 7f27d09fa700 1 -- 172.21.15.38:0/2636217327 reap_dead start 2020-06-12T17:48:20.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.193+0000 7f27d245d700 1 -- 172.21.15.38:0/2636217327 shutdown_connections 2020-06-12T17:48:20.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.193+0000 7f27d245d700 1 -- 172.21.15.38:0/2636217327 >> 172.21.15.38:0/2636217327 conn(0x7f27cc0b8410 msgr2=0x7f27cc0b4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:20.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.193+0000 7f27d245d700 1 -- 172.21.15.38:0/2636217327 shutdown_connections 2020-06-12T17:48:20.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.193+0000 7f27d245d700 1 -- 172.21.15.38:0/2636217327 wait complete. 2020-06-12T17:48:20.206 INFO:teuthology.orchestra.run.smithi038.stdout:55834574855 2020-06-12T17:48:20.207 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 flush_pg_stats 2020-06-12T17:48:20.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.319+0000 7f12fd7b7700 1 Processor -- start 2020-06-12T17:48:20.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.319+0000 7f12fd7b7700 1 -- start start 2020-06-12T17:48:20.325 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.319+0000 7f12fd7b7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12f805bf20 0x7f12f80ac320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:20.325 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.319+0000 7f12fd7b7700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f12f8065a00 0x7f12f8143040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:20.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.319+0000 7f12fd7b7700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f80ac8a0 con 0x7f12f81434a0 2020-06-12T17:48:20.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.319+0000 7f12fd7b7700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f8144e40 con 0x7f12f8065a00 2020-06-12T17:48:20.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.319+0000 7f12fd7b7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f80acb40 con 0x7f12f805bf20 2020-06-12T17:48:20.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.320+0000 7f12f77fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f12f81434a0 0x7f12f81462d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37518/0 (socket says 172.21.15.38:37518) 2020-06-12T17:48:20.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.320+0000 7f12effff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f12f8065a00 0x7f12f8143040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.327 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.320+0000 7f12f77fe700 1 -- 172.21.15.38:0/3891820431 learned_addr learned my addr 172.21.15.38:0/3891820431 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:20.327 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.320+0000 7f12f6ffd700 1 --2- 172.21.15.38:0/3891820431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12f805bf20 0x7f12f80ac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.327 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.320+0000 7f12effff700 1 -- 172.21.15.38:0/3891820431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12f805bf20 msgr2=0x7f12f80ac320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:20.327 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.320+0000 7f12effff700 1 --2- 172.21.15.38:0/3891820431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12f805bf20 0x7f12f80ac320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:20.327 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.320+0000 7f12effff700 1 -- 172.21.15.38:0/3891820431 >> v1:172.21.15.38:6789/0 conn(0x7f12f81434a0 legacy=0x7f12f81462d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.320+0000 7f12effff700 1 -- 172.21.15.38:0/3891820431 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f80acde0 con 0x7f12f8065a00 2020-06-12T17:48:20.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.320+0000 7f12f67fc700 1 -- 172.21.15.38:0/3891820431 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616066879 0 0) 0x7f12f80ac8a0 con 0x7f12f81434a0 2020-06-12T17:48:20.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.320+0000 7f12effff700 1 --2- 172.21.15.38:0/3891820431 >> v2:172.21.15.38:3300/0 conn(0x7f12f8065a00 0x7f12f8143040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f12e0002f30 tx=0x7f12e0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.320+0000 7f12effff700 1 --2- 172.21.15.38:0/3891820431 >> v2:172.21.15.38:3300/0 conn(0x7f12f8065a00 0x7f12f8143040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f12e0002f30 tx=0x7f12e0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.320+0000 7f12effff700 1 --2- 172.21.15.38:0/3891820431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12f8065a00 0x7f12f8143040 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7f12e0002f30 tx=0x7f12e0007e60).ready entity=mon.0 client_cookie=31e085894f3cacb5 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.320+0000 7f12effff700 1 --2- 172.21.15.38:0/3891820431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12f8065a00 0x7f12f8143040 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f12e0002f30 tx=0x7f12e0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.320+0000 7f12f67fc700 1 -- 172.21.15.38:0/3891820431 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12e0011380 con 0x7f12f8065a00 2020-06-12T17:48:20.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.320+0000 7f12effff700 1 --2- 172.21.15.38:0/3891820431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12f8065a00 0x7f12f8143040 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f12e0002f30 tx=0x7f12e0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.320+0000 7f12f67fc700 1 -- 172.21.15.38:0/3891820431 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e00114e0 con 0x7f12f8065a00 2020-06-12T17:48:20.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.320+0000 7f12effff700 1 --2- 172.21.15.38:0/3891820431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12f8065a00 0x7f12f8143040 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7f12e0002f30 tx=0x7f12e0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.320+0000 7f12f67fc700 1 -- 172.21.15.38:0/3891820431 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12e00118c0 con 0x7f12f8065a00 2020-06-12T17:48:20.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.320+0000 7f12fd7b7700 1 -- 172.21.15.38:0/3891820431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12f8065a00 msgr2=0x7f12f8143040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.320+0000 7f12fd7b7700 1 --2- 172.21.15.38:0/3891820431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12f8065a00 0x7f12f8143040 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7f12e0002f30 tx=0x7f12e0007e60).stop 2020-06-12T17:48:20.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.321+0000 7f12fd7b7700 1 -- 172.21.15.38:0/3891820431 shutdown_connections 2020-06-12T17:48:20.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.321+0000 7f12fd7b7700 1 --2- 172.21.15.38:0/3891820431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12f805bf20 0x7f12f80ac320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:20.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.321+0000 7f12fd7b7700 1 --2- 172.21.15.38:0/3891820431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12f8065a00 0x7f12f8143040 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.321+0000 7f12fd7b7700 1 -- 172.21.15.38:0/3891820431 >> 172.21.15.38:0/3891820431 conn(0x7f12f80b4ea0 msgr2=0x7f12f80b52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:20.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.321+0000 7f12fd7b7700 1 -- 172.21.15.38:0/3891820431 shutdown_connections 2020-06-12T17:48:20.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.321+0000 7f12fd7b7700 1 -- 172.21.15.38:0/3891820431 wait complete. 2020-06-12T17:48:20.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.322+0000 7f12fd7b7700 1 Processor -- start 2020-06-12T17:48:20.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.322+0000 7f12fd7b7700 1 -- start start 2020-06-12T17:48:20.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.322+0000 7f12fd7b7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f12f805bf20 0x7f12f80b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.322+0000 7f12fd7b7700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f12f81434a0 0x7f12f80b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.322+0000 7f12fd7b7700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f80b2f70 con 0x7f12f8065a00 2020-06-12T17:48:20.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.322+0000 7f12fd7b7700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f80b31a0 con 0x7f12f81434a0 2020-06-12T17:48:20.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.322+0000 7f12fd7b7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f80b3440 con 0x7f12f805bf20 2020-06-12T17:48:20.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.323+0000 7f12effff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f12f8065a00 0x7f12f8144530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37522/0 (socket says 172.21.15.38:37522) 2020-06-12T17:48:20.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.323+0000 7f12effff700 1 -- 172.21.15.38:0/2437211109 learned_addr learned my addr 172.21.15.38:0/2437211109 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:20.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.323+0000 7f12f77fe700 1 --2- 172.21.15.38:0/2437211109 >> v2:172.21.15.38:3300/0 conn(0x7f12f81434a0 0x7f12f80b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.323+0000 7f12f6ffd700 1 --2- 172.21.15.38:0/2437211109 >> v2:172.21.15.150:3300/0 conn(0x7f12f805bf20 0x7f12f80b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.323+0000 7f12f4ff9700 1 -- 172.21.15.38:0/2437211109 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3069257478 0 0) 0x7f12f80b2f70 con 0x7f12f8065a00 2020-06-12T17:48:20.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.323+0000 7f12f4ff9700 1 -- 172.21.15.38:0/2437211109 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12dc002fe0 con 0x7f12f8065a00 2020-06-12T17:48:20.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.323+0000 7f12f77fe700 1 -- 172.21.15.38:0/2437211109 >> v2:172.21.15.150:3300/0 conn(0x7f12f805bf20 msgr2=0x7f12f80b1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.323+0000 7f12f77fe700 1 --2- 172.21.15.38:0/2437211109 >> v2:172.21.15.150:3300/0 conn(0x7f12f805bf20 0x7f12f80b1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.323+0000 7f12f77fe700 1 -- 172.21.15.38:0/2437211109 >> v1:172.21.15.38:6789/0 conn(0x7f12f8065a00 legacy=0x7f12f8144530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.323+0000 7f12f77fe700 1 -- 172.21.15.38:0/2437211109 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f80b36e0 con 0x7f12f81434a0 2020-06-12T17:48:20.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.323+0000 7f12f77fe700 1 --2- 172.21.15.38:0/2437211109 >> v2:172.21.15.38:3300/0 conn(0x7f12f81434a0 0x7f12f80b2970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f12f0001210 tx=0x7f12f00019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.323+0000 7f12f77fe700 1 --2- 172.21.15.38:0/2437211109 >> v2:172.21.15.38:3300/0 conn(0x7f12f81434a0 0x7f12f80b2970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f12f0001210 tx=0x7f12f00019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.323+0000 7f12f77fe700 1 --2- 172.21.15.38:0/2437211109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12f81434a0 0x7f12f80b2970 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7f12f0001210 tx=0x7f12f00019a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.323+0000 7f12f77fe700 1 --2- 172.21.15.38:0/2437211109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12f81434a0 0x7f12f80b2970 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f12f0001210 tx=0x7f12f00019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.323+0000 7f12f4ff9700 1 -- 172.21.15.38:0/2437211109 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12f0005e30 con 0x7f12f81434a0 2020-06-12T17:48:20.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.323+0000 7f12f77fe700 1 --2- 172.21.15.38:0/2437211109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12f81434a0 0x7f12f80b2970 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f12f0001210 tx=0x7f12f00019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.323+0000 7f12f77fe700 1 --2- 172.21.15.38:0/2437211109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12f81434a0 0x7f12f80b2970 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f12f0001210 tx=0x7f12f00019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.323+0000 7f12f4ff9700 1 -- 172.21.15.38:0/2437211109 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f00123a0 con 0x7f12f81434a0 2020-06-12T17:48:20.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.323+0000 7f12fd7b7700 1 -- 172.21.15.38:0/2437211109 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f8126740 con 0x7f12f81434a0 2020-06-12T17:48:20.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.323+0000 7f12f4ff9700 1 -- 172.21.15.38:0/2437211109 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12f00127c0 con 0x7f12f81434a0 2020-06-12T17:48:20.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.323+0000 7f12fd7b7700 1 -- 172.21.15.38:0/2437211109 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f8126c00 con 0x7f12f81434a0 2020-06-12T17:48:20.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.324+0000 7f12f77fe700 1 --2- 172.21.15.38:0/2437211109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12f81434a0 0x7f12f80b2970 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f12f0001210 tx=0x7f12f00019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.324+0000 7f12fd7b7700 1 -- 172.21.15.38:0/2437211109 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f12f80b38e0 con 0x7f12f81434a0 2020-06-12T17:48:20.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.324+0000 7f12f4ff9700 1 -- 172.21.15.38:0/2437211109 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f12f0012a30 con 0x7f12f81434a0 2020-06-12T17:48:20.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.324+0000 7f12f77fe700 1 --2- 172.21.15.38:0/2437211109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12f81434a0 0x7f12f80b2970 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f12f0001210 tx=0x7f12f00019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.324+0000 7f12f77fe700 1 --2- 172.21.15.38:0/2437211109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12f81434a0 0x7f12f80b2970 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f12f0001210 tx=0x7f12f00019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.325+0000 7f12f4ff9700 1 --2- 172.21.15.38:0/2437211109 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f12dc04d970 0x7f12dc04fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.325+0000 7f12f4ff9700 1 -- 172.21.15.38:0/2437211109 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f12f0061200 con 0x7f12f81434a0 2020-06-12T17:48:20.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.325+0000 7f12f4ff9700 1 --2- 172.21.15.38:0/2437211109 >> [v2:172.21.15.150:6802/31294,v1:172.21.15.150:6803/31294] conn(0x7f12dc054aa0 0x7f12dc056ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.325+0000 7f12f4ff9700 1 -- 172.21.15.38:0/2437211109 --> [v2:172.21.15.150:6802/31294,v1:172.21.15.150:6803/31294] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f12dc057480 con 0x7f12dc054aa0 2020-06-12T17:48:20.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.325+0000 7f12f4ff9700 1 -- 172.21.15.38:0/2437211109 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12f00626c0 con 0x7f12f81434a0 2020-06-12T17:48:20.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.325+0000 7f12f6ffd700 1 --2- 172.21.15.38:0/2437211109 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f12dc04d970 0x7f12dc04fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.325+0000 7f12effff700 1 --2- 172.21.15.38:0/2437211109 >> [v2:172.21.15.150:6802/31294,v1:172.21.15.150:6803/31294] conn(0x7f12dc054aa0 0x7f12dc056ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.325+0000 7f12f6ffd700 1 --2- 172.21.15.38:0/2437211109 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f12dc04d970 0x7f12dc04fe30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f12e8002f30 tx=0x7f12e8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.325+0000 7f12f6ffd700 1 --2- 172.21.15.38:0/2437211109 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f12dc04d970 0x7f12dc04fe30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f12e8002f30 tx=0x7f12e8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.325+0000 7f12f6ffd700 1 --2- 172.21.15.38:0/2437211109 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f12dc04d970 0x7f12dc04fe30 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f12e8002f30 tx=0x7f12e8007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.326+0000 7f12effff700 1 --2- 172.21.15.38:0/2437211109 >> [v2:172.21.15.150:6802/31294,v1:172.21.15.150:6803/31294] conn(0x7f12dc054aa0 0x7f12dc056ec0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.326+0000 7f12f4ff9700 1 -- 172.21.15.38:0/2437211109 <== osd.4 v2:172.21.15.150:6802/31294 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f12dc057480 con 0x7f12dc054aa0 2020-06-12T17:48:20.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.345+0000 7f12fd7b7700 1 -- 172.21.15.38:0/2437211109 --> [v2:172.21.15.150:6802/31294,v1:172.21.15.150:6803/31294] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f12f8137580 con 0x7f12dc054aa0 2020-06-12T17:48:20.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.345+0000 7f12f4ff9700 1 -- 172.21.15.38:0/2437211109 <== osd.4 v2:172.21.15.150:6802/31294 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f12f8137580 con 0x7f12dc054aa0 2020-06-12T17:48:20.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.346+0000 7f12fd7b7700 1 -- 172.21.15.38:0/2437211109 >> [v2:172.21.15.150:6802/31294,v1:172.21.15.150:6803/31294] conn(0x7f12dc054aa0 msgr2=0x7f12dc056ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.346+0000 7f12fd7b7700 1 --2- 172.21.15.38:0/2437211109 >> [v2:172.21.15.150:6802/31294,v1:172.21.15.150:6803/31294] conn(0x7f12dc054aa0 0x7f12dc056ec0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.346+0000 7f12fd7b7700 1 -- 172.21.15.38:0/2437211109 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f12dc04d970 msgr2=0x7f12dc04fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.346+0000 7f12fd7b7700 1 --2- 172.21.15.38:0/2437211109 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f12dc04d970 0x7f12dc04fe30 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f12e8002f30 tx=0x7f12e8007e60).stop 2020-06-12T17:48:20.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.346+0000 7f12fd7b7700 1 -- 172.21.15.38:0/2437211109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12f81434a0 msgr2=0x7f12f80b2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.346+0000 7f12fd7b7700 1 --2- 172.21.15.38:0/2437211109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12f81434a0 0x7f12f80b2970 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7f12f0001210 tx=0x7f12f00019a0).stop 2020-06-12T17:48:20.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.346+0000 7f12f77fe700 1 -- 172.21.15.38:0/2437211109 reap_dead start 2020-06-12T17:48:20.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.346+0000 7f12fd7b7700 1 -- 172.21.15.38:0/2437211109 shutdown_connections 2020-06-12T17:48:20.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.346+0000 7f12fd7b7700 1 --2- 172.21.15.38:0/2437211109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12f81434a0 0x7f12f80b2970 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.346+0000 7f12fd7b7700 1 -- 172.21.15.38:0/2437211109 >> 172.21.15.38:0/2437211109 conn(0x7f12f80b4ea0 msgr2=0x7f12f80b6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:20.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.346+0000 7f12fd7b7700 1 -- 172.21.15.38:0/2437211109 shutdown_connections 2020-06-12T17:48:20.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.346+0000 7f12fd7b7700 1 -- 172.21.15.38:0/2437211109 wait complete. 2020-06-12T17:48:20.362 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2020-06-12T17:48:20.363 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 flush_pg_stats 2020-06-12T17:48:20.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.474+0000 7f00d342c700 1 Processor -- start 2020-06-12T17:48:20.478 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.474+0000 7f00d342c700 1 -- start start 2020-06-12T17:48:20.484 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.475+0000 7f00d342c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f00cc09cf10 0x7f00cc0adaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:20.484 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.475+0000 7f00d342c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f00cc146cf0 0x7f00cc143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:20.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.475+0000 7f00d342c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00cc0aecd0 con 0x7f00cc1401f0 2020-06-12T17:48:20.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.475+0000 7f00d342c700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00cc09d420 con 0x7f00cc09cf10 2020-06-12T17:48:20.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.475+0000 7f00d342c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00cc09d6c0 con 0x7f00cc146cf0 2020-06-12T17:48:20.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.475+0000 7f00d09c7700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f00cc09cf10 0x7f00cc0adaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.475+0000 7f00d09c7700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f00cc09cf10 0x7f00cc0adaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35716/0 (socket says 172.21.15.38:35716) 2020-06-12T17:48:20.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.475+0000 7f00d09c7700 1 -- 172.21.15.38:0/1376222167 learned_addr learned my addr 172.21.15.38:0/1376222167 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:20.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.475+0000 7f00d19c9700 1 --2- 172.21.15.38:0/1376222167 >> v2:172.21.15.150:3300/0 conn(0x7f00cc146cf0 0x7f00cc143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.475+0000 7f00d09c7700 1 -- 172.21.15.38:0/1376222167 >> v2:172.21.15.150:3300/0 conn(0x7f00cc146cf0 msgr2=0x7f00cc143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:20.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.475+0000 7f00d09c7700 1 --2- 172.21.15.38:0/1376222167 >> v2:172.21.15.150:3300/0 conn(0x7f00cc146cf0 0x7f00cc143020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:20.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.475+0000 7f00d09c7700 1 -- 172.21.15.38:0/1376222167 >> v1:172.21.15.150:6789/0 conn(0x7f00cc1401f0 legacy=0x7f00cc0b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.475+0000 7f00d09c7700 1 -- 172.21.15.38:0/1376222167 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00cc0adf50 con 0x7f00cc09cf10 2020-06-12T17:48:20.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.475+0000 7f00d09c7700 1 --2- 172.21.15.38:0/1376222167 >> v2:172.21.15.38:3300/0 conn(0x7f00cc09cf10 0x7f00cc0adaf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f00bc002f30 tx=0x7f00bc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.475+0000 7f00d09c7700 1 --2- 172.21.15.38:0/1376222167 >> v2:172.21.15.38:3300/0 conn(0x7f00cc09cf10 0x7f00cc0adaf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f00bc002f30 tx=0x7f00bc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.475+0000 7f00d09c7700 1 --2- 172.21.15.38:0/1376222167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00cc09cf10 0x7f00cc0adaf0 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7f00bc002f30 tx=0x7f00bc007e60).ready entity=mon.0 client_cookie=8d7a5cf082f04baf server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.475+0000 7f00d09c7700 1 --2- 172.21.15.38:0/1376222167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00cc09cf10 0x7f00cc0adaf0 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f00bc002f30 tx=0x7f00bc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.475+0000 7f00bbfff700 1 -- 172.21.15.38:0/1376222167 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00bc011630 con 0x7f00cc09cf10 2020-06-12T17:48:20.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.475+0000 7f00d09c7700 1 --2- 172.21.15.38:0/1376222167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00cc09cf10 0x7f00cc0adaf0 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f00bc002f30 tx=0x7f00bc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.475+0000 7f00d09c7700 1 --2- 172.21.15.38:0/1376222167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00cc09cf10 0x7f00cc0adaf0 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f00bc002f30 tx=0x7f00bc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.475+0000 7f00bbfff700 1 -- 172.21.15.38:0/1376222167 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00bc011790 con 0x7f00cc09cf10 2020-06-12T17:48:20.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.475+0000 7f00bbfff700 1 -- 172.21.15.38:0/1376222167 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00bc011b70 con 0x7f00cc09cf10 2020-06-12T17:48:20.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.475+0000 7f00d342c700 1 -- 172.21.15.38:0/1376222167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00cc09cf10 msgr2=0x7f00cc0adaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.475+0000 7f00d342c700 1 --2- 172.21.15.38:0/1376222167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00cc09cf10 0x7f00cc0adaf0 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7f00bc002f30 tx=0x7f00bc007e60).stop 2020-06-12T17:48:20.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.476+0000 7f00d342c700 1 -- 172.21.15.38:0/1376222167 shutdown_connections 2020-06-12T17:48:20.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.476+0000 7f00d342c700 1 --2- 172.21.15.38:0/1376222167 >> v2:172.21.15.150:3300/0 conn(0x7f00cc146cf0 0x7f00cc143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:20.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.476+0000 7f00d342c700 1 --2- 172.21.15.38:0/1376222167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00cc09cf10 0x7f00cc0adaf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.476+0000 7f00d342c700 1 -- 172.21.15.38:0/1376222167 >> 172.21.15.38:0/1376222167 conn(0x7f00cc0b8410 msgr2=0x7f00cc0b8820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:20.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.476+0000 7f00d342c700 1 -- 172.21.15.38:0/1376222167 shutdown_connections 2020-06-12T17:48:20.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.476+0000 7f00d342c700 1 -- 172.21.15.38:0/1376222167 wait complete. 2020-06-12T17:48:20.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.477+0000 7f00d342c700 1 Processor -- start 2020-06-12T17:48:20.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.477+0000 7f00d342c700 1 -- start start 2020-06-12T17:48:20.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.478+0000 7f00d342c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00cc1401f0 0x7f00cc0b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.478+0000 7f00d342c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f00cc146cf0 0x7f00cc13faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.478+0000 7f00d342c700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00cc1451f0 con 0x7f00cc09cf10 2020-06-12T17:48:20.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.478+0000 7f00d342c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00cc145490 con 0x7f00cc146cf0 2020-06-12T17:48:20.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.478+0000 7f00d342c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc062660 con 0x7f00cc1401f0 2020-06-12T17:48:20.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.478+0000 7f00d11c8700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f00cc09cf10 0x7f00cc13f3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37536/0 (socket says 172.21.15.38:37536) 2020-06-12T17:48:20.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.478+0000 7f00d11c8700 1 -- 172.21.15.38:0/29546816 learned_addr learned my addr 172.21.15.38:0/29546816 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:20.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.478+0000 7f00d19c9700 1 --2- 172.21.15.38:0/29546816 >> v2:172.21.15.150:3300/0 conn(0x7f00cc146cf0 0x7f00cc13faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.478+0000 7f00d09c7700 1 --2- 172.21.15.38:0/29546816 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00cc1401f0 0x7f00cc0b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.478+0000 7f00ba7fc700 1 -- 172.21.15.38:0/29546816 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2868518452 0 0) 0x7f00cc1451f0 con 0x7f00cc09cf10 2020-06-12T17:48:20.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.478+0000 7f00ba7fc700 1 -- 172.21.15.38:0/29546816 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00ac002fe0 con 0x7f00cc09cf10 2020-06-12T17:48:20.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.478+0000 7f00d19c9700 1 -- 172.21.15.38:0/29546816 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00cc1401f0 msgr2=0x7f00cc0b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.478+0000 7f00d19c9700 1 --2- 172.21.15.38:0/29546816 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00cc1401f0 0x7f00cc0b1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.478+0000 7f00d19c9700 1 -- 172.21.15.38:0/29546816 >> v1:172.21.15.38:6789/0 conn(0x7f00cc09cf10 legacy=0x7f00cc13f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.478+0000 7f00d19c9700 1 -- 172.21.15.38:0/29546816 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00cc144e70 con 0x7f00cc146cf0 2020-06-12T17:48:20.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.478+0000 7f00d19c9700 1 --2- 172.21.15.38:0/29546816 >> v2:172.21.15.150:3300/0 conn(0x7f00cc146cf0 0x7f00cc13faf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f00c40032b0 tx=0x7f00c40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.478+0000 7f00d19c9700 1 --2- 172.21.15.38:0/29546816 >> v2:172.21.15.150:3300/0 conn(0x7f00cc146cf0 0x7f00cc13faf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f00c40032b0 tx=0x7f00c40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.478+0000 7f00d19c9700 1 --2- 172.21.15.38:0/29546816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00cc146cf0 0x7f00cc13faf0 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f00c40032b0 tx=0x7f00c40081e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.478+0000 7f00d19c9700 1 --2- 172.21.15.38:0/29546816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00cc146cf0 0x7f00cc13faf0 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f00c40032b0 tx=0x7f00c40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.478+0000 7f00ba7fc700 1 -- 172.21.15.38:0/29546816 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00c400e350 con 0x7f00cc146cf0 2020-06-12T17:48:20.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.478+0000 7f00d19c9700 1 --2- 172.21.15.38:0/29546816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00cc146cf0 0x7f00cc13faf0 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f00c40032b0 tx=0x7f00c40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.479+0000 7f00d342c700 1 -- 172.21.15.38:0/29546816 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00cc0b0b80 con 0x7f00cc146cf0 2020-06-12T17:48:20.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.479+0000 7f00ba7fc700 1 -- 172.21.15.38:0/29546816 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c4005c30 con 0x7f00cc146cf0 2020-06-12T17:48:20.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.479+0000 7f00d19c9700 1 --2- 172.21.15.38:0/29546816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00cc146cf0 0x7f00cc13faf0 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f00c40032b0 tx=0x7f00c40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.479+0000 7f00ba7fc700 1 -- 172.21.15.38:0/29546816 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00c4005da0 con 0x7f00cc146cf0 2020-06-12T17:48:20.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.479+0000 7f00d342c700 1 -- 172.21.15.38:0/29546816 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00cc0afd40 con 0x7f00cc146cf0 2020-06-12T17:48:20.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.479+0000 7f00d19c9700 1 --2- 172.21.15.38:0/29546816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00cc146cf0 0x7f00cc13faf0 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f00c40032b0 tx=0x7f00c40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.479+0000 7f00d342c700 1 -- 172.21.15.38:0/29546816 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f00cc06a990 con 0x7f00cc146cf0 2020-06-12T17:48:20.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.480+0000 7f00ba7fc700 1 -- 172.21.15.38:0/29546816 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f00c4014c00 con 0x7f00cc146cf0 2020-06-12T17:48:20.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.480+0000 7f00d19c9700 1 --2- 172.21.15.38:0/29546816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00cc146cf0 0x7f00cc13faf0 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f00c40032b0 tx=0x7f00c40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.480+0000 7f00d19c9700 1 --2- 172.21.15.38:0/29546816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00cc146cf0 0x7f00cc13faf0 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f00c40032b0 tx=0x7f00c40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.480+0000 7f00ba7fc700 1 --2- 172.21.15.38:0/29546816 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f00ac04d8f0 0x7f00ac04fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.480+0000 7f00ba7fc700 1 -- 172.21.15.38:0/29546816 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f00c4062f80 con 0x7f00cc146cf0 2020-06-12T17:48:20.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.480+0000 7f00ba7fc700 1 --2- 172.21.15.38:0/29546816 >> [v2:172.21.15.150:6811/31295,v1:172.21.15.150:6813/31295] conn(0x7f00ac054990 0x7f00ac056db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.480+0000 7f00ba7fc700 1 -- 172.21.15.38:0/29546816 --> [v2:172.21.15.150:6811/31295,v1:172.21.15.150:6813/31295] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f00ac057370 con 0x7f00ac054990 2020-06-12T17:48:20.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.480+0000 7f00d11c8700 1 --2- 172.21.15.38:0/29546816 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f00ac04d8f0 0x7f00ac04fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.480+0000 7f00ba7fc700 1 -- 172.21.15.38:0/29546816 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00c40644a0 con 0x7f00cc146cf0 2020-06-12T17:48:20.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.480+0000 7f00d09c7700 1 --2- 172.21.15.38:0/29546816 >> [v2:172.21.15.150:6811/31295,v1:172.21.15.150:6813/31295] conn(0x7f00ac054990 0x7f00ac056db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.480+0000 7f00d11c8700 1 --2- 172.21.15.38:0/29546816 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f00ac04d8f0 0x7f00ac04fdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f00c80010d0 tx=0x7f00c8001660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.480+0000 7f00d11c8700 1 --2- 172.21.15.38:0/29546816 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f00ac04d8f0 0x7f00ac04fdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f00c80010d0 tx=0x7f00c8001660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.480+0000 7f00d11c8700 1 --2- 172.21.15.38:0/29546816 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f00ac04d8f0 0x7f00ac04fdb0 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f00c80010d0 tx=0x7f00c8001660).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.481+0000 7f00d09c7700 1 --2- 172.21.15.38:0/29546816 >> [v2:172.21.15.150:6811/31295,v1:172.21.15.150:6813/31295] conn(0x7f00ac054990 0x7f00ac056db0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.481+0000 7f00ba7fc700 1 -- 172.21.15.38:0/29546816 <== osd.5 v2:172.21.15.150:6811/31295 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f00ac057370 con 0x7f00ac054990 2020-06-12T17:48:20.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.500+0000 7f00d342c700 1 -- 172.21.15.38:0/29546816 --> [v2:172.21.15.150:6811/31295,v1:172.21.15.150:6813/31295] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f00cc055bf0 con 0x7f00ac054990 2020-06-12T17:48:20.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.501+0000 7f00ba7fc700 1 -- 172.21.15.38:0/29546816 <== osd.5 v2:172.21.15.150:6811/31295 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f00cc055bf0 con 0x7f00ac054990 2020-06-12T17:48:20.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.501+0000 7f00d342c700 1 -- 172.21.15.38:0/29546816 >> [v2:172.21.15.150:6811/31295,v1:172.21.15.150:6813/31295] conn(0x7f00ac054990 msgr2=0x7f00ac056db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.501+0000 7f00d342c700 1 --2- 172.21.15.38:0/29546816 >> [v2:172.21.15.150:6811/31295,v1:172.21.15.150:6813/31295] conn(0x7f00ac054990 0x7f00ac056db0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.501+0000 7f00d342c700 1 -- 172.21.15.38:0/29546816 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f00ac04d8f0 msgr2=0x7f00ac04fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.501+0000 7f00d342c700 1 --2- 172.21.15.38:0/29546816 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f00ac04d8f0 0x7f00ac04fdb0 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f00c80010d0 tx=0x7f00c8001660).stop 2020-06-12T17:48:20.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.501+0000 7f00d342c700 1 -- 172.21.15.38:0/29546816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00cc146cf0 msgr2=0x7f00cc13faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.501+0000 7f00d342c700 1 --2- 172.21.15.38:0/29546816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00cc146cf0 0x7f00cc13faf0 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f00c40032b0 tx=0x7f00c40081e0).stop 2020-06-12T17:48:20.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.501+0000 7f00d19c9700 1 -- 172.21.15.38:0/29546816 reap_dead start 2020-06-12T17:48:20.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.501+0000 7f00d342c700 1 -- 172.21.15.38:0/29546816 shutdown_connections 2020-06-12T17:48:20.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.501+0000 7f00d342c700 1 --2- 172.21.15.38:0/29546816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00cc146cf0 0x7f00cc13faf0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.501+0000 7f00d342c700 1 -- 172.21.15.38:0/29546816 >> 172.21.15.38:0/29546816 conn(0x7f00cc0b8410 msgr2=0x7f00cc0b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:20.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.501+0000 7f00d342c700 1 -- 172.21.15.38:0/29546816 shutdown_connections 2020-06-12T17:48:20.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.501+0000 7f00d342c700 1 -- 172.21.15.38:0/29546816 wait complete. 2020-06-12T17:48:20.514 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2020-06-12T17:48:20.515 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 flush_pg_stats 2020-06-12T17:48:20.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.627+0000 7f19cd1a4700 1 Processor -- start 2020-06-12T17:48:20.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.627+0000 7f19cd1a4700 1 -- start start 2020-06-12T17:48:20.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.628+0000 7f19cd1a4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f19c81401f0 0x7f19c809cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:20.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.628+0000 7f19cd1a4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f19c80adaf0 0x7f19c8146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:20.634 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.628+0000 7f19cd1a4700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c80aecd0 con 0x7f19c80b3f40 2020-06-12T17:48:20.634 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.628+0000 7f19cd1a4700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c809d420 con 0x7f19c81401f0 2020-06-12T17:48:20.634 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.628+0000 7f19cd1a4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c809d6c0 con 0x7f19c80adaf0 2020-06-12T17:48:20.634 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.628+0000 7f19c6d9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f19c81401f0 0x7f19c809cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.635 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.628+0000 7f19c6d9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f19c81401f0 0x7f19c809cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35730/0 (socket says 172.21.15.38:35730) 2020-06-12T17:48:20.635 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.628+0000 7f19c6d9d700 1 -- 172.21.15.38:0/2324281912 learned_addr learned my addr 172.21.15.38:0/2324281912 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:20.635 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.628+0000 7f19c759e700 1 --1- 172.21.15.38:0/2324281912 >> v1:172.21.15.38:6789/0 conn(0x7f19c80b3f40 0x7f19c8143020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37550/0 (socket says 172.21.15.38:37550) 2020-06-12T17:48:20.635 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.628+0000 7f19c659c700 1 --2- 172.21.15.38:0/2324281912 >> v2:172.21.15.150:3300/0 conn(0x7f19c80adaf0 0x7f19c8146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.635 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.628+0000 7f19c6d9d700 1 -- 172.21.15.38:0/2324281912 >> v2:172.21.15.150:3300/0 conn(0x7f19c80adaf0 msgr2=0x7f19c8146cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:20.635 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.628+0000 7f19c6d9d700 1 --2- 172.21.15.38:0/2324281912 >> v2:172.21.15.150:3300/0 conn(0x7f19c80adaf0 0x7f19c8146cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:20.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.628+0000 7f19c6d9d700 1 -- 172.21.15.38:0/2324281912 >> v1:172.21.15.38:6789/0 conn(0x7f19c80b3f40 legacy=0x7f19c8143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.628+0000 7f19c6d9d700 1 -- 172.21.15.38:0/2324281912 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c80adf80 con 0x7f19c81401f0 2020-06-12T17:48:20.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.628+0000 7f19c5d9b700 1 -- 172.21.15.38:0/2324281912 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626300667 0 0) 0x7f19c80aecd0 con 0x7f19c80b3f40 2020-06-12T17:48:20.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.628+0000 7f19c6d9d700 1 --2- 172.21.15.38:0/2324281912 >> v2:172.21.15.38:3300/0 conn(0x7f19c81401f0 0x7f19c809cf10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f19c00032b0 tx=0x7f19c00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.628+0000 7f19c6d9d700 1 --2- 172.21.15.38:0/2324281912 >> v2:172.21.15.38:3300/0 conn(0x7f19c81401f0 0x7f19c809cf10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f19c00032b0 tx=0x7f19c00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.637 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.628+0000 7f19c6d9d700 1 --2- 172.21.15.38:0/2324281912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19c81401f0 0x7f19c809cf10 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7f19c00032b0 tx=0x7f19c00081e0).ready entity=mon.0 client_cookie=6eb6a94b79704c22 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.637 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.628+0000 7f19c6d9d700 1 --2- 172.21.15.38:0/2324281912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19c81401f0 0x7f19c809cf10 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7f19c00032b0 tx=0x7f19c00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.637 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.628+0000 7f19c6d9d700 1 --2- 172.21.15.38:0/2324281912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19c81401f0 0x7f19c809cf10 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7f19c00032b0 tx=0x7f19c00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.637 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.628+0000 7f19c5d9b700 1 -- 172.21.15.38:0/2324281912 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19c000a160 con 0x7f19c81401f0 2020-06-12T17:48:20.637 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.628+0000 7f19c6d9d700 1 --2- 172.21.15.38:0/2324281912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19c81401f0 0x7f19c809cf10 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7f19c00032b0 tx=0x7f19c00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.638 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.628+0000 7f19c5d9b700 1 -- 172.21.15.38:0/2324281912 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c000a2c0 con 0x7f19c81401f0 2020-06-12T17:48:20.638 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.628+0000 7f19c5d9b700 1 -- 172.21.15.38:0/2324281912 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19c000a660 con 0x7f19c81401f0 2020-06-12T17:48:20.638 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.628+0000 7f19cd1a4700 1 -- 172.21.15.38:0/2324281912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19c81401f0 msgr2=0x7f19c809cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.638 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.628+0000 7f19cd1a4700 1 --2- 172.21.15.38:0/2324281912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19c81401f0 0x7f19c809cf10 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7f19c00032b0 tx=0x7f19c00081e0).stop 2020-06-12T17:48:20.638 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.629+0000 7f19cd1a4700 1 -- 172.21.15.38:0/2324281912 shutdown_connections 2020-06-12T17:48:20.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.629+0000 7f19cd1a4700 1 --2- 172.21.15.38:0/2324281912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19c81401f0 0x7f19c809cf10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.629+0000 7f19cd1a4700 1 --2- 172.21.15.38:0/2324281912 >> v2:172.21.15.150:3300/0 conn(0x7f19c80adaf0 0x7f19c8146cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:20.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.629+0000 7f19cd1a4700 1 -- 172.21.15.38:0/2324281912 >> 172.21.15.38:0/2324281912 conn(0x7f19c80b8410 msgr2=0x7f19c80b8820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:20.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.629+0000 7f19cd1a4700 1 -- 172.21.15.38:0/2324281912 shutdown_connections 2020-06-12T17:48:20.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.629+0000 7f19cd1a4700 1 -- 172.21.15.38:0/2324281912 wait complete. 2020-06-12T17:48:20.640 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.630+0000 7f19cd1a4700 1 Processor -- start 2020-06-12T17:48:20.640 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.630+0000 7f19cd1a4700 1 -- start start 2020-06-12T17:48:20.643 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.631+0000 7f19cd1a4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f19c80b3f40 0x7f19c8130cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.643 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.631+0000 7f19cd1a4700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c8143f40 con 0x7f19c81401f0 2020-06-12T17:48:20.643 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.631+0000 7f19cd1a4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c81549d0 con 0x7f19c80adaf0 2020-06-12T17:48:20.644 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.631+0000 7f19cd1a4700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c8154c70 con 0x7f19c80b3f40 2020-06-12T17:48:20.644 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.631+0000 7f19c659c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f19c80b3f40 0x7f19c8130cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.644 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.631+0000 7f19c759e700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f19c81401f0 0x7f19c80b0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37556/0 (socket says 172.21.15.38:37556) 2020-06-12T17:48:20.644 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.631+0000 7f19c659c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f19c80b3f40 0x7f19c8130cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35738/0 (socket says 172.21.15.38:35738) 2020-06-12T17:48:20.644 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.631+0000 7f19c759e700 1 -- 172.21.15.38:0/1502402349 learned_addr learned my addr 172.21.15.38:0/1502402349 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:20.645 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.631+0000 7f19c659c700 1 -- 172.21.15.38:0/1502402349 >> v1:172.21.15.150:6789/0 conn(0x7f19c80adaf0 legacy=0x7f19c81305c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.645 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.631+0000 7f19bffff700 1 -- 172.21.15.38:0/1502402349 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795850009 0 0) 0x7f19c8143f40 con 0x7f19c81401f0 2020-06-12T17:48:20.645 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.631+0000 7f19c659c700 1 -- 172.21.15.38:0/1502402349 >> v1:172.21.15.38:6789/0 conn(0x7f19c81401f0 legacy=0x7f19c80b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.645 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.631+0000 7f19c659c700 1 -- 172.21.15.38:0/1502402349 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c8154f10 con 0x7f19c80b3f40 2020-06-12T17:48:20.645 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.631+0000 7f19c659c700 1 --2- 172.21.15.38:0/1502402349 >> v2:172.21.15.38:3300/0 conn(0x7f19c80b3f40 0x7f19c8130cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f19b0002f30 tx=0x7f19b000e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.631+0000 7f19c659c700 1 --2- 172.21.15.38:0/1502402349 >> v2:172.21.15.38:3300/0 conn(0x7f19c80b3f40 0x7f19c8130cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f19b0002f30 tx=0x7f19b000e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.631+0000 7f19c659c700 1 --2- 172.21.15.38:0/1502402349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19c80b3f40 0x7f19c8130cd0 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f19b0002f30 tx=0x7f19b000e0c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.631+0000 7f19c659c700 1 --2- 172.21.15.38:0/1502402349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19c80b3f40 0x7f19c8130cd0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f19b0002f30 tx=0x7f19b000e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.631+0000 7f19bffff700 1 -- 172.21.15.38:0/1502402349 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19b0007160 con 0x7f19c80b3f40 2020-06-12T17:48:20.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.631+0000 7f19c659c700 1 --2- 172.21.15.38:0/1502402349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19c80b3f40 0x7f19c8130cd0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f19b0002f30 tx=0x7f19b000e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.631+0000 7f19c659c700 1 --2- 172.21.15.38:0/1502402349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19c80b3f40 0x7f19c8130cd0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f19b0002f30 tx=0x7f19b000e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.631+0000 7f19bffff700 1 -- 172.21.15.38:0/1502402349 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b00072c0 con 0x7f19c80b3f40 2020-06-12T17:48:20.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.631+0000 7f19cd1a4700 1 -- 172.21.15.38:0/1502402349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c81551b0 con 0x7f19c80b3f40 2020-06-12T17:48:20.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.631+0000 7f19bffff700 1 -- 172.21.15.38:0/1502402349 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19b0012260 con 0x7f19c80b3f40 2020-06-12T17:48:20.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.631+0000 7f19cd1a4700 1 -- 172.21.15.38:0/1502402349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c8155650 con 0x7f19c80b3f40 2020-06-12T17:48:20.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.632+0000 7f19c659c700 1 --2- 172.21.15.38:0/1502402349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19c80b3f40 0x7f19c8130cd0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f19b0002f30 tx=0x7f19b000e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.632+0000 7f19cd1a4700 1 -- 172.21.15.38:0/1502402349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f19c81553b0 con 0x7f19c80b3f40 2020-06-12T17:48:20.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.632+0000 7f19bffff700 1 -- 172.21.15.38:0/1502402349 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f19b0013060 con 0x7f19c80b3f40 2020-06-12T17:48:20.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.632+0000 7f19c659c700 1 --2- 172.21.15.38:0/1502402349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19c80b3f40 0x7f19c8130cd0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f19b0002f30 tx=0x7f19b000e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.632+0000 7f19c659c700 1 --2- 172.21.15.38:0/1502402349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19c80b3f40 0x7f19c8130cd0 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7f19b0002f30 tx=0x7f19b000e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.633+0000 7f19bffff700 1 --2- 172.21.15.38:0/1502402349 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f19ac04d420 0x7f19ac04f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.633+0000 7f19bffff700 1 -- 172.21.15.38:0/1502402349 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f19b0061170 con 0x7f19c80b3f40 2020-06-12T17:48:20.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.633+0000 7f19bffff700 1 --2- 172.21.15.38:0/1502402349 >> [v2:172.21.15.150:6817/31297,v1:172.21.15.150:6820/31297] conn(0x7f19ac0545c0 0x7f19ac0569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.633+0000 7f19bffff700 1 -- 172.21.15.38:0/1502402349 --> [v2:172.21.15.150:6817/31297,v1:172.21.15.150:6820/31297] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f19ac056fa0 con 0x7f19ac0545c0 2020-06-12T17:48:20.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.633+0000 7f19bffff700 1 -- 172.21.15.38:0/1502402349 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19b00625d0 con 0x7f19c80b3f40 2020-06-12T17:48:20.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.633+0000 7f19c6d9d700 1 --2- 172.21.15.38:0/1502402349 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f19ac04d420 0x7f19ac04f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.633+0000 7f19c759e700 1 --2- 172.21.15.38:0/1502402349 >> [v2:172.21.15.150:6817/31297,v1:172.21.15.150:6820/31297] conn(0x7f19ac0545c0 0x7f19ac0569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.633+0000 7f19c6d9d700 1 --2- 172.21.15.38:0/1502402349 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f19ac04d420 0x7f19ac04f8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f19c0008250 tx=0x7f19c00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.633+0000 7f19c6d9d700 1 --2- 172.21.15.38:0/1502402349 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f19ac04d420 0x7f19ac04f8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f19c0008250 tx=0x7f19c00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.633+0000 7f19c6d9d700 1 --2- 172.21.15.38:0/1502402349 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f19ac04d420 0x7f19ac04f8e0 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f19c0008250 tx=0x7f19c00081e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.634+0000 7f19c759e700 1 --2- 172.21.15.38:0/1502402349 >> [v2:172.21.15.150:6817/31297,v1:172.21.15.150:6820/31297] conn(0x7f19ac0545c0 0x7f19ac0569e0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.634+0000 7f19bffff700 1 -- 172.21.15.38:0/1502402349 <== osd.6 v2:172.21.15.150:6817/31297 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f19ac056fa0 con 0x7f19ac0545c0 2020-06-12T17:48:20.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.652+0000 7f19cd1a4700 1 -- 172.21.15.38:0/1502402349 --> [v2:172.21.15.150:6817/31297,v1:172.21.15.150:6820/31297] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f19c8145bb0 con 0x7f19ac0545c0 2020-06-12T17:48:20.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.653+0000 7f19bffff700 1 -- 172.21.15.38:0/1502402349 <== osd.6 v2:172.21.15.150:6817/31297 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f19c8145bb0 con 0x7f19ac0545c0 2020-06-12T17:48:20.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.653+0000 7f19cd1a4700 1 -- 172.21.15.38:0/1502402349 >> [v2:172.21.15.150:6817/31297,v1:172.21.15.150:6820/31297] conn(0x7f19ac0545c0 msgr2=0x7f19ac0569e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.653+0000 7f19cd1a4700 1 --2- 172.21.15.38:0/1502402349 >> [v2:172.21.15.150:6817/31297,v1:172.21.15.150:6820/31297] conn(0x7f19ac0545c0 0x7f19ac0569e0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.653+0000 7f19cd1a4700 1 -- 172.21.15.38:0/1502402349 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f19ac04d420 msgr2=0x7f19ac04f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.653+0000 7f19cd1a4700 1 --2- 172.21.15.38:0/1502402349 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f19ac04d420 0x7f19ac04f8e0 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f19c0008250 tx=0x7f19c00081e0).stop 2020-06-12T17:48:20.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.653+0000 7f19cd1a4700 1 -- 172.21.15.38:0/1502402349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19c80b3f40 msgr2=0x7f19c8130cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.653+0000 7f19cd1a4700 1 --2- 172.21.15.38:0/1502402349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19c80b3f40 0x7f19c8130cd0 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f19b0002f30 tx=0x7f19b000e0c0).stop 2020-06-12T17:48:20.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.653+0000 7f19c759e700 1 -- 172.21.15.38:0/1502402349 reap_dead start 2020-06-12T17:48:20.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.653+0000 7f19cd1a4700 1 -- 172.21.15.38:0/1502402349 shutdown_connections 2020-06-12T17:48:20.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.653+0000 7f19cd1a4700 1 --2- 172.21.15.38:0/1502402349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19c80b3f40 0x7f19c8130cd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.653+0000 7f19cd1a4700 1 -- 172.21.15.38:0/1502402349 >> 172.21.15.38:0/1502402349 conn(0x7f19c80b8410 msgr2=0x7f19c813f150 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:20.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.654+0000 7f19cd1a4700 1 -- 172.21.15.38:0/1502402349 shutdown_connections 2020-06-12T17:48:20.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.654+0000 7f19cd1a4700 1 -- 172.21.15.38:0/1502402349 wait complete. 2020-06-12T17:48:20.666 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2020-06-12T17:48:20.667 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 flush_pg_stats 2020-06-12T17:48:20.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.779+0000 7f26b7f30700 1 Processor -- start 2020-06-12T17:48:20.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.779+0000 7f26b7f30700 1 -- start start 2020-06-12T17:48:20.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.780+0000 7f26b7f30700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26b00b44f0 0x7f26b0142bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:20.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.780+0000 7f26b7f30700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f26b0143010 0x7f26b01434a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:20.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.780+0000 7f26b7f30700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b01424b0 con 0x7f26b0066eb0 2020-06-12T17:48:20.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.780+0000 7f26b7f30700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b0067290 con 0x7f26b0143010 2020-06-12T17:48:20.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.780+0000 7f26b7f30700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b00b3bc0 con 0x7f26b00b44f0 2020-06-12T17:48:20.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.780+0000 7f26b64cd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f26b0143010 0x7f26b01434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.780+0000 7f26b64cd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f26b0143010 0x7f26b01434a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35748/0 (socket says 172.21.15.38:35748) 2020-06-12T17:48:20.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.780+0000 7f26b64cd700 1 -- 172.21.15.38:0/3569348182 learned_addr learned my addr 172.21.15.38:0/3569348182 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:20.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.780+0000 7f26b54cb700 1 --2- 172.21.15.38:0/3569348182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26b00b44f0 0x7f26b0142bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.780+0000 7f26b64cd700 1 -- 172.21.15.38:0/3569348182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26b00b44f0 msgr2=0x7f26b0142bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:20.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.780+0000 7f26b64cd700 1 --2- 172.21.15.38:0/3569348182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26b00b44f0 0x7f26b0142bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:20.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.780+0000 7f26b64cd700 1 -- 172.21.15.38:0/3569348182 >> v1:172.21.15.150:6789/0 conn(0x7f26b0066eb0 legacy=0x7f26b005b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:20.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.780+0000 7f26b64cd700 1 -- 172.21.15.38:0/3569348182 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b0142710 con 0x7f26b0143010 2020-06-12T17:48:20.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.780+0000 7f26b54cb700 1 --2- 172.21.15.38:0/3569348182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26b00b44f0 0x7f26b0142bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:48:20.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.780+0000 7f26b64cd700 1 --2- 172.21.15.38:0/3569348182 >> v2:172.21.15.38:3300/0 conn(0x7f26b0143010 0x7f26b01434a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f26b009db60 tx=0x7f26a80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.780+0000 7f26b64cd700 1 --2- 172.21.15.38:0/3569348182 >> v2:172.21.15.38:3300/0 conn(0x7f26b0143010 0x7f26b01434a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f26b009db60 tx=0x7f26a80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.780+0000 7f26b64cd700 1 --2- 172.21.15.38:0/3569348182 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26b0143010 0x7f26b01434a0 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7f26b009db60 tx=0x7f26a80081e0).ready entity=mon.0 client_cookie=3ccd6dbbb289ae03 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.780+0000 7f26b64cd700 1 --2- 172.21.15.38:0/3569348182 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26b0143010 0x7f26b01434a0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f26b009db60 tx=0x7f26a80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.780+0000 7f26b4cca700 1 -- 172.21.15.38:0/3569348182 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26a800a160 con 0x7f26b0143010 2020-06-12T17:48:20.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.780+0000 7f26b64cd700 1 --2- 172.21.15.38:0/3569348182 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26b0143010 0x7f26b01434a0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f26b009db60 tx=0x7f26a80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.780+0000 7f26b64cd700 1 --2- 172.21.15.38:0/3569348182 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26b0143010 0x7f26b01434a0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f26b009db60 tx=0x7f26a80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.780+0000 7f26b4cca700 1 -- 172.21.15.38:0/3569348182 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a800a2c0 con 0x7f26b0143010 2020-06-12T17:48:20.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.780+0000 7f26b4cca700 1 -- 172.21.15.38:0/3569348182 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26a800a6e0 con 0x7f26b0143010 2020-06-12T17:48:20.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.781+0000 7f26b7f30700 1 -- 172.21.15.38:0/3569348182 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26b0143010 msgr2=0x7f26b01434a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.781+0000 7f26b7f30700 1 --2- 172.21.15.38:0/3569348182 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26b0143010 0x7f26b01434a0 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7f26b009db60 tx=0x7f26a80081e0).stop 2020-06-12T17:48:20.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.781+0000 7f26b7f30700 1 -- 172.21.15.38:0/3569348182 shutdown_connections 2020-06-12T17:48:20.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.781+0000 7f26b7f30700 1 --2- 172.21.15.38:0/3569348182 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26b0143010 0x7f26b01434a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.781+0000 7f26b7f30700 1 --2- 172.21.15.38:0/3569348182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26b00b44f0 0x7f26b0142bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:20.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.781+0000 7f26b7f30700 1 -- 172.21.15.38:0/3569348182 >> 172.21.15.38:0/3569348182 conn(0x7f26b00b8410 msgr2=0x7f26b00b8820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:20.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.781+0000 7f26b7f30700 1 -- 172.21.15.38:0/3569348182 shutdown_connections 2020-06-12T17:48:20.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.781+0000 7f26b7f30700 1 -- 172.21.15.38:0/3569348182 wait complete. 2020-06-12T17:48:20.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.782+0000 7f26b7f30700 1 Processor -- start 2020-06-12T17:48:20.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.782+0000 7f26b7f30700 1 -- start start 2020-06-12T17:48:20.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.783+0000 7f26b7f30700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f26b00b44f0 0x7f26b0130de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.783+0000 7f26b7f30700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f26b0143010 0x7f26b01385b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.783+0000 7f26b7f30700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b00648c0 con 0x7f26b0066eb0 2020-06-12T17:48:20.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.783+0000 7f26b7f30700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b0066170 con 0x7f26b0143010 2020-06-12T17:48:20.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.783+0000 7f26b7f30700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b0066410 con 0x7f26b00b44f0 2020-06-12T17:48:20.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.783+0000 7f26b64cd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f26b0143010 0x7f26b01385b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.783+0000 7f26b64cd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f26b0143010 0x7f26b01385b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35756/0 (socket says 172.21.15.38:35756) 2020-06-12T17:48:20.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.783+0000 7f26b64cd700 1 -- 172.21.15.38:0/89171096 learned_addr learned my addr 172.21.15.38:0/89171096 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:20.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.783+0000 7f26b54cb700 1 --2- 172.21.15.38:0/89171096 >> v2:172.21.15.150:3300/0 conn(0x7f26b00b44f0 0x7f26b0130de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.783+0000 7f26b64cd700 1 -- 172.21.15.38:0/89171096 >> v2:172.21.15.150:3300/0 conn(0x7f26b00b44f0 msgr2=0x7f26b0130de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.783+0000 7f26b64cd700 1 --2- 172.21.15.38:0/89171096 >> v2:172.21.15.150:3300/0 conn(0x7f26b00b44f0 0x7f26b0130de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.783+0000 7f26b64cd700 1 -- 172.21.15.38:0/89171096 >> v1:172.21.15.150:6789/0 conn(0x7f26b0066eb0 legacy=0x7f26b0131900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.783+0000 7f26b64cd700 1 -- 172.21.15.38:0/89171096 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b00619a0 con 0x7f26b0143010 2020-06-12T17:48:20.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.783+0000 7f26b64cd700 1 --2- 172.21.15.38:0/89171096 >> v2:172.21.15.38:3300/0 conn(0x7f26b0143010 0x7f26b01385b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f26b0062b10 tx=0x7f26a80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.783+0000 7f26b64cd700 1 --2- 172.21.15.38:0/89171096 >> v2:172.21.15.38:3300/0 conn(0x7f26b0143010 0x7f26b01385b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f26b0062b10 tx=0x7f26a80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.783+0000 7f26b64cd700 1 --2- 172.21.15.38:0/89171096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26b0143010 0x7f26b01385b0 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7f26b0062b10 tx=0x7f26a80081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.783+0000 7f26b64cd700 1 --2- 172.21.15.38:0/89171096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26b0143010 0x7f26b01385b0 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f26b0062b10 tx=0x7f26a80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.783+0000 7f269effd700 1 -- 172.21.15.38:0/89171096 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26a8005c30 con 0x7f26b0143010 2020-06-12T17:48:20.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.783+0000 7f26b64cd700 1 --2- 172.21.15.38:0/89171096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26b0143010 0x7f26b01385b0 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f26b0062b10 tx=0x7f26a80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.783+0000 7f26b64cd700 1 --2- 172.21.15.38:0/89171096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26b0143010 0x7f26b01385b0 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f26b0062b10 tx=0x7f26a80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.783+0000 7f269effd700 1 -- 172.21.15.38:0/89171096 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a8005d90 con 0x7f26b0143010 2020-06-12T17:48:20.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.783+0000 7f26b7f30700 1 -- 172.21.15.38:0/89171096 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b0132010 con 0x7f26b0143010 2020-06-12T17:48:20.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.783+0000 7f269effd700 1 -- 172.21.15.38:0/89171096 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26a8007340 con 0x7f26b0143010 2020-06-12T17:48:20.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.783+0000 7f26b7f30700 1 -- 172.21.15.38:0/89171096 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b0061e20 con 0x7f26b0143010 2020-06-12T17:48:20.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.784+0000 7f26b64cd700 1 --2- 172.21.15.38:0/89171096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26b0143010 0x7f26b01385b0 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f26b0062b10 tx=0x7f26a80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.784+0000 7f26b7f30700 1 -- 172.21.15.38:0/89171096 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f26b009beb0 con 0x7f26b0143010 2020-06-12T17:48:20.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.784+0000 7f269effd700 1 -- 172.21.15.38:0/89171096 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f26a80075b0 con 0x7f26b0143010 2020-06-12T17:48:20.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.784+0000 7f26b64cd700 1 --2- 172.21.15.38:0/89171096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26b0143010 0x7f26b01385b0 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f26b0062b10 tx=0x7f26a80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.785+0000 7f26b64cd700 1 --2- 172.21.15.38:0/89171096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26b0143010 0x7f26b01385b0 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f26b0062b10 tx=0x7f26a80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.785+0000 7f269effd700 1 --2- 172.21.15.38:0/89171096 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f269004d5d0 0x7f269004fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.785+0000 7f269effd700 1 -- 172.21.15.38:0/89171096 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f26a8061bf0 con 0x7f26b0143010 2020-06-12T17:48:20.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.785+0000 7f269effd700 1 --2- 172.21.15.38:0/89171096 >> [v2:172.21.15.150:6810/31296,v1:172.21.15.150:6812/31296] conn(0x7f2690054870 0x7f2690056c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.785+0000 7f269effd700 1 -- 172.21.15.38:0/89171096 --> [v2:172.21.15.150:6810/31296,v1:172.21.15.150:6812/31296] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2690057250 con 0x7f2690054870 2020-06-12T17:48:20.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.785+0000 7f269effd700 1 -- 172.21.15.38:0/89171096 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26a80630b0 con 0x7f26b0143010 2020-06-12T17:48:20.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.785+0000 7f26b5ccc700 1 --2- 172.21.15.38:0/89171096 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f269004d5d0 0x7f269004fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.785+0000 7f26b54cb700 1 --2- 172.21.15.38:0/89171096 >> [v2:172.21.15.150:6810/31296,v1:172.21.15.150:6812/31296] conn(0x7f2690054870 0x7f2690056c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.785+0000 7f26b5ccc700 1 --2- 172.21.15.38:0/89171096 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f269004d5d0 0x7f269004fa90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f26a0001f50 tx=0x7f26a0002320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.785+0000 7f26b5ccc700 1 --2- 172.21.15.38:0/89171096 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f269004d5d0 0x7f269004fa90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f26a0001f50 tx=0x7f26a0002320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.785+0000 7f26b5ccc700 1 --2- 172.21.15.38:0/89171096 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f269004d5d0 0x7f269004fa90 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f26a0001f50 tx=0x7f26a0002320).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.786+0000 7f26b54cb700 1 --2- 172.21.15.38:0/89171096 >> [v2:172.21.15.150:6810/31296,v1:172.21.15.150:6812/31296] conn(0x7f2690054870 0x7f2690056c90 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.805 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.786+0000 7f269effd700 1 -- 172.21.15.38:0/89171096 <== osd.7 v2:172.21.15.150:6810/31296 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f2690057250 con 0x7f2690054870 2020-06-12T17:48:20.808 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.804+0000 7f26b7f30700 1 -- 172.21.15.38:0/89171096 --> [v2:172.21.15.150:6810/31296,v1:172.21.15.150:6812/31296] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f26b0062400 con 0x7f2690054870 2020-06-12T17:48:20.809 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.805+0000 7f269effd700 1 -- 172.21.15.38:0/89171096 <== osd.7 v2:172.21.15.150:6810/31296 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f26b0062400 con 0x7f2690054870 2020-06-12T17:48:20.809 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.805+0000 7f26b7f30700 1 -- 172.21.15.38:0/89171096 >> [v2:172.21.15.150:6810/31296,v1:172.21.15.150:6812/31296] conn(0x7f2690054870 msgr2=0x7f2690056c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.810 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.805+0000 7f26b7f30700 1 --2- 172.21.15.38:0/89171096 >> [v2:172.21.15.150:6810/31296,v1:172.21.15.150:6812/31296] conn(0x7f2690054870 0x7f2690056c90 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.810 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.805+0000 7f26b7f30700 1 -- 172.21.15.38:0/89171096 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f269004d5d0 msgr2=0x7f269004fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.810 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.805+0000 7f26b7f30700 1 --2- 172.21.15.38:0/89171096 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f269004d5d0 0x7f269004fa90 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f26a0001f50 tx=0x7f26a0002320).stop 2020-06-12T17:48:20.810 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.805+0000 7f26b7f30700 1 -- 172.21.15.38:0/89171096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26b0143010 msgr2=0x7f26b01385b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.810 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.805+0000 7f26b7f30700 1 --2- 172.21.15.38:0/89171096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26b0143010 0x7f26b01385b0 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7f26b0062b10 tx=0x7f26a80081e0).stop 2020-06-12T17:48:20.811 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.805+0000 7f26b64cd700 1 -- 172.21.15.38:0/89171096 reap_dead start 2020-06-12T17:48:20.811 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.805+0000 7f26b7f30700 1 -- 172.21.15.38:0/89171096 shutdown_connections 2020-06-12T17:48:20.811 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.805+0000 7f26b7f30700 1 --2- 172.21.15.38:0/89171096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26b0143010 0x7f26b01385b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.811 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.805+0000 7f26b7f30700 1 -- 172.21.15.38:0/89171096 >> 172.21.15.38:0/89171096 conn(0x7f26b00b8410 msgr2=0x7f26b009b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:20.811 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.805+0000 7f26b7f30700 1 -- 172.21.15.38:0/89171096 shutdown_connections 2020-06-12T17:48:20.812 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.805+0000 7f26b7f30700 1 -- 172.21.15.38:0/89171096 wait complete. 2020-06-12T17:48:20.818 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2020-06-12T17:48:20.819 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-06-12T17:48:20.935 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.932+0000 7f965312f700 1 Processor -- start 2020-06-12T17:48:20.936 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.932+0000 7f965312f700 1 -- start start 2020-06-12T17:48:20.939 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.933+0000 7f965312f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f964c0b1540 0x7f964c05c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:20.939 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.933+0000 7f965312f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f964c05c540 0x7f964c0b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:20.939 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.933+0000 7f965312f700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f964c05f910 con 0x7f964c0b20e0 2020-06-12T17:48:20.939 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.933+0000 7f965312f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f964c145e70 con 0x7f964c0b1540 2020-06-12T17:48:20.940 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.933+0000 7f965312f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964c05fbb0 con 0x7f964c05c540 2020-06-12T17:48:20.940 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.933+0000 7f965212d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f964c0b20e0 0x7f964c05f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37578/0 (socket says 172.21.15.38:37578) 2020-06-12T17:48:20.940 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.933+0000 7f965212d700 1 -- 172.21.15.38:0/1891983870 learned_addr learned my addr 172.21.15.38:0/1891983870 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:20.940 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.933+0000 7f965192c700 1 --2- 172.21.15.38:0/1891983870 >> v2:172.21.15.150:3300/0 conn(0x7f964c0b1540 0x7f964c05c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.940 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.933+0000 7f965292e700 1 --2- 172.21.15.38:0/1891983870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f964c05c540 0x7f964c0b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.933+0000 7f965112b700 1 -- 172.21.15.38:0/1891983870 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1676271892 0 0) 0x7f964c05f910 con 0x7f964c0b20e0 2020-06-12T17:48:20.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.933+0000 7f965112b700 1 -- 172.21.15.38:0/1891983870 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9638003230 con 0x7f964c0b20e0 2020-06-12T17:48:20.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.933+0000 7f965112b700 1 -- 172.21.15.38:0/1891983870 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1837336949 0 0) 0x7f9638003230 con 0x7f964c0b20e0 2020-06-12T17:48:20.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.933+0000 7f965292e700 1 -- 172.21.15.38:0/1891983870 >> v2:172.21.15.150:3300/0 conn(0x7f964c0b1540 msgr2=0x7f964c05c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:20.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.933+0000 7f965292e700 1 --2- 172.21.15.38:0/1891983870 >> v2:172.21.15.150:3300/0 conn(0x7f964c0b1540 0x7f964c05c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:20.942 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.933+0000 7f965292e700 1 -- 172.21.15.38:0/1891983870 >> v1:172.21.15.38:6789/0 conn(0x7f964c0b20e0 legacy=0x7f964c05f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.942 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.933+0000 7f965292e700 1 -- 172.21.15.38:0/1891983870 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964c05fe50 con 0x7f964c05c540 2020-06-12T17:48:20.942 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.933+0000 7f965192c700 1 --2- 172.21.15.38:0/1891983870 >> v2:172.21.15.150:3300/0 conn(0x7f964c0b1540 0x7f964c05c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:20.942 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.933+0000 7f965292e700 1 --2- 172.21.15.38:0/1891983870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f964c05c540 0x7f964c0b80d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9644001bf0 tx=0x7f963c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.942 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.934+0000 7f965292e700 1 --2- 172.21.15.38:0/1891983870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f964c05c540 0x7f964c0b80d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9644001bf0 tx=0x7f963c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.934+0000 7f965292e700 1 --2- 172.21.15.38:0/1891983870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f964c05c540 0x7f964c0b80d0 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f9644001bf0 tx=0x7f963c007e60).ready entity=mon.2 client_cookie=a45c90dce0e56b05 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.934+0000 7f965292e700 1 --2- 172.21.15.38:0/1891983870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f964c05c540 0x7f964c0b80d0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f9644001bf0 tx=0x7f963c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.934+0000 7f965112b700 1 -- 172.21.15.38:0/1891983870 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9644001a50 con 0x7f964c05c540 2020-06-12T17:48:20.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.934+0000 7f965292e700 1 --2- 172.21.15.38:0/1891983870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f964c05c540 0x7f964c0b80d0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f9644001bf0 tx=0x7f963c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.934+0000 7f965112b700 1 -- 172.21.15.38:0/1891983870 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963c008cb0 con 0x7f964c05c540 2020-06-12T17:48:20.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.934+0000 7f965292e700 1 --2- 172.21.15.38:0/1891983870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f964c05c540 0x7f964c0b80d0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f9644001bf0 tx=0x7f963c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.934+0000 7f965112b700 1 -- 172.21.15.38:0/1891983870 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f963c008e20 con 0x7f964c05c540 2020-06-12T17:48:20.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.934+0000 7f965312f700 1 -- 172.21.15.38:0/1891983870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f964c05c540 msgr2=0x7f964c0b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.934+0000 7f965312f700 1 --2- 172.21.15.38:0/1891983870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f964c05c540 0x7f964c0b80d0 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f9644001bf0 tx=0x7f963c007e60).stop 2020-06-12T17:48:20.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.934+0000 7f965312f700 1 -- 172.21.15.38:0/1891983870 shutdown_connections 2020-06-12T17:48:20.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.934+0000 7f965312f700 1 --2- 172.21.15.38:0/1891983870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f964c05c540 0x7f964c0b80d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.934+0000 7f965312f700 1 --2- 172.21.15.38:0/1891983870 >> v2:172.21.15.150:3300/0 conn(0x7f964c0b1540 0x7f964c05c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:20.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.934+0000 7f965312f700 1 -- 172.21.15.38:0/1891983870 >> 172.21.15.38:0/1891983870 conn(0x7f964c0b9b20 msgr2=0x7f964c0655b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:20.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.934+0000 7f965312f700 1 -- 172.21.15.38:0/1891983870 shutdown_connections 2020-06-12T17:48:20.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.934+0000 7f965312f700 1 -- 172.21.15.38:0/1891983870 wait complete. 2020-06-12T17:48:20.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.935+0000 7f965312f700 1 Processor -- start 2020-06-12T17:48:20.946 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.935+0000 7f965312f700 1 -- start start 2020-06-12T17:48:20.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.936+0000 7f965312f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f964c05c540 0x7f964c145fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.936+0000 7f965312f700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f964c0a0f30 con 0x7f964c0b20e0 2020-06-12T17:48:20.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.936+0000 7f965312f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f964c0a11d0 con 0x7f964c0b1540 2020-06-12T17:48:20.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.936+0000 7f965312f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f964c0a1470 con 0x7f964c05c540 2020-06-12T17:48:20.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.936+0000 7f965292e700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f964c0b20e0 0x7f964c0b37b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37588/0 (socket says 172.21.15.38:37588) 2020-06-12T17:48:20.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.936+0000 7f965292e700 1 -- 172.21.15.38:0/107337673 learned_addr learned my addr 172.21.15.38:0/107337673 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:20.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.936+0000 7f965212d700 1 --2- 172.21.15.38:0/107337673 >> v2:172.21.15.150:3300/0 conn(0x7f964c05c540 0x7f964c145fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.936+0000 7f964b7fe700 1 -- 172.21.15.38:0/107337673 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861470967 0 0) 0x7f964c0a0f30 con 0x7f964c0b20e0 2020-06-12T17:48:20.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.936+0000 7f964b7fe700 1 -- 172.21.15.38:0/107337673 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f962c002fe0 con 0x7f964c0b20e0 2020-06-12T17:48:20.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.936+0000 7f964b7fe700 1 -- 172.21.15.38:0/107337673 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4198463777 0 0) 0x7f962c002fe0 con 0x7f964c0b20e0 2020-06-12T17:48:20.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f964b7fe700 1 -- 172.21.15.38:0/107337673 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f964c0a0f30 con 0x7f964c0b20e0 2020-06-12T17:48:20.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f964b7fe700 1 -- 172.21.15.38:0/107337673 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f963c0085c0 con 0x7f964c0b20e0 2020-06-12T17:48:20.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f964b7fe700 1 -- 172.21.15.38:0/107337673 >> v2:172.21.15.150:3300/0 conn(0x7f964c05c540 msgr2=0x7f964c145fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f964b7fe700 1 --2- 172.21.15.38:0/107337673 >> v2:172.21.15.150:3300/0 conn(0x7f964c05c540 0x7f964c145fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f964b7fe700 1 -- 172.21.15.38:0/107337673 >> v1:172.21.15.150:6789/0 conn(0x7f964c0b1540 legacy=0x7f964c0bb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f964b7fe700 1 -- 172.21.15.38:0/107337673 >> v1:172.21.15.38:6789/0 conn(0x7f964c0b20e0 legacy=0x7f964c0b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f964b7fe700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f962c0049b0 0x7f962c004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f964b7fe700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f962c003920 0x7f962c003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f964b7fe700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f962c0041c0 0x7f962c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f964b7fe700 1 -- 172.21.15.38:0/107337673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964c0a1470 con 0x7f962c0049b0 2020-06-12T17:48:20.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f964b7fe700 1 -- 172.21.15.38:0/107337673 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962c004670 con 0x7f962c0041c0 2020-06-12T17:48:20.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f964b7fe700 1 -- 172.21.15.38:0/107337673 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962c00bbb0 con 0x7f962c003920 2020-06-12T17:48:20.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f965212d700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f962c0049b0 0x7f962c004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f965292e700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f962c0041c0 0x7f962c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f965192c700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f962c003920 0x7f962c003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f965212d700 1 -- 172.21.15.38:0/107337673 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f962c003920 msgr2=0x7f962c003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f965212d700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f962c003920 0x7f962c003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f965212d700 1 -- 172.21.15.38:0/107337673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f962c0041c0 msgr2=0x7f962c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:20.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f965212d700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f962c0041c0 0x7f962c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:20.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f965212d700 1 -- 172.21.15.38:0/107337673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964c0bbb80 con 0x7f962c0049b0 2020-06-12T17:48:20.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f965292e700 1 -- 172.21.15.38:0/107337673 reap_dead start 2020-06-12T17:48:20.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f965312f700 1 -- 172.21.15.38:0/107337673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f964c0a20f0 con 0x7f962c0049b0 2020-06-12T17:48:20.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f965212d700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f962c0049b0 0x7f962c004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f962c005650 tx=0x7f9644001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f965312f700 1 -- 172.21.15.38:0/107337673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f964c0bb630 con 0x7f962c0049b0 2020-06-12T17:48:20.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f965212d700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f962c0049b0 0x7f962c004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f962c005650 tx=0x7f9644001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f965212d700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f962c0049b0 0x7f962c004dd0 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f962c005650 tx=0x7f9644001dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f965212d700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f962c0049b0 0x7f962c004dd0 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f962c005650 tx=0x7f9644001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f964b7fe700 1 -- 172.21.15.38:0/107337673 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f964400ccd0 con 0x7f962c0049b0 2020-06-12T17:48:20.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f965212d700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f962c0049b0 0x7f962c004dd0 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f962c005650 tx=0x7f9644001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f965212d700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f962c0049b0 0x7f962c004dd0 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f962c005650 tx=0x7f9644001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f964b7fe700 1 -- 172.21.15.38:0/107337673 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964400ce30 con 0x7f962c0049b0 2020-06-12T17:48:20.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.937+0000 7f964b7fe700 1 -- 172.21.15.38:0/107337673 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9644011880 con 0x7f962c0049b0 2020-06-12T17:48:20.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.938+0000 7f965212d700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f962c0049b0 0x7f962c004dd0 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f962c005650 tx=0x7f9644001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.938+0000 7f965312f700 1 -- 172.21.15.38:0/107337673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f964c0a22e0 con 0x7f962c0049b0 2020-06-12T17:48:20.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.938+0000 7f964b7fe700 1 -- 172.21.15.38:0/107337673 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f96440119e0 con 0x7f962c0049b0 2020-06-12T17:48:20.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.938+0000 7f965212d700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f962c0049b0 0x7f962c004dd0 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f962c005650 tx=0x7f9644001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.939+0000 7f964b7fe700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f962c0513e0 0x7f962c0538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:20.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.939+0000 7f964b7fe700 1 -- 172.21.15.38:0/107337673 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f9644060f60 con 0x7f962c0049b0 2020-06-12T17:48:20.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.939+0000 7f965192c700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f962c0513e0 0x7f962c0538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:20.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.939+0000 7f965192c700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f962c0513e0 0x7f962c0538a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f964c0b59d0 tx=0x7f9640007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.939+0000 7f965192c700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f962c0513e0 0x7f962c0538a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f964c0b59d0 tx=0x7f9640007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.939+0000 7f965192c700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f962c0513e0 0x7f962c0538a0 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f964c0b59d0 tx=0x7f9640007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:20.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.942+0000 7f965212d700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f962c0049b0 0x7f962c004dd0 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f962c005650 tx=0x7f9644001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:20.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:20.942+0000 7f964b7fe700 1 -- 172.21.15.38:0/107337673 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f964c0a22e0 con 0x7f962c0049b0 2020-06-12T17:48:21.096 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:21.092+0000 7f965312f700 1 -- 172.21.15.38:0/107337673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f964c0a2280 con 0x7f962c0049b0 2020-06-12T17:48:21.097 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:21.093+0000 7f965212d700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f962c0049b0 0x7f962c004dd0 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f962c005650 tx=0x7f9644001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:21.097 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:21.093+0000 7f964b7fe700 1 -- 172.21.15.38:0/107337673 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f964403c6c0 con 0x7f962c0049b0 2020-06-12T17:48:21.097 INFO:teuthology.orchestra.run.smithi038.stdout:55834574852 2020-06-12T17:48:21.098 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:21.094+0000 7f965312f700 1 -- 172.21.15.38:0/107337673 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f962c0513e0 msgr2=0x7f962c0538a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:21.098 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:21.094+0000 7f965312f700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f962c0513e0 0x7f962c0538a0 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f964c0b59d0 tx=0x7f9640007e60).stop 2020-06-12T17:48:21.099 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:21.094+0000 7f965312f700 1 -- 172.21.15.38:0/107337673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f962c0049b0 msgr2=0x7f962c004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:21.099 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:21.094+0000 7f965312f700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f962c0049b0 0x7f962c004dd0 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f962c005650 tx=0x7f9644001dd0).stop 2020-06-12T17:48:21.099 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:21.094+0000 7f965312f700 1 -- 172.21.15.38:0/107337673 shutdown_connections 2020-06-12T17:48:21.099 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:21.094+0000 7f965312f700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f962c0513e0 0x7f962c0538a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:21.099 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:21.094+0000 7f965312f700 1 --2- 172.21.15.38:0/107337673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f962c0049b0 0x7f962c004dd0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:21.100 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:21.094+0000 7f965312f700 1 -- 172.21.15.38:0/107337673 >> 172.21.15.38:0/107337673 conn(0x7f964c0b9b20 msgr2=0x7f964c144210 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:21.100 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:21.094+0000 7f965312f700 1 -- 172.21.15.38:0/107337673 shutdown_connections 2020-06-12T17:48:21.100 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:21.094+0000 7f965312f700 1 -- 172.21.15.38:0/107337673 wait complete. 2020-06-12T17:48:21.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2020-06-12T17:48:22.109 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-06-12T17:48:22.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.235+0000 7f58df166700 1 Processor -- start 2020-06-12T17:48:22.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.235+0000 7f58df166700 1 -- start start 2020-06-12T17:48:22.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.236+0000 7f58df166700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f58d81401f0 0x7f58d809cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:22.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.236+0000 7f58df166700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d80aecd0 con 0x7f58d8146cf0 2020-06-12T17:48:22.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.236+0000 7f58df166700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d809d420 con 0x7f58d80adaf0 2020-06-12T17:48:22.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.236+0000 7f58df166700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d809d6c0 con 0x7f58d81401f0 2020-06-12T17:48:22.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.236+0000 7f58dd703700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f58d8146cf0 0x7f58d8143020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37598/0 (socket says 172.21.15.38:37598) 2020-06-12T17:48:22.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.236+0000 7f58dd703700 1 -- 172.21.15.38:0/3166452459 learned_addr learned my addr 172.21.15.38:0/3166452459 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:22.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.236+0000 7f58dcf02700 1 --2- 172.21.15.38:0/3166452459 >> v2:172.21.15.150:3300/0 conn(0x7f58d81401f0 0x7f58d809cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:22.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.236+0000 7f58d77fe700 1 -- 172.21.15.38:0/3166452459 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2313834749 0 0) 0x7f58d80aecd0 con 0x7f58d8146cf0 2020-06-12T17:48:22.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.236+0000 7f58d77fe700 1 -- 172.21.15.38:0/3166452459 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58c4003230 con 0x7f58d8146cf0 2020-06-12T17:48:22.245 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.236+0000 7f58d77fe700 1 -- 172.21.15.38:0/3166452459 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3538741165 0 0) 0x7f58c4003230 con 0x7f58d8146cf0 2020-06-12T17:48:22.245 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d77fe700 1 -- 172.21.15.38:0/3166452459 >> v2:172.21.15.150:3300/0 conn(0x7f58d81401f0 msgr2=0x7f58d809cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:22.245 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d77fe700 1 --2- 172.21.15.38:0/3166452459 >> v2:172.21.15.150:3300/0 conn(0x7f58d81401f0 0x7f58d809cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:22.245 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d77fe700 1 -- 172.21.15.38:0/3166452459 >> v1:172.21.15.150:6789/0 conn(0x7f58d80adaf0 legacy=0x7f58d80b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:22.245 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d77fe700 1 -- 172.21.15.38:0/3166452459 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d80adf80 con 0x7f58d8146cf0 2020-06-12T17:48:22.246 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d77fe700 1 -- 172.21.15.38:0/3166452459 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f58d0001a50 con 0x7f58d8146cf0 2020-06-12T17:48:22.246 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d77fe700 1 -- 172.21.15.38:0/3166452459 >> v1:172.21.15.38:6789/0 conn(0x7f58d8146cf0 legacy=0x7f58d8143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:22.246 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d77fe700 1 --2- 172.21.15.38:0/3166452459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58c4003720 0x7f58c4003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:22.246 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d77fe700 1 --2- 172.21.15.38:0/3166452459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58c4004020 0x7f58c40044f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:22.246 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d77fe700 1 --2- 172.21.15.38:0/3166452459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58c4004a60 0x7f58c4004f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:22.246 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d77fe700 1 -- 172.21.15.38:0/3166452459 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d809d6c0 con 0x7f58c4004020 2020-06-12T17:48:22.247 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d77fe700 1 -- 172.21.15.38:0/3166452459 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c400b830 con 0x7f58c4004a60 2020-06-12T17:48:22.247 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d77fe700 1 -- 172.21.15.38:0/3166452459 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c400b9f0 con 0x7f58c4003720 2020-06-12T17:48:22.247 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58dcf02700 1 --2- 172.21.15.38:0/3166452459 >> v2:172.21.15.150:3300/0 conn(0x7f58d81401f0 0x7f58d809cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:22.247 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d7fff700 1 --2- 172.21.15.38:0/3166452459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58c4004020 0x7f58c40044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:22.247 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58dd703700 1 --2- 172.21.15.38:0/3166452459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58c4004a60 0x7f58c4004f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:22.248 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58dcf02700 1 --2- 172.21.15.38:0/3166452459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58c4003720 0x7f58c4003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:22.248 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d7fff700 1 -- 172.21.15.38:0/3166452459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58c4003720 msgr2=0x7f58c4003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:22.248 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d7fff700 1 --2- 172.21.15.38:0/3166452459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58c4003720 0x7f58c4003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:22.248 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d7fff700 1 -- 172.21.15.38:0/3166452459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58c4004a60 msgr2=0x7f58c4004f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:22.248 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d7fff700 1 --2- 172.21.15.38:0/3166452459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58c4004a60 0x7f58c4004f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:22.249 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d7fff700 1 -- 172.21.15.38:0/3166452459 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c4003230 con 0x7f58c4004020 2020-06-12T17:48:22.249 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58dd703700 1 -- 172.21.15.38:0/3166452459 reap_dead start 2020-06-12T17:48:22.249 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58dcf02700 1 --2- 172.21.15.38:0/3166452459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58c4003720 0x7f58c4003b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:22.249 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d7fff700 1 --2- 172.21.15.38:0/3166452459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58c4004020 0x7f58c40044f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f58cc000fe0 tx=0x7f58cc0018e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.249 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d7fff700 1 --2- 172.21.15.38:0/3166452459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58c4004020 0x7f58c40044f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f58cc000fe0 tx=0x7f58cc0018e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.250 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d7fff700 1 --2- 172.21.15.38:0/3166452459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58c4004020 0x7f58c40044f0 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7f58cc000fe0 tx=0x7f58cc0018e0).ready entity=mon.0 client_cookie=99f8e46cded837fd server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:22.250 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d7fff700 1 --2- 172.21.15.38:0/3166452459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58c4004020 0x7f58c40044f0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f58cc000fe0 tx=0x7f58cc0018e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.250 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d77fe700 1 -- 172.21.15.38:0/3166452459 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58cc003540 con 0x7f58c4004020 2020-06-12T17:48:22.250 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d7fff700 1 --2- 172.21.15.38:0/3166452459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58c4004020 0x7f58c40044f0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f58cc000fe0 tx=0x7f58cc0018e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.250 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d7fff700 1 --2- 172.21.15.38:0/3166452459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58c4004020 0x7f58c40044f0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f58cc000fe0 tx=0x7f58cc0018e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.251 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d77fe700 1 -- 172.21.15.38:0/3166452459 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58cc0036a0 con 0x7f58c4004020 2020-06-12T17:48:22.251 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58d77fe700 1 -- 172.21.15.38:0/3166452459 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58cc003a80 con 0x7f58c4004020 2020-06-12T17:48:22.251 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58df166700 1 -- 172.21.15.38:0/3166452459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58c4004020 msgr2=0x7f58c40044f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:22.251 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.237+0000 7f58df166700 1 --2- 172.21.15.38:0/3166452459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58c4004020 0x7f58c40044f0 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7f58cc000fe0 tx=0x7f58cc0018e0).stop 2020-06-12T17:48:22.251 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.238+0000 7f58df166700 1 -- 172.21.15.38:0/3166452459 shutdown_connections 2020-06-12T17:48:22.251 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.238+0000 7f58df166700 1 --2- 172.21.15.38:0/3166452459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58c4004020 0x7f58c40044f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:22.252 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.238+0000 7f58df166700 1 -- 172.21.15.38:0/3166452459 >> 172.21.15.38:0/3166452459 conn(0x7f58d80b8410 msgr2=0x7f58d80b8820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:22.252 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.238+0000 7f58df166700 1 -- 172.21.15.38:0/3166452459 shutdown_connections 2020-06-12T17:48:22.252 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.238+0000 7f58df166700 1 -- 172.21.15.38:0/3166452459 wait complete. 2020-06-12T17:48:22.252 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.239+0000 7f58df166700 1 Processor -- start 2020-06-12T17:48:22.252 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.239+0000 7f58df166700 1 -- start start 2020-06-12T17:48:22.256 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.240+0000 7f58df166700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58c4004020 0x7f58d8156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:22.257 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.240+0000 7f58df166700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f58d8153340 0x7f58d80b7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:22.257 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.240+0000 7f58df166700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f58d8157030 0x7f58d81574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:22.257 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.240+0000 7f58df166700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d80b3b50 con 0x7f58d8157030 2020-06-12T17:48:22.257 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.240+0000 7f58df166700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d8153970 con 0x7f58d8153340 2020-06-12T17:48:22.257 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.240+0000 7f58df166700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d8153c10 con 0x7f58c4004020 2020-06-12T17:48:22.258 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.240+0000 7f58dd703700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f58d8157030 0x7f58d81574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:22.258 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.240+0000 7f58dd703700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f58d8157030 0x7f58d81574c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35798/0 (socket says 172.21.15.38:35798) 2020-06-12T17:48:22.258 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.240+0000 7f58dd703700 1 -- 172.21.15.38:0/4218341444 learned_addr learned my addr 172.21.15.38:0/4218341444 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:22.258 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.240+0000 7f58dcf02700 1 --2- 172.21.15.38:0/4218341444 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58c4004020 0x7f58d8156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:22.258 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.240+0000 7f58d7fff700 1 --2- 172.21.15.38:0/4218341444 >> v2:172.21.15.150:3300/0 conn(0x7f58d8153340 0x7f58d80b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:22.259 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.240+0000 7f58dd703700 1 -- 172.21.15.38:0/4218341444 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58c4004020 msgr2=0x7f58d8156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:22.259 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.240+0000 7f58dd703700 1 --2- 172.21.15.38:0/4218341444 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58c4004020 0x7f58d8156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:22.259 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.240+0000 7f58dd703700 1 -- 172.21.15.38:0/4218341444 >> v2:172.21.15.150:3300/0 conn(0x7f58d8153340 msgr2=0x7f58d80b7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:22.259 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.240+0000 7f58dd703700 1 --2- 172.21.15.38:0/4218341444 >> v2:172.21.15.150:3300/0 conn(0x7f58d8153340 0x7f58d80b7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:22.259 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.240+0000 7f58dd703700 1 -- 172.21.15.38:0/4218341444 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d8153eb0 con 0x7f58d8157030 2020-06-12T17:48:22.260 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.240+0000 7f58dd703700 1 --2- 172.21.15.38:0/4218341444 >> v2:172.21.15.38:3300/0 conn(0x7f58d8157030 0x7f58d81574c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f58d80607f0 tx=0x7f58d80b4af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.260 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.240+0000 7f58d7fff700 1 --2- 172.21.15.38:0/4218341444 >> v2:172.21.15.150:3300/0 conn(0x7f58d8153340 0x7f58d80b7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:48:22.260 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.240+0000 7f58dd703700 1 --2- 172.21.15.38:0/4218341444 >> v2:172.21.15.38:3300/0 conn(0x7f58d8157030 0x7f58d81574c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f58d80607f0 tx=0x7f58d80b4af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.260 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.240+0000 7f58dd703700 1 --2- 172.21.15.38:0/4218341444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58d8157030 0x7f58d81574c0 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7f58d80607f0 tx=0x7f58d80b4af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:22.260 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.240+0000 7f58dd703700 1 --2- 172.21.15.38:0/4218341444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58d8157030 0x7f58d81574c0 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f58d80607f0 tx=0x7f58d80b4af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.261 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.241+0000 7f58dd703700 1 --2- 172.21.15.38:0/4218341444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58d8157030 0x7f58d81574c0 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f58d80607f0 tx=0x7f58d80b4af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.261 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.240+0000 7f58d5ffb700 1 -- 172.21.15.38:0/4218341444 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58d00117a0 con 0x7f58d8157030 2020-06-12T17:48:22.261 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.241+0000 7f58dd703700 1 --2- 172.21.15.38:0/4218341444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58d8157030 0x7f58d81574c0 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f58d80607f0 tx=0x7f58d80b4af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.261 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.241+0000 7f58d5ffb700 1 -- 172.21.15.38:0/4218341444 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d0011900 con 0x7f58d8157030 2020-06-12T17:48:22.261 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.241+0000 7f58df166700 1 -- 172.21.15.38:0/4218341444 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d80b78c0 con 0x7f58d8157030 2020-06-12T17:48:22.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.241+0000 7f58d5ffb700 1 -- 172.21.15.38:0/4218341444 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58d0011c60 con 0x7f58d8157030 2020-06-12T17:48:22.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.241+0000 7f58df166700 1 -- 172.21.15.38:0/4218341444 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d8065c80 con 0x7f58d8157030 2020-06-12T17:48:22.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.241+0000 7f58dd703700 1 --2- 172.21.15.38:0/4218341444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58d8157030 0x7f58d81574c0 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f58d80607f0 tx=0x7f58d80b4af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.242+0000 7f58df166700 1 -- 172.21.15.38:0/4218341444 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d8154040 con 0x7f58d8157030 2020-06-12T17:48:22.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.242+0000 7f58d5ffb700 1 -- 172.21.15.38:0/4218341444 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f58d0004870 con 0x7f58d8157030 2020-06-12T17:48:22.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.242+0000 7f58dd703700 1 --2- 172.21.15.38:0/4218341444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58d8157030 0x7f58d81574c0 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f58d80607f0 tx=0x7f58d80b4af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.242+0000 7f58d5ffb700 1 --2- 172.21.15.38:0/4218341444 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f58b804d5d0 0x7f58b804fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:22.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.242+0000 7f58d5ffb700 1 -- 172.21.15.38:0/4218341444 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f58d0060920 con 0x7f58d8157030 2020-06-12T17:48:22.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.242+0000 7f58dcf02700 1 --2- 172.21.15.38:0/4218341444 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f58b804d5d0 0x7f58b804fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:22.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.243+0000 7f58dcf02700 1 --2- 172.21.15.38:0/4218341444 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f58b804d5d0 0x7f58b804fa90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f58c8002f30 tx=0x7f58c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.243+0000 7f58dcf02700 1 --2- 172.21.15.38:0/4218341444 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f58b804d5d0 0x7f58b804fa90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f58c8002f30 tx=0x7f58c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.264 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.243+0000 7f58dcf02700 1 --2- 172.21.15.38:0/4218341444 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f58b804d5d0 0x7f58b804fa90 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f58c8002f30 tx=0x7f58c8007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:22.264 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.245+0000 7f58dd703700 1 --2- 172.21.15.38:0/4218341444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58d8157030 0x7f58d81574c0 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f58d80607f0 tx=0x7f58d80b4af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.264 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.245+0000 7f58d5ffb700 1 -- 172.21.15.38:0/4218341444 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f58d003c080 con 0x7f58d8157030 2020-06-12T17:48:22.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.395+0000 7f58df166700 1 -- 172.21.15.38:0/4218341444 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f58d8056c30 con 0x7f58d8157030 2020-06-12T17:48:22.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.396+0000 7f58dd703700 1 --2- 172.21.15.38:0/4218341444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58d8157030 0x7f58d81574c0 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f58d80607f0 tx=0x7f58d80b4af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.400 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.396+0000 7f58d5ffb700 1 -- 172.21.15.38:0/4218341444 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f58d00070d0 con 0x7f58d8157030 2020-06-12T17:48:22.400 INFO:teuthology.orchestra.run.smithi038.stdout:55834574853 2020-06-12T17:48:22.401 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.397+0000 7f58df166700 1 -- 172.21.15.38:0/4218341444 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f58b804d5d0 msgr2=0x7f58b804fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:22.401 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.397+0000 7f58df166700 1 --2- 172.21.15.38:0/4218341444 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f58b804d5d0 0x7f58b804fa90 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f58c8002f30 tx=0x7f58c8007e60).stop 2020-06-12T17:48:22.402 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.397+0000 7f58df166700 1 -- 172.21.15.38:0/4218341444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58d8157030 msgr2=0x7f58d81574c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:22.402 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.397+0000 7f58df166700 1 --2- 172.21.15.38:0/4218341444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58d8157030 0x7f58d81574c0 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7f58d80607f0 tx=0x7f58d80b4af0).stop 2020-06-12T17:48:22.402 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.397+0000 7f58df166700 1 -- 172.21.15.38:0/4218341444 shutdown_connections 2020-06-12T17:48:22.402 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.397+0000 7f58df166700 1 --2- 172.21.15.38:0/4218341444 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f58b804d5d0 0x7f58b804fa90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:22.402 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.397+0000 7f58df166700 1 --2- 172.21.15.38:0/4218341444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58d8157030 0x7f58d81574c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:22.403 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.397+0000 7f58df166700 1 --2- 172.21.15.38:0/4218341444 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58c4004020 0x7f58d8156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:22.403 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.397+0000 7f58df166700 1 --2- 172.21.15.38:0/4218341444 >> v2:172.21.15.150:3300/0 conn(0x7f58d8153340 0x7f58d80b7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:22.403 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.397+0000 7f58df166700 1 -- 172.21.15.38:0/4218341444 >> 172.21.15.38:0/4218341444 conn(0x7f58d80b8410 msgr2=0x7f58d81462b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:22.403 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.397+0000 7f58df166700 1 -- 172.21.15.38:0/4218341444 shutdown_connections 2020-06-12T17:48:22.403 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.397+0000 7f58df166700 1 -- 172.21.15.38:0/4218341444 wait complete. 2020-06-12T17:48:22.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2020-06-12T17:48:22.411 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2020-06-12T17:48:22.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.522+0000 7fca603e0700 1 Processor -- start 2020-06-12T17:48:22.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.522+0000 7fca603e0700 1 -- start start 2020-06-12T17:48:22.529 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.523+0000 7fca603e0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca5809d010 0x7fca5809dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:22.529 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.523+0000 7fca603e0700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fca58147d40 0x7fca580b7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:22.529 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.523+0000 7fca603e0700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca580b8b60 con 0x7fca5809c4f0 2020-06-12T17:48:22.530 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.523+0000 7fca603e0700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca580b8e00 con 0x7fca58147d40 2020-06-12T17:48:22.530 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.523+0000 7fca603e0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca580b90a0 con 0x7fca5809d010 2020-06-12T17:48:22.530 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.523+0000 7fca5e97d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fca58147d40 0x7fca580b7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:22.530 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.523+0000 7fca5e97d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fca58147d40 0x7fca580b7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35802/0 (socket says 172.21.15.38:35802) 2020-06-12T17:48:22.531 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.523+0000 7fca5e97d700 1 -- 172.21.15.38:0/2490165476 learned_addr learned my addr 172.21.15.38:0/2490165476 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:22.531 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.524+0000 7fca5e17c700 1 --2- 172.21.15.38:0/2490165476 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca5809d010 0x7fca5809dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:22.531 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.524+0000 7fca5e97d700 1 -- 172.21.15.38:0/2490165476 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca5809d010 msgr2=0x7fca5809dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:22.531 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.524+0000 7fca5e97d700 1 --2- 172.21.15.38:0/2490165476 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca5809d010 0x7fca5809dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:22.531 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.524+0000 7fca5e97d700 1 -- 172.21.15.38:0/2490165476 >> v1:172.21.15.38:6789/0 conn(0x7fca5809c4f0 legacy=0x7fca5805b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:22.532 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.524+0000 7fca5d17a700 1 -- 172.21.15.38:0/2490165476 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497706902 0 0) 0x7fca580b8b60 con 0x7fca5809c4f0 2020-06-12T17:48:22.532 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.524+0000 7fca5e97d700 1 -- 172.21.15.38:0/2490165476 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5805bb30 con 0x7fca58147d40 2020-06-12T17:48:22.532 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.524+0000 7fca5e17c700 1 --2- 172.21.15.38:0/2490165476 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca5809d010 0x7fca5809dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:48:22.532 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.524+0000 7fca5e97d700 1 --2- 172.21.15.38:0/2490165476 >> v2:172.21.15.38:3300/0 conn(0x7fca58147d40 0x7fca580b7390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fca50002f30 tx=0x7fca50007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.532 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.524+0000 7fca5e97d700 1 --2- 172.21.15.38:0/2490165476 >> v2:172.21.15.38:3300/0 conn(0x7fca58147d40 0x7fca580b7390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fca50002f30 tx=0x7fca50007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.533 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.524+0000 7fca5e97d700 1 --2- 172.21.15.38:0/2490165476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca58147d40 0x7fca580b7390 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7fca50002f30 tx=0x7fca50007e60).ready entity=mon.0 client_cookie=60898549c6f6cf03 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:22.533 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.524+0000 7fca5e97d700 1 --2- 172.21.15.38:0/2490165476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca58147d40 0x7fca580b7390 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fca50002f30 tx=0x7fca50007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.533 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.524+0000 7fca5d17a700 1 -- 172.21.15.38:0/2490165476 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca500116e0 con 0x7fca58147d40 2020-06-12T17:48:22.533 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.524+0000 7fca5e97d700 1 --2- 172.21.15.38:0/2490165476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca58147d40 0x7fca580b7390 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fca50002f30 tx=0x7fca50007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.533 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.524+0000 7fca5d17a700 1 -- 172.21.15.38:0/2490165476 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca50011840 con 0x7fca58147d40 2020-06-12T17:48:22.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.524+0000 7fca5e97d700 1 --2- 172.21.15.38:0/2490165476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca58147d40 0x7fca580b7390 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7fca50002f30 tx=0x7fca50007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.524+0000 7fca603e0700 1 -- 172.21.15.38:0/2490165476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca58147d40 msgr2=0x7fca580b7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:22.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.524+0000 7fca5d17a700 1 -- 172.21.15.38:0/2490165476 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca50011c20 con 0x7fca58147d40 2020-06-12T17:48:22.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.524+0000 7fca603e0700 1 --2- 172.21.15.38:0/2490165476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca58147d40 0x7fca580b7390 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7fca50002f30 tx=0x7fca50007e60).stop 2020-06-12T17:48:22.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.524+0000 7fca603e0700 1 -- 172.21.15.38:0/2490165476 shutdown_connections 2020-06-12T17:48:22.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.524+0000 7fca603e0700 1 --2- 172.21.15.38:0/2490165476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca58147d40 0x7fca580b7390 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:22.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.524+0000 7fca603e0700 1 --2- 172.21.15.38:0/2490165476 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca5809d010 0x7fca5809dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:22.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.524+0000 7fca603e0700 1 -- 172.21.15.38:0/2490165476 >> 172.21.15.38:0/2490165476 conn(0x7fca580b9490 msgr2=0x7fca580b98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:22.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.525+0000 7fca603e0700 1 -- 172.21.15.38:0/2490165476 shutdown_connections 2020-06-12T17:48:22.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.525+0000 7fca603e0700 1 -- 172.21.15.38:0/2490165476 wait complete. 2020-06-12T17:48:22.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.525+0000 7fca603e0700 1 Processor -- start 2020-06-12T17:48:22.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.526+0000 7fca603e0700 1 -- start start 2020-06-12T17:48:22.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.526+0000 7fca603e0700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fca5809d010 0x7fca58153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:22.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.526+0000 7fca603e0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca58147d40 0x7fca581536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:22.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.526+0000 7fca603e0700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca58153b20 con 0x7fca5809c4f0 2020-06-12T17:48:22.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.526+0000 7fca603e0700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca580afc30 con 0x7fca5809d010 2020-06-12T17:48:22.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.526+0000 7fca603e0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca580afed0 con 0x7fca58147d40 2020-06-12T17:48:22.540 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.526+0000 7fca5e17c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fca5809c4f0 0x7fca5813d5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37624/0 (socket says 172.21.15.38:37624) 2020-06-12T17:48:22.540 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.526+0000 7fca5e17c700 1 -- 172.21.15.38:0/3318103431 learned_addr learned my addr 172.21.15.38:0/3318103431 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:22.540 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.526+0000 7fca5d97b700 1 --2- 172.21.15.38:0/3318103431 >> v2:172.21.15.38:3300/0 conn(0x7fca5809d010 0x7fca58153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:22.540 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.526+0000 7fca5e97d700 1 --2- 172.21.15.38:0/3318103431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca58147d40 0x7fca581536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:22.541 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.527+0000 7fca5d97b700 1 -- 172.21.15.38:0/3318103431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca58147d40 msgr2=0x7fca581536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:22.541 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.527+0000 7fca5d97b700 1 --2- 172.21.15.38:0/3318103431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca58147d40 0x7fca581536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:22.541 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.527+0000 7fca5d97b700 1 -- 172.21.15.38:0/3318103431 >> v1:172.21.15.38:6789/0 conn(0x7fca5809c4f0 legacy=0x7fca5813d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:22.541 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.527+0000 7fca477fe700 1 -- 172.21.15.38:0/3318103431 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164690841 0 0) 0x7fca48001fd0 con 0x7fca5809c4f0 2020-06-12T17:48:22.542 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.527+0000 7fca5d97b700 1 -- 172.21.15.38:0/3318103431 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca580b3b30 con 0x7fca5809d010 2020-06-12T17:48:22.542 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.527+0000 7fca5d97b700 1 --2- 172.21.15.38:0/3318103431 >> v2:172.21.15.38:3300/0 conn(0x7fca5809d010 0x7fca58153e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fca54000f00 tx=0x7fca54001b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.542 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.527+0000 7fca5d97b700 1 --2- 172.21.15.38:0/3318103431 >> v2:172.21.15.38:3300/0 conn(0x7fca5809d010 0x7fca58153e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fca54000f00 tx=0x7fca54001b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.542 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.527+0000 7fca5d97b700 1 --2- 172.21.15.38:0/3318103431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca5809d010 0x7fca58153e80 secure :-1 s=READY pgs=146 cs=0 l=1 rx=0x7fca54000f00 tx=0x7fca54001b20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:22.542 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.527+0000 7fca5d97b700 1 --2- 172.21.15.38:0/3318103431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca5809d010 0x7fca58153e80 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7fca54000f00 tx=0x7fca54001b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.543 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.527+0000 7fca5d97b700 1 --2- 172.21.15.38:0/3318103431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca5809d010 0x7fca58153e80 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7fca54000f00 tx=0x7fca54001b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.543 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.527+0000 7fca477fe700 1 -- 172.21.15.38:0/3318103431 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca5400cea0 con 0x7fca5809d010 2020-06-12T17:48:22.543 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.527+0000 7fca5d97b700 1 --2- 172.21.15.38:0/3318103431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca5809d010 0x7fca58153e80 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7fca54000f00 tx=0x7fca54001b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.543 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.527+0000 7fca477fe700 1 -- 172.21.15.38:0/3318103431 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca540103b0 con 0x7fca5809d010 2020-06-12T17:48:22.543 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.527+0000 7fca477fe700 1 -- 172.21.15.38:0/3318103431 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca54010790 con 0x7fca5809d010 2020-06-12T17:48:22.544 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.527+0000 7fca603e0700 1 -- 172.21.15.38:0/3318103431 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca58144f50 con 0x7fca5809d010 2020-06-12T17:48:22.544 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.527+0000 7fca603e0700 1 -- 172.21.15.38:0/3318103431 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca580af9e0 con 0x7fca5809d010 2020-06-12T17:48:22.544 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.528+0000 7fca5d97b700 1 --2- 172.21.15.38:0/3318103431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca5809d010 0x7fca58153e80 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7fca54000f00 tx=0x7fca54001b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.544 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.528+0000 7fca477fe700 1 -- 172.21.15.38:0/3318103431 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fca54006860 con 0x7fca5809d010 2020-06-12T17:48:22.545 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.528+0000 7fca5d97b700 1 --2- 172.21.15.38:0/3318103431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca5809d010 0x7fca58153e80 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7fca54000f00 tx=0x7fca54001b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.545 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.528+0000 7fca603e0700 1 -- 172.21.15.38:0/3318103431 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca58056c30 con 0x7fca5809d010 2020-06-12T17:48:22.545 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.528+0000 7fca477fe700 1 --2- 172.21.15.38:0/3318103431 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fca3804d430 0x7fca3804f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:22.545 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.528+0000 7fca477fe700 1 -- 172.21.15.38:0/3318103431 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fca54061210 con 0x7fca5809d010 2020-06-12T17:48:22.545 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.528+0000 7fca5e17c700 1 --2- 172.21.15.38:0/3318103431 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fca3804d430 0x7fca3804f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:22.546 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.529+0000 7fca5e17c700 1 --2- 172.21.15.38:0/3318103431 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fca3804d430 0x7fca3804f8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fca48003070 tx=0x7fca48002500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.546 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.529+0000 7fca5e17c700 1 --2- 172.21.15.38:0/3318103431 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fca3804d430 0x7fca3804f8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fca48003070 tx=0x7fca48002500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.546 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.529+0000 7fca5e17c700 1 --2- 172.21.15.38:0/3318103431 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fca3804d430 0x7fca3804f8f0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7fca48003070 tx=0x7fca48002500).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:22.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.532+0000 7fca5d97b700 1 --2- 172.21.15.38:0/3318103431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca5809d010 0x7fca58153e80 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7fca54000f00 tx=0x7fca54001b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.532+0000 7fca477fe700 1 -- 172.21.15.38:0/3318103431 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fca5403c990 con 0x7fca5809d010 2020-06-12T17:48:22.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.686+0000 7fca603e0700 1 -- 172.21.15.38:0/3318103431 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fca580b3cf0 con 0x7fca5809d010 2020-06-12T17:48:22.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.686+0000 7fca5d97b700 1 --2- 172.21.15.38:0/3318103431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca5809d010 0x7fca58153e80 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7fca54000f00 tx=0x7fca54001b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.686+0000 7fca477fe700 1 -- 172.21.15.38:0/3318103431 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fca5403ffb0 con 0x7fca5809d010 2020-06-12T17:48:22.691 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2020-06-12T17:48:22.692 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.687+0000 7fca603e0700 1 -- 172.21.15.38:0/3318103431 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fca3804d430 msgr2=0x7fca3804f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:22.692 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.687+0000 7fca603e0700 1 --2- 172.21.15.38:0/3318103431 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fca3804d430 0x7fca3804f8f0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7fca48003070 tx=0x7fca48002500).stop 2020-06-12T17:48:22.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.687+0000 7fca603e0700 1 -- 172.21.15.38:0/3318103431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca5809d010 msgr2=0x7fca58153e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:22.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.687+0000 7fca603e0700 1 --2- 172.21.15.38:0/3318103431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca5809d010 0x7fca58153e80 secure :-1 s=READY pgs=146 cs=0 l=1 rx=0x7fca54000f00 tx=0x7fca54001b20).stop 2020-06-12T17:48:22.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.688+0000 7fca603e0700 1 -- 172.21.15.38:0/3318103431 shutdown_connections 2020-06-12T17:48:22.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.688+0000 7fca603e0700 1 --2- 172.21.15.38:0/3318103431 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fca3804d430 0x7fca3804f8f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:22.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.688+0000 7fca603e0700 1 --2- 172.21.15.38:0/3318103431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca58147d40 0x7fca581536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:22.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.688+0000 7fca603e0700 1 --2- 172.21.15.38:0/3318103431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca5809d010 0x7fca58153e80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:22.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.688+0000 7fca603e0700 1 -- 172.21.15.38:0/3318103431 >> 172.21.15.38:0/3318103431 conn(0x7fca580b9490 msgr2=0x7fca580b9870 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:22.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.688+0000 7fca603e0700 1 -- 172.21.15.38:0/3318103431 shutdown_connections 2020-06-12T17:48:22.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.688+0000 7fca603e0700 1 -- 172.21.15.38:0/3318103431 wait complete. 2020-06-12T17:48:22.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2020-06-12T17:48:22.702 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2020-06-12T17:48:22.819 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.813+0000 7fc5b4ea4700 1 Processor -- start 2020-06-12T17:48:22.819 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.813+0000 7fc5b4ea4700 1 -- start start 2020-06-12T17:48:22.819 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.814+0000 7fc5b4ea4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc5b009db70 0x7fc5b009b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:22.820 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.814+0000 7fc5b4ea4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc5b0066a80 0x7fc5b00aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:22.820 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.814+0000 7fc5b4ea4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b00ad7b0 con 0x7fc5b009df50 2020-06-12T17:48:22.820 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.814+0000 7fc5b4ea4700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b0144ee0 con 0x7fc5b009db70 2020-06-12T17:48:22.820 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.814+0000 7fc5b4ea4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b01449a0 con 0x7fc5b0066a80 2020-06-12T17:48:22.820 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.814+0000 7fc5ae59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc5b009db70 0x7fc5b009b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:22.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.814+0000 7fc5ae59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc5b009db70 0x7fc5b009b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35816/0 (socket says 172.21.15.38:35816) 2020-06-12T17:48:22.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.814+0000 7fc5ae59c700 1 -- 172.21.15.38:0/4200263572 learned_addr learned my addr 172.21.15.38:0/4200263572 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:22.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.814+0000 7fc5aed9d700 1 --2- 172.21.15.38:0/4200263572 >> v2:172.21.15.150:3300/0 conn(0x7fc5b0066a80 0x7fc5b00aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:22.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.814+0000 7fc5ae59c700 1 -- 172.21.15.38:0/4200263572 >> v2:172.21.15.150:3300/0 conn(0x7fc5b0066a80 msgr2=0x7fc5b00aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:22.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.814+0000 7fc5ae59c700 1 --2- 172.21.15.38:0/4200263572 >> v2:172.21.15.150:3300/0 conn(0x7fc5b0066a80 0x7fc5b00aebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:22.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.814+0000 7fc5ae59c700 1 -- 172.21.15.38:0/4200263572 >> v1:172.21.15.150:6789/0 conn(0x7fc5b009df50 legacy=0x7fc5b0141040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:22.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.814+0000 7fc5ae59c700 1 -- 172.21.15.38:0/4200263572 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b0144c40 con 0x7fc5b009db70 2020-06-12T17:48:22.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.814+0000 7fc5aed9d700 1 --2- 172.21.15.38:0/4200263572 >> v2:172.21.15.150:3300/0 conn(0x7fc5b0066a80 0x7fc5b00aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:48:22.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.814+0000 7fc5ae59c700 1 --2- 172.21.15.38:0/4200263572 >> v2:172.21.15.38:3300/0 conn(0x7fc5b009db70 0x7fc5b009b120 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc5b009e590 tx=0x7fc5a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.814+0000 7fc5ae59c700 1 --2- 172.21.15.38:0/4200263572 >> v2:172.21.15.38:3300/0 conn(0x7fc5b009db70 0x7fc5b009b120 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc5b009e590 tx=0x7fc5a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.814+0000 7fc5ae59c700 1 --2- 172.21.15.38:0/4200263572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b009db70 0x7fc5b009b120 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7fc5b009e590 tx=0x7fc5a0007e60).ready entity=mon.0 client_cookie=eb62f26f2caca4ab server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:22.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.815+0000 7fc5ae59c700 1 --2- 172.21.15.38:0/4200263572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b009db70 0x7fc5b009b120 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7fc5b009e590 tx=0x7fc5a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.815+0000 7fc5add9b700 1 -- 172.21.15.38:0/4200263572 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5a0008e10 con 0x7fc5b009db70 2020-06-12T17:48:22.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.815+0000 7fc5ae59c700 1 --2- 172.21.15.38:0/4200263572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b009db70 0x7fc5b009b120 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7fc5b009e590 tx=0x7fc5a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.815+0000 7fc5ae59c700 1 --2- 172.21.15.38:0/4200263572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b009db70 0x7fc5b009b120 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7fc5b009e590 tx=0x7fc5a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.815+0000 7fc5add9b700 1 -- 172.21.15.38:0/4200263572 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a0010740 con 0x7fc5b009db70 2020-06-12T17:48:22.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.815+0000 7fc5add9b700 1 -- 172.21.15.38:0/4200263572 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5a0010b20 con 0x7fc5b009db70 2020-06-12T17:48:22.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.815+0000 7fc5b4ea4700 1 -- 172.21.15.38:0/4200263572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b009db70 msgr2=0x7fc5b009b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:22.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.815+0000 7fc5b4ea4700 1 --2- 172.21.15.38:0/4200263572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b009db70 0x7fc5b009b120 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7fc5b009e590 tx=0x7fc5a0007e60).stop 2020-06-12T17:48:22.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.815+0000 7fc5b4ea4700 1 -- 172.21.15.38:0/4200263572 shutdown_connections 2020-06-12T17:48:22.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.815+0000 7fc5b4ea4700 1 --2- 172.21.15.38:0/4200263572 >> v2:172.21.15.150:3300/0 conn(0x7fc5b0066a80 0x7fc5b00aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:22.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.815+0000 7fc5b4ea4700 1 --2- 172.21.15.38:0/4200263572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b009db70 0x7fc5b009b120 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:22.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.815+0000 7fc5b4ea4700 1 -- 172.21.15.38:0/4200263572 >> 172.21.15.38:0/4200263572 conn(0x7fc5b00b8410 msgr2=0x7fc5b00b8820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:22.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.815+0000 7fc5b4ea4700 1 -- 172.21.15.38:0/4200263572 shutdown_connections 2020-06-12T17:48:22.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.815+0000 7fc5b4ea4700 1 -- 172.21.15.38:0/4200263572 wait complete. 2020-06-12T17:48:22.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.816+0000 7fc5b4ea4700 1 Processor -- start 2020-06-12T17:48:22.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.816+0000 7fc5b4ea4700 1 -- start start 2020-06-12T17:48:22.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.817+0000 7fc5b4ea4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc5b0066a80 0x7fc5b009a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:22.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.817+0000 7fc5b4ea4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc5b009df50 0x7fc5b0063e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:22.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.817+0000 7fc5b4ea4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b009ac90 con 0x7fc5b009db70 2020-06-12T17:48:22.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.817+0000 7fc5b4ea4700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b01521d0 con 0x7fc5b0066a80 2020-06-12T17:48:22.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.817+0000 7fc5b4ea4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b00636f0 con 0x7fc5b009df50 2020-06-12T17:48:22.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.817+0000 7fc5ae59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc5b0066a80 0x7fc5b009a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:22.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.817+0000 7fc5ae59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc5b0066a80 0x7fc5b009a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35822/0 (socket says 172.21.15.38:35822) 2020-06-12T17:48:22.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.817+0000 7fc5ae59c700 1 -- 172.21.15.38:0/1197989389 learned_addr learned my addr 172.21.15.38:0/1197989389 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:22.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.817+0000 7fc5aed9d700 1 --2- 172.21.15.38:0/1197989389 >> v2:172.21.15.150:3300/0 conn(0x7fc5b009df50 0x7fc5b0063e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:22.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.817+0000 7fc5ae59c700 1 -- 172.21.15.38:0/1197989389 >> v2:172.21.15.150:3300/0 conn(0x7fc5b009df50 msgr2=0x7fc5b0063e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:22.836 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.817+0000 7fc5ae59c700 1 --2- 172.21.15.38:0/1197989389 >> v2:172.21.15.150:3300/0 conn(0x7fc5b009df50 0x7fc5b0063e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:22.836 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.817+0000 7fc5ae59c700 1 -- 172.21.15.38:0/1197989389 >> v1:172.21.15.150:6789/0 conn(0x7fc5b009db70 legacy=0x7fc5b0143060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:22.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.817+0000 7fc5ae59c700 1 -- 172.21.15.38:0/1197989389 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b0063990 con 0x7fc5b0066a80 2020-06-12T17:48:22.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.817+0000 7fc5aed9d700 1 --2- 172.21.15.38:0/1197989389 >> v2:172.21.15.150:3300/0 conn(0x7fc5b009df50 0x7fc5b0063e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:22.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.817+0000 7fc5ae59c700 1 --2- 172.21.15.38:0/1197989389 >> v2:172.21.15.38:3300/0 conn(0x7fc5b0066a80 0x7fc5b009a510 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc5b009e590 tx=0x7fc5a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.817+0000 7fc5ae59c700 1 --2- 172.21.15.38:0/1197989389 >> v2:172.21.15.38:3300/0 conn(0x7fc5b0066a80 0x7fc5b009a510 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc5b009e590 tx=0x7fc5a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.817+0000 7fc5ae59c700 1 --2- 172.21.15.38:0/1197989389 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b0066a80 0x7fc5b009a510 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7fc5b009e590 tx=0x7fc5a0007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:22.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.817+0000 7fc5ae59c700 1 --2- 172.21.15.38:0/1197989389 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b0066a80 0x7fc5b009a510 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7fc5b009e590 tx=0x7fc5a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.817+0000 7fc5a77fe700 1 -- 172.21.15.38:0/1197989389 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5a000f900 con 0x7fc5b0066a80 2020-06-12T17:48:22.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.817+0000 7fc5ae59c700 1 --2- 172.21.15.38:0/1197989389 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b0066a80 0x7fc5b009a510 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7fc5b009e590 tx=0x7fc5a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.817+0000 7fc5ae59c700 1 --2- 172.21.15.38:0/1197989389 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b0066a80 0x7fc5b009a510 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7fc5b009e590 tx=0x7fc5a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.817+0000 7fc5a77fe700 1 -- 172.21.15.38:0/1197989389 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a0007160 con 0x7fc5b0066a80 2020-06-12T17:48:22.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.817+0000 7fc5b4ea4700 1 -- 172.21.15.38:0/1197989389 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b0151cf0 con 0x7fc5b0066a80 2020-06-12T17:48:22.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.817+0000 7fc5a77fe700 1 -- 172.21.15.38:0/1197989389 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5a0007500 con 0x7fc5b0066a80 2020-06-12T17:48:22.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.818+0000 7fc5b4ea4700 1 -- 172.21.15.38:0/1197989389 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b0064450 con 0x7fc5b0066a80 2020-06-12T17:48:22.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.818+0000 7fc5ae59c700 1 --2- 172.21.15.38:0/1197989389 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b0066a80 0x7fc5b009a510 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7fc5b009e590 tx=0x7fc5a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.819+0000 7fc5b4ea4700 1 -- 172.21.15.38:0/1197989389 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b0152000 con 0x7fc5b0066a80 2020-06-12T17:48:22.840 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.819+0000 7fc5a77fe700 1 -- 172.21.15.38:0/1197989389 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fc5a00056c0 con 0x7fc5b0066a80 2020-06-12T17:48:22.840 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.819+0000 7fc5ae59c700 1 --2- 172.21.15.38:0/1197989389 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b0066a80 0x7fc5b009a510 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7fc5b009e590 tx=0x7fc5a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.840 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.819+0000 7fc5a77fe700 1 --2- 172.21.15.38:0/1197989389 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc59404d5c0 0x7fc59404fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:22.840 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.819+0000 7fc5a77fe700 1 -- 172.21.15.38:0/1197989389 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc5a0061290 con 0x7fc5b0066a80 2020-06-12T17:48:22.840 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.819+0000 7fc5a7fff700 1 --2- 172.21.15.38:0/1197989389 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc59404d5c0 0x7fc59404fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:22.841 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.820+0000 7fc5a7fff700 1 --2- 172.21.15.38:0/1197989389 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc59404d5c0 0x7fc59404fa80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc5b00b7840 tx=0x7fc598001340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.820+0000 7fc5a7fff700 1 --2- 172.21.15.38:0/1197989389 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc59404d5c0 0x7fc59404fa80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc5b00b7840 tx=0x7fc598001340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.820+0000 7fc5a7fff700 1 --2- 172.21.15.38:0/1197989389 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc59404d5c0 0x7fc59404fa80 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7fc5b00b7840 tx=0x7fc598001340).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:22.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.823+0000 7fc5ae59c700 1 --2- 172.21.15.38:0/1197989389 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b0066a80 0x7fc5b009a510 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7fc5b009e590 tx=0x7fc5a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.823+0000 7fc5a77fe700 1 -- 172.21.15.38:0/1197989389 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fc5a003c9f0 con 0x7fc5b0066a80 2020-06-12T17:48:22.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.973+0000 7fc5b4ea4700 1 -- 172.21.15.38:0/1197989389 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc5b0056c30 con 0x7fc5b0066a80 2020-06-12T17:48:22.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.973+0000 7fc5ae59c700 1 --2- 172.21.15.38:0/1197989389 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b0066a80 0x7fc5b009a510 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7fc5b009e590 tx=0x7fc5a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:22.978 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.973+0000 7fc5a77fe700 1 -- 172.21.15.38:0/1197989389 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc5a0007960 con 0x7fc5b0066a80 2020-06-12T17:48:22.978 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2020-06-12T17:48:22.979 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.975+0000 7fc5b4ea4700 1 -- 172.21.15.38:0/1197989389 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc59404d5c0 msgr2=0x7fc59404fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:22.979 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.975+0000 7fc5b4ea4700 1 --2- 172.21.15.38:0/1197989389 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc59404d5c0 0x7fc59404fa80 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7fc5b00b7840 tx=0x7fc598001340).stop 2020-06-12T17:48:22.979 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.975+0000 7fc5b4ea4700 1 -- 172.21.15.38:0/1197989389 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b0066a80 msgr2=0x7fc5b009a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:22.980 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.975+0000 7fc5b4ea4700 1 --2- 172.21.15.38:0/1197989389 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b0066a80 0x7fc5b009a510 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7fc5b009e590 tx=0x7fc5a0007e60).stop 2020-06-12T17:48:22.980 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.975+0000 7fc5b4ea4700 1 -- 172.21.15.38:0/1197989389 shutdown_connections 2020-06-12T17:48:22.980 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.975+0000 7fc5b4ea4700 1 --2- 172.21.15.38:0/1197989389 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc59404d5c0 0x7fc59404fa80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:22.980 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.975+0000 7fc5b4ea4700 1 --2- 172.21.15.38:0/1197989389 >> v2:172.21.15.150:3300/0 conn(0x7fc5b009df50 0x7fc5b0063e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:22.981 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.975+0000 7fc5b4ea4700 1 --2- 172.21.15.38:0/1197989389 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5b0066a80 0x7fc5b009a510 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:22.981 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.975+0000 7fc5b4ea4700 1 -- 172.21.15.38:0/1197989389 >> 172.21.15.38:0/1197989389 conn(0x7fc5b00b8410 msgr2=0x7fc5b00b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:22.981 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.975+0000 7fc5b4ea4700 1 -- 172.21.15.38:0/1197989389 shutdown_connections 2020-06-12T17:48:22.981 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:22.975+0000 7fc5b4ea4700 1 -- 172.21.15.38:0/1197989389 wait complete. 2020-06-12T17:48:22.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2020-06-12T17:48:22.996 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.3 2020-06-12T17:48:23.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.108+0000 7f6a2b0a5700 1 Processor -- start 2020-06-12T17:48:23.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.108+0000 7f6a2b0a5700 1 -- start start 2020-06-12T17:48:23.119 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.109+0000 7f6a2b0a5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6a2409db70 0x7f6a2409b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:23.119 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.109+0000 7f6a2b0a5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a2409df50 0x7f6a24066a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:23.119 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.109+0000 7f6a2b0a5700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6a240aebc0 0x7f6a24141040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:23.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.109+0000 7f6a2b0a5700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a24144ee0 con 0x7f6a240aebc0 2020-06-12T17:48:23.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.109+0000 7f6a2b0a5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a240ad7b0 con 0x7f6a2409db70 2020-06-12T17:48:23.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.109+0000 7f6a2b0a5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a241449a0 con 0x7f6a2409df50 2020-06-12T17:48:23.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.109+0000 7f6a29642700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6a240aebc0 0x7f6a24141040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:23.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.109+0000 7f6a29642700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6a240aebc0 0x7f6a24141040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35834/0 (socket says 172.21.15.38:35834) 2020-06-12T17:48:23.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.109+0000 7f6a29642700 1 -- 172.21.15.38:0/1261268209 learned_addr learned my addr 172.21.15.38:0/1261268209 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:23.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.109+0000 7f6a28e41700 1 --2- 172.21.15.38:0/1261268209 >> v2:172.21.15.150:3300/0 conn(0x7f6a2409db70 0x7f6a2409b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:23.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.109+0000 7f6a23fff700 1 --2- 172.21.15.38:0/1261268209 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a2409df50 0x7f6a24066a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:23.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.109+0000 7f6a29642700 1 -- 172.21.15.38:0/1261268209 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a2409df50 msgr2=0x7f6a24066a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:23.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.109+0000 7f6a29642700 1 --2- 172.21.15.38:0/1261268209 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a2409df50 0x7f6a24066a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:23.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.109+0000 7f6a29642700 1 -- 172.21.15.38:0/1261268209 >> v2:172.21.15.150:3300/0 conn(0x7f6a2409db70 msgr2=0x7f6a2409b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:23.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.109+0000 7f6a29642700 1 --2- 172.21.15.38:0/1261268209 >> v2:172.21.15.150:3300/0 conn(0x7f6a2409db70 0x7f6a2409b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:23.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.109+0000 7f6a29642700 1 -- 172.21.15.38:0/1261268209 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a24144c40 con 0x7f6a240aebc0 2020-06-12T17:48:23.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.109+0000 7f6a29642700 1 --2- 172.21.15.38:0/1261268209 >> v2:172.21.15.38:3300/0 conn(0x7f6a240aebc0 0x7f6a24141040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6a14002f30 tx=0x7f6a14007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.109+0000 7f6a29642700 1 --2- 172.21.15.38:0/1261268209 >> v2:172.21.15.38:3300/0 conn(0x7f6a240aebc0 0x7f6a24141040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6a14002f30 tx=0x7f6a14007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.109+0000 7f6a29642700 1 --2- 172.21.15.38:0/1261268209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a240aebc0 0x7f6a24141040 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f6a14002f30 tx=0x7f6a14007e60).ready entity=mon.0 client_cookie=12add1aad889713e server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:23.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.109+0000 7f6a29642700 1 --2- 172.21.15.38:0/1261268209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a240aebc0 0x7f6a24141040 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f6a14002f30 tx=0x7f6a14007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.110+0000 7f6a237fe700 1 -- 172.21.15.38:0/1261268209 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a14011630 con 0x7f6a240aebc0 2020-06-12T17:48:23.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.110+0000 7f6a29642700 1 --2- 172.21.15.38:0/1261268209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a240aebc0 0x7f6a24141040 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f6a14002f30 tx=0x7f6a14007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.110+0000 7f6a29642700 1 --2- 172.21.15.38:0/1261268209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a240aebc0 0x7f6a24141040 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f6a14002f30 tx=0x7f6a14007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.110+0000 7f6a237fe700 1 -- 172.21.15.38:0/1261268209 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a14011790 con 0x7f6a240aebc0 2020-06-12T17:48:23.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.110+0000 7f6a237fe700 1 -- 172.21.15.38:0/1261268209 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a14011b70 con 0x7f6a240aebc0 2020-06-12T17:48:23.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.110+0000 7f6a2b0a5700 1 -- 172.21.15.38:0/1261268209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a240aebc0 msgr2=0x7f6a24141040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:23.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.110+0000 7f6a2b0a5700 1 --2- 172.21.15.38:0/1261268209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a240aebc0 0x7f6a24141040 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f6a14002f30 tx=0x7f6a14007e60).stop 2020-06-12T17:48:23.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.110+0000 7f6a2b0a5700 1 -- 172.21.15.38:0/1261268209 shutdown_connections 2020-06-12T17:48:23.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.110+0000 7f6a2b0a5700 1 --2- 172.21.15.38:0/1261268209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a240aebc0 0x7f6a24141040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:23.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.110+0000 7f6a2b0a5700 1 --2- 172.21.15.38:0/1261268209 >> v2:172.21.15.150:3300/0 conn(0x7f6a2409db70 0x7f6a2409b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:23.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.110+0000 7f6a2b0a5700 1 --2- 172.21.15.38:0/1261268209 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a2409df50 0x7f6a24066a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:23.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.110+0000 7f6a2b0a5700 1 -- 172.21.15.38:0/1261268209 >> 172.21.15.38:0/1261268209 conn(0x7f6a240b8410 msgr2=0x7f6a240b8820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:23.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.110+0000 7f6a2b0a5700 1 -- 172.21.15.38:0/1261268209 shutdown_connections 2020-06-12T17:48:23.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.110+0000 7f6a2b0a5700 1 -- 172.21.15.38:0/1261268209 wait complete. 2020-06-12T17:48:23.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.111+0000 7f6a2b0a5700 1 Processor -- start 2020-06-12T17:48:23.129 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.111+0000 7f6a2b0a5700 1 -- start start 2020-06-12T17:48:23.129 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.112+0000 7f6a2b0a5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a2409db70 0x7f6a24065f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:23.129 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.112+0000 7f6a2b0a5700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6a2409df50 0x7f6a240663b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:23.130 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.112+0000 7f6a2b0a5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6a240aebc0 0x7f6a24154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:23.130 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.112+0000 7f6a2b0a5700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a24066810 con 0x7f6a2409df50 2020-06-12T17:48:23.130 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.112+0000 7f6a2b0a5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a24065850 con 0x7f6a240aebc0 2020-06-12T17:48:23.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.112+0000 7f6a2b0a5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a24063b80 con 0x7f6a2409db70 2020-06-12T17:48:23.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.112+0000 7f6a23fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6a2409df50 0x7f6a240663b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:23.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.112+0000 7f6a23fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6a2409df50 0x7f6a240663b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35838/0 (socket says 172.21.15.38:35838) 2020-06-12T17:48:23.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.112+0000 7f6a23fff700 1 -- 172.21.15.38:0/1841087121 learned_addr learned my addr 172.21.15.38:0/1841087121 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:23.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.112+0000 7f6a28e41700 1 --2- 172.21.15.38:0/1841087121 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a2409db70 0x7f6a24065f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:23.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.112+0000 7f6a29642700 1 --2- 172.21.15.38:0/1841087121 >> v2:172.21.15.150:3300/0 conn(0x7f6a240aebc0 0x7f6a24154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:23.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.112+0000 7f6a23fff700 1 -- 172.21.15.38:0/1841087121 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a2409db70 msgr2=0x7f6a24065f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:23.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.112+0000 7f6a23fff700 1 --2- 172.21.15.38:0/1841087121 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a2409db70 0x7f6a24065f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:23.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.112+0000 7f6a23fff700 1 -- 172.21.15.38:0/1841087121 >> v2:172.21.15.150:3300/0 conn(0x7f6a240aebc0 msgr2=0x7f6a24154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:23.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.112+0000 7f6a23fff700 1 --2- 172.21.15.38:0/1841087121 >> v2:172.21.15.150:3300/0 conn(0x7f6a240aebc0 0x7f6a24154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:23.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.112+0000 7f6a23fff700 1 -- 172.21.15.38:0/1841087121 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a24065ab0 con 0x7f6a2409df50 2020-06-12T17:48:23.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.112+0000 7f6a23fff700 1 --2- 172.21.15.38:0/1841087121 >> v2:172.21.15.38:3300/0 conn(0x7f6a2409df50 0x7f6a240663b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6a18002f30 tx=0x7f6a1800e1c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.112+0000 7f6a23fff700 1 --2- 172.21.15.38:0/1841087121 >> v2:172.21.15.38:3300/0 conn(0x7f6a2409df50 0x7f6a240663b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6a18002f30 tx=0x7f6a1800e1c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.112+0000 7f6a23fff700 1 --2- 172.21.15.38:0/1841087121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a2409df50 0x7f6a240663b0 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f6a18002f30 tx=0x7f6a1800e1c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:23.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.113+0000 7f6a23fff700 1 --2- 172.21.15.38:0/1841087121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a2409df50 0x7f6a240663b0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f6a18002f30 tx=0x7f6a1800e1c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.113+0000 7f6a23fff700 1 --2- 172.21.15.38:0/1841087121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a2409df50 0x7f6a240663b0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f6a18002f30 tx=0x7f6a1800e1c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.113+0000 7f6a21ffb700 1 -- 172.21.15.38:0/1841087121 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a18012940 con 0x7f6a2409df50 2020-06-12T17:48:23.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.113+0000 7f6a23fff700 1 --2- 172.21.15.38:0/1841087121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a2409df50 0x7f6a240663b0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f6a18002f30 tx=0x7f6a1800e1c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.113+0000 7f6a21ffb700 1 -- 172.21.15.38:0/1841087121 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a18012aa0 con 0x7f6a2409df50 2020-06-12T17:48:23.135 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.113+0000 7f6a2b0a5700 1 -- 172.21.15.38:0/1841087121 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a24155100 con 0x7f6a2409df50 2020-06-12T17:48:23.135 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.113+0000 7f6a21ffb700 1 -- 172.21.15.38:0/1841087121 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a18012e80 con 0x7f6a2409df50 2020-06-12T17:48:23.135 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.113+0000 7f6a2b0a5700 1 -- 172.21.15.38:0/1841087121 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a241513a0 con 0x7f6a2409df50 2020-06-12T17:48:23.135 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.113+0000 7f6a23fff700 1 --2- 172.21.15.38:0/1841087121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a2409df50 0x7f6a240663b0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f6a18002f30 tx=0x7f6a1800e1c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.135 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.114+0000 7f6a2b0a5700 1 -- 172.21.15.38:0/1841087121 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a24056c30 con 0x7f6a2409df50 2020-06-12T17:48:23.135 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.114+0000 7f6a21ffb700 1 -- 172.21.15.38:0/1841087121 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f6a18007170 con 0x7f6a2409df50 2020-06-12T17:48:23.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.114+0000 7f6a23fff700 1 --2- 172.21.15.38:0/1841087121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a2409df50 0x7f6a240663b0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f6a18002f30 tx=0x7f6a1800e1c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.114+0000 7f6a21ffb700 1 --2- 172.21.15.38:0/1841087121 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6a0404d6a0 0x7f6a0404fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:23.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.114+0000 7f6a21ffb700 1 -- 172.21.15.38:0/1841087121 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f6a18060fb0 con 0x7f6a2409df50 2020-06-12T17:48:23.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.114+0000 7f6a28e41700 1 --2- 172.21.15.38:0/1841087121 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6a0404d6a0 0x7f6a0404fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:23.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.114+0000 7f6a28e41700 1 --2- 172.21.15.38:0/1841087121 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6a0404d6a0 0x7f6a0404fb60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6a1c0032b0 tx=0x7f6a1c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.115+0000 7f6a28e41700 1 --2- 172.21.15.38:0/1841087121 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6a0404d6a0 0x7f6a0404fb60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6a1c0032b0 tx=0x7f6a1c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.115+0000 7f6a28e41700 1 --2- 172.21.15.38:0/1841087121 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6a0404d6a0 0x7f6a0404fb60 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f6a1c0032b0 tx=0x7f6a1c0081e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:23.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.117+0000 7f6a23fff700 1 --2- 172.21.15.38:0/1841087121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a2409df50 0x7f6a240663b0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f6a18002f30 tx=0x7f6a1800e1c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.118+0000 7f6a21ffb700 1 -- 172.21.15.38:0/1841087121 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f6a1803c710 con 0x7f6a2409df50 2020-06-12T17:48:23.275 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.271+0000 7f6a2b0a5700 1 -- 172.21.15.38:0/1841087121 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6a240af1b0 con 0x7f6a2409df50 2020-06-12T17:48:23.275 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.271+0000 7f6a23fff700 1 --2- 172.21.15.38:0/1841087121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a2409df50 0x7f6a240663b0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f6a18002f30 tx=0x7f6a1800e1c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.275 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.271+0000 7f6a21ffb700 1 -- 172.21.15.38:0/1841087121 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6a1803fd30 con 0x7f6a2409df50 2020-06-12T17:48:23.275 INFO:teuthology.orchestra.run.smithi038.stdout:55834574855 2020-06-12T17:48:23.277 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.272+0000 7f6a2b0a5700 1 -- 172.21.15.38:0/1841087121 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6a0404d6a0 msgr2=0x7f6a0404fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:23.277 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.272+0000 7f6a2b0a5700 1 --2- 172.21.15.38:0/1841087121 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6a0404d6a0 0x7f6a0404fb60 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f6a1c0032b0 tx=0x7f6a1c0081e0).stop 2020-06-12T17:48:23.277 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.273+0000 7f6a2b0a5700 1 -- 172.21.15.38:0/1841087121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a2409df50 msgr2=0x7f6a240663b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:23.277 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.273+0000 7f6a2b0a5700 1 --2- 172.21.15.38:0/1841087121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a2409df50 0x7f6a240663b0 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f6a18002f30 tx=0x7f6a1800e1c0).stop 2020-06-12T17:48:23.278 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.273+0000 7f6a2b0a5700 1 -- 172.21.15.38:0/1841087121 shutdown_connections 2020-06-12T17:48:23.278 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.273+0000 7f6a2b0a5700 1 --2- 172.21.15.38:0/1841087121 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6a0404d6a0 0x7f6a0404fb60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:23.278 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.273+0000 7f6a2b0a5700 1 --2- 172.21.15.38:0/1841087121 >> v2:172.21.15.150:3300/0 conn(0x7f6a240aebc0 0x7f6a24154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:23.278 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.273+0000 7f6a2b0a5700 1 --2- 172.21.15.38:0/1841087121 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a2409db70 0x7f6a24065f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:23.279 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.273+0000 7f6a2b0a5700 1 --2- 172.21.15.38:0/1841087121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a2409df50 0x7f6a240663b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:23.279 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.273+0000 7f6a2b0a5700 1 -- 172.21.15.38:0/1841087121 >> 172.21.15.38:0/1841087121 conn(0x7f6a240b8410 msgr2=0x7f6a2405b190 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:23.279 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.273+0000 7f6a2b0a5700 1 -- 172.21.15.38:0/1841087121 shutdown_connections 2020-06-12T17:48:23.279 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.273+0000 7f6a2b0a5700 1 -- 172.21.15.38:0/1841087121 wait complete. 2020-06-12T17:48:23.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2020-06-12T17:48:23.287 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.4 2020-06-12T17:48:23.403 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.399+0000 7f13f2db7700 1 Processor -- start 2020-06-12T17:48:23.403 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.400+0000 7f13f2db7700 1 -- start start 2020-06-12T17:48:23.406 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.400+0000 7f13f2db7700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f13ec0b6420 0x7f13ec09ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:23.407 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.400+0000 7f13f2db7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f13ec05b3e0 0x7f13ec09d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:23.407 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.400+0000 7f13f2db7700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13ec09f570 con 0x7f13ec05b890 2020-06-12T17:48:23.407 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.400+0000 7f13f2db7700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13ec05aca0 con 0x7f13ec0b6420 2020-06-12T17:48:23.407 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.400+0000 7f13f2db7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13ec05af40 con 0x7f13ec05b3e0 2020-06-12T17:48:23.407 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.400+0000 7f13f0b53700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f13ec0b6420 0x7f13ec09ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:23.408 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.400+0000 7f13f1354700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f13ec05b890 0x7f13ec09dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37660/0 (socket says 172.21.15.38:37660) 2020-06-12T17:48:23.408 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.400+0000 7f13f1354700 1 -- 172.21.15.38:0/757507792 learned_addr learned my addr 172.21.15.38:0/757507792 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:23.408 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.401+0000 7f13ebfff700 1 --2- 172.21.15.38:0/757507792 >> v2:172.21.15.150:3300/0 conn(0x7f13ec05b3e0 0x7f13ec09d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:23.408 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.401+0000 7f13f0b53700 1 -- 172.21.15.38:0/757507792 >> v2:172.21.15.150:3300/0 conn(0x7f13ec05b3e0 msgr2=0x7f13ec09d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:23.408 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.401+0000 7f13f0b53700 1 --2- 172.21.15.38:0/757507792 >> v2:172.21.15.150:3300/0 conn(0x7f13ec05b3e0 0x7f13ec09d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:23.409 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.401+0000 7f13f0b53700 1 -- 172.21.15.38:0/757507792 >> v1:172.21.15.38:6789/0 conn(0x7f13ec05b890 legacy=0x7f13ec09dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:23.409 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.401+0000 7f13eb7fe700 1 -- 172.21.15.38:0/757507792 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537383048 0 0) 0x7f13ec09f570 con 0x7f13ec05b890 2020-06-12T17:48:23.409 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.401+0000 7f13f0b53700 1 -- 172.21.15.38:0/757507792 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ec0b6800 con 0x7f13ec0b6420 2020-06-12T17:48:23.409 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.401+0000 7f13f0b53700 1 --2- 172.21.15.38:0/757507792 >> v2:172.21.15.38:3300/0 conn(0x7f13ec0b6420 0x7f13ec09ecd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f13dc002f30 tx=0x7f13dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.409 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.401+0000 7f13f0b53700 1 --2- 172.21.15.38:0/757507792 >> v2:172.21.15.38:3300/0 conn(0x7f13ec0b6420 0x7f13ec09ecd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f13dc002f30 tx=0x7f13dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.410 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.401+0000 7f13f0b53700 1 --2- 172.21.15.38:0/757507792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ec0b6420 0x7f13ec09ecd0 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7f13dc002f30 tx=0x7f13dc007e60).ready entity=mon.0 client_cookie=c80cc340db9dcfd5 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:23.410 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.401+0000 7f13f0b53700 1 --2- 172.21.15.38:0/757507792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ec0b6420 0x7f13ec09ecd0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f13dc002f30 tx=0x7f13dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.410 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.401+0000 7f13eb7fe700 1 -- 172.21.15.38:0/757507792 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13dc011380 con 0x7f13ec0b6420 2020-06-12T17:48:23.410 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.401+0000 7f13f0b53700 1 --2- 172.21.15.38:0/757507792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ec0b6420 0x7f13ec09ecd0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f13dc002f30 tx=0x7f13dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.410 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.401+0000 7f13f0b53700 1 --2- 172.21.15.38:0/757507792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ec0b6420 0x7f13ec09ecd0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f13dc002f30 tx=0x7f13dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.411 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.401+0000 7f13eb7fe700 1 -- 172.21.15.38:0/757507792 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13dc0114e0 con 0x7f13ec0b6420 2020-06-12T17:48:23.411 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.401+0000 7f13eb7fe700 1 -- 172.21.15.38:0/757507792 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13dc0118c0 con 0x7f13ec0b6420 2020-06-12T17:48:23.411 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.401+0000 7f13f2db7700 1 -- 172.21.15.38:0/757507792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ec0b6420 msgr2=0x7f13ec09ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:23.411 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.401+0000 7f13f2db7700 1 --2- 172.21.15.38:0/757507792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ec0b6420 0x7f13ec09ecd0 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7f13dc002f30 tx=0x7f13dc007e60).stop 2020-06-12T17:48:23.411 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.402+0000 7f13f2db7700 1 -- 172.21.15.38:0/757507792 shutdown_connections 2020-06-12T17:48:23.412 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.402+0000 7f13f2db7700 1 --2- 172.21.15.38:0/757507792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ec0b6420 0x7f13ec09ecd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:23.412 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.402+0000 7f13f2db7700 1 --2- 172.21.15.38:0/757507792 >> v2:172.21.15.150:3300/0 conn(0x7f13ec05b3e0 0x7f13ec09d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:23.412 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.402+0000 7f13f2db7700 1 -- 172.21.15.38:0/757507792 >> 172.21.15.38:0/757507792 conn(0x7f13ec0b7190 msgr2=0x7f13ec0b75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:23.412 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.402+0000 7f13f2db7700 1 -- 172.21.15.38:0/757507792 shutdown_connections 2020-06-12T17:48:23.412 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.402+0000 7f13f2db7700 1 -- 172.21.15.38:0/757507792 wait complete. 2020-06-12T17:48:23.412 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.403+0000 7f13f2db7700 1 Processor -- start 2020-06-12T17:48:23.413 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.403+0000 7f13f2db7700 1 -- start start 2020-06-12T17:48:23.415 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.403+0000 7f13f2db7700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f13ec05b3e0 0x7f13ec063c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:23.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.404+0000 7f13f2db7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f13ec05b890 0x7f13ec143db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:23.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.404+0000 7f13f2db7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13ec0640f0 con 0x7f13ec0b6420 2020-06-12T17:48:23.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.404+0000 7f13f2db7700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13ec144730 con 0x7f13ec05b3e0 2020-06-12T17:48:23.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.404+0000 7f13f2db7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13ec1548a0 con 0x7f13ec05b890 2020-06-12T17:48:23.417 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.404+0000 7f13f0b53700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f13ec05b3e0 0x7f13ec063c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:23.417 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.404+0000 7f13f0b53700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f13ec05b3e0 0x7f13ec063c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35848/0 (socket says 172.21.15.38:35848) 2020-06-12T17:48:23.417 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.404+0000 7f13f0b53700 1 -- 172.21.15.38:0/3614977324 learned_addr learned my addr 172.21.15.38:0/3614977324 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:23.417 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.404+0000 7f13ebfff700 1 --2- 172.21.15.38:0/3614977324 >> v2:172.21.15.150:3300/0 conn(0x7f13ec05b890 0x7f13ec143db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:23.417 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.404+0000 7f13f0b53700 1 -- 172.21.15.38:0/3614977324 >> v2:172.21.15.150:3300/0 conn(0x7f13ec05b890 msgr2=0x7f13ec143db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:23.418 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.404+0000 7f13f0b53700 1 --2- 172.21.15.38:0/3614977324 >> v2:172.21.15.150:3300/0 conn(0x7f13ec05b890 0x7f13ec143db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:23.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.404+0000 7f13f0b53700 1 -- 172.21.15.38:0/3614977324 >> v1:172.21.15.150:6789/0 conn(0x7f13ec0b6420 legacy=0x7f13ec142c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:23.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.404+0000 7f13f0b53700 1 -- 172.21.15.38:0/3614977324 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ec143320 con 0x7f13ec05b3e0 2020-06-12T17:48:23.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.404+0000 7f13f0b53700 1 --2- 172.21.15.38:0/3614977324 >> v2:172.21.15.38:3300/0 conn(0x7f13ec05b3e0 0x7f13ec063c90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f13dc002f30 tx=0x7f13dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.404+0000 7f13f0b53700 1 --2- 172.21.15.38:0/3614977324 >> v2:172.21.15.38:3300/0 conn(0x7f13ec05b3e0 0x7f13ec063c90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f13dc002f30 tx=0x7f13dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.404+0000 7f13f0b53700 1 --2- 172.21.15.38:0/3614977324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ec05b3e0 0x7f13ec063c90 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7f13dc002f30 tx=0x7f13dc007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:23.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.404+0000 7f13f0b53700 1 --2- 172.21.15.38:0/3614977324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ec05b3e0 0x7f13ec063c90 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f13dc002f30 tx=0x7f13dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.404+0000 7f13f0b53700 1 --2- 172.21.15.38:0/3614977324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ec05b3e0 0x7f13ec063c90 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f13dc002f30 tx=0x7f13dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.404+0000 7f13e9ffb700 1 -- 172.21.15.38:0/3614977324 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13dc011880 con 0x7f13ec05b3e0 2020-06-12T17:48:23.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.404+0000 7f13f0b53700 1 --2- 172.21.15.38:0/3614977324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ec05b3e0 0x7f13ec063c90 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f13dc002f30 tx=0x7f13dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.404+0000 7f13e9ffb700 1 -- 172.21.15.38:0/3614977324 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13dc007150 con 0x7f13ec05b3e0 2020-06-12T17:48:23.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.404+0000 7f13e9ffb700 1 -- 172.21.15.38:0/3614977324 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13dc0074b0 con 0x7f13ec05b3e0 2020-06-12T17:48:23.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.404+0000 7f13f2db7700 1 -- 172.21.15.38:0/3614977324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13ec0b0ee0 con 0x7f13ec05b3e0 2020-06-12T17:48:23.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.404+0000 7f13f2db7700 1 -- 172.21.15.38:0/3614977324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13ec1443d0 con 0x7f13ec05b3e0 2020-06-12T17:48:23.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.405+0000 7f13f0b53700 1 --2- 172.21.15.38:0/3614977324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ec05b3e0 0x7f13ec063c90 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f13dc002f30 tx=0x7f13dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.405+0000 7f13e9ffb700 1 -- 172.21.15.38:0/3614977324 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f13dc0056c0 con 0x7f13ec05b3e0 2020-06-12T17:48:23.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.405+0000 7f13f0b53700 1 --2- 172.21.15.38:0/3614977324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ec05b3e0 0x7f13ec063c90 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f13dc002f30 tx=0x7f13dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.405+0000 7f13f2db7700 1 -- 172.21.15.38:0/3614977324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13ec056c30 con 0x7f13ec05b3e0 2020-06-12T17:48:23.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.405+0000 7f13e9ffb700 1 --2- 172.21.15.38:0/3614977324 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f13cc04d470 0x7f13cc04f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:23.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.406+0000 7f13e9ffb700 1 -- 172.21.15.38:0/3614977324 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f13dc061800 con 0x7f13ec05b3e0 2020-06-12T17:48:23.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.406+0000 7f13ebfff700 1 --2- 172.21.15.38:0/3614977324 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f13cc04d470 0x7f13cc04f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:23.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.406+0000 7f13ebfff700 1 --2- 172.21.15.38:0/3614977324 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f13cc04d470 0x7f13cc04f930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f13e0002f30 tx=0x7f13e0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.406+0000 7f13ebfff700 1 --2- 172.21.15.38:0/3614977324 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f13cc04d470 0x7f13cc04f930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f13e0002f30 tx=0x7f13e0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.406+0000 7f13ebfff700 1 --2- 172.21.15.38:0/3614977324 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f13cc04d470 0x7f13cc04f930 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f13e0002f30 tx=0x7f13e0007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:23.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.409+0000 7f13f0b53700 1 --2- 172.21.15.38:0/3614977324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ec05b3e0 0x7f13ec063c90 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f13dc002f30 tx=0x7f13dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.409+0000 7f13e9ffb700 1 -- 172.21.15.38:0/3614977324 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f13dc03d020 con 0x7f13ec05b3e0 2020-06-12T17:48:23.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.560+0000 7f13f2db7700 1 -- 172.21.15.38:0/3614977324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f13ec144870 con 0x7f13ec05b3e0 2020-06-12T17:48:23.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.560+0000 7f13f0b53700 1 --2- 172.21.15.38:0/3614977324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ec05b3e0 0x7f13ec063c90 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f13dc002f30 tx=0x7f13dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.560+0000 7f13e9ffb700 1 -- 172.21.15.38:0/3614977324 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f13dc040640 con 0x7f13ec05b3e0 2020-06-12T17:48:23.565 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2020-06-12T17:48:23.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.562+0000 7f13f2db7700 1 -- 172.21.15.38:0/3614977324 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f13cc04d470 msgr2=0x7f13cc04f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:23.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.562+0000 7f13f2db7700 1 --2- 172.21.15.38:0/3614977324 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f13cc04d470 0x7f13cc04f930 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f13e0002f30 tx=0x7f13e0007e60).stop 2020-06-12T17:48:23.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.562+0000 7f13f2db7700 1 -- 172.21.15.38:0/3614977324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ec05b3e0 msgr2=0x7f13ec063c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:23.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.562+0000 7f13f2db7700 1 --2- 172.21.15.38:0/3614977324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ec05b3e0 0x7f13ec063c90 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7f13dc002f30 tx=0x7f13dc007e60).stop 2020-06-12T17:48:23.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.562+0000 7f13f2db7700 1 -- 172.21.15.38:0/3614977324 shutdown_connections 2020-06-12T17:48:23.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.562+0000 7f13f2db7700 1 --2- 172.21.15.38:0/3614977324 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f13cc04d470 0x7f13cc04f930 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:23.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.562+0000 7f13f2db7700 1 --2- 172.21.15.38:0/3614977324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ec05b3e0 0x7f13ec063c90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:23.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.562+0000 7f13f2db7700 1 --2- 172.21.15.38:0/3614977324 >> v2:172.21.15.150:3300/0 conn(0x7f13ec05b890 0x7f13ec143db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:23.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.562+0000 7f13f2db7700 1 -- 172.21.15.38:0/3614977324 >> 172.21.15.38:0/3614977324 conn(0x7f13ec0b7190 msgr2=0x7f13ec0b5090 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:23.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.562+0000 7f13f2db7700 1 -- 172.21.15.38:0/3614977324 shutdown_connections 2020-06-12T17:48:23.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.562+0000 7f13f2db7700 1 -- 172.21.15.38:0/3614977324 wait complete. 2020-06-12T17:48:23.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2020-06-12T17:48:23.576 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.5 2020-06-12T17:48:23.692 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.688+0000 7f377a8dd700 1 Processor -- start 2020-06-12T17:48:23.692 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.688+0000 7f377a8dd700 1 -- start start 2020-06-12T17:48:23.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.689+0000 7f377a8dd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f377409cf10 0x7f37740adaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:23.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.689+0000 7f377a8dd700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37740aecd0 con 0x7f3774146cf0 2020-06-12T17:48:23.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.689+0000 7f377a8dd700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377409d420 con 0x7f37741401f0 2020-06-12T17:48:23.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.689+0000 7f377a8dd700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377409d6c0 con 0x7f377409cf10 2020-06-12T17:48:23.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.689+0000 7f3778e7a700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f3774146cf0 0x7f3774143020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37674/0 (socket says 172.21.15.38:37674) 2020-06-12T17:48:23.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.689+0000 7f3778e7a700 1 -- 172.21.15.38:0/2687818460 learned_addr learned my addr 172.21.15.38:0/2687818460 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:23.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.689+0000 7f37737fe700 1 -- 172.21.15.38:0/2687818460 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657939677 0 0) 0x7f37740aecd0 con 0x7f3774146cf0 2020-06-12T17:48:23.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.689+0000 7f37737fe700 1 -- 172.21.15.38:0/2687818460 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3754003230 con 0x7f3774146cf0 2020-06-12T17:48:23.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.689+0000 7f376bfff700 1 --2- 172.21.15.38:0/2687818460 >> v2:172.21.15.150:3300/0 conn(0x7f377409cf10 0x7f37740adaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:23.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.689+0000 7f37737fe700 1 -- 172.21.15.38:0/2687818460 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2812799283 0 0) 0x7f3754003230 con 0x7f3774146cf0 2020-06-12T17:48:23.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.689+0000 7f37737fe700 1 -- 172.21.15.38:0/2687818460 >> v2:172.21.15.150:3300/0 conn(0x7f377409cf10 msgr2=0x7f37740adaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:23.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.689+0000 7f37737fe700 1 --2- 172.21.15.38:0/2687818460 >> v2:172.21.15.150:3300/0 conn(0x7f377409cf10 0x7f37740adaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:23.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.689+0000 7f37737fe700 1 -- 172.21.15.38:0/2687818460 >> v1:172.21.15.150:6789/0 conn(0x7f37741401f0 legacy=0x7f37740b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:23.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.689+0000 7f37737fe700 1 -- 172.21.15.38:0/2687818460 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37740adf50 con 0x7f3774146cf0 2020-06-12T17:48:23.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.689+0000 7f37737fe700 1 -- 172.21.15.38:0/2687818460 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f376c001a50 con 0x7f3774146cf0 2020-06-12T17:48:23.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f37737fe700 1 -- 172.21.15.38:0/2687818460 >> v1:172.21.15.38:6789/0 conn(0x7f3774146cf0 legacy=0x7f3774143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:23.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f37737fe700 1 --2- 172.21.15.38:0/2687818460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3754003720 0x7f3754003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:23.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f37737fe700 1 --2- 172.21.15.38:0/2687818460 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540044d0 0x7f3754004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:23.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f37737fe700 1 --2- 172.21.15.38:0/2687818460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3754004db0 0x7f375400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:23.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f37737fe700 1 -- 172.21.15.38:0/2687818460 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377409d6c0 con 0x7f37540044d0 2020-06-12T17:48:23.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f37737fe700 1 -- 172.21.15.38:0/2687818460 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37540041c0 con 0x7f3754004db0 2020-06-12T17:48:23.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f37737fe700 1 -- 172.21.15.38:0/2687818460 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375400bb80 con 0x7f3754003720 2020-06-12T17:48:23.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f376bfff700 1 --2- 172.21.15.38:0/2687818460 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540044d0 0x7f3754004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:23.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f3778e7a700 1 --2- 172.21.15.38:0/2687818460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3754004db0 0x7f375400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:23.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f3773fff700 1 --2- 172.21.15.38:0/2687818460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3754003720 0x7f3754003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:23.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f376bfff700 1 -- 172.21.15.38:0/2687818460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3754003720 msgr2=0x7f3754003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:23.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f376bfff700 1 --2- 172.21.15.38:0/2687818460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3754003720 0x7f3754003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:23.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f376bfff700 1 -- 172.21.15.38:0/2687818460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3754004db0 msgr2=0x7f375400b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:23.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f376bfff700 1 --2- 172.21.15.38:0/2687818460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3754004db0 0x7f375400b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:23.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f3778e7a700 1 -- 172.21.15.38:0/2687818460 reap_dead start 2020-06-12T17:48:23.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f376bfff700 1 -- 172.21.15.38:0/2687818460 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3754003230 con 0x7f37540044d0 2020-06-12T17:48:23.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f3773fff700 1 --2- 172.21.15.38:0/2687818460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3754003720 0x7f3754003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:23.705 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f376bfff700 1 --2- 172.21.15.38:0/2687818460 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540044d0 0x7f3754004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f375c002f30 tx=0x7f375c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.705 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f376bfff700 1 --2- 172.21.15.38:0/2687818460 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540044d0 0x7f3754004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f375c002f30 tx=0x7f375c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.705 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f376bfff700 1 --2- 172.21.15.38:0/2687818460 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540044d0 0x7f3754004950 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7f375c002f30 tx=0x7f375c007e60).ready entity=mon.0 client_cookie=f5864730af427526 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:23.705 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f376bfff700 1 --2- 172.21.15.38:0/2687818460 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540044d0 0x7f3754004950 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f375c002f30 tx=0x7f375c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.705 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f376bfff700 1 --2- 172.21.15.38:0/2687818460 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540044d0 0x7f3754004950 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f375c002f30 tx=0x7f375c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f37737fe700 1 -- 172.21.15.38:0/2687818460 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f375c008d30 con 0x7f37540044d0 2020-06-12T17:48:23.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f376bfff700 1 --2- 172.21.15.38:0/2687818460 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540044d0 0x7f3754004950 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f375c002f30 tx=0x7f375c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f37737fe700 1 -- 172.21.15.38:0/2687818460 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375c008e90 con 0x7f37540044d0 2020-06-12T17:48:23.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f37737fe700 1 -- 172.21.15.38:0/2687818460 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f375c010a60 con 0x7f37540044d0 2020-06-12T17:48:23.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f377a8dd700 1 -- 172.21.15.38:0/2687818460 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540044d0 msgr2=0x7f3754004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:23.707 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.690+0000 7f377a8dd700 1 --2- 172.21.15.38:0/2687818460 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540044d0 0x7f3754004950 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7f375c002f30 tx=0x7f375c007e60).stop 2020-06-12T17:48:23.707 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.691+0000 7f377a8dd700 1 -- 172.21.15.38:0/2687818460 shutdown_connections 2020-06-12T17:48:23.707 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.691+0000 7f377a8dd700 1 --2- 172.21.15.38:0/2687818460 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540044d0 0x7f3754004950 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:23.707 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.691+0000 7f377a8dd700 1 -- 172.21.15.38:0/2687818460 >> 172.21.15.38:0/2687818460 conn(0x7f37740b8410 msgr2=0x7f37740b8820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:23.707 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.691+0000 7f377a8dd700 1 -- 172.21.15.38:0/2687818460 shutdown_connections 2020-06-12T17:48:23.707 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.691+0000 7f377a8dd700 1 -- 172.21.15.38:0/2687818460 wait complete. 2020-06-12T17:48:23.708 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.692+0000 7f377a8dd700 1 Processor -- start 2020-06-12T17:48:23.708 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.692+0000 7f377a8dd700 1 -- start start 2020-06-12T17:48:23.708 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.692+0000 7f377a8dd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f37540044d0 0x7f37740b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:23.708 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.692+0000 7f377a8dd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37740b0a80 0x7f377413f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:23.708 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.692+0000 7f377a8dd700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37740b1390 con 0x7f37740b0f10 2020-06-12T17:48:23.709 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.692+0000 7f377a8dd700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37740b1630 con 0x7f37540044d0 2020-06-12T17:48:23.709 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.692+0000 7f377a8dd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37740b18d0 con 0x7f37740b0a80 2020-06-12T17:48:23.709 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.692+0000 7f3773fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f37540044d0 0x7f37740b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:23.709 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.692+0000 7f3773fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f37540044d0 0x7f37740b31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35870/0 (socket says 172.21.15.38:35870) 2020-06-12T17:48:23.709 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.692+0000 7f3773fff700 1 -- 172.21.15.38:0/2583942657 learned_addr learned my addr 172.21.15.38:0/2583942657 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:23.710 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.692+0000 7f3778e7a700 1 --1- 172.21.15.38:0/2583942657 >> v1:172.21.15.38:6789/0 conn(0x7f37740b0f10 0x7f377413f850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37688/0 (socket says 172.21.15.38:37688) 2020-06-12T17:48:23.710 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.693+0000 7f376bfff700 1 --2- 172.21.15.38:0/2583942657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37740b0a80 0x7f377413f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:23.710 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.693+0000 7f3773fff700 1 -- 172.21.15.38:0/2583942657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37740b0a80 msgr2=0x7f377413f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:23.711 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.693+0000 7f3773fff700 1 --2- 172.21.15.38:0/2583942657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37740b0a80 0x7f377413f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:23.711 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.693+0000 7f3773fff700 1 -- 172.21.15.38:0/2583942657 >> v1:172.21.15.38:6789/0 conn(0x7f37740b0f10 legacy=0x7f377413f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:23.711 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.693+0000 7f3771ffb700 1 -- 172.21.15.38:0/2583942657 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1026684688 0 0) 0x7f37740b1390 con 0x7f37740b0f10 2020-06-12T17:48:23.711 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.693+0000 7f3773fff700 1 -- 172.21.15.38:0/2583942657 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3774156c50 con 0x7f37540044d0 2020-06-12T17:48:23.711 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.693+0000 7f3773fff700 1 --2- 172.21.15.38:0/2583942657 >> v2:172.21.15.38:3300/0 conn(0x7f37540044d0 0x7f37740b31b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3774060440 tx=0x7f37640018d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.711 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.693+0000 7f3773fff700 1 --2- 172.21.15.38:0/2583942657 >> v2:172.21.15.38:3300/0 conn(0x7f37540044d0 0x7f37740b31b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3774060440 tx=0x7f37640018d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.712 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.693+0000 7f3773fff700 1 --2- 172.21.15.38:0/2583942657 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540044d0 0x7f37740b31b0 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7f3774060440 tx=0x7f37640018d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:23.712 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.693+0000 7f3773fff700 1 --2- 172.21.15.38:0/2583942657 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540044d0 0x7f37740b31b0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f3774060440 tx=0x7f37640018d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.712 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.693+0000 7f3771ffb700 1 -- 172.21.15.38:0/2583942657 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f376400cce0 con 0x7f37540044d0 2020-06-12T17:48:23.712 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.693+0000 7f3773fff700 1 --2- 172.21.15.38:0/2583942657 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540044d0 0x7f37740b31b0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f3774060440 tx=0x7f37640018d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.712 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.693+0000 7f3773fff700 1 --2- 172.21.15.38:0/2583942657 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540044d0 0x7f37740b31b0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f3774060440 tx=0x7f37640018d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.713 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.693+0000 7f3771ffb700 1 -- 172.21.15.38:0/2583942657 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376400ce40 con 0x7f37540044d0 2020-06-12T17:48:23.713 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.693+0000 7f377a8dd700 1 -- 172.21.15.38:0/2583942657 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3774140cf0 con 0x7f37540044d0 2020-06-12T17:48:23.713 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.693+0000 7f3771ffb700 1 -- 172.21.15.38:0/2583942657 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3764011140 con 0x7f37540044d0 2020-06-12T17:48:23.713 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.693+0000 7f377a8dd700 1 -- 172.21.15.38:0/2583942657 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3774141210 con 0x7f37540044d0 2020-06-12T17:48:23.713 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.694+0000 7f3773fff700 1 --2- 172.21.15.38:0/2583942657 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540044d0 0x7f37740b31b0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f3774060440 tx=0x7f37640018d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.714 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.694+0000 7f377a8dd700 1 -- 172.21.15.38:0/2583942657 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3774067b20 con 0x7f37540044d0 2020-06-12T17:48:23.714 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.694+0000 7f3771ffb700 1 -- 172.21.15.38:0/2583942657 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f37640064e0 con 0x7f37540044d0 2020-06-12T17:48:23.714 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.694+0000 7f3773fff700 1 --2- 172.21.15.38:0/2583942657 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540044d0 0x7f37740b31b0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f3774060440 tx=0x7f37640018d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.714 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.694+0000 7f3771ffb700 1 --2- 172.21.15.38:0/2583942657 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f375804d450 0x7f375804f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:23.714 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.694+0000 7f3771ffb700 1 -- 172.21.15.38:0/2583942657 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f37640609c0 con 0x7f37540044d0 2020-06-12T17:48:23.715 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.695+0000 7f376bfff700 1 --2- 172.21.15.38:0/2583942657 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f375804d450 0x7f375804f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:23.715 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.695+0000 7f376bfff700 1 --2- 172.21.15.38:0/2583942657 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f375804d450 0x7f375804f910 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f375c002f30 tx=0x7f375c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.715 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.695+0000 7f376bfff700 1 --2- 172.21.15.38:0/2583942657 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f375804d450 0x7f375804f910 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f375c002f30 tx=0x7f375c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.715 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.695+0000 7f376bfff700 1 --2- 172.21.15.38:0/2583942657 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f375804d450 0x7f375804f910 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f375c002f30 tx=0x7f375c007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:23.716 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.698+0000 7f3773fff700 1 --2- 172.21.15.38:0/2583942657 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540044d0 0x7f37740b31b0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f3774060440 tx=0x7f37640018d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.716 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.698+0000 7f3771ffb700 1 -- 172.21.15.38:0/2583942657 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f376403c120 con 0x7f37540044d0 2020-06-12T17:48:23.853 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.850+0000 7f377a8dd700 1 -- 172.21.15.38:0/2583942657 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3774156e40 con 0x7f37540044d0 2020-06-12T17:48:23.854 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.850+0000 7f3773fff700 1 --2- 172.21.15.38:0/2583942657 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540044d0 0x7f37740b31b0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f3774060440 tx=0x7f37640018d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.854 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.850+0000 7f3771ffb700 1 -- 172.21.15.38:0/2583942657 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3774156e40 con 0x7f37540044d0 2020-06-12T17:48:23.854 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2020-06-12T17:48:23.869 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.851+0000 7f377a8dd700 1 -- 172.21.15.38:0/2583942657 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f375804d450 msgr2=0x7f375804f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:23.869 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.851+0000 7f377a8dd700 1 --2- 172.21.15.38:0/2583942657 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f375804d450 0x7f375804f910 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f375c002f30 tx=0x7f375c007e60).stop 2020-06-12T17:48:23.869 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.851+0000 7f377a8dd700 1 -- 172.21.15.38:0/2583942657 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540044d0 msgr2=0x7f37740b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:23.869 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.851+0000 7f377a8dd700 1 --2- 172.21.15.38:0/2583942657 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540044d0 0x7f37740b31b0 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7f3774060440 tx=0x7f37640018d0).stop 2020-06-12T17:48:23.870 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.852+0000 7f377a8dd700 1 -- 172.21.15.38:0/2583942657 shutdown_connections 2020-06-12T17:48:23.870 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.852+0000 7f377a8dd700 1 --2- 172.21.15.38:0/2583942657 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f375804d450 0x7f375804f910 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:23.870 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.852+0000 7f377a8dd700 1 --2- 172.21.15.38:0/2583942657 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540044d0 0x7f37740b31b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:23.870 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.852+0000 7f377a8dd700 1 --2- 172.21.15.38:0/2583942657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37740b0a80 0x7f377413f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:23.870 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.852+0000 7f377a8dd700 1 -- 172.21.15.38:0/2583942657 >> 172.21.15.38:0/2583942657 conn(0x7f37740b8410 msgr2=0x7f37740b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:23.871 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.852+0000 7f377a8dd700 1 -- 172.21.15.38:0/2583942657 shutdown_connections 2020-06-12T17:48:23.871 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.852+0000 7f377a8dd700 1 -- 172.21.15.38:0/2583942657 wait complete. 2020-06-12T17:48:23.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2020-06-12T17:48:23.872 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.6 2020-06-12T17:48:23.986 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.983+0000 7fc986caf700 1 Processor -- start 2020-06-12T17:48:23.987 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.983+0000 7fc986caf700 1 -- start start 2020-06-12T17:48:23.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.983+0000 7fc986caf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc980066eb0 0x7fc9800b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:23.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.983+0000 7fc986caf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc980143bc0 0x7fc98005b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:23.991 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.983+0000 7fc986caf700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9801424b0 con 0x7fc98005b420 2020-06-12T17:48:23.991 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.983+0000 7fc986caf700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9800b4950 con 0x7fc980143bc0 2020-06-12T17:48:23.991 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.983+0000 7fc986caf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc980067290 con 0x7fc980066eb0 2020-06-12T17:48:23.991 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.984+0000 7fc97ffff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc98005b420 0x7fc98009b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37692/0 (socket says 172.21.15.38:37692) 2020-06-12T17:48:23.991 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.984+0000 7fc97ffff700 1 -- 172.21.15.38:0/1663504399 learned_addr learned my addr 172.21.15.38:0/1663504399 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:23.992 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.984+0000 7fc98524c700 1 --2- 172.21.15.38:0/1663504399 >> v2:172.21.15.150:3300/0 conn(0x7fc980143bc0 0x7fc98005b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:23.992 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.984+0000 7fc984a4b700 1 --2- 172.21.15.38:0/1663504399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc980066eb0 0x7fc9800b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:23.992 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.984+0000 7fc97f7fe700 1 -- 172.21.15.38:0/1663504399 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292437892 0 0) 0x7fc9801424b0 con 0x7fc98005b420 2020-06-12T17:48:23.992 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.984+0000 7fc97f7fe700 1 -- 172.21.15.38:0/1663504399 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc960003230 con 0x7fc98005b420 2020-06-12T17:48:23.992 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.984+0000 7fc97f7fe700 1 -- 172.21.15.38:0/1663504399 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1334624485 0 0) 0x7fc960003230 con 0x7fc98005b420 2020-06-12T17:48:23.993 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.984+0000 7fc97f7fe700 1 -- 172.21.15.38:0/1663504399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc980066eb0 msgr2=0x7fc9800b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:23.993 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.984+0000 7fc97f7fe700 1 --2- 172.21.15.38:0/1663504399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc980066eb0 0x7fc9800b44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:23.993 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.984+0000 7fc97f7fe700 1 -- 172.21.15.38:0/1663504399 >> v2:172.21.15.150:3300/0 conn(0x7fc980143bc0 msgr2=0x7fc98005b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:23.993 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.984+0000 7fc97f7fe700 1 --2- 172.21.15.38:0/1663504399 >> v2:172.21.15.150:3300/0 conn(0x7fc980143bc0 0x7fc98005b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:23.993 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.984+0000 7fc97f7fe700 1 -- 172.21.15.38:0/1663504399 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9800b3bc0 con 0x7fc98005b420 2020-06-12T17:48:23.994 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.984+0000 7fc97f7fe700 1 -- 172.21.15.38:0/1663504399 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fc9700016d0 con 0x7fc98005b420 2020-06-12T17:48:23.994 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.984+0000 7fc97f7fe700 1 -- 172.21.15.38:0/1663504399 >> v1:172.21.15.38:6789/0 conn(0x7fc98005b420 legacy=0x7fc98009b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:23.994 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.984+0000 7fc97f7fe700 1 --2- 172.21.15.38:0/1663504399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc960003720 0x7fc960003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:23.994 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.984+0000 7fc97f7fe700 1 --2- 172.21.15.38:0/1663504399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc980066eb0 0x7fc9600044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:23.994 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.984+0000 7fc97f7fe700 1 --2- 172.21.15.38:0/1663504399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc960004930 0x7fc960004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:23.995 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.984+0000 7fc97f7fe700 1 -- 172.21.15.38:0/1663504399 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9800b4950 con 0x7fc960004930 2020-06-12T17:48:23.995 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.984+0000 7fc97f7fe700 1 -- 172.21.15.38:0/1663504399 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc980067290 con 0x7fc960003720 2020-06-12T17:48:23.995 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.984+0000 7fc97f7fe700 1 -- 172.21.15.38:0/1663504399 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc960005380 con 0x7fc980066eb0 2020-06-12T17:48:23.995 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.984+0000 7fc98524c700 1 --2- 172.21.15.38:0/1663504399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc960004930 0x7fc960004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:23.995 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.984+0000 7fc984a4b700 1 --2- 172.21.15.38:0/1663504399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc960003720 0x7fc960003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:23.996 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.985+0000 7fc97ffff700 1 --2- 172.21.15.38:0/1663504399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc980066eb0 0x7fc9600044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:23.996 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.985+0000 7fc98524c700 1 -- 172.21.15.38:0/1663504399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc980066eb0 msgr2=0x7fc9600044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:23.996 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.985+0000 7fc98524c700 1 --2- 172.21.15.38:0/1663504399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc980066eb0 0x7fc9600044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:23.996 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.985+0000 7fc98524c700 1 -- 172.21.15.38:0/1663504399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc960003720 msgr2=0x7fc960003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:23.996 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.985+0000 7fc98524c700 1 --2- 172.21.15.38:0/1663504399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc960003720 0x7fc960003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:23.996 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.985+0000 7fc98524c700 1 -- 172.21.15.38:0/1663504399 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc960003230 con 0x7fc960004930 2020-06-12T17:48:23.997 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.985+0000 7fc97ffff700 1 --2- 172.21.15.38:0/1663504399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc980066eb0 0x7fc9600044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:23.997 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.985+0000 7fc98524c700 1 --2- 172.21.15.38:0/1663504399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc960004930 0x7fc960004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc9780032b0 tx=0x7fc9780081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.997 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.985+0000 7fc98524c700 1 --2- 172.21.15.38:0/1663504399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc960004930 0x7fc960004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc9780032b0 tx=0x7fc9780081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.997 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.985+0000 7fc98524c700 1 --2- 172.21.15.38:0/1663504399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc960004930 0x7fc960004db0 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7fc9780032b0 tx=0x7fc9780081e0).ready entity=mon.0 client_cookie=a085be01d6e662c7 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:23.997 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.985+0000 7fc98524c700 1 --2- 172.21.15.38:0/1663504399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc960004930 0x7fc960004db0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fc9780032b0 tx=0x7fc9780081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.985+0000 7fc97f7fe700 1 -- 172.21.15.38:0/1663504399 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc978010e60 con 0x7fc960004930 2020-06-12T17:48:23.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.985+0000 7fc98524c700 1 --2- 172.21.15.38:0/1663504399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc960004930 0x7fc960004db0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fc9780032b0 tx=0x7fc9780081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.985+0000 7fc98524c700 1 --2- 172.21.15.38:0/1663504399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc960004930 0x7fc960004db0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fc9780032b0 tx=0x7fc9780081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:23.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.985+0000 7fc97f7fe700 1 -- 172.21.15.38:0/1663504399 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9780112b0 con 0x7fc960004930 2020-06-12T17:48:23.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.985+0000 7fc97f7fe700 1 -- 172.21.15.38:0/1663504399 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc978011610 con 0x7fc960004930 2020-06-12T17:48:23.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.985+0000 7fc986caf700 1 -- 172.21.15.38:0/1663504399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc960004930 msgr2=0x7fc960004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:23.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.985+0000 7fc986caf700 1 --2- 172.21.15.38:0/1663504399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc960004930 0x7fc960004db0 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7fc9780032b0 tx=0x7fc9780081e0).stop 2020-06-12T17:48:23.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.985+0000 7fc98524c700 1 -- 172.21.15.38:0/1663504399 reap_dead start 2020-06-12T17:48:23.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.986+0000 7fc986caf700 1 -- 172.21.15.38:0/1663504399 shutdown_connections 2020-06-12T17:48:23.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.986+0000 7fc986caf700 1 -- 172.21.15.38:0/1663504399 >> 172.21.15.38:0/1663504399 conn(0x7fc9800b8410 msgr2=0x7fc9800b8820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:24.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.986+0000 7fc986caf700 1 -- 172.21.15.38:0/1663504399 shutdown_connections 2020-06-12T17:48:24.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.986+0000 7fc986caf700 1 -- 172.21.15.38:0/1663504399 wait complete. 2020-06-12T17:48:24.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.986+0000 7fc986caf700 1 Processor -- start 2020-06-12T17:48:24.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.987+0000 7fc986caf700 1 -- start start 2020-06-12T17:48:24.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.987+0000 7fc986caf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9800b1d40 0x7fc980144810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:24.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.987+0000 7fc986caf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc980062e10 0x7fc980061f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:24.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.987+0000 7fc986caf700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc980125a50 con 0x7fc9801453c0 2020-06-12T17:48:24.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.987+0000 7fc986caf700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc980062380 con 0x7fc980062e10 2020-06-12T17:48:24.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.987+0000 7fc986caf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc980133e20 con 0x7fc9800b1d40 2020-06-12T17:48:24.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.987+0000 7fc97ffff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc9801453c0 0x7fc980062700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37704/0 (socket says 172.21.15.38:37704) 2020-06-12T17:48:24.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.987+0000 7fc97ffff700 1 -- 172.21.15.38:0/1864100558 learned_addr learned my addr 172.21.15.38:0/1864100558 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:24.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc98524c700 1 --2- 172.21.15.38:0/1864100558 >> v2:172.21.15.150:3300/0 conn(0x7fc980062e10 0x7fc980061f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:24.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc984a4b700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9800b1d40 0x7fc980144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:24.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc97dffb700 1 -- 172.21.15.38:0/1864100558 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1572495599 0 0) 0x7fc980125a50 con 0x7fc9801453c0 2020-06-12T17:48:24.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc97dffb700 1 -- 172.21.15.38:0/1864100558 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc964002fe0 con 0x7fc9801453c0 2020-06-12T17:48:24.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc97dffb700 1 -- 172.21.15.38:0/1864100558 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2194989398 0 0) 0x7fc964002fe0 con 0x7fc9801453c0 2020-06-12T17:48:24.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc97dffb700 1 -- 172.21.15.38:0/1864100558 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc980125a50 con 0x7fc9801453c0 2020-06-12T17:48:24.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc97dffb700 1 -- 172.21.15.38:0/1864100558 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fc9700047a0 con 0x7fc9801453c0 2020-06-12T17:48:24.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc97dffb700 1 -- 172.21.15.38:0/1864100558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9800b1d40 msgr2=0x7fc980144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:24.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc97dffb700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9800b1d40 0x7fc980144810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:24.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc97dffb700 1 -- 172.21.15.38:0/1864100558 >> v2:172.21.15.150:3300/0 conn(0x7fc980062e10 msgr2=0x7fc980061f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:24.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc97dffb700 1 --2- 172.21.15.38:0/1864100558 >> v2:172.21.15.150:3300/0 conn(0x7fc980062e10 0x7fc980061f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:24.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc97dffb700 1 -- 172.21.15.38:0/1864100558 >> v1:172.21.15.38:6789/0 conn(0x7fc9801453c0 legacy=0x7fc980062700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:24.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc97dffb700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9640049b0 0x7fc964004df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:24.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc97dffb700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc964003920 0x7fc964003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:24.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc97dffb700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9800b1d40 0x7fc9640041c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:24.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc97dffb700 1 -- 172.21.15.38:0/1864100558 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc980133e20 con 0x7fc9640049b0 2020-06-12T17:48:24.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc97dffb700 1 -- 172.21.15.38:0/1864100558 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9640054f0 con 0x7fc964003920 2020-06-12T17:48:24.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc97dffb700 1 -- 172.21.15.38:0/1864100558 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc964004620 con 0x7fc9800b1d40 2020-06-12T17:48:24.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc984a4b700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9640049b0 0x7fc964004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:24.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc97ffff700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc964003920 0x7fc964003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:24.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc98524c700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9800b1d40 0x7fc9640041c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:24.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc984a4b700 1 -- 172.21.15.38:0/1864100558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9800b1d40 msgr2=0x7fc9640041c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:24.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc984a4b700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9800b1d40 0x7fc9640041c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:24.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc984a4b700 1 -- 172.21.15.38:0/1864100558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc964003920 msgr2=0x7fc964003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:24.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc984a4b700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc964003920 0x7fc964003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:24.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc984a4b700 1 -- 172.21.15.38:0/1864100558 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc980125cb0 con 0x7fc9640049b0 2020-06-12T17:48:24.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc986caf700 1 -- 172.21.15.38:0/1864100558 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9800b2120 con 0x7fc9640049b0 2020-06-12T17:48:24.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.988+0000 7fc984a4b700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9640049b0 0x7fc964004df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc968002f30 tx=0x7fc968007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.989+0000 7fc986caf700 1 -- 172.21.15.38:0/1864100558 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc980144810 con 0x7fc9640049b0 2020-06-12T17:48:24.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.989+0000 7fc984a4b700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9640049b0 0x7fc964004df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc968002f30 tx=0x7fc968007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.989+0000 7fc984a4b700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9640049b0 0x7fc964004df0 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7fc968002f30 tx=0x7fc968007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:24.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.989+0000 7fc984a4b700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9640049b0 0x7fc964004df0 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7fc968002f30 tx=0x7fc968007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.989+0000 7fc97dffb700 1 -- 172.21.15.38:0/1864100558 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc968007560 con 0x7fc9640049b0 2020-06-12T17:48:24.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.989+0000 7fc984a4b700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9640049b0 0x7fc964004df0 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7fc968002f30 tx=0x7fc968007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.989+0000 7fc984a4b700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9640049b0 0x7fc964004df0 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7fc968002f30 tx=0x7fc968007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.989+0000 7fc97dffb700 1 -- 172.21.15.38:0/1864100558 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc968012780 con 0x7fc9640049b0 2020-06-12T17:48:24.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.989+0000 7fc97dffb700 1 -- 172.21.15.38:0/1864100558 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc968012b20 con 0x7fc9640049b0 2020-06-12T17:48:24.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.989+0000 7fc984a4b700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9640049b0 0x7fc964004df0 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7fc968002f30 tx=0x7fc968007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.989+0000 7fc986caf700 1 -- 172.21.15.38:0/1864100558 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc958003340 con 0x7fc9640049b0 2020-06-12T17:48:24.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.990+0000 7fc97dffb700 1 -- 172.21.15.38:0/1864100558 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fc968012c80 con 0x7fc9640049b0 2020-06-12T17:48:24.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.990+0000 7fc984a4b700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9640049b0 0x7fc964004df0 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7fc968002f30 tx=0x7fc968007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.990+0000 7fc97dffb700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc9640558a0 0x7fc964057d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:24.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.990+0000 7fc97dffb700 1 -- 172.21.15.38:0/1864100558 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc968061100 con 0x7fc9640049b0 2020-06-12T17:48:24.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.990+0000 7fc97ffff700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc9640558a0 0x7fc964057d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:24.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.990+0000 7fc97ffff700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc9640558a0 0x7fc964057d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc970001d40 tx=0x7fc98009e510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.990+0000 7fc97ffff700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc9640558a0 0x7fc964057d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc970001d40 tx=0x7fc98009e510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.990+0000 7fc97ffff700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc9640558a0 0x7fc964057d60 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7fc970001d40 tx=0x7fc98009e510).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:24.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.993+0000 7fc984a4b700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9640049b0 0x7fc964004df0 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7fc968002f30 tx=0x7fc968007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:23.993+0000 7fc97dffb700 1 -- 172.21.15.38:0/1864100558 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fc96803c8c0 con 0x7fc9640049b0 2020-06-12T17:48:24.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.144+0000 7fc986caf700 1 -- 172.21.15.38:0/1864100558 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc9580021d0 con 0x7fc9640049b0 2020-06-12T17:48:24.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.145+0000 7fc984a4b700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9640049b0 0x7fc964004df0 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7fc968002f30 tx=0x7fc968007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.145+0000 7fc97dffb700 1 -- 172.21.15.38:0/1864100558 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc96803fee0 con 0x7fc9640049b0 2020-06-12T17:48:24.149 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2020-06-12T17:48:24.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.146+0000 7fc986caf700 1 -- 172.21.15.38:0/1864100558 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc9640558a0 msgr2=0x7fc964057d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:24.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.146+0000 7fc986caf700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc9640558a0 0x7fc964057d60 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7fc970001d40 tx=0x7fc98009e510).stop 2020-06-12T17:48:24.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.146+0000 7fc986caf700 1 -- 172.21.15.38:0/1864100558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9640049b0 msgr2=0x7fc964004df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:24.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.146+0000 7fc986caf700 1 --2- 172.21.15.38:0/1864100558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9640049b0 0x7fc964004df0 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7fc968002f30 tx=0x7fc968007e60).stop 2020-06-12T17:48:24.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.146+0000 7fc98524c700 1 -- 172.21.15.38:0/1864100558 reap_dead start 2020-06-12T17:48:24.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.146+0000 7fc98524c700 1 -- 172.21.15.38:0/1864100558 reap_dead start 2020-06-12T17:48:24.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.146+0000 7fc986caf700 1 -- 172.21.15.38:0/1864100558 shutdown_connections 2020-06-12T17:48:24.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.146+0000 7fc986caf700 1 -- 172.21.15.38:0/1864100558 >> 172.21.15.38:0/1864100558 conn(0x7fc9800b8410 msgr2=0x7fc9800b55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:24.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.146+0000 7fc986caf700 1 -- 172.21.15.38:0/1864100558 shutdown_connections 2020-06-12T17:48:24.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.146+0000 7fc986caf700 1 -- 172.21.15.38:0/1864100558 wait complete. 2020-06-12T17:48:24.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2020-06-12T17:48:24.160 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.7 2020-06-12T17:48:24.276 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.272+0000 7f8a57ec1700 1 Processor -- start 2020-06-12T17:48:24.276 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.272+0000 7f8a57ec1700 1 -- start start 2020-06-12T17:48:24.279 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.273+0000 7f8a57ec1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8a501401f0 0x7f8a5009cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:24.279 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.273+0000 7f8a57ec1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a50146cf0 0x7f8a50143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:24.279 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.273+0000 7f8a57ec1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a500aecd0 con 0x7f8a500adaf0 2020-06-12T17:48:24.279 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.273+0000 7f8a57ec1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a5009d420 con 0x7f8a501401f0 2020-06-12T17:48:24.279 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.273+0000 7f8a57ec1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5009d6c0 con 0x7f8a50146cf0 2020-06-12T17:48:24.280 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.273+0000 7f8a5645e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a50146cf0 0x7f8a50143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:24.280 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.273+0000 7f8a55c5d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8a501401f0 0x7f8a5009cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:24.280 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.273+0000 7f8a5645e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a50146cf0 0x7f8a50143020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:55360/0 (socket says 172.21.15.38:55360) 2020-06-12T17:48:24.280 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.273+0000 7f8a5545c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f8a500adaf0 0x7f8a500b3f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:58450/0 (socket says 172.21.15.38:58450) 2020-06-12T17:48:24.280 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.273+0000 7f8a55c5d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8a501401f0 0x7f8a5009cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:45376/0 (socket says 172.21.15.38:45376) 2020-06-12T17:48:24.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.273+0000 7f8a5645e700 1 -- 172.21.15.38:0/2181292976 learned_addr learned my addr 172.21.15.38:0/2181292976 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:24.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.274+0000 7f8a55c5d700 1 -- 172.21.15.38:0/2181292976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a50146cf0 msgr2=0x7f8a50143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:24.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.274+0000 7f8a55c5d700 1 --2- 172.21.15.38:0/2181292976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a50146cf0 0x7f8a50143020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:24.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.274+0000 7f8a55c5d700 1 -- 172.21.15.38:0/2181292976 >> v1:172.21.15.150:6789/0 conn(0x7f8a500adaf0 legacy=0x7f8a500b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:24.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.274+0000 7f8a55c5d700 1 -- 172.21.15.38:0/2181292976 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a500adf80 con 0x7f8a501401f0 2020-06-12T17:48:24.282 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.274+0000 7f8a54c5b700 1 -- 172.21.15.38:0/2181292976 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3348428386 0 0) 0x7f8a500aecd0 con 0x7f8a500adaf0 2020-06-12T17:48:24.282 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.274+0000 7f8a5645e700 1 --2- 172.21.15.38:0/2181292976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a50146cf0 0x7f8a50143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:24.282 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.274+0000 7f8a55c5d700 1 --2- 172.21.15.38:0/2181292976 >> v2:172.21.15.150:3300/0 conn(0x7f8a501401f0 0x7f8a5009cf10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8a40002f30 tx=0x7f8a40007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.282 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.274+0000 7f8a55c5d700 1 --2- 172.21.15.38:0/2181292976 >> v2:172.21.15.150:3300/0 conn(0x7f8a501401f0 0x7f8a5009cf10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8a40002f30 tx=0x7f8a40007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.282 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.274+0000 7f8a55c5d700 1 --2- 172.21.15.38:0/2181292976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a501401f0 0x7f8a5009cf10 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f8a40002f30 tx=0x7f8a40007e60).ready entity=mon.1 client_cookie=805a68565d887a0f server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:24.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.274+0000 7f8a55c5d700 1 --2- 172.21.15.38:0/2181292976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a501401f0 0x7f8a5009cf10 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f8a40002f30 tx=0x7f8a40007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.274+0000 7f8a54c5b700 1 -- 172.21.15.38:0/2181292976 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a40011380 con 0x7f8a501401f0 2020-06-12T17:48:24.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.274+0000 7f8a55c5d700 1 --2- 172.21.15.38:0/2181292976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a501401f0 0x7f8a5009cf10 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f8a40002f30 tx=0x7f8a40007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.274+0000 7f8a55c5d700 1 --2- 172.21.15.38:0/2181292976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a501401f0 0x7f8a5009cf10 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f8a40002f30 tx=0x7f8a40007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.274+0000 7f8a54c5b700 1 -- 172.21.15.38:0/2181292976 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a400114e0 con 0x7f8a501401f0 2020-06-12T17:48:24.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.274+0000 7f8a54c5b700 1 -- 172.21.15.38:0/2181292976 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a400118c0 con 0x7f8a501401f0 2020-06-12T17:48:24.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.274+0000 7f8a57ec1700 1 -- 172.21.15.38:0/2181292976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a501401f0 msgr2=0x7f8a5009cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:24.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.274+0000 7f8a57ec1700 1 --2- 172.21.15.38:0/2181292976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a501401f0 0x7f8a5009cf10 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f8a40002f30 tx=0x7f8a40007e60).stop 2020-06-12T17:48:24.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.275+0000 7f8a57ec1700 1 -- 172.21.15.38:0/2181292976 shutdown_connections 2020-06-12T17:48:24.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.275+0000 7f8a57ec1700 1 --2- 172.21.15.38:0/2181292976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a50146cf0 0x7f8a50143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:24.285 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.275+0000 7f8a57ec1700 1 --2- 172.21.15.38:0/2181292976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a501401f0 0x7f8a5009cf10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:24.285 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.275+0000 7f8a57ec1700 1 -- 172.21.15.38:0/2181292976 >> 172.21.15.38:0/2181292976 conn(0x7f8a500b8410 msgr2=0x7f8a500b8820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:24.285 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.275+0000 7f8a57ec1700 1 -- 172.21.15.38:0/2181292976 shutdown_connections 2020-06-12T17:48:24.285 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.275+0000 7f8a57ec1700 1 -- 172.21.15.38:0/2181292976 wait complete. 2020-06-12T17:48:24.290 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.276+0000 7f8a57ec1700 1 Processor -- start 2020-06-12T17:48:24.291 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.276+0000 7f8a57ec1700 1 -- start start 2020-06-12T17:48:24.291 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.276+0000 7f8a57ec1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8a501401f0 0x7f8a50144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:24.291 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.276+0000 7f8a57ec1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a50146cf0 0x7f8a50065dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:24.292 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.276+0000 7f8a57ec1700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a50145350 con 0x7f8a500adaf0 2020-06-12T17:48:24.292 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.276+0000 7f8a57ec1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a50066220 con 0x7f8a501401f0 2020-06-12T17:48:24.292 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.276+0000 7f8a57ec1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500aff30 con 0x7f8a50146cf0 2020-06-12T17:48:24.292 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.276+0000 7f8a55c5d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8a500adaf0 0x7f8a50136ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37722/0 (socket says 172.21.15.38:37722) 2020-06-12T17:48:24.292 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.276+0000 7f8a55c5d700 1 -- 172.21.15.38:0/3432029021 learned_addr learned my addr 172.21.15.38:0/3432029021 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:24.292 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.277+0000 7f8a5545c700 1 --2- 172.21.15.38:0/3432029021 >> v2:172.21.15.150:3300/0 conn(0x7f8a501401f0 0x7f8a50144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:24.293 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.277+0000 7f8a5645e700 1 --2- 172.21.15.38:0/3432029021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a50146cf0 0x7f8a50065dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:24.293 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.277+0000 7f8a3effd700 1 -- 172.21.15.38:0/3432029021 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1005358100 0 0) 0x7f8a500adf80 con 0x7f8a500adaf0 2020-06-12T17:48:24.293 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.277+0000 7f8a3effd700 1 -- 172.21.15.38:0/3432029021 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a30002fe0 con 0x7f8a500adaf0 2020-06-12T17:48:24.293 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.277+0000 7f8a3effd700 1 -- 172.21.15.38:0/3432029021 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 130694250 0 0) 0x7f8a30002fe0 con 0x7f8a500adaf0 2020-06-12T17:48:24.293 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.277+0000 7f8a3effd700 1 -- 172.21.15.38:0/3432029021 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8a500adf80 con 0x7f8a500adaf0 2020-06-12T17:48:24.294 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.277+0000 7f8a3effd700 1 -- 172.21.15.38:0/3432029021 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f8a40008e10 con 0x7f8a500adaf0 2020-06-12T17:48:24.294 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.277+0000 7f8a5645e700 1 -- 172.21.15.38:0/3432029021 >> v2:172.21.15.150:3300/0 conn(0x7f8a501401f0 msgr2=0x7f8a50144ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:24.294 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.277+0000 7f8a5645e700 1 --2- 172.21.15.38:0/3432029021 >> v2:172.21.15.150:3300/0 conn(0x7f8a501401f0 0x7f8a50144ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:24.294 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.277+0000 7f8a5645e700 1 -- 172.21.15.38:0/3432029021 >> v1:172.21.15.38:6789/0 conn(0x7f8a500adaf0 legacy=0x7f8a50136ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:24.294 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.277+0000 7f8a5645e700 1 -- 172.21.15.38:0/3432029021 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a500b0190 con 0x7f8a50146cf0 2020-06-12T17:48:24.295 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.277+0000 7f8a5545c700 1 --2- 172.21.15.38:0/3432029021 >> v2:172.21.15.150:3300/0 conn(0x7f8a501401f0 0x7f8a50144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:24.295 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.277+0000 7f8a5645e700 1 --2- 172.21.15.38:0/3432029021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a50146cf0 0x7f8a50065dc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8a480032b0 tx=0x7f8a480081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.295 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.277+0000 7f8a5645e700 1 --2- 172.21.15.38:0/3432029021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a50146cf0 0x7f8a50065dc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8a480032b0 tx=0x7f8a480081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.295 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.277+0000 7f8a5645e700 1 --2- 172.21.15.38:0/3432029021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a50146cf0 0x7f8a50065dc0 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f8a480032b0 tx=0x7f8a480081e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:24.295 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.277+0000 7f8a5645e700 1 --2- 172.21.15.38:0/3432029021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a50146cf0 0x7f8a50065dc0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f8a480032b0 tx=0x7f8a480081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.296 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.277+0000 7f8a3effd700 1 -- 172.21.15.38:0/3432029021 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a48007160 con 0x7f8a50146cf0 2020-06-12T17:48:24.296 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.277+0000 7f8a5645e700 1 --2- 172.21.15.38:0/3432029021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a50146cf0 0x7f8a50065dc0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f8a480032b0 tx=0x7f8a480081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.296 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.277+0000 7f8a3effd700 1 -- 172.21.15.38:0/3432029021 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a480072c0 con 0x7f8a50146cf0 2020-06-12T17:48:24.296 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.277+0000 7f8a5645e700 1 --2- 172.21.15.38:0/3432029021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a50146cf0 0x7f8a50065dc0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f8a480032b0 tx=0x7f8a480081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.296 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.277+0000 7f8a57ec1700 1 -- 172.21.15.38:0/3432029021 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a501371d0 con 0x7f8a50146cf0 2020-06-12T17:48:24.297 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.277+0000 7f8a3effd700 1 -- 172.21.15.38:0/3432029021 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a48007660 con 0x7f8a50146cf0 2020-06-12T17:48:24.297 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.277+0000 7f8a57ec1700 1 -- 172.21.15.38:0/3432029021 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a501457d0 con 0x7f8a50146cf0 2020-06-12T17:48:24.297 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.278+0000 7f8a5645e700 1 --2- 172.21.15.38:0/3432029021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a50146cf0 0x7f8a50065dc0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f8a480032b0 tx=0x7f8a480081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.297 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.279+0000 7f8a57ec1700 1 -- 172.21.15.38:0/3432029021 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a50056c30 con 0x7f8a50146cf0 2020-06-12T17:48:24.297 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.279+0000 7f8a3effd700 1 -- 172.21.15.38:0/3432029021 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f8a4800e180 con 0x7f8a50146cf0 2020-06-12T17:48:24.298 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.279+0000 7f8a5645e700 1 --2- 172.21.15.38:0/3432029021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a50146cf0 0x7f8a50065dc0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f8a480032b0 tx=0x7f8a480081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.298 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.279+0000 7f8a3effd700 1 --2- 172.21.15.38:0/3432029021 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8a3004db10 0x7f8a3004ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:24.298 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.279+0000 7f8a3effd700 1 -- 172.21.15.38:0/3432029021 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f8a48060c40 con 0x7f8a50146cf0 2020-06-12T17:48:24.298 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.279+0000 7f8a55c5d700 1 --2- 172.21.15.38:0/3432029021 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8a3004db10 0x7f8a3004ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:24.298 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.279+0000 7f8a55c5d700 1 --2- 172.21.15.38:0/3432029021 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8a3004db10 0x7f8a3004ffd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8a400082e0 tx=0x7f8a40007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.298 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.279+0000 7f8a55c5d700 1 --2- 172.21.15.38:0/3432029021 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8a3004db10 0x7f8a3004ffd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8a400082e0 tx=0x7f8a40007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.299 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.279+0000 7f8a55c5d700 1 --2- 172.21.15.38:0/3432029021 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8a3004db10 0x7f8a3004ffd0 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f8a400082e0 tx=0x7f8a40007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:24.299 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.283+0000 7f8a5645e700 1 --2- 172.21.15.38:0/3432029021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a50146cf0 0x7f8a50065dc0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f8a480032b0 tx=0x7f8a480081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.299 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.283+0000 7f8a3effd700 1 -- 172.21.15.38:0/3432029021 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f8a4803c320 con 0x7f8a50146cf0 2020-06-12T17:48:24.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.434+0000 7f8a57ec1700 1 -- 172.21.15.38:0/3432029021 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f8a5005bbd0 con 0x7f8a50146cf0 2020-06-12T17:48:24.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.435+0000 7f8a5645e700 1 --2- 172.21.15.38:0/3432029021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a50146cf0 0x7f8a50065dc0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f8a480032b0 tx=0x7f8a480081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.435+0000 7f8a3effd700 1 -- 172.21.15.38:0/3432029021 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8a4800e410 con 0x7f8a50146cf0 2020-06-12T17:48:24.439 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2020-06-12T17:48:24.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.436+0000 7f8a57ec1700 1 -- 172.21.15.38:0/3432029021 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8a3004db10 msgr2=0x7f8a3004ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:24.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.436+0000 7f8a57ec1700 1 --2- 172.21.15.38:0/3432029021 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8a3004db10 0x7f8a3004ffd0 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f8a400082e0 tx=0x7f8a40007e60).stop 2020-06-12T17:48:24.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.436+0000 7f8a57ec1700 1 -- 172.21.15.38:0/3432029021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a50146cf0 msgr2=0x7f8a50065dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:24.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.436+0000 7f8a57ec1700 1 --2- 172.21.15.38:0/3432029021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a50146cf0 0x7f8a50065dc0 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f8a480032b0 tx=0x7f8a480081e0).stop 2020-06-12T17:48:24.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.436+0000 7f8a57ec1700 1 -- 172.21.15.38:0/3432029021 shutdown_connections 2020-06-12T17:48:24.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.436+0000 7f8a57ec1700 1 --2- 172.21.15.38:0/3432029021 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8a3004db10 0x7f8a3004ffd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:24.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.436+0000 7f8a57ec1700 1 --2- 172.21.15.38:0/3432029021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a50146cf0 0x7f8a50065dc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:24.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.436+0000 7f8a57ec1700 1 --2- 172.21.15.38:0/3432029021 >> v2:172.21.15.150:3300/0 conn(0x7f8a501401f0 0x7f8a50144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:24.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.436+0000 7f8a57ec1700 1 -- 172.21.15.38:0/3432029021 >> 172.21.15.38:0/3432029021 conn(0x7f8a500b8410 msgr2=0x7f8a50142dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:24.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.436+0000 7f8a57ec1700 1 -- 172.21.15.38:0/3432029021 shutdown_connections 2020-06-12T17:48:24.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.437+0000 7f8a57ec1700 1 -- 172.21.15.38:0/3432029021 wait complete. 2020-06-12T17:48:24.450 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2020-06-12T17:48:24.450 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-06-12T17:48:24.451 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-12T17:48:24.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.563+0000 7f6f78b6f700 1 Processor -- start 2020-06-12T17:48:24.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.563+0000 7f6f78b6f700 1 -- start start 2020-06-12T17:48:24.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.564+0000 7f6f78b6f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6f74143470 0x7f6f74143850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:24.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.564+0000 7f6f78b6f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f74146ae0 0x7f6f7409fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:24.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.564+0000 7f6f78b6f700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f740a0f90 con 0x7f6f740a1970 2020-06-12T17:48:24.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.564+0000 7f6f78b6f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f740a1230 con 0x7f6f74143470 2020-06-12T17:48:24.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.564+0000 7f6f78b6f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f740a14d0 con 0x7f6f74146ae0 2020-06-12T17:48:24.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.564+0000 7f6f71d9b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6f740a1970 0x7f6f740bcf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37732/0 (socket says 172.21.15.38:37732) 2020-06-12T17:48:24.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.564+0000 7f6f71d9b700 1 -- 172.21.15.38:0/2746829984 learned_addr learned my addr 172.21.15.38:0/2746829984 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:24.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.564+0000 7f6f72d9d700 1 --2- 172.21.15.38:0/2746829984 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f74146ae0 0x7f6f7409fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:24.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.564+0000 7f6f7259c700 1 --2- 172.21.15.38:0/2746829984 >> v2:172.21.15.150:3300/0 conn(0x7f6f74143470 0x7f6f74143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:24.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.564+0000 7f6f7259c700 1 -- 172.21.15.38:0/2746829984 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f74146ae0 msgr2=0x7f6f7409fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:24.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.564+0000 7f6f7259c700 1 --2- 172.21.15.38:0/2746829984 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f74146ae0 0x7f6f7409fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:24.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.564+0000 7f6f7259c700 1 -- 172.21.15.38:0/2746829984 >> v1:172.21.15.38:6789/0 conn(0x7f6f740a1970 legacy=0x7f6f740bcf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:24.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.564+0000 7f6f7259c700 1 -- 172.21.15.38:0/2746829984 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f740a0cd0 con 0x7f6f74143470 2020-06-12T17:48:24.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.564+0000 7f6f72d9d700 1 --2- 172.21.15.38:0/2746829984 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f74146ae0 0x7f6f7409fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:24.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.564+0000 7f6f7259c700 1 --2- 172.21.15.38:0/2746829984 >> v2:172.21.15.150:3300/0 conn(0x7f6f74143470 0x7f6f74143850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6f64002f30 tx=0x7f6f64007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.564+0000 7f6f7259c700 1 --2- 172.21.15.38:0/2746829984 >> v2:172.21.15.150:3300/0 conn(0x7f6f74143470 0x7f6f74143850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6f64002f30 tx=0x7f6f64007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.564+0000 7f6f7259c700 1 --2- 172.21.15.38:0/2746829984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f74143470 0x7f6f74143850 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f6f64002f30 tx=0x7f6f64007e60).ready entity=mon.1 client_cookie=2e4d1df4d89fba9d server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:24.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.567+0000 7f6f7259c700 1 --2- 172.21.15.38:0/2746829984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f74143470 0x7f6f74143850 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f6f64002f30 tx=0x7f6f64007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.567+0000 7f6f7259c700 1 --2- 172.21.15.38:0/2746829984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f74143470 0x7f6f74143850 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f6f64002f30 tx=0x7f6f64007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.567+0000 7f6f7259c700 1 --2- 172.21.15.38:0/2746829984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f74143470 0x7f6f74143850 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f6f64002f30 tx=0x7f6f64007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.567+0000 7f6f7159a700 1 -- 172.21.15.38:0/2746829984 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f64011380 con 0x7f6f74143470 2020-06-12T17:48:24.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.567+0000 7f6f7159a700 1 -- 172.21.15.38:0/2746829984 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f640114e0 con 0x7f6f74143470 2020-06-12T17:48:24.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.567+0000 7f6f78b6f700 1 -- 172.21.15.38:0/2746829984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f74143470 msgr2=0x7f6f74143850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:24.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.567+0000 7f6f7159a700 1 -- 172.21.15.38:0/2746829984 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f640118c0 con 0x7f6f74143470 2020-06-12T17:48:24.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.567+0000 7f6f78b6f700 1 --2- 172.21.15.38:0/2746829984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f74143470 0x7f6f74143850 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f6f64002f30 tx=0x7f6f64007e60).stop 2020-06-12T17:48:24.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.568+0000 7f6f78b6f700 1 -- 172.21.15.38:0/2746829984 shutdown_connections 2020-06-12T17:48:24.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.568+0000 7f6f78b6f700 1 --2- 172.21.15.38:0/2746829984 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f74146ae0 0x7f6f7409fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:24.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.568+0000 7f6f78b6f700 1 --2- 172.21.15.38:0/2746829984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f74143470 0x7f6f74143850 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:24.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.568+0000 7f6f78b6f700 1 -- 172.21.15.38:0/2746829984 >> 172.21.15.38:0/2746829984 conn(0x7f6f74066040 msgr2=0x7f6f740bc840 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:24.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.568+0000 7f6f78b6f700 1 -- 172.21.15.38:0/2746829984 shutdown_connections 2020-06-12T17:48:24.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.568+0000 7f6f78b6f700 1 -- 172.21.15.38:0/2746829984 wait complete. 2020-06-12T17:48:24.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.569+0000 7f6f78b6f700 1 Processor -- start 2020-06-12T17:48:24.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.569+0000 7f6f78b6f700 1 -- start start 2020-06-12T17:48:24.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.569+0000 7f6f78b6f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6f74143470 0x7f6f741578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:24.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.569+0000 7f6f78b6f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6f74146ae0 0x7f6f7405b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:24.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.569+0000 7f6f78b6f700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f7405bca0 con 0x7f6f740a1970 2020-06-12T17:48:24.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.569+0000 7f6f78b6f700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7409baf0 con 0x7f6f74146ae0 2020-06-12T17:48:24.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.569+0000 7f6f78b6f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7409bd90 con 0x7f6f74143470 2020-06-12T17:48:24.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.570+0000 7f6f72d9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6f74146ae0 0x7f6f7405b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:24.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.570+0000 7f6f72d9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6f74146ae0 0x7f6f7405b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35924/0 (socket says 172.21.15.38:35924) 2020-06-12T17:48:24.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.570+0000 7f6f72d9d700 1 -- 172.21.15.38:0/1486739836 learned_addr learned my addr 172.21.15.38:0/1486739836 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:24.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.570+0000 7f6f7259c700 1 --1- 172.21.15.38:0/1486739836 >> v1:172.21.15.38:6789/0 conn(0x7f6f740a1970 0x7f6f740b1960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37736/0 (socket says 172.21.15.38:37736) 2020-06-12T17:48:24.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.570+0000 7f6f71d9b700 1 --2- 172.21.15.38:0/1486739836 >> v2:172.21.15.150:3300/0 conn(0x7f6f74143470 0x7f6f741578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:24.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.570+0000 7f6f72d9d700 1 -- 172.21.15.38:0/1486739836 >> v2:172.21.15.150:3300/0 conn(0x7f6f74143470 msgr2=0x7f6f741578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:24.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.570+0000 7f6f72d9d700 1 --2- 172.21.15.38:0/1486739836 >> v2:172.21.15.150:3300/0 conn(0x7f6f74143470 0x7f6f741578c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:24.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.570+0000 7f6f72d9d700 1 -- 172.21.15.38:0/1486739836 >> v1:172.21.15.38:6789/0 conn(0x7f6f740a1970 legacy=0x7f6f740b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:24.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.570+0000 7f6f72d9d700 1 -- 172.21.15.38:0/1486739836 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f740b5740 con 0x7f6f74146ae0 2020-06-12T17:48:24.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.570+0000 7f6f637fe700 1 -- 172.21.15.38:0/1486739836 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1226161698 0 0) 0x7f6f740a0cd0 con 0x7f6f740a1970 2020-06-12T17:48:24.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.570+0000 7f6f72d9d700 1 --2- 172.21.15.38:0/1486739836 >> v2:172.21.15.38:3300/0 conn(0x7f6f74146ae0 0x7f6f7405b840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6f6c0033f0 tx=0x7f6f6c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.570+0000 7f6f72d9d700 1 --2- 172.21.15.38:0/1486739836 >> v2:172.21.15.38:3300/0 conn(0x7f6f74146ae0 0x7f6f7405b840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6f6c0033f0 tx=0x7f6f6c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.570+0000 7f6f72d9d700 1 --2- 172.21.15.38:0/1486739836 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f74146ae0 0x7f6f7405b840 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7f6f6c0033f0 tx=0x7f6f6c0081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:24.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.570+0000 7f6f72d9d700 1 --2- 172.21.15.38:0/1486739836 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f74146ae0 0x7f6f7405b840 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f6f6c0033f0 tx=0x7f6f6c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.570+0000 7f6f637fe700 1 -- 172.21.15.38:0/1486739836 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f6c005e30 con 0x7f6f74146ae0 2020-06-12T17:48:24.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.570+0000 7f6f72d9d700 1 --2- 172.21.15.38:0/1486739836 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f74146ae0 0x7f6f7405b840 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f6f6c0033f0 tx=0x7f6f6c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.570+0000 7f6f78b6f700 1 -- 172.21.15.38:0/1486739836 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f7409b370 con 0x7f6f74146ae0 2020-06-12T17:48:24.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.570+0000 7f6f637fe700 1 -- 172.21.15.38:0/1486739836 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c00cbf0 con 0x7f6f74146ae0 2020-06-12T17:48:24.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.570+0000 7f6f72d9d700 1 --2- 172.21.15.38:0/1486739836 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f74146ae0 0x7f6f7405b840 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f6f6c0033f0 tx=0x7f6f6c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.570+0000 7f6f637fe700 1 -- 172.21.15.38:0/1486739836 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f6c012730 con 0x7f6f74146ae0 2020-06-12T17:48:24.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.570+0000 7f6f78b6f700 1 -- 172.21.15.38:0/1486739836 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f7409b830 con 0x7f6f74146ae0 2020-06-12T17:48:24.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.571+0000 7f6f72d9d700 1 --2- 172.21.15.38:0/1486739836 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f74146ae0 0x7f6f7405b840 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f6f6c0033f0 tx=0x7f6f6c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.571+0000 7f6f72d9d700 1 --2- 172.21.15.38:0/1486739836 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f74146ae0 0x7f6f7405b840 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f6f6c0033f0 tx=0x7f6f6c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.571+0000 7f6f637fe700 1 -- 172.21.15.38:0/1486739836 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f6f6c0129b0 con 0x7f6f74146ae0 2020-06-12T17:48:24.585 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.571+0000 7f6f78b6f700 1 -- 172.21.15.38:0/1486739836 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f74056c30 con 0x7f6f74146ae0 2020-06-12T17:48:24.585 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.571+0000 7f6f637fe700 1 --2- 172.21.15.38:0/1486739836 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6f5004d560 0x7f6f5004fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:24.585 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.571+0000 7f6f637fe700 1 -- 172.21.15.38:0/1486739836 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f6f6c061170 con 0x7f6f74146ae0 2020-06-12T17:48:24.585 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.572+0000 7f6f7259c700 1 --2- 172.21.15.38:0/1486739836 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6f5004d560 0x7f6f5004fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:24.585 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.572+0000 7f6f7259c700 1 --2- 172.21.15.38:0/1486739836 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6f5004d560 0x7f6f5004fa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6f640088e0 tx=0x7f6f64007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.572+0000 7f6f7259c700 1 --2- 172.21.15.38:0/1486739836 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6f5004d560 0x7f6f5004fa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6f640088e0 tx=0x7f6f64007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.572+0000 7f6f7259c700 1 --2- 172.21.15.38:0/1486739836 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6f5004d560 0x7f6f5004fa20 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f6f640088e0 tx=0x7f6f64007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:24.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.575+0000 7f6f72d9d700 1 --2- 172.21.15.38:0/1486739836 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f74146ae0 0x7f6f7405b840 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f6f6c0033f0 tx=0x7f6f6c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.575+0000 7f6f637fe700 1 -- 172.21.15.38:0/1486739836 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f6f6c03c7b0 con 0x7f6f74146ae0 2020-06-12T17:48:24.727 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.723+0000 7f6f78b6f700 1 -- 172.21.15.38:0/1486739836 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f7409c2b0 con 0x7f6f5004d560 2020-06-12T17:48:24.731 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.727+0000 7f6f7259c700 1 --2- 172.21.15.38:0/1486739836 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6f5004d560 0x7f6f5004fa20 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f6f640088e0 tx=0x7f6f64007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.731 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.727+0000 7f6f637fe700 1 -- 172.21.15.38:0/1486739836 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82363 (secure 0 0 0) 0x7f6f7409c2b0 con 0x7f6f5004d560 2020-06-12T17:48:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:24.733 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.728+0000 7f6f78b6f700 1 -- 172.21.15.38:0/1486739836 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6f5004d560 msgr2=0x7f6f5004fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:24.733 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.728+0000 7f6f78b6f700 1 --2- 172.21.15.38:0/1486739836 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6f5004d560 0x7f6f5004fa20 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f6f640088e0 tx=0x7f6f64007e60).stop 2020-06-12T17:48:24.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.728+0000 7f6f78b6f700 1 -- 172.21.15.38:0/1486739836 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f74146ae0 msgr2=0x7f6f7405b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:24.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.728+0000 7f6f78b6f700 1 --2- 172.21.15.38:0/1486739836 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f74146ae0 0x7f6f7405b840 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7f6f6c0033f0 tx=0x7f6f6c0081e0).stop 2020-06-12T17:48:24.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.728+0000 7f6f78b6f700 1 -- 172.21.15.38:0/1486739836 shutdown_connections 2020-06-12T17:48:24.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.728+0000 7f6f78b6f700 1 --2- 172.21.15.38:0/1486739836 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6f5004d560 0x7f6f5004fa20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:24.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.728+0000 7f6f78b6f700 1 --2- 172.21.15.38:0/1486739836 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f74146ae0 0x7f6f7405b840 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:24.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.728+0000 7f6f78b6f700 1 --2- 172.21.15.38:0/1486739836 >> v2:172.21.15.150:3300/0 conn(0x7f6f74143470 0x7f6f741578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:24.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.729+0000 7f6f78b6f700 1 -- 172.21.15.38:0/1486739836 >> 172.21.15.38:0/1486739836 conn(0x7f6f74066040 msgr2=0x7f6f74145a80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:24.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.729+0000 7f6f78b6f700 1 -- 172.21.15.38:0/1486739836 shutdown_connections 2020-06-12T17:48:24.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.729+0000 7f6f78b6f700 1 -- 172.21.15.38:0/1486739836 wait complete. 2020-06-12T17:48:24.735 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2020-06-12T17:48:24.742 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2020-06-12T17:48:23.540822+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390720,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584000,"statfs":{"total":773094113280,"available":764502016000,"internally_reserved":8589934592,"allocated":2097152,"data_stored":829828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.056204"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.633205+0000","last_change":"2020-06-12T17:48:14.628381+0000","last_active":"2020-06-12T17:48:14.633205+0000","last_peered":"2020-06-12T17:48:14.633205+0000","last_clean":"2020-06-12T17:48:14.633205+0000","last_became_active":"2020-06-12T17:48:14.627059+0000","last_became_peered":"2020-06-12T17:48:14.627059+0000","last_unstale":"2020-06-12T17:48:14.633205+0000","last_undegraded":"2020-06-12T17:48:14.633205+0000","last_fullsized":"2020-06-12T17:48:14.633205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_clean_scrub_stamp":"2020-06-12T17:48:13.480108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.487958+0000","last_change":"2020-06-12T17:48:08.536277+0000","last_active":"2020-06-12T17:48:14.487958+0000","last_peered":"2020-06-12T17:48:14.487958+0000","last_clean":"2020-06-12T17:48:14.487958+0000","last_became_active":"2020-06-12T17:48:08.535917+0000","last_became_peered":"2020-06-12T17:48:08.535917+0000","last_unstale":"2020-06-12T17:48:14.487958+0000","last_undegraded":"2020-06-12T17:48:14.487958+0000","last_fullsized":"2020-06-12T17:48:14.487958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_clean_scrub_stamp":"2020-06-12T17:48:07.435220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"24'6","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-06-12T17:48:17.547049+0000","last_change":"2020-06-12T17:48:11.469198+0000","last_active":"2020-06-12T17:48:17.547049+0000","last_peered":"2020-06-12T17:48:17.547049+0000","last_clean":"2020-06-12T17:48:17.547049+0000","last_became_active":"2020-06-12T17:48:11.468741+0000","last_became_peered":"2020-06-12T17:48:11.468741+0000","last_unstale":"2020-06-12T17:48:17.547049+0000","last_undegraded":"2020-06-12T17:48:17.547049+0000","last_fullsized":"2020-06-12T17:48:17.547049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_clean_scrub_stamp":"2020-06-12T17:48:10.453503+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.633601+0000","last_change":"2020-06-12T17:48:14.628483+0000","last_active":"2020-06-12T17:48:14.633601+0000","last_peered":"2020-06-12T17:48:14.633601+0000","last_clean":"2020-06-12T17:48:14.633601+0000","last_became_active":"2020-06-12T17:48:14.627239+0000","last_became_peered":"2020-06-12T17:48:14.627239+0000","last_unstale":"2020-06-12T17:48:14.633601+0000","last_undegraded":"2020-06-12T17:48:14.633601+0000","last_fullsized":"2020-06-12T17:48:14.633601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_clean_scrub_stamp":"2020-06-12T17:48:13.480108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.491260+0000","last_change":"2020-06-12T17:48:08.536895+0000","last_active":"2020-06-12T17:48:14.491260+0000","last_peered":"2020-06-12T17:48:14.491260+0000","last_clean":"2020-06-12T17:48:14.491260+0000","last_became_active":"2020-06-12T17:48:08.536439+0000","last_became_peered":"2020-06-12T17:48:08.536439+0000","last_unstale":"2020-06-12T17:48:14.491260+0000","last_undegraded":"2020-06-12T17:48:14.491260+0000","last_fullsized":"2020-06-12T17:48:14.491260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_clean_scrub_stamp":"2020-06-12T17:48:07.435220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"24'5","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2020-06-12T17:48:17.539237+0000","last_change":"2020-06-12T17:48:11.476215+0000","last_active":"2020-06-12T17:48:17.539237+0000","last_peered":"2020-06-12T17:48:17.539237+0000","last_clean":"2020-06-12T17:48:17.539237+0000","last_became_active":"2020-06-12T17:48:11.475541+0000","last_became_peered":"2020-06-12T17:48:11.475541+0000","last_unstale":"2020-06-12T17:48:17.539237+0000","last_undegraded":"2020-06-12T17:48:17.539237+0000","last_fullsized":"2020-06-12T17:48:17.539237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_clean_scrub_stamp":"2020-06-12T17:48:10.453503+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.634141+0000","last_change":"2020-06-12T17:48:14.632585+0000","last_active":"2020-06-12T17:48:14.634141+0000","last_peered":"2020-06-12T17:48:14.634141+0000","last_clean":"2020-06-12T17:48:14.634141+0000","last_became_active":"2020-06-12T17:48:14.630808+0000","last_became_peered":"2020-06-12T17:48:14.630808+0000","last_unstale":"2020-06-12T17:48:14.634141+0000","last_undegraded":"2020-06-12T17:48:14.634141+0000","last_fullsized":"2020-06-12T17:48:14.634141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_clean_scrub_stamp":"2020-06-12T17:48:13.480108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.624995+0000","last_change":"2020-06-12T17:48:08.452925+0000","last_active":"2020-06-12T17:48:14.624995+0000","last_peered":"2020-06-12T17:48:14.624995+0000","last_clean":"2020-06-12T17:48:14.624995+0000","last_became_active":"2020-06-12T17:48:08.452582+0000","last_became_peered":"2020-06-12T17:48:08.452582+0000","last_unstale":"2020-06-12T17:48:14.624995+0000","last_undegraded":"2020-06-12T17:48:14.624995+0000","last_fullsized":"2020-06-12T17:48:14.624995+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_clean_scrub_stamp":"2020-06-12T17:48:07.435220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"24'8","reported_seq":"20","reported_epoch":"24","state":"active+clean","last_fresh":"2020-06-12T17:48:17.544858+0000","last_change":"2020-06-12T17:48:11.659797+0000","last_active":"2020-06-12T17:48:17.544858+0000","last_peered":"2020-06-12T17:48:17.544858+0000","last_clean":"2020-06-12T17:48:17.544858+0000","last_became_active":"2020-06-12T17:48:11.659241+0000","last_became_peered":"2020-06-12T17:48:11.659241+0000","last_unstale":"2020-06-12T17:48:17.544858+0000","last_undegraded":"2020-06-12T17:48:17.544858+0000","last_fullsized":"2020-06-12T17:48:17.544858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_clean_scrub_stamp":"2020-06-12T17:48:10.453503+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.634616+0000","last_change":"2020-06-12T17:48:14.630680+0000","last_active":"2020-06-12T17:48:14.634616+0000","last_peered":"2020-06-12T17:48:14.634616+0000","last_clean":"2020-06-12T17:48:14.634616+0000","last_became_active":"2020-06-12T17:48:14.629803+0000","last_became_peered":"2020-06-12T17:48:14.629803+0000","last_unstale":"2020-06-12T17:48:14.634616+0000","last_undegraded":"2020-06-12T17:48:14.634616+0000","last_fullsized":"2020-06-12T17:48:14.634616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_clean_scrub_stamp":"2020-06-12T17:48:13.480108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.491262+0000","last_change":"2020-06-12T17:48:08.660698+0000","last_active":"2020-06-12T17:48:14.491262+0000","last_peered":"2020-06-12T17:48:14.491262+0000","last_clean":"2020-06-12T17:48:14.491262+0000","last_became_active":"2020-06-12T17:48:08.660318+0000","last_became_peered":"2020-06-12T17:48:08.660318+0000","last_unstale":"2020-06-12T17:48:14.491262+0000","last_undegraded":"2020-06-12T17:48:14.491262+0000","last_fullsized":"2020-06-12T17:48:14.491262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_clean_scrub_stamp":"2020-06-12T17:48:07.435220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"20","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.624227+0000","last_change":"2020-06-12T17:48:04.416139+0000","last_active":"2020-06-12T17:48:14.624227+0000","last_peered":"2020-06-12T17:48:14.624227+0000","last_clean":"2020-06-12T17:48:14.624227+0000","last_became_active":"2020-06-12T17:48:04.415787+0000","last_became_peered":"2020-06-12T17:48:04.415787+0000","last_unstale":"2020-06-12T17:48:14.624227+0000","last_undegraded":"2020-06-12T17:48:14.624227+0000","last_fullsized":"2020-06-12T17:48:14.624227+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":5,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:47:57.745991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:47:57.745991+0000","last_clean_scrub_stamp":"2020-06-12T17:47:57.745991+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"24'1","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2020-06-12T17:48:15.787693+0000","last_change":"2020-06-12T17:48:11.475144+0000","last_active":"2020-06-12T17:48:15.787693+0000","last_peered":"2020-06-12T17:48:15.787693+0000","last_clean":"2020-06-12T17:48:15.787693+0000","last_became_active":"2020-06-12T17:48:11.474716+0000","last_became_peered":"2020-06-12T17:48:11.474716+0000","last_unstale":"2020-06-12T17:48:15.787693+0000","last_undegraded":"2020-06-12T17:48:15.787693+0000","last_fullsized":"2020-06-12T17:48:15.787693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_clean_scrub_stamp":"2020-06-12T17:48:10.453503+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.631997+0000","last_change":"2020-06-12T17:48:14.630802+0000","last_active":"2020-06-12T17:48:14.631997+0000","last_peered":"2020-06-12T17:48:14.631997+0000","last_clean":"2020-06-12T17:48:14.631997+0000","last_became_active":"2020-06-12T17:48:14.630056+0000","last_became_peered":"2020-06-12T17:48:14.630056+0000","last_unstale":"2020-06-12T17:48:14.631997+0000","last_undegraded":"2020-06-12T17:48:14.631997+0000","last_fullsized":"2020-06-12T17:48:14.631997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_clean_scrub_stamp":"2020-06-12T17:48:13.480108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.491041+0000","last_change":"2020-06-12T17:48:08.455830+0000","last_active":"2020-06-12T17:48:14.491041+0000","last_peered":"2020-06-12T17:48:14.491041+0000","last_clean":"2020-06-12T17:48:14.491041+0000","last_became_active":"2020-06-12T17:48:08.455504+0000","last_became_peered":"2020-06-12T17:48:08.455504+0000","last_unstale":"2020-06-12T17:48:14.491041+0000","last_undegraded":"2020-06-12T17:48:14.491041+0000","last_fullsized":"2020-06-12T17:48:14.491041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_clean_scrub_stamp":"2020-06-12T17:48:07.435220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.488160+0000","last_change":"2020-06-12T17:48:11.475312+0000","last_active":"2020-06-12T17:48:14.488160+0000","last_peered":"2020-06-12T17:48:14.488160+0000","last_clean":"2020-06-12T17:48:14.488160+0000","last_became_active":"2020-06-12T17:48:11.474898+0000","last_became_peered":"2020-06-12T17:48:11.474898+0000","last_unstale":"2020-06-12T17:48:14.488160+0000","last_undegraded":"2020-06-12T17:48:14.488160+0000","last_fullsized":"2020-06-12T17:48:14.488160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_clean_scrub_stamp":"2020-06-12T17:48:10.453503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.633059+0000","last_change":"2020-06-12T17:48:14.627843+0000","last_active":"2020-06-12T17:48:14.633059+0000","last_peered":"2020-06-12T17:48:14.633059+0000","last_clean":"2020-06-12T17:48:14.633059+0000","last_became_active":"2020-06-12T17:48:14.626807+0000","last_became_peered":"2020-06-12T17:48:14.626807+0000","last_unstale":"2020-06-12T17:48:14.633059+0000","last_undegraded":"2020-06-12T17:48:14.633059+0000","last_fullsized":"2020-06-12T17:48:14.633059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_clean_scrub_stamp":"2020-06-12T17:48:13.480108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.491468+0000","last_change":"2020-06-12T17:48:08.455836+0000","last_active":"2020-06-12T17:48:14.491468+0000","last_peered":"2020-06-12T17:48:14.491468+0000","last_clean":"2020-06-12T17:48:14.491468+0000","last_became_active":"2020-06-12T17:48:08.455214+0000","last_became_peered":"2020-06-12T17:48:08.455214+0000","last_unstale":"2020-06-12T17:48:14.491468+0000","last_undegraded":"2020-06-12T17:48:14.491468+0000","last_fullsized":"2020-06-12T17:48:14.491468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_clean_scrub_stamp":"2020-06-12T17:48:07.435220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"24'8","reported_seq":"20","reported_epoch":"24","state":"active+clean","last_fresh":"2020-06-12T17:48:17.544871+0000","last_change":"2020-06-12T17:48:11.471700+0000","last_active":"2020-06-12T17:48:17.544871+0000","last_peered":"2020-06-12T17:48:17.544871+0000","last_clean":"2020-06-12T17:48:17.544871+0000","last_became_active":"2020-06-12T17:48:11.471235+0000","last_became_peered":"2020-06-12T17:48:11.471235+0000","last_unstale":"2020-06-12T17:48:17.544871+0000","last_undegraded":"2020-06-12T17:48:17.544871+0000","last_fullsized":"2020-06-12T17:48:17.544871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_clean_scrub_stamp":"2020-06-12T17:48:10.453503+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.631704+0000","last_change":"2020-06-12T17:48:14.630511+0000","last_active":"2020-06-12T17:48:14.631704+0000","last_peered":"2020-06-12T17:48:14.631704+0000","last_clean":"2020-06-12T17:48:14.631704+0000","last_became_active":"2020-06-12T17:48:14.629921+0000","last_became_peered":"2020-06-12T17:48:14.629921+0000","last_unstale":"2020-06-12T17:48:14.631704+0000","last_undegraded":"2020-06-12T17:48:14.631704+0000","last_fullsized":"2020-06-12T17:48:14.631704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_clean_scrub_stamp":"2020-06-12T17:48:13.480108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'7","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2020-06-12T17:48:17.546852+0000","last_change":"2020-06-12T17:48:11.473205+0000","last_active":"2020-06-12T17:48:17.546852+0000","last_peered":"2020-06-12T17:48:17.546852+0000","last_clean":"2020-06-12T17:48:17.546852+0000","last_became_active":"2020-06-12T17:48:11.472755+0000","last_became_peered":"2020-06-12T17:48:11.472755+0000","last_unstale":"2020-06-12T17:48:17.546852+0000","last_undegraded":"2020-06-12T17:48:17.546852+0000","last_fullsized":"2020-06-12T17:48:17.546852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_clean_scrub_stamp":"2020-06-12T17:48:10.453503+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.491494+0000","last_change":"2020-06-12T17:48:08.475147+0000","last_active":"2020-06-12T17:48:14.491494+0000","last_peered":"2020-06-12T17:48:14.491494+0000","last_clean":"2020-06-12T17:48:14.491494+0000","last_became_active":"2020-06-12T17:48:08.474864+0000","last_became_peered":"2020-06-12T17:48:08.474864+0000","last_unstale":"2020-06-12T17:48:14.491494+0000","last_undegraded":"2020-06-12T17:48:14.491494+0000","last_fullsized":"2020-06-12T17:48:14.491494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_clean_scrub_stamp":"2020-06-12T17:48:07.435220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.634446+0000","last_change":"2020-06-12T17:48:14.630178+0000","last_active":"2020-06-12T17:48:14.634446+0000","last_peered":"2020-06-12T17:48:14.634446+0000","last_clean":"2020-06-12T17:48:14.634446+0000","last_became_active":"2020-06-12T17:48:14.629579+0000","last_became_peered":"2020-06-12T17:48:14.629579+0000","last_unstale":"2020-06-12T17:48:14.634446+0000","last_undegraded":"2020-06-12T17:48:14.634446+0000","last_fullsized":"2020-06-12T17:48:14.634446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_clean_scrub_stamp":"2020-06-12T17:48:13.480108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.491486+0000","last_change":"2020-06-12T17:48:08.475539+0000","last_active":"2020-06-12T17:48:14.491486+0000","last_peered":"2020-06-12T17:48:14.491486+0000","last_clean":"2020-06-12T17:48:14.491486+0000","last_became_active":"2020-06-12T17:48:08.475028+0000","last_became_peered":"2020-06-12T17:48:08.475028+0000","last_unstale":"2020-06-12T17:48:14.491486+0000","last_undegraded":"2020-06-12T17:48:14.491486+0000","last_fullsized":"2020-06-12T17:48:14.491486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_clean_scrub_stamp":"2020-06-12T17:48:07.435220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'3","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2020-06-12T17:48:17.539180+0000","last_change":"2020-06-12T17:48:11.659741+0000","last_active":"2020-06-12T17:48:17.539180+0000","last_peered":"2020-06-12T17:48:17.539180+0000","last_clean":"2020-06-12T17:48:17.539180+0000","last_became_active":"2020-06-12T17:48:11.658991+0000","last_became_peered":"2020-06-12T17:48:11.658991+0000","last_unstale":"2020-06-12T17:48:17.539180+0000","last_undegraded":"2020-06-12T17:48:17.539180+0000","last_fullsized":"2020-06-12T17:48:17.539180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_clean_scrub_stamp":"2020-06-12T17:48:10.453503+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":103157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":105409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":103157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":103191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.395}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6859999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":103351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.429}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":103157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4890000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":103723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6060000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.663}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":104683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]}]}]}} 2020-06-12T17:48:24.744 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-12T17:48:24.859 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.856+0000 7f0fae73e700 1 Processor -- start 2020-06-12T17:48:24.859 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.856+0000 7f0fae73e700 1 -- start start 2020-06-12T17:48:24.862 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.856+0000 7f0fae73e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fa8061a80 0x7f0fa809bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:24.862 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.856+0000 7f0fae73e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0fa80b44a0 0x7f0fa81427b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:24.862 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.856+0000 7f0fae73e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa80b2dc0 con 0x7f0fa8142350 2020-06-12T17:48:24.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.856+0000 7f0fae73e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa809e560 con 0x7f0fa80b44a0 2020-06-12T17:48:24.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.856+0000 7f0fae73e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa80b29d0 con 0x7f0fa8061a80 2020-06-12T17:48:24.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.857+0000 7f0fa7fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fa8061a80 0x7f0fa809bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:24.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.857+0000 7f0faccdb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0fa80b44a0 0x7f0fa81427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:24.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.857+0000 7f0fa77fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f0fa8142350 0x7f0fa8146380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:58476/0 (socket says 172.21.15.38:58476) 2020-06-12T17:48:24.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.857+0000 7f0fa77fe700 1 -- 172.21.15.38:0/1650732403 learned_addr learned my addr 172.21.15.38:0/1650732403 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:24.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.857+0000 7f0fa7fff700 1 -- 172.21.15.38:0/1650732403 >> v2:172.21.15.150:3300/0 conn(0x7f0fa80b44a0 msgr2=0x7f0fa81427b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:24.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.857+0000 7f0fa7fff700 1 --2- 172.21.15.38:0/1650732403 >> v2:172.21.15.150:3300/0 conn(0x7f0fa80b44a0 0x7f0fa81427b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:24.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.857+0000 7f0fa7fff700 1 -- 172.21.15.38:0/1650732403 >> v1:172.21.15.150:6789/0 conn(0x7f0fa8142350 legacy=0x7f0fa8146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:24.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.857+0000 7f0fa7fff700 1 -- 172.21.15.38:0/1650732403 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa80b2ff0 con 0x7f0fa8061a80 2020-06-12T17:48:24.865 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.857+0000 7f0fa6ffd700 1 -- 172.21.15.38:0/1650732403 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797996951 0 0) 0x7f0fa80b2dc0 con 0x7f0fa8142350 2020-06-12T17:48:24.865 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.857+0000 7f0faccdb700 1 --2- 172.21.15.38:0/1650732403 >> v2:172.21.15.150:3300/0 conn(0x7f0fa80b44a0 0x7f0fa81427b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:24.865 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.857+0000 7f0fa7fff700 1 --2- 172.21.15.38:0/1650732403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fa8061a80 0x7f0fa809bee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0f98002f30 tx=0x7f0f98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.865 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.857+0000 7f0fa7fff700 1 --2- 172.21.15.38:0/1650732403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fa8061a80 0x7f0fa809bee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0f98002f30 tx=0x7f0f98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.865 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.857+0000 7f0fa7fff700 1 --2- 172.21.15.38:0/1650732403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fa8061a80 0x7f0fa809bee0 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7f0f98002f30 tx=0x7f0f98007e60).ready entity=mon.2 client_cookie=5547a9f352b018f6 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:24.866 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.857+0000 7f0fa7fff700 1 --2- 172.21.15.38:0/1650732403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fa8061a80 0x7f0fa809bee0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f0f98002f30 tx=0x7f0f98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.866 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.857+0000 7f0fa6ffd700 1 -- 172.21.15.38:0/1650732403 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f98011380 con 0x7f0fa8061a80 2020-06-12T17:48:24.866 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.858+0000 7f0fa7fff700 1 --2- 172.21.15.38:0/1650732403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fa8061a80 0x7f0fa809bee0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f0f98002f30 tx=0x7f0f98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.866 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.858+0000 7f0fa7fff700 1 --2- 172.21.15.38:0/1650732403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fa8061a80 0x7f0fa809bee0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f0f98002f30 tx=0x7f0f98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.866 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.858+0000 7f0fa6ffd700 1 -- 172.21.15.38:0/1650732403 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f980114e0 con 0x7f0fa8061a80 2020-06-12T17:48:24.866 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.858+0000 7f0fa6ffd700 1 -- 172.21.15.38:0/1650732403 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f980118c0 con 0x7f0fa8061a80 2020-06-12T17:48:24.867 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.858+0000 7f0fae73e700 1 -- 172.21.15.38:0/1650732403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fa8061a80 msgr2=0x7f0fa809bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:24.867 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.858+0000 7f0fae73e700 1 --2- 172.21.15.38:0/1650732403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fa8061a80 0x7f0fa809bee0 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7f0f98002f30 tx=0x7f0f98007e60).stop 2020-06-12T17:48:24.867 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.858+0000 7f0fae73e700 1 -- 172.21.15.38:0/1650732403 shutdown_connections 2020-06-12T17:48:24.867 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.858+0000 7f0fae73e700 1 --2- 172.21.15.38:0/1650732403 >> v2:172.21.15.150:3300/0 conn(0x7f0fa80b44a0 0x7f0fa81427b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:24.867 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.858+0000 7f0fae73e700 1 --2- 172.21.15.38:0/1650732403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fa8061a80 0x7f0fa809bee0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:24.868 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.858+0000 7f0fae73e700 1 -- 172.21.15.38:0/1650732403 >> 172.21.15.38:0/1650732403 conn(0x7f0fa80b8420 msgr2=0x7f0fa80b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:24.868 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.858+0000 7f0fae73e700 1 -- 172.21.15.38:0/1650732403 shutdown_connections 2020-06-12T17:48:24.868 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.858+0000 7f0fae73e700 1 -- 172.21.15.38:0/1650732403 wait complete. 2020-06-12T17:48:24.871 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.859+0000 7f0fae73e700 1 Processor -- start 2020-06-12T17:48:24.871 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.859+0000 7f0fae73e700 1 -- start start 2020-06-12T17:48:24.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.860+0000 7f0fae73e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0fa8061a80 0x7f0fa80ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:24.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.860+0000 7f0fae73e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0fa80b44a0 0x7f0fa8150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:24.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.860+0000 7f0fae73e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fa8142350 0x7f0fa814f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:24.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.860+0000 7f0fae73e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa80668c0 con 0x7f0fa80b44a0 2020-06-12T17:48:24.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.860+0000 7f0fae73e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa80add20 con 0x7f0fa8061a80 2020-06-12T17:48:24.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.860+0000 7f0fae73e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa8066380 con 0x7f0fa8142350 2020-06-12T17:48:24.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.860+0000 7f0fa77fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0fa80b44a0 0x7f0fa8150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:24.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.860+0000 7f0fa77fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0fa80b44a0 0x7f0fa8150b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35934/0 (socket says 172.21.15.38:35934) 2020-06-12T17:48:24.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.860+0000 7f0fa77fe700 1 -- 172.21.15.38:0/3587464236 learned_addr learned my addr 172.21.15.38:0/3587464236 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:24.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.860+0000 7f0faccdb700 1 --2- 172.21.15.38:0/3587464236 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fa8142350 0x7f0fa814f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:24.874 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.860+0000 7f0fa7fff700 1 --2- 172.21.15.38:0/3587464236 >> v2:172.21.15.150:3300/0 conn(0x7f0fa8061a80 0x7f0fa80ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:24.874 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.860+0000 7f0fa77fe700 1 -- 172.21.15.38:0/3587464236 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fa8142350 msgr2=0x7f0fa814f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:24.874 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.860+0000 7f0fa77fe700 1 --2- 172.21.15.38:0/3587464236 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fa8142350 0x7f0fa814f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:24.874 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.860+0000 7f0fa77fe700 1 -- 172.21.15.38:0/3587464236 >> v2:172.21.15.150:3300/0 conn(0x7f0fa8061a80 msgr2=0x7f0fa80ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:24.874 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.860+0000 7f0fa77fe700 1 --2- 172.21.15.38:0/3587464236 >> v2:172.21.15.150:3300/0 conn(0x7f0fa8061a80 0x7f0fa80ad8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:24.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.860+0000 7f0fa77fe700 1 -- 172.21.15.38:0/3587464236 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa8066620 con 0x7f0fa80b44a0 2020-06-12T17:48:24.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.860+0000 7f0fa77fe700 1 --2- 172.21.15.38:0/3587464236 >> v2:172.21.15.38:3300/0 conn(0x7f0fa80b44a0 0x7f0fa8150b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0f9c000b80 tx=0x7f0f9c0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.860+0000 7f0fa77fe700 1 --2- 172.21.15.38:0/3587464236 >> v2:172.21.15.38:3300/0 conn(0x7f0fa80b44a0 0x7f0fa8150b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0f9c000b80 tx=0x7f0f9c0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.860+0000 7f0fa77fe700 1 --2- 172.21.15.38:0/3587464236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0fa80b44a0 0x7f0fa8150b20 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7f0f9c000b80 tx=0x7f0f9c0017a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:24.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.861+0000 7f0fa77fe700 1 --2- 172.21.15.38:0/3587464236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0fa80b44a0 0x7f0fa8150b20 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f0f9c000b80 tx=0x7f0f9c0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.861+0000 7f0fa57fa700 1 -- 172.21.15.38:0/3587464236 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f9c00ca40 con 0x7f0fa80b44a0 2020-06-12T17:48:24.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.861+0000 7f0fa77fe700 1 --2- 172.21.15.38:0/3587464236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0fa80b44a0 0x7f0fa8150b20 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f0f9c000b80 tx=0x7f0f9c0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.861+0000 7f0fa57fa700 1 -- 172.21.15.38:0/3587464236 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9c00cba0 con 0x7f0fa80b44a0 2020-06-12T17:48:24.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.861+0000 7f0fa77fe700 1 --2- 172.21.15.38:0/3587464236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0fa80b44a0 0x7f0fa8150b20 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f0f9c000b80 tx=0x7f0f9c0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.861+0000 7f0fae73e700 1 -- 172.21.15.38:0/3587464236 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa8150f80 con 0x7f0fa80b44a0 2020-06-12T17:48:24.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.861+0000 7f0fa57fa700 1 -- 172.21.15.38:0/3587464236 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f9c00d0c0 con 0x7f0fa80b44a0 2020-06-12T17:48:24.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.861+0000 7f0fae73e700 1 -- 172.21.15.38:0/3587464236 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa8064cb0 con 0x7f0fa80b44a0 2020-06-12T17:48:24.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.861+0000 7f0fa77fe700 1 --2- 172.21.15.38:0/3587464236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0fa80b44a0 0x7f0fa8150b20 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f0f9c000b80 tx=0x7f0f9c0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.862+0000 7f0fae73e700 1 -- 172.21.15.38:0/3587464236 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa8056c30 con 0x7f0fa80b44a0 2020-06-12T17:48:24.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.862+0000 7f0fa57fa700 1 -- 172.21.15.38:0/3587464236 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f0f9c0055c0 con 0x7f0fa80b44a0 2020-06-12T17:48:24.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.862+0000 7f0fa77fe700 1 --2- 172.21.15.38:0/3587464236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0fa80b44a0 0x7f0fa8150b20 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f0f9c000b80 tx=0x7f0f9c0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.862+0000 7f0fa57fa700 1 --2- 172.21.15.38:0/3587464236 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0f8804d5c0 0x7f0f8804fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:24.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.862+0000 7f0fa57fa700 1 -- 172.21.15.38:0/3587464236 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f0f9c060b50 con 0x7f0fa80b44a0 2020-06-12T17:48:24.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.862+0000 7f0fa7fff700 1 --2- 172.21.15.38:0/3587464236 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0f8804d5c0 0x7f0f8804fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:24.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.862+0000 7f0fa7fff700 1 --2- 172.21.15.38:0/3587464236 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0f8804d5c0 0x7f0f8804fa80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0f98002f30 tx=0x7f0f98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.863+0000 7f0fa7fff700 1 --2- 172.21.15.38:0/3587464236 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0f8804d5c0 0x7f0f8804fa80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0f98002f30 tx=0x7f0f98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.863+0000 7f0fa7fff700 1 --2- 172.21.15.38:0/3587464236 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0f8804d5c0 0x7f0f8804fa80 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f0f98002f30 tx=0x7f0f98007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:24.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.865+0000 7f0fa77fe700 1 --2- 172.21.15.38:0/3587464236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0fa80b44a0 0x7f0fa8150b20 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f0f9c000b80 tx=0x7f0f9c0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:24.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:24.866+0000 7f0fa57fa700 1 -- 172.21.15.38:0/3587464236 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f0f9c064e60 con 0x7f0fa80b44a0 2020-06-12T17:48:25.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.011+0000 7f0fae73e700 1 -- 172.21.15.38:0/3587464236 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0fa8151110 con 0x7f0f8804d5c0 2020-06-12T17:48:25.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.015+0000 7f0fa7fff700 1 --2- 172.21.15.38:0/3587464236 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0f8804d5c0 0x7f0f8804fa80 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f0f98002f30 tx=0x7f0f98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.015+0000 7f0fa57fa700 1 -- 172.21.15.38:0/3587464236 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82363 (secure 0 0 0) 0x7f0fa8151110 con 0x7f0f8804d5c0 2020-06-12T17:48:25.020 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:25.021 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.016+0000 7f0fae73e700 1 -- 172.21.15.38:0/3587464236 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0f8804d5c0 msgr2=0x7f0f8804fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:25.021 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.016+0000 7f0fae73e700 1 --2- 172.21.15.38:0/3587464236 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0f8804d5c0 0x7f0f8804fa80 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f0f98002f30 tx=0x7f0f98007e60).stop 2020-06-12T17:48:25.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.016+0000 7f0fae73e700 1 -- 172.21.15.38:0/3587464236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0fa80b44a0 msgr2=0x7f0fa8150b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:25.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.016+0000 7f0fae73e700 1 --2- 172.21.15.38:0/3587464236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0fa80b44a0 0x7f0fa8150b20 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7f0f9c000b80 tx=0x7f0f9c0017a0).stop 2020-06-12T17:48:25.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.016+0000 7f0fae73e700 1 -- 172.21.15.38:0/3587464236 shutdown_connections 2020-06-12T17:48:25.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.016+0000 7f0fae73e700 1 --2- 172.21.15.38:0/3587464236 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0f8804d5c0 0x7f0f8804fa80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:25.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.016+0000 7f0fae73e700 1 --2- 172.21.15.38:0/3587464236 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fa8142350 0x7f0fa814f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:25.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.016+0000 7f0fae73e700 1 --2- 172.21.15.38:0/3587464236 >> v2:172.21.15.150:3300/0 conn(0x7f0fa8061a80 0x7f0fa80ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:25.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.016+0000 7f0fae73e700 1 --2- 172.21.15.38:0/3587464236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0fa80b44a0 0x7f0fa8150b20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:25.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.016+0000 7f0fae73e700 1 -- 172.21.15.38:0/3587464236 >> 172.21.15.38:0/3587464236 conn(0x7f0fa80b8420 msgr2=0x7f0fa813e590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:25.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.016+0000 7f0fae73e700 1 -- 172.21.15.38:0/3587464236 shutdown_connections 2020-06-12T17:48:25.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.016+0000 7f0fae73e700 1 -- 172.21.15.38:0/3587464236 wait complete. 2020-06-12T17:48:25.024 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2020-06-12T17:48:25.030 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2020-06-12T17:48:23.540822+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390720,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584000,"statfs":{"total":773094113280,"available":764502016000,"internally_reserved":8589934592,"allocated":2097152,"data_stored":829828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.056204"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.633205+0000","last_change":"2020-06-12T17:48:14.628381+0000","last_active":"2020-06-12T17:48:14.633205+0000","last_peered":"2020-06-12T17:48:14.633205+0000","last_clean":"2020-06-12T17:48:14.633205+0000","last_became_active":"2020-06-12T17:48:14.627059+0000","last_became_peered":"2020-06-12T17:48:14.627059+0000","last_unstale":"2020-06-12T17:48:14.633205+0000","last_undegraded":"2020-06-12T17:48:14.633205+0000","last_fullsized":"2020-06-12T17:48:14.633205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_clean_scrub_stamp":"2020-06-12T17:48:13.480108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.487958+0000","last_change":"2020-06-12T17:48:08.536277+0000","last_active":"2020-06-12T17:48:14.487958+0000","last_peered":"2020-06-12T17:48:14.487958+0000","last_clean":"2020-06-12T17:48:14.487958+0000","last_became_active":"2020-06-12T17:48:08.535917+0000","last_became_peered":"2020-06-12T17:48:08.535917+0000","last_unstale":"2020-06-12T17:48:14.487958+0000","last_undegraded":"2020-06-12T17:48:14.487958+0000","last_fullsized":"2020-06-12T17:48:14.487958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_clean_scrub_stamp":"2020-06-12T17:48:07.435220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"24'6","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-06-12T17:48:17.547049+0000","last_change":"2020-06-12T17:48:11.469198+0000","last_active":"2020-06-12T17:48:17.547049+0000","last_peered":"2020-06-12T17:48:17.547049+0000","last_clean":"2020-06-12T17:48:17.547049+0000","last_became_active":"2020-06-12T17:48:11.468741+0000","last_became_peered":"2020-06-12T17:48:11.468741+0000","last_unstale":"2020-06-12T17:48:17.547049+0000","last_undegraded":"2020-06-12T17:48:17.547049+0000","last_fullsized":"2020-06-12T17:48:17.547049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_clean_scrub_stamp":"2020-06-12T17:48:10.453503+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.633601+0000","last_change":"2020-06-12T17:48:14.628483+0000","last_active":"2020-06-12T17:48:14.633601+0000","last_peered":"2020-06-12T17:48:14.633601+0000","last_clean":"2020-06-12T17:48:14.633601+0000","last_became_active":"2020-06-12T17:48:14.627239+0000","last_became_peered":"2020-06-12T17:48:14.627239+0000","last_unstale":"2020-06-12T17:48:14.633601+0000","last_undegraded":"2020-06-12T17:48:14.633601+0000","last_fullsized":"2020-06-12T17:48:14.633601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_clean_scrub_stamp":"2020-06-12T17:48:13.480108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.491260+0000","last_change":"2020-06-12T17:48:08.536895+0000","last_active":"2020-06-12T17:48:14.491260+0000","last_peered":"2020-06-12T17:48:14.491260+0000","last_clean":"2020-06-12T17:48:14.491260+0000","last_became_active":"2020-06-12T17:48:08.536439+0000","last_became_peered":"2020-06-12T17:48:08.536439+0000","last_unstale":"2020-06-12T17:48:14.491260+0000","last_undegraded":"2020-06-12T17:48:14.491260+0000","last_fullsized":"2020-06-12T17:48:14.491260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_clean_scrub_stamp":"2020-06-12T17:48:07.435220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"24'5","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2020-06-12T17:48:17.539237+0000","last_change":"2020-06-12T17:48:11.476215+0000","last_active":"2020-06-12T17:48:17.539237+0000","last_peered":"2020-06-12T17:48:17.539237+0000","last_clean":"2020-06-12T17:48:17.539237+0000","last_became_active":"2020-06-12T17:48:11.475541+0000","last_became_peered":"2020-06-12T17:48:11.475541+0000","last_unstale":"2020-06-12T17:48:17.539237+0000","last_undegraded":"2020-06-12T17:48:17.539237+0000","last_fullsized":"2020-06-12T17:48:17.539237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_clean_scrub_stamp":"2020-06-12T17:48:10.453503+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.634141+0000","last_change":"2020-06-12T17:48:14.632585+0000","last_active":"2020-06-12T17:48:14.634141+0000","last_peered":"2020-06-12T17:48:14.634141+0000","last_clean":"2020-06-12T17:48:14.634141+0000","last_became_active":"2020-06-12T17:48:14.630808+0000","last_became_peered":"2020-06-12T17:48:14.630808+0000","last_unstale":"2020-06-12T17:48:14.634141+0000","last_undegraded":"2020-06-12T17:48:14.634141+0000","last_fullsized":"2020-06-12T17:48:14.634141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_clean_scrub_stamp":"2020-06-12T17:48:13.480108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.624995+0000","last_change":"2020-06-12T17:48:08.452925+0000","last_active":"2020-06-12T17:48:14.624995+0000","last_peered":"2020-06-12T17:48:14.624995+0000","last_clean":"2020-06-12T17:48:14.624995+0000","last_became_active":"2020-06-12T17:48:08.452582+0000","last_became_peered":"2020-06-12T17:48:08.452582+0000","last_unstale":"2020-06-12T17:48:14.624995+0000","last_undegraded":"2020-06-12T17:48:14.624995+0000","last_fullsized":"2020-06-12T17:48:14.624995+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_clean_scrub_stamp":"2020-06-12T17:48:07.435220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"24'8","reported_seq":"20","reported_epoch":"24","state":"active+clean","last_fresh":"2020-06-12T17:48:17.544858+0000","last_change":"2020-06-12T17:48:11.659797+0000","last_active":"2020-06-12T17:48:17.544858+0000","last_peered":"2020-06-12T17:48:17.544858+0000","last_clean":"2020-06-12T17:48:17.544858+0000","last_became_active":"2020-06-12T17:48:11.659241+0000","last_became_peered":"2020-06-12T17:48:11.659241+0000","last_unstale":"2020-06-12T17:48:17.544858+0000","last_undegraded":"2020-06-12T17:48:17.544858+0000","last_fullsized":"2020-06-12T17:48:17.544858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_clean_scrub_stamp":"2020-06-12T17:48:10.453503+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.634616+0000","last_change":"2020-06-12T17:48:14.630680+0000","last_active":"2020-06-12T17:48:14.634616+0000","last_peered":"2020-06-12T17:48:14.634616+0000","last_clean":"2020-06-12T17:48:14.634616+0000","last_became_active":"2020-06-12T17:48:14.629803+0000","last_became_peered":"2020-06-12T17:48:14.629803+0000","last_unstale":"2020-06-12T17:48:14.634616+0000","last_undegraded":"2020-06-12T17:48:14.634616+0000","last_fullsized":"2020-06-12T17:48:14.634616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_clean_scrub_stamp":"2020-06-12T17:48:13.480108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.491262+0000","last_change":"2020-06-12T17:48:08.660698+0000","last_active":"2020-06-12T17:48:14.491262+0000","last_peered":"2020-06-12T17:48:14.491262+0000","last_clean":"2020-06-12T17:48:14.491262+0000","last_became_active":"2020-06-12T17:48:08.660318+0000","last_became_peered":"2020-06-12T17:48:08.660318+0000","last_unstale":"2020-06-12T17:48:14.491262+0000","last_undegraded":"2020-06-12T17:48:14.491262+0000","last_fullsized":"2020-06-12T17:48:14.491262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_clean_scrub_stamp":"2020-06-12T17:48:07.435220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"20","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.624227+0000","last_change":"2020-06-12T17:48:04.416139+0000","last_active":"2020-06-12T17:48:14.624227+0000","last_peered":"2020-06-12T17:48:14.624227+0000","last_clean":"2020-06-12T17:48:14.624227+0000","last_became_active":"2020-06-12T17:48:04.415787+0000","last_became_peered":"2020-06-12T17:48:04.415787+0000","last_unstale":"2020-06-12T17:48:14.624227+0000","last_undegraded":"2020-06-12T17:48:14.624227+0000","last_fullsized":"2020-06-12T17:48:14.624227+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":5,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:47:57.745991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:47:57.745991+0000","last_clean_scrub_stamp":"2020-06-12T17:47:57.745991+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"24'1","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2020-06-12T17:48:15.787693+0000","last_change":"2020-06-12T17:48:11.475144+0000","last_active":"2020-06-12T17:48:15.787693+0000","last_peered":"2020-06-12T17:48:15.787693+0000","last_clean":"2020-06-12T17:48:15.787693+0000","last_became_active":"2020-06-12T17:48:11.474716+0000","last_became_peered":"2020-06-12T17:48:11.474716+0000","last_unstale":"2020-06-12T17:48:15.787693+0000","last_undegraded":"2020-06-12T17:48:15.787693+0000","last_fullsized":"2020-06-12T17:48:15.787693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_clean_scrub_stamp":"2020-06-12T17:48:10.453503+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.631997+0000","last_change":"2020-06-12T17:48:14.630802+0000","last_active":"2020-06-12T17:48:14.631997+0000","last_peered":"2020-06-12T17:48:14.631997+0000","last_clean":"2020-06-12T17:48:14.631997+0000","last_became_active":"2020-06-12T17:48:14.630056+0000","last_became_peered":"2020-06-12T17:48:14.630056+0000","last_unstale":"2020-06-12T17:48:14.631997+0000","last_undegraded":"2020-06-12T17:48:14.631997+0000","last_fullsized":"2020-06-12T17:48:14.631997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_clean_scrub_stamp":"2020-06-12T17:48:13.480108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.491041+0000","last_change":"2020-06-12T17:48:08.455830+0000","last_active":"2020-06-12T17:48:14.491041+0000","last_peered":"2020-06-12T17:48:14.491041+0000","last_clean":"2020-06-12T17:48:14.491041+0000","last_became_active":"2020-06-12T17:48:08.455504+0000","last_became_peered":"2020-06-12T17:48:08.455504+0000","last_unstale":"2020-06-12T17:48:14.491041+0000","last_undegraded":"2020-06-12T17:48:14.491041+0000","last_fullsized":"2020-06-12T17:48:14.491041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_clean_scrub_stamp":"2020-06-12T17:48:07.435220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.488160+0000","last_change":"2020-06-12T17:48:11.475312+0000","last_active":"2020-06-12T17:48:14.488160+0000","last_peered":"2020-06-12T17:48:14.488160+0000","last_clean":"2020-06-12T17:48:14.488160+0000","last_became_active":"2020-06-12T17:48:11.474898+0000","last_became_peered":"2020-06-12T17:48:11.474898+0000","last_unstale":"2020-06-12T17:48:14.488160+0000","last_undegraded":"2020-06-12T17:48:14.488160+0000","last_fullsized":"2020-06-12T17:48:14.488160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_clean_scrub_stamp":"2020-06-12T17:48:10.453503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.633059+0000","last_change":"2020-06-12T17:48:14.627843+0000","last_active":"2020-06-12T17:48:14.633059+0000","last_peered":"2020-06-12T17:48:14.633059+0000","last_clean":"2020-06-12T17:48:14.633059+0000","last_became_active":"2020-06-12T17:48:14.626807+0000","last_became_peered":"2020-06-12T17:48:14.626807+0000","last_unstale":"2020-06-12T17:48:14.633059+0000","last_undegraded":"2020-06-12T17:48:14.633059+0000","last_fullsized":"2020-06-12T17:48:14.633059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_clean_scrub_stamp":"2020-06-12T17:48:13.480108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.491468+0000","last_change":"2020-06-12T17:48:08.455836+0000","last_active":"2020-06-12T17:48:14.491468+0000","last_peered":"2020-06-12T17:48:14.491468+0000","last_clean":"2020-06-12T17:48:14.491468+0000","last_became_active":"2020-06-12T17:48:08.455214+0000","last_became_peered":"2020-06-12T17:48:08.455214+0000","last_unstale":"2020-06-12T17:48:14.491468+0000","last_undegraded":"2020-06-12T17:48:14.491468+0000","last_fullsized":"2020-06-12T17:48:14.491468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_clean_scrub_stamp":"2020-06-12T17:48:07.435220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"24'8","reported_seq":"20","reported_epoch":"24","state":"active+clean","last_fresh":"2020-06-12T17:48:17.544871+0000","last_change":"2020-06-12T17:48:11.471700+0000","last_active":"2020-06-12T17:48:17.544871+0000","last_peered":"2020-06-12T17:48:17.544871+0000","last_clean":"2020-06-12T17:48:17.544871+0000","last_became_active":"2020-06-12T17:48:11.471235+0000","last_became_peered":"2020-06-12T17:48:11.471235+0000","last_unstale":"2020-06-12T17:48:17.544871+0000","last_undegraded":"2020-06-12T17:48:17.544871+0000","last_fullsized":"2020-06-12T17:48:17.544871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_clean_scrub_stamp":"2020-06-12T17:48:10.453503+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.631704+0000","last_change":"2020-06-12T17:48:14.630511+0000","last_active":"2020-06-12T17:48:14.631704+0000","last_peered":"2020-06-12T17:48:14.631704+0000","last_clean":"2020-06-12T17:48:14.631704+0000","last_became_active":"2020-06-12T17:48:14.629921+0000","last_became_peered":"2020-06-12T17:48:14.629921+0000","last_unstale":"2020-06-12T17:48:14.631704+0000","last_undegraded":"2020-06-12T17:48:14.631704+0000","last_fullsized":"2020-06-12T17:48:14.631704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_clean_scrub_stamp":"2020-06-12T17:48:13.480108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'7","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2020-06-12T17:48:17.546852+0000","last_change":"2020-06-12T17:48:11.473205+0000","last_active":"2020-06-12T17:48:17.546852+0000","last_peered":"2020-06-12T17:48:17.546852+0000","last_clean":"2020-06-12T17:48:17.546852+0000","last_became_active":"2020-06-12T17:48:11.472755+0000","last_became_peered":"2020-06-12T17:48:11.472755+0000","last_unstale":"2020-06-12T17:48:17.546852+0000","last_undegraded":"2020-06-12T17:48:17.546852+0000","last_fullsized":"2020-06-12T17:48:17.546852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_clean_scrub_stamp":"2020-06-12T17:48:10.453503+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.491494+0000","last_change":"2020-06-12T17:48:08.475147+0000","last_active":"2020-06-12T17:48:14.491494+0000","last_peered":"2020-06-12T17:48:14.491494+0000","last_clean":"2020-06-12T17:48:14.491494+0000","last_became_active":"2020-06-12T17:48:08.474864+0000","last_became_peered":"2020-06-12T17:48:08.474864+0000","last_unstale":"2020-06-12T17:48:14.491494+0000","last_undegraded":"2020-06-12T17:48:14.491494+0000","last_fullsized":"2020-06-12T17:48:14.491494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_clean_scrub_stamp":"2020-06-12T17:48:07.435220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.634446+0000","last_change":"2020-06-12T17:48:14.630178+0000","last_active":"2020-06-12T17:48:14.634446+0000","last_peered":"2020-06-12T17:48:14.634446+0000","last_clean":"2020-06-12T17:48:14.634446+0000","last_became_active":"2020-06-12T17:48:14.629579+0000","last_became_peered":"2020-06-12T17:48:14.629579+0000","last_unstale":"2020-06-12T17:48:14.634446+0000","last_undegraded":"2020-06-12T17:48:14.634446+0000","last_fullsized":"2020-06-12T17:48:14.634446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:13.480108+0000","last_clean_scrub_stamp":"2020-06-12T17:48:13.480108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-06-12T17:48:14.491486+0000","last_change":"2020-06-12T17:48:08.475539+0000","last_active":"2020-06-12T17:48:14.491486+0000","last_peered":"2020-06-12T17:48:14.491486+0000","last_clean":"2020-06-12T17:48:14.491486+0000","last_became_active":"2020-06-12T17:48:08.475028+0000","last_became_peered":"2020-06-12T17:48:08.475028+0000","last_unstale":"2020-06-12T17:48:14.491486+0000","last_undegraded":"2020-06-12T17:48:14.491486+0000","last_fullsized":"2020-06-12T17:48:14.491486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:07.435220+0000","last_clean_scrub_stamp":"2020-06-12T17:48:07.435220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'3","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2020-06-12T17:48:17.539180+0000","last_change":"2020-06-12T17:48:11.659741+0000","last_active":"2020-06-12T17:48:17.539180+0000","last_peered":"2020-06-12T17:48:17.539180+0000","last_clean":"2020-06-12T17:48:17.539180+0000","last_became_active":"2020-06-12T17:48:11.658991+0000","last_became_peered":"2020-06-12T17:48:11.658991+0000","last_unstale":"2020-06-12T17:48:17.539180+0000","last_undegraded":"2020-06-12T17:48:17.539180+0000","last_fullsized":"2020-06-12T17:48:17.539180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T17:48:10.453503+0000","last_clean_scrub_stamp":"2020-06-12T17:48:10.453503+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":103157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":105409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":103157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":103191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.395}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6859999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":103351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.429}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":103157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4890000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":103723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6060000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.663}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":104683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]}]}]}} 2020-06-12T17:48:25.032 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-06-12T17:48:25.033 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-06-12T17:48:25.033 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-06-12T17:48:25.033 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early health --format=json 2020-06-12T17:48:25.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.143+0000 7f31e6848700 1 Processor -- start 2020-06-12T17:48:25.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.143+0000 7f31e6848700 1 -- start start 2020-06-12T17:48:25.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.144+0000 7f31e6848700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f31e009e020 0x7f31e005be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:25.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.144+0000 7f31e6848700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e01448f0 con 0x7f31e009fdd0 2020-06-12T17:48:25.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.144+0000 7f31e6848700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e0144b90 con 0x7f31e009dba0 2020-06-12T17:48:25.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.144+0000 7f31e6848700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e013e380 con 0x7f31e009e020 2020-06-12T17:48:25.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.144+0000 7f31e4de5700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f31e009e020 0x7f31e005be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:25.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.144+0000 7f31e4de5700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f31e009e020 0x7f31e005be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35944/0 (socket says 172.21.15.38:35944) 2020-06-12T17:48:25.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.144+0000 7f31e4de5700 1 -- 172.21.15.38:0/649020088 learned_addr learned my addr 172.21.15.38:0/649020088 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:25.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.144+0000 7f31dffff700 1 --1- 172.21.15.38:0/649020088 >> v1:172.21.15.38:6789/0 conn(0x7f31e009fdd0 0x7f31e00a01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37756/0 (socket says 172.21.15.38:37756) 2020-06-12T17:48:25.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.145+0000 7f31deffd700 1 -- 172.21.15.38:0/649020088 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 391754631 0 0) 0x7f31e01448f0 con 0x7f31e009fdd0 2020-06-12T17:48:25.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.145+0000 7f31deffd700 1 -- 172.21.15.38:0/649020088 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31cc003230 con 0x7f31e009fdd0 2020-06-12T17:48:25.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.145+0000 7f31e4de5700 1 -- 172.21.15.38:0/649020088 >> v1:172.21.15.150:6789/0 conn(0x7f31e009dba0 legacy=0x7f31e005b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:25.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.145+0000 7f31e4de5700 1 -- 172.21.15.38:0/649020088 >> v1:172.21.15.38:6789/0 conn(0x7f31e009fdd0 legacy=0x7f31e00a01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:25.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.145+0000 7f31e4de5700 1 -- 172.21.15.38:0/649020088 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e01445e0 con 0x7f31e009e020 2020-06-12T17:48:25.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.145+0000 7f31e4de5700 1 --2- 172.21.15.38:0/649020088 >> v2:172.21.15.38:3300/0 conn(0x7f31e009e020 0x7f31e005be00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f31d80032b0 tx=0x7f31d80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.145+0000 7f31e4de5700 1 --2- 172.21.15.38:0/649020088 >> v2:172.21.15.38:3300/0 conn(0x7f31e009e020 0x7f31e005be00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f31d80032b0 tx=0x7f31d80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.145+0000 7f31e4de5700 1 --2- 172.21.15.38:0/649020088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31e009e020 0x7f31e005be00 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7f31d80032b0 tx=0x7f31d80081e0).ready entity=mon.0 client_cookie=7f7abf1c29489ebf server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:25.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.145+0000 7f31e4de5700 1 --2- 172.21.15.38:0/649020088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31e009e020 0x7f31e005be00 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f31d80032b0 tx=0x7f31d80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.145+0000 7f31deffd700 1 -- 172.21.15.38:0/649020088 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31d8011ea0 con 0x7f31e009e020 2020-06-12T17:48:25.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.145+0000 7f31e4de5700 1 --2- 172.21.15.38:0/649020088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31e009e020 0x7f31e005be00 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f31d80032b0 tx=0x7f31d80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.145+0000 7f31e4de5700 1 --2- 172.21.15.38:0/649020088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31e009e020 0x7f31e005be00 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f31d80032b0 tx=0x7f31d80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.145+0000 7f31deffd700 1 -- 172.21.15.38:0/649020088 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d800a160 con 0x7f31e009e020 2020-06-12T17:48:25.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.145+0000 7f31deffd700 1 -- 172.21.15.38:0/649020088 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31d800a540 con 0x7f31e009e020 2020-06-12T17:48:25.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.145+0000 7f31e6848700 1 -- 172.21.15.38:0/649020088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31e009e020 msgr2=0x7f31e005be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:25.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.145+0000 7f31e6848700 1 --2- 172.21.15.38:0/649020088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31e009e020 0x7f31e005be00 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7f31d80032b0 tx=0x7f31d80081e0).stop 2020-06-12T17:48:25.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.146+0000 7f31e6848700 1 -- 172.21.15.38:0/649020088 shutdown_connections 2020-06-12T17:48:25.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.146+0000 7f31e6848700 1 --2- 172.21.15.38:0/649020088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31e009e020 0x7f31e005be00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:25.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.146+0000 7f31e6848700 1 -- 172.21.15.38:0/649020088 >> 172.21.15.38:0/649020088 conn(0x7f31e00ba670 msgr2=0x7f31e00baa80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:25.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.146+0000 7f31e6848700 1 -- 172.21.15.38:0/649020088 shutdown_connections 2020-06-12T17:48:25.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.146+0000 7f31e6848700 1 -- 172.21.15.38:0/649020088 wait complete. 2020-06-12T17:48:25.156 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.146+0000 7f31e6848700 1 Processor -- start 2020-06-12T17:48:25.156 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.147+0000 7f31e6848700 1 -- start start 2020-06-12T17:48:25.160 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.147+0000 7f31e6848700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31e009dba0 0x7f31e00652a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:25.160 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.147+0000 7f31e6848700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e0146f70 con 0x7f31e009e020 2020-06-12T17:48:25.160 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.147+0000 7f31e6848700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e0063bd0 con 0x7f31e009fdd0 2020-06-12T17:48:25.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.147+0000 7f31e6848700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e0063930 con 0x7f31e009dba0 2020-06-12T17:48:25.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.147+0000 7f31df7fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f31e009e020 0x7f31e01516c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37764/0 (socket says 172.21.15.38:37764) 2020-06-12T17:48:25.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.147+0000 7f31df7fe700 1 -- 172.21.15.38:0/1244235498 learned_addr learned my addr 172.21.15.38:0/1244235498 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:25.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31dffff700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31e009dba0 0x7f31e00652a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:25.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31dd7fa700 1 -- 172.21.15.38:0/1244235498 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3564095020 0 0) 0x7f31e0146f70 con 0x7f31e009e020 2020-06-12T17:48:25.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31dd7fa700 1 -- 172.21.15.38:0/1244235498 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31c0002fe0 con 0x7f31e009e020 2020-06-12T17:48:25.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31dd7fa700 1 -- 172.21.15.38:0/1244235498 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706708371 0 0) 0x7f31e0063bd0 con 0x7f31e009fdd0 2020-06-12T17:48:25.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31dd7fa700 1 -- 172.21.15.38:0/1244235498 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31e0146f70 con 0x7f31e009fdd0 2020-06-12T17:48:25.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31dd7fa700 1 -- 172.21.15.38:0/1244235498 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 507168543 0 0) 0x7f31c0002fe0 con 0x7f31e009e020 2020-06-12T17:48:25.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31dd7fa700 1 -- 172.21.15.38:0/1244235498 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f31e0063bd0 con 0x7f31e009e020 2020-06-12T17:48:25.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31dd7fa700 1 -- 172.21.15.38:0/1244235498 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f31d40019c0 con 0x7f31e009e020 2020-06-12T17:48:25.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31dd7fa700 1 -- 172.21.15.38:0/1244235498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31e009dba0 msgr2=0x7f31e00652a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:25.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31dd7fa700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31e009dba0 0x7f31e00652a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:25.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31dd7fa700 1 -- 172.21.15.38:0/1244235498 >> v1:172.21.15.150:6789/0 conn(0x7f31e009fdd0 legacy=0x7f31e0140b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:25.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31dd7fa700 1 -- 172.21.15.38:0/1244235498 >> v1:172.21.15.38:6789/0 conn(0x7f31e009e020 legacy=0x7f31e01516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:25.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31dd7fa700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31c0004b20 0x7f31c0004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:25.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31dd7fa700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31e009dba0 0x7f31c0003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:25.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31dd7fa700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31c0003f10 0x7f31c0004390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:25.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31dd7fa700 1 -- 172.21.15.38:0/1244235498 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e0063930 con 0x7f31c0003f10 2020-06-12T17:48:25.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31dd7fa700 1 -- 172.21.15.38:0/1244235498 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c00047f0 con 0x7f31c0004b20 2020-06-12T17:48:25.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31dd7fa700 1 -- 172.21.15.38:0/1244235498 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c000b750 con 0x7f31e009dba0 2020-06-12T17:48:25.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31e4de5700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31c0003f10 0x7f31c0004390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:25.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31dffff700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31c0004b20 0x7f31c0004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:25.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31df7fe700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31e009dba0 0x7f31c0003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:25.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31e4de5700 1 -- 172.21.15.38:0/1244235498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31e009dba0 msgr2=0x7f31c0003ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:25.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31e4de5700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31e009dba0 0x7f31c0003ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:25.166 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31e4de5700 1 -- 172.21.15.38:0/1244235498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31c0004b20 msgr2=0x7f31c0004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:25.166 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31e4de5700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31c0004b20 0x7f31c0004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:25.166 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31e4de5700 1 -- 172.21.15.38:0/1244235498 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e0141220 con 0x7f31c0003f10 2020-06-12T17:48:25.166 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31e6848700 1 -- 172.21.15.38:0/1244235498 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e01458c0 con 0x7f31c0003f10 2020-06-12T17:48:25.166 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.148+0000 7f31e4de5700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31c0003f10 0x7f31c0004390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f31d8008250 tx=0x7f31d80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.167 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.149+0000 7f31e6848700 1 -- 172.21.15.38:0/1244235498 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e0064890 con 0x7f31c0003f10 2020-06-12T17:48:25.167 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.149+0000 7f31e4de5700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31c0003f10 0x7f31c0004390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f31d8008250 tx=0x7f31d80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.167 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.149+0000 7f31e4de5700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31c0003f10 0x7f31c0004390 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f31d8008250 tx=0x7f31d80081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:25.167 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.149+0000 7f31e4de5700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31c0003f10 0x7f31c0004390 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f31d8008250 tx=0x7f31d80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.167 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.149+0000 7f31dd7fa700 1 -- 172.21.15.38:0/1244235498 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31d8005a40 con 0x7f31c0003f10 2020-06-12T17:48:25.167 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.149+0000 7f31e4de5700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31c0003f10 0x7f31c0004390 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f31d8008250 tx=0x7f31d80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.168 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.149+0000 7f31e4de5700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31c0003f10 0x7f31c0004390 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f31d8008250 tx=0x7f31d80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.168 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.149+0000 7f31dd7fa700 1 -- 172.21.15.38:0/1244235498 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d8005ba0 con 0x7f31c0003f10 2020-06-12T17:48:25.168 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.149+0000 7f31dd7fa700 1 -- 172.21.15.38:0/1244235498 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31d800f570 con 0x7f31c0003f10 2020-06-12T17:48:25.168 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.149+0000 7f31e4de5700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31c0003f10 0x7f31c0004390 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f31d8008250 tx=0x7f31d80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.168 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.149+0000 7f31e6848700 1 -- 172.21.15.38:0/1244235498 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31bc003340 con 0x7f31c0003f10 2020-06-12T17:48:25.169 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.150+0000 7f31dd7fa700 1 -- 172.21.15.38:0/1244235498 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f31d800f6d0 con 0x7f31c0003f10 2020-06-12T17:48:25.169 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.150+0000 7f31e4de5700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31c0003f10 0x7f31c0004390 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f31d8008250 tx=0x7f31d80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.169 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.150+0000 7f31dd7fa700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f31c00558a0 0x7f31c0057d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:25.169 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.150+0000 7f31dd7fa700 1 -- 172.21.15.38:0/1244235498 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f31d8061b10 con 0x7f31c0003f10 2020-06-12T17:48:25.169 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.150+0000 7f31dffff700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f31c00558a0 0x7f31c0057d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:25.170 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.150+0000 7f31dffff700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f31c00558a0 0x7f31c0057d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f31d00010d0 tx=0x7f31d0001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.170 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.150+0000 7f31dffff700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f31c00558a0 0x7f31c0057d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f31d00010d0 tx=0x7f31d0001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.170 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.150+0000 7f31dffff700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f31c00558a0 0x7f31c0057d60 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f31d00010d0 tx=0x7f31d0001760).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:25.170 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.153+0000 7f31e4de5700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31c0003f10 0x7f31c0004390 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f31d8008250 tx=0x7f31d80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.170 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.153+0000 7f31dd7fa700 1 -- 172.21.15.38:0/1244235498 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f31d803d330 con 0x7f31c0003f10 2020-06-12T17:48:25.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.359+0000 7f31e6848700 1 -- 172.21.15.38:0/1244235498 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f31bc0036e0 con 0x7f31c0003f10 2020-06-12T17:48:25.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.359+0000 7f31e4de5700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31c0003f10 0x7f31c0004390 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f31d8008250 tx=0x7f31d80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.359+0000 7f31dd7fa700 1 -- 172.21.15.38:0/1244235498 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f31d8040950 con 0x7f31c0003f10 2020-06-12T17:48:25.363 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:25.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.360+0000 7f31e6848700 1 -- 172.21.15.38:0/1244235498 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f31c00558a0 msgr2=0x7f31c0057d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:25.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.360+0000 7f31e6848700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f31c00558a0 0x7f31c0057d60 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f31d00010d0 tx=0x7f31d0001760).stop 2020-06-12T17:48:25.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.360+0000 7f31e6848700 1 -- 172.21.15.38:0/1244235498 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31c0003f10 msgr2=0x7f31c0004390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:25.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.360+0000 7f31e6848700 1 --2- 172.21.15.38:0/1244235498 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31c0003f10 0x7f31c0004390 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f31d8008250 tx=0x7f31d80081e0).stop 2020-06-12T17:48:25.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.360+0000 7f31e4de5700 1 -- 172.21.15.38:0/1244235498 reap_dead start 2020-06-12T17:48:25.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.360+0000 7f31e4de5700 1 -- 172.21.15.38:0/1244235498 reap_dead start 2020-06-12T17:48:25.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.361+0000 7f31e6848700 1 -- 172.21.15.38:0/1244235498 shutdown_connections 2020-06-12T17:48:25.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.361+0000 7f31e6848700 1 -- 172.21.15.38:0/1244235498 >> 172.21.15.38:0/1244235498 conn(0x7f31e00ba670 msgr2=0x7f31e00b8840 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:25.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.361+0000 7f31e6848700 1 -- 172.21.15.38:0/1244235498 shutdown_connections 2020-06-12T17:48:25.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.361+0000 7f31e6848700 1 -- 172.21.15.38:0/1244235498 wait complete. 2020-06-12T17:48:25.374 INFO:teuthology.orchestra.run.smithi038.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-06-12T17:48:25.374 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-06-12T17:48:25.375 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-12T17:48:25.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.486+0000 7f5432029700 1 Processor -- start 2020-06-12T17:48:25.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.486+0000 7f5432029700 1 -- start start 2020-06-12T17:48:25.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.487+0000 7f5432029700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f542c061a80 0x7f542c09bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:25.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.487+0000 7f5432029700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f542c142350 0x7f542c1427b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:25.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.487+0000 7f5432029700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542c0b2dc0 con 0x7f542c146380 2020-06-12T17:48:25.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.487+0000 7f5432029700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f542c09e560 con 0x7f542c061a80 2020-06-12T17:48:25.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.487+0000 7f5432029700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542c0b29d0 con 0x7f542c142350 2020-06-12T17:48:25.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.487+0000 7f542affd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f542c142350 0x7f542c1427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:25.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.487+0000 7f542b7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f542c061a80 0x7f542c09bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:25.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.487+0000 7f542affd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f542c142350 0x7f542c1427b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:55418/0 (socket says 172.21.15.38:55418) 2020-06-12T17:48:25.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.487+0000 7f542affd700 1 -- 172.21.15.38:0/1716729704 learned_addr learned my addr 172.21.15.38:0/1716729704 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:25.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.487+0000 7f542bfff700 1 --1- 172.21.15.38:0/1716729704 >> v1:172.21.15.150:6789/0 conn(0x7f542c146380 0x7f542c146810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:58512/0 (socket says 172.21.15.38:58512) 2020-06-12T17:48:25.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.488+0000 7f542affd700 1 -- 172.21.15.38:0/1716729704 >> v2:172.21.15.150:3300/0 conn(0x7f542c061a80 msgr2=0x7f542c09bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:25.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.488+0000 7f542affd700 1 --2- 172.21.15.38:0/1716729704 >> v2:172.21.15.150:3300/0 conn(0x7f542c061a80 0x7f542c09bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:25.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.488+0000 7f542affd700 1 -- 172.21.15.38:0/1716729704 >> v1:172.21.15.150:6789/0 conn(0x7f542c146380 legacy=0x7f542c146810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:25.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.488+0000 7f542affd700 1 -- 172.21.15.38:0/1716729704 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c0b2ff0 con 0x7f542c142350 2020-06-12T17:48:25.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.488+0000 7f542b7fe700 1 --2- 172.21.15.38:0/1716729704 >> v2:172.21.15.150:3300/0 conn(0x7f542c061a80 0x7f542c09bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:25.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.488+0000 7f542affd700 1 --2- 172.21.15.38:0/1716729704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f542c142350 0x7f542c1427b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5420002f30 tx=0x7f5420007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.488+0000 7f542affd700 1 --2- 172.21.15.38:0/1716729704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f542c142350 0x7f542c1427b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5420002f30 tx=0x7f5420007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.488+0000 7f542affd700 1 --2- 172.21.15.38:0/1716729704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f542c142350 0x7f542c1427b0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f5420002f30 tx=0x7f5420007e60).ready entity=mon.2 client_cookie=5d77afecc3a087fb server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:25.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.488+0000 7f542affd700 1 --2- 172.21.15.38:0/1716729704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f542c142350 0x7f542c1427b0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f5420002f30 tx=0x7f5420007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.488+0000 7f542affd700 1 --2- 172.21.15.38:0/1716729704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f542c142350 0x7f542c1427b0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f5420002f30 tx=0x7f5420007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.488+0000 7f542a7fc700 1 -- 172.21.15.38:0/1716729704 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5420011630 con 0x7f542c142350 2020-06-12T17:48:25.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.488+0000 7f542affd700 1 --2- 172.21.15.38:0/1716729704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f542c142350 0x7f542c1427b0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f5420002f30 tx=0x7f5420007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.488+0000 7f542a7fc700 1 -- 172.21.15.38:0/1716729704 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5420011790 con 0x7f542c142350 2020-06-12T17:48:25.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.488+0000 7f542a7fc700 1 -- 172.21.15.38:0/1716729704 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5420011bb0 con 0x7f542c142350 2020-06-12T17:48:25.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.488+0000 7f5432029700 1 -- 172.21.15.38:0/1716729704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f542c142350 msgr2=0x7f542c1427b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:25.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.488+0000 7f5432029700 1 --2- 172.21.15.38:0/1716729704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f542c142350 0x7f542c1427b0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f5420002f30 tx=0x7f5420007e60).stop 2020-06-12T17:48:25.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.489+0000 7f5432029700 1 -- 172.21.15.38:0/1716729704 shutdown_connections 2020-06-12T17:48:25.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.489+0000 7f5432029700 1 --2- 172.21.15.38:0/1716729704 >> v2:172.21.15.150:3300/0 conn(0x7f542c061a80 0x7f542c09bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:25.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.489+0000 7f5432029700 1 --2- 172.21.15.38:0/1716729704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f542c142350 0x7f542c1427b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:25.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.489+0000 7f5432029700 1 -- 172.21.15.38:0/1716729704 >> 172.21.15.38:0/1716729704 conn(0x7f542c0b8420 msgr2=0x7f542c0b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:25.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.489+0000 7f5432029700 1 -- 172.21.15.38:0/1716729704 shutdown_connections 2020-06-12T17:48:25.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.489+0000 7f5432029700 1 -- 172.21.15.38:0/1716729704 wait complete. 2020-06-12T17:48:25.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.490+0000 7f5432029700 1 Processor -- start 2020-06-12T17:48:25.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.490+0000 7f5432029700 1 -- start start 2020-06-12T17:48:25.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.490+0000 7f5432029700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f542c061a80 0x7f542c065c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:25.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.490+0000 7f5432029700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f542c146380 0x7f542c140110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:25.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.490+0000 7f5432029700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542c140570 con 0x7f542c142350 2020-06-12T17:48:25.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.490+0000 7f5432029700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f542c1546c0 con 0x7f542c061a80 2020-06-12T17:48:25.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.490+0000 7f5432029700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542c1505c0 con 0x7f542c146380 2020-06-12T17:48:25.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.491+0000 7f542b7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f542c061a80 0x7f542c065c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:25.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.491+0000 7f542b7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f542c061a80 0x7f542c065c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35966/0 (socket says 172.21.15.38:35966) 2020-06-12T17:48:25.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.491+0000 7f542b7fe700 1 -- 172.21.15.38:0/2914347280 learned_addr learned my addr 172.21.15.38:0/2914347280 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:25.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.491+0000 7f542bfff700 1 --2- 172.21.15.38:0/2914347280 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f542c146380 0x7f542c140110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:25.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.491+0000 7f542b7fe700 1 -- 172.21.15.38:0/2914347280 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f542c146380 msgr2=0x7f542c140110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:25.506 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.491+0000 7f542b7fe700 1 --2- 172.21.15.38:0/2914347280 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f542c146380 0x7f542c140110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:25.506 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.491+0000 7f542b7fe700 1 -- 172.21.15.38:0/2914347280 >> v1:172.21.15.150:6789/0 conn(0x7f542c142350 legacy=0x7f542c150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:25.506 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.491+0000 7f542b7fe700 1 -- 172.21.15.38:0/2914347280 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c154300 con 0x7f542c061a80 2020-06-12T17:48:25.506 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.491+0000 7f5428ff9700 1 -- 172.21.15.38:0/2914347280 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311546391 0 0) 0x7f542c0b2ff0 con 0x7f542c142350 2020-06-12T17:48:25.506 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.491+0000 7f542b7fe700 1 --2- 172.21.15.38:0/2914347280 >> v2:172.21.15.38:3300/0 conn(0x7f542c061a80 0x7f542c065c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f542c0b75f0 tx=0x7f541c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.491+0000 7f542b7fe700 1 --2- 172.21.15.38:0/2914347280 >> v2:172.21.15.38:3300/0 conn(0x7f542c061a80 0x7f542c065c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f542c0b75f0 tx=0x7f541c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.491+0000 7f542b7fe700 1 --2- 172.21.15.38:0/2914347280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f542c061a80 0x7f542c065c40 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7f542c0b75f0 tx=0x7f541c007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:25.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.491+0000 7f542b7fe700 1 --2- 172.21.15.38:0/2914347280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f542c061a80 0x7f542c065c40 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f542c0b75f0 tx=0x7f541c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.491+0000 7f5428ff9700 1 -- 172.21.15.38:0/2914347280 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f541c007540 con 0x7f542c061a80 2020-06-12T17:48:25.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.491+0000 7f542b7fe700 1 --2- 172.21.15.38:0/2914347280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f542c061a80 0x7f542c065c40 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f542c0b75f0 tx=0x7f541c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.491+0000 7f5432029700 1 -- 172.21.15.38:0/2914347280 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f542c151170 con 0x7f542c061a80 2020-06-12T17:48:25.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.491+0000 7f5428ff9700 1 -- 172.21.15.38:0/2914347280 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c005a10 con 0x7f542c061a80 2020-06-12T17:48:25.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.491+0000 7f542b7fe700 1 --2- 172.21.15.38:0/2914347280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f542c061a80 0x7f542c065c40 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f542c0b75f0 tx=0x7f541c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.491+0000 7f5428ff9700 1 -- 172.21.15.38:0/2914347280 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f541c005df0 con 0x7f542c061a80 2020-06-12T17:48:25.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.491+0000 7f5432029700 1 -- 172.21.15.38:0/2914347280 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542c064120 con 0x7f542c061a80 2020-06-12T17:48:25.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.492+0000 7f542b7fe700 1 --2- 172.21.15.38:0/2914347280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f542c061a80 0x7f542c065c40 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f542c0b75f0 tx=0x7f541c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.492+0000 7f5432029700 1 -- 172.21.15.38:0/2914347280 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542c056c30 con 0x7f542c061a80 2020-06-12T17:48:25.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.492+0000 7f5428ff9700 1 -- 172.21.15.38:0/2914347280 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f541c010180 con 0x7f542c061a80 2020-06-12T17:48:25.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.492+0000 7f542b7fe700 1 --2- 172.21.15.38:0/2914347280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f542c061a80 0x7f542c065c40 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f542c0b75f0 tx=0x7f541c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.493+0000 7f5428ff9700 1 --2- 172.21.15.38:0/2914347280 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f540c04d4b0 0x7f540c04f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:25.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.493+0000 7f5428ff9700 1 -- 172.21.15.38:0/2914347280 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f541c061100 con 0x7f542c061a80 2020-06-12T17:48:25.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.493+0000 7f542affd700 1 --2- 172.21.15.38:0/2914347280 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f540c04d4b0 0x7f540c04f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:25.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.493+0000 7f542affd700 1 --2- 172.21.15.38:0/2914347280 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f540c04d4b0 0x7f540c04f970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5420007ed0 tx=0x7f5420007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.493+0000 7f542affd700 1 --2- 172.21.15.38:0/2914347280 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f540c04d4b0 0x7f540c04f970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5420007ed0 tx=0x7f5420007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.511 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.493+0000 7f542affd700 1 --2- 172.21.15.38:0/2914347280 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f540c04d4b0 0x7f540c04f970 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7f5420007ed0 tx=0x7f5420007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:25.511 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.496+0000 7f542b7fe700 1 --2- 172.21.15.38:0/2914347280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f542c061a80 0x7f542c065c40 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f542c0b75f0 tx=0x7f541c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.511 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.496+0000 7f5428ff9700 1 -- 172.21.15.38:0/2914347280 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f541c03c840 con 0x7f542c061a80 2020-06-12T17:48:25.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.651+0000 7f5432029700 1 -- 172.21.15.38:0/2914347280 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f542c1544f0 con 0x7f542c061a80 2020-06-12T17:48:25.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.652+0000 7f542b7fe700 1 --2- 172.21.15.38:0/2914347280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f542c061a80 0x7f542c065c40 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f542c0b75f0 tx=0x7f541c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.652+0000 7f5428ff9700 1 -- 172.21.15.38:0/2914347280 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16347 (secure 0 0 0) 0x7f541c03fe60 con 0x7f542c061a80 2020-06-12T17:48:25.656 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:25.656 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":24,"fsid":"8e42a2e7-b187-42c4-a73f-8f812ee62352","created":"2020-06-12T17:47:54.434340+0000","modified":"2020-06-12T17:48:14.851712+0000","last_up_change":"2020-06-12T17:48:03.388718+0000","last_in_change":"2020-06-12T17:48:03.388718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-06-12T17:47:57.558119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-06-12T17:48:07.419264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-06-12T17:48:09.934098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-06-12T17:48:12.497229+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"44ac3dea-67b4-4b9a-bc18-ac511710afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":31038},{"type":"v1","addr":"172.21.15.38:6816","nonce":31038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":31038},{"type":"v1","addr":"172.21.15.38:6819","nonce":31038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":31038},{"type":"v1","addr":"172.21.15.38:6823","nonce":31038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":31038},{"type":"v1","addr":"172.21.15.38:6821","nonce":31038}]},"public_addr":"172.21.15.38:6816/31038","cluster_addr":"172.21.15.38:6819/31038","heartbeat_back_addr":"172.21.15.38:6823/31038","heartbeat_front_addr":"172.21.15.38:6821/31038","state":["exists","up"]},{"osd":1,"uuid":"561f7ced-3fff-4364-8619-6e4ecbc9d256","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":31036},{"type":"v1","addr":"172.21.15.38:6801","nonce":31036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":31036},{"type":"v1","addr":"172.21.15.38:6803","nonce":31036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":31036},{"type":"v1","addr":"172.21.15.38:6807","nonce":31036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":31036},{"type":"v1","addr":"172.21.15.38:6805","nonce":31036}]},"public_addr":"172.21.15.38:6801/31036","cluster_addr":"172.21.15.38:6803/31036","heartbeat_back_addr":"172.21.15.38:6807/31036","heartbeat_front_addr":"172.21.15.38:6805/31036","state":["exists","up"]},{"osd":2,"uuid":"0bb3c806-07af-49f5-b492-d0e33f2de37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":31053},{"type":"v1","addr":"172.21.15.38:6825","nonce":31053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":31053},{"type":"v1","addr":"172.21.15.38:6827","nonce":31053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":31053},{"type":"v1","addr":"172.21.15.38:6831","nonce":31053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":31053},{"type":"v1","addr":"172.21.15.38:6829","nonce":31053}]},"public_addr":"172.21.15.38:6825/31053","cluster_addr":"172.21.15.38:6827/31053","heartbeat_back_addr":"172.21.15.38:6831/31053","heartbeat_front_addr":"172.21.15.38:6829/31053","state":["exists","up"]},{"osd":3,"uuid":"7f6a1e75-7b11-456e-8a4b-510b16226800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":31037},{"type":"v1","addr":"172.21.15.38:6809","nonce":31037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":31037},{"type":"v1","addr":"172.21.15.38:6811","nonce":31037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6815","nonce":31037},{"type":"v1","addr":"172.21.15.38:6817","nonce":31037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":31037},{"type":"v1","addr":"172.21.15.38:6813","nonce":31037}]},"public_addr":"172.21.15.38:6809/31037","cluster_addr":"172.21.15.38:6811/31037","heartbeat_back_addr":"172.21.15.38:6817/31037","heartbeat_front_addr":"172.21.15.38:6813/31037","state":["exists","up"]},{"osd":4,"uuid":"0eca0272-8cfd-469c-a32d-e29730dc0e1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":31294},{"type":"v1","addr":"172.21.15.150:6803","nonce":31294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":31294},{"type":"v1","addr":"172.21.15.150:6805","nonce":31294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":31294},{"type":"v1","addr":"172.21.15.150:6809","nonce":31294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":31294},{"type":"v1","addr":"172.21.15.150:6807","nonce":31294}]},"public_addr":"172.21.15.150:6803/31294","cluster_addr":"172.21.15.150:6805/31294","heartbeat_back_addr":"172.21.15.150:6809/31294","heartbeat_front_addr":"172.21.15.150:6807/31294","state":["exists","up"]},{"osd":5,"uuid":"69d6a7dc-a55a-4ebc-8479-8bb921ddfb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":31295},{"type":"v1","addr":"172.21.15.150:6813","nonce":31295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":31295},{"type":"v1","addr":"172.21.15.150:6816","nonce":31295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":31295},{"type":"v1","addr":"172.21.15.150:6828","nonce":31295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6819","nonce":31295},{"type":"v1","addr":"172.21.15.150:6822","nonce":31295}]},"public_addr":"172.21.15.150:6813/31295","cluster_addr":"172.21.15.150:6816/31295","heartbeat_back_addr":"172.21.15.150:6828/31295","heartbeat_front_addr":"172.21.15.150:6822/31295","state":["exists","up"]},{"osd":6,"uuid":"f0d320f8-c2f0-40bb-b713-526246cf97b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":31297},{"type":"v1","addr":"172.21.15.150:6820","nonce":31297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6823","nonce":31297},{"type":"v1","addr":"172.21.15.150:6827","nonce":31297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":31297},{"type":"v1","addr":"172.21.15.150:6833","nonce":31297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":31297},{"type":"v1","addr":"172.21.15.150:6831","nonce":31297}]},"public_addr":"172.21.15.150:6820/31297","cluster_addr":"172.21.15.150:6827/31297","heartbeat_back_addr":"172.21.15.150:6833/31297","heartbeat_front_addr":"172.21.15.150:6831/31297","state":["exists","up"]},{"osd":7,"uuid":"970b7d02-a189-41b2-96e5-a5a5a57c6476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":31296},{"type":"v1","addr":"172.21.15.150:6812","nonce":31296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":31296},{"type":"v1","addr":"172.21.15.150:6818","nonce":31296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":31296},{"type":"v1","addr":"172.21.15.150:6829","nonce":31296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":31296},{"type":"v1","addr":"172.21.15.150:6824","nonce":31296}]},"public_addr":"172.21.15.150:6812/31296","cluster_addr":"172.21.15.150:6818/31296","heartbeat_back_addr":"172.21.15.150:6829/31296","heartbeat_front_addr":"172.21.15.150:6824/31296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.664300+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.644253+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.651120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.584978+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.561149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.661778+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T17:48:25.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.653+0000 7f5432029700 1 -- 172.21.15.38:0/2914347280 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f540c04d4b0 msgr2=0x7f540c04f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:25.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.653+0000 7f5432029700 1 --2- 172.21.15.38:0/2914347280 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f540c04d4b0 0x7f540c04f970 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7f5420007ed0 tx=0x7f5420007e60).stop 2020-06-12T17:48:25.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.653+0000 7f5432029700 1 -- 172.21.15.38:0/2914347280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f542c061a80 msgr2=0x7f542c065c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:25.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.653+0000 7f5432029700 1 --2- 172.21.15.38:0/2914347280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f542c061a80 0x7f542c065c40 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7f542c0b75f0 tx=0x7f541c007e60).stop 2020-06-12T17:48:25.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.653+0000 7f5432029700 1 -- 172.21.15.38:0/2914347280 shutdown_connections 2020-06-12T17:48:25.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.653+0000 7f5432029700 1 --2- 172.21.15.38:0/2914347280 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f540c04d4b0 0x7f540c04f970 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:25.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.653+0000 7f5432029700 1 --2- 172.21.15.38:0/2914347280 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f542c146380 0x7f542c140110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:25.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.653+0000 7f5432029700 1 --2- 172.21.15.38:0/2914347280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f542c061a80 0x7f542c065c40 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:25.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.653+0000 7f5432029700 1 -- 172.21.15.38:0/2914347280 >> 172.21.15.38:0/2914347280 conn(0x7f542c0b8420 msgr2=0x7f542c140980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:25.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.653+0000 7f5432029700 1 -- 172.21.15.38:0/2914347280 shutdown_connections 2020-06-12T17:48:25.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.653+0000 7f5432029700 1 -- 172.21.15.38:0/2914347280 wait complete. 2020-06-12T17:48:25.667 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-06-12T17:47:57.558119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-06-12T17:48:07.419264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-06-12T17:48:09.934098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-06-12T17:48:12.497229+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-06-12T17:48:25.668 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-06-12T17:48:25.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.783+0000 7efd64b2d700 1 Processor -- start 2020-06-12T17:48:25.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.783+0000 7efd64b2d700 1 -- start start 2020-06-12T17:48:25.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.783+0000 7efd64b2d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efd600b11e0 0x7efd600b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:25.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.783+0000 7efd64b2d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efd600b2380 0x7efd600ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:25.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.783+0000 7efd64b2d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd600ae520 0x7efd600afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:25.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.783+0000 7efd64b2d700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd600b2900 con 0x7efd600b2380 2020-06-12T17:48:25.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.783+0000 7efd64b2d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd600b1ad0 con 0x7efd600b11e0 2020-06-12T17:48:25.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.783+0000 7efd64b2d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd600b1d70 con 0x7efd600ae520 2020-06-12T17:48:25.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.783+0000 7efd5effd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efd600b2380 0x7efd600ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:25.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.784+0000 7efd5effd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efd600b2380 0x7efd600ae0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35974/0 (socket says 172.21.15.38:35974) 2020-06-12T17:48:25.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.784+0000 7efd5effd700 1 -- 172.21.15.38:0/3652992979 learned_addr learned my addr 172.21.15.38:0/3652992979 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:25.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.784+0000 7efd5f7fe700 1 --2- 172.21.15.38:0/3652992979 >> v2:172.21.15.150:3300/0 conn(0x7efd600b11e0 0x7efd600b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:25.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.784+0000 7efd5effd700 1 -- 172.21.15.38:0/3652992979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd600ae520 msgr2=0x7efd600afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:25.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.784+0000 7efd5ffff700 1 --2- 172.21.15.38:0/3652992979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd600ae520 0x7efd600afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:25.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.784+0000 7efd5effd700 1 --2- 172.21.15.38:0/3652992979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd600ae520 0x7efd600afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:25.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.784+0000 7efd5effd700 1 -- 172.21.15.38:0/3652992979 >> v2:172.21.15.150:3300/0 conn(0x7efd600b11e0 msgr2=0x7efd600b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:25.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.784+0000 7efd5effd700 1 --2- 172.21.15.38:0/3652992979 >> v2:172.21.15.150:3300/0 conn(0x7efd600b11e0 0x7efd600b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:25.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.784+0000 7efd5effd700 1 -- 172.21.15.38:0/3652992979 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd600b0080 con 0x7efd600b2380 2020-06-12T17:48:25.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.784+0000 7efd5f7fe700 1 --2- 172.21.15.38:0/3652992979 >> v2:172.21.15.150:3300/0 conn(0x7efd600b11e0 0x7efd600b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:48:25.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.784+0000 7efd5ffff700 1 --2- 172.21.15.38:0/3652992979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd600ae520 0x7efd600afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:48:25.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.784+0000 7efd5effd700 1 --2- 172.21.15.38:0/3652992979 >> v2:172.21.15.38:3300/0 conn(0x7efd600b2380 0x7efd600ae0c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efd54002f30 tx=0x7efd54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.784+0000 7efd5effd700 1 --2- 172.21.15.38:0/3652992979 >> v2:172.21.15.38:3300/0 conn(0x7efd600b2380 0x7efd600ae0c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efd54002f30 tx=0x7efd54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.784+0000 7efd5effd700 1 --2- 172.21.15.38:0/3652992979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd600b2380 0x7efd600ae0c0 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7efd54002f30 tx=0x7efd54007e60).ready entity=mon.0 client_cookie=821728f074a6f65b server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:25.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.784+0000 7efd5effd700 1 --2- 172.21.15.38:0/3652992979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd600b2380 0x7efd600ae0c0 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7efd54002f30 tx=0x7efd54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.784+0000 7efd5e7fc700 1 -- 172.21.15.38:0/3652992979 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd540116e0 con 0x7efd600b2380 2020-06-12T17:48:25.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.784+0000 7efd5effd700 1 --2- 172.21.15.38:0/3652992979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd600b2380 0x7efd600ae0c0 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7efd54002f30 tx=0x7efd54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.784+0000 7efd5e7fc700 1 -- 172.21.15.38:0/3652992979 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd54011840 con 0x7efd600b2380 2020-06-12T17:48:25.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.784+0000 7efd5effd700 1 --2- 172.21.15.38:0/3652992979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd600b2380 0x7efd600ae0c0 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7efd54002f30 tx=0x7efd54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.784+0000 7efd5e7fc700 1 -- 172.21.15.38:0/3652992979 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd54011be0 con 0x7efd600b2380 2020-06-12T17:48:25.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.784+0000 7efd64b2d700 1 -- 172.21.15.38:0/3652992979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd600b2380 msgr2=0x7efd600ae0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:25.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.784+0000 7efd64b2d700 1 --2- 172.21.15.38:0/3652992979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd600b2380 0x7efd600ae0c0 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7efd54002f30 tx=0x7efd54007e60).stop 2020-06-12T17:48:25.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.785+0000 7efd64b2d700 1 -- 172.21.15.38:0/3652992979 shutdown_connections 2020-06-12T17:48:25.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.785+0000 7efd64b2d700 1 --2- 172.21.15.38:0/3652992979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd600ae520 0x7efd600afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:25.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.785+0000 7efd64b2d700 1 --2- 172.21.15.38:0/3652992979 >> v2:172.21.15.150:3300/0 conn(0x7efd600b11e0 0x7efd600b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:25.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.785+0000 7efd64b2d700 1 --2- 172.21.15.38:0/3652992979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd600b2380 0x7efd600ae0c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:25.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.785+0000 7efd64b2d700 1 -- 172.21.15.38:0/3652992979 >> 172.21.15.38:0/3652992979 conn(0x7efd600b4cc0 msgr2=0x7efd600b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:25.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.785+0000 7efd64b2d700 1 -- 172.21.15.38:0/3652992979 shutdown_connections 2020-06-12T17:48:25.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.785+0000 7efd64b2d700 1 -- 172.21.15.38:0/3652992979 wait complete. 2020-06-12T17:48:25.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.786+0000 7efd64b2d700 1 Processor -- start 2020-06-12T17:48:25.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.786+0000 7efd64b2d700 1 -- start start 2020-06-12T17:48:25.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.786+0000 7efd64b2d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efd600b11e0 0x7efd600b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:25.800 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.787+0000 7efd64b2d700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd600b7130 con 0x7efd600ae520 2020-06-12T17:48:25.800 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.787+0000 7efd64b2d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd60064840 con 0x7efd600b2380 2020-06-12T17:48:25.800 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.787+0000 7efd64b2d700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd60064300 con 0x7efd600b11e0 2020-06-12T17:48:25.800 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.787+0000 7efd5effd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efd600b11e0 0x7efd600b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:25.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.787+0000 7efd5effd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efd600b11e0 0x7efd600b6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35982/0 (socket says 172.21.15.38:35982) 2020-06-12T17:48:25.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.787+0000 7efd5effd700 1 -- 172.21.15.38:0/2382801863 learned_addr learned my addr 172.21.15.38:0/2382801863 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:25.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.787+0000 7efd5f7fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7efd600ae520 0x7efd60141980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37796/0 (socket says 172.21.15.38:37796) 2020-06-12T17:48:25.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.787+0000 7efd5effd700 1 -- 172.21.15.38:0/2382801863 >> v1:172.21.15.150:6789/0 conn(0x7efd600b2380 legacy=0x7efd60062840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:25.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.787+0000 7efd5effd700 1 -- 172.21.15.38:0/2382801863 >> v1:172.21.15.38:6789/0 conn(0x7efd600ae520 legacy=0x7efd60141980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:25.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.787+0000 7efd5cff9700 1 -- 172.21.15.38:0/2382801863 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2801075458 0 0) 0x7efd50001ec0 con 0x7efd600ae520 2020-06-12T17:48:25.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.787+0000 7efd5effd700 1 -- 172.21.15.38:0/2382801863 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd600645a0 con 0x7efd600b11e0 2020-06-12T17:48:25.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.787+0000 7efd5effd700 1 --2- 172.21.15.38:0/2382801863 >> v2:172.21.15.38:3300/0 conn(0x7efd600b11e0 0x7efd600b6cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efd600b3420 tx=0x7efd54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.787+0000 7efd5effd700 1 --2- 172.21.15.38:0/2382801863 >> v2:172.21.15.38:3300/0 conn(0x7efd600b11e0 0x7efd600b6cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efd600b3420 tx=0x7efd54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.787+0000 7efd5effd700 1 --2- 172.21.15.38:0/2382801863 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd600b11e0 0x7efd600b6cd0 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7efd600b3420 tx=0x7efd54007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:25.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.787+0000 7efd5effd700 1 --2- 172.21.15.38:0/2382801863 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd600b11e0 0x7efd600b6cd0 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7efd600b3420 tx=0x7efd54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.787+0000 7efd5cff9700 1 -- 172.21.15.38:0/2382801863 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd54007340 con 0x7efd600b11e0 2020-06-12T17:48:25.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.787+0000 7efd5effd700 1 --2- 172.21.15.38:0/2382801863 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd600b11e0 0x7efd600b6cd0 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7efd600b3420 tx=0x7efd54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.787+0000 7efd5effd700 1 --2- 172.21.15.38:0/2382801863 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd600b11e0 0x7efd600b6cd0 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7efd600b3420 tx=0x7efd54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.787+0000 7efd5cff9700 1 -- 172.21.15.38:0/2382801863 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd540074a0 con 0x7efd600b11e0 2020-06-12T17:48:25.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.787+0000 7efd64b2d700 1 -- 172.21.15.38:0/2382801863 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd600b3820 con 0x7efd600b11e0 2020-06-12T17:48:25.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.787+0000 7efd5cff9700 1 -- 172.21.15.38:0/2382801863 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd540058b0 con 0x7efd600b11e0 2020-06-12T17:48:25.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.788+0000 7efd64b2d700 1 -- 172.21.15.38:0/2382801863 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd60142250 con 0x7efd600b11e0 2020-06-12T17:48:25.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.788+0000 7efd5effd700 1 --2- 172.21.15.38:0/2382801863 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd600b11e0 0x7efd600b6cd0 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7efd600b3420 tx=0x7efd54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.788+0000 7efd5cff9700 1 -- 172.21.15.38:0/2382801863 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7efd54005a10 con 0x7efd600b11e0 2020-06-12T17:48:25.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.788+0000 7efd5effd700 1 --2- 172.21.15.38:0/2382801863 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd600b11e0 0x7efd600b6cd0 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7efd600b3420 tx=0x7efd54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.805 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.789+0000 7efd64b2d700 1 -- 172.21.15.38:0/2382801863 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd60064160 con 0x7efd600b11e0 2020-06-12T17:48:25.805 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.789+0000 7efd5cff9700 1 --2- 172.21.15.38:0/2382801863 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efd4004d4b0 0x7efd4004f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:25.805 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.789+0000 7efd5cff9700 1 -- 172.21.15.38:0/2382801863 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7efd54061720 con 0x7efd600b11e0 2020-06-12T17:48:25.805 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.789+0000 7efd5f7fe700 1 --2- 172.21.15.38:0/2382801863 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efd4004d4b0 0x7efd4004f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:25.805 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.789+0000 7efd5f7fe700 1 --2- 172.21.15.38:0/2382801863 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efd4004d4b0 0x7efd4004f970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efd50003070 tx=0x7efd500023d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.789+0000 7efd5f7fe700 1 --2- 172.21.15.38:0/2382801863 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efd4004d4b0 0x7efd4004f970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efd50003070 tx=0x7efd500023d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.789+0000 7efd5f7fe700 1 --2- 172.21.15.38:0/2382801863 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efd4004d4b0 0x7efd4004f970 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7efd50003070 tx=0x7efd500023d0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:25.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.792+0000 7efd5effd700 1 --2- 172.21.15.38:0/2382801863 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd600b11e0 0x7efd600b6cd0 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7efd600b3420 tx=0x7efd54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.792+0000 7efd5cff9700 1 -- 172.21.15.38:0/2382801863 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7efd60064160 con 0x7efd600b11e0 2020-06-12T17:48:25.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.943+0000 7efd64b2d700 1 -- 172.21.15.38:0/2382801863 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7efd60064160 con 0x7efd600b11e0 2020-06-12T17:48:25.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.943+0000 7efd5effd700 1 --2- 172.21.15.38:0/2382801863 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd600b11e0 0x7efd600b6cd0 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7efd600b3420 tx=0x7efd54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:25.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.943+0000 7efd5cff9700 1 -- 172.21.15.38:0/2382801863 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7efd60064160 con 0x7efd600b11e0 2020-06-12T17:48:25.948 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2020-06-12T17:48:25.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.944+0000 7efd64b2d700 1 -- 172.21.15.38:0/2382801863 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efd4004d4b0 msgr2=0x7efd4004f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.944+0000 7efd64b2d700 1 --2- 172.21.15.38:0/2382801863 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efd4004d4b0 0x7efd4004f970 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7efd50003070 tx=0x7efd500023d0).stop 2020-06-12T17:48:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.944+0000 7efd64b2d700 1 -- 172.21.15.38:0/2382801863 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd600b11e0 msgr2=0x7efd600b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.944+0000 7efd64b2d700 1 --2- 172.21.15.38:0/2382801863 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd600b11e0 0x7efd600b6cd0 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7efd600b3420 tx=0x7efd54007e60).stop 2020-06-12T17:48:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.944+0000 7efd64b2d700 1 -- 172.21.15.38:0/2382801863 shutdown_connections 2020-06-12T17:48:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.944+0000 7efd64b2d700 1 --2- 172.21.15.38:0/2382801863 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efd4004d4b0 0x7efd4004f970 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.944+0000 7efd64b2d700 1 --2- 172.21.15.38:0/2382801863 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd600b11e0 0x7efd600b6cd0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:25.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.944+0000 7efd64b2d700 1 -- 172.21.15.38:0/2382801863 >> 172.21.15.38:0/2382801863 conn(0x7efd600b4cc0 msgr2=0x7efd601461a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:25.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.944+0000 7efd64b2d700 1 -- 172.21.15.38:0/2382801863 shutdown_connections 2020-06-12T17:48:25.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:25.944+0000 7efd64b2d700 1 -- 172.21.15.38:0/2382801863 wait complete. 2020-06-12T17:48:25.958 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-06-12T17:48:26.078 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.073+0000 7f49a50b8700 1 Processor -- start 2020-06-12T17:48:26.078 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.073+0000 7f49a50b8700 1 -- start start 2020-06-12T17:48:26.084 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.074+0000 7f49a50b8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49a0146680 0x7f49a00ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:26.084 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.074+0000 7f49a50b8700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a0146d20 con 0x7f49a009d8d0 2020-06-12T17:48:26.084 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.074+0000 7f49a50b8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a0066a80 con 0x7f49a00b2eb0 2020-06-12T17:48:26.084 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.074+0000 7f49a50b8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a0146f50 con 0x7f49a0146680 2020-06-12T17:48:26.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.074+0000 7f499f59e700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f49a009d8d0 0x7f49a01421d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37804/0 (socket says 172.21.15.38:37804) 2020-06-12T17:48:26.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.074+0000 7f499f59e700 1 -- 172.21.15.38:0/2523954558 learned_addr learned my addr 172.21.15.38:0/2523954558 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:26.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.074+0000 7f499ed9d700 1 --2- 172.21.15.38:0/2523954558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49a0146680 0x7f49a00ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:26.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.074+0000 7f499dd9b700 1 -- 172.21.15.38:0/2523954558 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1387988387 0 0) 0x7f49a0146d20 con 0x7f49a009d8d0 2020-06-12T17:48:26.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.074+0000 7f499dd9b700 1 -- 172.21.15.38:0/2523954558 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4984003230 con 0x7f49a009d8d0 2020-06-12T17:48:26.086 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.074+0000 7f499dd9b700 1 -- 172.21.15.38:0/2523954558 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2293902335 0 0) 0x7f49a0066a80 con 0x7f49a00b2eb0 2020-06-12T17:48:26.086 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.074+0000 7f499dd9b700 1 -- 172.21.15.38:0/2523954558 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49a0146d20 con 0x7f49a00b2eb0 2020-06-12T17:48:26.086 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.074+0000 7f499dd9b700 1 -- 172.21.15.38:0/2523954558 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2961604652 0 0) 0x7f4984003230 con 0x7f49a009d8d0 2020-06-12T17:48:26.086 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.074+0000 7f499ed9d700 1 -- 172.21.15.38:0/2523954558 >> v1:172.21.15.150:6789/0 conn(0x7f49a00b2eb0 legacy=0x7f49a009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:26.086 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.074+0000 7f499ed9d700 1 -- 172.21.15.38:0/2523954558 >> v1:172.21.15.38:6789/0 conn(0x7f49a009d8d0 legacy=0x7f49a01421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:26.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.074+0000 7f499ed9d700 1 -- 172.21.15.38:0/2523954558 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a0146a60 con 0x7f49a0146680 2020-06-12T17:48:26.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.074+0000 7f499ed9d700 1 --2- 172.21.15.38:0/2523954558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49a0146680 0x7f49a00ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f49900010d0 tx=0x7f49980081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.074+0000 7f499ed9d700 1 --2- 172.21.15.38:0/2523954558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49a0146680 0x7f49a00ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f49900010d0 tx=0x7f49980081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.074+0000 7f499ed9d700 1 --2- 172.21.15.38:0/2523954558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49a0146680 0x7f49a00ad5b0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f49900010d0 tx=0x7f49980081e0).ready entity=mon.2 client_cookie=2790b23efb0a6f18 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:26.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.075+0000 7f499ed9d700 1 --2- 172.21.15.38:0/2523954558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49a0146680 0x7f49a00ad5b0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f49900010d0 tx=0x7f49980081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.088 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.075+0000 7f499dd9b700 1 -- 172.21.15.38:0/2523954558 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49900016d0 con 0x7f49a0146680 2020-06-12T17:48:26.088 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.075+0000 7f499ed9d700 1 --2- 172.21.15.38:0/2523954558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49a0146680 0x7f49a00ad5b0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f49900010d0 tx=0x7f49980081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.088 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.075+0000 7f499ed9d700 1 --2- 172.21.15.38:0/2523954558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49a0146680 0x7f49a00ad5b0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f49900010d0 tx=0x7f49980081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.088 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.075+0000 7f499dd9b700 1 -- 172.21.15.38:0/2523954558 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4998010a10 con 0x7f49a0146680 2020-06-12T17:48:26.088 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.075+0000 7f499dd9b700 1 -- 172.21.15.38:0/2523954558 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4998010d70 con 0x7f49a0146680 2020-06-12T17:48:26.088 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.075+0000 7f49a50b8700 1 -- 172.21.15.38:0/2523954558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49a0146680 msgr2=0x7f49a00ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:26.089 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.075+0000 7f49a50b8700 1 --2- 172.21.15.38:0/2523954558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49a0146680 0x7f49a00ad5b0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f49900010d0 tx=0x7f49980081e0).stop 2020-06-12T17:48:26.089 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.075+0000 7f49a50b8700 1 -- 172.21.15.38:0/2523954558 shutdown_connections 2020-06-12T17:48:26.089 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.075+0000 7f49a50b8700 1 --2- 172.21.15.38:0/2523954558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49a0146680 0x7f49a00ad5b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:26.089 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.075+0000 7f49a50b8700 1 -- 172.21.15.38:0/2523954558 >> 172.21.15.38:0/2523954558 conn(0x7f49a00b5a20 msgr2=0x7f49a005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:26.089 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.075+0000 7f49a50b8700 1 -- 172.21.15.38:0/2523954558 shutdown_connections 2020-06-12T17:48:26.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.075+0000 7f49a50b8700 1 -- 172.21.15.38:0/2523954558 wait complete. 2020-06-12T17:48:26.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.076+0000 7f49a50b8700 1 Processor -- start 2020-06-12T17:48:26.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.076+0000 7f49a50b8700 1 -- start start 2020-06-12T17:48:26.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.077+0000 7f49a50b8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f49a00b2eb0 0x7f49a00b1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:26.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.077+0000 7f49a50b8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49a0146680 0x7f49a008ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:26.091 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.077+0000 7f49a50b8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a00b2130 con 0x7f49a009d8d0 2020-06-12T17:48:26.091 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.077+0000 7f49a50b8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a00b1e90 con 0x7f49a00b2eb0 2020-06-12T17:48:26.091 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.077+0000 7f49a50b8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a01512f0 con 0x7f49a0146680 2020-06-12T17:48:26.091 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.077+0000 7f499f59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49a0146680 0x7f49a008ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:26.091 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.077+0000 7f499e59c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f49a00b2eb0 0x7f49a00b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:26.092 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.077+0000 7f499f59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49a0146680 0x7f49a008ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:55452/0 (socket says 172.21.15.38:55452) 2020-06-12T17:48:26.092 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.077+0000 7f499ed9d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f49a009d8d0 0x7f49a009cc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:58542/0 (socket says 172.21.15.38:58542) 2020-06-12T17:48:26.092 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.077+0000 7f499f59e700 1 -- 172.21.15.38:0/2196680804 learned_addr learned my addr 172.21.15.38:0/2196680804 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:26.092 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.078+0000 7f499e59c700 1 -- 172.21.15.38:0/2196680804 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49a0146680 msgr2=0x7f49a008ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:26.092 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.078+0000 7f499e59c700 1 --2- 172.21.15.38:0/2196680804 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49a0146680 0x7f49a008ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:26.093 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.078+0000 7f499e59c700 1 -- 172.21.15.38:0/2196680804 >> v1:172.21.15.150:6789/0 conn(0x7f49a009d8d0 legacy=0x7f49a009cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:26.093 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.078+0000 7f498ffff700 1 -- 172.21.15.38:0/2196680804 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158817033 0 0) 0x7f49a00b2130 con 0x7f49a009d8d0 2020-06-12T17:48:26.093 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.078+0000 7f499e59c700 1 -- 172.21.15.38:0/2196680804 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a009d310 con 0x7f49a00b2eb0 2020-06-12T17:48:26.093 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.078+0000 7f499f59e700 1 --2- 172.21.15.38:0/2196680804 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49a0146680 0x7f49a008ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:26.093 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.078+0000 7f499e59c700 1 --2- 172.21.15.38:0/2196680804 >> v2:172.21.15.150:3300/0 conn(0x7f49a00b2eb0 0x7f49a00b1710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f49940010d0 tx=0x7f4994002810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.094 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.078+0000 7f499e59c700 1 --2- 172.21.15.38:0/2196680804 >> v2:172.21.15.150:3300/0 conn(0x7f49a00b2eb0 0x7f49a00b1710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f49940010d0 tx=0x7f4994002810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.094 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.078+0000 7f499e59c700 1 --2- 172.21.15.38:0/2196680804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49a00b2eb0 0x7f49a00b1710 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f49940010d0 tx=0x7f4994002810).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:26.094 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.078+0000 7f499e59c700 1 --2- 172.21.15.38:0/2196680804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49a00b2eb0 0x7f49a00b1710 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f49940010d0 tx=0x7f4994002810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.094 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.078+0000 7f498ffff700 1 -- 172.21.15.38:0/2196680804 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4994011ea0 con 0x7f49a00b2eb0 2020-06-12T17:48:26.094 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.078+0000 7f499e59c700 1 --2- 172.21.15.38:0/2196680804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49a00b2eb0 0x7f49a00b1710 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f49940010d0 tx=0x7f4994002810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.095 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.078+0000 7f49a50b8700 1 -- 172.21.15.38:0/2196680804 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a00b1b70 con 0x7f49a00b2eb0 2020-06-12T17:48:26.095 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.078+0000 7f499e59c700 1 --2- 172.21.15.38:0/2196680804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49a00b2eb0 0x7f49a00b1710 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f49940010d0 tx=0x7f4994002810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.095 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.078+0000 7f498ffff700 1 -- 172.21.15.38:0/2196680804 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499400cc20 con 0x7f49a00b2eb0 2020-06-12T17:48:26.095 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.078+0000 7f498ffff700 1 -- 172.21.15.38:0/2196680804 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f499400e160 con 0x7f49a00b2eb0 2020-06-12T17:48:26.095 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.078+0000 7f49a50b8700 1 -- 172.21.15.38:0/2196680804 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a008f470 con 0x7f49a00b2eb0 2020-06-12T17:48:26.097 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.079+0000 7f499e59c700 1 --2- 172.21.15.38:0/2196680804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49a00b2eb0 0x7f49a00b1710 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f49940010d0 tx=0x7f4994002810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.097 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.079+0000 7f49a50b8700 1 -- 172.21.15.38:0/2196680804 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a0151130 con 0x7f49a00b2eb0 2020-06-12T17:48:26.098 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.079+0000 7f498ffff700 1 -- 172.21.15.38:0/2196680804 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f49940064e0 con 0x7f49a00b2eb0 2020-06-12T17:48:26.098 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.079+0000 7f499e59c700 1 --2- 172.21.15.38:0/2196680804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49a00b2eb0 0x7f49a00b1710 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f49940010d0 tx=0x7f4994002810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.098 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.080+0000 7f498ffff700 1 --2- 172.21.15.38:0/2196680804 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f497c04d4d0 0x7f497c04f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:26.098 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.080+0000 7f498ffff700 1 -- 172.21.15.38:0/2196680804 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f4994060b90 con 0x7f49a00b2eb0 2020-06-12T17:48:26.099 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.080+0000 7f499ed9d700 1 --2- 172.21.15.38:0/2196680804 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f497c04d4d0 0x7f497c04f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:26.099 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.080+0000 7f499ed9d700 1 --2- 172.21.15.38:0/2196680804 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f497c04d4d0 0x7f497c04f990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4998000f00 tx=0x7f49980081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.099 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.080+0000 7f499ed9d700 1 --2- 172.21.15.38:0/2196680804 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f497c04d4d0 0x7f497c04f990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4998000f00 tx=0x7f49980081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.099 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.080+0000 7f499ed9d700 1 --2- 172.21.15.38:0/2196680804 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f497c04d4d0 0x7f497c04f990 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f4998000f00 tx=0x7f49980081e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:26.100 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.083+0000 7f499e59c700 1 --2- 172.21.15.38:0/2196680804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49a00b2eb0 0x7f49a00b1710 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f49940010d0 tx=0x7f4994002810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.100 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.083+0000 7f498ffff700 1 -- 172.21.15.38:0/2196680804 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f499403c270 con 0x7f49a00b2eb0 2020-06-12T17:48:26.238 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.234+0000 7f49a50b8700 1 -- 172.21.15.38:0/2196680804 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f49a00b1d00 con 0x7f49a00b2eb0 2020-06-12T17:48:26.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.235+0000 7f499e59c700 1 --2- 172.21.15.38:0/2196680804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49a00b2eb0 0x7f49a00b1710 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f49940010d0 tx=0x7f4994002810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.235+0000 7f498ffff700 1 -- 172.21.15.38:0/2196680804 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f499403f890 con 0x7f49a00b2eb0 2020-06-12T17:48:26.239 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:26.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.236+0000 7f49a50b8700 1 -- 172.21.15.38:0/2196680804 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f497c04d4d0 msgr2=0x7f497c04f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:26.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.236+0000 7f49a50b8700 1 --2- 172.21.15.38:0/2196680804 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f497c04d4d0 0x7f497c04f990 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f4998000f00 tx=0x7f49980081e0).stop 2020-06-12T17:48:26.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.236+0000 7f49a50b8700 1 -- 172.21.15.38:0/2196680804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49a00b2eb0 msgr2=0x7f49a00b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:26.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.236+0000 7f49a50b8700 1 --2- 172.21.15.38:0/2196680804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49a00b2eb0 0x7f49a00b1710 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f49940010d0 tx=0x7f4994002810).stop 2020-06-12T17:48:26.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.237+0000 7f49a50b8700 1 -- 172.21.15.38:0/2196680804 shutdown_connections 2020-06-12T17:48:26.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.237+0000 7f49a50b8700 1 --2- 172.21.15.38:0/2196680804 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f497c04d4d0 0x7f497c04f990 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:26.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.237+0000 7f49a50b8700 1 --2- 172.21.15.38:0/2196680804 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49a0146680 0x7f49a008ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:26.242 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.237+0000 7f49a50b8700 1 --2- 172.21.15.38:0/2196680804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49a00b2eb0 0x7f49a00b1710 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:26.242 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.237+0000 7f49a50b8700 1 -- 172.21.15.38:0/2196680804 >> 172.21.15.38:0/2196680804 conn(0x7f49a00b5a20 msgr2=0x7f49a00b6390 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:26.242 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.237+0000 7f49a50b8700 1 -- 172.21.15.38:0/2196680804 shutdown_connections 2020-06-12T17:48:26.242 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.237+0000 7f49a50b8700 1 -- 172.21.15.38:0/2196680804 wait complete. 2020-06-12T17:48:26.250 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-06-12T17:48:26.367 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.363+0000 7fae78834700 1 Processor -- start 2020-06-12T17:48:26.367 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.363+0000 7fae78834700 1 -- start start 2020-06-12T17:48:26.370 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.364+0000 7fae78834700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fae740ad5b0 0x7fae740b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:26.370 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.364+0000 7fae78834700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fae7409d8d0 0x7fae741421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:26.371 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.364+0000 7fae78834700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae74146d20 con 0x7fae74146680 2020-06-12T17:48:26.371 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.364+0000 7fae78834700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae74066a80 con 0x7fae7409d8d0 2020-06-12T17:48:26.371 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.364+0000 7fae78834700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae74146f50 con 0x7fae740ad5b0 2020-06-12T17:48:26.371 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.364+0000 7fae72d9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fae7409d8d0 0x7fae741421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:26.371 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.364+0000 7fae7259c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fae74146680 0x7fae7409d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37816/0 (socket says 172.21.15.38:37816) 2020-06-12T17:48:26.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.364+0000 7fae72d9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fae7409d8d0 0x7fae741421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36004/0 (socket says 172.21.15.38:36004) 2020-06-12T17:48:26.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.364+0000 7fae7259c700 1 -- 172.21.15.38:0/2169160796 learned_addr learned my addr 172.21.15.38:0/2169160796 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:26.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.364+0000 7fae71d9b700 1 --2- 172.21.15.38:0/2169160796 >> v2:172.21.15.150:3300/0 conn(0x7fae740ad5b0 0x7fae740b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:26.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.365+0000 7fae72d9d700 1 -- 172.21.15.38:0/2169160796 >> v2:172.21.15.150:3300/0 conn(0x7fae740ad5b0 msgr2=0x7fae740b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:26.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.365+0000 7fae72d9d700 1 --2- 172.21.15.38:0/2169160796 >> v2:172.21.15.150:3300/0 conn(0x7fae740ad5b0 0x7fae740b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:26.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.365+0000 7fae72d9d700 1 -- 172.21.15.38:0/2169160796 >> v1:172.21.15.38:6789/0 conn(0x7fae74146680 legacy=0x7fae7409d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:26.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.365+0000 7fae72d9d700 1 -- 172.21.15.38:0/2169160796 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae74146a60 con 0x7fae7409d8d0 2020-06-12T17:48:26.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.365+0000 7fae7159a700 1 -- 172.21.15.38:0/2169160796 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171388173 0 0) 0x7fae74146d20 con 0x7fae74146680 2020-06-12T17:48:26.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.365+0000 7fae71d9b700 1 --2- 172.21.15.38:0/2169160796 >> v2:172.21.15.150:3300/0 conn(0x7fae740ad5b0 0x7fae740b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:26.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.365+0000 7fae72d9d700 1 --2- 172.21.15.38:0/2169160796 >> v2:172.21.15.38:3300/0 conn(0x7fae7409d8d0 0x7fae741421d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fae6c002f30 tx=0x7fae6c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.365+0000 7fae72d9d700 1 --2- 172.21.15.38:0/2169160796 >> v2:172.21.15.38:3300/0 conn(0x7fae7409d8d0 0x7fae741421d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fae6c002f30 tx=0x7fae6c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.365+0000 7fae72d9d700 1 --2- 172.21.15.38:0/2169160796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae7409d8d0 0x7fae741421d0 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7fae6c002f30 tx=0x7fae6c007e60).ready entity=mon.0 client_cookie=dc584045da69d8be server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:26.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.365+0000 7fae72d9d700 1 --2- 172.21.15.38:0/2169160796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae7409d8d0 0x7fae741421d0 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7fae6c002f30 tx=0x7fae6c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.365+0000 7fae7159a700 1 -- 172.21.15.38:0/2169160796 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae6c011430 con 0x7fae7409d8d0 2020-06-12T17:48:26.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.365+0000 7fae72d9d700 1 --2- 172.21.15.38:0/2169160796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae7409d8d0 0x7fae741421d0 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7fae6c002f30 tx=0x7fae6c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.365+0000 7fae7159a700 1 -- 172.21.15.38:0/2169160796 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c011590 con 0x7fae7409d8d0 2020-06-12T17:48:26.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.365+0000 7fae72d9d700 1 --2- 172.21.15.38:0/2169160796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae7409d8d0 0x7fae741421d0 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7fae6c002f30 tx=0x7fae6c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.365+0000 7fae7159a700 1 -- 172.21.15.38:0/2169160796 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae6c011930 con 0x7fae7409d8d0 2020-06-12T17:48:26.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.365+0000 7fae78834700 1 -- 172.21.15.38:0/2169160796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae7409d8d0 msgr2=0x7fae741421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:26.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.365+0000 7fae78834700 1 --2- 172.21.15.38:0/2169160796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae7409d8d0 0x7fae741421d0 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7fae6c002f30 tx=0x7fae6c007e60).stop 2020-06-12T17:48:26.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.365+0000 7fae78834700 1 -- 172.21.15.38:0/2169160796 shutdown_connections 2020-06-12T17:48:26.376 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.365+0000 7fae78834700 1 --2- 172.21.15.38:0/2169160796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae7409d8d0 0x7fae741421d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:26.376 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.365+0000 7fae78834700 1 --2- 172.21.15.38:0/2169160796 >> v2:172.21.15.150:3300/0 conn(0x7fae740ad5b0 0x7fae740b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:26.376 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.365+0000 7fae78834700 1 -- 172.21.15.38:0/2169160796 >> 172.21.15.38:0/2169160796 conn(0x7fae740b5a20 msgr2=0x7fae7405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:26.376 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.366+0000 7fae78834700 1 -- 172.21.15.38:0/2169160796 shutdown_connections 2020-06-12T17:48:26.376 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.366+0000 7fae78834700 1 -- 172.21.15.38:0/2169160796 wait complete. 2020-06-12T17:48:26.377 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.366+0000 7fae78834700 1 Processor -- start 2020-06-12T17:48:26.377 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.367+0000 7fae78834700 1 -- start start 2020-06-12T17:48:26.380 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.367+0000 7fae78834700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fae7409d8d0 0x7fae7409cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:26.380 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.367+0000 7fae78834700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae7409cf10 con 0x7fae740ad5b0 2020-06-12T17:48:26.380 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.367+0000 7fae78834700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae740630a0 con 0x7fae74146680 2020-06-12T17:48:26.380 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.367+0000 7fae78834700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae74063340 con 0x7fae7409d8d0 2020-06-12T17:48:26.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.367+0000 7fae7259c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fae7409d8d0 0x7fae7409cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:26.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.367+0000 7fae7259c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fae7409d8d0 0x7fae7409cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36006/0 (socket says 172.21.15.38:36006) 2020-06-12T17:48:26.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.367+0000 7fae7259c700 1 -- 172.21.15.38:0/3384305879 learned_addr learned my addr 172.21.15.38:0/3384305879 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:26.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.367+0000 7fae71d9b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fae740ad5b0 0x7fae740b0410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37824/0 (socket says 172.21.15.38:37824) 2020-06-12T17:48:26.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.368+0000 7fae7259c700 1 -- 172.21.15.38:0/3384305879 >> v1:172.21.15.150:6789/0 conn(0x7fae74146680 legacy=0x7fae741385f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:26.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.368+0000 7fae7259c700 1 -- 172.21.15.38:0/3384305879 >> v1:172.21.15.38:6789/0 conn(0x7fae740ad5b0 legacy=0x7fae740b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:26.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.368+0000 7fae7259c700 1 -- 172.21.15.38:0/3384305879 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae740635e0 con 0x7fae7409d8d0 2020-06-12T17:48:26.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.368+0000 7fae637fe700 1 -- 172.21.15.38:0/3384305879 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4063000086 0 0) 0x7fae64002240 con 0x7fae740ad5b0 2020-06-12T17:48:26.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.368+0000 7fae7259c700 1 --2- 172.21.15.38:0/3384305879 >> v2:172.21.15.38:3300/0 conn(0x7fae7409d8d0 0x7fae7409cab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fae68000b80 tx=0x7fae680016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.368+0000 7fae7259c700 1 --2- 172.21.15.38:0/3384305879 >> v2:172.21.15.38:3300/0 conn(0x7fae7409d8d0 0x7fae7409cab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fae68000b80 tx=0x7fae680016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.368+0000 7fae7259c700 1 --2- 172.21.15.38:0/3384305879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae7409d8d0 0x7fae7409cab0 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7fae68000b80 tx=0x7fae680016e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:26.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.368+0000 7fae7259c700 1 --2- 172.21.15.38:0/3384305879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae7409d8d0 0x7fae7409cab0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7fae68000b80 tx=0x7fae680016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.368+0000 7fae637fe700 1 -- 172.21.15.38:0/3384305879 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae68005cf0 con 0x7fae7409d8d0 2020-06-12T17:48:26.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.368+0000 7fae7259c700 1 --2- 172.21.15.38:0/3384305879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae7409d8d0 0x7fae7409cab0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7fae68000b80 tx=0x7fae680016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.368+0000 7fae7259c700 1 --2- 172.21.15.38:0/3384305879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae7409d8d0 0x7fae7409cab0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7fae68000b80 tx=0x7fae680016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.368+0000 7fae637fe700 1 -- 172.21.15.38:0/3384305879 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae68005e50 con 0x7fae7409d8d0 2020-06-12T17:48:26.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.368+0000 7fae78834700 1 -- 172.21.15.38:0/3384305879 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae74066110 con 0x7fae7409d8d0 2020-06-12T17:48:26.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.368+0000 7fae637fe700 1 -- 172.21.15.38:0/3384305879 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae680062b0 con 0x7fae7409d8d0 2020-06-12T17:48:26.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.368+0000 7fae78834700 1 -- 172.21.15.38:0/3384305879 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae74138f40 con 0x7fae7409d8d0 2020-06-12T17:48:26.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.369+0000 7fae7259c700 1 --2- 172.21.15.38:0/3384305879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae7409d8d0 0x7fae7409cab0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7fae68000b80 tx=0x7fae680016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.369+0000 7fae637fe700 1 -- 172.21.15.38:0/3384305879 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fae680064e0 con 0x7fae7409d8d0 2020-06-12T17:48:26.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.369+0000 7fae7259c700 1 --2- 172.21.15.38:0/3384305879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae7409d8d0 0x7fae7409cab0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7fae68000b80 tx=0x7fae680016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.369+0000 7fae78834700 1 -- 172.21.15.38:0/3384305879 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae74056c30 con 0x7fae7409d8d0 2020-06-12T17:48:26.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.370+0000 7fae637fe700 1 --2- 172.21.15.38:0/3384305879 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fae5004d420 0x7fae5004f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:26.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.370+0000 7fae637fe700 1 -- 172.21.15.38:0/3384305879 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fae68060f70 con 0x7fae7409d8d0 2020-06-12T17:48:26.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.370+0000 7fae71d9b700 1 --2- 172.21.15.38:0/3384305879 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fae5004d420 0x7fae5004f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:26.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.370+0000 7fae71d9b700 1 --2- 172.21.15.38:0/3384305879 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fae5004d420 0x7fae5004f8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fae64003270 tx=0x7fae640024e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.370+0000 7fae71d9b700 1 --2- 172.21.15.38:0/3384305879 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fae5004d420 0x7fae5004f8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fae64003270 tx=0x7fae640024e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.370+0000 7fae71d9b700 1 --2- 172.21.15.38:0/3384305879 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fae5004d420 0x7fae5004f8e0 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7fae64003270 tx=0x7fae640024e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:26.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.373+0000 7fae7259c700 1 --2- 172.21.15.38:0/3384305879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae7409d8d0 0x7fae7409cab0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7fae68000b80 tx=0x7fae680016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.387 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.373+0000 7fae637fe700 1 -- 172.21.15.38:0/3384305879 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fae6803c670 con 0x7fae7409d8d0 2020-06-12T17:48:26.528 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.524+0000 7fae78834700 1 -- 172.21.15.38:0/3384305879 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fae740b0be0 con 0x7fae7409d8d0 2020-06-12T17:48:26.528 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.524+0000 7fae7259c700 1 --2- 172.21.15.38:0/3384305879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae7409d8d0 0x7fae7409cab0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7fae68000b80 tx=0x7fae680016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.529 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.524+0000 7fae637fe700 1 -- 172.21.15.38:0/3384305879 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7fae6803fc90 con 0x7fae7409d8d0 2020-06-12T17:48:26.529 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:26.530 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.526+0000 7fae78834700 1 -- 172.21.15.38:0/3384305879 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fae5004d420 msgr2=0x7fae5004f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:26.530 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.526+0000 7fae78834700 1 --2- 172.21.15.38:0/3384305879 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fae5004d420 0x7fae5004f8e0 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7fae64003270 tx=0x7fae640024e0).stop 2020-06-12T17:48:26.530 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.526+0000 7fae78834700 1 -- 172.21.15.38:0/3384305879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae7409d8d0 msgr2=0x7fae7409cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:26.531 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.526+0000 7fae78834700 1 --2- 172.21.15.38:0/3384305879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae7409d8d0 0x7fae7409cab0 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7fae68000b80 tx=0x7fae680016e0).stop 2020-06-12T17:48:26.531 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.526+0000 7fae78834700 1 -- 172.21.15.38:0/3384305879 shutdown_connections 2020-06-12T17:48:26.531 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.526+0000 7fae78834700 1 --2- 172.21.15.38:0/3384305879 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fae5004d420 0x7fae5004f8e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:26.531 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.526+0000 7fae78834700 1 --2- 172.21.15.38:0/3384305879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae7409d8d0 0x7fae7409cab0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:26.531 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.526+0000 7fae78834700 1 -- 172.21.15.38:0/3384305879 >> 172.21.15.38:0/3384305879 conn(0x7fae740b5a20 msgr2=0x7fae7405b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:26.532 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.526+0000 7fae78834700 1 -- 172.21.15.38:0/3384305879 shutdown_connections 2020-06-12T17:48:26.532 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.526+0000 7fae78834700 1 -- 172.21.15.38:0/3384305879 wait complete. 2020-06-12T17:48:26.539 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-06-12T17:48:26.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.654+0000 7f7c9d72e700 1 Processor -- start 2020-06-12T17:48:26.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.654+0000 7f7c9d72e700 1 -- start start 2020-06-12T17:48:26.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.655+0000 7f7c9d72e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7c98146680 0x7f7c980ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:26.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.655+0000 7f7c9d72e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c980b2eb0 0x7f7c9809d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:26.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.655+0000 7f7c9d72e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c98146d20 con 0x7f7c9809d620 2020-06-12T17:48:26.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.655+0000 7f7c9d72e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c98066a80 con 0x7f7c98146680 2020-06-12T17:48:26.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.655+0000 7f7c9d72e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c98146f50 con 0x7f7c980b2eb0 2020-06-12T17:48:26.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.655+0000 7f7c96ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7c98146680 0x7f7c980ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:26.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.655+0000 7f7c977fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7c9809d620 0x7f7c9809b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37830/0 (socket says 172.21.15.38:37830) 2020-06-12T17:48:26.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.655+0000 7f7c96ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7c98146680 0x7f7c980ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36014/0 (socket says 172.21.15.38:36014) 2020-06-12T17:48:26.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.655+0000 7f7c977fe700 1 -- 172.21.15.38:0/385941096 learned_addr learned my addr 172.21.15.38:0/385941096 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:26.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.655+0000 7f7c967fc700 1 --2- 172.21.15.38:0/385941096 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c980b2eb0 0x7f7c9809d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:26.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.655+0000 7f7c96ffd700 1 -- 172.21.15.38:0/385941096 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c980b2eb0 msgr2=0x7f7c9809d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:26.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.655+0000 7f7c96ffd700 1 --2- 172.21.15.38:0/385941096 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c980b2eb0 0x7f7c9809d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:26.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.655+0000 7f7c96ffd700 1 -- 172.21.15.38:0/385941096 >> v1:172.21.15.38:6789/0 conn(0x7f7c9809d620 legacy=0x7f7c9809b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:26.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.655+0000 7f7c96ffd700 1 -- 172.21.15.38:0/385941096 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c98146a60 con 0x7f7c98146680 2020-06-12T17:48:26.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.655+0000 7f7c95ffb700 1 -- 172.21.15.38:0/385941096 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 18499243 0 0) 0x7f7c98146d20 con 0x7f7c9809d620 2020-06-12T17:48:26.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.655+0000 7f7c967fc700 1 --2- 172.21.15.38:0/385941096 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c980b2eb0 0x7f7c9809d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:26.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.655+0000 7f7c96ffd700 1 --2- 172.21.15.38:0/385941096 >> v2:172.21.15.38:3300/0 conn(0x7f7c98146680 0x7f7c980ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7c8c002f30 tx=0x7f7c8c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.655+0000 7f7c96ffd700 1 --2- 172.21.15.38:0/385941096 >> v2:172.21.15.38:3300/0 conn(0x7f7c98146680 0x7f7c980ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7c8c002f30 tx=0x7f7c8c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.655+0000 7f7c96ffd700 1 --2- 172.21.15.38:0/385941096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c98146680 0x7f7c980ad5b0 secure :-1 s=READY pgs=181 cs=0 l=1 rx=0x7f7c8c002f30 tx=0x7f7c8c007e60).ready entity=mon.0 client_cookie=23fa3d187399dac9 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:26.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.656+0000 7f7c96ffd700 1 --2- 172.21.15.38:0/385941096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c98146680 0x7f7c980ad5b0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f7c8c002f30 tx=0x7f7c8c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.656+0000 7f7c95ffb700 1 -- 172.21.15.38:0/385941096 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c8c011430 con 0x7f7c98146680 2020-06-12T17:48:26.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.656+0000 7f7c96ffd700 1 --2- 172.21.15.38:0/385941096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c98146680 0x7f7c980ad5b0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f7c8c002f30 tx=0x7f7c8c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.656+0000 7f7c96ffd700 1 --2- 172.21.15.38:0/385941096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c98146680 0x7f7c980ad5b0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f7c8c002f30 tx=0x7f7c8c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.656+0000 7f7c95ffb700 1 -- 172.21.15.38:0/385941096 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c011590 con 0x7f7c98146680 2020-06-12T17:48:26.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.656+0000 7f7c95ffb700 1 -- 172.21.15.38:0/385941096 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c8c011970 con 0x7f7c98146680 2020-06-12T17:48:26.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.656+0000 7f7c9d72e700 1 -- 172.21.15.38:0/385941096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c98146680 msgr2=0x7f7c980ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:26.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.656+0000 7f7c9d72e700 1 --2- 172.21.15.38:0/385941096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c98146680 0x7f7c980ad5b0 secure :-1 s=READY pgs=181 cs=0 l=1 rx=0x7f7c8c002f30 tx=0x7f7c8c007e60).stop 2020-06-12T17:48:26.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.656+0000 7f7c9d72e700 1 -- 172.21.15.38:0/385941096 shutdown_connections 2020-06-12T17:48:26.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.656+0000 7f7c9d72e700 1 --2- 172.21.15.38:0/385941096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c98146680 0x7f7c980ad5b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:26.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.656+0000 7f7c9d72e700 1 --2- 172.21.15.38:0/385941096 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c980b2eb0 0x7f7c9809d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:26.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.656+0000 7f7c9d72e700 1 -- 172.21.15.38:0/385941096 >> 172.21.15.38:0/385941096 conn(0x7f7c980b5a20 msgr2=0x7f7c9805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:26.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.656+0000 7f7c9d72e700 1 -- 172.21.15.38:0/385941096 shutdown_connections 2020-06-12T17:48:26.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.656+0000 7f7c9d72e700 1 -- 172.21.15.38:0/385941096 wait complete. 2020-06-12T17:48:26.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.657+0000 7f7c9d72e700 1 Processor -- start 2020-06-12T17:48:26.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.657+0000 7f7c9d72e700 1 -- start start 2020-06-12T17:48:26.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.658+0000 7f7c9d72e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7c9809d620 0x7f7c980b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:26.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.658+0000 7f7c9d72e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c98146680 0x7f7c98065790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:26.673 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.658+0000 7f7c9d72e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c981553b0 con 0x7f7c980b2eb0 2020-06-12T17:48:26.673 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.658+0000 7f7c9d72e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c98155650 con 0x7f7c9809d620 2020-06-12T17:48:26.673 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.658+0000 7f7c9d72e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c980627d0 con 0x7f7c98146680 2020-06-12T17:48:26.674 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.658+0000 7f7c96ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7c9809d620 0x7f7c980b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:26.674 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.658+0000 7f7c96ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7c9809d620 0x7f7c980b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36020/0 (socket says 172.21.15.38:36020) 2020-06-12T17:48:26.674 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.658+0000 7f7c96ffd700 1 -- 172.21.15.38:0/2938863730 learned_addr learned my addr 172.21.15.38:0/2938863730 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:26.674 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.658+0000 7f7c96ffd700 1 -- 172.21.15.38:0/2938863730 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c98146680 msgr2=0x7f7c98065790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:26.674 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.658+0000 7f7c977fe700 1 --2- 172.21.15.38:0/2938863730 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c98146680 0x7f7c98065790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:26.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.658+0000 7f7c96ffd700 1 --2- 172.21.15.38:0/2938863730 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c98146680 0x7f7c98065790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:26.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.658+0000 7f7c96ffd700 1 -- 172.21.15.38:0/2938863730 >> v1:172.21.15.150:6789/0 conn(0x7f7c980b2eb0 legacy=0x7f7c98065080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:26.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.658+0000 7f7c96ffd700 1 -- 172.21.15.38:0/2938863730 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c98155000 con 0x7f7c9809d620 2020-06-12T17:48:26.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.658+0000 7f7c977fe700 1 --2- 172.21.15.38:0/2938863730 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c98146680 0x7f7c98065790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:48:26.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.658+0000 7f7c96ffd700 1 --2- 172.21.15.38:0/2938863730 >> v2:172.21.15.38:3300/0 conn(0x7f7c9809d620 0x7f7c980b3740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7c980b4390 tx=0x7f7c8c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.658+0000 7f7c96ffd700 1 --2- 172.21.15.38:0/2938863730 >> v2:172.21.15.38:3300/0 conn(0x7f7c9809d620 0x7f7c980b3740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7c980b4390 tx=0x7f7c8c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.658+0000 7f7c96ffd700 1 --2- 172.21.15.38:0/2938863730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c9809d620 0x7f7c980b3740 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f7c980b4390 tx=0x7f7c8c007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:26.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.658+0000 7f7c96ffd700 1 --2- 172.21.15.38:0/2938863730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c9809d620 0x7f7c980b3740 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f7c980b4390 tx=0x7f7c8c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.658+0000 7f7c87fff700 1 -- 172.21.15.38:0/2938863730 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c8c007150 con 0x7f7c9809d620 2020-06-12T17:48:26.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.659+0000 7f7c96ffd700 1 --2- 172.21.15.38:0/2938863730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c9809d620 0x7f7c980b3740 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f7c980b4390 tx=0x7f7c8c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.659+0000 7f7c96ffd700 1 --2- 172.21.15.38:0/2938863730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c9809d620 0x7f7c980b3740 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f7c980b4390 tx=0x7f7c8c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.659+0000 7f7c87fff700 1 -- 172.21.15.38:0/2938863730 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c0072b0 con 0x7f7c9809d620 2020-06-12T17:48:26.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.659+0000 7f7c9d72e700 1 -- 172.21.15.38:0/2938863730 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c98154920 con 0x7f7c9809d620 2020-06-12T17:48:26.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.659+0000 7f7c87fff700 1 -- 172.21.15.38:0/2938863730 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c8c0056c0 con 0x7f7c9809d620 2020-06-12T17:48:26.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.659+0000 7f7c9d72e700 1 -- 172.21.15.38:0/2938863730 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c980b3d60 con 0x7f7c9809d620 2020-06-12T17:48:26.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.659+0000 7f7c96ffd700 1 --2- 172.21.15.38:0/2938863730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c9809d620 0x7f7c980b3740 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f7c980b4390 tx=0x7f7c8c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.660+0000 7f7c9d72e700 1 -- 172.21.15.38:0/2938863730 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c981551f0 con 0x7f7c9809d620 2020-06-12T17:48:26.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.660+0000 7f7c87fff700 1 -- 172.21.15.38:0/2938863730 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f7c8c005930 con 0x7f7c9809d620 2020-06-12T17:48:26.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.660+0000 7f7c96ffd700 1 --2- 172.21.15.38:0/2938863730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c9809d620 0x7f7c980b3740 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f7c980b4390 tx=0x7f7c8c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.660+0000 7f7c87fff700 1 --2- 172.21.15.38:0/2938863730 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7c7404d680 0x7f7c7404fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:26.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.660+0000 7f7c87fff700 1 -- 172.21.15.38:0/2938863730 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f7c8c0614e0 con 0x7f7c9809d620 2020-06-12T17:48:26.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.660+0000 7f7c967fc700 1 --2- 172.21.15.38:0/2938863730 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7c7404d680 0x7f7c7404fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:26.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.661+0000 7f7c967fc700 1 --2- 172.21.15.38:0/2938863730 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7c7404d680 0x7f7c7404fb40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7c880032b0 tx=0x7f7c880098e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.661+0000 7f7c967fc700 1 --2- 172.21.15.38:0/2938863730 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7c7404d680 0x7f7c7404fb40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7c880032b0 tx=0x7f7c880098e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.661+0000 7f7c967fc700 1 --2- 172.21.15.38:0/2938863730 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7c7404d680 0x7f7c7404fb40 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f7c880032b0 tx=0x7f7c880098e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:26.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.663+0000 7f7c96ffd700 1 --2- 172.21.15.38:0/2938863730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c9809d620 0x7f7c980b3740 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f7c980b4390 tx=0x7f7c8c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.663+0000 7f7c87fff700 1 -- 172.21.15.38:0/2938863730 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f7c8c03cce0 con 0x7f7c9809d620 2020-06-12T17:48:26.818 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.814+0000 7f7c9d72e700 1 -- 172.21.15.38:0/2938863730 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7c98056c30 con 0x7f7c9809d620 2020-06-12T17:48:26.819 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.815+0000 7f7c96ffd700 1 --2- 172.21.15.38:0/2938863730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c9809d620 0x7f7c980b3740 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f7c980b4390 tx=0x7f7c8c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.819 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.815+0000 7f7c87fff700 1 -- 172.21.15.38:0/2938863730 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f7c8c007960 con 0x7f7c9809d620 2020-06-12T17:48:26.820 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:26.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.816+0000 7f7c9d72e700 1 -- 172.21.15.38:0/2938863730 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7c7404d680 msgr2=0x7f7c7404fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:26.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.816+0000 7f7c9d72e700 1 --2- 172.21.15.38:0/2938863730 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7c7404d680 0x7f7c7404fb40 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f7c880032b0 tx=0x7f7c880098e0).stop 2020-06-12T17:48:26.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.816+0000 7f7c9d72e700 1 -- 172.21.15.38:0/2938863730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c9809d620 msgr2=0x7f7c980b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:26.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.816+0000 7f7c9d72e700 1 --2- 172.21.15.38:0/2938863730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c9809d620 0x7f7c980b3740 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f7c980b4390 tx=0x7f7c8c007e60).stop 2020-06-12T17:48:26.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.816+0000 7f7c9d72e700 1 -- 172.21.15.38:0/2938863730 shutdown_connections 2020-06-12T17:48:26.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.816+0000 7f7c9d72e700 1 --2- 172.21.15.38:0/2938863730 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7c7404d680 0x7f7c7404fb40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:26.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.816+0000 7f7c9d72e700 1 --2- 172.21.15.38:0/2938863730 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c98146680 0x7f7c98065790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:26.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.816+0000 7f7c9d72e700 1 --2- 172.21.15.38:0/2938863730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c9809d620 0x7f7c980b3740 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:26.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.816+0000 7f7c9d72e700 1 -- 172.21.15.38:0/2938863730 >> 172.21.15.38:0/2938863730 conn(0x7f7c980b5a20 msgr2=0x7f7c9809dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:26.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.816+0000 7f7c9d72e700 1 -- 172.21.15.38:0/2938863730 shutdown_connections 2020-06-12T17:48:26.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.816+0000 7f7c9d72e700 1 -- 172.21.15.38:0/2938863730 wait complete. 2020-06-12T17:48:26.829 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-06-12T17:48:26.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.942+0000 7f814d8f3700 1 Processor -- start 2020-06-12T17:48:26.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.942+0000 7f814d8f3700 1 -- start start 2020-06-12T17:48:26.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.942+0000 7f814d8f3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f81480b3ba0 0x7f81480b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:26.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.942+0000 7f814d8f3700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81480b2dc0 con 0x7f8148061a80 2020-06-12T17:48:26.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.942+0000 7f814d8f3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f814809e560 con 0x7f814809bee0 2020-06-12T17:48:26.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.942+0000 7f814d8f3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81480b29d0 con 0x7f81480b3ba0 2020-06-12T17:48:26.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.943+0000 7f8146ffd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8148061a80 0x7f8148142350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37844/0 (socket says 172.21.15.38:37844) 2020-06-12T17:48:26.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.943+0000 7f8146ffd700 1 -- 172.21.15.38:0/1309453928 learned_addr learned my addr 172.21.15.38:0/1309453928 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:26.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.943+0000 7f81477fe700 1 --2- 172.21.15.38:0/1309453928 >> v2:172.21.15.150:3300/0 conn(0x7f81480b3ba0 0x7f81480b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:26.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.943+0000 7f81467fc700 1 -- 172.21.15.38:0/1309453928 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891031315 0 0) 0x7f81480b2dc0 con 0x7f8148061a80 2020-06-12T17:48:26.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.943+0000 7f81467fc700 1 -- 172.21.15.38:0/1309453928 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8128003230 con 0x7f8148061a80 2020-06-12T17:48:26.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.943+0000 7f81467fc700 1 -- 172.21.15.38:0/1309453928 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104046240 0 0) 0x7f814809e560 con 0x7f814809bee0 2020-06-12T17:48:26.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.943+0000 7f81467fc700 1 -- 172.21.15.38:0/1309453928 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81480b2dc0 con 0x7f814809bee0 2020-06-12T17:48:26.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.943+0000 7f81477fe700 1 -- 172.21.15.38:0/1309453928 >> v1:172.21.15.150:6789/0 conn(0x7f814809bee0 legacy=0x7f81480b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:26.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.943+0000 7f81467fc700 1 -- 172.21.15.38:0/1309453928 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1338360384 0 0) 0x7f8128003230 con 0x7f8148061a80 2020-06-12T17:48:26.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.943+0000 7f81477fe700 1 -- 172.21.15.38:0/1309453928 >> v1:172.21.15.38:6789/0 conn(0x7f8148061a80 legacy=0x7f8148142350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:26.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.943+0000 7f81477fe700 1 -- 172.21.15.38:0/1309453928 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81480b2ff0 con 0x7f81480b3ba0 2020-06-12T17:48:26.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.943+0000 7f81477fe700 1 --2- 172.21.15.38:0/1309453928 >> v2:172.21.15.150:3300/0 conn(0x7f81480b3ba0 0x7f81480b3ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f81380010d0 tx=0x7f81400081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.943+0000 7f81477fe700 1 --2- 172.21.15.38:0/1309453928 >> v2:172.21.15.150:3300/0 conn(0x7f81480b3ba0 0x7f81480b3ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f81380010d0 tx=0x7f81400081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.943+0000 7f81477fe700 1 --2- 172.21.15.38:0/1309453928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81480b3ba0 0x7f81480b3ff0 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7f81380010d0 tx=0x7f81400081e0).ready entity=mon.1 client_cookie=e31fed1c7d93dad9 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:26.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.943+0000 7f81477fe700 1 --2- 172.21.15.38:0/1309453928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81480b3ba0 0x7f81480b3ff0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f81380010d0 tx=0x7f81400081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.943+0000 7f81467fc700 1 -- 172.21.15.38:0/1309453928 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81380016d0 con 0x7f81480b3ba0 2020-06-12T17:48:26.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.943+0000 7f81477fe700 1 --2- 172.21.15.38:0/1309453928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81480b3ba0 0x7f81480b3ff0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f81380010d0 tx=0x7f81400081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.943+0000 7f81467fc700 1 -- 172.21.15.38:0/1309453928 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8140010920 con 0x7f81480b3ba0 2020-06-12T17:48:26.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.943+0000 7f81477fe700 1 --2- 172.21.15.38:0/1309453928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81480b3ba0 0x7f81480b3ff0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f81380010d0 tx=0x7f81400081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.943+0000 7f81467fc700 1 -- 172.21.15.38:0/1309453928 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8140010c80 con 0x7f81480b3ba0 2020-06-12T17:48:26.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.943+0000 7f814d8f3700 1 -- 172.21.15.38:0/1309453928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81480b3ba0 msgr2=0x7f81480b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:26.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.943+0000 7f814d8f3700 1 --2- 172.21.15.38:0/1309453928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81480b3ba0 0x7f81480b3ff0 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7f81380010d0 tx=0x7f81400081e0).stop 2020-06-12T17:48:26.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.944+0000 7f814d8f3700 1 -- 172.21.15.38:0/1309453928 shutdown_connections 2020-06-12T17:48:26.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.944+0000 7f814d8f3700 1 --2- 172.21.15.38:0/1309453928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81480b3ba0 0x7f81480b3ff0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:26.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.944+0000 7f814d8f3700 1 -- 172.21.15.38:0/1309453928 >> 172.21.15.38:0/1309453928 conn(0x7f81480b8420 msgr2=0x7f81480b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:26.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.944+0000 7f814d8f3700 1 -- 172.21.15.38:0/1309453928 shutdown_connections 2020-06-12T17:48:26.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.944+0000 7f814d8f3700 1 -- 172.21.15.38:0/1309453928 wait complete. 2020-06-12T17:48:26.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.945+0000 7f814d8f3700 1 Processor -- start 2020-06-12T17:48:26.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.945+0000 7f814d8f3700 1 -- start start 2020-06-12T17:48:26.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.946+0000 7f814d8f3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f814809bee0 0x7f8148066410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:26.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.946+0000 7f814d8f3700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f81480b3ba0 0x7f8148145690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:26.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.946+0000 7f814d8f3700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8148065a30 con 0x7f8148061a80 2020-06-12T17:48:26.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.946+0000 7f814d8f3700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8148065cd0 con 0x7f81480b3ba0 2020-06-12T17:48:26.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.946+0000 7f814d8f3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8148065f70 con 0x7f814809bee0 2020-06-12T17:48:26.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.946+0000 7f81477fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f81480b3ba0 0x7f8148145690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:26.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.946+0000 7f8146ffd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8148061a80 0x7f81480b5540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37850/0 (socket says 172.21.15.38:37850) 2020-06-12T17:48:26.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.946+0000 7f8146ffd700 1 -- 172.21.15.38:0/881298341 learned_addr learned my addr 172.21.15.38:0/881298341 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:26.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.946+0000 7f813ffff700 1 --2- 172.21.15.38:0/881298341 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f814809bee0 0x7f8148066410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:26.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.946+0000 7f81477fe700 1 -- 172.21.15.38:0/881298341 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f814809bee0 msgr2=0x7f8148066410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:26.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.946+0000 7f81477fe700 1 --2- 172.21.15.38:0/881298341 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f814809bee0 0x7f8148066410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:26.962 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.946+0000 7f81477fe700 1 -- 172.21.15.38:0/881298341 >> v1:172.21.15.38:6789/0 conn(0x7f8148061a80 legacy=0x7f81480b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:26.962 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.946+0000 7f81477fe700 1 -- 172.21.15.38:0/881298341 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8148066870 con 0x7f81480b3ba0 2020-06-12T17:48:26.962 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.946+0000 7f8144ff9700 1 -- 172.21.15.38:0/881298341 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959962080 0 0) 0x7f8148065a30 con 0x7f8148061a80 2020-06-12T17:48:26.962 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.946+0000 7f81477fe700 1 --2- 172.21.15.38:0/881298341 >> v2:172.21.15.38:3300/0 conn(0x7f81480b3ba0 0x7f8148145690 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f81380010d0 tx=0x7f81400081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.963 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.946+0000 7f81477fe700 1 --2- 172.21.15.38:0/881298341 >> v2:172.21.15.38:3300/0 conn(0x7f81480b3ba0 0x7f8148145690 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f81380010d0 tx=0x7f81400081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.963 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.946+0000 7f81477fe700 1 --2- 172.21.15.38:0/881298341 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81480b3ba0 0x7f8148145690 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f81380010d0 tx=0x7f81400081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:26.963 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.946+0000 7f81477fe700 1 --2- 172.21.15.38:0/881298341 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81480b3ba0 0x7f8148145690 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f81380010d0 tx=0x7f81400081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.963 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.946+0000 7f8144ff9700 1 -- 172.21.15.38:0/881298341 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f814000fbb0 con 0x7f81480b3ba0 2020-06-12T17:48:26.964 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.946+0000 7f81477fe700 1 --2- 172.21.15.38:0/881298341 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81480b3ba0 0x7f8148145690 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f81380010d0 tx=0x7f81400081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.964 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.946+0000 7f8144ff9700 1 -- 172.21.15.38:0/881298341 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8140005a40 con 0x7f81480b3ba0 2020-06-12T17:48:26.964 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.946+0000 7f814d8f3700 1 -- 172.21.15.38:0/881298341 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8148145af0 con 0x7f81480b3ba0 2020-06-12T17:48:26.965 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.946+0000 7f81477fe700 1 --2- 172.21.15.38:0/881298341 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81480b3ba0 0x7f8148145690 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f81380010d0 tx=0x7f81400081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.965 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.946+0000 7f8144ff9700 1 -- 172.21.15.38:0/881298341 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8140005e20 con 0x7f81480b3ba0 2020-06-12T17:48:26.965 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.946+0000 7f814d8f3700 1 -- 172.21.15.38:0/881298341 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f814809a5b0 con 0x7f81480b3ba0 2020-06-12T17:48:26.965 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.947+0000 7f81477fe700 1 --2- 172.21.15.38:0/881298341 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81480b3ba0 0x7f8148145690 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f81380010d0 tx=0x7f81400081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.965 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.947+0000 7f814d8f3700 1 -- 172.21.15.38:0/881298341 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8148056c30 con 0x7f81480b3ba0 2020-06-12T17:48:26.966 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.947+0000 7f8144ff9700 1 -- 172.21.15.38:0/881298341 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f8140007160 con 0x7f81480b3ba0 2020-06-12T17:48:26.966 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.947+0000 7f81477fe700 1 --2- 172.21.15.38:0/881298341 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81480b3ba0 0x7f8148145690 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f81380010d0 tx=0x7f81400081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.966 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.948+0000 7f8144ff9700 1 --2- 172.21.15.38:0/881298341 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f812c04d4d0 0x7f812c04f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:26.966 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.948+0000 7f8144ff9700 1 -- 172.21.15.38:0/881298341 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f8140008e40 con 0x7f81480b3ba0 2020-06-12T17:48:26.966 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.948+0000 7f8146ffd700 1 --2- 172.21.15.38:0/881298341 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f812c04d4d0 0x7f812c04f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:26.967 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.948+0000 7f8146ffd700 1 --2- 172.21.15.38:0/881298341 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f812c04d4d0 0x7f812c04f990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8138000f10 tx=0x7f8138001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.967 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.948+0000 7f8146ffd700 1 --2- 172.21.15.38:0/881298341 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f812c04d4d0 0x7f812c04f990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8138000f10 tx=0x7f8138001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.967 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.948+0000 7f8146ffd700 1 --2- 172.21.15.38:0/881298341 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f812c04d4d0 0x7f812c04f990 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f8138000f10 tx=0x7f8138001400).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:26.967 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.951+0000 7f81477fe700 1 --2- 172.21.15.38:0/881298341 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81480b3ba0 0x7f8148145690 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f81380010d0 tx=0x7f81400081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:26.967 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:26.951+0000 7f8144ff9700 1 -- 172.21.15.38:0/881298341 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f814003c8c0 con 0x7f81480b3ba0 2020-06-12T17:48:27.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.151+0000 7f814d8f3700 1 -- 172.21.15.38:0/881298341 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81480660b0 con 0x7f81480b3ba0 2020-06-12T17:48:27.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.151+0000 7f81477fe700 1 --2- 172.21.15.38:0/881298341 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81480b3ba0 0x7f8148145690 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f81380010d0 tx=0x7f81400081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:27.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.151+0000 7f8144ff9700 1 -- 172.21.15.38:0/881298341 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2137 (secure 0 0 0) 0x7f814003fee0 con 0x7f81480b3ba0 2020-06-12T17:48:27.156 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:27.156 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1134306892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1134306892},{"type":"v1","addr":"172.21.15.150:6835","nonce":1134306892}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-06-12T17:48:14.851844+0000","modified":"2020-06-12T17:48:18.530885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4389":{"gid":4389,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.38:6833/4064318189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":4064318189},{"type":"v1","addr":"172.21.15.38:6833","nonce":4064318189}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-06-12T17:48:27.157 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.152+0000 7f814d8f3700 1 -- 172.21.15.38:0/881298341 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f812c04d4d0 msgr2=0x7f812c04f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:27.157 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.152+0000 7f814d8f3700 1 --2- 172.21.15.38:0/881298341 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f812c04d4d0 0x7f812c04f990 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f8138000f10 tx=0x7f8138001400).stop 2020-06-12T17:48:27.158 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.152+0000 7f814d8f3700 1 -- 172.21.15.38:0/881298341 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81480b3ba0 msgr2=0x7f8148145690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:27.158 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.152+0000 7f814d8f3700 1 --2- 172.21.15.38:0/881298341 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81480b3ba0 0x7f8148145690 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f81380010d0 tx=0x7f81400081e0).stop 2020-06-12T17:48:27.158 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.152+0000 7f814d8f3700 1 -- 172.21.15.38:0/881298341 shutdown_connections 2020-06-12T17:48:27.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.153+0000 7f814d8f3700 1 --2- 172.21.15.38:0/881298341 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f812c04d4d0 0x7f812c04f990 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:27.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.153+0000 7f814d8f3700 1 --2- 172.21.15.38:0/881298341 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81480b3ba0 0x7f8148145690 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:27.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.153+0000 7f814d8f3700 1 --2- 172.21.15.38:0/881298341 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f814809bee0 0x7f8148066410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:27.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.153+0000 7f814d8f3700 1 -- 172.21.15.38:0/881298341 >> 172.21.15.38:0/881298341 conn(0x7f81480b8420 msgr2=0x7f81480b7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:27.160 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.153+0000 7f814d8f3700 1 -- 172.21.15.38:0/881298341 shutdown_connections 2020-06-12T17:48:27.160 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.153+0000 7f814d8f3700 1 -- 172.21.15.38:0/881298341 wait complete. 2020-06-12T17:48:27.160 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 6 2020-06-12T17:48:27.368 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-06-12T17:48:14.851844+0000', 'modified': '2020-06-12T17:48:18.530885+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4389}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4389': {'gid': 4389, 'name': 'a', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.38:6833/4064318189', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6832', 'nonce': 4064318189}, {'type': 'v1', 'addr': '172.21.15.38:6833', 'nonce': 4064318189}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292836696063, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-06-12T17:48:27.369 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-06-12T17:48:27.369 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-06-12T17:48:27.498 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2020-06-12T17:48:27.499 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "8e42a2e7-b187-42c4-a73f-8f812ee62352", 2020-06-12T17:48:27.499 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2020-06-12T17:48:27.499 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 4389, 2020-06-12T17:48:27.499 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2020-06-12T17:48:27.499 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2020-06-12T17:48:27.500 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 9.9652111039999998, 2020-06-12T17:48:27.500 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 6, 2020-06-12T17:48:27.500 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 24, 2020-06-12T17:48:27.500 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 24, 2020-06-12T17:48:27.500 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 10.241185160000001 2020-06-12T17:48:27.501 INFO:teuthology.orchestra.run.smithi038.stdout:} 2020-06-12T17:48:27.511 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "8e42a2e7-b187-42c4-a73f-8f812ee62352", "whoami": 0, "id": 4389, "want_state": "up:active", "state": "up:active", "rank_uptime": 9.9652111039999998, "mdsmap_epoch": 6, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "uptime": 10.241185160000001 } 2020-06-12T17:48:27.513 INFO:teuthology.run_tasks:Running task ceph-fuse... 2020-06-12T17:48:27.556 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2020-06-12T17:48:27.556 INFO:tasks.ceph_fuse:config is None 2020-06-12T17:48:27.557 INFO:tasks.ceph_fuse:new config is {'client.0': None, 'client.1': None, 'client.2': None, 'client.3': None} 2020-06-12T17:48:27.557 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2020-06-12T17:48:27.558 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-12T17:48:27.674 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.670+0000 7f2cabf8c700 1 Processor -- start 2020-06-12T17:48:27.674 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.671+0000 7f2cabf8c700 1 -- start start 2020-06-12T17:48:27.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.671+0000 7f2cabf8c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2ca4145ee0 0x7f2ca40b5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:27.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.671+0000 7f2cabf8c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2ca405be20 0x7f2ca40621b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:27.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.671+0000 7f2cabf8c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca41462c0 con 0x7f2ca4062610 2020-06-12T17:48:27.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.671+0000 7f2cabf8c700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca405c2b0 con 0x7f2ca405be20 2020-06-12T17:48:27.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.671+0000 7f2cabf8c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca40adfb0 con 0x7f2ca4145ee0 2020-06-12T17:48:27.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.671+0000 7f2ca9527700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2ca405be20 0x7f2ca40621b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:27.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.671+0000 7f2ca9527700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2ca405be20 0x7f2ca40621b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36044/0 (socket says 172.21.15.38:36044) 2020-06-12T17:48:27.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.671+0000 7f2ca9527700 1 -- 172.21.15.38:0/3464399758 learned_addr learned my addr 172.21.15.38:0/3464399758 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:27.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.672+0000 7f2ca9d28700 1 --2- 172.21.15.38:0/3464399758 >> v2:172.21.15.150:3300/0 conn(0x7f2ca4145ee0 0x7f2ca40b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:27.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.672+0000 7f2ca9527700 1 -- 172.21.15.38:0/3464399758 >> v2:172.21.15.150:3300/0 conn(0x7f2ca4145ee0 msgr2=0x7f2ca40b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:27.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.672+0000 7f2ca9527700 1 --2- 172.21.15.38:0/3464399758 >> v2:172.21.15.150:3300/0 conn(0x7f2ca4145ee0 0x7f2ca40b5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:27.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.672+0000 7f2ca9527700 1 -- 172.21.15.38:0/3464399758 >> v1:172.21.15.150:6789/0 conn(0x7f2ca4062610 legacy=0x7f2ca40b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:27.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.672+0000 7f2ca9527700 1 -- 172.21.15.38:0/3464399758 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca405c500 con 0x7f2ca405be20 2020-06-12T17:48:27.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.672+0000 7f2ca9d28700 1 --2- 172.21.15.38:0/3464399758 >> v2:172.21.15.150:3300/0 conn(0x7f2ca4145ee0 0x7f2ca40b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:27.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.672+0000 7f2ca9527700 1 --2- 172.21.15.38:0/3464399758 >> v2:172.21.15.38:3300/0 conn(0x7f2ca405be20 0x7f2ca40621b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2c98002f30 tx=0x7f2c98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:27.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.672+0000 7f2ca9527700 1 --2- 172.21.15.38:0/3464399758 >> v2:172.21.15.38:3300/0 conn(0x7f2ca405be20 0x7f2ca40621b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2c98002f30 tx=0x7f2c98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:27.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.672+0000 7f2ca9527700 1 --2- 172.21.15.38:0/3464399758 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ca405be20 0x7f2ca40621b0 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7f2c98002f30 tx=0x7f2c98007e60).ready entity=mon.0 client_cookie=c26e6accb494dc8a server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:27.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.672+0000 7f2ca9527700 1 --2- 172.21.15.38:0/3464399758 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ca405be20 0x7f2ca40621b0 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f2c98002f30 tx=0x7f2c98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:27.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.672+0000 7f2ca9527700 1 --2- 172.21.15.38:0/3464399758 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ca405be20 0x7f2ca40621b0 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f2c98002f30 tx=0x7f2c98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:27.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.672+0000 7f2ca8d26700 1 -- 172.21.15.38:0/3464399758 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c980116e0 con 0x7f2ca405be20 2020-06-12T17:48:27.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.672+0000 7f2ca9527700 1 --2- 172.21.15.38:0/3464399758 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ca405be20 0x7f2ca40621b0 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f2c98002f30 tx=0x7f2c98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:27.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.672+0000 7f2ca8d26700 1 -- 172.21.15.38:0/3464399758 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c98011840 con 0x7f2ca405be20 2020-06-12T17:48:27.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.672+0000 7f2ca8d26700 1 -- 172.21.15.38:0/3464399758 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c98011c20 con 0x7f2ca405be20 2020-06-12T17:48:27.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.672+0000 7f2cabf8c700 1 -- 172.21.15.38:0/3464399758 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ca405be20 msgr2=0x7f2ca40621b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:27.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.672+0000 7f2cabf8c700 1 --2- 172.21.15.38:0/3464399758 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ca405be20 0x7f2ca40621b0 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7f2c98002f30 tx=0x7f2c98007e60).stop 2020-06-12T17:48:27.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.673+0000 7f2cabf8c700 1 -- 172.21.15.38:0/3464399758 shutdown_connections 2020-06-12T17:48:27.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.673+0000 7f2cabf8c700 1 --2- 172.21.15.38:0/3464399758 >> v2:172.21.15.150:3300/0 conn(0x7f2ca4145ee0 0x7f2ca40b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:27.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.673+0000 7f2cabf8c700 1 --2- 172.21.15.38:0/3464399758 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ca405be20 0x7f2ca40621b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:27.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.673+0000 7f2cabf8c700 1 -- 172.21.15.38:0/3464399758 >> 172.21.15.38:0/3464399758 conn(0x7f2ca40b8ed0 msgr2=0x7f2ca40b92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:27.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.673+0000 7f2cabf8c700 1 -- 172.21.15.38:0/3464399758 shutdown_connections 2020-06-12T17:48:27.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.673+0000 7f2cabf8c700 1 -- 172.21.15.38:0/3464399758 wait complete. 2020-06-12T17:48:27.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.674+0000 7f2cabf8c700 1 Processor -- start 2020-06-12T17:48:27.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.674+0000 7f2cabf8c700 1 -- start start 2020-06-12T17:48:27.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.674+0000 7f2cabf8c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ca405be20 0x7f2ca409a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:27.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.674+0000 7f2cabf8c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2ca4062610 0x7f2ca409a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:27.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.674+0000 7f2cabf8c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca4066be0 con 0x7f2ca4145ee0 2020-06-12T17:48:27.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.674+0000 7f2cabf8c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca4156ef0 con 0x7f2ca4062610 2020-06-12T17:48:27.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.674+0000 7f2cabf8c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca4157190 con 0x7f2ca405be20 2020-06-12T17:48:27.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.675+0000 7f2ca9527700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2ca4062610 0x7f2ca409a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:27.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.675+0000 7f2ca9527700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2ca4062610 0x7f2ca409a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:45526/0 (socket says 172.21.15.38:45526) 2020-06-12T17:48:27.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.675+0000 7f2ca9d28700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ca405be20 0x7f2ca409a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:27.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.675+0000 7f2ca9527700 1 -- 172.21.15.38:0/4225905831 learned_addr learned my addr 172.21.15.38:0/4225905831 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:27.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.675+0000 7f2ca9527700 1 -- 172.21.15.38:0/4225905831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ca405be20 msgr2=0x7f2ca409a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:27.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.675+0000 7f2ca9527700 1 --2- 172.21.15.38:0/4225905831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ca405be20 0x7f2ca409a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:27.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.675+0000 7f2ca9527700 1 -- 172.21.15.38:0/4225905831 >> v1:172.21.15.150:6789/0 conn(0x7f2ca4145ee0 legacy=0x7f2ca4144fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:27.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.675+0000 7f2ca9527700 1 -- 172.21.15.38:0/4225905831 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca4157430 con 0x7f2ca4062610 2020-06-12T17:48:27.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.675+0000 7f2ca2ffd700 1 -- 172.21.15.38:0/4225905831 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078732395 0 0) 0x7f2ca4066be0 con 0x7f2ca4145ee0 2020-06-12T17:48:27.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.675+0000 7f2ca9d28700 1 --2- 172.21.15.38:0/4225905831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ca405be20 0x7f2ca409a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:27.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.675+0000 7f2ca9527700 1 --2- 172.21.15.38:0/4225905831 >> v2:172.21.15.150:3300/0 conn(0x7f2ca4062610 0x7f2ca409a870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2c98002f30 tx=0x7f2c98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:27.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.675+0000 7f2ca9527700 1 --2- 172.21.15.38:0/4225905831 >> v2:172.21.15.150:3300/0 conn(0x7f2ca4062610 0x7f2ca409a870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2c98002f30 tx=0x7f2c98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:27.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.675+0000 7f2ca9527700 1 --2- 172.21.15.38:0/4225905831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca4062610 0x7f2ca409a870 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f2c98002f30 tx=0x7f2c98007e60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:27.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.675+0000 7f2ca9527700 1 --2- 172.21.15.38:0/4225905831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca4062610 0x7f2ca409a870 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f2c98002f30 tx=0x7f2c98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:27.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.675+0000 7f2ca2ffd700 1 -- 172.21.15.38:0/4225905831 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c98011e90 con 0x7f2ca4062610 2020-06-12T17:48:27.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.675+0000 7f2ca9527700 1 --2- 172.21.15.38:0/4225905831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca4062610 0x7f2ca409a870 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f2c98002f30 tx=0x7f2c98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:27.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.675+0000 7f2cabf8c700 1 -- 172.21.15.38:0/4225905831 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca41456c0 con 0x7f2ca4062610 2020-06-12T17:48:27.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.675+0000 7f2ca2ffd700 1 -- 172.21.15.38:0/4225905831 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c98011ca0 con 0x7f2ca4062610 2020-06-12T17:48:27.705 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.675+0000 7f2ca9527700 1 --2- 172.21.15.38:0/4225905831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca4062610 0x7f2ca409a870 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f2c98002f30 tx=0x7f2c98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:27.705 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.675+0000 7f2ca2ffd700 1 -- 172.21.15.38:0/4225905831 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c98007530 con 0x7f2ca4062610 2020-06-12T17:48:27.705 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.675+0000 7f2cabf8c700 1 -- 172.21.15.38:0/4225905831 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca40b8650 con 0x7f2ca4062610 2020-06-12T17:48:27.705 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.676+0000 7f2ca9527700 1 --2- 172.21.15.38:0/4225905831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca4062610 0x7f2ca409a870 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f2c98002f30 tx=0x7f2c98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:27.705 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.676+0000 7f2cabf8c700 1 -- 172.21.15.38:0/4225905831 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca4056c30 con 0x7f2ca4062610 2020-06-12T17:48:27.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.676+0000 7f2ca9527700 1 --2- 172.21.15.38:0/4225905831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca4062610 0x7f2ca409a870 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f2c98002f30 tx=0x7f2c98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:27.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.676+0000 7f2ca2ffd700 1 -- 172.21.15.38:0/4225905831 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f2c980056c0 con 0x7f2ca4062610 2020-06-12T17:48:27.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.677+0000 7f2ca2ffd700 1 --2- 172.21.15.38:0/4225905831 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2c8404d560 0x7f2c8404fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:27.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.677+0000 7f2ca2ffd700 1 -- 172.21.15.38:0/4225905831 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f2c980615d0 con 0x7f2ca4062610 2020-06-12T17:48:27.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.677+0000 7f2ca9d28700 1 --2- 172.21.15.38:0/4225905831 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2c8404d560 0x7f2c8404fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:27.707 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.677+0000 7f2ca9d28700 1 --2- 172.21.15.38:0/4225905831 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2c8404d560 0x7f2c8404fa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2c9c0032b0 tx=0x7f2c9c00e320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:27.707 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.677+0000 7f2ca9d28700 1 --2- 172.21.15.38:0/4225905831 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2c8404d560 0x7f2c8404fa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2c9c0032b0 tx=0x7f2c9c00e320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:27.707 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.677+0000 7f2ca9d28700 1 --2- 172.21.15.38:0/4225905831 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2c8404d560 0x7f2c8404fa20 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f2c9c0032b0 tx=0x7f2c9c00e320).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:27.707 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.680+0000 7f2ca9527700 1 --2- 172.21.15.38:0/4225905831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca4062610 0x7f2ca409a870 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f2c98002f30 tx=0x7f2c98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:27.708 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.680+0000 7f2ca2ffd700 1 -- 172.21.15.38:0/4225905831 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f2c9803cc70 con 0x7f2ca4062610 2020-06-12T17:48:27.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.833+0000 7f2cabf8c700 1 -- 172.21.15.38:0/4225905831 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ca405cdb0 con 0x7f2ca4062610 2020-06-12T17:48:27.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.834+0000 7f2ca9527700 1 --2- 172.21.15.38:0/4225905831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca4062610 0x7f2ca409a870 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f2c98002f30 tx=0x7f2c98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:27.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.835+0000 7f2ca2ffd700 1 -- 172.21.15.38:0/4225905831 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16347 (secure 0 0 0) 0x7f2c98040290 con 0x7f2ca4062610 2020-06-12T17:48:27.839 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:27.839 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":24,"fsid":"8e42a2e7-b187-42c4-a73f-8f812ee62352","created":"2020-06-12T17:47:54.434340+0000","modified":"2020-06-12T17:48:14.851712+0000","last_up_change":"2020-06-12T17:48:03.388718+0000","last_in_change":"2020-06-12T17:48:03.388718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-06-12T17:47:57.558119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-06-12T17:48:07.419264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-06-12T17:48:09.934098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-06-12T17:48:12.497229+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"44ac3dea-67b4-4b9a-bc18-ac511710afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":31038},{"type":"v1","addr":"172.21.15.38:6816","nonce":31038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":31038},{"type":"v1","addr":"172.21.15.38:6819","nonce":31038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":31038},{"type":"v1","addr":"172.21.15.38:6823","nonce":31038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":31038},{"type":"v1","addr":"172.21.15.38:6821","nonce":31038}]},"public_addr":"172.21.15.38:6816/31038","cluster_addr":"172.21.15.38:6819/31038","heartbeat_back_addr":"172.21.15.38:6823/31038","heartbeat_front_addr":"172.21.15.38:6821/31038","state":["exists","up"]},{"osd":1,"uuid":"561f7ced-3fff-4364-8619-6e4ecbc9d256","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":31036},{"type":"v1","addr":"172.21.15.38:6801","nonce":31036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":31036},{"type":"v1","addr":"172.21.15.38:6803","nonce":31036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":31036},{"type":"v1","addr":"172.21.15.38:6807","nonce":31036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":31036},{"type":"v1","addr":"172.21.15.38:6805","nonce":31036}]},"public_addr":"172.21.15.38:6801/31036","cluster_addr":"172.21.15.38:6803/31036","heartbeat_back_addr":"172.21.15.38:6807/31036","heartbeat_front_addr":"172.21.15.38:6805/31036","state":["exists","up"]},{"osd":2,"uuid":"0bb3c806-07af-49f5-b492-d0e33f2de37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":31053},{"type":"v1","addr":"172.21.15.38:6825","nonce":31053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":31053},{"type":"v1","addr":"172.21.15.38:6827","nonce":31053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":31053},{"type":"v1","addr":"172.21.15.38:6831","nonce":31053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":31053},{"type":"v1","addr":"172.21.15.38:6829","nonce":31053}]},"public_addr":"172.21.15.38:6825/31053","cluster_addr":"172.21.15.38:6827/31053","heartbeat_back_addr":"172.21.15.38:6831/31053","heartbeat_front_addr":"172.21.15.38:6829/31053","state":["exists","up"]},{"osd":3,"uuid":"7f6a1e75-7b11-456e-8a4b-510b16226800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":31037},{"type":"v1","addr":"172.21.15.38:6809","nonce":31037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":31037},{"type":"v1","addr":"172.21.15.38:6811","nonce":31037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6815","nonce":31037},{"type":"v1","addr":"172.21.15.38:6817","nonce":31037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":31037},{"type":"v1","addr":"172.21.15.38:6813","nonce":31037}]},"public_addr":"172.21.15.38:6809/31037","cluster_addr":"172.21.15.38:6811/31037","heartbeat_back_addr":"172.21.15.38:6817/31037","heartbeat_front_addr":"172.21.15.38:6813/31037","state":["exists","up"]},{"osd":4,"uuid":"0eca0272-8cfd-469c-a32d-e29730dc0e1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":31294},{"type":"v1","addr":"172.21.15.150:6803","nonce":31294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":31294},{"type":"v1","addr":"172.21.15.150:6805","nonce":31294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":31294},{"type":"v1","addr":"172.21.15.150:6809","nonce":31294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":31294},{"type":"v1","addr":"172.21.15.150:6807","nonce":31294}]},"public_addr":"172.21.15.150:6803/31294","cluster_addr":"172.21.15.150:6805/31294","heartbeat_back_addr":"172.21.15.150:6809/31294","heartbeat_front_addr":"172.21.15.150:6807/31294","state":["exists","up"]},{"osd":5,"uuid":"69d6a7dc-a55a-4ebc-8479-8bb921ddfb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":31295},{"type":"v1","addr":"172.21.15.150:6813","nonce":31295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":31295},{"type":"v1","addr":"172.21.15.150:6816","nonce":31295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":31295},{"type":"v1","addr":"172.21.15.150:6828","nonce":31295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6819","nonce":31295},{"type":"v1","addr":"172.21.15.150:6822","nonce":31295}]},"public_addr":"172.21.15.150:6813/31295","cluster_addr":"172.21.15.150:6816/31295","heartbeat_back_addr":"172.21.15.150:6828/31295","heartbeat_front_addr":"172.21.15.150:6822/31295","state":["exists","up"]},{"osd":6,"uuid":"f0d320f8-c2f0-40bb-b713-526246cf97b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":31297},{"type":"v1","addr":"172.21.15.150:6820","nonce":31297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6823","nonce":31297},{"type":"v1","addr":"172.21.15.150:6827","nonce":31297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":31297},{"type":"v1","addr":"172.21.15.150:6833","nonce":31297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":31297},{"type":"v1","addr":"172.21.15.150:6831","nonce":31297}]},"public_addr":"172.21.15.150:6820/31297","cluster_addr":"172.21.15.150:6827/31297","heartbeat_back_addr":"172.21.15.150:6833/31297","heartbeat_front_addr":"172.21.15.150:6831/31297","state":["exists","up"]},{"osd":7,"uuid":"970b7d02-a189-41b2-96e5-a5a5a57c6476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":31296},{"type":"v1","addr":"172.21.15.150:6812","nonce":31296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":31296},{"type":"v1","addr":"172.21.15.150:6818","nonce":31296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":31296},{"type":"v1","addr":"172.21.15.150:6829","nonce":31296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":31296},{"type":"v1","addr":"172.21.15.150:6824","nonce":31296}]},"public_addr":"172.21.15.150:6812/31296","cluster_addr":"172.21.15.150:6818/31296","heartbeat_back_addr":"172.21.15.150:6829/31296","heartbeat_front_addr":"172.21.15.150:6824/31296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.664300+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.644253+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.651120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.584978+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.561149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.661778+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T17:48:27.841 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.836+0000 7f2cabf8c700 1 -- 172.21.15.38:0/4225905831 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2c8404d560 msgr2=0x7f2c8404fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:27.841 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.836+0000 7f2cabf8c700 1 --2- 172.21.15.38:0/4225905831 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2c8404d560 0x7f2c8404fa20 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f2c9c0032b0 tx=0x7f2c9c00e320).stop 2020-06-12T17:48:27.841 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.836+0000 7f2cabf8c700 1 -- 172.21.15.38:0/4225905831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca4062610 msgr2=0x7f2ca409a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:27.841 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.836+0000 7f2cabf8c700 1 --2- 172.21.15.38:0/4225905831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca4062610 0x7f2ca409a870 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f2c98002f30 tx=0x7f2c98007e60).stop 2020-06-12T17:48:27.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.836+0000 7f2cabf8c700 1 -- 172.21.15.38:0/4225905831 shutdown_connections 2020-06-12T17:48:27.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.836+0000 7f2cabf8c700 1 --2- 172.21.15.38:0/4225905831 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2c8404d560 0x7f2c8404fa20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:27.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.836+0000 7f2cabf8c700 1 --2- 172.21.15.38:0/4225905831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ca405be20 0x7f2ca409a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:27.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.836+0000 7f2cabf8c700 1 --2- 172.21.15.38:0/4225905831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca4062610 0x7f2ca409a870 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:27.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.836+0000 7f2cabf8c700 1 -- 172.21.15.38:0/4225905831 >> 172.21.15.38:0/4225905831 conn(0x7f2ca40b8ed0 msgr2=0x7f2ca405b450 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:27.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.836+0000 7f2cabf8c700 1 -- 172.21.15.38:0/4225905831 shutdown_connections 2020-06-12T17:48:27.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.836+0000 7f2cabf8c700 1 -- 172.21.15.38:0/4225905831 wait complete. 2020-06-12T17:48:27.850 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-06-12T17:47:57.558119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-06-12T17:48:07.419264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-06-12T17:48:09.934098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-06-12T17:48:12.497229+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-06-12T17:48:27.851 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-06-12T17:48:27.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.965+0000 7f2da00de700 1 Processor -- start 2020-06-12T17:48:27.978 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.965+0000 7f2da00de700 1 -- start start 2020-06-12T17:48:27.978 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.966+0000 7f2da00de700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2d98065420 0x7f2d9805b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:27.978 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.966+0000 7f2da00de700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2d98146090 0x7f2d98146520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:27.979 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.966+0000 7f2da00de700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d9805c8e0 con 0x7f2d980b7070 2020-06-12T17:48:27.979 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.966+0000 7f2da00de700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d98149700 con 0x7f2d98065420 2020-06-12T17:48:27.979 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.966+0000 7f2da00de700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d9805cb80 con 0x7f2d98146090 2020-06-12T17:48:27.979 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.966+0000 7f2d9de7a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2d98065420 0x7f2d9805b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:27.979 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.966+0000 7f2d9de7a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2d98065420 0x7f2d9805b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36056/0 (socket says 172.21.15.38:36056) 2020-06-12T17:48:27.980 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.966+0000 7f2d9de7a700 1 -- 172.21.15.38:0/479379045 learned_addr learned my addr 172.21.15.38:0/479379045 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:27.980 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.967+0000 7f2d9d679700 1 --2- 172.21.15.38:0/479379045 >> v2:172.21.15.150:3300/0 conn(0x7f2d98146090 0x7f2d98146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:27.980 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.967+0000 7f2d9de7a700 1 -- 172.21.15.38:0/479379045 >> v2:172.21.15.150:3300/0 conn(0x7f2d98146090 msgr2=0x7f2d98146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:27.980 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.967+0000 7f2d9de7a700 1 --2- 172.21.15.38:0/479379045 >> v2:172.21.15.150:3300/0 conn(0x7f2d98146090 0x7f2d98146520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:27.980 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.967+0000 7f2d9de7a700 1 -- 172.21.15.38:0/479379045 >> v1:172.21.15.150:6789/0 conn(0x7f2d980b7070 legacy=0x7f2d98149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:27.981 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.967+0000 7f2d9de7a700 1 -- 172.21.15.38:0/479379045 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9805c560 con 0x7f2d98065420 2020-06-12T17:48:27.981 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.967+0000 7f2d9de7a700 1 --2- 172.21.15.38:0/479379045 >> v2:172.21.15.38:3300/0 conn(0x7f2d98065420 0x7f2d9805b0a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2d88002f30 tx=0x7f2d88007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:27.981 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.967+0000 7f2d9de7a700 1 --2- 172.21.15.38:0/479379045 >> v2:172.21.15.38:3300/0 conn(0x7f2d98065420 0x7f2d9805b0a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2d88002f30 tx=0x7f2d88007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:27.981 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.967+0000 7f2d9de7a700 1 --2- 172.21.15.38:0/479379045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d98065420 0x7f2d9805b0a0 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7f2d88002f30 tx=0x7f2d88007e60).ready entity=mon.0 client_cookie=58f50dfd1d0025a0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:27.981 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.967+0000 7f2d9de7a700 1 --2- 172.21.15.38:0/479379045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d98065420 0x7f2d9805b0a0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f2d88002f30 tx=0x7f2d88007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:27.982 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.967+0000 7f2d9ce78700 1 -- 172.21.15.38:0/479379045 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d880116e0 con 0x7f2d98065420 2020-06-12T17:48:27.982 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.967+0000 7f2d9de7a700 1 --2- 172.21.15.38:0/479379045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d98065420 0x7f2d9805b0a0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f2d88002f30 tx=0x7f2d88007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:27.982 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.967+0000 7f2d9de7a700 1 --2- 172.21.15.38:0/479379045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d98065420 0x7f2d9805b0a0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f2d88002f30 tx=0x7f2d88007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:27.988 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.967+0000 7f2d9ce78700 1 -- 172.21.15.38:0/479379045 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d88011840 con 0x7f2d98065420 2020-06-12T17:48:27.989 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.967+0000 7f2d9ce78700 1 -- 172.21.15.38:0/479379045 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d88011c20 con 0x7f2d98065420 2020-06-12T17:48:27.989 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.967+0000 7f2da00de700 1 -- 172.21.15.38:0/479379045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d98065420 msgr2=0x7f2d9805b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:27.989 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.967+0000 7f2da00de700 1 --2- 172.21.15.38:0/479379045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d98065420 0x7f2d9805b0a0 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7f2d88002f30 tx=0x7f2d88007e60).stop 2020-06-12T17:48:27.989 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.967+0000 7f2da00de700 1 -- 172.21.15.38:0/479379045 shutdown_connections 2020-06-12T17:48:27.989 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.967+0000 7f2da00de700 1 --2- 172.21.15.38:0/479379045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d98065420 0x7f2d9805b0a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:27.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.967+0000 7f2da00de700 1 --2- 172.21.15.38:0/479379045 >> v2:172.21.15.150:3300/0 conn(0x7f2d98146090 0x7f2d98146520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:27.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.967+0000 7f2da00de700 1 -- 172.21.15.38:0/479379045 >> 172.21.15.38:0/479379045 conn(0x7f2d980ba610 msgr2=0x7f2d980baa20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:27.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.968+0000 7f2da00de700 1 -- 172.21.15.38:0/479379045 shutdown_connections 2020-06-12T17:48:27.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.968+0000 7f2da00de700 1 -- 172.21.15.38:0/479379045 wait complete. 2020-06-12T17:48:27.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.968+0000 7f2da00de700 1 Processor -- start 2020-06-12T17:48:27.991 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.969+0000 7f2da00de700 1 -- start start 2020-06-12T17:48:27.991 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.969+0000 7f2da00de700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2d98065420 0x7f2d98148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:27.991 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.969+0000 7f2da00de700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d980b7070 0x7f2d9809ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:27.991 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.969+0000 7f2da00de700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2d98146090 0x7f2d9813f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:27.991 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.969+0000 7f2da00de700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d98143fb0 con 0x7f2d98146090 2020-06-12T17:48:27.992 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.969+0000 7f2da00de700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d98144250 con 0x7f2d98065420 2020-06-12T17:48:27.992 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.969+0000 7f2da00de700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d981444f0 con 0x7f2d980b7070 2020-06-12T17:48:27.992 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.969+0000 7f2d9e67b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2d98146090 0x7f2d9813f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:27.992 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.969+0000 7f2d9e67b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2d98146090 0x7f2d9813f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36064/0 (socket says 172.21.15.38:36064) 2020-06-12T17:48:27.992 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.969+0000 7f2d9e67b700 1 -- 172.21.15.38:0/322684295 learned_addr learned my addr 172.21.15.38:0/322684295 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:27.993 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.969+0000 7f2d9de7a700 1 --2- 172.21.15.38:0/322684295 >> v2:172.21.15.150:3300/0 conn(0x7f2d98065420 0x7f2d98148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:27.993 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.969+0000 7f2d9d679700 1 --2- 172.21.15.38:0/322684295 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d980b7070 0x7f2d9809ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:27.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.970+0000 7f2d9e67b700 1 -- 172.21.15.38:0/322684295 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d980b7070 msgr2=0x7f2d9809ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:27.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.970+0000 7f2d9e67b700 1 --2- 172.21.15.38:0/322684295 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d980b7070 0x7f2d9809ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:27.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.970+0000 7f2d9e67b700 1 -- 172.21.15.38:0/322684295 >> v2:172.21.15.150:3300/0 conn(0x7f2d98065420 msgr2=0x7f2d98148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:27.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.970+0000 7f2d9e67b700 1 --2- 172.21.15.38:0/322684295 >> v2:172.21.15.150:3300/0 conn(0x7f2d98065420 0x7f2d98148a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:27.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.970+0000 7f2d9e67b700 1 -- 172.21.15.38:0/322684295 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9809df30 con 0x7f2d98146090 2020-06-12T17:48:27.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.970+0000 7f2d9e67b700 1 --2- 172.21.15.38:0/322684295 >> v2:172.21.15.38:3300/0 conn(0x7f2d98146090 0x7f2d9813f5e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2d980b4de0 tx=0x7f2d90001ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:27.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.970+0000 7f2d9e67b700 1 --2- 172.21.15.38:0/322684295 >> v2:172.21.15.38:3300/0 conn(0x7f2d98146090 0x7f2d9813f5e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2d980b4de0 tx=0x7f2d90001ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:27.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.970+0000 7f2d9e67b700 1 --2- 172.21.15.38:0/322684295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d98146090 0x7f2d9813f5e0 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7f2d980b4de0 tx=0x7f2d90001ba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:27.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.970+0000 7f2d9e67b700 1 --2- 172.21.15.38:0/322684295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d98146090 0x7f2d9813f5e0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f2d980b4de0 tx=0x7f2d90001ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.970+0000 7f2d9e67b700 1 --2- 172.21.15.38:0/322684295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d98146090 0x7f2d9813f5e0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f2d980b4de0 tx=0x7f2d90001ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.970+0000 7f2d86ffd700 1 -- 172.21.15.38:0/322684295 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d9000cca0 con 0x7f2d98146090 2020-06-12T17:48:28.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.970+0000 7f2d9e67b700 1 --2- 172.21.15.38:0/322684295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d98146090 0x7f2d9813f5e0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f2d980b4de0 tx=0x7f2d90001ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.970+0000 7f2d86ffd700 1 -- 172.21.15.38:0/322684295 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9000ce00 con 0x7f2d98146090 2020-06-12T17:48:28.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.970+0000 7f2da00de700 1 -- 172.21.15.38:0/322684295 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d981403f0 con 0x7f2d98146090 2020-06-12T17:48:28.001 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.970+0000 7f2d86ffd700 1 -- 172.21.15.38:0/322684295 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d90010360 con 0x7f2d98146090 2020-06-12T17:48:28.001 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.970+0000 7f2da00de700 1 -- 172.21.15.38:0/322684295 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d980a05f0 con 0x7f2d98146090 2020-06-12T17:48:28.001 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.971+0000 7f2d9e67b700 1 --2- 172.21.15.38:0/322684295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d98146090 0x7f2d9813f5e0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f2d980b4de0 tx=0x7f2d90001ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.971+0000 7f2da00de700 1 -- 172.21.15.38:0/322684295 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d98056c30 con 0x7f2d98146090 2020-06-12T17:48:28.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.971+0000 7f2d86ffd700 1 -- 172.21.15.38:0/322684295 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f2d90010580 con 0x7f2d98146090 2020-06-12T17:48:28.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.971+0000 7f2d9e67b700 1 --2- 172.21.15.38:0/322684295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d98146090 0x7f2d9813f5e0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f2d980b4de0 tx=0x7f2d90001ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.971+0000 7f2d86ffd700 1 --2- 172.21.15.38:0/322684295 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2d7804d560 0x7f2d7804fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:28.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.971+0000 7f2d86ffd700 1 -- 172.21.15.38:0/322684295 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f2d90060d80 con 0x7f2d98146090 2020-06-12T17:48:28.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.972+0000 7f2d9de7a700 1 --2- 172.21.15.38:0/322684295 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2d7804d560 0x7f2d7804fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:28.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.972+0000 7f2d9de7a700 1 --2- 172.21.15.38:0/322684295 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2d7804d560 0x7f2d7804fa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2d88002f30 tx=0x7f2d88007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.972+0000 7f2d9de7a700 1 --2- 172.21.15.38:0/322684295 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2d7804d560 0x7f2d7804fa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2d88002f30 tx=0x7f2d88007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.972+0000 7f2d9de7a700 1 --2- 172.21.15.38:0/322684295 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2d7804d560 0x7f2d7804fa20 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f2d88002f30 tx=0x7f2d88007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:28.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.975+0000 7f2d9e67b700 1 --2- 172.21.15.38:0/322684295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d98146090 0x7f2d9813f5e0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f2d980b4de0 tx=0x7f2d90001ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:27.975+0000 7f2d86ffd700 1 -- 172.21.15.38:0/322684295 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f2d9003c4e0 con 0x7f2d98146090 2020-06-12T17:48:28.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.130+0000 7f2da00de700 1 -- 172.21.15.38:0/322684295 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2d9805a5e0 con 0x7f2d98146090 2020-06-12T17:48:28.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.130+0000 7f2d9e67b700 1 --2- 172.21.15.38:0/322684295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d98146090 0x7f2d9813f5e0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f2d980b4de0 tx=0x7f2d90001ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.130+0000 7f2d86ffd700 1 -- 172.21.15.38:0/322684295 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2d9003fb00 con 0x7f2d98146090 2020-06-12T17:48:28.135 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2020-06-12T17:48:28.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.132+0000 7f2da00de700 1 -- 172.21.15.38:0/322684295 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2d7804d560 msgr2=0x7f2d7804fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:28.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.132+0000 7f2da00de700 1 --2- 172.21.15.38:0/322684295 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2d7804d560 0x7f2d7804fa20 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f2d88002f30 tx=0x7f2d88007e60).stop 2020-06-12T17:48:28.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.132+0000 7f2da00de700 1 -- 172.21.15.38:0/322684295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d98146090 msgr2=0x7f2d9813f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:28.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.132+0000 7f2da00de700 1 --2- 172.21.15.38:0/322684295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d98146090 0x7f2d9813f5e0 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7f2d980b4de0 tx=0x7f2d90001ba0).stop 2020-06-12T17:48:28.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.132+0000 7f2da00de700 1 -- 172.21.15.38:0/322684295 shutdown_connections 2020-06-12T17:48:28.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.132+0000 7f2da00de700 1 --2- 172.21.15.38:0/322684295 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2d7804d560 0x7f2d7804fa20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:28.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.132+0000 7f2da00de700 1 --2- 172.21.15.38:0/322684295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d98146090 0x7f2d9813f5e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:28.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.132+0000 7f2da00de700 1 --2- 172.21.15.38:0/322684295 >> v2:172.21.15.150:3300/0 conn(0x7f2d98065420 0x7f2d98148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:28.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.132+0000 7f2da00de700 1 --2- 172.21.15.38:0/322684295 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d980b7070 0x7f2d9809ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:28.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.132+0000 7f2da00de700 1 -- 172.21.15.38:0/322684295 >> 172.21.15.38:0/322684295 conn(0x7f2d980ba610 msgr2=0x7f2d980b8510 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:28.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.132+0000 7f2da00de700 1 -- 172.21.15.38:0/322684295 shutdown_connections 2020-06-12T17:48:28.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.132+0000 7f2da00de700 1 -- 172.21.15.38:0/322684295 wait complete. 2020-06-12T17:48:28.145 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-06-12T17:48:28.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.259+0000 7feef9beb700 1 Processor -- start 2020-06-12T17:48:28.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.259+0000 7feef9beb700 1 -- start start 2020-06-12T17:48:28.266 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.260+0000 7feef9beb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7feef40a2460 0x7feef40a2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:28.266 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.260+0000 7feef9beb700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7feef4146060 0x7feef409d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:28.266 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.260+0000 7feef9beb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feef409dd10 0x7feef413fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:28.266 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.260+0000 7feef9beb700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef405f2b0 con 0x7feef4146060 2020-06-12T17:48:28.266 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.260+0000 7feef9beb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef405f7a0 con 0x7feef40a2460 2020-06-12T17:48:28.267 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.260+0000 7feef9beb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef405fa40 con 0x7feef409dd10 2020-06-12T17:48:28.267 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.260+0000 7feef2ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7feef4146060 0x7feef409d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:28.267 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.260+0000 7feef2ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7feef4146060 0x7feef409d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36072/0 (socket says 172.21.15.38:36072) 2020-06-12T17:48:28.267 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.260+0000 7feef2ffd700 1 -- 172.21.15.38:0/1563494078 learned_addr learned my addr 172.21.15.38:0/1563494078 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:28.267 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.260+0000 7feef3fff700 1 --2- 172.21.15.38:0/1563494078 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feef409dd10 0x7feef413fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:28.268 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.260+0000 7feef37fe700 1 --2- 172.21.15.38:0/1563494078 >> v2:172.21.15.150:3300/0 conn(0x7feef40a2460 0x7feef40a2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:28.268 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.260+0000 7feef2ffd700 1 -- 172.21.15.38:0/1563494078 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feef409dd10 msgr2=0x7feef413fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:28.268 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.260+0000 7feef2ffd700 1 --2- 172.21.15.38:0/1563494078 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feef409dd10 0x7feef413fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:28.268 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.260+0000 7feef2ffd700 1 -- 172.21.15.38:0/1563494078 >> v2:172.21.15.150:3300/0 conn(0x7feef40a2460 msgr2=0x7feef40a2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:28.268 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.260+0000 7feef2ffd700 1 --2- 172.21.15.38:0/1563494078 >> v2:172.21.15.150:3300/0 conn(0x7feef40a2460 0x7feef40a2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:28.269 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.260+0000 7feef2ffd700 1 -- 172.21.15.38:0/1563494078 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef40b7bf0 con 0x7feef4146060 2020-06-12T17:48:28.269 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.261+0000 7feef37fe700 1 --2- 172.21.15.38:0/1563494078 >> v2:172.21.15.150:3300/0 conn(0x7feef40a2460 0x7feef40a2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:48:28.269 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.261+0000 7feef2ffd700 1 --2- 172.21.15.38:0/1563494078 >> v2:172.21.15.38:3300/0 conn(0x7feef4146060 0x7feef409d8b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7feee8002f30 tx=0x7feee8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.269 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.261+0000 7feef2ffd700 1 --2- 172.21.15.38:0/1563494078 >> v2:172.21.15.38:3300/0 conn(0x7feef4146060 0x7feef409d8b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7feee8002f30 tx=0x7feee8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.269 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.261+0000 7feef2ffd700 1 --2- 172.21.15.38:0/1563494078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feef4146060 0x7feef409d8b0 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7feee8002f30 tx=0x7feee8007e60).ready entity=mon.0 client_cookie=c83e1f3cabf45ae0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:28.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.261+0000 7feef2ffd700 1 --2- 172.21.15.38:0/1563494078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feef4146060 0x7feef409d8b0 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7feee8002f30 tx=0x7feee8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.261+0000 7feef27fc700 1 -- 172.21.15.38:0/1563494078 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feee80116e0 con 0x7feef4146060 2020-06-12T17:48:28.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.261+0000 7feef2ffd700 1 --2- 172.21.15.38:0/1563494078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feef4146060 0x7feef409d8b0 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7feee8002f30 tx=0x7feee8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.261+0000 7feef27fc700 1 -- 172.21.15.38:0/1563494078 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee8011840 con 0x7feef4146060 2020-06-12T17:48:28.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.261+0000 7feef2ffd700 1 --2- 172.21.15.38:0/1563494078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feef4146060 0x7feef409d8b0 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7feee8002f30 tx=0x7feee8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.271 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.261+0000 7feef9beb700 1 -- 172.21.15.38:0/1563494078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feef4146060 msgr2=0x7feef409d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:28.271 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.261+0000 7feef27fc700 1 -- 172.21.15.38:0/1563494078 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feee8011be0 con 0x7feef4146060 2020-06-12T17:48:28.271 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.261+0000 7feef9beb700 1 --2- 172.21.15.38:0/1563494078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feef4146060 0x7feef409d8b0 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7feee8002f30 tx=0x7feee8007e60).stop 2020-06-12T17:48:28.271 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.261+0000 7feef9beb700 1 -- 172.21.15.38:0/1563494078 shutdown_connections 2020-06-12T17:48:28.271 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.261+0000 7feef9beb700 1 --2- 172.21.15.38:0/1563494078 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feef409dd10 0x7feef413fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:28.272 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.261+0000 7feef9beb700 1 --2- 172.21.15.38:0/1563494078 >> v2:172.21.15.150:3300/0 conn(0x7feef40a2460 0x7feef40a2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:28.272 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.261+0000 7feef9beb700 1 --2- 172.21.15.38:0/1563494078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feef4146060 0x7feef409d8b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:28.272 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.261+0000 7feef9beb700 1 -- 172.21.15.38:0/1563494078 >> 172.21.15.38:0/1563494078 conn(0x7feef405b450 msgr2=0x7feef405b860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:28.272 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.262+0000 7feef9beb700 1 -- 172.21.15.38:0/1563494078 shutdown_connections 2020-06-12T17:48:28.272 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.262+0000 7feef9beb700 1 -- 172.21.15.38:0/1563494078 wait complete. 2020-06-12T17:48:28.272 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.262+0000 7feef9beb700 1 Processor -- start 2020-06-12T17:48:28.280 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.263+0000 7feef9beb700 1 -- start start 2020-06-12T17:48:28.280 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.263+0000 7feef9beb700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7feef409dd10 0x7feef4150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:28.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.263+0000 7feef9beb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7feef40a2460 0x7feef40b6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:28.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.263+0000 7feef9beb700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef4155030 con 0x7feef4146060 2020-06-12T17:48:28.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.263+0000 7feef9beb700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef41552d0 con 0x7feef409dd10 2020-06-12T17:48:28.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.263+0000 7feef9beb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef4157090 con 0x7feef40a2460 2020-06-12T17:48:28.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.263+0000 7feef37fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7feef409dd10 0x7feef4150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:28.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.263+0000 7feef37fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7feef409dd10 0x7feef4150fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36074/0 (socket says 172.21.15.38:36074) 2020-06-12T17:48:28.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.263+0000 7feef37fe700 1 -- 172.21.15.38:0/2550362970 learned_addr learned my addr 172.21.15.38:0/2550362970 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:28.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.263+0000 7feef3fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7feef4146060 0x7feef4156980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37894/0 (socket says 172.21.15.38:37894) 2020-06-12T17:48:28.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.264+0000 7feef2ffd700 1 --2- 172.21.15.38:0/2550362970 >> v2:172.21.15.150:3300/0 conn(0x7feef40a2460 0x7feef40b6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:28.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.264+0000 7feef37fe700 1 -- 172.21.15.38:0/2550362970 >> v2:172.21.15.150:3300/0 conn(0x7feef40a2460 msgr2=0x7feef40b6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:28.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.264+0000 7feef37fe700 1 --2- 172.21.15.38:0/2550362970 >> v2:172.21.15.150:3300/0 conn(0x7feef40a2460 0x7feef40b6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:28.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.264+0000 7feef37fe700 1 -- 172.21.15.38:0/2550362970 >> v1:172.21.15.38:6789/0 conn(0x7feef4146060 legacy=0x7feef4156980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:28.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.264+0000 7feef0ff9700 1 -- 172.21.15.38:0/2550362970 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3283541017 0 0) 0x7feef4155030 con 0x7feef4146060 2020-06-12T17:48:28.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.264+0000 7feef37fe700 1 -- 172.21.15.38:0/2550362970 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef40b6780 con 0x7feef409dd10 2020-06-12T17:48:28.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.264+0000 7feef37fe700 1 --2- 172.21.15.38:0/2550362970 >> v2:172.21.15.38:3300/0 conn(0x7feef409dd10 0x7feef4150fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feee4002f30 tx=0x7feee4007ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.285 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.264+0000 7feef37fe700 1 --2- 172.21.15.38:0/2550362970 >> v2:172.21.15.38:3300/0 conn(0x7feef409dd10 0x7feef4150fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feee4002f30 tx=0x7feee4007ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.285 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.264+0000 7feef37fe700 1 --2- 172.21.15.38:0/2550362970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feef409dd10 0x7feef4150fd0 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7feee4002f30 tx=0x7feee4007ed0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:28.285 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.264+0000 7feef37fe700 1 --2- 172.21.15.38:0/2550362970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feef409dd10 0x7feef4150fd0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7feee4002f30 tx=0x7feee4007ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.285 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.264+0000 7feef0ff9700 1 -- 172.21.15.38:0/2550362970 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feee4007540 con 0x7feef409dd10 2020-06-12T17:48:28.285 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.264+0000 7feef37fe700 1 --2- 172.21.15.38:0/2550362970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feef409dd10 0x7feef4150fd0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7feee4002f30 tx=0x7feee4007ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.286 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.264+0000 7feef0ff9700 1 -- 172.21.15.38:0/2550362970 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee4008a40 con 0x7feef409dd10 2020-06-12T17:48:28.286 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.264+0000 7feef37fe700 1 --2- 172.21.15.38:0/2550362970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feef409dd10 0x7feef4150fd0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7feee4002f30 tx=0x7feee4007ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.286 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.264+0000 7feef0ff9700 1 -- 172.21.15.38:0/2550362970 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feee4008de0 con 0x7feef409dd10 2020-06-12T17:48:28.286 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.264+0000 7feef9beb700 1 -- 172.21.15.38:0/2550362970 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef40b69d0 con 0x7feef409dd10 2020-06-12T17:48:28.286 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.264+0000 7feef9beb700 1 -- 172.21.15.38:0/2550362970 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef41540c0 con 0x7feef409dd10 2020-06-12T17:48:28.287 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.265+0000 7feef37fe700 1 --2- 172.21.15.38:0/2550362970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feef409dd10 0x7feef4150fd0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7feee4002f30 tx=0x7feee4007ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.287 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.265+0000 7feef9beb700 1 -- 172.21.15.38:0/2550362970 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef4056c30 con 0x7feef409dd10 2020-06-12T17:48:28.287 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.265+0000 7feef0ff9700 1 -- 172.21.15.38:0/2550362970 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7feee40059c0 con 0x7feef409dd10 2020-06-12T17:48:28.287 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.265+0000 7feef37fe700 1 --2- 172.21.15.38:0/2550362970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feef409dd10 0x7feef4150fd0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7feee4002f30 tx=0x7feee4007ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.287 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.265+0000 7feef0ff9700 1 --2- 172.21.15.38:0/2550362970 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7feed404d470 0x7feed404f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:28.288 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.266+0000 7feef0ff9700 1 -- 172.21.15.38:0/2550362970 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7feee4060b20 con 0x7feef409dd10 2020-06-12T17:48:28.288 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.266+0000 7feef2ffd700 1 --2- 172.21.15.38:0/2550362970 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7feed404d470 0x7feed404f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:28.288 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.266+0000 7feef2ffd700 1 --2- 172.21.15.38:0/2550362970 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7feed404d470 0x7feed404f930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feee8002f30 tx=0x7feee8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.288 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.266+0000 7feef2ffd700 1 --2- 172.21.15.38:0/2550362970 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7feed404d470 0x7feed404f930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feee8002f30 tx=0x7feee8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.288 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.266+0000 7feef2ffd700 1 --2- 172.21.15.38:0/2550362970 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7feed404d470 0x7feed404f930 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7feee8002f30 tx=0x7feee8007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:28.289 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.269+0000 7feef37fe700 1 --2- 172.21.15.38:0/2550362970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feef409dd10 0x7feef4150fd0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7feee4002f30 tx=0x7feee4007ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.289 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.269+0000 7feef0ff9700 1 -- 172.21.15.38:0/2550362970 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7feee403c370 con 0x7feef409dd10 2020-06-12T17:48:28.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.419+0000 7feef9beb700 1 -- 172.21.15.38:0/2550362970 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7feef41556e0 con 0x7feef409dd10 2020-06-12T17:48:28.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.419+0000 7feef37fe700 1 --2- 172.21.15.38:0/2550362970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feef409dd10 0x7feef4150fd0 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7feee4002f30 tx=0x7feee4007ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.419+0000 7feef0ff9700 1 -- 172.21.15.38:0/2550362970 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7feee403f990 con 0x7feef409dd10 2020-06-12T17:48:28.424 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:28.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.420+0000 7feef9beb700 1 -- 172.21.15.38:0/2550362970 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7feed404d470 msgr2=0x7feed404f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:28.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.420+0000 7feef9beb700 1 --2- 172.21.15.38:0/2550362970 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7feed404d470 0x7feed404f930 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7feee8002f30 tx=0x7feee8007e60).stop 2020-06-12T17:48:28.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.420+0000 7feef9beb700 1 -- 172.21.15.38:0/2550362970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feef409dd10 msgr2=0x7feef4150fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:28.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.420+0000 7feef9beb700 1 --2- 172.21.15.38:0/2550362970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feef409dd10 0x7feef4150fd0 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7feee4002f30 tx=0x7feee4007ed0).stop 2020-06-12T17:48:28.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.421+0000 7feef9beb700 1 -- 172.21.15.38:0/2550362970 shutdown_connections 2020-06-12T17:48:28.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.421+0000 7feef9beb700 1 --2- 172.21.15.38:0/2550362970 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7feed404d470 0x7feed404f930 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:28.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.421+0000 7feef9beb700 1 --2- 172.21.15.38:0/2550362970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feef409dd10 0x7feef4150fd0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:28.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.421+0000 7feef9beb700 1 --2- 172.21.15.38:0/2550362970 >> v2:172.21.15.150:3300/0 conn(0x7feef40a2460 0x7feef40b6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:28.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.421+0000 7feef9beb700 1 -- 172.21.15.38:0/2550362970 >> 172.21.15.38:0/2550362970 conn(0x7feef405b450 msgr2=0x7feef40b90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:28.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.421+0000 7feef9beb700 1 -- 172.21.15.38:0/2550362970 shutdown_connections 2020-06-12T17:48:28.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.421+0000 7feef9beb700 1 -- 172.21.15.38:0/2550362970 wait complete. 2020-06-12T17:48:28.434 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-06-12T17:48:28.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.548+0000 7f4f75ffc700 1 Processor -- start 2020-06-12T17:48:28.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.548+0000 7f4f75ffc700 1 -- start start 2020-06-12T17:48:28.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.549+0000 7f4f75ffc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f70146680 0x7f4f700ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:28.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.549+0000 7f4f75ffc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4f700b2eb0 0x7f4f7009d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:28.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.549+0000 7f4f75ffc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4f7009d620 0x7f4f7009da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:28.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.549+0000 7f4f75ffc700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f70146d20 con 0x7f4f7009d620 2020-06-12T17:48:28.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.549+0000 7f4f75ffc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f70066a80 con 0x7f4f700b2eb0 2020-06-12T17:48:28.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.549+0000 7f4f75ffc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f70146f50 con 0x7f4f70146680 2020-06-12T17:48:28.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.549+0000 7f4f6ffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4f7009d620 0x7f4f7009da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:28.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.549+0000 7f4f6ffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4f7009d620 0x7f4f7009da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36084/0 (socket says 172.21.15.38:36084) 2020-06-12T17:48:28.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.549+0000 7f4f6ffff700 1 -- 172.21.15.38:0/3700582273 learned_addr learned my addr 172.21.15.38:0/3700582273 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:28.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.549+0000 7f4f6f7fe700 1 --2- 172.21.15.38:0/3700582273 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f70146680 0x7f4f700ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:28.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.549+0000 7f4f6effd700 1 --2- 172.21.15.38:0/3700582273 >> v2:172.21.15.150:3300/0 conn(0x7f4f700b2eb0 0x7f4f7009d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:28.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.549+0000 7f4f6ffff700 1 -- 172.21.15.38:0/3700582273 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f70146680 msgr2=0x7f4f700ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:28.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.549+0000 7f4f6ffff700 1 --2- 172.21.15.38:0/3700582273 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f70146680 0x7f4f700ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:28.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.549+0000 7f4f6ffff700 1 -- 172.21.15.38:0/3700582273 >> v2:172.21.15.150:3300/0 conn(0x7f4f700b2eb0 msgr2=0x7f4f7009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:28.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.549+0000 7f4f6ffff700 1 --2- 172.21.15.38:0/3700582273 >> v2:172.21.15.150:3300/0 conn(0x7f4f700b2eb0 0x7f4f7009d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:28.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.549+0000 7f4f6ffff700 1 -- 172.21.15.38:0/3700582273 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f70146a60 con 0x7f4f7009d620 2020-06-12T17:48:28.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.549+0000 7f4f6effd700 1 --2- 172.21.15.38:0/3700582273 >> v2:172.21.15.150:3300/0 conn(0x7f4f700b2eb0 0x7f4f7009d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:28.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.550+0000 7f4f6ffff700 1 --2- 172.21.15.38:0/3700582273 >> v2:172.21.15.38:3300/0 conn(0x7f4f7009d620 0x7f4f7009da90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4f680032b0 tx=0x7f4f680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.550+0000 7f4f6ffff700 1 --2- 172.21.15.38:0/3700582273 >> v2:172.21.15.38:3300/0 conn(0x7f4f7009d620 0x7f4f7009da90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4f680032b0 tx=0x7f4f680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.550+0000 7f4f6ffff700 1 --2- 172.21.15.38:0/3700582273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f7009d620 0x7f4f7009da90 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7f4f680032b0 tx=0x7f4f680081e0).ready entity=mon.0 client_cookie=97eb9fb6fcd93746 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:28.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.550+0000 7f4f6ffff700 1 --2- 172.21.15.38:0/3700582273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f7009d620 0x7f4f7009da90 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7f4f680032b0 tx=0x7f4f680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.550+0000 7f4f6e7fc700 1 -- 172.21.15.38:0/3700582273 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f68011ea0 con 0x7f4f7009d620 2020-06-12T17:48:28.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.550+0000 7f4f6ffff700 1 --2- 172.21.15.38:0/3700582273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f7009d620 0x7f4f7009da90 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7f4f680032b0 tx=0x7f4f680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.550+0000 7f4f6ffff700 1 --2- 172.21.15.38:0/3700582273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f7009d620 0x7f4f7009da90 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7f4f680032b0 tx=0x7f4f680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.550+0000 7f4f6e7fc700 1 -- 172.21.15.38:0/3700582273 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6800a160 con 0x7f4f7009d620 2020-06-12T17:48:28.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.550+0000 7f4f6e7fc700 1 -- 172.21.15.38:0/3700582273 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f6800a500 con 0x7f4f7009d620 2020-06-12T17:48:28.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.550+0000 7f4f75ffc700 1 -- 172.21.15.38:0/3700582273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f7009d620 msgr2=0x7f4f7009da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:28.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.550+0000 7f4f75ffc700 1 --2- 172.21.15.38:0/3700582273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f7009d620 0x7f4f7009da90 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7f4f680032b0 tx=0x7f4f680081e0).stop 2020-06-12T17:48:28.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.550+0000 7f4f75ffc700 1 -- 172.21.15.38:0/3700582273 shutdown_connections 2020-06-12T17:48:28.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.550+0000 7f4f75ffc700 1 --2- 172.21.15.38:0/3700582273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f7009d620 0x7f4f7009da90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:28.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.550+0000 7f4f75ffc700 1 --2- 172.21.15.38:0/3700582273 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f70146680 0x7f4f700ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:28.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.550+0000 7f4f75ffc700 1 --2- 172.21.15.38:0/3700582273 >> v2:172.21.15.150:3300/0 conn(0x7f4f700b2eb0 0x7f4f7009d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:28.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.550+0000 7f4f75ffc700 1 -- 172.21.15.38:0/3700582273 >> 172.21.15.38:0/3700582273 conn(0x7f4f700b5a20 msgr2=0x7f4f7005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:28.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.550+0000 7f4f75ffc700 1 -- 172.21.15.38:0/3700582273 shutdown_connections 2020-06-12T17:48:28.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.550+0000 7f4f75ffc700 1 -- 172.21.15.38:0/3700582273 wait complete. 2020-06-12T17:48:28.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.551+0000 7f4f75ffc700 1 Processor -- start 2020-06-12T17:48:28.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.551+0000 7f4f75ffc700 1 -- start start 2020-06-12T17:48:28.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.552+0000 7f4f75ffc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4f70146680 0x7f4f70144620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:28.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.552+0000 7f4f75ffc700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f700b1980 con 0x7f4f7009d620 2020-06-12T17:48:28.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.552+0000 7f4f75ffc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f700af560 con 0x7f4f700b2eb0 2020-06-12T17:48:28.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.552+0000 7f4f75ffc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f700af800 con 0x7f4f70146680 2020-06-12T17:48:28.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.552+0000 7f4f6f7fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4f7009d620 0x7f4f7013dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37902/0 (socket says 172.21.15.38:37902) 2020-06-12T17:48:28.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.552+0000 7f4f6f7fe700 1 -- 172.21.15.38:0/1886306730 learned_addr learned my addr 172.21.15.38:0/1886306730 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:28.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.552+0000 7f4f6cff9700 1 -- 172.21.15.38:0/1886306730 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156579837 0 0) 0x7f4f700b1980 con 0x7f4f7009d620 2020-06-12T17:48:28.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.552+0000 7f4f6ffff700 1 --2- 172.21.15.38:0/1886306730 >> v2:172.21.15.150:3300/0 conn(0x7f4f70146680 0x7f4f70144620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:28.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.552+0000 7f4f6cff9700 1 -- 172.21.15.38:0/1886306730 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f50002fe0 con 0x7f4f7009d620 2020-06-12T17:48:28.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6cff9700 1 -- 172.21.15.38:0/1886306730 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3367919764 0 0) 0x7f4f50002fe0 con 0x7f4f7009d620 2020-06-12T17:48:28.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6cff9700 1 -- 172.21.15.38:0/1886306730 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4f700b1980 con 0x7f4f7009d620 2020-06-12T17:48:28.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6cff9700 1 -- 172.21.15.38:0/1886306730 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f4f60001490 con 0x7f4f7009d620 2020-06-12T17:48:28.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6cff9700 1 -- 172.21.15.38:0/1886306730 >> v2:172.21.15.150:3300/0 conn(0x7f4f70146680 msgr2=0x7f4f70144620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:28.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6cff9700 1 --2- 172.21.15.38:0/1886306730 >> v2:172.21.15.150:3300/0 conn(0x7f4f70146680 0x7f4f70144620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:28.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6cff9700 1 -- 172.21.15.38:0/1886306730 >> v1:172.21.15.150:6789/0 conn(0x7f4f700b2eb0 legacy=0x7f4f700afca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:28.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6cff9700 1 -- 172.21.15.38:0/1886306730 >> v1:172.21.15.38:6789/0 conn(0x7f4f7009d620 legacy=0x7f4f7013dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:28.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6cff9700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f500049b0 0x7f4f50004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:28.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6cff9700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f50003920 0x7f4f50003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:28.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6cff9700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f500041c0 0x7f4f5000b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:28.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6cff9700 1 -- 172.21.15.38:0/1886306730 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f700af800 con 0x7f4f50003920 2020-06-12T17:48:28.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6cff9700 1 -- 172.21.15.38:0/1886306730 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5000bbb0 con 0x7f4f500041c0 2020-06-12T17:48:28.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6cff9700 1 -- 172.21.15.38:0/1886306730 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5000bcf0 con 0x7f4f500049b0 2020-06-12T17:48:28.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6effd700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f50003920 0x7f4f50003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:28.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6f7fe700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f500049b0 0x7f4f50004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:28.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6ffff700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f500041c0 0x7f4f5000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:28.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6effd700 1 -- 172.21.15.38:0/1886306730 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f500049b0 msgr2=0x7f4f50004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:28.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6effd700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f500049b0 0x7f4f50004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:28.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6effd700 1 -- 172.21.15.38:0/1886306730 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f500041c0 msgr2=0x7f4f5000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:28.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6effd700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f500041c0 0x7f4f5000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:28.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6effd700 1 -- 172.21.15.38:0/1886306730 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7013e5f0 con 0x7f4f50003920 2020-06-12T17:48:28.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6ffff700 1 -- 172.21.15.38:0/1886306730 reap_dead start 2020-06-12T17:48:28.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f75ffc700 1 -- 172.21.15.38:0/1886306730 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f7013e7e0 con 0x7f4f50003920 2020-06-12T17:48:28.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6effd700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f50003920 0x7f4f50003d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4f700b2740 tx=0x7f4f6400e160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f75ffc700 1 -- 172.21.15.38:0/1886306730 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f701447e0 con 0x7f4f50003920 2020-06-12T17:48:28.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6effd700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f50003920 0x7f4f50003d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4f700b2740 tx=0x7f4f6400e160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6effd700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f50003920 0x7f4f50003d60 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f4f700b2740 tx=0x7f4f6400e160).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:28.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6effd700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f50003920 0x7f4f50003d60 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f4f700b2740 tx=0x7f4f6400e160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6cff9700 1 -- 172.21.15.38:0/1886306730 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f64007560 con 0x7f4f50003920 2020-06-12T17:48:28.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6effd700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f50003920 0x7f4f50003d60 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f4f700b2740 tx=0x7f4f6400e160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6effd700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f50003920 0x7f4f50003d60 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f4f700b2740 tx=0x7f4f6400e160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6cff9700 1 -- 172.21.15.38:0/1886306730 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f640056c0 con 0x7f4f50003920 2020-06-12T17:48:28.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.553+0000 7f4f6cff9700 1 -- 172.21.15.38:0/1886306730 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f64005a60 con 0x7f4f50003920 2020-06-12T17:48:28.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.554+0000 7f4f6effd700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f50003920 0x7f4f50003d60 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f4f700b2740 tx=0x7f4f6400e160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.554+0000 7f4f75ffc700 1 -- 172.21.15.38:0/1886306730 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f4c003340 con 0x7f4f50003920 2020-06-12T17:48:28.588 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.554+0000 7f4f6cff9700 1 -- 172.21.15.38:0/1886306730 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f4f64005bc0 con 0x7f4f50003920 2020-06-12T17:48:28.588 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.554+0000 7f4f6effd700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f50003920 0x7f4f50003d60 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f4f700b2740 tx=0x7f4f6400e160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.588 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.555+0000 7f4f6cff9700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4f50051590 0x7f4f50053a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:28.588 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.555+0000 7f4f6cff9700 1 -- 172.21.15.38:0/1886306730 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f4f64007e40 con 0x7f4f50003920 2020-06-12T17:48:28.588 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.555+0000 7f4f6f7fe700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4f50051590 0x7f4f50053a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:28.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.555+0000 7f4f6f7fe700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4f50051590 0x7f4f50053a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4f60007a90 tx=0x7f4f60007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.555+0000 7f4f6f7fe700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4f50051590 0x7f4f50053a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4f60007a90 tx=0x7f4f60007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.555+0000 7f4f6f7fe700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4f50051590 0x7f4f50053a50 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f4f60007a90 tx=0x7f4f60007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:28.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.558+0000 7f4f6effd700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f50003920 0x7f4f50003d60 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f4f700b2740 tx=0x7f4f6400e160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.558+0000 7f4f6cff9700 1 -- 172.21.15.38:0/1886306730 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f4f6403c350 con 0x7f4f50003920 2020-06-12T17:48:28.714 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.710+0000 7f4f75ffc700 1 -- 172.21.15.38:0/1886306730 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4f4c002200 con 0x7f4f50003920 2020-06-12T17:48:28.714 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.711+0000 7f4f6effd700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f50003920 0x7f4f50003d60 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f4f700b2740 tx=0x7f4f6400e160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.715 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.711+0000 7f4f6cff9700 1 -- 172.21.15.38:0/1886306730 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f4f6403f970 con 0x7f4f50003920 2020-06-12T17:48:28.715 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:28.716 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.712+0000 7f4f75ffc700 1 -- 172.21.15.38:0/1886306730 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4f50051590 msgr2=0x7f4f50053a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:28.716 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.712+0000 7f4f75ffc700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4f50051590 0x7f4f50053a50 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f4f60007a90 tx=0x7f4f60007e60).stop 2020-06-12T17:48:28.716 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.712+0000 7f4f75ffc700 1 -- 172.21.15.38:0/1886306730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f50003920 msgr2=0x7f4f50003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:28.717 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.712+0000 7f4f75ffc700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f50003920 0x7f4f50003d60 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f4f700b2740 tx=0x7f4f6400e160).stop 2020-06-12T17:48:28.717 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.712+0000 7f4f75ffc700 1 -- 172.21.15.38:0/1886306730 shutdown_connections 2020-06-12T17:48:28.717 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.712+0000 7f4f75ffc700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4f50051590 0x7f4f50053a50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:28.717 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.712+0000 7f4f75ffc700 1 --2- 172.21.15.38:0/1886306730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f50003920 0x7f4f50003d60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:28.717 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.712+0000 7f4f75ffc700 1 -- 172.21.15.38:0/1886306730 >> 172.21.15.38:0/1886306730 conn(0x7f4f700b5a20 msgr2=0x7f4f7009b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:28.718 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.712+0000 7f4f75ffc700 1 -- 172.21.15.38:0/1886306730 shutdown_connections 2020-06-12T17:48:28.718 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.712+0000 7f4f75ffc700 1 -- 172.21.15.38:0/1886306730 wait complete. 2020-06-12T17:48:28.726 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-06-12T17:48:28.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.840+0000 7f6484977700 1 Processor -- start 2020-06-12T17:48:28.844 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.840+0000 7f6484977700 1 -- start start 2020-06-12T17:48:28.846 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.841+0000 7f6484977700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f648009df00 0x7f648013c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:28.846 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.841+0000 7f6484977700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648009b960 con 0x7f6480142e90 2020-06-12T17:48:28.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.841+0000 7f6484977700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648009bc00 con 0x7f64800b3ac0 2020-06-12T17:48:28.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.841+0000 7f6484977700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6480143270 con 0x7f648009df00 2020-06-12T17:48:28.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.841+0000 7f647dd9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f648009df00 0x7f648013c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:28.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.841+0000 7f647dd9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f648009df00 0x7f648013c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36100/0 (socket says 172.21.15.38:36100) 2020-06-12T17:48:28.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.841+0000 7f647ed9d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6480142e90 0x7f6480066790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37916/0 (socket says 172.21.15.38:37916) 2020-06-12T17:48:28.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.841+0000 7f647dd9b700 1 -- 172.21.15.38:0/2749460095 learned_addr learned my addr 172.21.15.38:0/2749460095 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:28.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.841+0000 7f647dd9b700 1 -- 172.21.15.38:0/2749460095 >> v1:172.21.15.150:6789/0 conn(0x7f64800b3ac0 legacy=0x7f648013bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:28.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.841+0000 7f647dd9b700 1 -- 172.21.15.38:0/2749460095 >> v1:172.21.15.38:6789/0 conn(0x7f6480142e90 legacy=0x7f6480066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:28.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.841+0000 7f647dd9b700 1 -- 172.21.15.38:0/2749460095 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64800b48f0 con 0x7f648009df00 2020-06-12T17:48:28.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.841+0000 7f647d59a700 1 -- 172.21.15.38:0/2749460095 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 546602346 0 0) 0x7f648009b960 con 0x7f6480142e90 2020-06-12T17:48:28.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.841+0000 7f647dd9b700 1 --2- 172.21.15.38:0/2749460095 >> v2:172.21.15.38:3300/0 conn(0x7f648009df00 0x7f648013c650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6470002f30 tx=0x7f6470007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.842+0000 7f647dd9b700 1 --2- 172.21.15.38:0/2749460095 >> v2:172.21.15.38:3300/0 conn(0x7f648009df00 0x7f648013c650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6470002f30 tx=0x7f6470007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.842+0000 7f647dd9b700 1 --2- 172.21.15.38:0/2749460095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f648009df00 0x7f648013c650 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7f6470002f30 tx=0x7f6470007e60).ready entity=mon.0 client_cookie=7a0eb7dfd05a8c32 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:28.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.842+0000 7f647dd9b700 1 --2- 172.21.15.38:0/2749460095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f648009df00 0x7f648013c650 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f6470002f30 tx=0x7f6470007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.842+0000 7f647d59a700 1 -- 172.21.15.38:0/2749460095 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6470009e40 con 0x7f648009df00 2020-06-12T17:48:28.851 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.842+0000 7f647dd9b700 1 --2- 172.21.15.38:0/2749460095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f648009df00 0x7f648013c650 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f6470002f30 tx=0x7f6470007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.851 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.842+0000 7f647d59a700 1 -- 172.21.15.38:0/2749460095 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64700129e0 con 0x7f648009df00 2020-06-12T17:48:28.851 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.842+0000 7f647dd9b700 1 --2- 172.21.15.38:0/2749460095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f648009df00 0x7f648013c650 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f6470002f30 tx=0x7f6470007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.851 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.842+0000 7f647d59a700 1 -- 172.21.15.38:0/2749460095 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6470012d80 con 0x7f648009df00 2020-06-12T17:48:28.852 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.842+0000 7f6484977700 1 -- 172.21.15.38:0/2749460095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f648009df00 msgr2=0x7f648013c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:28.852 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.842+0000 7f6484977700 1 --2- 172.21.15.38:0/2749460095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f648009df00 0x7f648013c650 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7f6470002f30 tx=0x7f6470007e60).stop 2020-06-12T17:48:28.852 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.842+0000 7f6484977700 1 -- 172.21.15.38:0/2749460095 shutdown_connections 2020-06-12T17:48:28.852 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.842+0000 7f6484977700 1 --2- 172.21.15.38:0/2749460095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f648009df00 0x7f648013c650 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:28.852 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.842+0000 7f6484977700 1 -- 172.21.15.38:0/2749460095 >> 172.21.15.38:0/2749460095 conn(0x7f64800b5a20 msgr2=0x7f648005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:28.853 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.842+0000 7f6484977700 1 -- 172.21.15.38:0/2749460095 shutdown_connections 2020-06-12T17:48:28.853 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.842+0000 7f6484977700 1 -- 172.21.15.38:0/2749460095 wait complete. 2020-06-12T17:48:28.856 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.843+0000 7f6484977700 1 Processor -- start 2020-06-12T17:48:28.856 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.843+0000 7f6484977700 1 -- start start 2020-06-12T17:48:28.857 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.844+0000 7f6484977700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64800b3ac0 0x7f6480153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:28.857 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.844+0000 7f6484977700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6480145390 con 0x7f648009df00 2020-06-12T17:48:28.857 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.844+0000 7f6484977700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6480153c70 con 0x7f6480142e90 2020-06-12T17:48:28.857 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.844+0000 7f6484977700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6480153f10 con 0x7f64800b3ac0 2020-06-12T17:48:28.857 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.844+0000 7f647e59c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f648009df00 0x7f6480140b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37920/0 (socket says 172.21.15.38:37920) 2020-06-12T17:48:28.858 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.844+0000 7f647e59c700 1 -- 172.21.15.38:0/3030592778 learned_addr learned my addr 172.21.15.38:0/3030592778 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:28.858 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.844+0000 7f647dd9b700 1 --2- 172.21.15.38:0/3030592778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64800b3ac0 0x7f6480153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:28.859 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.844+0000 7f646f7fe700 1 -- 172.21.15.38:0/3030592778 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3620696777 0 0) 0x7f6480145390 con 0x7f648009df00 2020-06-12T17:48:28.859 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.844+0000 7f646f7fe700 1 -- 172.21.15.38:0/3030592778 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f645c002fe0 con 0x7f648009df00 2020-06-12T17:48:28.859 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.844+0000 7f646f7fe700 1 -- 172.21.15.38:0/3030592778 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208214245 0 0) 0x7f6480153c70 con 0x7f6480142e90 2020-06-12T17:48:28.859 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.844+0000 7f646f7fe700 1 -- 172.21.15.38:0/3030592778 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6480145390 con 0x7f6480142e90 2020-06-12T17:48:28.859 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.844+0000 7f646f7fe700 1 -- 172.21.15.38:0/3030592778 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3766902512 0 0) 0x7f645c002fe0 con 0x7f648009df00 2020-06-12T17:48:28.860 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.844+0000 7f646f7fe700 1 -- 172.21.15.38:0/3030592778 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6480153c70 con 0x7f648009df00 2020-06-12T17:48:28.860 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.845+0000 7f646f7fe700 1 -- 172.21.15.38:0/3030592778 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f64740018d0 con 0x7f648009df00 2020-06-12T17:48:28.860 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.845+0000 7f647dd9b700 1 -- 172.21.15.38:0/3030592778 >> v1:172.21.15.150:6789/0 conn(0x7f6480142e90 legacy=0x7f648013bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:28.860 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.845+0000 7f647dd9b700 1 -- 172.21.15.38:0/3030592778 >> v1:172.21.15.38:6789/0 conn(0x7f648009df00 legacy=0x7f6480140b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:28.860 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.845+0000 7f647dd9b700 1 -- 172.21.15.38:0/3030592778 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64801541b0 con 0x7f64800b3ac0 2020-06-12T17:48:28.861 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.845+0000 7f647dd9b700 1 --2- 172.21.15.38:0/3030592778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64800b3ac0 0x7f6480153730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6470002f30 tx=0x7f6470007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.861 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.845+0000 7f647dd9b700 1 --2- 172.21.15.38:0/3030592778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64800b3ac0 0x7f6480153730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6470002f30 tx=0x7f6470007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.861 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.845+0000 7f647dd9b700 1 --2- 172.21.15.38:0/3030592778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64800b3ac0 0x7f6480153730 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f6470002f30 tx=0x7f6470007e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:28.861 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.845+0000 7f647dd9b700 1 --2- 172.21.15.38:0/3030592778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64800b3ac0 0x7f6480153730 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f6470002f30 tx=0x7f6470007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.861 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.845+0000 7f646f7fe700 1 -- 172.21.15.38:0/3030592778 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64700109b0 con 0x7f64800b3ac0 2020-06-12T17:48:28.862 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.845+0000 7f647dd9b700 1 --2- 172.21.15.38:0/3030592778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64800b3ac0 0x7f6480153730 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f6470002f30 tx=0x7f6470007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.862 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.845+0000 7f647dd9b700 1 --2- 172.21.15.38:0/3030592778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64800b3ac0 0x7f6480153730 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f6470002f30 tx=0x7f6470007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.862 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.845+0000 7f646f7fe700 1 -- 172.21.15.38:0/3030592778 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6470007150 con 0x7f64800b3ac0 2020-06-12T17:48:28.862 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.845+0000 7f646f7fe700 1 -- 172.21.15.38:0/3030592778 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64700074b0 con 0x7f64800b3ac0 2020-06-12T17:48:28.862 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.845+0000 7f6484977700 1 -- 172.21.15.38:0/3030592778 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6480141210 con 0x7f64800b3ac0 2020-06-12T17:48:28.862 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.845+0000 7f6484977700 1 -- 172.21.15.38:0/3030592778 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6480067100 con 0x7f64800b3ac0 2020-06-12T17:48:28.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.846+0000 7f647dd9b700 1 --2- 172.21.15.38:0/3030592778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64800b3ac0 0x7f6480153730 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f6470002f30 tx=0x7f6470007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.846+0000 7f6484977700 1 -- 172.21.15.38:0/3030592778 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6480056c30 con 0x7f64800b3ac0 2020-06-12T17:48:28.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.846+0000 7f646f7fe700 1 -- 172.21.15.38:0/3030592778 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f647000f0c0 con 0x7f64800b3ac0 2020-06-12T17:48:28.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.846+0000 7f647dd9b700 1 --2- 172.21.15.38:0/3030592778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64800b3ac0 0x7f6480153730 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f6470002f30 tx=0x7f6470007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.846+0000 7f646f7fe700 1 --2- 172.21.15.38:0/3030592778 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f645c04dc70 0x7f645c050130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:28.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.846+0000 7f646f7fe700 1 -- 172.21.15.38:0/3030592778 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f64700610e0 con 0x7f64800b3ac0 2020-06-12T17:48:28.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.847+0000 7f647e59c700 1 --2- 172.21.15.38:0/3030592778 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f645c04dc70 0x7f645c050130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:28.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.847+0000 7f647e59c700 1 --2- 172.21.15.38:0/3030592778 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f645c04dc70 0x7f645c050130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6480142930 tx=0x7f647400a520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.847+0000 7f647e59c700 1 --2- 172.21.15.38:0/3030592778 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f645c04dc70 0x7f645c050130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6480142930 tx=0x7f647400a520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.847+0000 7f647e59c700 1 --2- 172.21.15.38:0/3030592778 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f645c04dc70 0x7f645c050130 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f6480142930 tx=0x7f647400a520).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:28.865 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.850+0000 7f647dd9b700 1 --2- 172.21.15.38:0/3030592778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64800b3ac0 0x7f6480153730 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f6470002f30 tx=0x7f6470007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:28.865 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:28.850+0000 7f646f7fe700 1 -- 172.21.15.38:0/3030592778 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f647003c9b0 con 0x7f64800b3ac0 2020-06-12T17:48:29.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.001+0000 7f6484977700 1 -- 172.21.15.38:0/3030592778 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f648013fde0 con 0x7f64800b3ac0 2020-06-12T17:48:29.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.001+0000 7f647dd9b700 1 --2- 172.21.15.38:0/3030592778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64800b3ac0 0x7f6480153730 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f6470002f30 tx=0x7f6470007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:29.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.001+0000 7f646f7fe700 1 -- 172.21.15.38:0/3030592778 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f647003ffd0 con 0x7f64800b3ac0 2020-06-12T17:48:29.005 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:29.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.003+0000 7f6484977700 1 -- 172.21.15.38:0/3030592778 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f645c04dc70 msgr2=0x7f645c050130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:29.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.003+0000 7f6484977700 1 --2- 172.21.15.38:0/3030592778 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f645c04dc70 0x7f645c050130 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f6480142930 tx=0x7f647400a520).stop 2020-06-12T17:48:29.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.003+0000 7f6484977700 1 -- 172.21.15.38:0/3030592778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64800b3ac0 msgr2=0x7f6480153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:29.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.003+0000 7f6484977700 1 --2- 172.21.15.38:0/3030592778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64800b3ac0 0x7f6480153730 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f6470002f30 tx=0x7f6470007e60).stop 2020-06-12T17:48:29.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.003+0000 7f6484977700 1 -- 172.21.15.38:0/3030592778 shutdown_connections 2020-06-12T17:48:29.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.003+0000 7f6484977700 1 --2- 172.21.15.38:0/3030592778 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f645c04dc70 0x7f645c050130 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:29.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.003+0000 7f6484977700 1 --2- 172.21.15.38:0/3030592778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64800b3ac0 0x7f6480153730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:29.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.003+0000 7f6484977700 1 -- 172.21.15.38:0/3030592778 >> 172.21.15.38:0/3030592778 conn(0x7f64800b5a20 msgr2=0x7f648009cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:29.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.003+0000 7f6484977700 1 -- 172.21.15.38:0/3030592778 shutdown_connections 2020-06-12T17:48:29.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.003+0000 7f6484977700 1 -- 172.21.15.38:0/3030592778 wait complete. 2020-06-12T17:48:29.017 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-06-12T17:48:29.017 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-06-12T17:48:29.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.129+0000 7f65ca192700 1 Processor -- start 2020-06-12T17:48:29.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.129+0000 7f65ca192700 1 -- start start 2020-06-12T17:48:29.135 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.130+0000 7f65ca192700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f65c4061a80 0x7f65c409bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:29.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.130+0000 7f65ca192700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f65c40b44a0 0x7f65c41427e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:29.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.130+0000 7f65ca192700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65c40b2dc0 con 0x7f65c4142350 2020-06-12T17:48:29.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.130+0000 7f65ca192700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c4142c40 con 0x7f65c4061a80 2020-06-12T17:48:29.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.130+0000 7f65ca192700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c409e560 con 0x7f65c40b44a0 2020-06-12T17:48:29.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.130+0000 7f65c37fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f65c4061a80 0x7f65c409bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:29.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.130+0000 7f65c37fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f65c4061a80 0x7f65c409bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36112/0 (socket says 172.21.15.38:36112) 2020-06-12T17:48:29.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.130+0000 7f65c37fe700 1 -- 172.21.15.38:0/4048988899 learned_addr learned my addr 172.21.15.38:0/4048988899 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:29.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.130+0000 7f65c3fff700 1 --2- 172.21.15.38:0/4048988899 >> v2:172.21.15.150:3300/0 conn(0x7f65c40b44a0 0x7f65c41427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:29.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.131+0000 7f65c37fe700 1 -- 172.21.15.38:0/4048988899 >> v2:172.21.15.150:3300/0 conn(0x7f65c40b44a0 msgr2=0x7f65c41427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:29.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.131+0000 7f65c37fe700 1 --2- 172.21.15.38:0/4048988899 >> v2:172.21.15.150:3300/0 conn(0x7f65c40b44a0 0x7f65c41427e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:29.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.131+0000 7f65c37fe700 1 -- 172.21.15.38:0/4048988899 >> v1:172.21.15.150:6789/0 conn(0x7f65c4142350 legacy=0x7f65c4146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:29.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.131+0000 7f65c37fe700 1 -- 172.21.15.38:0/4048988899 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c40b29d0 con 0x7f65c4061a80 2020-06-12T17:48:29.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.131+0000 7f65c37fe700 1 --2- 172.21.15.38:0/4048988899 >> v2:172.21.15.38:3300/0 conn(0x7f65c4061a80 0x7f65c409bee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f65b8002f30 tx=0x7f65b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:29.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.131+0000 7f65c37fe700 1 --2- 172.21.15.38:0/4048988899 >> v2:172.21.15.38:3300/0 conn(0x7f65c4061a80 0x7f65c409bee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f65b8002f30 tx=0x7f65b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:29.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.131+0000 7f65c37fe700 1 --2- 172.21.15.38:0/4048988899 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65c4061a80 0x7f65c409bee0 secure :-1 s=READY pgs=198 cs=0 l=1 rx=0x7f65b8002f30 tx=0x7f65b8007e60).ready entity=mon.0 client_cookie=ecf5c09040971ed2 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:29.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.131+0000 7f65c37fe700 1 --2- 172.21.15.38:0/4048988899 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65c4061a80 0x7f65c409bee0 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7f65b8002f30 tx=0x7f65b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:29.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.131+0000 7f65c27fc700 1 -- 172.21.15.38:0/4048988899 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65b8011630 con 0x7f65c4061a80 2020-06-12T17:48:29.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.131+0000 7f65c37fe700 1 --2- 172.21.15.38:0/4048988899 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65c4061a80 0x7f65c409bee0 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7f65b8002f30 tx=0x7f65b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:29.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.131+0000 7f65c37fe700 1 --2- 172.21.15.38:0/4048988899 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65c4061a80 0x7f65c409bee0 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7f65b8002f30 tx=0x7f65b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:29.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.131+0000 7f65c27fc700 1 -- 172.21.15.38:0/4048988899 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b8011790 con 0x7f65c4061a80 2020-06-12T17:48:29.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.131+0000 7f65c27fc700 1 -- 172.21.15.38:0/4048988899 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65b8011b70 con 0x7f65c4061a80 2020-06-12T17:48:29.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.131+0000 7f65ca192700 1 -- 172.21.15.38:0/4048988899 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65c4061a80 msgr2=0x7f65c409bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:29.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.131+0000 7f65ca192700 1 --2- 172.21.15.38:0/4048988899 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65c4061a80 0x7f65c409bee0 secure :-1 s=READY pgs=198 cs=0 l=1 rx=0x7f65b8002f30 tx=0x7f65b8007e60).stop 2020-06-12T17:48:29.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.131+0000 7f65ca192700 1 -- 172.21.15.38:0/4048988899 shutdown_connections 2020-06-12T17:48:29.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.131+0000 7f65ca192700 1 --2- 172.21.15.38:0/4048988899 >> v2:172.21.15.150:3300/0 conn(0x7f65c40b44a0 0x7f65c41427e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:29.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.131+0000 7f65ca192700 1 --2- 172.21.15.38:0/4048988899 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65c4061a80 0x7f65c409bee0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:29.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.131+0000 7f65ca192700 1 -- 172.21.15.38:0/4048988899 >> 172.21.15.38:0/4048988899 conn(0x7f65c40b8420 msgr2=0x7f65c40b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:29.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.131+0000 7f65ca192700 1 -- 172.21.15.38:0/4048988899 shutdown_connections 2020-06-12T17:48:29.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.132+0000 7f65ca192700 1 -- 172.21.15.38:0/4048988899 wait complete. 2020-06-12T17:48:29.144 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.132+0000 7f65ca192700 1 Processor -- start 2020-06-12T17:48:29.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.133+0000 7f65ca192700 1 -- start start 2020-06-12T17:48:29.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.133+0000 7f65ca192700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65c4142350 0x7f65c40b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:29.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.133+0000 7f65ca192700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65c4144670 con 0x7f65c4061a80 2020-06-12T17:48:29.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.133+0000 7f65ca192700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65c4144910 con 0x7f65c40b44a0 2020-06-12T17:48:29.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.133+0000 7f65ca192700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c4144bb0 con 0x7f65c4142350 2020-06-12T17:48:29.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.133+0000 7f65c37fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f65c4061a80 0x7f65c41351e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37934/0 (socket says 172.21.15.38:37934) 2020-06-12T17:48:29.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.133+0000 7f65c37fe700 1 -- 172.21.15.38:0/556043695 learned_addr learned my addr 172.21.15.38:0/556043695 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:29.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.133+0000 7f65c3fff700 1 --2- 172.21.15.38:0/556043695 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65c4142350 0x7f65c40b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:29.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.134+0000 7f65c0ff9700 1 -- 172.21.15.38:0/556043695 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127477392 0 0) 0x7f65c4144670 con 0x7f65c4061a80 2020-06-12T17:48:29.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.134+0000 7f65c0ff9700 1 -- 172.21.15.38:0/556043695 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65a4002fe0 con 0x7f65c4061a80 2020-06-12T17:48:29.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.134+0000 7f65c0ff9700 1 -- 172.21.15.38:0/556043695 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972652304 0 0) 0x7f65c4144910 con 0x7f65c40b44a0 2020-06-12T17:48:29.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.134+0000 7f65c0ff9700 1 -- 172.21.15.38:0/556043695 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65c4144670 con 0x7f65c40b44a0 2020-06-12T17:48:29.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.134+0000 7f65c3fff700 1 -- 172.21.15.38:0/556043695 >> v1:172.21.15.150:6789/0 conn(0x7f65c40b44a0 legacy=0x7f65c40afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:29.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.134+0000 7f65c3fff700 1 -- 172.21.15.38:0/556043695 >> v1:172.21.15.38:6789/0 conn(0x7f65c4061a80 legacy=0x7f65c41351e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:29.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.134+0000 7f65c3fff700 1 -- 172.21.15.38:0/556043695 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c40adbb0 con 0x7f65c4142350 2020-06-12T17:48:29.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.134+0000 7f65c3fff700 1 --2- 172.21.15.38:0/556043695 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65c4142350 0x7f65c40b0200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f65bc0032b0 tx=0x7f65bc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:29.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.134+0000 7f65c3fff700 1 --2- 172.21.15.38:0/556043695 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65c4142350 0x7f65c40b0200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f65bc0032b0 tx=0x7f65bc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:29.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.134+0000 7f65c3fff700 1 --2- 172.21.15.38:0/556043695 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65c4142350 0x7f65c40b0200 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7f65bc0032b0 tx=0x7f65bc0081e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:29.158 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.134+0000 7f65c3fff700 1 --2- 172.21.15.38:0/556043695 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65c4142350 0x7f65c40b0200 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f65bc0032b0 tx=0x7f65bc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:29.158 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.134+0000 7f65c0ff9700 1 -- 172.21.15.38:0/556043695 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65bc005e30 con 0x7f65c4142350 2020-06-12T17:48:29.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.134+0000 7f65c3fff700 1 --2- 172.21.15.38:0/556043695 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65c4142350 0x7f65c40b0200 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f65bc0032b0 tx=0x7f65bc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:29.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.134+0000 7f65c0ff9700 1 -- 172.21.15.38:0/556043695 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65bc007540 con 0x7f65c4142350 2020-06-12T17:48:29.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.134+0000 7f65ca192700 1 -- 172.21.15.38:0/556043695 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c41442f0 con 0x7f65c4142350 2020-06-12T17:48:29.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.134+0000 7f65c3fff700 1 --2- 172.21.15.38:0/556043695 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65c4142350 0x7f65c40b0200 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f65bc0032b0 tx=0x7f65bc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:29.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.134+0000 7f65c0ff9700 1 -- 172.21.15.38:0/556043695 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65bc007960 con 0x7f65c4142350 2020-06-12T17:48:29.160 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.134+0000 7f65ca192700 1 -- 172.21.15.38:0/556043695 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c4135b30 con 0x7f65c4142350 2020-06-12T17:48:29.160 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.135+0000 7f65c3fff700 1 --2- 172.21.15.38:0/556043695 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65c4142350 0x7f65c40b0200 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f65bc0032b0 tx=0x7f65bc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:29.160 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.135+0000 7f65ca192700 1 -- 172.21.15.38:0/556043695 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c4056c30 con 0x7f65c4142350 2020-06-12T17:48:29.160 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.135+0000 7f65c0ff9700 1 -- 172.21.15.38:0/556043695 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f65bc012470 con 0x7f65c4142350 2020-06-12T17:48:29.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.135+0000 7f65c3fff700 1 --2- 172.21.15.38:0/556043695 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65c4142350 0x7f65c40b0200 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f65bc0032b0 tx=0x7f65bc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:29.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.136+0000 7f65c0ff9700 1 --2- 172.21.15.38:0/556043695 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f65a404da70 0x7f65a404ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:29.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.136+0000 7f65c0ff9700 1 -- 172.21.15.38:0/556043695 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f65bc0611c0 con 0x7f65c4142350 2020-06-12T17:48:29.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.136+0000 7f65c37fe700 1 --2- 172.21.15.38:0/556043695 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f65a404da70 0x7f65a404ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:29.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.136+0000 7f65c37fe700 1 --2- 172.21.15.38:0/556043695 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f65a404da70 0x7f65a404ff30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f65c413a160 tx=0x7f65b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:29.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.136+0000 7f65c37fe700 1 --2- 172.21.15.38:0/556043695 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f65a404da70 0x7f65a404ff30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f65c413a160 tx=0x7f65b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:29.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.136+0000 7f65c37fe700 1 --2- 172.21.15.38:0/556043695 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f65a404da70 0x7f65a404ff30 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f65c413a160 tx=0x7f65b8007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:29.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.140+0000 7f65c3fff700 1 --2- 172.21.15.38:0/556043695 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65c4142350 0x7f65c40b0200 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f65bc0032b0 tx=0x7f65bc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:29.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.140+0000 7f65c0ff9700 1 -- 172.21.15.38:0/556043695 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f65bc03c900 con 0x7f65c4142350 2020-06-12T17:48:29.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.341+0000 7f65ca192700 1 -- 172.21.15.38:0/556043695 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65c4139a00 con 0x7f65c4142350 2020-06-12T17:48:29.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.342+0000 7f65c3fff700 1 --2- 172.21.15.38:0/556043695 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65c4142350 0x7f65c40b0200 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f65bc0032b0 tx=0x7f65bc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:29.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.342+0000 7f65c0ff9700 1 -- 172.21.15.38:0/556043695 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2137 (secure 0 0 0) 0x7f65bc03ff20 con 0x7f65c4142350 2020-06-12T17:48:29.346 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:29.346 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1134306892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1134306892},{"type":"v1","addr":"172.21.15.150:6835","nonce":1134306892}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-06-12T17:48:14.851844+0000","modified":"2020-06-12T17:48:18.530885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4389":{"gid":4389,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.38:6833/4064318189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":4064318189},{"type":"v1","addr":"172.21.15.38:6833","nonce":4064318189}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-06-12T17:48:29.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.343+0000 7f65ca192700 1 -- 172.21.15.38:0/556043695 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f65a404da70 msgr2=0x7f65a404ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:29.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.343+0000 7f65ca192700 1 --2- 172.21.15.38:0/556043695 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f65a404da70 0x7f65a404ff30 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f65c413a160 tx=0x7f65b8007e60).stop 2020-06-12T17:48:29.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.343+0000 7f65ca192700 1 -- 172.21.15.38:0/556043695 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65c4142350 msgr2=0x7f65c40b0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:29.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.343+0000 7f65ca192700 1 --2- 172.21.15.38:0/556043695 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65c4142350 0x7f65c40b0200 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7f65bc0032b0 tx=0x7f65bc0081e0).stop 2020-06-12T17:48:29.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.343+0000 7f65ca192700 1 -- 172.21.15.38:0/556043695 shutdown_connections 2020-06-12T17:48:29.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.343+0000 7f65ca192700 1 --2- 172.21.15.38:0/556043695 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f65a404da70 0x7f65a404ff30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:29.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.343+0000 7f65ca192700 1 --2- 172.21.15.38:0/556043695 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65c4142350 0x7f65c40b0200 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:29.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.343+0000 7f65ca192700 1 -- 172.21.15.38:0/556043695 >> 172.21.15.38:0/556043695 conn(0x7f65c40b8420 msgr2=0x7f65c41417b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:29.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.343+0000 7f65ca192700 1 -- 172.21.15.38:0/556043695 shutdown_connections 2020-06-12T17:48:29.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:29.344+0000 7f65ca192700 1 -- 172.21.15.38:0/556043695 wait complete. 2020-06-12T17:48:29.353 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 6 2020-06-12T17:48:29.558 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-06-12T17:48:14.851844+0000', 'modified': '2020-06-12T17:48:18.530885+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4389}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4389': {'gid': 4389, 'name': 'a', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.38:6833/4064318189', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6832', 'nonce': 4064318189}, {'type': 'v1', 'addr': '172.21.15.38:6833', 'nonce': 4064318189}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292836696063, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-06-12T17:48:29.559 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-06-12T17:48:29.560 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-06-12T17:48:29.689 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2020-06-12T17:48:29.690 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "8e42a2e7-b187-42c4-a73f-8f812ee62352", 2020-06-12T17:48:29.690 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2020-06-12T17:48:29.690 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 4389, 2020-06-12T17:48:29.690 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2020-06-12T17:48:29.690 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2020-06-12T17:48:29.691 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 12.15616256, 2020-06-12T17:48:29.691 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 6, 2020-06-12T17:48:29.691 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 24, 2020-06-12T17:48:29.691 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 24, 2020-06-12T17:48:29.691 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 12.432136908 2020-06-12T17:48:29.692 INFO:teuthology.orchestra.run.smithi038.stdout:} 2020-06-12T17:48:29.698 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "8e42a2e7-b187-42c4-a73f-8f812ee62352", "whoami": 0, "id": 4389, "want_state": "up:active", "state": "up:active", "rank_uptime": 12.15616256, "mdsmap_epoch": 6, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "uptime": 12.432136908 } 2020-06-12T17:48:29.698 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-06-12T17:48:29.699 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-06-12T17:48:29.699 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-06-12T17:48:29.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:29.700 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:48:29.718 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:29.719 INFO:teuthology.orchestra.run.smithi038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-06-12T17:48:29.789 INFO:teuthology.orchestra.run.smithi038.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2020-06-12T17:48:29.790 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-06-12T17:48:29.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:29.791 INFO:teuthology.orchestra.run.smithi038:> ls /sys/fs/fuse/connections 2020-06-12T17:48:29.845 INFO:teuthology.orchestra.run.smithi038.stderr:ls: cannot access '/sys/fs/fuse/connections': No such file or directory 2020-06-12T17:48:29.845 DEBUG:teuthology.orchestra.run:got remote process result: 2 2020-06-12T17:48:29.846 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-06-12T17:48:29.846 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:48:29.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:29.889 INFO:teuthology.orchestra.run.smithi038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-06-12T17:48:29.918 INFO:teuthology.orchestra.run.smithi038.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2020-06-12T17:48:29.919 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-06-12T17:48:29.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:29.921 INFO:teuthology.orchestra.run.smithi038:> ls /sys/fs/fuse/connections 2020-06-12T17:48:29.969 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi038.stderr:2020-06-12T17:48:29.965+0000 7fdc993751c0 -1 init, newargv = 0x55c610f97130 newargc=9 2020-06-12T17:48:29.969 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi038.stderr:ceph-fuse[34302]: starting ceph client 2020-06-12T17:48:29.979 INFO:teuthology.orchestra.run.smithi038.stderr:ls: cannot access '/sys/fs/fuse/connections': No such file or directory 2020-06-12T17:48:29.979 DEBUG:teuthology.orchestra.run:got remote process result: 2 2020-06-12T17:48:30.002 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi038.stderr:ceph-fuse[34302]: starting fuse 2020-06-12T17:48:31.081 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:31.082 INFO:teuthology.orchestra.run.smithi038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-06-12T17:48:31.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:31.121 INFO:teuthology.orchestra.run.smithi038:> ls /sys/fs/fuse/connections 2020-06-12T17:48:31.179 INFO:teuthology.orchestra.run.smithi038.stdout:46 2020-06-12T17:48:31.180 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2020-06-12T17:48:31.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:31.181 INFO:teuthology.orchestra.run.smithi038:> sudo python3 -c ' 2020-06-12T17:48:31.181 INFO:teuthology.orchestra.run.smithi038:> import glob 2020-06-12T17:48:31.181 INFO:teuthology.orchestra.run.smithi038:> import re 2020-06-12T17:48:31.182 INFO:teuthology.orchestra.run.smithi038:> import os 2020-06-12T17:48:31.186 INFO:teuthology.orchestra.run.smithi038:> import subprocess 2020-06-12T17:48:31.186 INFO:teuthology.orchestra.run.smithi038:> 2020-06-12T17:48:31.187 INFO:teuthology.orchestra.run.smithi038:> def find_socket(client_name): 2020-06-12T17:48:31.187 INFO:teuthology.orchestra.run.smithi038:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-06-12T17:48:31.187 INFO:teuthology.orchestra.run.smithi038:> files = glob.glob(asok_path) 2020-06-12T17:48:31.188 INFO:teuthology.orchestra.run.smithi038:> 2020-06-12T17:48:31.188 INFO:teuthology.orchestra.run.smithi038:> # Given a non-glob path, it better be there 2020-06-12T17:48:31.188 INFO:teuthology.orchestra.run.smithi038:> if "*" not in asok_path: 2020-06-12T17:48:31.189 INFO:teuthology.orchestra.run.smithi038:> assert(len(files) == 1) 2020-06-12T17:48:31.189 INFO:teuthology.orchestra.run.smithi038:> return files[0] 2020-06-12T17:48:31.189 INFO:teuthology.orchestra.run.smithi038:> 2020-06-12T17:48:31.190 INFO:teuthology.orchestra.run.smithi038:> for f in files: 2020-06-12T17:48:31.190 INFO:teuthology.orchestra.run.smithi038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-06-12T17:48:31.190 INFO:teuthology.orchestra.run.smithi038:> if os.path.exists("/proc/{0}".format(pid)): 2020-06-12T17:48:31.190 INFO:teuthology.orchestra.run.smithi038:> return f 2020-06-12T17:48:31.191 INFO:teuthology.orchestra.run.smithi038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-06-12T17:48:31.191 INFO:teuthology.orchestra.run.smithi038:> 2020-06-12T17:48:31.191 INFO:teuthology.orchestra.run.smithi038:> print(find_socket("client.0")) 2020-06-12T17:48:31.192 INFO:teuthology.orchestra.run.smithi038:> ' 2020-06-12T17:48:31.284 INFO:teuthology.orchestra.run.smithi038.stdout:/var/run/ceph/ceph-client.0.34302.asok 2020-06-12T17:48:31.288 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.34302.asok 2020-06-12T17:48:31.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:31.289 INFO:teuthology.orchestra.run.smithi038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.34302.asok status 2020-06-12T17:48:31.404 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2020-06-12T17:48:31.405 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": { 2020-06-12T17:48:31.405 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_sha1": "91d24f498556f86f6d1318d2efd5210c35b36762", 2020-06-12T17:48:31.405 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_version": "ceph version 15.2.3-196-g91d24f4 (91d24f498556f86f6d1318d2efd5210c35b36762) octopus (stable)", 2020-06-12T17:48:31.405 INFO:teuthology.orchestra.run.smithi038.stdout: "entity_id": "0", 2020-06-12T17:48:31.405 INFO:teuthology.orchestra.run.smithi038.stdout: "hostname": "smithi038", 2020-06-12T17:48:31.406 INFO:teuthology.orchestra.run.smithi038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-06-12T17:48:31.406 INFO:teuthology.orchestra.run.smithi038.stdout: "pid": "34302", 2020-06-12T17:48:31.406 INFO:teuthology.orchestra.run.smithi038.stdout: "root": "/" 2020-06-12T17:48:31.406 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:31.406 INFO:teuthology.orchestra.run.smithi038.stdout: "dentry_count": 0, 2020-06-12T17:48:31.407 INFO:teuthology.orchestra.run.smithi038.stdout: "dentry_pinned_count": 0, 2020-06-12T17:48:31.407 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 4698, 2020-06-12T17:48:31.407 INFO:teuthology.orchestra.run.smithi038.stdout: "inst": { 2020-06-12T17:48:31.407 INFO:teuthology.orchestra.run.smithi038.stdout: "name": { 2020-06-12T17:48:31.407 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "client", 2020-06-12T17:48:31.408 INFO:teuthology.orchestra.run.smithi038.stdout: "num": 4698 2020-06-12T17:48:31.408 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:31.408 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": { 2020-06-12T17:48:31.408 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:31.408 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:0", 2020-06-12T17:48:31.408 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 2226321548 2020-06-12T17:48:31.409 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:31.409 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:31.409 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": { 2020-06-12T17:48:31.409 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:31.409 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:0", 2020-06-12T17:48:31.410 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 2226321548 2020-06-12T17:48:31.410 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:31.410 INFO:teuthology.orchestra.run.smithi038.stdout: "inst_str": "client.4698 172.21.15.38:0/2226321548", 2020-06-12T17:48:31.410 INFO:teuthology.orchestra.run.smithi038.stdout: "addr_str": "172.21.15.38:0/2226321548", 2020-06-12T17:48:31.410 INFO:teuthology.orchestra.run.smithi038.stdout: "inode_count": 1, 2020-06-12T17:48:31.411 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_epoch": 6, 2020-06-12T17:48:31.411 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_epoch": 24, 2020-06-12T17:48:31.411 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_epoch_barrier": 0, 2020-06-12T17:48:31.411 INFO:teuthology.orchestra.run.smithi038.stdout: "blacklisted": false 2020-06-12T17:48:31.411 INFO:teuthology.orchestra.run.smithi038.stdout:} 2020-06-12T17:48:31.414 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-12T17:48:31.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.530+0000 7f83e7f97700 1 Processor -- start 2020-06-12T17:48:31.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.531+0000 7f83e7f97700 1 -- start start 2020-06-12T17:48:31.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.531+0000 7f83e7f97700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f83e009bee0 0x7f83e00b3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:31.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.531+0000 7f83e7f97700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83e00b38f0 0x7f83e00b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:31.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.531+0000 7f83e7f97700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e00b2dc0 con 0x7f83e0061a80 2020-06-12T17:48:31.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.531+0000 7f83e7f97700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e009e560 con 0x7f83e009bee0 2020-06-12T17:48:31.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.531+0000 7f83e7f97700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e00b29d0 con 0x7f83e00b38f0 2020-06-12T17:48:31.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.531+0000 7f83e5532700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f83e009bee0 0x7f83e00b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:31.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.532+0000 7f83e5532700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f83e009bee0 0x7f83e00b3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36148/0 (socket says 172.21.15.38:36148) 2020-06-12T17:48:31.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.532+0000 7f83e5532700 1 -- 172.21.15.38:0/1568874677 learned_addr learned my addr 172.21.15.38:0/1568874677 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:31.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.532+0000 7f83e6534700 1 --2- 172.21.15.38:0/1568874677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83e00b38f0 0x7f83e00b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:31.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.532+0000 7f83e5532700 1 -- 172.21.15.38:0/1568874677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83e00b38f0 msgr2=0x7f83e00b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:31.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.532+0000 7f83e5532700 1 --2- 172.21.15.38:0/1568874677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83e00b38f0 0x7f83e00b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:31.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.532+0000 7f83e5532700 1 -- 172.21.15.38:0/1568874677 >> v1:172.21.15.150:6789/0 conn(0x7f83e0061a80 legacy=0x7f83e0142350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:31.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.532+0000 7f83e5532700 1 -- 172.21.15.38:0/1568874677 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e00b2ff0 con 0x7f83e009bee0 2020-06-12T17:48:31.540 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.532+0000 7f83e5532700 1 --2- 172.21.15.38:0/1568874677 >> v2:172.21.15.38:3300/0 conn(0x7f83e009bee0 0x7f83e00b3490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f83dc002f30 tx=0x7f83dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.540 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.532+0000 7f83e5532700 1 --2- 172.21.15.38:0/1568874677 >> v2:172.21.15.38:3300/0 conn(0x7f83e009bee0 0x7f83e00b3490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f83dc002f30 tx=0x7f83dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.540 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.532+0000 7f83e5532700 1 --2- 172.21.15.38:0/1568874677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83e009bee0 0x7f83e00b3490 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7f83dc002f30 tx=0x7f83dc007e60).ready entity=mon.0 client_cookie=ac8253560e53d700 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:31.540 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.532+0000 7f83e5532700 1 --2- 172.21.15.38:0/1568874677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83e009bee0 0x7f83e00b3490 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f83dc002f30 tx=0x7f83dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.540 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.532+0000 7f83e5532700 1 --2- 172.21.15.38:0/1568874677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83e009bee0 0x7f83e00b3490 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f83dc002f30 tx=0x7f83dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.541 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.532+0000 7f83e4d31700 1 -- 172.21.15.38:0/1568874677 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83dc011630 con 0x7f83e009bee0 2020-06-12T17:48:31.541 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.532+0000 7f83e5532700 1 --2- 172.21.15.38:0/1568874677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83e009bee0 0x7f83e00b3490 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f83dc002f30 tx=0x7f83dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.541 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.532+0000 7f83e4d31700 1 -- 172.21.15.38:0/1568874677 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83dc011790 con 0x7f83e009bee0 2020-06-12T17:48:31.541 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.532+0000 7f83e4d31700 1 -- 172.21.15.38:0/1568874677 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83dc011bb0 con 0x7f83e009bee0 2020-06-12T17:48:31.541 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.532+0000 7f83e7f97700 1 -- 172.21.15.38:0/1568874677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83e009bee0 msgr2=0x7f83e00b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:31.542 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.532+0000 7f83e7f97700 1 --2- 172.21.15.38:0/1568874677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83e009bee0 0x7f83e00b3490 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7f83dc002f30 tx=0x7f83dc007e60).stop 2020-06-12T17:48:31.542 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.533+0000 7f83e7f97700 1 -- 172.21.15.38:0/1568874677 shutdown_connections 2020-06-12T17:48:31.542 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.533+0000 7f83e7f97700 1 --2- 172.21.15.38:0/1568874677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83e00b38f0 0x7f83e00b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:31.542 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.533+0000 7f83e7f97700 1 --2- 172.21.15.38:0/1568874677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83e009bee0 0x7f83e00b3490 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:31.542 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.533+0000 7f83e7f97700 1 -- 172.21.15.38:0/1568874677 >> 172.21.15.38:0/1568874677 conn(0x7f83e00b8420 msgr2=0x7f83e00b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:31.542 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.533+0000 7f83e7f97700 1 -- 172.21.15.38:0/1568874677 shutdown_connections 2020-06-12T17:48:31.543 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.533+0000 7f83e7f97700 1 -- 172.21.15.38:0/1568874677 wait complete. 2020-06-12T17:48:31.543 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.534+0000 7f83e7f97700 1 Processor -- start 2020-06-12T17:48:31.543 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.534+0000 7f83e7f97700 1 -- start start 2020-06-12T17:48:31.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.534+0000 7f83e7f97700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83e0061a80 0x7f83e008ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:31.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.534+0000 7f83e7f97700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f83e009bee0 0x7f83e013f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:31.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.534+0000 7f83e7f97700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f83e00b38f0 0x7f83e00b1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:31.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.534+0000 7f83e7f97700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e0064d70 con 0x7f83e00b38f0 2020-06-12T17:48:31.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.534+0000 7f83e7f97700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e0064310 con 0x7f83e009bee0 2020-06-12T17:48:31.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.534+0000 7f83e7f97700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e0064630 con 0x7f83e0061a80 2020-06-12T17:48:31.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.534+0000 7f83e6534700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f83e00b38f0 0x7f83e00b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:31.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.535+0000 7f83e6534700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f83e00b38f0 0x7f83e00b1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36156/0 (socket says 172.21.15.38:36156) 2020-06-12T17:48:31.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.535+0000 7f83e6534700 1 -- 172.21.15.38:0/471886294 learned_addr learned my addr 172.21.15.38:0/471886294 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:31.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.535+0000 7f83e5532700 1 --2- 172.21.15.38:0/471886294 >> v2:172.21.15.150:3300/0 conn(0x7f83e009bee0 0x7f83e013f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:31.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.535+0000 7f83e5d33700 1 --2- 172.21.15.38:0/471886294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83e0061a80 0x7f83e008ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:31.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.535+0000 7f83e6534700 1 -- 172.21.15.38:0/471886294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83e0061a80 msgr2=0x7f83e008ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:31.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.535+0000 7f83e6534700 1 --2- 172.21.15.38:0/471886294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83e0061a80 0x7f83e008ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:31.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.535+0000 7f83e6534700 1 -- 172.21.15.38:0/471886294 >> v2:172.21.15.150:3300/0 conn(0x7f83e009bee0 msgr2=0x7f83e013f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:31.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.535+0000 7f83e6534700 1 --2- 172.21.15.38:0/471886294 >> v2:172.21.15.150:3300/0 conn(0x7f83e009bee0 0x7f83e013f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:31.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.535+0000 7f83e6534700 1 -- 172.21.15.38:0/471886294 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e00648d0 con 0x7f83e00b38f0 2020-06-12T17:48:31.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.535+0000 7f83e6534700 1 --2- 172.21.15.38:0/471886294 >> v2:172.21.15.38:3300/0 conn(0x7f83e00b38f0 0x7f83e00b1950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f83d80032b0 tx=0x7f83d80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.535+0000 7f83e6534700 1 --2- 172.21.15.38:0/471886294 >> v2:172.21.15.38:3300/0 conn(0x7f83e00b38f0 0x7f83e00b1950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f83d80032b0 tx=0x7f83d80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.535+0000 7f83e6534700 1 --2- 172.21.15.38:0/471886294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83e00b38f0 0x7f83e00b1950 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x7f83d80032b0 tx=0x7f83d80081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:31.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.535+0000 7f83e6534700 1 --2- 172.21.15.38:0/471886294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83e00b38f0 0x7f83e00b1950 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f83d80032b0 tx=0x7f83d80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.535+0000 7f83ceffd700 1 -- 172.21.15.38:0/471886294 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83d800e350 con 0x7f83e00b38f0 2020-06-12T17:48:31.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.535+0000 7f83e6534700 1 --2- 172.21.15.38:0/471886294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83e00b38f0 0x7f83e00b1950 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f83d80032b0 tx=0x7f83d80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.535+0000 7f83ceffd700 1 -- 172.21.15.38:0/471886294 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d8005c30 con 0x7f83e00b38f0 2020-06-12T17:48:31.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.535+0000 7f83e7f97700 1 -- 172.21.15.38:0/471886294 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e013f670 con 0x7f83e00b38f0 2020-06-12T17:48:31.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.535+0000 7f83e6534700 1 --2- 172.21.15.38:0/471886294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83e00b38f0 0x7f83e00b1950 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f83d80032b0 tx=0x7f83d80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.535+0000 7f83ceffd700 1 -- 172.21.15.38:0/471886294 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83d8005e20 con 0x7f83e00b38f0 2020-06-12T17:48:31.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.535+0000 7f83e7f97700 1 -- 172.21.15.38:0/471886294 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e0063ac0 con 0x7f83e00b38f0 2020-06-12T17:48:31.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.536+0000 7f83e6534700 1 --2- 172.21.15.38:0/471886294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83e00b38f0 0x7f83e00b1950 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f83d80032b0 tx=0x7f83d80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.537+0000 7f83e7f97700 1 -- 172.21.15.38:0/471886294 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e005d3e0 con 0x7f83e00b38f0 2020-06-12T17:48:31.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.537+0000 7f83ceffd700 1 -- 172.21.15.38:0/471886294 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f83d800caf0 con 0x7f83e00b38f0 2020-06-12T17:48:31.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.537+0000 7f83e6534700 1 --2- 172.21.15.38:0/471886294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83e00b38f0 0x7f83e00b1950 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f83d80032b0 tx=0x7f83d80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.537+0000 7f83ceffd700 1 --2- 172.21.15.38:0/471886294 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f83c004d650 0x7f83c004fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:31.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.537+0000 7f83ceffd700 1 -- 172.21.15.38:0/471886294 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f83d8060e00 con 0x7f83e00b38f0 2020-06-12T17:48:31.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.537+0000 7f83e5d33700 1 --2- 172.21.15.38:0/471886294 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f83c004d650 0x7f83c004fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:31.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.537+0000 7f83e5d33700 1 --2- 172.21.15.38:0/471886294 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f83c004d650 0x7f83c004fb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f83e0060540 tx=0x7f83d0001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.537+0000 7f83e5d33700 1 --2- 172.21.15.38:0/471886294 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f83c004d650 0x7f83c004fb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f83e0060540 tx=0x7f83d0001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.537+0000 7f83e5d33700 1 --2- 172.21.15.38:0/471886294 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f83c004d650 0x7f83c004fb10 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f83e0060540 tx=0x7f83d0001760).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:31.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.540+0000 7f83e6534700 1 --2- 172.21.15.38:0/471886294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83e00b38f0 0x7f83e00b1950 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f83d80032b0 tx=0x7f83d80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.540+0000 7f83ceffd700 1 -- 172.21.15.38:0/471886294 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f83d803c5a0 con 0x7f83e00b38f0 2020-06-12T17:48:31.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.691+0000 7f83e7f97700 1 -- 172.21.15.38:0/471886294 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83e00b2130 con 0x7f83e00b38f0 2020-06-12T17:48:31.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.692+0000 7f83e6534700 1 --2- 172.21.15.38:0/471886294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83e00b38f0 0x7f83e00b1950 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f83d80032b0 tx=0x7f83d80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.692+0000 7f83ceffd700 1 -- 172.21.15.38:0/471886294 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16347 (secure 0 0 0) 0x7f83e00b2130 con 0x7f83e00b38f0 2020-06-12T17:48:31.697 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:31.697 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":24,"fsid":"8e42a2e7-b187-42c4-a73f-8f812ee62352","created":"2020-06-12T17:47:54.434340+0000","modified":"2020-06-12T17:48:14.851712+0000","last_up_change":"2020-06-12T17:48:03.388718+0000","last_in_change":"2020-06-12T17:48:03.388718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-06-12T17:47:57.558119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-06-12T17:48:07.419264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-06-12T17:48:09.934098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-06-12T17:48:12.497229+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"44ac3dea-67b4-4b9a-bc18-ac511710afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":31038},{"type":"v1","addr":"172.21.15.38:6816","nonce":31038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":31038},{"type":"v1","addr":"172.21.15.38:6819","nonce":31038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":31038},{"type":"v1","addr":"172.21.15.38:6823","nonce":31038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":31038},{"type":"v1","addr":"172.21.15.38:6821","nonce":31038}]},"public_addr":"172.21.15.38:6816/31038","cluster_addr":"172.21.15.38:6819/31038","heartbeat_back_addr":"172.21.15.38:6823/31038","heartbeat_front_addr":"172.21.15.38:6821/31038","state":["exists","up"]},{"osd":1,"uuid":"561f7ced-3fff-4364-8619-6e4ecbc9d256","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":31036},{"type":"v1","addr":"172.21.15.38:6801","nonce":31036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":31036},{"type":"v1","addr":"172.21.15.38:6803","nonce":31036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":31036},{"type":"v1","addr":"172.21.15.38:6807","nonce":31036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":31036},{"type":"v1","addr":"172.21.15.38:6805","nonce":31036}]},"public_addr":"172.21.15.38:6801/31036","cluster_addr":"172.21.15.38:6803/31036","heartbeat_back_addr":"172.21.15.38:6807/31036","heartbeat_front_addr":"172.21.15.38:6805/31036","state":["exists","up"]},{"osd":2,"uuid":"0bb3c806-07af-49f5-b492-d0e33f2de37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":31053},{"type":"v1","addr":"172.21.15.38:6825","nonce":31053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":31053},{"type":"v1","addr":"172.21.15.38:6827","nonce":31053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":31053},{"type":"v1","addr":"172.21.15.38:6831","nonce":31053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":31053},{"type":"v1","addr":"172.21.15.38:6829","nonce":31053}]},"public_addr":"172.21.15.38:6825/31053","cluster_addr":"172.21.15.38:6827/31053","heartbeat_back_addr":"172.21.15.38:6831/31053","heartbeat_front_addr":"172.21.15.38:6829/31053","state":["exists","up"]},{"osd":3,"uuid":"7f6a1e75-7b11-456e-8a4b-510b16226800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":31037},{"type":"v1","addr":"172.21.15.38:6809","nonce":31037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":31037},{"type":"v1","addr":"172.21.15.38:6811","nonce":31037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6815","nonce":31037},{"type":"v1","addr":"172.21.15.38:6817","nonce":31037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":31037},{"type":"v1","addr":"172.21.15.38:6813","nonce":31037}]},"public_addr":"172.21.15.38:6809/31037","cluster_addr":"172.21.15.38:6811/31037","heartbeat_back_addr":"172.21.15.38:6817/31037","heartbeat_front_addr":"172.21.15.38:6813/31037","state":["exists","up"]},{"osd":4,"uuid":"0eca0272-8cfd-469c-a32d-e29730dc0e1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":31294},{"type":"v1","addr":"172.21.15.150:6803","nonce":31294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":31294},{"type":"v1","addr":"172.21.15.150:6805","nonce":31294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":31294},{"type":"v1","addr":"172.21.15.150:6809","nonce":31294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":31294},{"type":"v1","addr":"172.21.15.150:6807","nonce":31294}]},"public_addr":"172.21.15.150:6803/31294","cluster_addr":"172.21.15.150:6805/31294","heartbeat_back_addr":"172.21.15.150:6809/31294","heartbeat_front_addr":"172.21.15.150:6807/31294","state":["exists","up"]},{"osd":5,"uuid":"69d6a7dc-a55a-4ebc-8479-8bb921ddfb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":31295},{"type":"v1","addr":"172.21.15.150:6813","nonce":31295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":31295},{"type":"v1","addr":"172.21.15.150:6816","nonce":31295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":31295},{"type":"v1","addr":"172.21.15.150:6828","nonce":31295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6819","nonce":31295},{"type":"v1","addr":"172.21.15.150:6822","nonce":31295}]},"public_addr":"172.21.15.150:6813/31295","cluster_addr":"172.21.15.150:6816/31295","heartbeat_back_addr":"172.21.15.150:6828/31295","heartbeat_front_addr":"172.21.15.150:6822/31295","state":["exists","up"]},{"osd":6,"uuid":"f0d320f8-c2f0-40bb-b713-526246cf97b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":31297},{"type":"v1","addr":"172.21.15.150:6820","nonce":31297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6823","nonce":31297},{"type":"v1","addr":"172.21.15.150:6827","nonce":31297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":31297},{"type":"v1","addr":"172.21.15.150:6833","nonce":31297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":31297},{"type":"v1","addr":"172.21.15.150:6831","nonce":31297}]},"public_addr":"172.21.15.150:6820/31297","cluster_addr":"172.21.15.150:6827/31297","heartbeat_back_addr":"172.21.15.150:6833/31297","heartbeat_front_addr":"172.21.15.150:6831/31297","state":["exists","up"]},{"osd":7,"uuid":"970b7d02-a189-41b2-96e5-a5a5a57c6476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":31296},{"type":"v1","addr":"172.21.15.150:6812","nonce":31296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":31296},{"type":"v1","addr":"172.21.15.150:6818","nonce":31296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":31296},{"type":"v1","addr":"172.21.15.150:6829","nonce":31296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":31296},{"type":"v1","addr":"172.21.15.150:6824","nonce":31296}]},"public_addr":"172.21.15.150:6812/31296","cluster_addr":"172.21.15.150:6818/31296","heartbeat_back_addr":"172.21.15.150:6829/31296","heartbeat_front_addr":"172.21.15.150:6824/31296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.664300+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.644253+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.651120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.584978+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.561149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.661778+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T17:48:31.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.693+0000 7f83e7f97700 1 -- 172.21.15.38:0/471886294 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f83c004d650 msgr2=0x7f83c004fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:31.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.693+0000 7f83e7f97700 1 --2- 172.21.15.38:0/471886294 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f83c004d650 0x7f83c004fb10 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f83e0060540 tx=0x7f83d0001760).stop 2020-06-12T17:48:31.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.693+0000 7f83e7f97700 1 -- 172.21.15.38:0/471886294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83e00b38f0 msgr2=0x7f83e00b1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:31.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.693+0000 7f83e7f97700 1 --2- 172.21.15.38:0/471886294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83e00b38f0 0x7f83e00b1950 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x7f83d80032b0 tx=0x7f83d80081e0).stop 2020-06-12T17:48:31.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.694+0000 7f83e7f97700 1 -- 172.21.15.38:0/471886294 shutdown_connections 2020-06-12T17:48:31.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.694+0000 7f83e7f97700 1 --2- 172.21.15.38:0/471886294 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f83c004d650 0x7f83c004fb10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:31.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.694+0000 7f83e7f97700 1 --2- 172.21.15.38:0/471886294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83e00b38f0 0x7f83e00b1950 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:31.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.694+0000 7f83e7f97700 1 --2- 172.21.15.38:0/471886294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83e0061a80 0x7f83e008ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:31.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.694+0000 7f83e7f97700 1 --2- 172.21.15.38:0/471886294 >> v2:172.21.15.150:3300/0 conn(0x7f83e009bee0 0x7f83e013f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:31.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.694+0000 7f83e7f97700 1 -- 172.21.15.38:0/471886294 >> 172.21.15.38:0/471886294 conn(0x7f83e00b8420 msgr2=0x7f83e00b6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:31.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.694+0000 7f83e7f97700 1 -- 172.21.15.38:0/471886294 shutdown_connections 2020-06-12T17:48:31.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.694+0000 7f83e7f97700 1 -- 172.21.15.38:0/471886294 wait complete. 2020-06-12T17:48:31.710 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-06-12T17:47:57.558119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-06-12T17:48:07.419264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-06-12T17:48:09.934098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-06-12T17:48:12.497229+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-06-12T17:48:31.711 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-06-12T17:48:31.836 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.832+0000 7feb8229c700 1 Processor -- start 2020-06-12T17:48:31.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.832+0000 7feb8229c700 1 -- start start 2020-06-12T17:48:31.841 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.833+0000 7feb8229c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb7c0ad5b0 0x7feb7c0b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:31.841 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.833+0000 7feb8229c700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb7c146d20 con 0x7feb7c09d8d0 2020-06-12T17:48:31.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.833+0000 7feb8229c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb7c066a80 con 0x7feb7c146680 2020-06-12T17:48:31.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.833+0000 7feb8229c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c146f50 con 0x7feb7c0ad5b0 2020-06-12T17:48:31.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.833+0000 7feb80839700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7feb7c09d8d0 0x7feb7c1421d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37980/0 (socket says 172.21.15.38:37980) 2020-06-12T17:48:31.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.833+0000 7feb80839700 1 -- 172.21.15.38:0/3502942719 learned_addr learned my addr 172.21.15.38:0/3502942719 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:31.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.833+0000 7feb7b7fe700 1 --2- 172.21.15.38:0/3502942719 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb7c0ad5b0 0x7feb7c0b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:31.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.833+0000 7feb7affd700 1 -- 172.21.15.38:0/3502942719 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164434353 0 0) 0x7feb7c146d20 con 0x7feb7c09d8d0 2020-06-12T17:48:31.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.833+0000 7feb7affd700 1 -- 172.21.15.38:0/3502942719 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb68003230 con 0x7feb7c09d8d0 2020-06-12T17:48:31.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.834+0000 7feb7affd700 1 -- 172.21.15.38:0/3502942719 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786151352 0 0) 0x7feb7c066a80 con 0x7feb7c146680 2020-06-12T17:48:31.844 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.834+0000 7feb7affd700 1 -- 172.21.15.38:0/3502942719 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb7c146d20 con 0x7feb7c146680 2020-06-12T17:48:31.844 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.834+0000 7feb7affd700 1 -- 172.21.15.38:0/3502942719 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3402439650 0 0) 0x7feb68003230 con 0x7feb7c09d8d0 2020-06-12T17:48:31.844 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.834+0000 7feb7b7fe700 1 -- 172.21.15.38:0/3502942719 >> v1:172.21.15.150:6789/0 conn(0x7feb7c146680 legacy=0x7feb7c09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:31.844 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.834+0000 7feb7b7fe700 1 -- 172.21.15.38:0/3502942719 >> v1:172.21.15.38:6789/0 conn(0x7feb7c09d8d0 legacy=0x7feb7c1421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:31.844 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.834+0000 7feb7b7fe700 1 -- 172.21.15.38:0/3502942719 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c146a60 con 0x7feb7c0ad5b0 2020-06-12T17:48:31.845 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.834+0000 7feb7b7fe700 1 --2- 172.21.15.38:0/3502942719 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb7c0ad5b0 0x7feb7c0b2eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7feb74001bf0 tx=0x7feb70007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.845 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.834+0000 7feb7b7fe700 1 --2- 172.21.15.38:0/3502942719 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb7c0ad5b0 0x7feb7c0b2eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7feb74001bf0 tx=0x7feb70007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.845 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.834+0000 7feb7b7fe700 1 --2- 172.21.15.38:0/3502942719 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb7c0ad5b0 0x7feb7c0b2eb0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7feb74001bf0 tx=0x7feb70007e60).ready entity=mon.2 client_cookie=123ec27463a6278b server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:31.845 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.834+0000 7feb7b7fe700 1 --2- 172.21.15.38:0/3502942719 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb7c0ad5b0 0x7feb7c0b2eb0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7feb74001bf0 tx=0x7feb70007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.845 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.834+0000 7feb7affd700 1 -- 172.21.15.38:0/3502942719 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb74001a50 con 0x7feb7c0ad5b0 2020-06-12T17:48:31.846 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.834+0000 7feb7b7fe700 1 --2- 172.21.15.38:0/3502942719 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb7c0ad5b0 0x7feb7c0b2eb0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7feb74001bf0 tx=0x7feb70007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.846 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.834+0000 7feb7affd700 1 -- 172.21.15.38:0/3502942719 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb70008b40 con 0x7feb7c0ad5b0 2020-06-12T17:48:31.846 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.834+0000 7feb7b7fe700 1 --2- 172.21.15.38:0/3502942719 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb7c0ad5b0 0x7feb7c0b2eb0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7feb74001bf0 tx=0x7feb70007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.846 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.834+0000 7feb7affd700 1 -- 172.21.15.38:0/3502942719 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb70008ea0 con 0x7feb7c0ad5b0 2020-06-12T17:48:31.846 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.834+0000 7feb8229c700 1 -- 172.21.15.38:0/3502942719 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb7c0ad5b0 msgr2=0x7feb7c0b2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:31.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.834+0000 7feb8229c700 1 --2- 172.21.15.38:0/3502942719 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb7c0ad5b0 0x7feb7c0b2eb0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7feb74001bf0 tx=0x7feb70007e60).stop 2020-06-12T17:48:31.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.835+0000 7feb8229c700 1 -- 172.21.15.38:0/3502942719 shutdown_connections 2020-06-12T17:48:31.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.835+0000 7feb8229c700 1 --2- 172.21.15.38:0/3502942719 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb7c0ad5b0 0x7feb7c0b2eb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:31.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.835+0000 7feb8229c700 1 -- 172.21.15.38:0/3502942719 >> 172.21.15.38:0/3502942719 conn(0x7feb7c0b5a20 msgr2=0x7feb7c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:31.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.835+0000 7feb8229c700 1 -- 172.21.15.38:0/3502942719 shutdown_connections 2020-06-12T17:48:31.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.835+0000 7feb8229c700 1 -- 172.21.15.38:0/3502942719 wait complete. 2020-06-12T17:48:31.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.836+0000 7feb8229c700 1 Processor -- start 2020-06-12T17:48:31.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.836+0000 7feb8229c700 1 -- start start 2020-06-12T17:48:31.850 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.836+0000 7feb8229c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb7c09d8d0 0x7feb7c061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:31.850 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.836+0000 7feb8229c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7feb7c0ad5b0 0x7feb7c0b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:31.850 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.836+0000 7feb8229c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb7c0b1810 con 0x7feb7c146680 2020-06-12T17:48:31.851 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.836+0000 7feb8229c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb7c063110 con 0x7feb7c0ad5b0 2020-06-12T17:48:31.851 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.836+0000 7feb8229c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c0633b0 con 0x7feb7c09d8d0 2020-06-12T17:48:31.851 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.837+0000 7feb7b7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7feb7c0ad5b0 0x7feb7c0b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:31.852 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.837+0000 7feb7bfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb7c09d8d0 0x7feb7c061510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:31.852 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.837+0000 7feb7b7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7feb7c0ad5b0 0x7feb7c0b13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:45644/0 (socket says 172.21.15.38:45644) 2020-06-12T17:48:31.853 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.837+0000 7feb7b7fe700 1 -- 172.21.15.38:0/1042242357 learned_addr learned my addr 172.21.15.38:0/1042242357 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:31.853 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.837+0000 7feb7bfff700 1 -- 172.21.15.38:0/1042242357 >> v2:172.21.15.150:3300/0 conn(0x7feb7c0ad5b0 msgr2=0x7feb7c0b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:31.853 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.837+0000 7feb7bfff700 1 --2- 172.21.15.38:0/1042242357 >> v2:172.21.15.150:3300/0 conn(0x7feb7c0ad5b0 0x7feb7c0b13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:31.854 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.837+0000 7feb7bfff700 1 -- 172.21.15.38:0/1042242357 >> v1:172.21.15.150:6789/0 conn(0x7feb7c146680 legacy=0x7feb7c150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:31.854 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.837+0000 7feb7bfff700 1 -- 172.21.15.38:0/1042242357 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c063650 con 0x7feb7c09d8d0 2020-06-12T17:48:31.855 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.837+0000 7feb7bfff700 1 --2- 172.21.15.38:0/1042242357 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb7c09d8d0 0x7feb7c061510 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feb6c0010d0 tx=0x7feb6c0027b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.855 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.837+0000 7feb7bfff700 1 --2- 172.21.15.38:0/1042242357 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb7c09d8d0 0x7feb7c061510 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feb6c0010d0 tx=0x7feb6c0027b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.855 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.837+0000 7feb7bfff700 1 --2- 172.21.15.38:0/1042242357 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb7c09d8d0 0x7feb7c061510 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7feb6c0010d0 tx=0x7feb6c0027b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:31.856 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.837+0000 7feb7bfff700 1 --2- 172.21.15.38:0/1042242357 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb7c09d8d0 0x7feb7c061510 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7feb6c0010d0 tx=0x7feb6c0027b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.856 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.837+0000 7feb797fa700 1 -- 172.21.15.38:0/1042242357 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb6c006bc0 con 0x7feb7c09d8d0 2020-06-12T17:48:31.856 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.837+0000 7feb7bfff700 1 --2- 172.21.15.38:0/1042242357 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb7c09d8d0 0x7feb7c061510 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7feb6c0010d0 tx=0x7feb6c0027b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.857 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.837+0000 7feb7bfff700 1 --2- 172.21.15.38:0/1042242357 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb7c09d8d0 0x7feb7c061510 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7feb6c0010d0 tx=0x7feb6c0027b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.857 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.837+0000 7feb797fa700 1 -- 172.21.15.38:0/1042242357 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6c006d60 con 0x7feb7c09d8d0 2020-06-12T17:48:31.857 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.837+0000 7feb797fa700 1 -- 172.21.15.38:0/1042242357 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb6c008350 con 0x7feb7c09d8d0 2020-06-12T17:48:31.858 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.837+0000 7feb8229c700 1 -- 172.21.15.38:0/1042242357 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb7c062a00 con 0x7feb7c09d8d0 2020-06-12T17:48:31.858 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.837+0000 7feb8229c700 1 -- 172.21.15.38:0/1042242357 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb7c135400 con 0x7feb7c09d8d0 2020-06-12T17:48:31.860 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.838+0000 7feb7bfff700 1 --2- 172.21.15.38:0/1042242357 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb7c09d8d0 0x7feb7c061510 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7feb6c0010d0 tx=0x7feb6c0027b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.861 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.838+0000 7feb8229c700 1 -- 172.21.15.38:0/1042242357 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb7c062f50 con 0x7feb7c09d8d0 2020-06-12T17:48:31.861 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.839+0000 7feb797fa700 1 -- 172.21.15.38:0/1042242357 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7feb6c0085c0 con 0x7feb7c09d8d0 2020-06-12T17:48:31.861 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.839+0000 7feb7bfff700 1 --2- 172.21.15.38:0/1042242357 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb7c09d8d0 0x7feb7c061510 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7feb6c0010d0 tx=0x7feb6c0027b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.839+0000 7feb797fa700 1 --2- 172.21.15.38:0/1042242357 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7feb5c04d590 0x7feb5c04fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:31.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.839+0000 7feb797fa700 1 -- 172.21.15.38:0/1042242357 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7feb6c061090 con 0x7feb7c09d8d0 2020-06-12T17:48:31.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.839+0000 7feb7b7fe700 1 --2- 172.21.15.38:0/1042242357 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7feb5c04d590 0x7feb5c04fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:31.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.839+0000 7feb7b7fe700 1 --2- 172.21.15.38:0/1042242357 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7feb5c04d590 0x7feb5c04fa50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feb74001bf0 tx=0x7feb70007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.839+0000 7feb7b7fe700 1 --2- 172.21.15.38:0/1042242357 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7feb5c04d590 0x7feb5c04fa50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feb74001bf0 tx=0x7feb70007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.839+0000 7feb7b7fe700 1 --2- 172.21.15.38:0/1042242357 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7feb5c04d590 0x7feb5c04fa50 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7feb74001bf0 tx=0x7feb70007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:31.874 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.843+0000 7feb7bfff700 1 --2- 172.21.15.38:0/1042242357 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb7c09d8d0 0x7feb7c061510 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7feb6c0010d0 tx=0x7feb6c0027b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.874 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.843+0000 7feb797fa700 1 -- 172.21.15.38:0/1042242357 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7feb6c03c730 con 0x7feb7c09d8d0 2020-06-12T17:48:31.996 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.992+0000 7feb8229c700 1 -- 172.21.15.38:0/1042242357 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7feb7c056c30 con 0x7feb7c09d8d0 2020-06-12T17:48:31.997 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.993+0000 7feb7bfff700 1 --2- 172.21.15.38:0/1042242357 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb7c09d8d0 0x7feb7c061510 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7feb6c0010d0 tx=0x7feb6c0027b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:31.997 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.993+0000 7feb797fa700 1 -- 172.21.15.38:0/1042242357 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7feb6c03fd50 con 0x7feb7c09d8d0 2020-06-12T17:48:31.997 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2020-06-12T17:48:32.003 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.994+0000 7feb8229c700 1 -- 172.21.15.38:0/1042242357 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7feb5c04d590 msgr2=0x7feb5c04fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:32.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.994+0000 7feb8229c700 1 --2- 172.21.15.38:0/1042242357 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7feb5c04d590 0x7feb5c04fa50 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7feb74001bf0 tx=0x7feb70007e60).stop 2020-06-12T17:48:32.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.994+0000 7feb8229c700 1 -- 172.21.15.38:0/1042242357 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb7c09d8d0 msgr2=0x7feb7c061510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:32.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.994+0000 7feb8229c700 1 --2- 172.21.15.38:0/1042242357 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb7c09d8d0 0x7feb7c061510 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7feb6c0010d0 tx=0x7feb6c0027b0).stop 2020-06-12T17:48:32.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.994+0000 7feb8229c700 1 -- 172.21.15.38:0/1042242357 shutdown_connections 2020-06-12T17:48:32.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.994+0000 7feb8229c700 1 --2- 172.21.15.38:0/1042242357 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7feb5c04d590 0x7feb5c04fa50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:32.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.994+0000 7feb8229c700 1 --2- 172.21.15.38:0/1042242357 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb7c09d8d0 0x7feb7c061510 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:32.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.994+0000 7feb8229c700 1 --2- 172.21.15.38:0/1042242357 >> v2:172.21.15.150:3300/0 conn(0x7feb7c0ad5b0 0x7feb7c0b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:32.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.994+0000 7feb8229c700 1 -- 172.21.15.38:0/1042242357 >> 172.21.15.38:0/1042242357 conn(0x7feb7c0b5a20 msgr2=0x7feb7c09c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:32.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.995+0000 7feb8229c700 1 -- 172.21.15.38:0/1042242357 shutdown_connections 2020-06-12T17:48:32.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:31.995+0000 7feb8229c700 1 -- 172.21.15.38:0/1042242357 wait complete. 2020-06-12T17:48:32.016 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-06-12T17:48:32.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.129+0000 7f0a6c147700 1 Processor -- start 2020-06-12T17:48:32.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.130+0000 7f0a6c147700 1 -- start start 2020-06-12T17:48:32.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.130+0000 7f0a6c147700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0a640ad5b0 0x7f0a640b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:32.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.130+0000 7f0a6c147700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0a6409d8d0 0x7f0a641421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:32.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.130+0000 7f0a6c147700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a64146d20 con 0x7f0a64146680 2020-06-12T17:48:32.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.130+0000 7f0a6c147700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a64066a80 con 0x7f0a6409d8d0 2020-06-12T17:48:32.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.130+0000 7f0a6c147700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a64146f50 con 0x7f0a640ad5b0 2020-06-12T17:48:32.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.130+0000 7f0a6a6e4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0a6409d8d0 0x7f0a641421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:32.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.131+0000 7f0a6a6e4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0a6409d8d0 0x7f0a641421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36174/0 (socket says 172.21.15.38:36174) 2020-06-12T17:48:32.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.131+0000 7f0a6a6e4700 1 -- 172.21.15.38:0/2350076447 learned_addr learned my addr 172.21.15.38:0/2350076447 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:32.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.131+0000 7f0a696e2700 1 --2- 172.21.15.38:0/2350076447 >> v2:172.21.15.150:3300/0 conn(0x7f0a640ad5b0 0x7f0a640b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:32.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.131+0000 7f0a6a6e4700 1 -- 172.21.15.38:0/2350076447 >> v2:172.21.15.150:3300/0 conn(0x7f0a640ad5b0 msgr2=0x7f0a640b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:32.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.131+0000 7f0a6a6e4700 1 --2- 172.21.15.38:0/2350076447 >> v2:172.21.15.150:3300/0 conn(0x7f0a640ad5b0 0x7f0a640b2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:32.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.131+0000 7f0a6a6e4700 1 -- 172.21.15.38:0/2350076447 >> v1:172.21.15.150:6789/0 conn(0x7f0a64146680 legacy=0x7f0a6409d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:32.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.131+0000 7f0a6a6e4700 1 -- 172.21.15.38:0/2350076447 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a64146a60 con 0x7f0a6409d8d0 2020-06-12T17:48:32.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.131+0000 7f0a6a6e4700 1 --2- 172.21.15.38:0/2350076447 >> v2:172.21.15.38:3300/0 conn(0x7f0a6409d8d0 0x7f0a641421d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0a64061380 tx=0x7f0a5c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.131+0000 7f0a6a6e4700 1 --2- 172.21.15.38:0/2350076447 >> v2:172.21.15.38:3300/0 conn(0x7f0a6409d8d0 0x7f0a641421d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0a64061380 tx=0x7f0a5c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.131+0000 7f0a6a6e4700 1 --2- 172.21.15.38:0/2350076447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a6409d8d0 0x7f0a641421d0 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7f0a64061380 tx=0x7f0a5c007e60).ready entity=mon.0 client_cookie=9b436448ddcec2e8 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:32.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.131+0000 7f0a6a6e4700 1 --2- 172.21.15.38:0/2350076447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a6409d8d0 0x7f0a641421d0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7f0a64061380 tx=0x7f0a5c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.131+0000 7f0a68ee1700 1 -- 172.21.15.38:0/2350076447 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a5c0116a0 con 0x7f0a6409d8d0 2020-06-12T17:48:32.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.131+0000 7f0a6a6e4700 1 --2- 172.21.15.38:0/2350076447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a6409d8d0 0x7f0a641421d0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7f0a64061380 tx=0x7f0a5c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.131+0000 7f0a6a6e4700 1 --2- 172.21.15.38:0/2350076447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a6409d8d0 0x7f0a641421d0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7f0a64061380 tx=0x7f0a5c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.131+0000 7f0a68ee1700 1 -- 172.21.15.38:0/2350076447 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5c011800 con 0x7f0a6409d8d0 2020-06-12T17:48:32.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.131+0000 7f0a68ee1700 1 -- 172.21.15.38:0/2350076447 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a5c011be0 con 0x7f0a6409d8d0 2020-06-12T17:48:32.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.131+0000 7f0a6c147700 1 -- 172.21.15.38:0/2350076447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a6409d8d0 msgr2=0x7f0a641421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:32.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.131+0000 7f0a6c147700 1 --2- 172.21.15.38:0/2350076447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a6409d8d0 0x7f0a641421d0 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7f0a64061380 tx=0x7f0a5c007e60).stop 2020-06-12T17:48:32.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.132+0000 7f0a6c147700 1 -- 172.21.15.38:0/2350076447 shutdown_connections 2020-06-12T17:48:32.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.132+0000 7f0a6c147700 1 --2- 172.21.15.38:0/2350076447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a6409d8d0 0x7f0a641421d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:32.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.132+0000 7f0a6c147700 1 --2- 172.21.15.38:0/2350076447 >> v2:172.21.15.150:3300/0 conn(0x7f0a640ad5b0 0x7f0a640b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:32.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.132+0000 7f0a6c147700 1 -- 172.21.15.38:0/2350076447 >> 172.21.15.38:0/2350076447 conn(0x7f0a640b5a20 msgr2=0x7f0a6405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:32.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.132+0000 7f0a6c147700 1 -- 172.21.15.38:0/2350076447 shutdown_connections 2020-06-12T17:48:32.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.132+0000 7f0a6c147700 1 -- 172.21.15.38:0/2350076447 wait complete. 2020-06-12T17:48:32.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.133+0000 7f0a6c147700 1 Processor -- start 2020-06-12T17:48:32.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.133+0000 7f0a6c147700 1 -- start start 2020-06-12T17:48:32.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.133+0000 7f0a6c147700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0a64146680 0x7f0a640b0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:32.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.133+0000 7f0a6c147700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a64062850 con 0x7f0a6409d8d0 2020-06-12T17:48:32.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.133+0000 7f0a6c147700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a64063900 con 0x7f0a640ad5b0 2020-06-12T17:48:32.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.133+0000 7f0a6c147700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a64063ba0 con 0x7f0a64146680 2020-06-12T17:48:32.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.134+0000 7f0a6a6e4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0a64146680 0x7f0a640b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:32.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.134+0000 7f0a6a6e4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0a64146680 0x7f0a640b0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36182/0 (socket says 172.21.15.38:36182) 2020-06-12T17:48:32.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.134+0000 7f0a69ee3700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f0a6409d8d0 0x7f0a64138790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37994/0 (socket says 172.21.15.38:37994) 2020-06-12T17:48:32.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.134+0000 7f0a6a6e4700 1 -- 172.21.15.38:0/3021903093 learned_addr learned my addr 172.21.15.38:0/3021903093 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:32.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.134+0000 7f0a6a6e4700 1 -- 172.21.15.38:0/3021903093 >> v1:172.21.15.150:6789/0 conn(0x7f0a640ad5b0 legacy=0x7f0a64064040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:32.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.134+0000 7f0a6a6e4700 1 -- 172.21.15.38:0/3021903093 >> v1:172.21.15.38:6789/0 conn(0x7f0a6409d8d0 legacy=0x7f0a64138790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:32.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.134+0000 7f0a52ffd700 1 -- 172.21.15.38:0/3021903093 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3979174146 0 0) 0x7f0a64062850 con 0x7f0a6409d8d0 2020-06-12T17:48:32.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.134+0000 7f0a6a6e4700 1 -- 172.21.15.38:0/3021903093 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a64062460 con 0x7f0a64146680 2020-06-12T17:48:32.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.134+0000 7f0a6a6e4700 1 --2- 172.21.15.38:0/3021903093 >> v2:172.21.15.38:3300/0 conn(0x7f0a64146680 0x7f0a640b0130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0a64061380 tx=0x7f0a5c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.134+0000 7f0a6a6e4700 1 --2- 172.21.15.38:0/3021903093 >> v2:172.21.15.38:3300/0 conn(0x7f0a64146680 0x7f0a640b0130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0a64061380 tx=0x7f0a5c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.134+0000 7f0a6a6e4700 1 --2- 172.21.15.38:0/3021903093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a64146680 0x7f0a640b0130 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7f0a64061380 tx=0x7f0a5c007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:32.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.134+0000 7f0a6a6e4700 1 --2- 172.21.15.38:0/3021903093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a64146680 0x7f0a640b0130 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f0a64061380 tx=0x7f0a5c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.134+0000 7f0a6a6e4700 1 --2- 172.21.15.38:0/3021903093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a64146680 0x7f0a640b0130 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f0a64061380 tx=0x7f0a5c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.134+0000 7f0a52ffd700 1 -- 172.21.15.38:0/3021903093 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a5c007340 con 0x7f0a64146680 2020-06-12T17:48:32.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.134+0000 7f0a6a6e4700 1 --2- 172.21.15.38:0/3021903093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a64146680 0x7f0a640b0130 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f0a64061380 tx=0x7f0a5c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.134+0000 7f0a52ffd700 1 -- 172.21.15.38:0/3021903093 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5c0074a0 con 0x7f0a64146680 2020-06-12T17:48:32.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.134+0000 7f0a52ffd700 1 -- 172.21.15.38:0/3021903093 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a5c0058b0 con 0x7f0a64146680 2020-06-12T17:48:32.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.134+0000 7f0a6c147700 1 -- 172.21.15.38:0/3021903093 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a64138ea0 con 0x7f0a64146680 2020-06-12T17:48:32.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.134+0000 7f0a6c147700 1 -- 172.21.15.38:0/3021903093 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a640635f0 con 0x7f0a64146680 2020-06-12T17:48:32.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.135+0000 7f0a6a6e4700 1 --2- 172.21.15.38:0/3021903093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a64146680 0x7f0a640b0130 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f0a64061380 tx=0x7f0a5c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.136+0000 7f0a6c147700 1 -- 172.21.15.38:0/3021903093 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a640626b0 con 0x7f0a64146680 2020-06-12T17:48:32.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.136+0000 7f0a52ffd700 1 -- 172.21.15.38:0/3021903093 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f0a5c005a10 con 0x7f0a64146680 2020-06-12T17:48:32.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.136+0000 7f0a6a6e4700 1 --2- 172.21.15.38:0/3021903093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a64146680 0x7f0a640b0130 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f0a64061380 tx=0x7f0a5c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.136+0000 7f0a52ffd700 1 --2- 172.21.15.38:0/3021903093 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0a4404d4b0 0x7f0a4404f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:32.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.136+0000 7f0a52ffd700 1 -- 172.21.15.38:0/3021903093 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f0a5c061760 con 0x7f0a64146680 2020-06-12T17:48:32.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.136+0000 7f0a69ee3700 1 --2- 172.21.15.38:0/3021903093 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0a4404d4b0 0x7f0a4404f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:32.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.136+0000 7f0a69ee3700 1 --2- 172.21.15.38:0/3021903093 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0a4404d4b0 0x7f0a4404f970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0a54001160 tx=0x7f0a54001560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.137+0000 7f0a69ee3700 1 --2- 172.21.15.38:0/3021903093 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0a4404d4b0 0x7f0a4404f970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0a54001160 tx=0x7f0a54001560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.137+0000 7f0a69ee3700 1 --2- 172.21.15.38:0/3021903093 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0a4404d4b0 0x7f0a4404f970 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f0a54001160 tx=0x7f0a54001560).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:32.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.139+0000 7f0a6a6e4700 1 --2- 172.21.15.38:0/3021903093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a64146680 0x7f0a640b0130 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f0a64061380 tx=0x7f0a5c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.139+0000 7f0a52ffd700 1 -- 172.21.15.38:0/3021903093 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f0a640626b0 con 0x7f0a64146680 2020-06-12T17:48:32.294 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.291+0000 7f0a6c147700 1 -- 172.21.15.38:0/3021903093 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0a64062650 con 0x7f0a64146680 2020-06-12T17:48:32.295 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.291+0000 7f0a6a6e4700 1 --2- 172.21.15.38:0/3021903093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a64146680 0x7f0a640b0130 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f0a64061380 tx=0x7f0a5c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.295 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.291+0000 7f0a52ffd700 1 -- 172.21.15.38:0/3021903093 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0a5c03cf80 con 0x7f0a64146680 2020-06-12T17:48:32.295 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:32.296 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.292+0000 7f0a6c147700 1 -- 172.21.15.38:0/3021903093 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0a4404d4b0 msgr2=0x7f0a4404f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:32.297 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.292+0000 7f0a6c147700 1 --2- 172.21.15.38:0/3021903093 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0a4404d4b0 0x7f0a4404f970 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f0a54001160 tx=0x7f0a54001560).stop 2020-06-12T17:48:32.297 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.292+0000 7f0a6c147700 1 -- 172.21.15.38:0/3021903093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a64146680 msgr2=0x7f0a640b0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:32.297 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.292+0000 7f0a6c147700 1 --2- 172.21.15.38:0/3021903093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a64146680 0x7f0a640b0130 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7f0a64061380 tx=0x7f0a5c007e60).stop 2020-06-12T17:48:32.297 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.292+0000 7f0a6c147700 1 -- 172.21.15.38:0/3021903093 shutdown_connections 2020-06-12T17:48:32.297 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.292+0000 7f0a6c147700 1 --2- 172.21.15.38:0/3021903093 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0a4404d4b0 0x7f0a4404f970 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:32.298 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.292+0000 7f0a6c147700 1 --2- 172.21.15.38:0/3021903093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a64146680 0x7f0a640b0130 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:32.298 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.292+0000 7f0a6c147700 1 -- 172.21.15.38:0/3021903093 >> 172.21.15.38:0/3021903093 conn(0x7f0a640b5a20 msgr2=0x7f0a640b6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:32.298 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.292+0000 7f0a6c147700 1 -- 172.21.15.38:0/3021903093 shutdown_connections 2020-06-12T17:48:32.298 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.292+0000 7f0a6c147700 1 -- 172.21.15.38:0/3021903093 wait complete. 2020-06-12T17:48:32.306 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-06-12T17:48:32.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.419+0000 7f774359e700 1 Processor -- start 2020-06-12T17:48:32.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.419+0000 7f774359e700 1 -- start start 2020-06-12T17:48:32.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.420+0000 7f774359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77440b64c0 0x7f774405ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:32.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.420+0000 7f774359e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77440b6af0 con 0x7f77440b43b0 2020-06-12T17:48:32.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.420+0000 7f774359e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7744145f70 con 0x7f7744060a40 2020-06-12T17:48:32.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.420+0000 7f774359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77440b6910 con 0x7f77440b64c0 2020-06-12T17:48:32.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.420+0000 7f7741d9b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f77440b43b0 0x7f77441466b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38004/0 (socket says 172.21.15.38:38004) 2020-06-12T17:48:32.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.420+0000 7f7741d9b700 1 -- 172.21.15.38:0/2532392993 learned_addr learned my addr 172.21.15.38:0/2532392993 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:32.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.421+0000 7f7742d9d700 1 --2- 172.21.15.38:0/2532392993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77440b64c0 0x7f774405ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:32.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.421+0000 7f774159a700 1 -- 172.21.15.38:0/2532392993 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779013647 0 0) 0x7f77440b6af0 con 0x7f77440b43b0 2020-06-12T17:48:32.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.421+0000 7f774159a700 1 -- 172.21.15.38:0/2532392993 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7724003230 con 0x7f77440b43b0 2020-06-12T17:48:32.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.421+0000 7f774159a700 1 -- 172.21.15.38:0/2532392993 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114023808 0 0) 0x7f7744145f70 con 0x7f7744060a40 2020-06-12T17:48:32.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.421+0000 7f774159a700 1 -- 172.21.15.38:0/2532392993 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77440b6af0 con 0x7f7744060a40 2020-06-12T17:48:32.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.421+0000 7f774159a700 1 -- 172.21.15.38:0/2532392993 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3327220468 0 0) 0x7f7724003230 con 0x7f77440b43b0 2020-06-12T17:48:32.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.421+0000 7f7742d9d700 1 -- 172.21.15.38:0/2532392993 >> v1:172.21.15.150:6789/0 conn(0x7f7744060a40 legacy=0x7f77440b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:32.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.421+0000 7f7742d9d700 1 -- 172.21.15.38:0/2532392993 >> v1:172.21.15.38:6789/0 conn(0x7f77440b43b0 legacy=0x7f77441466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:32.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.421+0000 7f7742d9d700 1 -- 172.21.15.38:0/2532392993 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7744146210 con 0x7f77440b64c0 2020-06-12T17:48:32.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.421+0000 7f7742d9d700 1 --2- 172.21.15.38:0/2532392993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77440b64c0 0x7f774405ab90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7734001870 tx=0x7f773c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.421+0000 7f7742d9d700 1 --2- 172.21.15.38:0/2532392993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77440b64c0 0x7f774405ab90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7734001870 tx=0x7f773c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.421+0000 7f7742d9d700 1 --2- 172.21.15.38:0/2532392993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77440b64c0 0x7f774405ab90 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f7734001870 tx=0x7f773c0081e0).ready entity=mon.2 client_cookie=8fd9099aa4a93541 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:32.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.421+0000 7f7742d9d700 1 --2- 172.21.15.38:0/2532392993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77440b64c0 0x7f774405ab90 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f7734001870 tx=0x7f773c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.421+0000 7f774159a700 1 -- 172.21.15.38:0/2532392993 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77340016d0 con 0x7f77440b64c0 2020-06-12T17:48:32.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.421+0000 7f7742d9d700 1 --2- 172.21.15.38:0/2532392993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77440b64c0 0x7f774405ab90 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f7734001870 tx=0x7f773c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.421+0000 7f7742d9d700 1 --2- 172.21.15.38:0/2532392993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77440b64c0 0x7f774405ab90 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f7734001870 tx=0x7f773c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.421+0000 7f774159a700 1 -- 172.21.15.38:0/2532392993 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773c010a10 con 0x7f77440b64c0 2020-06-12T17:48:32.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.421+0000 7f774159a700 1 -- 172.21.15.38:0/2532392993 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f773c010d70 con 0x7f77440b64c0 2020-06-12T17:48:32.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.421+0000 7f774359e700 1 -- 172.21.15.38:0/2532392993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77440b64c0 msgr2=0x7f774405ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:32.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.421+0000 7f774359e700 1 --2- 172.21.15.38:0/2532392993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77440b64c0 0x7f774405ab90 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f7734001870 tx=0x7f773c0081e0).stop 2020-06-12T17:48:32.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.422+0000 7f774359e700 1 -- 172.21.15.38:0/2532392993 shutdown_connections 2020-06-12T17:48:32.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.422+0000 7f774359e700 1 --2- 172.21.15.38:0/2532392993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77440b64c0 0x7f774405ab90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:32.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.422+0000 7f774359e700 1 -- 172.21.15.38:0/2532392993 >> 172.21.15.38:0/2532392993 conn(0x7f77440ba410 msgr2=0x7f77440ba820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:32.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.422+0000 7f774359e700 1 -- 172.21.15.38:0/2532392993 shutdown_connections 2020-06-12T17:48:32.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.422+0000 7f774359e700 1 -- 172.21.15.38:0/2532392993 wait complete. 2020-06-12T17:48:32.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.423+0000 7f774359e700 1 Processor -- start 2020-06-12T17:48:32.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.423+0000 7f774359e700 1 -- start start 2020-06-12T17:48:32.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.424+0000 7f774359e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7744060a40 0x7f7744066020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:32.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.424+0000 7f774359e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f77440b64c0 0x7f774413dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:32.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.424+0000 7f774359e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7744141ed0 con 0x7f77440b43b0 2020-06-12T17:48:32.437 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.424+0000 7f774359e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7744141cf0 con 0x7f7744060a40 2020-06-12T17:48:32.437 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.424+0000 7f774359e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77440b38b0 con 0x7f77440b64c0 2020-06-12T17:48:32.437 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.424+0000 7f774259c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7744060a40 0x7f7744066020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:32.437 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.424+0000 7f774259c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7744060a40 0x7f7744066020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36192/0 (socket says 172.21.15.38:36192) 2020-06-12T17:48:32.437 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.424+0000 7f774259c700 1 -- 172.21.15.38:0/3960295505 learned_addr learned my addr 172.21.15.38:0/3960295505 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:32.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.424+0000 7f7742d9d700 1 --2- 172.21.15.38:0/3960295505 >> v2:172.21.15.150:3300/0 conn(0x7f77440b64c0 0x7f774413dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:32.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.424+0000 7f774259c700 1 -- 172.21.15.38:0/3960295505 >> v2:172.21.15.150:3300/0 conn(0x7f77440b64c0 msgr2=0x7f774413dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:32.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.424+0000 7f774259c700 1 --2- 172.21.15.38:0/3960295505 >> v2:172.21.15.150:3300/0 conn(0x7f77440b64c0 0x7f774413dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:32.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.424+0000 7f774259c700 1 -- 172.21.15.38:0/3960295505 >> v1:172.21.15.150:6789/0 conn(0x7f77440b43b0 legacy=0x7f77440652a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:32.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.424+0000 7f774259c700 1 -- 172.21.15.38:0/3960295505 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7744142170 con 0x7f7744060a40 2020-06-12T17:48:32.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.424+0000 7f774259c700 1 --2- 172.21.15.38:0/3960295505 >> v2:172.21.15.38:3300/0 conn(0x7f7744060a40 0x7f7744066020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f772c001190 tx=0x7f772c0028b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.424+0000 7f774259c700 1 --2- 172.21.15.38:0/3960295505 >> v2:172.21.15.38:3300/0 conn(0x7f7744060a40 0x7f7744066020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f772c001190 tx=0x7f772c0028b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.424+0000 7f774259c700 1 --2- 172.21.15.38:0/3960295505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7744060a40 0x7f7744066020 secure :-1 s=READY pgs=211 cs=0 l=1 rx=0x7f772c001190 tx=0x7f772c0028b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:32.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.424+0000 7f774259c700 1 --2- 172.21.15.38:0/3960295505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7744060a40 0x7f7744066020 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f772c001190 tx=0x7f772c0028b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.424+0000 7f773b7fe700 1 -- 172.21.15.38:0/3960295505 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f772c00cc00 con 0x7f7744060a40 2020-06-12T17:48:32.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.424+0000 7f774259c700 1 --2- 172.21.15.38:0/3960295505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7744060a40 0x7f7744066020 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f772c001190 tx=0x7f772c0028b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.424+0000 7f773b7fe700 1 -- 172.21.15.38:0/3960295505 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772c00cda0 con 0x7f7744060a40 2020-06-12T17:48:32.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.424+0000 7f774259c700 1 --2- 172.21.15.38:0/3960295505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7744060a40 0x7f7744066020 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f772c001190 tx=0x7f772c0028b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.424+0000 7f774359e700 1 -- 172.21.15.38:0/3960295505 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7744066540 con 0x7f7744060a40 2020-06-12T17:48:32.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.424+0000 7f773b7fe700 1 -- 172.21.15.38:0/3960295505 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f772c00e350 con 0x7f7744060a40 2020-06-12T17:48:32.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.424+0000 7f774359e700 1 -- 172.21.15.38:0/3960295505 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77441539e0 con 0x7f7744060a40 2020-06-12T17:48:32.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.425+0000 7f774259c700 1 --2- 172.21.15.38:0/3960295505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7744060a40 0x7f7744066020 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f772c001190 tx=0x7f772c0028b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.425+0000 7f773b7fe700 1 -- 172.21.15.38:0/3960295505 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f772c00e610 con 0x7f7744060a40 2020-06-12T17:48:32.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.425+0000 7f774359e700 1 -- 172.21.15.38:0/3960295505 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7744056c30 con 0x7f7744060a40 2020-06-12T17:48:32.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.425+0000 7f774259c700 1 --2- 172.21.15.38:0/3960295505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7744060a40 0x7f7744066020 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f772c001190 tx=0x7f772c0028b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.426+0000 7f773b7fe700 1 --2- 172.21.15.38:0/3960295505 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f772804d560 0x7f772804fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.426+0000 7f773b7fe700 1 -- 172.21.15.38:0/3960295505 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f772c060cf0 con 0x7f7744060a40 2020-06-12T17:48:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.426+0000 7f7741d9b700 1 --2- 172.21.15.38:0/3960295505 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f772804d560 0x7f772804fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.426+0000 7f7741d9b700 1 --2- 172.21.15.38:0/3960295505 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f772804d560 0x7f772804fa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7744064ee0 tx=0x7f7734001150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.426+0000 7f7741d9b700 1 --2- 172.21.15.38:0/3960295505 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f772804d560 0x7f772804fa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7744064ee0 tx=0x7f7734001150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.426+0000 7f7741d9b700 1 --2- 172.21.15.38:0/3960295505 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f772804d560 0x7f772804fa20 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f7744064ee0 tx=0x7f7734001150).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:32.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.429+0000 7f774259c700 1 --2- 172.21.15.38:0/3960295505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7744060a40 0x7f7744066020 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f772c001190 tx=0x7f772c0028b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.429+0000 7f773b7fe700 1 -- 172.21.15.38:0/3960295505 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f772c03c370 con 0x7f7744060a40 2020-06-12T17:48:32.588 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.584+0000 7f774359e700 1 -- 172.21.15.38:0/3960295505 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f77440b55a0 con 0x7f7744060a40 2020-06-12T17:48:32.588 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.585+0000 7f774259c700 1 --2- 172.21.15.38:0/3960295505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7744060a40 0x7f7744066020 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f772c001190 tx=0x7f772c0028b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.588 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.585+0000 7f773b7fe700 1 -- 172.21.15.38:0/3960295505 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f772c03f990 con 0x7f7744060a40 2020-06-12T17:48:32.589 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:32.591 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.586+0000 7f774359e700 1 -- 172.21.15.38:0/3960295505 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f772804d560 msgr2=0x7f772804fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:32.591 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.586+0000 7f774359e700 1 --2- 172.21.15.38:0/3960295505 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f772804d560 0x7f772804fa20 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f7744064ee0 tx=0x7f7734001150).stop 2020-06-12T17:48:32.591 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.586+0000 7f774359e700 1 -- 172.21.15.38:0/3960295505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7744060a40 msgr2=0x7f7744066020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:32.592 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.586+0000 7f774359e700 1 --2- 172.21.15.38:0/3960295505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7744060a40 0x7f7744066020 secure :-1 s=READY pgs=211 cs=0 l=1 rx=0x7f772c001190 tx=0x7f772c0028b0).stop 2020-06-12T17:48:32.592 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.586+0000 7f774359e700 1 -- 172.21.15.38:0/3960295505 shutdown_connections 2020-06-12T17:48:32.592 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.586+0000 7f774359e700 1 --2- 172.21.15.38:0/3960295505 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f772804d560 0x7f772804fa20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:32.592 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.586+0000 7f774359e700 1 --2- 172.21.15.38:0/3960295505 >> v2:172.21.15.150:3300/0 conn(0x7f77440b64c0 0x7f774413dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:32.592 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.586+0000 7f774359e700 1 --2- 172.21.15.38:0/3960295505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7744060a40 0x7f7744066020 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:32.592 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.586+0000 7f774359e700 1 -- 172.21.15.38:0/3960295505 >> 172.21.15.38:0/3960295505 conn(0x7f77440ba410 msgr2=0x7f774406a440 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:32.593 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.586+0000 7f774359e700 1 -- 172.21.15.38:0/3960295505 shutdown_connections 2020-06-12T17:48:32.593 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.586+0000 7f774359e700 1 -- 172.21.15.38:0/3960295505 wait complete. 2020-06-12T17:48:32.599 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-06-12T17:48:32.716 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.713+0000 7f7e17731700 1 Processor -- start 2020-06-12T17:48:32.717 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.713+0000 7f7e17731700 1 -- start start 2020-06-12T17:48:32.720 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.714+0000 7f7e17731700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7e10146680 0x7f7e100ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:32.720 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.714+0000 7f7e17731700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e100b2eb0 0x7f7e1009d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:32.720 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.714+0000 7f7e17731700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7e1009d620 0x7f7e1009da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:32.720 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.714+0000 7f7e17731700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e10146d20 con 0x7f7e1009d620 2020-06-12T17:48:32.720 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.714+0000 7f7e17731700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e10066a80 con 0x7f7e10146680 2020-06-12T17:48:32.721 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.714+0000 7f7e17731700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e10146f50 con 0x7f7e100b2eb0 2020-06-12T17:48:32.721 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.714+0000 7f7e15cce700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7e1009d620 0x7f7e1009da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:32.721 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.714+0000 7f7e15cce700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7e1009d620 0x7f7e1009da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36200/0 (socket says 172.21.15.38:36200) 2020-06-12T17:48:32.721 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.714+0000 7f7e15cce700 1 -- 172.21.15.38:0/3404226823 learned_addr learned my addr 172.21.15.38:0/3404226823 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:32.722 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.714+0000 7f7e14ccc700 1 --2- 172.21.15.38:0/3404226823 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e100b2eb0 0x7f7e1009d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:32.722 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.714+0000 7f7e154cd700 1 --2- 172.21.15.38:0/3404226823 >> v2:172.21.15.150:3300/0 conn(0x7f7e10146680 0x7f7e100ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:32.722 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.714+0000 7f7e15cce700 1 -- 172.21.15.38:0/3404226823 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e100b2eb0 msgr2=0x7f7e1009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:32.722 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.714+0000 7f7e15cce700 1 --2- 172.21.15.38:0/3404226823 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e100b2eb0 0x7f7e1009d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:32.723 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.714+0000 7f7e15cce700 1 -- 172.21.15.38:0/3404226823 >> v2:172.21.15.150:3300/0 conn(0x7f7e10146680 msgr2=0x7f7e100ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:32.723 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.714+0000 7f7e15cce700 1 --2- 172.21.15.38:0/3404226823 >> v2:172.21.15.150:3300/0 conn(0x7f7e10146680 0x7f7e100ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:32.723 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.714+0000 7f7e15cce700 1 -- 172.21.15.38:0/3404226823 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e10146a60 con 0x7f7e1009d620 2020-06-12T17:48:32.723 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.714+0000 7f7e15cce700 1 --2- 172.21.15.38:0/3404226823 >> v2:172.21.15.38:3300/0 conn(0x7f7e1009d620 0x7f7e1009da90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7e080032b0 tx=0x7f7e080081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.724 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.714+0000 7f7e15cce700 1 --2- 172.21.15.38:0/3404226823 >> v2:172.21.15.38:3300/0 conn(0x7f7e1009d620 0x7f7e1009da90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7e080032b0 tx=0x7f7e080081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.724 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.714+0000 7f7e15cce700 1 --2- 172.21.15.38:0/3404226823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e1009d620 0x7f7e1009da90 secure :-1 s=READY pgs=212 cs=0 l=1 rx=0x7f7e080032b0 tx=0x7f7e080081e0).ready entity=mon.0 client_cookie=fe72020de405992e server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:32.724 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.714+0000 7f7e15cce700 1 --2- 172.21.15.38:0/3404226823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e1009d620 0x7f7e1009da90 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f7e080032b0 tx=0x7f7e080081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.725 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.715+0000 7f7dfffff700 1 -- 172.21.15.38:0/3404226823 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e0800a160 con 0x7f7e1009d620 2020-06-12T17:48:32.725 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.715+0000 7f7e15cce700 1 --2- 172.21.15.38:0/3404226823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e1009d620 0x7f7e1009da90 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f7e080032b0 tx=0x7f7e080081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.726 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.715+0000 7f7e15cce700 1 --2- 172.21.15.38:0/3404226823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e1009d620 0x7f7e1009da90 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f7e080032b0 tx=0x7f7e080081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.726 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.715+0000 7f7dfffff700 1 -- 172.21.15.38:0/3404226823 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0800a2c0 con 0x7f7e1009d620 2020-06-12T17:48:32.726 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.715+0000 7f7dfffff700 1 -- 172.21.15.38:0/3404226823 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e0800a6a0 con 0x7f7e1009d620 2020-06-12T17:48:32.727 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.715+0000 7f7e17731700 1 -- 172.21.15.38:0/3404226823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e1009d620 msgr2=0x7f7e1009da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:32.727 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.715+0000 7f7e17731700 1 --2- 172.21.15.38:0/3404226823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e1009d620 0x7f7e1009da90 secure :-1 s=READY pgs=212 cs=0 l=1 rx=0x7f7e080032b0 tx=0x7f7e080081e0).stop 2020-06-12T17:48:32.727 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.715+0000 7f7e17731700 1 -- 172.21.15.38:0/3404226823 shutdown_connections 2020-06-12T17:48:32.727 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.715+0000 7f7e17731700 1 --2- 172.21.15.38:0/3404226823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e1009d620 0x7f7e1009da90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:32.728 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.715+0000 7f7e17731700 1 --2- 172.21.15.38:0/3404226823 >> v2:172.21.15.150:3300/0 conn(0x7f7e10146680 0x7f7e100ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:32.728 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.715+0000 7f7e17731700 1 --2- 172.21.15.38:0/3404226823 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e100b2eb0 0x7f7e1009d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:32.728 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.715+0000 7f7e17731700 1 -- 172.21.15.38:0/3404226823 >> 172.21.15.38:0/3404226823 conn(0x7f7e100b5a20 msgr2=0x7f7e1005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:32.728 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.715+0000 7f7e17731700 1 -- 172.21.15.38:0/3404226823 shutdown_connections 2020-06-12T17:48:32.728 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.715+0000 7f7e17731700 1 -- 172.21.15.38:0/3404226823 wait complete. 2020-06-12T17:48:32.729 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.716+0000 7f7e17731700 1 Processor -- start 2020-06-12T17:48:32.729 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.716+0000 7f7e17731700 1 -- start start 2020-06-12T17:48:32.733 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.717+0000 7f7e17731700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e1009d620 0x7f7e100b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:32.733 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.717+0000 7f7e17731700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e100b2250 con 0x7f7e100b2eb0 2020-06-12T17:48:32.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.717+0000 7f7e17731700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e100b24f0 con 0x7f7e10146680 2020-06-12T17:48:32.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.717+0000 7f7e17731700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e100b2990 con 0x7f7e1009d620 2020-06-12T17:48:32.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.717+0000 7f7e14ccc700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7e100b2eb0 0x7f7e101399f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38024/0 (socket says 172.21.15.38:38024) 2020-06-12T17:48:32.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.717+0000 7f7e14ccc700 1 -- 172.21.15.38:0/3762343394 learned_addr learned my addr 172.21.15.38:0/3762343394 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:32.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.717+0000 7f7dfe7fc700 1 -- 172.21.15.38:0/3762343394 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 749844171 0 0) 0x7f7e100b2250 con 0x7f7e100b2eb0 2020-06-12T17:48:32.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.717+0000 7f7dfe7fc700 1 -- 172.21.15.38:0/3762343394 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7df0002fe0 con 0x7f7e100b2eb0 2020-06-12T17:48:32.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.717+0000 7f7e154cd700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e1009d620 0x7f7e100b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:32.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.717+0000 7f7dfe7fc700 1 -- 172.21.15.38:0/3762343394 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2265324810 0 0) 0x7f7df0002fe0 con 0x7f7e100b2eb0 2020-06-12T17:48:32.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.717+0000 7f7dfe7fc700 1 -- 172.21.15.38:0/3762343394 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7e100b2250 con 0x7f7e100b2eb0 2020-06-12T17:48:32.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.717+0000 7f7dfe7fc700 1 -- 172.21.15.38:0/3762343394 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f7e0c0025c0 con 0x7f7e100b2eb0 2020-06-12T17:48:32.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.717+0000 7f7dfe7fc700 1 -- 172.21.15.38:0/3762343394 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e1009d620 msgr2=0x7f7e100b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:32.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.717+0000 7f7dfe7fc700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e1009d620 0x7f7e100b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:32.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.717+0000 7f7dfe7fc700 1 -- 172.21.15.38:0/3762343394 >> v1:172.21.15.150:6789/0 conn(0x7f7e10146680 legacy=0x7f7e10148260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:32.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.717+0000 7f7dfe7fc700 1 -- 172.21.15.38:0/3762343394 >> v1:172.21.15.38:6789/0 conn(0x7f7e100b2eb0 legacy=0x7f7e101399f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:32.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.717+0000 7f7dfe7fc700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7df00049b0 0x7f7df0004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:32.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.717+0000 7f7dfe7fc700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e1009d620 0x7f7df0003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:32.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.717+0000 7f7dfe7fc700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7df0003d80 0x7f7df0004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:32.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.717+0000 7f7dfe7fc700 1 -- 172.21.15.38:0/3762343394 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e100b2990 con 0x7f7df00049b0 2020-06-12T17:48:32.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.717+0000 7f7dfe7fc700 1 -- 172.21.15.38:0/3762343394 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df0004750 con 0x7f7df0003d80 2020-06-12T17:48:32.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.717+0000 7f7dfe7fc700 1 -- 172.21.15.38:0/3762343394 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df0005340 con 0x7f7e1009d620 2020-06-12T17:48:32.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.718+0000 7f7e154cd700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7df00049b0 0x7f7df0004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:32.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.718+0000 7f7e14ccc700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e1009d620 0x7f7df0003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:32.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.718+0000 7f7e15cce700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7df0003d80 0x7f7df0004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:32.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.718+0000 7f7e154cd700 1 -- 172.21.15.38:0/3762343394 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e1009d620 msgr2=0x7f7df0003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:32.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.718+0000 7f7e154cd700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e1009d620 0x7f7df0003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:32.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.718+0000 7f7e154cd700 1 -- 172.21.15.38:0/3762343394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7df0003d80 msgr2=0x7f7df0004200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:32.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.718+0000 7f7e154cd700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7df0003d80 0x7f7df0004200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:32.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.718+0000 7f7e154cd700 1 -- 172.21.15.38:0/3762343394 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1013a100 con 0x7f7df00049b0 2020-06-12T17:48:32.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.718+0000 7f7e17731700 1 -- 172.21.15.38:0/3762343394 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e1013a350 con 0x7f7df00049b0 2020-06-12T17:48:32.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.718+0000 7f7e154cd700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7df00049b0 0x7f7df0004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7e00002f30 tx=0x7f7e0000e040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.740 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.718+0000 7f7e154cd700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7df00049b0 0x7f7df0004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7e00002f30 tx=0x7f7e0000e040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.740 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.718+0000 7f7e154cd700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7df00049b0 0x7f7df0004dd0 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7f7e00002f30 tx=0x7f7e0000e040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:32.740 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.718+0000 7f7e154cd700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7df00049b0 0x7f7df0004dd0 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f7e00002f30 tx=0x7f7e0000e040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.740 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.718+0000 7f7e17731700 1 -- 172.21.15.38:0/3762343394 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e100b1e80 con 0x7f7df00049b0 2020-06-12T17:48:32.740 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.718+0000 7f7dfe7fc700 1 -- 172.21.15.38:0/3762343394 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e00007530 con 0x7f7df00049b0 2020-06-12T17:48:32.741 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.718+0000 7f7e154cd700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7df00049b0 0x7f7df0004dd0 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f7e00002f30 tx=0x7f7e0000e040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.741 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.718+0000 7f7e154cd700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7df00049b0 0x7f7df0004dd0 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f7e00002f30 tx=0x7f7e0000e040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.741 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.718+0000 7f7dfe7fc700 1 -- 172.21.15.38:0/3762343394 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e000056c0 con 0x7f7df00049b0 2020-06-12T17:48:32.741 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.718+0000 7f7dfe7fc700 1 -- 172.21.15.38:0/3762343394 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e00005ae0 con 0x7f7df00049b0 2020-06-12T17:48:32.741 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.719+0000 7f7e154cd700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7df00049b0 0x7f7df0004dd0 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f7e00002f30 tx=0x7f7e0000e040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.742 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.719+0000 7f7e17731700 1 -- 172.21.15.38:0/3762343394 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dec003340 con 0x7f7df00049b0 2020-06-12T17:48:32.742 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.719+0000 7f7dfe7fc700 1 -- 172.21.15.38:0/3762343394 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f7e00005c40 con 0x7f7df00049b0 2020-06-12T17:48:32.742 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.719+0000 7f7e154cd700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7df00049b0 0x7f7df0004dd0 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f7e00002f30 tx=0x7f7e0000e040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.742 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.719+0000 7f7dfe7fc700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7df0055730 0x7f7df0057bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:32.742 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.720+0000 7f7dfe7fc700 1 -- 172.21.15.38:0/3762343394 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f7e00061560 con 0x7f7df00049b0 2020-06-12T17:48:32.742 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.720+0000 7f7e14ccc700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7df0055730 0x7f7df0057bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:32.743 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.720+0000 7f7e14ccc700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7df0055730 0x7f7df0057bf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7e0c007a60 tx=0x7f7e0c00ed60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.743 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.720+0000 7f7e14ccc700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7df0055730 0x7f7df0057bf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7e0c007a60 tx=0x7f7e0c00ed60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.743 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.720+0000 7f7e14ccc700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7df0055730 0x7f7df0057bf0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f7e0c007a60 tx=0x7f7e0c00ed60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:32.743 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.723+0000 7f7e154cd700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7df00049b0 0x7f7df0004dd0 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f7e00002f30 tx=0x7f7e0000e040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.743 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.723+0000 7f7dfe7fc700 1 -- 172.21.15.38:0/3762343394 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f7e0003cc60 con 0x7f7df00049b0 2020-06-12T17:48:32.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.873+0000 7f7e17731700 1 -- 172.21.15.38:0/3762343394 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7dec002200 con 0x7f7df00049b0 2020-06-12T17:48:32.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.874+0000 7f7e154cd700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7df00049b0 0x7f7df0004dd0 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f7e00002f30 tx=0x7f7e0000e040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:32.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.874+0000 7f7dfe7fc700 1 -- 172.21.15.38:0/3762343394 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f7e0000a0e0 con 0x7f7df00049b0 2020-06-12T17:48:32.878 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:32.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.875+0000 7f7e17731700 1 -- 172.21.15.38:0/3762343394 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7df0055730 msgr2=0x7f7df0057bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:32.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.875+0000 7f7e17731700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7df0055730 0x7f7df0057bf0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f7e0c007a60 tx=0x7f7e0c00ed60).stop 2020-06-12T17:48:32.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.875+0000 7f7e17731700 1 -- 172.21.15.38:0/3762343394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7df00049b0 msgr2=0x7f7df0004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:32.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.875+0000 7f7e17731700 1 --2- 172.21.15.38:0/3762343394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7df00049b0 0x7f7df0004dd0 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7f7e00002f30 tx=0x7f7e0000e040).stop 2020-06-12T17:48:32.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.875+0000 7f7e15cce700 1 -- 172.21.15.38:0/3762343394 reap_dead start 2020-06-12T17:48:32.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.875+0000 7f7e15cce700 1 -- 172.21.15.38:0/3762343394 reap_dead start 2020-06-12T17:48:32.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.875+0000 7f7e17731700 1 -- 172.21.15.38:0/3762343394 shutdown_connections 2020-06-12T17:48:32.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.875+0000 7f7e17731700 1 -- 172.21.15.38:0/3762343394 >> 172.21.15.38:0/3762343394 conn(0x7f7e100b5a20 msgr2=0x7f7e1009b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:32.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.875+0000 7f7e17731700 1 -- 172.21.15.38:0/3762343394 shutdown_connections 2020-06-12T17:48:32.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:32.875+0000 7f7e17731700 1 -- 172.21.15.38:0/3762343394 wait complete. 2020-06-12T17:48:32.888 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-06-12T17:48:32.889 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-06-12T17:48:33.003 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.000+0000 7f8387e2d700 1 Processor -- start 2020-06-12T17:48:33.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.000+0000 7f8387e2d700 1 -- start start 2020-06-12T17:48:33.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.001+0000 7f8387e2d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8380143470 0x7f8380143850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:33.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.001+0000 7f8387e2d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8380146ae0 0x7f838009fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:33.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.001+0000 7f8387e2d700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83800a0f90 con 0x7f83800a1970 2020-06-12T17:48:33.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.001+0000 7f8387e2d700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83800a1230 con 0x7f8380143470 2020-06-12T17:48:33.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.001+0000 7f8387e2d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83800a14d0 con 0x7f8380146ae0 2020-06-12T17:48:33.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.001+0000 7f8385bc9700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8380143470 0x7f8380143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:33.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.001+0000 7f83853c8700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f83800a1970 0x7f83800bcf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38038/0 (socket says 172.21.15.38:38038) 2020-06-12T17:48:33.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.001+0000 7f83853c8700 1 -- 172.21.15.38:0/3294787062 learned_addr learned my addr 172.21.15.38:0/3294787062 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:33.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.001+0000 7f83863ca700 1 --2- 172.21.15.38:0/3294787062 >> v2:172.21.15.150:3300/0 conn(0x7f8380146ae0 0x7f838009fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:33.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.001+0000 7f8385bc9700 1 -- 172.21.15.38:0/3294787062 >> v2:172.21.15.150:3300/0 conn(0x7f8380146ae0 msgr2=0x7f838009fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:33.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.001+0000 7f8385bc9700 1 --2- 172.21.15.38:0/3294787062 >> v2:172.21.15.150:3300/0 conn(0x7f8380146ae0 0x7f838009fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:33.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.001+0000 7f8385bc9700 1 -- 172.21.15.38:0/3294787062 >> v1:172.21.15.38:6789/0 conn(0x7f83800a1970 legacy=0x7f83800bcf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:33.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.001+0000 7f8385bc9700 1 -- 172.21.15.38:0/3294787062 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83800a0cd0 con 0x7f8380143470 2020-06-12T17:48:33.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.001+0000 7f8384bc7700 1 -- 172.21.15.38:0/3294787062 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782766903 0 0) 0x7f83800a0f90 con 0x7f83800a1970 2020-06-12T17:48:33.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.001+0000 7f8385bc9700 1 --2- 172.21.15.38:0/3294787062 >> v2:172.21.15.38:3300/0 conn(0x7f8380143470 0x7f8380143850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f838005b170 tx=0x7f8370007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:33.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.001+0000 7f8385bc9700 1 --2- 172.21.15.38:0/3294787062 >> v2:172.21.15.38:3300/0 conn(0x7f8380143470 0x7f8380143850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f838005b170 tx=0x7f8370007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:33.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.001+0000 7f8385bc9700 1 --2- 172.21.15.38:0/3294787062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8380143470 0x7f8380143850 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7f838005b170 tx=0x7f8370007e60).ready entity=mon.0 client_cookie=9d79322309b2d430 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:33.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.001+0000 7f8385bc9700 1 --2- 172.21.15.38:0/3294787062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8380143470 0x7f8380143850 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f838005b170 tx=0x7f8370007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:33.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.002+0000 7f8384bc7700 1 -- 172.21.15.38:0/3294787062 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83700113f0 con 0x7f8380143470 2020-06-12T17:48:33.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.002+0000 7f8385bc9700 1 --2- 172.21.15.38:0/3294787062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8380143470 0x7f8380143850 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f838005b170 tx=0x7f8370007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:33.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.002+0000 7f8385bc9700 1 --2- 172.21.15.38:0/3294787062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8380143470 0x7f8380143850 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f838005b170 tx=0x7f8370007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:33.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.002+0000 7f8384bc7700 1 -- 172.21.15.38:0/3294787062 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8370011550 con 0x7f8380143470 2020-06-12T17:48:33.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.002+0000 7f8384bc7700 1 -- 172.21.15.38:0/3294787062 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8370011930 con 0x7f8380143470 2020-06-12T17:48:33.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.002+0000 7f8387e2d700 1 -- 172.21.15.38:0/3294787062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8380143470 msgr2=0x7f8380143850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:33.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.002+0000 7f8387e2d700 1 --2- 172.21.15.38:0/3294787062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8380143470 0x7f8380143850 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7f838005b170 tx=0x7f8370007e60).stop 2020-06-12T17:48:33.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.002+0000 7f8387e2d700 1 -- 172.21.15.38:0/3294787062 shutdown_connections 2020-06-12T17:48:33.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.002+0000 7f8387e2d700 1 --2- 172.21.15.38:0/3294787062 >> v2:172.21.15.150:3300/0 conn(0x7f8380146ae0 0x7f838009fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:33.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.002+0000 7f8387e2d700 1 --2- 172.21.15.38:0/3294787062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8380143470 0x7f8380143850 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:33.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.002+0000 7f8387e2d700 1 -- 172.21.15.38:0/3294787062 >> 172.21.15.38:0/3294787062 conn(0x7f8380066040 msgr2=0x7f83800bc840 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:33.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.002+0000 7f8387e2d700 1 -- 172.21.15.38:0/3294787062 shutdown_connections 2020-06-12T17:48:33.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.002+0000 7f8387e2d700 1 -- 172.21.15.38:0/3294787062 wait complete. 2020-06-12T17:48:33.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.003+0000 7f8387e2d700 1 Processor -- start 2020-06-12T17:48:33.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.003+0000 7f8387e2d700 1 -- start start 2020-06-12T17:48:33.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f8387e2d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83800a1970 0x7f83800b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:33.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f8387e2d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8380143470 0x7f83800b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f8387e2d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8380146ae0 0x7f83800b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f8387e2d700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f838009ede0 con 0x7f8380143470 2020-06-12T17:48:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f8387e2d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f838009f080 con 0x7f8380146ae0 2020-06-12T17:48:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f8387e2d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838009f320 con 0x7f83800a1970 2020-06-12T17:48:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f83853c8700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8380143470 0x7f83800b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f83853c8700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8380143470 0x7f83800b33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36228/0 (socket says 172.21.15.38:36228) 2020-06-12T17:48:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f83853c8700 1 -- 172.21.15.38:0/2651881128 learned_addr learned my addr 172.21.15.38:0/2651881128 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f8385bc9700 1 --2- 172.21.15.38:0/2651881128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83800a1970 0x7f83800b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f83863ca700 1 --2- 172.21.15.38:0/2651881128 >> v2:172.21.15.150:3300/0 conn(0x7f8380146ae0 0x7f83800b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f83853c8700 1 -- 172.21.15.38:0/2651881128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83800a1970 msgr2=0x7f83800b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:33.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f83853c8700 1 --2- 172.21.15.38:0/2651881128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83800a1970 0x7f83800b5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:33.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f83853c8700 1 -- 172.21.15.38:0/2651881128 >> v2:172.21.15.150:3300/0 conn(0x7f8380146ae0 msgr2=0x7f83800b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:33.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f83853c8700 1 --2- 172.21.15.38:0/2651881128 >> v2:172.21.15.150:3300/0 conn(0x7f8380146ae0 0x7f83800b1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:33.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f83853c8700 1 -- 172.21.15.38:0/2651881128 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83800b3830 con 0x7f8380143470 2020-06-12T17:48:33.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f83853c8700 1 --2- 172.21.15.38:0/2651881128 >> v2:172.21.15.38:3300/0 conn(0x7f8380143470 0x7f83800b33d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f837c000b80 tx=0x7f837c0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:33.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f83853c8700 1 --2- 172.21.15.38:0/2651881128 >> v2:172.21.15.38:3300/0 conn(0x7f8380143470 0x7f83800b33d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f837c000b80 tx=0x7f837c0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:33.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f83853c8700 1 --2- 172.21.15.38:0/2651881128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8380143470 0x7f83800b33d0 secure :-1 s=READY pgs=217 cs=0 l=1 rx=0x7f837c000b80 tx=0x7f837c0017a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:33.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f83853c8700 1 --2- 172.21.15.38:0/2651881128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8380143470 0x7f83800b33d0 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f837c000b80 tx=0x7f837c0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:33.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f83853c8700 1 --2- 172.21.15.38:0/2651881128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8380143470 0x7f83800b33d0 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f837c000b80 tx=0x7f837c0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:33.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f836effd700 1 -- 172.21.15.38:0/2651881128 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f837c00ca40 con 0x7f8380143470 2020-06-12T17:48:33.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f83853c8700 1 --2- 172.21.15.38:0/2651881128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8380143470 0x7f83800b33d0 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f837c000b80 tx=0x7f837c0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:33.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f836effd700 1 -- 172.21.15.38:0/2651881128 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c00cba0 con 0x7f8380143470 2020-06-12T17:48:33.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f8387e2d700 1 -- 172.21.15.38:0/2651881128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83800b2140 con 0x7f8380143470 2020-06-12T17:48:33.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f836effd700 1 -- 172.21.15.38:0/2651881128 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f837c00d0c0 con 0x7f8380143470 2020-06-12T17:48:33.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.004+0000 7f8387e2d700 1 -- 172.21.15.38:0/2651881128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8380142310 con 0x7f8380143470 2020-06-12T17:48:33.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.005+0000 7f83853c8700 1 --2- 172.21.15.38:0/2651881128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8380143470 0x7f83800b33d0 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f837c000b80 tx=0x7f837c0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:33.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.005+0000 7f836effd700 1 -- 172.21.15.38:0/2651881128 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f837c0055c0 con 0x7f8380143470 2020-06-12T17:48:33.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.005+0000 7f83853c8700 1 --2- 172.21.15.38:0/2651881128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8380143470 0x7f83800b33d0 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f837c000b80 tx=0x7f837c0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:33.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.006+0000 7f8387e2d700 1 -- 172.21.15.38:0/2651881128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8380056c30 con 0x7f8380143470 2020-06-12T17:48:33.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.006+0000 7f836effd700 1 --2- 172.21.15.38:0/2651881128 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f836004d600 0x7f836004fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:33.028 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.006+0000 7f836effd700 1 -- 172.21.15.38:0/2651881128 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f837c060a00 con 0x7f8380143470 2020-06-12T17:48:33.028 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.006+0000 7f8385bc9700 1 --2- 172.21.15.38:0/2651881128 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f836004d600 0x7f836004fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:33.028 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.006+0000 7f8385bc9700 1 --2- 172.21.15.38:0/2651881128 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f836004d600 0x7f836004fac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f838005b170 tx=0x7f8370007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:33.028 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.006+0000 7f8385bc9700 1 --2- 172.21.15.38:0/2651881128 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f836004d600 0x7f836004fac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f838005b170 tx=0x7f8370007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:33.029 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.006+0000 7f8385bc9700 1 --2- 172.21.15.38:0/2651881128 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f836004d600 0x7f836004fac0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f838005b170 tx=0x7f8370007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:33.029 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.009+0000 7f83853c8700 1 --2- 172.21.15.38:0/2651881128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8380143470 0x7f83800b33d0 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f837c000b80 tx=0x7f837c0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:33.029 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.009+0000 7f836effd700 1 -- 172.21.15.38:0/2651881128 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f837c03c160 con 0x7f8380143470 2020-06-12T17:48:33.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.209+0000 7f8387e2d700 1 -- 172.21.15.38:0/2651881128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f838005a5e0 con 0x7f8380143470 2020-06-12T17:48:33.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.210+0000 7f83853c8700 1 --2- 172.21.15.38:0/2651881128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8380143470 0x7f83800b33d0 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f837c000b80 tx=0x7f837c0017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:33.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.210+0000 7f836effd700 1 -- 172.21.15.38:0/2651881128 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2137 (secure 0 0 0) 0x7f837c0100b0 con 0x7f8380143470 2020-06-12T17:48:33.214 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:33.214 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1134306892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1134306892},{"type":"v1","addr":"172.21.15.150:6835","nonce":1134306892}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-06-12T17:48:14.851844+0000","modified":"2020-06-12T17:48:18.530885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4389":{"gid":4389,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.38:6833/4064318189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":4064318189},{"type":"v1","addr":"172.21.15.38:6833","nonce":4064318189}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-06-12T17:48:33.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.211+0000 7f8387e2d700 1 -- 172.21.15.38:0/2651881128 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f836004d600 msgr2=0x7f836004fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:33.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.211+0000 7f8387e2d700 1 --2- 172.21.15.38:0/2651881128 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f836004d600 0x7f836004fac0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f838005b170 tx=0x7f8370007e60).stop 2020-06-12T17:48:33.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.211+0000 7f8387e2d700 1 -- 172.21.15.38:0/2651881128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8380143470 msgr2=0x7f83800b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:33.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.211+0000 7f8387e2d700 1 --2- 172.21.15.38:0/2651881128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8380143470 0x7f83800b33d0 secure :-1 s=READY pgs=217 cs=0 l=1 rx=0x7f837c000b80 tx=0x7f837c0017a0).stop 2020-06-12T17:48:33.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.211+0000 7f8387e2d700 1 -- 172.21.15.38:0/2651881128 shutdown_connections 2020-06-12T17:48:33.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.211+0000 7f8387e2d700 1 --2- 172.21.15.38:0/2651881128 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f836004d600 0x7f836004fac0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:33.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.211+0000 7f8387e2d700 1 --2- 172.21.15.38:0/2651881128 >> v2:172.21.15.150:3300/0 conn(0x7f8380146ae0 0x7f83800b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:33.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.211+0000 7f8387e2d700 1 --2- 172.21.15.38:0/2651881128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83800a1970 0x7f83800b5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:33.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.211+0000 7f8387e2d700 1 --2- 172.21.15.38:0/2651881128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8380143470 0x7f83800b33d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:33.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.211+0000 7f8387e2d700 1 -- 172.21.15.38:0/2651881128 >> 172.21.15.38:0/2651881128 conn(0x7f8380066040 msgr2=0x7f838005b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:33.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.211+0000 7f8387e2d700 1 -- 172.21.15.38:0/2651881128 shutdown_connections 2020-06-12T17:48:33.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:33.211+0000 7f8387e2d700 1 -- 172.21.15.38:0/2651881128 wait complete. 2020-06-12T17:48:33.218 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 6 2020-06-12T17:48:33.427 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-06-12T17:48:14.851844+0000', 'modified': '2020-06-12T17:48:18.530885+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4389}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4389': {'gid': 4389, 'name': 'a', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.38:6833/4064318189', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6832', 'nonce': 4064318189}, {'type': 'v1', 'addr': '172.21.15.38:6833', 'nonce': 4064318189}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292836696063, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-06-12T17:48:33.428 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-06-12T17:48:33.428 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-06-12T17:48:33.557 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2020-06-12T17:48:33.557 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "8e42a2e7-b187-42c4-a73f-8f812ee62352", 2020-06-12T17:48:33.557 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2020-06-12T17:48:33.557 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 4389, 2020-06-12T17:48:33.558 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2020-06-12T17:48:33.558 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2020-06-12T17:48:33.558 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 16.023571482000001, 2020-06-12T17:48:33.558 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 6, 2020-06-12T17:48:33.558 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 24, 2020-06-12T17:48:33.559 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 24, 2020-06-12T17:48:33.559 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 16.299543055000001 2020-06-12T17:48:33.559 INFO:teuthology.orchestra.run.smithi038.stdout:} 2020-06-12T17:48:33.565 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "8e42a2e7-b187-42c4-a73f-8f812ee62352", "whoami": 0, "id": 4389, "want_state": "up:active", "state": "up:active", "rank_uptime": 16.023571482000001, "mdsmap_epoch": 6, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "uptime": 16.299543055000001 } 2020-06-12T17:48:33.566 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-06-12T17:48:33.566 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-06-12T17:48:33.566 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-06-12T17:48:33.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:33.567 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.1) 2020-06-12T17:48:33.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:33.583 INFO:teuthology.orchestra.run.smithi038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-06-12T17:48:33.652 INFO:teuthology.orchestra.run.smithi038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-06-12T17:48:33.653 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-06-12T17:48:33.654 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:33.654 INFO:teuthology.orchestra.run.smithi038:> ls /sys/fs/fuse/connections 2020-06-12T17:48:33.708 INFO:teuthology.orchestra.run.smithi038.stdout:46 2020-06-12T17:48:33.708 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [46] 2020-06-12T17:48:33.709 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-06-12T17:48:33.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:33.751 INFO:teuthology.orchestra.run.smithi038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-06-12T17:48:33.781 INFO:teuthology.orchestra.run.smithi038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-06-12T17:48:33.782 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-06-12T17:48:33.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:33.783 INFO:teuthology.orchestra.run.smithi038:> ls /sys/fs/fuse/connections 2020-06-12T17:48:33.831 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi038.stderr:2020-06-12T17:48:33.828+0000 7f4eee9441c0 -1 init, newargv = 0x560b5df64010 newargc=9 2020-06-12T17:48:33.832 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi038.stderr:ceph-fuse[34786]: starting ceph client 2020-06-12T17:48:33.837 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi038.stderr:ceph-fuse[34786]: starting fuse 2020-06-12T17:48:33.839 INFO:teuthology.orchestra.run.smithi038.stdout:46 2020-06-12T17:48:33.839 INFO:teuthology.orchestra.run.smithi038.stdout:48 2020-06-12T17:48:33.840 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46, 48] 2020-06-12T17:48:33.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:33.841 INFO:teuthology.orchestra.run.smithi038:> sudo python3 -c ' 2020-06-12T17:48:33.841 INFO:teuthology.orchestra.run.smithi038:> import glob 2020-06-12T17:48:33.841 INFO:teuthology.orchestra.run.smithi038:> import re 2020-06-12T17:48:33.842 INFO:teuthology.orchestra.run.smithi038:> import os 2020-06-12T17:48:33.842 INFO:teuthology.orchestra.run.smithi038:> import subprocess 2020-06-12T17:48:33.842 INFO:teuthology.orchestra.run.smithi038:> 2020-06-12T17:48:33.849 INFO:teuthology.orchestra.run.smithi038:> def find_socket(client_name): 2020-06-12T17:48:33.850 INFO:teuthology.orchestra.run.smithi038:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-06-12T17:48:33.850 INFO:teuthology.orchestra.run.smithi038:> files = glob.glob(asok_path) 2020-06-12T17:48:33.850 INFO:teuthology.orchestra.run.smithi038:> 2020-06-12T17:48:33.851 INFO:teuthology.orchestra.run.smithi038:> # Given a non-glob path, it better be there 2020-06-12T17:48:33.851 INFO:teuthology.orchestra.run.smithi038:> if "*" not in asok_path: 2020-06-12T17:48:33.851 INFO:teuthology.orchestra.run.smithi038:> assert(len(files) == 1) 2020-06-12T17:48:33.852 INFO:teuthology.orchestra.run.smithi038:> return files[0] 2020-06-12T17:48:33.852 INFO:teuthology.orchestra.run.smithi038:> 2020-06-12T17:48:33.852 INFO:teuthology.orchestra.run.smithi038:> for f in files: 2020-06-12T17:48:33.853 INFO:teuthology.orchestra.run.smithi038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-06-12T17:48:33.854 INFO:teuthology.orchestra.run.smithi038:> if os.path.exists("/proc/{0}".format(pid)): 2020-06-12T17:48:33.854 INFO:teuthology.orchestra.run.smithi038:> return f 2020-06-12T17:48:33.855 INFO:teuthology.orchestra.run.smithi038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-06-12T17:48:33.855 INFO:teuthology.orchestra.run.smithi038:> 2020-06-12T17:48:33.855 INFO:teuthology.orchestra.run.smithi038:> print(find_socket("client.1")) 2020-06-12T17:48:33.856 INFO:teuthology.orchestra.run.smithi038:> ' 2020-06-12T17:48:33.935 INFO:teuthology.orchestra.run.smithi038.stdout:/var/run/ceph/ceph-client.1.34786.asok 2020-06-12T17:48:33.939 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.34786.asok 2020-06-12T17:48:33.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:33.940 INFO:teuthology.orchestra.run.smithi038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.34786.asok status 2020-06-12T17:48:34.054 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2020-06-12T17:48:34.055 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": { 2020-06-12T17:48:34.055 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_sha1": "91d24f498556f86f6d1318d2efd5210c35b36762", 2020-06-12T17:48:34.055 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_version": "ceph version 15.2.3-196-g91d24f4 (91d24f498556f86f6d1318d2efd5210c35b36762) octopus (stable)", 2020-06-12T17:48:34.055 INFO:teuthology.orchestra.run.smithi038.stdout: "entity_id": "1", 2020-06-12T17:48:34.055 INFO:teuthology.orchestra.run.smithi038.stdout: "hostname": "smithi038", 2020-06-12T17:48:34.056 INFO:teuthology.orchestra.run.smithi038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-06-12T17:48:34.056 INFO:teuthology.orchestra.run.smithi038.stdout: "pid": "34786", 2020-06-12T17:48:34.056 INFO:teuthology.orchestra.run.smithi038.stdout: "root": "/" 2020-06-12T17:48:34.056 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:34.056 INFO:teuthology.orchestra.run.smithi038.stdout: "dentry_count": 0, 2020-06-12T17:48:34.057 INFO:teuthology.orchestra.run.smithi038.stdout: "dentry_pinned_count": 0, 2020-06-12T17:48:34.057 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 4406, 2020-06-12T17:48:34.057 INFO:teuthology.orchestra.run.smithi038.stdout: "inst": { 2020-06-12T17:48:34.057 INFO:teuthology.orchestra.run.smithi038.stdout: "name": { 2020-06-12T17:48:34.057 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "client", 2020-06-12T17:48:34.058 INFO:teuthology.orchestra.run.smithi038.stdout: "num": 4406 2020-06-12T17:48:34.058 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:34.058 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": { 2020-06-12T17:48:34.058 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:34.058 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:0", 2020-06-12T17:48:34.059 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 3017527690 2020-06-12T17:48:34.059 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:34.059 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:34.059 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": { 2020-06-12T17:48:34.059 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:34.059 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:0", 2020-06-12T17:48:34.060 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 3017527690 2020-06-12T17:48:34.060 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:34.060 INFO:teuthology.orchestra.run.smithi038.stdout: "inst_str": "client.4406 172.21.15.38:0/3017527690", 2020-06-12T17:48:34.060 INFO:teuthology.orchestra.run.smithi038.stdout: "addr_str": "172.21.15.38:0/3017527690", 2020-06-12T17:48:34.060 INFO:teuthology.orchestra.run.smithi038.stdout: "inode_count": 1, 2020-06-12T17:48:34.061 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_epoch": 6, 2020-06-12T17:48:34.061 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_epoch": 24, 2020-06-12T17:48:34.061 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_epoch_barrier": 0, 2020-06-12T17:48:34.061 INFO:teuthology.orchestra.run.smithi038.stdout: "blacklisted": false 2020-06-12T17:48:34.061 INFO:teuthology.orchestra.run.smithi038.stdout:} 2020-06-12T17:48:34.063 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-12T17:48:34.182 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.178+0000 7fae27456700 1 Processor -- start 2020-06-12T17:48:34.182 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.178+0000 7fae27456700 1 -- start start 2020-06-12T17:48:34.185 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.179+0000 7fae27456700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae2009bee0 0x7fae200b3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:34.185 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.179+0000 7fae27456700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fae200b38f0 0x7fae200b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:34.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.179+0000 7fae27456700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae200b2dc0 con 0x7fae20061a80 2020-06-12T17:48:34.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.179+0000 7fae27456700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2009e560 con 0x7fae200b38f0 2020-06-12T17:48:34.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.179+0000 7fae27456700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae200b29d0 con 0x7fae2009bee0 2020-06-12T17:48:34.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.179+0000 7fae259f3700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fae200b38f0 0x7fae200b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:34.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.179+0000 7fae251f2700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fae20061a80 0x7fae20142350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38064/0 (socket says 172.21.15.38:38064) 2020-06-12T17:48:34.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.179+0000 7fae259f3700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fae200b38f0 0x7fae200b3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36248/0 (socket says 172.21.15.38:36248) 2020-06-12T17:48:34.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.179+0000 7fae251f2700 1 -- 172.21.15.38:0/3331704073 learned_addr learned my addr 172.21.15.38:0/3331704073 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:34.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.179+0000 7fae249f1700 1 --2- 172.21.15.38:0/3331704073 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae2009bee0 0x7fae200b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:34.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.180+0000 7fae259f3700 1 -- 172.21.15.38:0/3331704073 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae2009bee0 msgr2=0x7fae200b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:34.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.180+0000 7fae259f3700 1 --2- 172.21.15.38:0/3331704073 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae2009bee0 0x7fae200b3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:34.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.180+0000 7fae259f3700 1 -- 172.21.15.38:0/3331704073 >> v1:172.21.15.38:6789/0 conn(0x7fae20061a80 legacy=0x7fae20142350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:34.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.180+0000 7fae259f3700 1 -- 172.21.15.38:0/3331704073 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae200b2ff0 con 0x7fae200b38f0 2020-06-12T17:48:34.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.180+0000 7fae13fff700 1 -- 172.21.15.38:0/3331704073 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768677571 0 0) 0x7fae200b2dc0 con 0x7fae20061a80 2020-06-12T17:48:34.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.180+0000 7fae249f1700 1 --2- 172.21.15.38:0/3331704073 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae2009bee0 0x7fae200b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:34.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.180+0000 7fae259f3700 1 --2- 172.21.15.38:0/3331704073 >> v2:172.21.15.38:3300/0 conn(0x7fae200b38f0 0x7fae200b3d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fae180032b0 tx=0x7fae180081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.180+0000 7fae259f3700 1 --2- 172.21.15.38:0/3331704073 >> v2:172.21.15.38:3300/0 conn(0x7fae200b38f0 0x7fae200b3d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fae180032b0 tx=0x7fae180081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.180+0000 7fae259f3700 1 --2- 172.21.15.38:0/3331704073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae200b38f0 0x7fae200b3d80 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7fae180032b0 tx=0x7fae180081e0).ready entity=mon.0 client_cookie=d4b5ec8e94a6b75e server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:34.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.180+0000 7fae259f3700 1 --2- 172.21.15.38:0/3331704073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae200b38f0 0x7fae200b3d80 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7fae180032b0 tx=0x7fae180081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.180+0000 7fae13fff700 1 -- 172.21.15.38:0/3331704073 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae18011e90 con 0x7fae200b38f0 2020-06-12T17:48:34.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.180+0000 7fae259f3700 1 --2- 172.21.15.38:0/3331704073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae200b38f0 0x7fae200b3d80 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7fae180032b0 tx=0x7fae180081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.180+0000 7fae259f3700 1 --2- 172.21.15.38:0/3331704073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae200b38f0 0x7fae200b3d80 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7fae180032b0 tx=0x7fae180081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.180+0000 7fae13fff700 1 -- 172.21.15.38:0/3331704073 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1800a160 con 0x7fae200b38f0 2020-06-12T17:48:34.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.180+0000 7fae13fff700 1 -- 172.21.15.38:0/3331704073 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae1800a540 con 0x7fae200b38f0 2020-06-12T17:48:34.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.180+0000 7fae27456700 1 -- 172.21.15.38:0/3331704073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae200b38f0 msgr2=0x7fae200b3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:34.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.180+0000 7fae27456700 1 --2- 172.21.15.38:0/3331704073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae200b38f0 0x7fae200b3d80 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7fae180032b0 tx=0x7fae180081e0).stop 2020-06-12T17:48:34.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.181+0000 7fae27456700 1 -- 172.21.15.38:0/3331704073 shutdown_connections 2020-06-12T17:48:34.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.181+0000 7fae27456700 1 --2- 172.21.15.38:0/3331704073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae200b38f0 0x7fae200b3d80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:34.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.181+0000 7fae27456700 1 --2- 172.21.15.38:0/3331704073 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae2009bee0 0x7fae200b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:34.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.181+0000 7fae27456700 1 -- 172.21.15.38:0/3331704073 >> 172.21.15.38:0/3331704073 conn(0x7fae200b8420 msgr2=0x7fae200b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:34.192 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.181+0000 7fae27456700 1 -- 172.21.15.38:0/3331704073 shutdown_connections 2020-06-12T17:48:34.192 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.181+0000 7fae27456700 1 -- 172.21.15.38:0/3331704073 wait complete. 2020-06-12T17:48:34.192 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.182+0000 7fae27456700 1 Processor -- start 2020-06-12T17:48:34.192 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.182+0000 7fae27456700 1 -- start start 2020-06-12T17:48:34.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.182+0000 7fae27456700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fae200b38f0 0x7fae200643a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:34.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.182+0000 7fae27456700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae200b2180 con 0x7fae20061a80 2020-06-12T17:48:34.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.182+0000 7fae27456700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae20066690 con 0x7fae2009bee0 2020-06-12T17:48:34.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.182+0000 7fae27456700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae20066b30 con 0x7fae200b38f0 2020-06-12T17:48:34.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.182+0000 7fae259f3700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fae200b38f0 0x7fae200643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:34.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.182+0000 7fae251f2700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fae20061a80 0x7fae2013da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38070/0 (socket says 172.21.15.38:38070) 2020-06-12T17:48:34.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.182+0000 7fae251f2700 1 -- 172.21.15.38:0/437205490 learned_addr learned my addr 172.21.15.38:0/437205490 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:34.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.183+0000 7fae259f3700 1 -- 172.21.15.38:0/437205490 >> v1:172.21.15.150:6789/0 conn(0x7fae2009bee0 legacy=0x7fae201430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:34.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.183+0000 7fae259f3700 1 -- 172.21.15.38:0/437205490 >> v1:172.21.15.38:6789/0 conn(0x7fae20061a80 legacy=0x7fae2013da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:34.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.183+0000 7fae259f3700 1 -- 172.21.15.38:0/437205490 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae200b18e0 con 0x7fae200b38f0 2020-06-12T17:48:34.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.183+0000 7fae127fc700 1 -- 172.21.15.38:0/437205490 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3086236661 0 0) 0x7fae200b2180 con 0x7fae20061a80 2020-06-12T17:48:34.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.183+0000 7fae259f3700 1 --2- 172.21.15.38:0/437205490 >> v2:172.21.15.38:3300/0 conn(0x7fae200b38f0 0x7fae200643a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fae180032b0 tx=0x7fae180081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.183+0000 7fae259f3700 1 --2- 172.21.15.38:0/437205490 >> v2:172.21.15.38:3300/0 conn(0x7fae200b38f0 0x7fae200643a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fae180032b0 tx=0x7fae180081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.183+0000 7fae259f3700 1 --2- 172.21.15.38:0/437205490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae200b38f0 0x7fae200643a0 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7fae180032b0 tx=0x7fae180081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:34.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.183+0000 7fae259f3700 1 --2- 172.21.15.38:0/437205490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae200b38f0 0x7fae200643a0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7fae180032b0 tx=0x7fae180081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.183+0000 7fae127fc700 1 -- 172.21.15.38:0/437205490 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae1800ae50 con 0x7fae200b38f0 2020-06-12T17:48:34.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.183+0000 7fae259f3700 1 --2- 172.21.15.38:0/437205490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae200b38f0 0x7fae200643a0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7fae180032b0 tx=0x7fae180081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.183+0000 7fae259f3700 1 --2- 172.21.15.38:0/437205490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae200b38f0 0x7fae200643a0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7fae180032b0 tx=0x7fae180081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.183+0000 7fae127fc700 1 -- 172.21.15.38:0/437205490 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae18005c30 con 0x7fae200b38f0 2020-06-12T17:48:34.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.183+0000 7fae127fc700 1 -- 172.21.15.38:0/437205490 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae1800f570 con 0x7fae200b38f0 2020-06-12T17:48:34.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.183+0000 7fae27456700 1 -- 172.21.15.38:0/437205490 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae200b1d50 con 0x7fae200b38f0 2020-06-12T17:48:34.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.183+0000 7fae27456700 1 -- 172.21.15.38:0/437205490 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae2013e2f0 con 0x7fae200b38f0 2020-06-12T17:48:34.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.184+0000 7fae259f3700 1 --2- 172.21.15.38:0/437205490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae200b38f0 0x7fae200643a0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7fae180032b0 tx=0x7fae180081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.184+0000 7fae127fc700 1 -- 172.21.15.38:0/437205490 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fae1800f6d0 con 0x7fae200b38f0 2020-06-12T17:48:34.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.184+0000 7fae259f3700 1 --2- 172.21.15.38:0/437205490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae200b38f0 0x7fae200643a0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7fae180032b0 tx=0x7fae180081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.184+0000 7fae27456700 1 -- 172.21.15.38:0/437205490 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae20056c30 con 0x7fae200b38f0 2020-06-12T17:48:34.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.184+0000 7fae127fc700 1 --2- 172.21.15.38:0/437205490 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fae0004d450 0x7fae0004f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:34.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.185+0000 7fae127fc700 1 -- 172.21.15.38:0/437205490 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fae18061e60 con 0x7fae200b38f0 2020-06-12T17:48:34.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.185+0000 7fae251f2700 1 --2- 172.21.15.38:0/437205490 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fae0004d450 0x7fae0004f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:34.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.185+0000 7fae251f2700 1 --2- 172.21.15.38:0/437205490 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fae0004d450 0x7fae0004f910 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fae14001260 tx=0x7fae140015c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.185+0000 7fae251f2700 1 --2- 172.21.15.38:0/437205490 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fae0004d450 0x7fae0004f910 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fae14001260 tx=0x7fae140015c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.185+0000 7fae251f2700 1 --2- 172.21.15.38:0/437205490 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fae0004d450 0x7fae0004f910 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7fae14001260 tx=0x7fae140015c0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:34.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.188+0000 7fae259f3700 1 --2- 172.21.15.38:0/437205490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae200b38f0 0x7fae200643a0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7fae180032b0 tx=0x7fae180081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.188+0000 7fae127fc700 1 -- 172.21.15.38:0/437205490 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fae1803d680 con 0x7fae200b38f0 2020-06-12T17:48:34.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.340+0000 7fae27456700 1 -- 172.21.15.38:0/437205490 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae200b1a70 con 0x7fae200b38f0 2020-06-12T17:48:34.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.341+0000 7fae259f3700 1 --2- 172.21.15.38:0/437205490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae200b38f0 0x7fae200643a0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7fae180032b0 tx=0x7fae180081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.341+0000 7fae127fc700 1 -- 172.21.15.38:0/437205490 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16347 (secure 0 0 0) 0x7fae18040ca0 con 0x7fae200b38f0 2020-06-12T17:48:34.345 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:34.346 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":24,"fsid":"8e42a2e7-b187-42c4-a73f-8f812ee62352","created":"2020-06-12T17:47:54.434340+0000","modified":"2020-06-12T17:48:14.851712+0000","last_up_change":"2020-06-12T17:48:03.388718+0000","last_in_change":"2020-06-12T17:48:03.388718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-06-12T17:47:57.558119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-06-12T17:48:07.419264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-06-12T17:48:09.934098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-06-12T17:48:12.497229+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"44ac3dea-67b4-4b9a-bc18-ac511710afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":31038},{"type":"v1","addr":"172.21.15.38:6816","nonce":31038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":31038},{"type":"v1","addr":"172.21.15.38:6819","nonce":31038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":31038},{"type":"v1","addr":"172.21.15.38:6823","nonce":31038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":31038},{"type":"v1","addr":"172.21.15.38:6821","nonce":31038}]},"public_addr":"172.21.15.38:6816/31038","cluster_addr":"172.21.15.38:6819/31038","heartbeat_back_addr":"172.21.15.38:6823/31038","heartbeat_front_addr":"172.21.15.38:6821/31038","state":["exists","up"]},{"osd":1,"uuid":"561f7ced-3fff-4364-8619-6e4ecbc9d256","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":31036},{"type":"v1","addr":"172.21.15.38:6801","nonce":31036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":31036},{"type":"v1","addr":"172.21.15.38:6803","nonce":31036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":31036},{"type":"v1","addr":"172.21.15.38:6807","nonce":31036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":31036},{"type":"v1","addr":"172.21.15.38:6805","nonce":31036}]},"public_addr":"172.21.15.38:6801/31036","cluster_addr":"172.21.15.38:6803/31036","heartbeat_back_addr":"172.21.15.38:6807/31036","heartbeat_front_addr":"172.21.15.38:6805/31036","state":["exists","up"]},{"osd":2,"uuid":"0bb3c806-07af-49f5-b492-d0e33f2de37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":31053},{"type":"v1","addr":"172.21.15.38:6825","nonce":31053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":31053},{"type":"v1","addr":"172.21.15.38:6827","nonce":31053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":31053},{"type":"v1","addr":"172.21.15.38:6831","nonce":31053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":31053},{"type":"v1","addr":"172.21.15.38:6829","nonce":31053}]},"public_addr":"172.21.15.38:6825/31053","cluster_addr":"172.21.15.38:6827/31053","heartbeat_back_addr":"172.21.15.38:6831/31053","heartbeat_front_addr":"172.21.15.38:6829/31053","state":["exists","up"]},{"osd":3,"uuid":"7f6a1e75-7b11-456e-8a4b-510b16226800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":31037},{"type":"v1","addr":"172.21.15.38:6809","nonce":31037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":31037},{"type":"v1","addr":"172.21.15.38:6811","nonce":31037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6815","nonce":31037},{"type":"v1","addr":"172.21.15.38:6817","nonce":31037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":31037},{"type":"v1","addr":"172.21.15.38:6813","nonce":31037}]},"public_addr":"172.21.15.38:6809/31037","cluster_addr":"172.21.15.38:6811/31037","heartbeat_back_addr":"172.21.15.38:6817/31037","heartbeat_front_addr":"172.21.15.38:6813/31037","state":["exists","up"]},{"osd":4,"uuid":"0eca0272-8cfd-469c-a32d-e29730dc0e1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":31294},{"type":"v1","addr":"172.21.15.150:6803","nonce":31294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":31294},{"type":"v1","addr":"172.21.15.150:6805","nonce":31294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":31294},{"type":"v1","addr":"172.21.15.150:6809","nonce":31294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":31294},{"type":"v1","addr":"172.21.15.150:6807","nonce":31294}]},"public_addr":"172.21.15.150:6803/31294","cluster_addr":"172.21.15.150:6805/31294","heartbeat_back_addr":"172.21.15.150:6809/31294","heartbeat_front_addr":"172.21.15.150:6807/31294","state":["exists","up"]},{"osd":5,"uuid":"69d6a7dc-a55a-4ebc-8479-8bb921ddfb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":31295},{"type":"v1","addr":"172.21.15.150:6813","nonce":31295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":31295},{"type":"v1","addr":"172.21.15.150:6816","nonce":31295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":31295},{"type":"v1","addr":"172.21.15.150:6828","nonce":31295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6819","nonce":31295},{"type":"v1","addr":"172.21.15.150:6822","nonce":31295}]},"public_addr":"172.21.15.150:6813/31295","cluster_addr":"172.21.15.150:6816/31295","heartbeat_back_addr":"172.21.15.150:6828/31295","heartbeat_front_addr":"172.21.15.150:6822/31295","state":["exists","up"]},{"osd":6,"uuid":"f0d320f8-c2f0-40bb-b713-526246cf97b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":31297},{"type":"v1","addr":"172.21.15.150:6820","nonce":31297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6823","nonce":31297},{"type":"v1","addr":"172.21.15.150:6827","nonce":31297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":31297},{"type":"v1","addr":"172.21.15.150:6833","nonce":31297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":31297},{"type":"v1","addr":"172.21.15.150:6831","nonce":31297}]},"public_addr":"172.21.15.150:6820/31297","cluster_addr":"172.21.15.150:6827/31297","heartbeat_back_addr":"172.21.15.150:6833/31297","heartbeat_front_addr":"172.21.15.150:6831/31297","state":["exists","up"]},{"osd":7,"uuid":"970b7d02-a189-41b2-96e5-a5a5a57c6476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":31296},{"type":"v1","addr":"172.21.15.150:6812","nonce":31296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":31296},{"type":"v1","addr":"172.21.15.150:6818","nonce":31296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":31296},{"type":"v1","addr":"172.21.15.150:6829","nonce":31296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":31296},{"type":"v1","addr":"172.21.15.150:6824","nonce":31296}]},"public_addr":"172.21.15.150:6812/31296","cluster_addr":"172.21.15.150:6818/31296","heartbeat_back_addr":"172.21.15.150:6829/31296","heartbeat_front_addr":"172.21.15.150:6824/31296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.664300+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.644253+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.651120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.584978+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.561149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.661778+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T17:48:34.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.343+0000 7fae27456700 1 -- 172.21.15.38:0/437205490 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fae0004d450 msgr2=0x7fae0004f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:34.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.343+0000 7fae27456700 1 --2- 172.21.15.38:0/437205490 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fae0004d450 0x7fae0004f910 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7fae14001260 tx=0x7fae140015c0).stop 2020-06-12T17:48:34.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.343+0000 7fae27456700 1 -- 172.21.15.38:0/437205490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae200b38f0 msgr2=0x7fae200643a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:34.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.343+0000 7fae27456700 1 --2- 172.21.15.38:0/437205490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae200b38f0 0x7fae200643a0 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7fae180032b0 tx=0x7fae180081e0).stop 2020-06-12T17:48:34.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.343+0000 7fae27456700 1 -- 172.21.15.38:0/437205490 shutdown_connections 2020-06-12T17:48:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.343+0000 7fae27456700 1 --2- 172.21.15.38:0/437205490 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fae0004d450 0x7fae0004f910 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.343+0000 7fae27456700 1 --2- 172.21.15.38:0/437205490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae200b38f0 0x7fae200643a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.343+0000 7fae27456700 1 -- 172.21.15.38:0/437205490 >> 172.21.15.38:0/437205490 conn(0x7fae200b8420 msgr2=0x7fae20061e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.343+0000 7fae27456700 1 -- 172.21.15.38:0/437205490 shutdown_connections 2020-06-12T17:48:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.343+0000 7fae27456700 1 -- 172.21.15.38:0/437205490 wait complete. 2020-06-12T17:48:34.356 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-06-12T17:47:57.558119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-06-12T17:48:07.419264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-06-12T17:48:09.934098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-06-12T17:48:12.497229+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-06-12T17:48:34.357 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-06-12T17:48:34.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.471+0000 7fd6ffd8c700 1 Processor -- start 2020-06-12T17:48:34.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.471+0000 7fd6ffd8c700 1 -- start start 2020-06-12T17:48:34.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.472+0000 7fd6ffd8c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd6f80b5120 0x7fd6f805c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:34.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.472+0000 7fd6ffd8c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6f80b4460 0x7fd6f80b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:34.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.472+0000 7fd6ffd8c700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f814a7b0 con 0x7fd6f80b5c70 2020-06-12T17:48:34.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.472+0000 7fd6ffd8c700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f814a510 con 0x7fd6f80b5120 2020-06-12T17:48:34.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.472+0000 7fd6ffd8c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f8146410 con 0x7fd6f80b4460 2020-06-12T17:48:34.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.472+0000 7fd6fd327700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd6f80b5120 0x7fd6f805c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:34.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.472+0000 7fd6fdb28700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd6f80b5c70 0x7fd6f80b3860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38078/0 (socket says 172.21.15.38:38078) 2020-06-12T17:48:34.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.472+0000 7fd6fd327700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd6f80b5120 0x7fd6f805c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36262/0 (socket says 172.21.15.38:36262) 2020-06-12T17:48:34.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.472+0000 7fd6fd327700 1 -- 172.21.15.38:0/1390083727 learned_addr learned my addr 172.21.15.38:0/1390083727 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:34.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.472+0000 7fd6fe329700 1 --2- 172.21.15.38:0/1390083727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6f80b4460 0x7fd6f80b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:34.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.473+0000 7fd6fd327700 1 -- 172.21.15.38:0/1390083727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6f80b4460 msgr2=0x7fd6f80b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:34.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.473+0000 7fd6fd327700 1 --2- 172.21.15.38:0/1390083727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6f80b4460 0x7fd6f80b48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:34.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.473+0000 7fd6fd327700 1 -- 172.21.15.38:0/1390083727 >> v1:172.21.15.38:6789/0 conn(0x7fd6f80b5c70 legacy=0x7fd6f80b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:34.483 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.473+0000 7fd6fd327700 1 -- 172.21.15.38:0/1390083727 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f80b4d10 con 0x7fd6f80b5120 2020-06-12T17:48:34.483 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.473+0000 7fd6fcb26700 1 -- 172.21.15.38:0/1390083727 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1146475571 0 0) 0x7fd6f814a7b0 con 0x7fd6f80b5c70 2020-06-12T17:48:34.483 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.473+0000 7fd6fe329700 1 --2- 172.21.15.38:0/1390083727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6f80b4460 0x7fd6f80b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:34.483 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.473+0000 7fd6fd327700 1 --2- 172.21.15.38:0/1390083727 >> v2:172.21.15.38:3300/0 conn(0x7fd6f80b5120 0x7fd6f805c4f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd6f4002f30 tx=0x7fd6f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.483 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.473+0000 7fd6fd327700 1 --2- 172.21.15.38:0/1390083727 >> v2:172.21.15.38:3300/0 conn(0x7fd6f80b5120 0x7fd6f805c4f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd6f4002f30 tx=0x7fd6f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.484 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.473+0000 7fd6fd327700 1 --2- 172.21.15.38:0/1390083727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6f80b5120 0x7fd6f805c4f0 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7fd6f4002f30 tx=0x7fd6f4007e60).ready entity=mon.0 client_cookie=73f447b585505a26 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:34.484 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.473+0000 7fd6fd327700 1 --2- 172.21.15.38:0/1390083727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6f80b5120 0x7fd6f805c4f0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fd6f4002f30 tx=0x7fd6f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.484 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.473+0000 7fd6fcb26700 1 -- 172.21.15.38:0/1390083727 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6f40116e0 con 0x7fd6f80b5120 2020-06-12T17:48:34.484 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.473+0000 7fd6fd327700 1 --2- 172.21.15.38:0/1390083727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6f80b5120 0x7fd6f805c4f0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fd6f4002f30 tx=0x7fd6f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.484 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.473+0000 7fd6fd327700 1 --2- 172.21.15.38:0/1390083727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6f80b5120 0x7fd6f805c4f0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fd6f4002f30 tx=0x7fd6f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.473+0000 7fd6fcb26700 1 -- 172.21.15.38:0/1390083727 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f4011840 con 0x7fd6f80b5120 2020-06-12T17:48:34.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.473+0000 7fd6fcb26700 1 -- 172.21.15.38:0/1390083727 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6f4011c20 con 0x7fd6f80b5120 2020-06-12T17:48:34.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.473+0000 7fd6ffd8c700 1 -- 172.21.15.38:0/1390083727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6f80b5120 msgr2=0x7fd6f805c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:34.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.473+0000 7fd6ffd8c700 1 --2- 172.21.15.38:0/1390083727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6f80b5120 0x7fd6f805c4f0 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7fd6f4002f30 tx=0x7fd6f4007e60).stop 2020-06-12T17:48:34.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.473+0000 7fd6ffd8c700 1 -- 172.21.15.38:0/1390083727 shutdown_connections 2020-06-12T17:48:34.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.473+0000 7fd6ffd8c700 1 --2- 172.21.15.38:0/1390083727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6f80b4460 0x7fd6f80b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:34.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.473+0000 7fd6ffd8c700 1 --2- 172.21.15.38:0/1390083727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6f80b5120 0x7fd6f805c4f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:34.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.473+0000 7fd6ffd8c700 1 -- 172.21.15.38:0/1390083727 >> 172.21.15.38:0/1390083727 conn(0x7fd6f80b8ec0 msgr2=0x7fd6f80b92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:34.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.473+0000 7fd6ffd8c700 1 -- 172.21.15.38:0/1390083727 shutdown_connections 2020-06-12T17:48:34.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.473+0000 7fd6ffd8c700 1 -- 172.21.15.38:0/1390083727 wait complete. 2020-06-12T17:48:34.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.474+0000 7fd6ffd8c700 1 Processor -- start 2020-06-12T17:48:34.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.474+0000 7fd6ffd8c700 1 -- start start 2020-06-12T17:48:34.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.475+0000 7fd6ffd8c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6f80b5120 0x7fd6f8066760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:34.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.475+0000 7fd6ffd8c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd6f80b5c70 0x7fd6f81575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:34.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.475+0000 7fd6ffd8c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f80670d0 con 0x7fd6f80b4460 2020-06-12T17:48:34.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.475+0000 7fd6ffd8c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f8145a80 con 0x7fd6f80b5c70 2020-06-12T17:48:34.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.475+0000 7fd6ffd8c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80649d0 con 0x7fd6f80b5120 2020-06-12T17:48:34.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.475+0000 7fd6fd327700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6f80b5120 0x7fd6f8066760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:34.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.475+0000 7fd6fe329700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd6f80b5c70 0x7fd6f81575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:34.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.475+0000 7fd6fd327700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6f80b5120 0x7fd6f8066760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:55728/0 (socket says 172.21.15.38:55728) 2020-06-12T17:48:34.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.475+0000 7fd6fe329700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd6f80b5c70 0x7fd6f81575b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:45748/0 (socket says 172.21.15.38:45748) 2020-06-12T17:48:34.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.475+0000 7fd6fd327700 1 -- 172.21.15.38:0/1173944922 learned_addr learned my addr 172.21.15.38:0/1173944922 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:34.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.475+0000 7fd6fdb28700 1 --1- 172.21.15.38:0/1173944922 >> v1:172.21.15.150:6789/0 conn(0x7fd6f80b4460 0x7fd6f813fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:58816/0 (socket says 172.21.15.38:58816) 2020-06-12T17:48:34.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.476+0000 7fd6fe329700 1 -- 172.21.15.38:0/1173944922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6f80b5120 msgr2=0x7fd6f8066760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:34.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.476+0000 7fd6fe329700 1 --2- 172.21.15.38:0/1173944922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6f80b5120 0x7fd6f8066760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:34.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.476+0000 7fd6fe329700 1 -- 172.21.15.38:0/1173944922 >> v1:172.21.15.150:6789/0 conn(0x7fd6f80b4460 legacy=0x7fd6f813fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:34.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.476+0000 7fd6e6ffd700 1 -- 172.21.15.38:0/1173944922 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2731145141 0 0) 0x7fd6f80670d0 con 0x7fd6f80b4460 2020-06-12T17:48:34.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.476+0000 7fd6fe329700 1 -- 172.21.15.38:0/1173944922 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f8064c70 con 0x7fd6f80b5c70 2020-06-12T17:48:34.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.476+0000 7fd6fd327700 1 --2- 172.21.15.38:0/1173944922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6f80b5120 0x7fd6f8066760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:34.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.476+0000 7fd6fe329700 1 --2- 172.21.15.38:0/1173944922 >> v2:172.21.15.150:3300/0 conn(0x7fd6f80b5c70 0x7fd6f81575b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd6f00032b0 tx=0x7fd6f000e270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.476+0000 7fd6fe329700 1 --2- 172.21.15.38:0/1173944922 >> v2:172.21.15.150:3300/0 conn(0x7fd6f80b5c70 0x7fd6f81575b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd6f00032b0 tx=0x7fd6f000e270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.476+0000 7fd6fe329700 1 --2- 172.21.15.38:0/1173944922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6f80b5c70 0x7fd6f81575b0 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7fd6f00032b0 tx=0x7fd6f000e270).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:34.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.476+0000 7fd6fe329700 1 --2- 172.21.15.38:0/1173944922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6f80b5c70 0x7fd6f81575b0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fd6f00032b0 tx=0x7fd6f000e270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.476+0000 7fd6e6ffd700 1 -- 172.21.15.38:0/1173944922 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6f0005e30 con 0x7fd6f80b5c70 2020-06-12T17:48:34.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.476+0000 7fd6fe329700 1 --2- 172.21.15.38:0/1173944922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6f80b5c70 0x7fd6f81575b0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fd6f00032b0 tx=0x7fd6f000e270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.476+0000 7fd6ffd8c700 1 -- 172.21.15.38:0/1173944922 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f8140430 con 0x7fd6f80b5c70 2020-06-12T17:48:34.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.476+0000 7fd6e6ffd700 1 -- 172.21.15.38:0/1173944922 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f0007540 con 0x7fd6f80b5c70 2020-06-12T17:48:34.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.476+0000 7fd6fe329700 1 --2- 172.21.15.38:0/1173944922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6f80b5c70 0x7fd6f81575b0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fd6f00032b0 tx=0x7fd6f000e270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.476+0000 7fd6e6ffd700 1 -- 172.21.15.38:0/1173944922 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6f0007920 con 0x7fd6f80b5c70 2020-06-12T17:48:34.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.476+0000 7fd6ffd8c700 1 -- 172.21.15.38:0/1173944922 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f81419a0 con 0x7fd6f80b5c70 2020-06-12T17:48:34.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.477+0000 7fd6fe329700 1 --2- 172.21.15.38:0/1173944922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6f80b5c70 0x7fd6f81575b0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fd6f00032b0 tx=0x7fd6f000e270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.477+0000 7fd6ffd8c700 1 -- 172.21.15.38:0/1173944922 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f8067b20 con 0x7fd6f80b5c70 2020-06-12T17:48:34.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.477+0000 7fd6fe329700 1 --2- 172.21.15.38:0/1173944922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6f80b5c70 0x7fd6f81575b0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fd6f00032b0 tx=0x7fd6f000e270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.477+0000 7fd6e6ffd700 1 -- 172.21.15.38:0/1173944922 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fd6f000e3b0 con 0x7fd6f80b5c70 2020-06-12T17:48:34.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.478+0000 7fd6e6ffd700 1 --2- 172.21.15.38:0/1173944922 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd6d804d420 0x7fd6d804f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:34.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.478+0000 7fd6e6ffd700 1 -- 172.21.15.38:0/1173944922 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd6f0061980 con 0x7fd6f80b5c70 2020-06-12T17:48:34.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.478+0000 7fd6fdb28700 1 --2- 172.21.15.38:0/1173944922 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd6d804d420 0x7fd6d804f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:34.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.478+0000 7fd6fdb28700 1 --2- 172.21.15.38:0/1173944922 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd6d804d420 0x7fd6d804f8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd6e80010f0 tx=0x7fd6e80015a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.478+0000 7fd6fdb28700 1 --2- 172.21.15.38:0/1173944922 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd6d804d420 0x7fd6d804f8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd6e80010f0 tx=0x7fd6e80015a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.478+0000 7fd6fdb28700 1 --2- 172.21.15.38:0/1173944922 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd6d804d420 0x7fd6d804f8e0 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7fd6e80010f0 tx=0x7fd6e80015a0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:34.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.481+0000 7fd6fe329700 1 --2- 172.21.15.38:0/1173944922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6f80b5c70 0x7fd6f81575b0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fd6f00032b0 tx=0x7fd6f000e270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.481+0000 7fd6e6ffd700 1 -- 172.21.15.38:0/1173944922 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fd6f003cf60 con 0x7fd6f80b5c70 2020-06-12T17:48:34.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.632+0000 7fd6ffd8c700 1 -- 172.21.15.38:0/1173944922 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd6f8056c30 con 0x7fd6f80b5c70 2020-06-12T17:48:34.637 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.633+0000 7fd6fe329700 1 --2- 172.21.15.38:0/1173944922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6f80b5c70 0x7fd6f81575b0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7fd6f00032b0 tx=0x7fd6f000e270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.637 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.633+0000 7fd6e6ffd700 1 -- 172.21.15.38:0/1173944922 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd6f0040580 con 0x7fd6f80b5c70 2020-06-12T17:48:34.638 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2020-06-12T17:48:34.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.635+0000 7fd6ffd8c700 1 -- 172.21.15.38:0/1173944922 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd6d804d420 msgr2=0x7fd6d804f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:34.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.635+0000 7fd6ffd8c700 1 --2- 172.21.15.38:0/1173944922 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd6d804d420 0x7fd6d804f8e0 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7fd6e80010f0 tx=0x7fd6e80015a0).stop 2020-06-12T17:48:34.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.635+0000 7fd6ffd8c700 1 -- 172.21.15.38:0/1173944922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6f80b5c70 msgr2=0x7fd6f81575b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:34.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.635+0000 7fd6ffd8c700 1 --2- 172.21.15.38:0/1173944922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6f80b5c70 0x7fd6f81575b0 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7fd6f00032b0 tx=0x7fd6f000e270).stop 2020-06-12T17:48:34.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.635+0000 7fd6ffd8c700 1 -- 172.21.15.38:0/1173944922 shutdown_connections 2020-06-12T17:48:34.640 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.635+0000 7fd6ffd8c700 1 --2- 172.21.15.38:0/1173944922 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd6d804d420 0x7fd6d804f8e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:34.640 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.635+0000 7fd6ffd8c700 1 --2- 172.21.15.38:0/1173944922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6f80b5c70 0x7fd6f81575b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:34.640 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.635+0000 7fd6ffd8c700 1 --2- 172.21.15.38:0/1173944922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6f80b5120 0x7fd6f8066760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:34.640 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.635+0000 7fd6ffd8c700 1 -- 172.21.15.38:0/1173944922 >> 172.21.15.38:0/1173944922 conn(0x7fd6f80b8ec0 msgr2=0x7fd6f80b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:34.640 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.635+0000 7fd6ffd8c700 1 -- 172.21.15.38:0/1173944922 shutdown_connections 2020-06-12T17:48:34.641 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.635+0000 7fd6ffd8c700 1 -- 172.21.15.38:0/1173944922 wait complete. 2020-06-12T17:48:34.648 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-06-12T17:48:34.765 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.762+0000 7fb34fa5a700 1 Processor -- start 2020-06-12T17:48:34.766 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.762+0000 7fb34fa5a700 1 -- start start 2020-06-12T17:48:34.768 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.763+0000 7fb34fa5a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb3480b2eb0 0x7fb34814d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.763+0000 7fb34fa5a700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb348146d20 con 0x7fb3480ad5b0 2020-06-12T17:48:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.763+0000 7fb34fa5a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb348066a80 con 0x7fb348146680 2020-06-12T17:48:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.763+0000 7fb34fa5a700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb348146f50 con 0x7fb3480b2eb0 2020-06-12T17:48:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.763+0000 7fb34dff7700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb3480b2eb0 0x7fb34814d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.763+0000 7fb34dff7700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb3480b2eb0 0x7fb34814d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36280/0 (socket says 172.21.15.38:36280) 2020-06-12T17:48:34.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.763+0000 7fb34cff5700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb3480ad5b0 0x7fb34809d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38092/0 (socket says 172.21.15.38:38092) 2020-06-12T17:48:34.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.763+0000 7fb34dff7700 1 -- 172.21.15.38:0/832664583 learned_addr learned my addr 172.21.15.38:0/832664583 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:34.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.763+0000 7fb34dff7700 1 -- 172.21.15.38:0/832664583 >> v1:172.21.15.150:6789/0 conn(0x7fb348146680 legacy=0x7fb34809d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:34.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.763+0000 7fb34dff7700 1 -- 172.21.15.38:0/832664583 >> v1:172.21.15.38:6789/0 conn(0x7fb3480ad5b0 legacy=0x7fb34809d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:34.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.763+0000 7fb347fff700 1 -- 172.21.15.38:0/832664583 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 119060761 0 0) 0x7fb348146d20 con 0x7fb3480ad5b0 2020-06-12T17:48:34.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.763+0000 7fb34dff7700 1 -- 172.21.15.38:0/832664583 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb348146a60 con 0x7fb3480b2eb0 2020-06-12T17:48:34.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.763+0000 7fb34dff7700 1 --2- 172.21.15.38:0/832664583 >> v2:172.21.15.38:3300/0 conn(0x7fb3480b2eb0 0x7fb34814d490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb3480b61c0 tx=0x7fb338007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.763+0000 7fb34dff7700 1 --2- 172.21.15.38:0/832664583 >> v2:172.21.15.38:3300/0 conn(0x7fb3480b2eb0 0x7fb34814d490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb3480b61c0 tx=0x7fb338007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.763+0000 7fb34dff7700 1 --2- 172.21.15.38:0/832664583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3480b2eb0 0x7fb34814d490 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7fb3480b61c0 tx=0x7fb338007e60).ready entity=mon.0 client_cookie=65aa69e99776ca86 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:34.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.764+0000 7fb34dff7700 1 --2- 172.21.15.38:0/832664583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3480b2eb0 0x7fb34814d490 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fb3480b61c0 tx=0x7fb338007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.764+0000 7fb347fff700 1 -- 172.21.15.38:0/832664583 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3380116a0 con 0x7fb3480b2eb0 2020-06-12T17:48:34.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.764+0000 7fb34dff7700 1 --2- 172.21.15.38:0/832664583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3480b2eb0 0x7fb34814d490 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fb3480b61c0 tx=0x7fb338007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.764+0000 7fb347fff700 1 -- 172.21.15.38:0/832664583 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb338011800 con 0x7fb3480b2eb0 2020-06-12T17:48:34.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.764+0000 7fb34dff7700 1 --2- 172.21.15.38:0/832664583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3480b2eb0 0x7fb34814d490 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fb3480b61c0 tx=0x7fb338007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.764+0000 7fb347fff700 1 -- 172.21.15.38:0/832664583 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb338011b60 con 0x7fb3480b2eb0 2020-06-12T17:48:34.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.764+0000 7fb34fa5a700 1 -- 172.21.15.38:0/832664583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3480b2eb0 msgr2=0x7fb34814d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:34.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.764+0000 7fb34fa5a700 1 --2- 172.21.15.38:0/832664583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3480b2eb0 0x7fb34814d490 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7fb3480b61c0 tx=0x7fb338007e60).stop 2020-06-12T17:48:34.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.764+0000 7fb34fa5a700 1 -- 172.21.15.38:0/832664583 shutdown_connections 2020-06-12T17:48:34.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.764+0000 7fb34fa5a700 1 --2- 172.21.15.38:0/832664583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3480b2eb0 0x7fb34814d490 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:34.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.764+0000 7fb34fa5a700 1 -- 172.21.15.38:0/832664583 >> 172.21.15.38:0/832664583 conn(0x7fb3480b5a20 msgr2=0x7fb34805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:34.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.764+0000 7fb34fa5a700 1 -- 172.21.15.38:0/832664583 shutdown_connections 2020-06-12T17:48:34.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.764+0000 7fb34fa5a700 1 -- 172.21.15.38:0/832664583 wait complete. 2020-06-12T17:48:34.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.765+0000 7fb34fa5a700 1 Processor -- start 2020-06-12T17:48:34.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.765+0000 7fb34fa5a700 1 -- start start 2020-06-12T17:48:34.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.766+0000 7fb34fa5a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb3480ad5b0 0x7fb348065ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:34.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.766+0000 7fb34fa5a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb348146680 0x7fb348156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:34.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.766+0000 7fb34fa5a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb348066100 con 0x7fb3480b2eb0 2020-06-12T17:48:34.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.766+0000 7fb34fa5a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb348153ce0 con 0x7fb3480ad5b0 2020-06-12T17:48:34.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.766+0000 7fb34fa5a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb348153f80 con 0x7fb348146680 2020-06-12T17:48:34.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.766+0000 7fb34d7f6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb3480ad5b0 0x7fb348065ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:34.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.766+0000 7fb34dff7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb348146680 0x7fb348156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:34.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.766+0000 7fb34dff7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb348146680 0x7fb348156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:55744/0 (socket says 172.21.15.38:55744) 2020-06-12T17:48:34.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.766+0000 7fb34dff7700 1 -- 172.21.15.38:0/4213480538 learned_addr learned my addr 172.21.15.38:0/4213480538 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:34.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.767+0000 7fb34dff7700 1 -- 172.21.15.38:0/4213480538 >> v2:172.21.15.150:3300/0 conn(0x7fb3480ad5b0 msgr2=0x7fb348065ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:34.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.767+0000 7fb34dff7700 1 --2- 172.21.15.38:0/4213480538 >> v2:172.21.15.150:3300/0 conn(0x7fb3480ad5b0 0x7fb348065ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:34.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.767+0000 7fb34dff7700 1 -- 172.21.15.38:0/4213480538 >> v1:172.21.15.150:6789/0 conn(0x7fb3480b2eb0 legacy=0x7fb3481533d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:34.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.767+0000 7fb34dff7700 1 -- 172.21.15.38:0/4213480538 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb348154220 con 0x7fb348146680 2020-06-12T17:48:34.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.767+0000 7fb34dff7700 1 --2- 172.21.15.38:0/4213480538 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb348146680 0x7fb348156af0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb3480b61c0 tx=0x7fb338007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.767+0000 7fb34dff7700 1 --2- 172.21.15.38:0/4213480538 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb348146680 0x7fb348156af0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb3480b61c0 tx=0x7fb338007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.767+0000 7fb34dff7700 1 --2- 172.21.15.38:0/4213480538 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb348146680 0x7fb348156af0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7fb3480b61c0 tx=0x7fb338007e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:34.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.767+0000 7fb34dff7700 1 --2- 172.21.15.38:0/4213480538 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb348146680 0x7fb348156af0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fb3480b61c0 tx=0x7fb338007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.767+0000 7fb3467fc700 1 -- 172.21.15.38:0/4213480538 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb338011e30 con 0x7fb348146680 2020-06-12T17:48:34.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.767+0000 7fb34dff7700 1 --2- 172.21.15.38:0/4213480538 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb348146680 0x7fb348156af0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fb3480b61c0 tx=0x7fb338007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.767+0000 7fb3467fc700 1 -- 172.21.15.38:0/4213480538 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb338007340 con 0x7fb348146680 2020-06-12T17:48:34.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.767+0000 7fb34dff7700 1 --2- 172.21.15.38:0/4213480538 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb348146680 0x7fb348156af0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fb3480b61c0 tx=0x7fb338007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.767+0000 7fb3467fc700 1 -- 172.21.15.38:0/4213480538 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3380056c0 con 0x7fb348146680 2020-06-12T17:48:34.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.767+0000 7fb34fa5a700 1 -- 172.21.15.38:0/4213480538 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3480b0c30 con 0x7fb348146680 2020-06-12T17:48:34.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.767+0000 7fb34fa5a700 1 -- 172.21.15.38:0/4213480538 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb348157190 con 0x7fb348146680 2020-06-12T17:48:34.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.768+0000 7fb34dff7700 1 --2- 172.21.15.38:0/4213480538 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb348146680 0x7fb348156af0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fb3480b61c0 tx=0x7fb338007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.768+0000 7fb34fa5a700 1 -- 172.21.15.38:0/4213480538 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb348056c30 con 0x7fb348146680 2020-06-12T17:48:34.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.768+0000 7fb3467fc700 1 -- 172.21.15.38:0/4213480538 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fb338005980 con 0x7fb348146680 2020-06-12T17:48:34.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.768+0000 7fb34dff7700 1 --2- 172.21.15.38:0/4213480538 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb348146680 0x7fb348156af0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fb3480b61c0 tx=0x7fb338007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.768+0000 7fb3467fc700 1 --2- 172.21.15.38:0/4213480538 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb32804d560 0x7fb32804fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:34.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.768+0000 7fb3467fc700 1 -- 172.21.15.38:0/4213480538 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fb338061620 con 0x7fb348146680 2020-06-12T17:48:34.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.769+0000 7fb34d7f6700 1 --2- 172.21.15.38:0/4213480538 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb32804d560 0x7fb32804fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:34.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.769+0000 7fb34d7f6700 1 --2- 172.21.15.38:0/4213480538 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb32804d560 0x7fb32804fa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb3400022d0 tx=0x7fb340002ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.769+0000 7fb34d7f6700 1 --2- 172.21.15.38:0/4213480538 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb32804d560 0x7fb32804fa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb3400022d0 tx=0x7fb340002ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.769+0000 7fb34d7f6700 1 --2- 172.21.15.38:0/4213480538 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb32804d560 0x7fb32804fa20 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7fb3400022d0 tx=0x7fb340002ab0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:34.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.772+0000 7fb34dff7700 1 --2- 172.21.15.38:0/4213480538 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb348146680 0x7fb348156af0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fb3480b61c0 tx=0x7fb338007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.772+0000 7fb3467fc700 1 -- 172.21.15.38:0/4213480538 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fb33803cdc0 con 0x7fb348146680 2020-06-12T17:48:34.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.922+0000 7fb34fa5a700 1 -- 172.21.15.38:0/4213480538 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb34805a5e0 con 0x7fb348146680 2020-06-12T17:48:34.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.923+0000 7fb34dff7700 1 --2- 172.21.15.38:0/4213480538 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb348146680 0x7fb348156af0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fb3480b61c0 tx=0x7fb338007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:34.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.923+0000 7fb3467fc700 1 -- 172.21.15.38:0/4213480538 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb3380403e0 con 0x7fb348146680 2020-06-12T17:48:34.927 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:34.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.924+0000 7fb34fa5a700 1 -- 172.21.15.38:0/4213480538 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb32804d560 msgr2=0x7fb32804fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:34.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.924+0000 7fb34fa5a700 1 --2- 172.21.15.38:0/4213480538 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb32804d560 0x7fb32804fa20 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7fb3400022d0 tx=0x7fb340002ab0).stop 2020-06-12T17:48:34.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.925+0000 7fb34fa5a700 1 -- 172.21.15.38:0/4213480538 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb348146680 msgr2=0x7fb348156af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:34.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.925+0000 7fb34fa5a700 1 --2- 172.21.15.38:0/4213480538 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb348146680 0x7fb348156af0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7fb3480b61c0 tx=0x7fb338007e60).stop 2020-06-12T17:48:34.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.925+0000 7fb34fa5a700 1 -- 172.21.15.38:0/4213480538 shutdown_connections 2020-06-12T17:48:34.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.925+0000 7fb34fa5a700 1 --2- 172.21.15.38:0/4213480538 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb32804d560 0x7fb32804fa20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:34.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.925+0000 7fb34fa5a700 1 --2- 172.21.15.38:0/4213480538 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb348146680 0x7fb348156af0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:34.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.925+0000 7fb34fa5a700 1 --2- 172.21.15.38:0/4213480538 >> v2:172.21.15.150:3300/0 conn(0x7fb3480ad5b0 0x7fb348065ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:34.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.925+0000 7fb34fa5a700 1 -- 172.21.15.38:0/4213480538 >> 172.21.15.38:0/4213480538 conn(0x7fb3480b5a20 msgr2=0x7fb34809b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:34.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.925+0000 7fb34fa5a700 1 -- 172.21.15.38:0/4213480538 shutdown_connections 2020-06-12T17:48:34.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:34.925+0000 7fb34fa5a700 1 -- 172.21.15.38:0/4213480538 wait complete. 2020-06-12T17:48:34.938 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-06-12T17:48:35.055 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.052+0000 7fd309d4f700 1 Processor -- start 2020-06-12T17:48:35.056 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.052+0000 7fd309d4f700 1 -- start start 2020-06-12T17:48:35.058 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.052+0000 7fd309d4f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd3040ad5b0 0x7fd3040b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:35.058 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.052+0000 7fd309d4f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd30409d8d0 0x7fd3041421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:35.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.052+0000 7fd309d4f700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd304146d20 con 0x7fd304146680 2020-06-12T17:48:35.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.053+0000 7fd309d4f700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd304066a80 con 0x7fd30409d8d0 2020-06-12T17:48:35.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.053+0000 7fd309d4f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd304146f50 con 0x7fd3040ad5b0 2020-06-12T17:48:35.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.053+0000 7fd303fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd30409d8d0 0x7fd3041421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:35.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.053+0000 7fd3037fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd304146680 0x7fd30409d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38106/0 (socket says 172.21.15.38:38106) 2020-06-12T17:48:35.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.053+0000 7fd3037fe700 1 -- 172.21.15.38:0/2304623830 learned_addr learned my addr 172.21.15.38:0/2304623830 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:35.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.053+0000 7fd302ffd700 1 --2- 172.21.15.38:0/2304623830 >> v2:172.21.15.150:3300/0 conn(0x7fd3040ad5b0 0x7fd3040b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:35.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.053+0000 7fd303fff700 1 -- 172.21.15.38:0/2304623830 >> v2:172.21.15.150:3300/0 conn(0x7fd3040ad5b0 msgr2=0x7fd3040b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:35.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.053+0000 7fd303fff700 1 --2- 172.21.15.38:0/2304623830 >> v2:172.21.15.150:3300/0 conn(0x7fd3040ad5b0 0x7fd3040b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:35.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.053+0000 7fd303fff700 1 -- 172.21.15.38:0/2304623830 >> v1:172.21.15.38:6789/0 conn(0x7fd304146680 legacy=0x7fd30409d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:35.061 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.053+0000 7fd3027fc700 1 -- 172.21.15.38:0/2304623830 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3233488415 0 0) 0x7fd304146d20 con 0x7fd304146680 2020-06-12T17:48:35.061 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.053+0000 7fd303fff700 1 -- 172.21.15.38:0/2304623830 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd304146a60 con 0x7fd30409d8d0 2020-06-12T17:48:35.061 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.053+0000 7fd303fff700 1 --2- 172.21.15.38:0/2304623830 >> v2:172.21.15.38:3300/0 conn(0x7fd30409d8d0 0x7fd3041421d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd2f4002f30 tx=0x7fd2f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.061 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.053+0000 7fd303fff700 1 --2- 172.21.15.38:0/2304623830 >> v2:172.21.15.38:3300/0 conn(0x7fd30409d8d0 0x7fd3041421d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd2f4002f30 tx=0x7fd2f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.061 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.053+0000 7fd303fff700 1 --2- 172.21.15.38:0/2304623830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd30409d8d0 0x7fd3041421d0 secure :-1 s=READY pgs=228 cs=0 l=1 rx=0x7fd2f4002f30 tx=0x7fd2f4007e60).ready entity=mon.0 client_cookie=4eddcee8cd0061d9 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:35.062 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.053+0000 7fd303fff700 1 --2- 172.21.15.38:0/2304623830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd30409d8d0 0x7fd3041421d0 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7fd2f4002f30 tx=0x7fd2f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.062 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.053+0000 7fd3027fc700 1 -- 172.21.15.38:0/2304623830 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2f4011430 con 0x7fd30409d8d0 2020-06-12T17:48:35.062 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.053+0000 7fd303fff700 1 --2- 172.21.15.38:0/2304623830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd30409d8d0 0x7fd3041421d0 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7fd2f4002f30 tx=0x7fd2f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.062 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.053+0000 7fd303fff700 1 --2- 172.21.15.38:0/2304623830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd30409d8d0 0x7fd3041421d0 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7fd2f4002f30 tx=0x7fd2f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.062 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.053+0000 7fd3027fc700 1 -- 172.21.15.38:0/2304623830 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f4011590 con 0x7fd30409d8d0 2020-06-12T17:48:35.063 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.053+0000 7fd3027fc700 1 -- 172.21.15.38:0/2304623830 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2f4011930 con 0x7fd30409d8d0 2020-06-12T17:48:35.063 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.053+0000 7fd309d4f700 1 -- 172.21.15.38:0/2304623830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd30409d8d0 msgr2=0x7fd3041421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:35.063 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.053+0000 7fd309d4f700 1 --2- 172.21.15.38:0/2304623830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd30409d8d0 0x7fd3041421d0 secure :-1 s=READY pgs=228 cs=0 l=1 rx=0x7fd2f4002f30 tx=0x7fd2f4007e60).stop 2020-06-12T17:48:35.063 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.054+0000 7fd309d4f700 1 -- 172.21.15.38:0/2304623830 shutdown_connections 2020-06-12T17:48:35.063 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.054+0000 7fd309d4f700 1 --2- 172.21.15.38:0/2304623830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd30409d8d0 0x7fd3041421d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:35.063 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.054+0000 7fd309d4f700 1 --2- 172.21.15.38:0/2304623830 >> v2:172.21.15.150:3300/0 conn(0x7fd3040ad5b0 0x7fd3040b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:35.064 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.054+0000 7fd309d4f700 1 -- 172.21.15.38:0/2304623830 >> 172.21.15.38:0/2304623830 conn(0x7fd3040b5a20 msgr2=0x7fd30405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:35.064 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.054+0000 7fd309d4f700 1 -- 172.21.15.38:0/2304623830 shutdown_connections 2020-06-12T17:48:35.064 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.054+0000 7fd309d4f700 1 -- 172.21.15.38:0/2304623830 wait complete. 2020-06-12T17:48:35.064 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.055+0000 7fd309d4f700 1 Processor -- start 2020-06-12T17:48:35.064 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.055+0000 7fd309d4f700 1 -- start start 2020-06-12T17:48:35.077 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.056+0000 7fd309d4f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd304146680 0x7fd304062460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:35.077 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.056+0000 7fd309d4f700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd304062970 con 0x7fd30409d8d0 2020-06-12T17:48:35.077 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.056+0000 7fd309d4f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd304062c10 con 0x7fd3040ad5b0 2020-06-12T17:48:35.077 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.056+0000 7fd309d4f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd304062eb0 con 0x7fd304146680 2020-06-12T17:48:35.078 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.056+0000 7fd3037fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd30409d8d0 0x7fd3040b3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38112/0 (socket says 172.21.15.38:38112) 2020-06-12T17:48:35.078 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.056+0000 7fd3037fe700 1 -- 172.21.15.38:0/202488039 learned_addr learned my addr 172.21.15.38:0/202488039 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:35.078 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.056+0000 7fd303fff700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd304146680 0x7fd304062460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:35.078 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.056+0000 7fd300ff9700 1 -- 172.21.15.38:0/202488039 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126455756 0 0) 0x7fd304062970 con 0x7fd30409d8d0 2020-06-12T17:48:35.078 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.056+0000 7fd300ff9700 1 -- 172.21.15.38:0/202488039 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2e8002fe0 con 0x7fd30409d8d0 2020-06-12T17:48:35.079 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.056+0000 7fd300ff9700 1 -- 172.21.15.38:0/202488039 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 143678450 0 0) 0x7fd2e8002fe0 con 0x7fd30409d8d0 2020-06-12T17:48:35.079 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.056+0000 7fd300ff9700 1 -- 172.21.15.38:0/202488039 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd304062970 con 0x7fd30409d8d0 2020-06-12T17:48:35.079 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.056+0000 7fd300ff9700 1 -- 172.21.15.38:0/202488039 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fd2fc001be0 con 0x7fd30409d8d0 2020-06-12T17:48:35.079 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.056+0000 7fd300ff9700 1 -- 172.21.15.38:0/202488039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd304146680 msgr2=0x7fd304062460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:35.080 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.056+0000 7fd300ff9700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd304146680 0x7fd304062460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:35.081 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.056+0000 7fd300ff9700 1 -- 172.21.15.38:0/202488039 >> v1:172.21.15.150:6789/0 conn(0x7fd3040ad5b0 legacy=0x7fd3040aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:35.081 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.056+0000 7fd300ff9700 1 -- 172.21.15.38:0/202488039 >> v1:172.21.15.38:6789/0 conn(0x7fd30409d8d0 legacy=0x7fd3040b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:35.081 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.056+0000 7fd300ff9700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd304146680 0x7fd2e80049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:35.082 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.056+0000 7fd300ff9700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2e8004e10 0x7fd2e8005230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:35.082 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.056+0000 7fd300ff9700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e80039e0 0x7fd2e8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:35.082 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.056+0000 7fd300ff9700 1 -- 172.21.15.38:0/202488039 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd304062eb0 con 0x7fd2e80039e0 2020-06-12T17:48:35.082 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.056+0000 7fd300ff9700 1 -- 172.21.15.38:0/202488039 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e80043e0 con 0x7fd2e8004e10 2020-06-12T17:48:35.082 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.056+0000 7fd300ff9700 1 -- 172.21.15.38:0/202488039 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e80045a0 con 0x7fd304146680 2020-06-12T17:48:35.083 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.056+0000 7fd303fff700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e80039e0 0x7fd2e8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:35.083 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.056+0000 7fd3037fe700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd304146680 0x7fd2e80049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:35.083 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.056+0000 7fd302ffd700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2e8004e10 0x7fd2e8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:35.083 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.057+0000 7fd303fff700 1 -- 172.21.15.38:0/202488039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd304146680 msgr2=0x7fd2e80049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:35.083 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.057+0000 7fd303fff700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd304146680 0x7fd2e80049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:35.084 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.057+0000 7fd303fff700 1 -- 172.21.15.38:0/202488039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2e8004e10 msgr2=0x7fd2e8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:35.084 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.057+0000 7fd303fff700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2e8004e10 0x7fd2e8005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:35.084 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.057+0000 7fd303fff700 1 -- 172.21.15.38:0/202488039 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3040b3e50 con 0x7fd2e80039e0 2020-06-12T17:48:35.084 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.057+0000 7fd309d4f700 1 -- 172.21.15.38:0/202488039 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd304063350 con 0x7fd2e80039e0 2020-06-12T17:48:35.084 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.057+0000 7fd303fff700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e80039e0 0x7fd2e8003e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2f4002f30 tx=0x7fd2f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.057+0000 7fd309d4f700 1 -- 172.21.15.38:0/202488039 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3040626a0 con 0x7fd2e80039e0 2020-06-12T17:48:35.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.057+0000 7fd303fff700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e80039e0 0x7fd2e8003e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2f4002f30 tx=0x7fd2f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.057+0000 7fd303fff700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e80039e0 0x7fd2e8003e60 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7fd2f4002f30 tx=0x7fd2f4007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:35.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.057+0000 7fd303fff700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e80039e0 0x7fd2e8003e60 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7fd2f4002f30 tx=0x7fd2f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.057+0000 7fd300ff9700 1 -- 172.21.15.38:0/202488039 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2f400f840 con 0x7fd2e80039e0 2020-06-12T17:48:35.086 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.057+0000 7fd303fff700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e80039e0 0x7fd2e8003e60 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7fd2f4002f30 tx=0x7fd2f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.086 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.057+0000 7fd303fff700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e80039e0 0x7fd2e8003e60 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7fd2f4002f30 tx=0x7fd2f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.086 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.057+0000 7fd300ff9700 1 -- 172.21.15.38:0/202488039 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f4007150 con 0x7fd2e80039e0 2020-06-12T17:48:35.086 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.057+0000 7fd300ff9700 1 -- 172.21.15.38:0/202488039 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2f40074f0 con 0x7fd2e80039e0 2020-06-12T17:48:35.086 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.058+0000 7fd303fff700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e80039e0 0x7fd2e8003e60 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7fd2f4002f30 tx=0x7fd2f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.058+0000 7fd309d4f700 1 -- 172.21.15.38:0/202488039 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2dc003340 con 0x7fd2e80039e0 2020-06-12T17:48:35.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.058+0000 7fd300ff9700 1 -- 172.21.15.38:0/202488039 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fd2f40056c0 con 0x7fd2e80039e0 2020-06-12T17:48:35.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.058+0000 7fd303fff700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e80039e0 0x7fd2e8003e60 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7fd2f4002f30 tx=0x7fd2f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.058+0000 7fd300ff9700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd2e8055700 0x7fd2e8057bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:35.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.058+0000 7fd300ff9700 1 -- 172.21.15.38:0/202488039 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd2f40613f0 con 0x7fd2e80039e0 2020-06-12T17:48:35.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.059+0000 7fd3037fe700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd2e8055700 0x7fd2e8057bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:35.088 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.059+0000 7fd3037fe700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd2e8055700 0x7fd2e8057bc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2fc0058c0 tx=0x7fd2fc00ece0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.088 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.059+0000 7fd3037fe700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd2e8055700 0x7fd2e8057bc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2fc0058c0 tx=0x7fd2fc00ece0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.088 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.059+0000 7fd3037fe700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd2e8055700 0x7fd2e8057bc0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7fd2fc0058c0 tx=0x7fd2fc00ece0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:35.088 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.062+0000 7fd303fff700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e80039e0 0x7fd2e8003e60 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7fd2f4002f30 tx=0x7fd2f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.088 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.062+0000 7fd300ff9700 1 -- 172.21.15.38:0/202488039 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fd2f403cc10 con 0x7fd2e80039e0 2020-06-12T17:48:35.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.212+0000 7fd309d4f700 1 -- 172.21.15.38:0/202488039 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd2dc002200 con 0x7fd2e80039e0 2020-06-12T17:48:35.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.212+0000 7fd303fff700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e80039e0 0x7fd2e8003e60 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7fd2f4002f30 tx=0x7fd2f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.212+0000 7fd300ff9700 1 -- 172.21.15.38:0/202488039 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd2f4040230 con 0x7fd2e80039e0 2020-06-12T17:48:35.216 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:35.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.213+0000 7fd309d4f700 1 -- 172.21.15.38:0/202488039 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd2e8055700 msgr2=0x7fd2e8057bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:35.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.213+0000 7fd309d4f700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd2e8055700 0x7fd2e8057bc0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7fd2fc0058c0 tx=0x7fd2fc00ece0).stop 2020-06-12T17:48:35.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.213+0000 7fd309d4f700 1 -- 172.21.15.38:0/202488039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e80039e0 msgr2=0x7fd2e8003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:35.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.213+0000 7fd309d4f700 1 --2- 172.21.15.38:0/202488039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e80039e0 0x7fd2e8003e60 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7fd2f4002f30 tx=0x7fd2f4007e60).stop 2020-06-12T17:48:35.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.213+0000 7fd303fff700 1 -- 172.21.15.38:0/202488039 reap_dead start 2020-06-12T17:48:35.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.213+0000 7fd303fff700 1 -- 172.21.15.38:0/202488039 reap_dead start 2020-06-12T17:48:35.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.213+0000 7fd309d4f700 1 -- 172.21.15.38:0/202488039 shutdown_connections 2020-06-12T17:48:35.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.213+0000 7fd309d4f700 1 -- 172.21.15.38:0/202488039 >> 172.21.15.38:0/202488039 conn(0x7fd3040b5a20 msgr2=0x7fd304140d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:35.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.213+0000 7fd309d4f700 1 -- 172.21.15.38:0/202488039 shutdown_connections 2020-06-12T17:48:35.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.213+0000 7fd309d4f700 1 -- 172.21.15.38:0/202488039 wait complete. 2020-06-12T17:48:35.227 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-06-12T17:48:35.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.340+0000 7f5c33301700 1 Processor -- start 2020-06-12T17:48:35.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.340+0000 7f5c33301700 1 -- start start 2020-06-12T17:48:35.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.341+0000 7f5c33301700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5c2c0b15c0 0x7f5c2c0b2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:35.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.341+0000 7f5c33301700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c2c0b2900 con 0x7f5c2c0afc20 2020-06-12T17:48:35.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.341+0000 7f5c33301700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c2c0ae7d0 con 0x7f5c2c0b11e0 2020-06-12T17:48:35.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.341+0000 7f5c33301700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c2c0add30 con 0x7f5c2c0b15c0 2020-06-12T17:48:35.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.341+0000 7f5c32b00700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f5c2c0afc20 0x7f5c2c0b0090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38130/0 (socket says 172.21.15.38:38130) 2020-06-12T17:48:35.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.341+0000 7f5c32b00700 1 -- 172.21.15.38:0/1449494948 learned_addr learned my addr 172.21.15.38:0/1449494948 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:35.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.342+0000 7f5c31afe700 1 --2- 172.21.15.38:0/1449494948 >> v2:172.21.15.150:3300/0 conn(0x7f5c2c0b15c0 0x7f5c2c0b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:35.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.342+0000 7f5c312fd700 1 -- 172.21.15.38:0/1449494948 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1168560424 0 0) 0x7f5c2c0b2900 con 0x7f5c2c0afc20 2020-06-12T17:48:35.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.342+0000 7f5c312fd700 1 -- 172.21.15.38:0/1449494948 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c14003230 con 0x7f5c2c0afc20 2020-06-12T17:48:35.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.342+0000 7f5c31afe700 1 -- 172.21.15.38:0/1449494948 >> v1:172.21.15.150:6789/0 conn(0x7f5c2c0b11e0 legacy=0x7f5c2c0ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:35.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.342+0000 7f5c312fd700 1 -- 172.21.15.38:0/1449494948 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1360309208 0 0) 0x7f5c2c0ae7d0 con 0x7f5c2c0b11e0 2020-06-12T17:48:35.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.342+0000 7f5c31afe700 1 -- 172.21.15.38:0/1449494948 >> v1:172.21.15.38:6789/0 conn(0x7f5c2c0afc20 legacy=0x7f5c2c0b0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:35.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.342+0000 7f5c31afe700 1 -- 172.21.15.38:0/1449494948 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2c0b1ad0 con 0x7f5c2c0b15c0 2020-06-12T17:48:35.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.342+0000 7f5c31afe700 1 --2- 172.21.15.38:0/1449494948 >> v2:172.21.15.150:3300/0 conn(0x7f5c2c0b15c0 0x7f5c2c0b2380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5c24001b70 tx=0x7f5c20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.342+0000 7f5c31afe700 1 --2- 172.21.15.38:0/1449494948 >> v2:172.21.15.150:3300/0 conn(0x7f5c2c0b15c0 0x7f5c2c0b2380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5c24001b70 tx=0x7f5c20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.342+0000 7f5c31afe700 1 --2- 172.21.15.38:0/1449494948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c2c0b15c0 0x7f5c2c0b2380 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7f5c24001b70 tx=0x7f5c20007e60).ready entity=mon.1 client_cookie=bd6b39419f4e2291 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:35.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.342+0000 7f5c31afe700 1 --2- 172.21.15.38:0/1449494948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c2c0b15c0 0x7f5c2c0b2380 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f5c24001b70 tx=0x7f5c20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.342+0000 7f5c312fd700 1 -- 172.21.15.38:0/1449494948 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c240019d0 con 0x7f5c2c0b15c0 2020-06-12T17:48:35.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.342+0000 7f5c31afe700 1 --2- 172.21.15.38:0/1449494948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c2c0b15c0 0x7f5c2c0b2380 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f5c24001b70 tx=0x7f5c20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.342+0000 7f5c31afe700 1 --2- 172.21.15.38:0/1449494948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c2c0b15c0 0x7f5c2c0b2380 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f5c24001b70 tx=0x7f5c20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.342+0000 7f5c312fd700 1 -- 172.21.15.38:0/1449494948 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c20008950 con 0x7f5c2c0b15c0 2020-06-12T17:48:35.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.342+0000 7f5c312fd700 1 -- 172.21.15.38:0/1449494948 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c20008cb0 con 0x7f5c2c0b15c0 2020-06-12T17:48:35.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.342+0000 7f5c33301700 1 -- 172.21.15.38:0/1449494948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c2c0b15c0 msgr2=0x7f5c2c0b2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:35.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.342+0000 7f5c33301700 1 --2- 172.21.15.38:0/1449494948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c2c0b15c0 0x7f5c2c0b2380 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7f5c24001b70 tx=0x7f5c20007e60).stop 2020-06-12T17:48:35.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.343+0000 7f5c33301700 1 -- 172.21.15.38:0/1449494948 shutdown_connections 2020-06-12T17:48:35.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.343+0000 7f5c33301700 1 --2- 172.21.15.38:0/1449494948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c2c0b15c0 0x7f5c2c0b2380 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:35.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.343+0000 7f5c33301700 1 -- 172.21.15.38:0/1449494948 >> 172.21.15.38:0/1449494948 conn(0x7f5c2c0b4cc0 msgr2=0x7f5c2c0b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:35.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.343+0000 7f5c33301700 1 -- 172.21.15.38:0/1449494948 shutdown_connections 2020-06-12T17:48:35.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.343+0000 7f5c33301700 1 -- 172.21.15.38:0/1449494948 wait complete. 2020-06-12T17:48:35.356 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.344+0000 7f5c33301700 1 Processor -- start 2020-06-12T17:48:35.356 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.344+0000 7f5c33301700 1 -- start start 2020-06-12T17:48:35.356 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.345+0000 7f5c33301700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5c2c0afc20 0x7f5c2c13dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:35.356 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.345+0000 7f5c33301700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5c2c0b11e0 0x7f5c2c13e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:35.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.345+0000 7f5c33301700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c2c0b6f40 con 0x7f5c2c0b15c0 2020-06-12T17:48:35.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.345+0000 7f5c33301700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c2c0b7920 con 0x7f5c2c0b11e0 2020-06-12T17:48:35.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.345+0000 7f5c33301700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c2c0b71e0 con 0x7f5c2c0afc20 2020-06-12T17:48:35.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.345+0000 7f5c31afe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5c2c0b11e0 0x7f5c2c13e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:35.358 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.345+0000 7f5c31afe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5c2c0b11e0 0x7f5c2c13e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36318/0 (socket says 172.21.15.38:36318) 2020-06-12T17:48:35.358 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.345+0000 7f5c31afe700 1 -- 172.21.15.38:0/1342474546 learned_addr learned my addr 172.21.15.38:0/1342474546 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:35.358 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.345+0000 7f5c322ff700 1 --2- 172.21.15.38:0/1342474546 >> v2:172.21.15.150:3300/0 conn(0x7f5c2c0afc20 0x7f5c2c13dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:35.358 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.345+0000 7f5c31afe700 1 -- 172.21.15.38:0/1342474546 >> v2:172.21.15.150:3300/0 conn(0x7f5c2c0afc20 msgr2=0x7f5c2c13dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:35.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.345+0000 7f5c31afe700 1 --2- 172.21.15.38:0/1342474546 >> v2:172.21.15.150:3300/0 conn(0x7f5c2c0afc20 0x7f5c2c13dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:35.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.345+0000 7f5c31afe700 1 -- 172.21.15.38:0/1342474546 >> v1:172.21.15.150:6789/0 conn(0x7f5c2c0b15c0 legacy=0x7f5c2c153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:35.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.345+0000 7f5c31afe700 1 -- 172.21.15.38:0/1342474546 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2c0b7480 con 0x7f5c2c0b11e0 2020-06-12T17:48:35.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.345+0000 7f5c322ff700 1 --2- 172.21.15.38:0/1342474546 >> v2:172.21.15.150:3300/0 conn(0x7f5c2c0afc20 0x7f5c2c13dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:48:35.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.345+0000 7f5c31afe700 1 --2- 172.21.15.38:0/1342474546 >> v2:172.21.15.38:3300/0 conn(0x7f5c2c0b11e0 0x7f5c2c13e080 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5c2c0b3ef0 tx=0x7f5c20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.345+0000 7f5c31afe700 1 --2- 172.21.15.38:0/1342474546 >> v2:172.21.15.38:3300/0 conn(0x7f5c2c0b11e0 0x7f5c2c13e080 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5c2c0b3ef0 tx=0x7f5c20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.345+0000 7f5c31afe700 1 --2- 172.21.15.38:0/1342474546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c2c0b11e0 0x7f5c2c13e080 secure :-1 s=READY pgs=232 cs=0 l=1 rx=0x7f5c2c0b3ef0 tx=0x7f5c20007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:35.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.345+0000 7f5c31afe700 1 --2- 172.21.15.38:0/1342474546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c2c0b11e0 0x7f5c2c13e080 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7f5c2c0b3ef0 tx=0x7f5c20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.345+0000 7f5c1f7fe700 1 -- 172.21.15.38:0/1342474546 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c20011c30 con 0x7f5c2c0b11e0 2020-06-12T17:48:35.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.345+0000 7f5c31afe700 1 --2- 172.21.15.38:0/1342474546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c2c0b11e0 0x7f5c2c13e080 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7f5c2c0b3ef0 tx=0x7f5c20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.361 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.345+0000 7f5c33301700 1 -- 172.21.15.38:0/1342474546 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c2c144e80 con 0x7f5c2c0b11e0 2020-06-12T17:48:35.361 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.345+0000 7f5c1f7fe700 1 -- 172.21.15.38:0/1342474546 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c20011d90 con 0x7f5c2c0b11e0 2020-06-12T17:48:35.361 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.345+0000 7f5c31afe700 1 --2- 172.21.15.38:0/1342474546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c2c0b11e0 0x7f5c2c13e080 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7f5c2c0b3ef0 tx=0x7f5c20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.361 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.345+0000 7f5c1f7fe700 1 -- 172.21.15.38:0/1342474546 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c20007350 con 0x7f5c2c0b11e0 2020-06-12T17:48:35.361 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.345+0000 7f5c33301700 1 -- 172.21.15.38:0/1342474546 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c2c0b6d10 con 0x7f5c2c0b11e0 2020-06-12T17:48:35.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.346+0000 7f5c31afe700 1 --2- 172.21.15.38:0/1342474546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c2c0b11e0 0x7f5c2c13e080 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7f5c2c0b3ef0 tx=0x7f5c20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.346+0000 7f5c1f7fe700 1 -- 172.21.15.38:0/1342474546 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f5c20012060 con 0x7f5c2c0b11e0 2020-06-12T17:48:35.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.346+0000 7f5c31afe700 1 --2- 172.21.15.38:0/1342474546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c2c0b11e0 0x7f5c2c13e080 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7f5c2c0b3ef0 tx=0x7f5c20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.346+0000 7f5c33301700 1 -- 172.21.15.38:0/1342474546 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c2c056c30 con 0x7f5c2c0b11e0 2020-06-12T17:48:35.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.347+0000 7f5c1f7fe700 1 --2- 172.21.15.38:0/1342474546 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5c0c04f720 0x7f5c0c051be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:35.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.347+0000 7f5c1f7fe700 1 -- 172.21.15.38:0/1342474546 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f5c20061910 con 0x7f5c2c0b11e0 2020-06-12T17:48:35.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.347+0000 7f5c322ff700 1 --2- 172.21.15.38:0/1342474546 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5c0c04f720 0x7f5c0c051be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:35.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.347+0000 7f5c322ff700 1 --2- 172.21.15.38:0/1342474546 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5c0c04f720 0x7f5c0c051be0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5c28001190 tx=0x7f5c28001540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.347+0000 7f5c322ff700 1 --2- 172.21.15.38:0/1342474546 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5c0c04f720 0x7f5c0c051be0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5c28001190 tx=0x7f5c28001540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.347+0000 7f5c322ff700 1 --2- 172.21.15.38:0/1342474546 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5c0c04f720 0x7f5c0c051be0 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f5c28001190 tx=0x7f5c28001540).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:35.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.350+0000 7f5c31afe700 1 --2- 172.21.15.38:0/1342474546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c2c0b11e0 0x7f5c2c13e080 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7f5c2c0b3ef0 tx=0x7f5c20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.350+0000 7f5c1f7fe700 1 -- 172.21.15.38:0/1342474546 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f5c2003d050 con 0x7f5c2c0b11e0 2020-06-12T17:48:35.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.501+0000 7f5c33301700 1 -- 172.21.15.38:0/1342474546 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5c2c0b0d70 con 0x7f5c2c0b11e0 2020-06-12T17:48:35.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.502+0000 7f5c31afe700 1 --2- 172.21.15.38:0/1342474546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c2c0b11e0 0x7f5c2c13e080 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7f5c2c0b3ef0 tx=0x7f5c20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.506 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.502+0000 7f5c1f7fe700 1 -- 172.21.15.38:0/1342474546 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5c20040670 con 0x7f5c2c0b11e0 2020-06-12T17:48:35.506 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:35.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.503+0000 7f5c33301700 1 -- 172.21.15.38:0/1342474546 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5c0c04f720 msgr2=0x7f5c0c051be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:35.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.503+0000 7f5c33301700 1 --2- 172.21.15.38:0/1342474546 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5c0c04f720 0x7f5c0c051be0 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f5c28001190 tx=0x7f5c28001540).stop 2020-06-12T17:48:35.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.503+0000 7f5c33301700 1 -- 172.21.15.38:0/1342474546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c2c0b11e0 msgr2=0x7f5c2c13e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:35.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.503+0000 7f5c33301700 1 --2- 172.21.15.38:0/1342474546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c2c0b11e0 0x7f5c2c13e080 secure :-1 s=READY pgs=232 cs=0 l=1 rx=0x7f5c2c0b3ef0 tx=0x7f5c20007e60).stop 2020-06-12T17:48:35.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.503+0000 7f5c33301700 1 -- 172.21.15.38:0/1342474546 shutdown_connections 2020-06-12T17:48:35.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.503+0000 7f5c33301700 1 --2- 172.21.15.38:0/1342474546 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5c0c04f720 0x7f5c0c051be0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:35.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.503+0000 7f5c33301700 1 --2- 172.21.15.38:0/1342474546 >> v2:172.21.15.150:3300/0 conn(0x7f5c2c0afc20 0x7f5c2c13dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:35.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.503+0000 7f5c33301700 1 --2- 172.21.15.38:0/1342474546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c2c0b11e0 0x7f5c2c13e080 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:35.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.503+0000 7f5c33301700 1 -- 172.21.15.38:0/1342474546 >> 172.21.15.38:0/1342474546 conn(0x7f5c2c0b4cc0 msgr2=0x7f5c2c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:35.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.503+0000 7f5c33301700 1 -- 172.21.15.38:0/1342474546 shutdown_connections 2020-06-12T17:48:35.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.503+0000 7f5c33301700 1 -- 172.21.15.38:0/1342474546 wait complete. 2020-06-12T17:48:35.517 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-06-12T17:48:35.517 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-06-12T17:48:35.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.629+0000 7f1879920700 1 Processor -- start 2020-06-12T17:48:35.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.629+0000 7f1879920700 1 -- start start 2020-06-12T17:48:35.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.630+0000 7f1879920700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f18740b3550 0x7f187405bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:35.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.630+0000 7f1879920700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187405c380 con 0x7f1874143480 2020-06-12T17:48:35.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.630+0000 7f1879920700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18740b3b80 con 0x7f187409dd30 2020-06-12T17:48:35.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.630+0000 7f1879920700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1874061880 con 0x7f18740b3550 2020-06-12T17:48:35.637 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.630+0000 7f18727fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f18740b3550 0x7f187405bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:35.637 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.630+0000 7f18737fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f1874143480 0x7f18741438a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38142/0 (socket says 172.21.15.38:38142) 2020-06-12T17:48:35.637 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.630+0000 7f18727fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f18740b3550 0x7f187405bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36324/0 (socket says 172.21.15.38:36324) 2020-06-12T17:48:35.637 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.630+0000 7f18737fe700 1 -- 172.21.15.38:0/2856219560 learned_addr learned my addr 172.21.15.38:0/2856219560 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:35.638 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.630+0000 7f18727fc700 1 -- 172.21.15.38:0/2856219560 >> v1:172.21.15.150:6789/0 conn(0x7f187409dd30 legacy=0x7f1874061d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:35.638 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.630+0000 7f18727fc700 1 -- 172.21.15.38:0/2856219560 >> v1:172.21.15.38:6789/0 conn(0x7f1874143480 legacy=0x7f18741438a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:35.638 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.630+0000 7f18727fc700 1 -- 172.21.15.38:0/2856219560 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187409e110 con 0x7f18740b3550 2020-06-12T17:48:35.638 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.631+0000 7f18727fc700 1 --2- 172.21.15.38:0/2856219560 >> v2:172.21.15.38:3300/0 conn(0x7f18740b3550 0x7f187405bf20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f18640032b0 tx=0x7f18640081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.638 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.631+0000 7f18727fc700 1 --2- 172.21.15.38:0/2856219560 >> v2:172.21.15.38:3300/0 conn(0x7f18740b3550 0x7f187405bf20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f18640032b0 tx=0x7f18640081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.631+0000 7f18727fc700 1 --2- 172.21.15.38:0/2856219560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18740b3550 0x7f187405bf20 secure :-1 s=READY pgs=234 cs=0 l=1 rx=0x7f18640032b0 tx=0x7f18640081e0).ready entity=mon.0 client_cookie=80b8f783dc6036 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:35.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.631+0000 7f18727fc700 1 --2- 172.21.15.38:0/2856219560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18740b3550 0x7f187405bf20 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7f18640032b0 tx=0x7f18640081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.631+0000 7f1871ffb700 1 -- 172.21.15.38:0/2856219560 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1864011e90 con 0x7f18740b3550 2020-06-12T17:48:35.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.631+0000 7f18727fc700 1 --2- 172.21.15.38:0/2856219560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18740b3550 0x7f187405bf20 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7f18640032b0 tx=0x7f18640081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.631+0000 7f18727fc700 1 --2- 172.21.15.38:0/2856219560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18740b3550 0x7f187405bf20 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7f18640032b0 tx=0x7f18640081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.640 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.631+0000 7f1871ffb700 1 -- 172.21.15.38:0/2856219560 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186400a160 con 0x7f18740b3550 2020-06-12T17:48:35.640 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.631+0000 7f1871ffb700 1 -- 172.21.15.38:0/2856219560 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f186400a540 con 0x7f18740b3550 2020-06-12T17:48:35.640 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.631+0000 7f1879920700 1 -- 172.21.15.38:0/2856219560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18740b3550 msgr2=0x7f187405bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:35.640 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.631+0000 7f1879920700 1 --2- 172.21.15.38:0/2856219560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18740b3550 0x7f187405bf20 secure :-1 s=READY pgs=234 cs=0 l=1 rx=0x7f18640032b0 tx=0x7f18640081e0).stop 2020-06-12T17:48:35.640 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.631+0000 7f1879920700 1 -- 172.21.15.38:0/2856219560 shutdown_connections 2020-06-12T17:48:35.641 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.631+0000 7f1879920700 1 --2- 172.21.15.38:0/2856219560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18740b3550 0x7f187405bf20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:35.641 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.631+0000 7f1879920700 1 -- 172.21.15.38:0/2856219560 >> 172.21.15.38:0/2856219560 conn(0x7f18740b8420 msgr2=0x7f18740b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:35.641 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.631+0000 7f1879920700 1 -- 172.21.15.38:0/2856219560 shutdown_connections 2020-06-12T17:48:35.642 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.631+0000 7f1879920700 1 -- 172.21.15.38:0/2856219560 wait complete. 2020-06-12T17:48:35.642 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.632+0000 7f1879920700 1 Processor -- start 2020-06-12T17:48:35.642 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.632+0000 7f1879920700 1 -- start start 2020-06-12T17:48:35.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.633+0000 7f1879920700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f187409dd30 0x7f18740ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:35.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.633+0000 7f1879920700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f18740b3550 0x7f18740637d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:35.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.633+0000 7f1879920700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1874140230 con 0x7f1874143480 2020-06-12T17:48:35.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.633+0000 7f1879920700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1874063c30 con 0x7f18740b3550 2020-06-12T17:48:35.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.633+0000 7f1879920700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18741404d0 con 0x7f187409dd30 2020-06-12T17:48:35.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.633+0000 7f18727fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f18740b3550 0x7f18740637d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:35.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.633+0000 7f18727fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f18740b3550 0x7f18740637d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36330/0 (socket says 172.21.15.38:36330) 2020-06-12T17:48:35.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.633+0000 7f18727fc700 1 -- 172.21.15.38:0/3397099007 learned_addr learned my addr 172.21.15.38:0/3397099007 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:35.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.633+0000 7f1872ffd700 1 --2- 172.21.15.38:0/3397099007 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f187409dd30 0x7f18740ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:35.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.633+0000 7f18727fc700 1 -- 172.21.15.38:0/3397099007 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f187409dd30 msgr2=0x7f18740ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:35.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.633+0000 7f18727fc700 1 --2- 172.21.15.38:0/3397099007 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f187409dd30 0x7f18740ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:35.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.633+0000 7f18727fc700 1 -- 172.21.15.38:0/3397099007 >> v1:172.21.15.150:6789/0 conn(0x7f1874143480 legacy=0x7f18740b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:35.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.633+0000 7f18727fc700 1 -- 172.21.15.38:0/3397099007 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1874140770 con 0x7f18740b3550 2020-06-12T17:48:35.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.633+0000 7f1872ffd700 1 --2- 172.21.15.38:0/3397099007 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f187409dd30 0x7f18740ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:35.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.634+0000 7f18727fc700 1 --2- 172.21.15.38:0/3397099007 >> v2:172.21.15.38:3300/0 conn(0x7f18740b3550 0x7f18740637d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f18640032b0 tx=0x7f18640081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.634+0000 7f18727fc700 1 --2- 172.21.15.38:0/3397099007 >> v2:172.21.15.38:3300/0 conn(0x7f18740b3550 0x7f18740637d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f18640032b0 tx=0x7f18640081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.634+0000 7f18727fc700 1 --2- 172.21.15.38:0/3397099007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18740b3550 0x7f18740637d0 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7f18640032b0 tx=0x7f18640081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:35.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.634+0000 7f18727fc700 1 --2- 172.21.15.38:0/3397099007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18740b3550 0x7f18740637d0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f18640032b0 tx=0x7f18640081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.634+0000 7f1863fff700 1 -- 172.21.15.38:0/3397099007 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1864005c30 con 0x7f18740b3550 2020-06-12T17:48:35.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.634+0000 7f18727fc700 1 --2- 172.21.15.38:0/3397099007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18740b3550 0x7f18740637d0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f18640032b0 tx=0x7f18640081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.634+0000 7f18727fc700 1 --2- 172.21.15.38:0/3397099007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18740b3550 0x7f18740637d0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f18640032b0 tx=0x7f18640081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.634+0000 7f1863fff700 1 -- 172.21.15.38:0/3397099007 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1864005d90 con 0x7f18740b3550 2020-06-12T17:48:35.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.634+0000 7f1879920700 1 -- 172.21.15.38:0/3397099007 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18740b27a0 con 0x7f18740b3550 2020-06-12T17:48:35.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.634+0000 7f1863fff700 1 -- 172.21.15.38:0/3397099007 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f186400f760 con 0x7f18740b3550 2020-06-12T17:48:35.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.634+0000 7f1879920700 1 -- 172.21.15.38:0/3397099007 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f187413e6d0 con 0x7f18740b3550 2020-06-12T17:48:35.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.634+0000 7f18727fc700 1 --2- 172.21.15.38:0/3397099007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18740b3550 0x7f18740637d0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f18640032b0 tx=0x7f18640081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.635+0000 7f1879920700 1 -- 172.21.15.38:0/3397099007 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1874056c30 con 0x7f18740b3550 2020-06-12T17:48:35.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.635+0000 7f1863fff700 1 -- 172.21.15.38:0/3397099007 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f186400f9d0 con 0x7f18740b3550 2020-06-12T17:48:35.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.635+0000 7f18727fc700 1 --2- 172.21.15.38:0/3397099007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18740b3550 0x7f18740637d0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f18640032b0 tx=0x7f18640081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.635+0000 7f1863fff700 1 --2- 172.21.15.38:0/3397099007 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f185004d640 0x7f185004fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:35.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.635+0000 7f1863fff700 1 -- 172.21.15.38:0/3397099007 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f1864062020 con 0x7f18740b3550 2020-06-12T17:48:35.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.635+0000 7f1872ffd700 1 --2- 172.21.15.38:0/3397099007 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f185004d640 0x7f185004fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:35.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.636+0000 7f1872ffd700 1 --2- 172.21.15.38:0/3397099007 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f185004d640 0x7f185004fb00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1874060250 tx=0x7f18680016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.636+0000 7f1872ffd700 1 --2- 172.21.15.38:0/3397099007 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f185004d640 0x7f185004fb00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1874060250 tx=0x7f18680016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.636+0000 7f1872ffd700 1 --2- 172.21.15.38:0/3397099007 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f185004d640 0x7f185004fb00 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7f1874060250 tx=0x7f18680016e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:35.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.639+0000 7f18727fc700 1 --2- 172.21.15.38:0/3397099007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18740b3550 0x7f18740637d0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f18640032b0 tx=0x7f18640081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.639+0000 7f1863fff700 1 -- 172.21.15.38:0/3397099007 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f186403d840 con 0x7f18740b3550 2020-06-12T17:48:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.839+0000 7f1879920700 1 -- 172.21.15.38:0/3397099007 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f187409b370 con 0x7f18740b3550 2020-06-12T17:48:35.844 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.840+0000 7f18727fc700 1 --2- 172.21.15.38:0/3397099007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18740b3550 0x7f18740637d0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f18640032b0 tx=0x7f18640081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:35.844 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.840+0000 7f1863fff700 1 -- 172.21.15.38:0/3397099007 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2137 (secure 0 0 0) 0x7f1864040e60 con 0x7f18740b3550 2020-06-12T17:48:35.844 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:35.845 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1134306892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1134306892},{"type":"v1","addr":"172.21.15.150:6835","nonce":1134306892}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-06-12T17:48:14.851844+0000","modified":"2020-06-12T17:48:18.530885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4389":{"gid":4389,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.38:6833/4064318189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":4064318189},{"type":"v1","addr":"172.21.15.38:6833","nonce":4064318189}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-06-12T17:48:35.846 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.841+0000 7f1879920700 1 -- 172.21.15.38:0/3397099007 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f185004d640 msgr2=0x7f185004fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:35.846 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.841+0000 7f1879920700 1 --2- 172.21.15.38:0/3397099007 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f185004d640 0x7f185004fb00 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7f1874060250 tx=0x7f18680016e0).stop 2020-06-12T17:48:35.846 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.841+0000 7f1879920700 1 -- 172.21.15.38:0/3397099007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18740b3550 msgr2=0x7f18740637d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:35.846 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.841+0000 7f1879920700 1 --2- 172.21.15.38:0/3397099007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18740b3550 0x7f18740637d0 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7f18640032b0 tx=0x7f18640081e0).stop 2020-06-12T17:48:35.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.841+0000 7f1879920700 1 -- 172.21.15.38:0/3397099007 shutdown_connections 2020-06-12T17:48:35.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.841+0000 7f1879920700 1 --2- 172.21.15.38:0/3397099007 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f185004d640 0x7f185004fb00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:35.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.841+0000 7f1879920700 1 --2- 172.21.15.38:0/3397099007 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f187409dd30 0x7f18740ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:35.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.841+0000 7f1879920700 1 --2- 172.21.15.38:0/3397099007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18740b3550 0x7f18740637d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:35.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.841+0000 7f1879920700 1 -- 172.21.15.38:0/3397099007 >> 172.21.15.38:0/3397099007 conn(0x7f18740b8420 msgr2=0x7f18740b6320 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:35.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.841+0000 7f1879920700 1 -- 172.21.15.38:0/3397099007 shutdown_connections 2020-06-12T17:48:35.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:35.841+0000 7f1879920700 1 -- 172.21.15.38:0/3397099007 wait complete. 2020-06-12T17:48:35.848 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 6 2020-06-12T17:48:36.056 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-06-12T17:48:14.851844+0000', 'modified': '2020-06-12T17:48:18.530885+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4389}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4389': {'gid': 4389, 'name': 'a', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.38:6833/4064318189', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6832', 'nonce': 4064318189}, {'type': 'v1', 'addr': '172.21.15.38:6833', 'nonce': 4064318189}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292836696063, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-06-12T17:48:36.057 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-06-12T17:48:36.058 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-06-12T17:48:36.186 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2020-06-12T17:48:36.187 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "8e42a2e7-b187-42c4-a73f-8f812ee62352", 2020-06-12T17:48:36.187 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2020-06-12T17:48:36.187 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 4389, 2020-06-12T17:48:36.188 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2020-06-12T17:48:36.188 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2020-06-12T17:48:36.188 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 18.65324416, 2020-06-12T17:48:36.188 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 6, 2020-06-12T17:48:36.188 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 24, 2020-06-12T17:48:36.189 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 24, 2020-06-12T17:48:36.189 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 18.929222453000001 2020-06-12T17:48:36.189 INFO:teuthology.orchestra.run.smithi038.stdout:} 2020-06-12T17:48:36.195 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "8e42a2e7-b187-42c4-a73f-8f812ee62352", "whoami": 0, "id": 4389, "want_state": "up:active", "state": "up:active", "rank_uptime": 18.65324416, "mdsmap_epoch": 6, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "uptime": 18.929222453000001 } 2020-06-12T17:48:36.195 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-06-12T17:48:36.196 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2020-06-12T17:48:36.196 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.2 at ubuntu@smithi150.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2... 2020-06-12T17:48:36.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:36.197 INFO:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.2) 2020-06-12T17:48:36.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:36.215 INFO:teuthology.orchestra.run.smithi150:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-06-12T17:48:36.286 INFO:teuthology.orchestra.run.smithi150.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2020-06-12T17:48:36.287 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-06-12T17:48:36.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:36.288 INFO:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2020-06-12T17:48:36.343 INFO:teuthology.orchestra.run.smithi150.stderr:ls: cannot access '/sys/fs/fuse/connections': No such file or directory 2020-06-12T17:48:36.343 DEBUG:teuthology.orchestra.run:got remote process result: 2 2020-06-12T17:48:36.344 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-06-12T17:48:36.344 INFO:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.2 /home/ubuntu/cephtest/mnt.2) 2020-06-12T17:48:36.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:36.386 INFO:teuthology.orchestra.run.smithi150:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-06-12T17:48:36.415 INFO:teuthology.orchestra.run.smithi150.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2020-06-12T17:48:36.416 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-06-12T17:48:36.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:36.417 INFO:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2020-06-12T17:48:36.467 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi150.stderr:2020-06-12T17:48:36.463+0000 7fe2c1a101c0 -1 init, newargv = 0x5604dbda8ad0 newargc=9 2020-06-12T17:48:36.468 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi150.stderr:ceph-fuse[31988]: starting ceph client 2020-06-12T17:48:36.472 INFO:teuthology.orchestra.run.smithi150.stderr:ls: cannot access '/sys/fs/fuse/connections': No such file or directory 2020-06-12T17:48:36.472 DEBUG:teuthology.orchestra.run:got remote process result: 2 2020-06-12T17:48:36.507 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi150.stderr:ceph-fuse[31988]: starting fuse 2020-06-12T17:48:37.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:37.575 INFO:teuthology.orchestra.run.smithi150:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-06-12T17:48:37.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:37.610 INFO:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2020-06-12T17:48:37.665 INFO:teuthology.orchestra.run.smithi150.stdout:46 2020-06-12T17:48:37.666 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2020-06-12T17:48:37.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:37.666 INFO:teuthology.orchestra.run.smithi150:> sudo python3 -c ' 2020-06-12T17:48:37.667 INFO:teuthology.orchestra.run.smithi150:> import glob 2020-06-12T17:48:37.667 INFO:teuthology.orchestra.run.smithi150:> import re 2020-06-12T17:48:37.667 INFO:teuthology.orchestra.run.smithi150:> import os 2020-06-12T17:48:37.668 INFO:teuthology.orchestra.run.smithi150:> import subprocess 2020-06-12T17:48:37.668 INFO:teuthology.orchestra.run.smithi150:> 2020-06-12T17:48:37.668 INFO:teuthology.orchestra.run.smithi150:> def find_socket(client_name): 2020-06-12T17:48:37.669 INFO:teuthology.orchestra.run.smithi150:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2020-06-12T17:48:37.669 INFO:teuthology.orchestra.run.smithi150:> files = glob.glob(asok_path) 2020-06-12T17:48:37.669 INFO:teuthology.orchestra.run.smithi150:> 2020-06-12T17:48:37.670 INFO:teuthology.orchestra.run.smithi150:> # Given a non-glob path, it better be there 2020-06-12T17:48:37.670 INFO:teuthology.orchestra.run.smithi150:> if "*" not in asok_path: 2020-06-12T17:48:37.670 INFO:teuthology.orchestra.run.smithi150:> assert(len(files) == 1) 2020-06-12T17:48:37.671 INFO:teuthology.orchestra.run.smithi150:> return files[0] 2020-06-12T17:48:37.671 INFO:teuthology.orchestra.run.smithi150:> 2020-06-12T17:48:37.671 INFO:teuthology.orchestra.run.smithi150:> for f in files: 2020-06-12T17:48:37.672 INFO:teuthology.orchestra.run.smithi150:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-06-12T17:48:37.672 INFO:teuthology.orchestra.run.smithi150:> if os.path.exists("/proc/{0}".format(pid)): 2020-06-12T17:48:37.672 INFO:teuthology.orchestra.run.smithi150:> return f 2020-06-12T17:48:37.673 INFO:teuthology.orchestra.run.smithi150:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-06-12T17:48:37.673 INFO:teuthology.orchestra.run.smithi150:> 2020-06-12T17:48:37.673 INFO:teuthology.orchestra.run.smithi150:> print(find_socket("client.2")) 2020-06-12T17:48:37.673 INFO:teuthology.orchestra.run.smithi150:> ' 2020-06-12T17:48:37.762 INFO:teuthology.orchestra.run.smithi150.stdout:/var/run/ceph/ceph-client.2.31988.asok 2020-06-12T17:48:37.767 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.31988.asok 2020-06-12T17:48:37.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:37.768 INFO:teuthology.orchestra.run.smithi150:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.31988.asok status 2020-06-12T17:48:37.882 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2020-06-12T17:48:37.883 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": { 2020-06-12T17:48:37.883 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_sha1": "91d24f498556f86f6d1318d2efd5210c35b36762", 2020-06-12T17:48:37.883 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_version": "ceph version 15.2.3-196-g91d24f4 (91d24f498556f86f6d1318d2efd5210c35b36762) octopus (stable)", 2020-06-12T17:48:37.883 INFO:teuthology.orchestra.run.smithi150.stdout: "entity_id": "2", 2020-06-12T17:48:37.883 INFO:teuthology.orchestra.run.smithi150.stdout: "hostname": "smithi150", 2020-06-12T17:48:37.884 INFO:teuthology.orchestra.run.smithi150.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2020-06-12T17:48:37.884 INFO:teuthology.orchestra.run.smithi150.stdout: "pid": "31988", 2020-06-12T17:48:37.884 INFO:teuthology.orchestra.run.smithi150.stdout: "root": "/" 2020-06-12T17:48:37.884 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2020-06-12T17:48:37.884 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_count": 0, 2020-06-12T17:48:37.885 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_pinned_count": 0, 2020-06-12T17:48:37.885 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 4430, 2020-06-12T17:48:37.885 INFO:teuthology.orchestra.run.smithi150.stdout: "inst": { 2020-06-12T17:48:37.885 INFO:teuthology.orchestra.run.smithi150.stdout: "name": { 2020-06-12T17:48:37.885 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "client", 2020-06-12T17:48:37.886 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4430 2020-06-12T17:48:37.886 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2020-06-12T17:48:37.886 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2020-06-12T17:48:37.886 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2020-06-12T17:48:37.887 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:0", 2020-06-12T17:48:37.887 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 4253959510 2020-06-12T17:48:37.887 INFO:teuthology.orchestra.run.smithi150.stdout: } 2020-06-12T17:48:37.887 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2020-06-12T17:48:37.887 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2020-06-12T17:48:37.888 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2020-06-12T17:48:37.888 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:0", 2020-06-12T17:48:37.888 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 4253959510 2020-06-12T17:48:37.888 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2020-06-12T17:48:37.889 INFO:teuthology.orchestra.run.smithi150.stdout: "inst_str": "client.4430 172.21.15.150:0/4253959510", 2020-06-12T17:48:37.889 INFO:teuthology.orchestra.run.smithi150.stdout: "addr_str": "172.21.15.150:0/4253959510", 2020-06-12T17:48:37.889 INFO:teuthology.orchestra.run.smithi150.stdout: "inode_count": 1, 2020-06-12T17:48:37.889 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_epoch": 6, 2020-06-12T17:48:37.889 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch": 24, 2020-06-12T17:48:37.890 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch_barrier": 0, 2020-06-12T17:48:37.890 INFO:teuthology.orchestra.run.smithi150.stdout: "blacklisted": false 2020-06-12T17:48:37.890 INFO:teuthology.orchestra.run.smithi150.stdout:} 2020-06-12T17:48:37.892 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-12T17:48:38.020 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.016+0000 7f230514e700 1 Processor -- start 2020-06-12T17:48:38.020 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.016+0000 7f230514e700 1 -- start start 2020-06-12T17:48:38.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.017+0000 7f230514e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f23000623f0 0x7f23000b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:38.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.017+0000 7f230514e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f230005b410 0x7f230013c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:38.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.017+0000 7f230514e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f230009b920 con 0x7f230013c6b0 2020-06-12T17:48:38.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.017+0000 7f230514e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2300142530 con 0x7f23000623f0 2020-06-12T17:48:38.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.017+0000 7f230514e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2300061ef0 con 0x7f230005b410 2020-06-12T17:48:38.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.017+0000 7f22fed9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f23000623f0 0x7f23000b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:38.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.017+0000 7f22fed9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f23000623f0 0x7f23000b49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36336/0 (socket says 172.21.15.38:36336) 2020-06-12T17:48:38.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.017+0000 7f22fed9d700 1 -- 172.21.15.38:0/3637452026 learned_addr learned my addr 172.21.15.38:0/3637452026 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:38.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.018+0000 7f22fe59c700 1 --2- 172.21.15.38:0/3637452026 >> v2:172.21.15.150:3300/0 conn(0x7f230005b410 0x7f230013c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:38.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.018+0000 7f22fed9d700 1 -- 172.21.15.38:0/3637452026 >> v2:172.21.15.150:3300/0 conn(0x7f230005b410 msgr2=0x7f230013c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:38.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.018+0000 7f22fed9d700 1 --2- 172.21.15.38:0/3637452026 >> v2:172.21.15.150:3300/0 conn(0x7f230005b410 0x7f230013c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:38.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.018+0000 7f22fed9d700 1 -- 172.21.15.38:0/3637452026 >> v1:172.21.15.150:6789/0 conn(0x7f230013c6b0 legacy=0x7f23000617e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:38.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.018+0000 7f22fed9d700 1 -- 172.21.15.38:0/3637452026 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2300067250 con 0x7f23000623f0 2020-06-12T17:48:38.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.018+0000 7f22fed9d700 1 --2- 172.21.15.38:0/3637452026 >> v2:172.21.15.38:3300/0 conn(0x7f23000623f0 0x7f23000b49e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f22e8002f30 tx=0x7f22e8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.018+0000 7f22fed9d700 1 --2- 172.21.15.38:0/3637452026 >> v2:172.21.15.38:3300/0 conn(0x7f23000623f0 0x7f23000b49e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f22e8002f30 tx=0x7f22e8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.018+0000 7f22fed9d700 1 --2- 172.21.15.38:0/3637452026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23000623f0 0x7f23000b49e0 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7f22e8002f30 tx=0x7f22e8007e60).ready entity=mon.0 client_cookie=40fc75d179454aab server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:38.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.018+0000 7f22fed9d700 1 --2- 172.21.15.38:0/3637452026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23000623f0 0x7f23000b49e0 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f22e8002f30 tx=0x7f22e8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.018+0000 7f22fdd9b700 1 -- 172.21.15.38:0/3637452026 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22e8013840 con 0x7f23000623f0 2020-06-12T17:48:38.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.018+0000 7f22fed9d700 1 --2- 172.21.15.38:0/3637452026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23000623f0 0x7f23000b49e0 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f22e8002f30 tx=0x7f22e8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.018+0000 7f22fdd9b700 1 -- 172.21.15.38:0/3637452026 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e80139a0 con 0x7f23000623f0 2020-06-12T17:48:38.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.018+0000 7f22fed9d700 1 --2- 172.21.15.38:0/3637452026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23000623f0 0x7f23000b49e0 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f22e8002f30 tx=0x7f22e8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.018+0000 7f230514e700 1 -- 172.21.15.38:0/3637452026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23000623f0 msgr2=0x7f23000b49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:38.028 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.018+0000 7f22fdd9b700 1 -- 172.21.15.38:0/3637452026 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22e8013d80 con 0x7f23000623f0 2020-06-12T17:48:38.028 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.018+0000 7f230514e700 1 --2- 172.21.15.38:0/3637452026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23000623f0 0x7f23000b49e0 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7f22e8002f30 tx=0x7f22e8007e60).stop 2020-06-12T17:48:38.028 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.019+0000 7f230514e700 1 -- 172.21.15.38:0/3637452026 shutdown_connections 2020-06-12T17:48:38.028 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.019+0000 7f230514e700 1 --2- 172.21.15.38:0/3637452026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23000623f0 0x7f23000b49e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:38.028 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.019+0000 7f230514e700 1 --2- 172.21.15.38:0/3637452026 >> v2:172.21.15.150:3300/0 conn(0x7f230005b410 0x7f230013c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:38.028 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.019+0000 7f230514e700 1 -- 172.21.15.38:0/3637452026 >> 172.21.15.38:0/3637452026 conn(0x7f23000b8420 msgr2=0x7f23000b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:38.029 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.019+0000 7f230514e700 1 -- 172.21.15.38:0/3637452026 shutdown_connections 2020-06-12T17:48:38.029 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.019+0000 7f230514e700 1 -- 172.21.15.38:0/3637452026 wait complete. 2020-06-12T17:48:38.032 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.020+0000 7f230514e700 1 Processor -- start 2020-06-12T17:48:38.033 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.020+0000 7f230514e700 1 -- start start 2020-06-12T17:48:38.033 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.020+0000 7f230514e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f23000623f0 0x7f2300152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:38.033 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.020+0000 7f230514e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f230013c6b0 0x7f2300064650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:38.033 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.021+0000 7f230514e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f230013e460 con 0x7f230005b410 2020-06-12T17:48:38.034 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.021+0000 7f230514e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2300064ab0 con 0x7f230013c6b0 2020-06-12T17:48:38.034 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.021+0000 7f230514e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f230013e700 con 0x7f23000623f0 2020-06-12T17:48:38.034 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.021+0000 7f22fed9d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f230005b410 0x7f230013b9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38156/0 (socket says 172.21.15.38:38156) 2020-06-12T17:48:38.034 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.021+0000 7f22fed9d700 1 -- 172.21.15.38:0/1590483411 learned_addr learned my addr 172.21.15.38:0/1590483411 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:38.034 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.021+0000 7f22ff59e700 1 --2- 172.21.15.38:0/1590483411 >> v2:172.21.15.38:3300/0 conn(0x7f230013c6b0 0x7f2300064650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:38.035 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.021+0000 7f22fe59c700 1 --2- 172.21.15.38:0/1590483411 >> v2:172.21.15.150:3300/0 conn(0x7f23000623f0 0x7f2300152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:38.035 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.021+0000 7f22f7fff700 1 -- 172.21.15.38:0/1590483411 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703882449 0 0) 0x7f230013e460 con 0x7f230005b410 2020-06-12T17:48:38.035 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.021+0000 7f22f7fff700 1 -- 172.21.15.38:0/1590483411 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22e4002fe0 con 0x7f230005b410 2020-06-12T17:48:38.035 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.021+0000 7f22ff59e700 1 -- 172.21.15.38:0/1590483411 >> v2:172.21.15.150:3300/0 conn(0x7f23000623f0 msgr2=0x7f2300152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:38.036 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.021+0000 7f22ff59e700 1 --2- 172.21.15.38:0/1590483411 >> v2:172.21.15.150:3300/0 conn(0x7f23000623f0 0x7f2300152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:38.036 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.021+0000 7f22ff59e700 1 -- 172.21.15.38:0/1590483411 >> v1:172.21.15.38:6789/0 conn(0x7f230005b410 legacy=0x7f230013b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:38.036 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.021+0000 7f22ff59e700 1 -- 172.21.15.38:0/1590483411 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230013e9a0 con 0x7f230013c6b0 2020-06-12T17:48:38.036 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.021+0000 7f22fe59c700 1 --2- 172.21.15.38:0/1590483411 >> v2:172.21.15.150:3300/0 conn(0x7f23000623f0 0x7f2300152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:38.037 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.021+0000 7f22ff59e700 1 --2- 172.21.15.38:0/1590483411 >> v2:172.21.15.38:3300/0 conn(0x7f230013c6b0 0x7f2300064650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f230009bf00 tx=0x7f22f8001a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.037 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.021+0000 7f22ff59e700 1 --2- 172.21.15.38:0/1590483411 >> v2:172.21.15.38:3300/0 conn(0x7f230013c6b0 0x7f2300064650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f230009bf00 tx=0x7f22f8001a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.037 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.021+0000 7f22ff59e700 1 --2- 172.21.15.38:0/1590483411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f230013c6b0 0x7f2300064650 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7f230009bf00 tx=0x7f22f8001a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:38.037 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.021+0000 7f22ff59e700 1 --2- 172.21.15.38:0/1590483411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f230013c6b0 0x7f2300064650 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f230009bf00 tx=0x7f22f8001a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.038 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.021+0000 7f22f7fff700 1 -- 172.21.15.38:0/1590483411 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22f8013060 con 0x7f230013c6b0 2020-06-12T17:48:38.038 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.021+0000 7f22ff59e700 1 --2- 172.21.15.38:0/1590483411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f230013c6b0 0x7f2300064650 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f230009bf00 tx=0x7f22f8001a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.038 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.021+0000 7f230514e700 1 -- 172.21.15.38:0/1590483411 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f230013e0e0 con 0x7f230013c6b0 2020-06-12T17:48:38.038 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.021+0000 7f22f7fff700 1 -- 172.21.15.38:0/1590483411 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f8002220 con 0x7f230013c6b0 2020-06-12T17:48:38.038 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.021+0000 7f22ff59e700 1 --2- 172.21.15.38:0/1590483411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f230013c6b0 0x7f2300064650 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f230009bf00 tx=0x7f22f8001a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.039 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.021+0000 7f22f7fff700 1 -- 172.21.15.38:0/1590483411 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22f8002640 con 0x7f230013c6b0 2020-06-12T17:48:38.039 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.021+0000 7f230514e700 1 -- 172.21.15.38:0/1590483411 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2300063040 con 0x7f230013c6b0 2020-06-12T17:48:38.039 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.022+0000 7f22ff59e700 1 --2- 172.21.15.38:0/1590483411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f230013c6b0 0x7f2300064650 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f230009bf00 tx=0x7f22f8001a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.039 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.022+0000 7f230514e700 1 -- 172.21.15.38:0/1590483411 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f230013eb30 con 0x7f230013c6b0 2020-06-12T17:48:38.039 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.022+0000 7f22f7fff700 1 -- 172.21.15.38:0/1590483411 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f22f8002900 con 0x7f230013c6b0 2020-06-12T17:48:38.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.022+0000 7f22ff59e700 1 --2- 172.21.15.38:0/1590483411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f230013c6b0 0x7f2300064650 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f230009bf00 tx=0x7f22f8001a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.023+0000 7f22f7fff700 1 --2- 172.21.15.38:0/1590483411 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f22e404d8d0 0x7f22e404fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:38.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.023+0000 7f22f7fff700 1 -- 172.21.15.38:0/1590483411 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f22f8061160 con 0x7f230013c6b0 2020-06-12T17:48:38.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.023+0000 7f22fed9d700 1 --2- 172.21.15.38:0/1590483411 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f22e404d8d0 0x7f22e404fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:38.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.023+0000 7f22fed9d700 1 --2- 172.21.15.38:0/1590483411 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f22e404d8d0 0x7f22e404fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f22e80084c0 tx=0x7f22e8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.041 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.023+0000 7f22fed9d700 1 --2- 172.21.15.38:0/1590483411 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f22e404d8d0 0x7f22e404fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f22e80084c0 tx=0x7f22e8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.041 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.023+0000 7f22fed9d700 1 --2- 172.21.15.38:0/1590483411 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f22e404d8d0 0x7f22e404fd90 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7f22e80084c0 tx=0x7f22e8007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:38.041 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.026+0000 7f22ff59e700 1 --2- 172.21.15.38:0/1590483411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f230013c6b0 0x7f2300064650 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f230009bf00 tx=0x7f22f8001a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.041 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.026+0000 7f22f7fff700 1 -- 172.21.15.38:0/1590483411 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f22f803c8a0 con 0x7f230013c6b0 2020-06-12T17:48:38.181 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.178+0000 7f230514e700 1 -- 172.21.15.38:0/1590483411 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f230013e270 con 0x7f230013c6b0 2020-06-12T17:48:38.182 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.178+0000 7f22ff59e700 1 --2- 172.21.15.38:0/1590483411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f230013c6b0 0x7f2300064650 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f230009bf00 tx=0x7f22f8001a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.182 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.178+0000 7f22f7fff700 1 -- 172.21.15.38:0/1590483411 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16347 (secure 0 0 0) 0x7f22f803fec0 con 0x7f230013c6b0 2020-06-12T17:48:38.185 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:38.186 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":24,"fsid":"8e42a2e7-b187-42c4-a73f-8f812ee62352","created":"2020-06-12T17:47:54.434340+0000","modified":"2020-06-12T17:48:14.851712+0000","last_up_change":"2020-06-12T17:48:03.388718+0000","last_in_change":"2020-06-12T17:48:03.388718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-06-12T17:47:57.558119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-06-12T17:48:07.419264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-06-12T17:48:09.934098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-06-12T17:48:12.497229+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"44ac3dea-67b4-4b9a-bc18-ac511710afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":31038},{"type":"v1","addr":"172.21.15.38:6816","nonce":31038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":31038},{"type":"v1","addr":"172.21.15.38:6819","nonce":31038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":31038},{"type":"v1","addr":"172.21.15.38:6823","nonce":31038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":31038},{"type":"v1","addr":"172.21.15.38:6821","nonce":31038}]},"public_addr":"172.21.15.38:6816/31038","cluster_addr":"172.21.15.38:6819/31038","heartbeat_back_addr":"172.21.15.38:6823/31038","heartbeat_front_addr":"172.21.15.38:6821/31038","state":["exists","up"]},{"osd":1,"uuid":"561f7ced-3fff-4364-8619-6e4ecbc9d256","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":31036},{"type":"v1","addr":"172.21.15.38:6801","nonce":31036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":31036},{"type":"v1","addr":"172.21.15.38:6803","nonce":31036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":31036},{"type":"v1","addr":"172.21.15.38:6807","nonce":31036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":31036},{"type":"v1","addr":"172.21.15.38:6805","nonce":31036}]},"public_addr":"172.21.15.38:6801/31036","cluster_addr":"172.21.15.38:6803/31036","heartbeat_back_addr":"172.21.15.38:6807/31036","heartbeat_front_addr":"172.21.15.38:6805/31036","state":["exists","up"]},{"osd":2,"uuid":"0bb3c806-07af-49f5-b492-d0e33f2de37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":31053},{"type":"v1","addr":"172.21.15.38:6825","nonce":31053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":31053},{"type":"v1","addr":"172.21.15.38:6827","nonce":31053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":31053},{"type":"v1","addr":"172.21.15.38:6831","nonce":31053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":31053},{"type":"v1","addr":"172.21.15.38:6829","nonce":31053}]},"public_addr":"172.21.15.38:6825/31053","cluster_addr":"172.21.15.38:6827/31053","heartbeat_back_addr":"172.21.15.38:6831/31053","heartbeat_front_addr":"172.21.15.38:6829/31053","state":["exists","up"]},{"osd":3,"uuid":"7f6a1e75-7b11-456e-8a4b-510b16226800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":31037},{"type":"v1","addr":"172.21.15.38:6809","nonce":31037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":31037},{"type":"v1","addr":"172.21.15.38:6811","nonce":31037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6815","nonce":31037},{"type":"v1","addr":"172.21.15.38:6817","nonce":31037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":31037},{"type":"v1","addr":"172.21.15.38:6813","nonce":31037}]},"public_addr":"172.21.15.38:6809/31037","cluster_addr":"172.21.15.38:6811/31037","heartbeat_back_addr":"172.21.15.38:6817/31037","heartbeat_front_addr":"172.21.15.38:6813/31037","state":["exists","up"]},{"osd":4,"uuid":"0eca0272-8cfd-469c-a32d-e29730dc0e1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":31294},{"type":"v1","addr":"172.21.15.150:6803","nonce":31294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":31294},{"type":"v1","addr":"172.21.15.150:6805","nonce":31294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":31294},{"type":"v1","addr":"172.21.15.150:6809","nonce":31294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":31294},{"type":"v1","addr":"172.21.15.150:6807","nonce":31294}]},"public_addr":"172.21.15.150:6803/31294","cluster_addr":"172.21.15.150:6805/31294","heartbeat_back_addr":"172.21.15.150:6809/31294","heartbeat_front_addr":"172.21.15.150:6807/31294","state":["exists","up"]},{"osd":5,"uuid":"69d6a7dc-a55a-4ebc-8479-8bb921ddfb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":31295},{"type":"v1","addr":"172.21.15.150:6813","nonce":31295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":31295},{"type":"v1","addr":"172.21.15.150:6816","nonce":31295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":31295},{"type":"v1","addr":"172.21.15.150:6828","nonce":31295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6819","nonce":31295},{"type":"v1","addr":"172.21.15.150:6822","nonce":31295}]},"public_addr":"172.21.15.150:6813/31295","cluster_addr":"172.21.15.150:6816/31295","heartbeat_back_addr":"172.21.15.150:6828/31295","heartbeat_front_addr":"172.21.15.150:6822/31295","state":["exists","up"]},{"osd":6,"uuid":"f0d320f8-c2f0-40bb-b713-526246cf97b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":31297},{"type":"v1","addr":"172.21.15.150:6820","nonce":31297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6823","nonce":31297},{"type":"v1","addr":"172.21.15.150:6827","nonce":31297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":31297},{"type":"v1","addr":"172.21.15.150:6833","nonce":31297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":31297},{"type":"v1","addr":"172.21.15.150:6831","nonce":31297}]},"public_addr":"172.21.15.150:6820/31297","cluster_addr":"172.21.15.150:6827/31297","heartbeat_back_addr":"172.21.15.150:6833/31297","heartbeat_front_addr":"172.21.15.150:6831/31297","state":["exists","up"]},{"osd":7,"uuid":"970b7d02-a189-41b2-96e5-a5a5a57c6476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":31296},{"type":"v1","addr":"172.21.15.150:6812","nonce":31296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":31296},{"type":"v1","addr":"172.21.15.150:6818","nonce":31296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":31296},{"type":"v1","addr":"172.21.15.150:6829","nonce":31296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":31296},{"type":"v1","addr":"172.21.15.150:6824","nonce":31296}]},"public_addr":"172.21.15.150:6812/31296","cluster_addr":"172.21.15.150:6818/31296","heartbeat_back_addr":"172.21.15.150:6829/31296","heartbeat_front_addr":"172.21.15.150:6824/31296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.664300+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.644253+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.651120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.584978+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.561149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.661778+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T17:48:38.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.180+0000 7f230514e700 1 -- 172.21.15.38:0/1590483411 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f22e404d8d0 msgr2=0x7f22e404fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:38.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.180+0000 7f230514e700 1 --2- 172.21.15.38:0/1590483411 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f22e404d8d0 0x7f22e404fd90 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7f22e80084c0 tx=0x7f22e8007e60).stop 2020-06-12T17:48:38.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.180+0000 7f230514e700 1 -- 172.21.15.38:0/1590483411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f230013c6b0 msgr2=0x7f2300064650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:38.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.180+0000 7f230514e700 1 --2- 172.21.15.38:0/1590483411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f230013c6b0 0x7f2300064650 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7f230009bf00 tx=0x7f22f8001a80).stop 2020-06-12T17:48:38.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.180+0000 7f230514e700 1 -- 172.21.15.38:0/1590483411 shutdown_connections 2020-06-12T17:48:38.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.180+0000 7f230514e700 1 --2- 172.21.15.38:0/1590483411 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f22e404d8d0 0x7f22e404fd90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:38.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.180+0000 7f230514e700 1 --2- 172.21.15.38:0/1590483411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f230013c6b0 0x7f2300064650 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:38.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.180+0000 7f230514e700 1 --2- 172.21.15.38:0/1590483411 >> v2:172.21.15.150:3300/0 conn(0x7f23000623f0 0x7f2300152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:38.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.180+0000 7f230514e700 1 -- 172.21.15.38:0/1590483411 >> 172.21.15.38:0/1590483411 conn(0x7f23000b8420 msgr2=0x7f23000b66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:38.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.180+0000 7f230514e700 1 -- 172.21.15.38:0/1590483411 shutdown_connections 2020-06-12T17:48:38.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.180+0000 7f230514e700 1 -- 172.21.15.38:0/1590483411 wait complete. 2020-06-12T17:48:38.197 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-06-12T17:47:57.558119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-06-12T17:48:07.419264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-06-12T17:48:09.934098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-06-12T17:48:12.497229+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-06-12T17:48:38.198 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-06-12T17:48:38.316 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.313+0000 7fa731c8e700 1 Processor -- start 2020-06-12T17:48:38.317 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.313+0000 7fa731c8e700 1 -- start start 2020-06-12T17:48:38.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.314+0000 7fa731c8e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa72c0ad5b0 0x7fa72c0b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:38.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.314+0000 7fa731c8e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa72c146d20 con 0x7fa72c146680 2020-06-12T17:48:38.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.314+0000 7fa731c8e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa72c066a80 con 0x7fa72c09d8d0 2020-06-12T17:48:38.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.314+0000 7fa731c8e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa72c146f50 con 0x7fa72c0ad5b0 2020-06-12T17:48:38.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.314+0000 7fa72b7fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa72c146680 0x7fa72c09d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38164/0 (socket says 172.21.15.38:38164) 2020-06-12T17:48:38.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.314+0000 7fa72b7fe700 1 -- 172.21.15.38:0/1689216870 learned_addr learned my addr 172.21.15.38:0/1689216870 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:38.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.314+0000 7fa72affd700 1 --2- 172.21.15.38:0/1689216870 >> v2:172.21.15.150:3300/0 conn(0x7fa72c0ad5b0 0x7fa72c0b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:38.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.314+0000 7fa72a7fc700 1 -- 172.21.15.38:0/1689216870 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2333393840 0 0) 0x7fa72c146d20 con 0x7fa72c146680 2020-06-12T17:48:38.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.314+0000 7fa72a7fc700 1 -- 172.21.15.38:0/1689216870 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa718003230 con 0x7fa72c146680 2020-06-12T17:48:38.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.314+0000 7fa72affd700 1 -- 172.21.15.38:0/1689216870 >> v1:172.21.15.150:6789/0 conn(0x7fa72c09d8d0 legacy=0x7fa72c1421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:38.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.314+0000 7fa72affd700 1 -- 172.21.15.38:0/1689216870 >> v1:172.21.15.38:6789/0 conn(0x7fa72c146680 legacy=0x7fa72c09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:38.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.314+0000 7fa72affd700 1 -- 172.21.15.38:0/1689216870 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72c146a60 con 0x7fa72c0ad5b0 2020-06-12T17:48:38.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.314+0000 7fa72affd700 1 --2- 172.21.15.38:0/1689216870 >> v2:172.21.15.150:3300/0 conn(0x7fa72c0ad5b0 0x7fa72c0b2eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa720002f30 tx=0x7fa720007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.323 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.315+0000 7fa72affd700 1 --2- 172.21.15.38:0/1689216870 >> v2:172.21.15.150:3300/0 conn(0x7fa72c0ad5b0 0x7fa72c0b2eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa720002f30 tx=0x7fa720007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.323 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.315+0000 7fa72affd700 1 --2- 172.21.15.38:0/1689216870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa72c0ad5b0 0x7fa72c0b2eb0 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7fa720002f30 tx=0x7fa720007e60).ready entity=mon.1 client_cookie=d7b9f8f286297b5e server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:38.323 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.315+0000 7fa72affd700 1 --2- 172.21.15.38:0/1689216870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa72c0ad5b0 0x7fa72c0b2eb0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7fa720002f30 tx=0x7fa720007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.323 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.315+0000 7fa72a7fc700 1 -- 172.21.15.38:0/1689216870 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa720011380 con 0x7fa72c0ad5b0 2020-06-12T17:48:38.324 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.315+0000 7fa72affd700 1 --2- 172.21.15.38:0/1689216870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa72c0ad5b0 0x7fa72c0b2eb0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7fa720002f30 tx=0x7fa720007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.324 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.315+0000 7fa72affd700 1 --2- 172.21.15.38:0/1689216870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa72c0ad5b0 0x7fa72c0b2eb0 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7fa720002f30 tx=0x7fa720007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.324 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.315+0000 7fa72a7fc700 1 -- 172.21.15.38:0/1689216870 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7200114e0 con 0x7fa72c0ad5b0 2020-06-12T17:48:38.325 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.315+0000 7fa72a7fc700 1 -- 172.21.15.38:0/1689216870 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa720011880 con 0x7fa72c0ad5b0 2020-06-12T17:48:38.325 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.315+0000 7fa731c8e700 1 -- 172.21.15.38:0/1689216870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa72c0ad5b0 msgr2=0x7fa72c0b2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:38.325 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.315+0000 7fa731c8e700 1 --2- 172.21.15.38:0/1689216870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa72c0ad5b0 0x7fa72c0b2eb0 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7fa720002f30 tx=0x7fa720007e60).stop 2020-06-12T17:48:38.325 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.315+0000 7fa731c8e700 1 -- 172.21.15.38:0/1689216870 shutdown_connections 2020-06-12T17:48:38.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.315+0000 7fa731c8e700 1 --2- 172.21.15.38:0/1689216870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa72c0ad5b0 0x7fa72c0b2eb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:38.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.315+0000 7fa731c8e700 1 -- 172.21.15.38:0/1689216870 >> 172.21.15.38:0/1689216870 conn(0x7fa72c0b5a20 msgr2=0x7fa72c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:38.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.315+0000 7fa731c8e700 1 -- 172.21.15.38:0/1689216870 shutdown_connections 2020-06-12T17:48:38.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.315+0000 7fa731c8e700 1 -- 172.21.15.38:0/1689216870 wait complete. 2020-06-12T17:48:38.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.316+0000 7fa731c8e700 1 Processor -- start 2020-06-12T17:48:38.327 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.316+0000 7fa731c8e700 1 -- start start 2020-06-12T17:48:38.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.317+0000 7fa731c8e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa72c09d8d0 0x7fa72c063730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:38.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.317+0000 7fa731c8e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa72c0ad5b0 0x7fa72c09a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:38.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.317+0000 7fa731c8e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa72c0658b0 con 0x7fa72c146680 2020-06-12T17:48:38.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.317+0000 7fa731c8e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa72c065fb0 con 0x7fa72c09d8d0 2020-06-12T17:48:38.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.317+0000 7fa731c8e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa72c09ac10 con 0x7fa72c0ad5b0 2020-06-12T17:48:38.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.317+0000 7fa72b7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa72c09d8d0 0x7fa72c063730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:38.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.317+0000 7fa72b7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa72c09d8d0 0x7fa72c063730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36354/0 (socket says 172.21.15.38:36354) 2020-06-12T17:48:38.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.317+0000 7fa72b7fe700 1 -- 172.21.15.38:0/4251063555 learned_addr learned my addr 172.21.15.38:0/4251063555 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:38.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.317+0000 7fa72affd700 1 --2- 172.21.15.38:0/4251063555 >> v2:172.21.15.150:3300/0 conn(0x7fa72c0ad5b0 0x7fa72c09a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:38.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.317+0000 7fa72b7fe700 1 -- 172.21.15.38:0/4251063555 >> v2:172.21.15.150:3300/0 conn(0x7fa72c0ad5b0 msgr2=0x7fa72c09a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:38.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.317+0000 7fa72b7fe700 1 --2- 172.21.15.38:0/4251063555 >> v2:172.21.15.150:3300/0 conn(0x7fa72c0ad5b0 0x7fa72c09a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:38.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.317+0000 7fa72b7fe700 1 -- 172.21.15.38:0/4251063555 >> v1:172.21.15.150:6789/0 conn(0x7fa72c146680 legacy=0x7fa72c0b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:38.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.317+0000 7fa72b7fe700 1 -- 172.21.15.38:0/4251063555 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72c065b10 con 0x7fa72c09d8d0 2020-06-12T17:48:38.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.317+0000 7fa72b7fe700 1 --2- 172.21.15.38:0/4251063555 >> v2:172.21.15.38:3300/0 conn(0x7fa72c09d8d0 0x7fa72c063730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa72c0b1c60 tx=0x7fa71c001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.318+0000 7fa72b7fe700 1 --2- 172.21.15.38:0/4251063555 >> v2:172.21.15.38:3300/0 conn(0x7fa72c09d8d0 0x7fa72c063730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa72c0b1c60 tx=0x7fa71c001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.318+0000 7fa72b7fe700 1 --2- 172.21.15.38:0/4251063555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa72c09d8d0 0x7fa72c063730 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7fa72c0b1c60 tx=0x7fa71c001700).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:38.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.318+0000 7fa72b7fe700 1 --2- 172.21.15.38:0/4251063555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa72c09d8d0 0x7fa72c063730 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fa72c0b1c60 tx=0x7fa71c001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.318+0000 7fa728ff9700 1 -- 172.21.15.38:0/4251063555 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa71c005cc0 con 0x7fa72c09d8d0 2020-06-12T17:48:38.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.318+0000 7fa72b7fe700 1 --2- 172.21.15.38:0/4251063555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa72c09d8d0 0x7fa72c063730 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fa72c0b1c60 tx=0x7fa71c001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.318+0000 7fa728ff9700 1 -- 172.21.15.38:0/4251063555 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71c005e20 con 0x7fa72c09d8d0 2020-06-12T17:48:38.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.318+0000 7fa72b7fe700 1 --2- 172.21.15.38:0/4251063555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa72c09d8d0 0x7fa72c063730 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fa72c0b1c60 tx=0x7fa71c001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.318+0000 7fa731c8e700 1 -- 172.21.15.38:0/4251063555 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa72c09a940 con 0x7fa72c09d8d0 2020-06-12T17:48:38.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.318+0000 7fa728ff9700 1 -- 172.21.15.38:0/4251063555 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa71c0062b0 con 0x7fa72c09d8d0 2020-06-12T17:48:38.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.318+0000 7fa731c8e700 1 -- 172.21.15.38:0/4251063555 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa72c142c40 con 0x7fa72c09d8d0 2020-06-12T17:48:38.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.318+0000 7fa72b7fe700 1 --2- 172.21.15.38:0/4251063555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa72c09d8d0 0x7fa72c063730 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fa72c0b1c60 tx=0x7fa71c001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.319+0000 7fa731c8e700 1 -- 172.21.15.38:0/4251063555 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa72c056c30 con 0x7fa72c09d8d0 2020-06-12T17:48:38.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.319+0000 7fa728ff9700 1 -- 172.21.15.38:0/4251063555 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fa71c0064f0 con 0x7fa72c09d8d0 2020-06-12T17:48:38.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.319+0000 7fa72b7fe700 1 --2- 172.21.15.38:0/4251063555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa72c09d8d0 0x7fa72c063730 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fa72c0b1c60 tx=0x7fa71c001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.319+0000 7fa728ff9700 1 --2- 172.21.15.38:0/4251063555 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa70c04d5f0 0x7fa70c04fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:38.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.319+0000 7fa728ff9700 1 -- 172.21.15.38:0/4251063555 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fa71c060e60 con 0x7fa72c09d8d0 2020-06-12T17:48:38.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.319+0000 7fa72affd700 1 --2- 172.21.15.38:0/4251063555 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa70c04d5f0 0x7fa70c04fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:38.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.320+0000 7fa72affd700 1 --2- 172.21.15.38:0/4251063555 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa70c04d5f0 0x7fa70c04fab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa720002f30 tx=0x7fa720007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.320+0000 7fa72affd700 1 --2- 172.21.15.38:0/4251063555 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa70c04d5f0 0x7fa70c04fab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa720002f30 tx=0x7fa720007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.320+0000 7fa72affd700 1 --2- 172.21.15.38:0/4251063555 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa70c04d5f0 0x7fa70c04fab0 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7fa720002f30 tx=0x7fa720007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:38.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.323+0000 7fa72b7fe700 1 --2- 172.21.15.38:0/4251063555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa72c09d8d0 0x7fa72c063730 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fa72c0b1c60 tx=0x7fa71c001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.323+0000 7fa728ff9700 1 -- 172.21.15.38:0/4251063555 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fa71c0660c0 con 0x7fa72c09d8d0 2020-06-12T17:48:38.479 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.476+0000 7fa731c8e700 1 -- 172.21.15.38:0/4251063555 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa72c09ad50 con 0x7fa72c09d8d0 2020-06-12T17:48:38.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.476+0000 7fa72b7fe700 1 --2- 172.21.15.38:0/4251063555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa72c09d8d0 0x7fa72c063730 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fa72c0b1c60 tx=0x7fa71c001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.476+0000 7fa728ff9700 1 -- 172.21.15.38:0/4251063555 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa71c03c540 con 0x7fa72c09d8d0 2020-06-12T17:48:38.480 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2020-06-12T17:48:38.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.477+0000 7fa731c8e700 1 -- 172.21.15.38:0/4251063555 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa70c04d5f0 msgr2=0x7fa70c04fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:38.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.477+0000 7fa731c8e700 1 --2- 172.21.15.38:0/4251063555 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa70c04d5f0 0x7fa70c04fab0 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7fa720002f30 tx=0x7fa720007e60).stop 2020-06-12T17:48:38.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.477+0000 7fa731c8e700 1 -- 172.21.15.38:0/4251063555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa72c09d8d0 msgr2=0x7fa72c063730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:38.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.477+0000 7fa731c8e700 1 --2- 172.21.15.38:0/4251063555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa72c09d8d0 0x7fa72c063730 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7fa72c0b1c60 tx=0x7fa71c001700).stop 2020-06-12T17:48:38.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.477+0000 7fa731c8e700 1 -- 172.21.15.38:0/4251063555 shutdown_connections 2020-06-12T17:48:38.483 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.477+0000 7fa731c8e700 1 --2- 172.21.15.38:0/4251063555 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa70c04d5f0 0x7fa70c04fab0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:38.483 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.477+0000 7fa731c8e700 1 --2- 172.21.15.38:0/4251063555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa72c09d8d0 0x7fa72c063730 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:38.483 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.477+0000 7fa731c8e700 1 --2- 172.21.15.38:0/4251063555 >> v2:172.21.15.150:3300/0 conn(0x7fa72c0ad5b0 0x7fa72c09a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:38.483 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.477+0000 7fa731c8e700 1 -- 172.21.15.38:0/4251063555 >> 172.21.15.38:0/4251063555 conn(0x7fa72c0b5a20 msgr2=0x7fa72c0b68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:38.483 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.478+0000 7fa731c8e700 1 -- 172.21.15.38:0/4251063555 shutdown_connections 2020-06-12T17:48:38.484 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.478+0000 7fa731c8e700 1 -- 172.21.15.38:0/4251063555 wait complete. 2020-06-12T17:48:38.494 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-06-12T17:48:38.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.608+0000 7ff41bb42700 1 Processor -- start 2020-06-12T17:48:38.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.608+0000 7ff41bb42700 1 -- start start 2020-06-12T17:48:38.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.609+0000 7ff41bb42700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff4140ad5b0 0x7ff4140b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:38.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.609+0000 7ff41bb42700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff41409d8d0 0x7ff4141421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:38.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.609+0000 7ff41bb42700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff414146d20 con 0x7ff414146680 2020-06-12T17:48:38.616 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.609+0000 7ff41bb42700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff414066a80 con 0x7ff41409d8d0 2020-06-12T17:48:38.616 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.609+0000 7ff41bb42700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff414146f50 con 0x7ff4140ad5b0 2020-06-12T17:48:38.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.609+0000 7ff41a0df700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff41409d8d0 0x7ff4141421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:38.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.609+0000 7ff41a0df700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff41409d8d0 0x7ff4141421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36366/0 (socket says 172.21.15.38:36366) 2020-06-12T17:48:38.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.609+0000 7ff41a0df700 1 -- 172.21.15.38:0/3839289569 learned_addr learned my addr 172.21.15.38:0/3839289569 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:38.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.609+0000 7ff4190dd700 1 --2- 172.21.15.38:0/3839289569 >> v2:172.21.15.150:3300/0 conn(0x7ff4140ad5b0 0x7ff4140b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:38.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.609+0000 7ff41a0df700 1 -- 172.21.15.38:0/3839289569 >> v2:172.21.15.150:3300/0 conn(0x7ff4140ad5b0 msgr2=0x7ff4140b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:38.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.610+0000 7ff41a0df700 1 --2- 172.21.15.38:0/3839289569 >> v2:172.21.15.150:3300/0 conn(0x7ff4140ad5b0 0x7ff4140b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:38.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.610+0000 7ff41a0df700 1 -- 172.21.15.38:0/3839289569 >> v1:172.21.15.150:6789/0 conn(0x7ff414146680 legacy=0x7ff41409d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:38.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.610+0000 7ff41a0df700 1 -- 172.21.15.38:0/3839289569 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff414146a60 con 0x7ff41409d8d0 2020-06-12T17:48:38.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.610+0000 7ff41a0df700 1 --2- 172.21.15.38:0/3839289569 >> v2:172.21.15.38:3300/0 conn(0x7ff41409d8d0 0x7ff4141421d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff40c002f30 tx=0x7ff40c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.610+0000 7ff41a0df700 1 --2- 172.21.15.38:0/3839289569 >> v2:172.21.15.38:3300/0 conn(0x7ff41409d8d0 0x7ff4141421d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff40c002f30 tx=0x7ff40c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.610+0000 7ff41a0df700 1 --2- 172.21.15.38:0/3839289569 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff41409d8d0 0x7ff4141421d0 secure :-1 s=READY pgs=242 cs=0 l=1 rx=0x7ff40c002f30 tx=0x7ff40c007e60).ready entity=mon.0 client_cookie=ead2e95fce67171c server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:38.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.610+0000 7ff41a0df700 1 --2- 172.21.15.38:0/3839289569 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff41409d8d0 0x7ff4141421d0 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7ff40c002f30 tx=0x7ff40c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.610+0000 7ff4188dc700 1 -- 172.21.15.38:0/3839289569 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff40c011630 con 0x7ff41409d8d0 2020-06-12T17:48:38.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.610+0000 7ff41a0df700 1 --2- 172.21.15.38:0/3839289569 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff41409d8d0 0x7ff4141421d0 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7ff40c002f30 tx=0x7ff40c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.610+0000 7ff41a0df700 1 --2- 172.21.15.38:0/3839289569 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff41409d8d0 0x7ff4141421d0 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7ff40c002f30 tx=0x7ff40c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.610+0000 7ff4188dc700 1 -- 172.21.15.38:0/3839289569 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c011790 con 0x7ff41409d8d0 2020-06-12T17:48:38.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.610+0000 7ff4188dc700 1 -- 172.21.15.38:0/3839289569 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff40c011b70 con 0x7ff41409d8d0 2020-06-12T17:48:38.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.610+0000 7ff41bb42700 1 -- 172.21.15.38:0/3839289569 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff41409d8d0 msgr2=0x7ff4141421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:38.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.610+0000 7ff41bb42700 1 --2- 172.21.15.38:0/3839289569 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff41409d8d0 0x7ff4141421d0 secure :-1 s=READY pgs=242 cs=0 l=1 rx=0x7ff40c002f30 tx=0x7ff40c007e60).stop 2020-06-12T17:48:38.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.610+0000 7ff41bb42700 1 -- 172.21.15.38:0/3839289569 shutdown_connections 2020-06-12T17:48:38.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.610+0000 7ff41bb42700 1 --2- 172.21.15.38:0/3839289569 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff41409d8d0 0x7ff4141421d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:38.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.610+0000 7ff41bb42700 1 --2- 172.21.15.38:0/3839289569 >> v2:172.21.15.150:3300/0 conn(0x7ff4140ad5b0 0x7ff4140b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:38.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.610+0000 7ff41bb42700 1 -- 172.21.15.38:0/3839289569 >> 172.21.15.38:0/3839289569 conn(0x7ff4140b5a20 msgr2=0x7ff41405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:38.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.610+0000 7ff41bb42700 1 -- 172.21.15.38:0/3839289569 shutdown_connections 2020-06-12T17:48:38.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.610+0000 7ff41bb42700 1 -- 172.21.15.38:0/3839289569 wait complete. 2020-06-12T17:48:38.622 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.611+0000 7ff41bb42700 1 Processor -- start 2020-06-12T17:48:38.622 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.611+0000 7ff41bb42700 1 -- start start 2020-06-12T17:48:38.625 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.612+0000 7ff41bb42700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff41409d8d0 0x7ff4140b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:38.626 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.612+0000 7ff41bb42700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff4140ad5b0 0x7ff414061f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:38.627 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.612+0000 7ff41bb42700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4140b3f20 con 0x7ff414146680 2020-06-12T17:48:38.627 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.612+0000 7ff41bb42700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41408fad0 con 0x7ff4140ad5b0 2020-06-12T17:48:38.627 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.612+0000 7ff41bb42700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41408ee50 con 0x7ff41409d8d0 2020-06-12T17:48:38.627 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.612+0000 7ff4190dd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff4140ad5b0 0x7ff414061f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:38.628 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.612+0000 7ff41a0df700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff414146680 0x7ff4141353b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38188/0 (socket says 172.21.15.38:38188) 2020-06-12T17:48:38.628 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.612+0000 7ff41a0df700 1 -- 172.21.15.38:0/1111235365 learned_addr learned my addr 172.21.15.38:0/1111235365 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:38.629 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.612+0000 7ff4198de700 1 --2- 172.21.15.38:0/1111235365 >> v2:172.21.15.150:3300/0 conn(0x7ff41409d8d0 0x7ff4140b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:38.629 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.612+0000 7ff4190dd700 1 -- 172.21.15.38:0/1111235365 >> v2:172.21.15.150:3300/0 conn(0x7ff41409d8d0 msgr2=0x7ff4140b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:38.629 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.612+0000 7ff4190dd700 1 --2- 172.21.15.38:0/1111235365 >> v2:172.21.15.150:3300/0 conn(0x7ff41409d8d0 0x7ff4140b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:38.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.612+0000 7ff4190dd700 1 -- 172.21.15.38:0/1111235365 >> v1:172.21.15.38:6789/0 conn(0x7ff414146680 legacy=0x7ff4141353b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:38.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.612+0000 7ff402ffd700 1 -- 172.21.15.38:0/1111235365 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 168080669 0 0) 0x7ff414146a60 con 0x7ff414146680 2020-06-12T17:48:38.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.612+0000 7ff4190dd700 1 -- 172.21.15.38:0/1111235365 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41408f0f0 con 0x7ff4140ad5b0 2020-06-12T17:48:38.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.612+0000 7ff4190dd700 1 --2- 172.21.15.38:0/1111235365 >> v2:172.21.15.38:3300/0 conn(0x7ff4140ad5b0 0x7ff414061f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff414065150 tx=0x7ff4100081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.613+0000 7ff4190dd700 1 --2- 172.21.15.38:0/1111235365 >> v2:172.21.15.38:3300/0 conn(0x7ff4140ad5b0 0x7ff414061f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff414065150 tx=0x7ff4100081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.613+0000 7ff4190dd700 1 --2- 172.21.15.38:0/1111235365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4140ad5b0 0x7ff414061f20 secure :-1 s=READY pgs=244 cs=0 l=1 rx=0x7ff414065150 tx=0x7ff4100081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:38.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.613+0000 7ff4190dd700 1 --2- 172.21.15.38:0/1111235365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4140ad5b0 0x7ff414061f20 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7ff414065150 tx=0x7ff4100081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.613+0000 7ff402ffd700 1 -- 172.21.15.38:0/1111235365 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff41000e350 con 0x7ff4140ad5b0 2020-06-12T17:48:38.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.613+0000 7ff4190dd700 1 --2- 172.21.15.38:0/1111235365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4140ad5b0 0x7ff414061f20 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7ff414065150 tx=0x7ff4100081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.613+0000 7ff4190dd700 1 --2- 172.21.15.38:0/1111235365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4140ad5b0 0x7ff414061f20 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7ff414065150 tx=0x7ff4100081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.632 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.613+0000 7ff402ffd700 1 -- 172.21.15.38:0/1111235365 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff410005c30 con 0x7ff4140ad5b0 2020-06-12T17:48:38.632 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.613+0000 7ff41bb42700 1 -- 172.21.15.38:0/1111235365 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff41408f390 con 0x7ff4140ad5b0 2020-06-12T17:48:38.632 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.613+0000 7ff402ffd700 1 -- 172.21.15.38:0/1111235365 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff410005e20 con 0x7ff4140ad5b0 2020-06-12T17:48:38.632 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.613+0000 7ff41bb42700 1 -- 172.21.15.38:0/1111235365 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff414062380 con 0x7ff4140ad5b0 2020-06-12T17:48:38.632 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.613+0000 7ff4190dd700 1 --2- 172.21.15.38:0/1111235365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4140ad5b0 0x7ff414061f20 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7ff414065150 tx=0x7ff4100081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.614+0000 7ff402ffd700 1 -- 172.21.15.38:0/1111235365 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7ff41000caf0 con 0x7ff4140ad5b0 2020-06-12T17:48:38.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.614+0000 7ff4190dd700 1 --2- 172.21.15.38:0/1111235365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4140ad5b0 0x7ff414061f20 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7ff414065150 tx=0x7ff4100081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.614+0000 7ff41bb42700 1 -- 172.21.15.38:0/1111235365 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff414056c30 con 0x7ff4140ad5b0 2020-06-12T17:48:38.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.614+0000 7ff402ffd700 1 --2- 172.21.15.38:0/1111235365 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff3f404d470 0x7ff3f404f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:38.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.614+0000 7ff402ffd700 1 -- 172.21.15.38:0/1111235365 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff410060ef0 con 0x7ff4140ad5b0 2020-06-12T17:48:38.634 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.614+0000 7ff4198de700 1 --2- 172.21.15.38:0/1111235365 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff3f404d470 0x7ff3f404f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:38.634 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.615+0000 7ff4198de700 1 --2- 172.21.15.38:0/1111235365 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff3f404d470 0x7ff3f404f930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff414061380 tx=0x7ff404001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.634 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.615+0000 7ff4198de700 1 --2- 172.21.15.38:0/1111235365 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff3f404d470 0x7ff3f404f930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff414061380 tx=0x7ff404001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.634 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.615+0000 7ff4198de700 1 --2- 172.21.15.38:0/1111235365 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff3f404d470 0x7ff3f404f930 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7ff414061380 tx=0x7ff404001760).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:38.635 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.618+0000 7ff4190dd700 1 --2- 172.21.15.38:0/1111235365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4140ad5b0 0x7ff414061f20 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7ff414065150 tx=0x7ff4100081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.635 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.618+0000 7ff402ffd700 1 -- 172.21.15.38:0/1111235365 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7ff41003c570 con 0x7ff4140ad5b0 2020-06-12T17:48:38.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.771+0000 7ff41bb42700 1 -- 172.21.15.38:0/1111235365 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff4140b4470 con 0x7ff4140ad5b0 2020-06-12T17:48:38.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.771+0000 7ff4190dd700 1 --2- 172.21.15.38:0/1111235365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4140ad5b0 0x7ff414061f20 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7ff414065150 tx=0x7ff4100081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.772+0000 7ff402ffd700 1 -- 172.21.15.38:0/1111235365 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff41003fb90 con 0x7ff4140ad5b0 2020-06-12T17:48:38.776 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:38.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.773+0000 7ff41bb42700 1 -- 172.21.15.38:0/1111235365 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff3f404d470 msgr2=0x7ff3f404f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:38.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.773+0000 7ff41bb42700 1 --2- 172.21.15.38:0/1111235365 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff3f404d470 0x7ff3f404f930 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7ff414061380 tx=0x7ff404001760).stop 2020-06-12T17:48:38.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.773+0000 7ff41bb42700 1 -- 172.21.15.38:0/1111235365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4140ad5b0 msgr2=0x7ff414061f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:38.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.773+0000 7ff41bb42700 1 --2- 172.21.15.38:0/1111235365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4140ad5b0 0x7ff414061f20 secure :-1 s=READY pgs=244 cs=0 l=1 rx=0x7ff414065150 tx=0x7ff4100081e0).stop 2020-06-12T17:48:38.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.773+0000 7ff41bb42700 1 -- 172.21.15.38:0/1111235365 shutdown_connections 2020-06-12T17:48:38.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.773+0000 7ff41bb42700 1 --2- 172.21.15.38:0/1111235365 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff3f404d470 0x7ff3f404f930 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:38.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.773+0000 7ff41bb42700 1 --2- 172.21.15.38:0/1111235365 >> v2:172.21.15.150:3300/0 conn(0x7ff41409d8d0 0x7ff4140b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:38.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.773+0000 7ff41bb42700 1 --2- 172.21.15.38:0/1111235365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4140ad5b0 0x7ff414061f20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:38.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.773+0000 7ff41bb42700 1 -- 172.21.15.38:0/1111235365 >> 172.21.15.38:0/1111235365 conn(0x7ff4140b5a20 msgr2=0x7ff41409c530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:38.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.773+0000 7ff41bb42700 1 -- 172.21.15.38:0/1111235365 shutdown_connections 2020-06-12T17:48:38.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.773+0000 7ff41bb42700 1 -- 172.21.15.38:0/1111235365 wait complete. 2020-06-12T17:48:38.787 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-06-12T17:48:38.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.901+0000 7fad92499700 1 Processor -- start 2020-06-12T17:48:38.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.901+0000 7fad92499700 1 -- start start 2020-06-12T17:48:38.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.902+0000 7fad92499700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fad8c14da00 0x7fad8c14dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:38.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.902+0000 7fad92499700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad8c0b3890 0x7fad8c14a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:38.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.902+0000 7fad92499700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad8c0b4040 con 0x7fad8c14a850 2020-06-12T17:48:38.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.902+0000 7fad92499700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad8c14e240 con 0x7fad8c14da00 2020-06-12T17:48:38.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.902+0000 7fad92499700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c0b42e0 con 0x7fad8c0b3890 2020-06-12T17:48:38.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.902+0000 7fad90a36700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fad8c14a850 0x7fad8c14aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38196/0 (socket says 172.21.15.38:38196) 2020-06-12T17:48:38.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.902+0000 7fad90a36700 1 -- 172.21.15.38:0/982853034 learned_addr learned my addr 172.21.15.38:0/982853034 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:38.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.902+0000 7fad8b7fe700 1 --2- 172.21.15.38:0/982853034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad8c0b3890 0x7fad8c14a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:38.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.902+0000 7fad8bfff700 1 --2- 172.21.15.38:0/982853034 >> v2:172.21.15.150:3300/0 conn(0x7fad8c14da00 0x7fad8c14dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:38.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.902+0000 7fad8affd700 1 -- 172.21.15.38:0/982853034 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286140973 0 0) 0x7fad8c0b4040 con 0x7fad8c14a850 2020-06-12T17:48:38.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.902+0000 7fad8affd700 1 -- 172.21.15.38:0/982853034 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad78003230 con 0x7fad8c14a850 2020-06-12T17:48:38.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.902+0000 7fad8bfff700 1 -- 172.21.15.38:0/982853034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad8c0b3890 msgr2=0x7fad8c14a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:38.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.902+0000 7fad8bfff700 1 --2- 172.21.15.38:0/982853034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad8c0b3890 0x7fad8c14a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:38.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.902+0000 7fad8bfff700 1 -- 172.21.15.38:0/982853034 >> v1:172.21.15.38:6789/0 conn(0x7fad8c14a850 legacy=0x7fad8c14aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:38.913 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.902+0000 7fad8bfff700 1 -- 172.21.15.38:0/982853034 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8c0b4580 con 0x7fad8c14da00 2020-06-12T17:48:38.913 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.902+0000 7fad8b7fe700 1 --2- 172.21.15.38:0/982853034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad8c0b3890 0x7fad8c14a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:38.913 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.902+0000 7fad8bfff700 1 --2- 172.21.15.38:0/982853034 >> v2:172.21.15.150:3300/0 conn(0x7fad8c14da00 0x7fad8c14dde0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fad7c002f30 tx=0x7fad7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.913 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.902+0000 7fad8bfff700 1 --2- 172.21.15.38:0/982853034 >> v2:172.21.15.150:3300/0 conn(0x7fad8c14da00 0x7fad8c14dde0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fad7c002f30 tx=0x7fad7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.913 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.902+0000 7fad8bfff700 1 --2- 172.21.15.38:0/982853034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad8c14da00 0x7fad8c14dde0 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7fad7c002f30 tx=0x7fad7c007e60).ready entity=mon.1 client_cookie=33b54fcf3a40f8d2 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:38.914 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.903+0000 7fad8bfff700 1 --2- 172.21.15.38:0/982853034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad8c14da00 0x7fad8c14dde0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7fad7c002f30 tx=0x7fad7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.914 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.903+0000 7fad8affd700 1 -- 172.21.15.38:0/982853034 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad7c0112d0 con 0x7fad8c14da00 2020-06-12T17:48:38.914 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.903+0000 7fad8bfff700 1 --2- 172.21.15.38:0/982853034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad8c14da00 0x7fad8c14dde0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7fad7c002f30 tx=0x7fad7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.914 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.903+0000 7fad8bfff700 1 --2- 172.21.15.38:0/982853034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad8c14da00 0x7fad8c14dde0 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7fad7c002f30 tx=0x7fad7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.914 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.903+0000 7fad8affd700 1 -- 172.21.15.38:0/982853034 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7c011430 con 0x7fad8c14da00 2020-06-12T17:48:38.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.903+0000 7fad8affd700 1 -- 172.21.15.38:0/982853034 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad7c011850 con 0x7fad8c14da00 2020-06-12T17:48:38.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.903+0000 7fad92499700 1 -- 172.21.15.38:0/982853034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad8c14da00 msgr2=0x7fad8c14dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:38.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.903+0000 7fad92499700 1 --2- 172.21.15.38:0/982853034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad8c14da00 0x7fad8c14dde0 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7fad7c002f30 tx=0x7fad7c007e60).stop 2020-06-12T17:48:38.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.903+0000 7fad92499700 1 -- 172.21.15.38:0/982853034 shutdown_connections 2020-06-12T17:48:38.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.903+0000 7fad92499700 1 --2- 172.21.15.38:0/982853034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad8c14da00 0x7fad8c14dde0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:38.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.903+0000 7fad92499700 1 --2- 172.21.15.38:0/982853034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad8c0b3890 0x7fad8c14a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:38.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.903+0000 7fad92499700 1 -- 172.21.15.38:0/982853034 >> 172.21.15.38:0/982853034 conn(0x7fad8c0b5a20 msgr2=0x7fad8c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:38.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.903+0000 7fad92499700 1 -- 172.21.15.38:0/982853034 shutdown_connections 2020-06-12T17:48:38.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.903+0000 7fad92499700 1 -- 172.21.15.38:0/982853034 wait complete. 2020-06-12T17:48:38.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.904+0000 7fad92499700 1 Processor -- start 2020-06-12T17:48:38.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.904+0000 7fad92499700 1 -- start start 2020-06-12T17:48:38.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.905+0000 7fad92499700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fad8c14a850 0x7fad8c09cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:38.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.905+0000 7fad92499700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fad8c14da00 0x7fad8c157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:38.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.905+0000 7fad92499700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad8c0b2570 con 0x7fad8c0b3890 2020-06-12T17:48:38.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.905+0000 7fad92499700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad8c09d100 con 0x7fad8c14da00 2020-06-12T17:48:38.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.905+0000 7fad92499700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad8c0b22d0 con 0x7fad8c14a850 2020-06-12T17:48:38.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.905+0000 7fad8bfff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fad8c0b3890 0x7fad8c0b1aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38198/0 (socket says 172.21.15.38:38198) 2020-06-12T17:48:38.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.905+0000 7fad8bfff700 1 -- 172.21.15.38:0/3967393234 learned_addr learned my addr 172.21.15.38:0/3967393234 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:38.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.905+0000 7fad90a36700 1 --2- 172.21.15.38:0/3967393234 >> v2:172.21.15.38:3300/0 conn(0x7fad8c14da00 0x7fad8c157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:38.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.905+0000 7fad8b7fe700 1 --2- 172.21.15.38:0/3967393234 >> v2:172.21.15.150:3300/0 conn(0x7fad8c14a850 0x7fad8c09cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:38.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.905+0000 7fad897fa700 1 -- 172.21.15.38:0/3967393234 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465407040 0 0) 0x7fad8c0b2570 con 0x7fad8c0b3890 2020-06-12T17:48:38.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.905+0000 7fad897fa700 1 -- 172.21.15.38:0/3967393234 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad6c002fe0 con 0x7fad8c0b3890 2020-06-12T17:48:38.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.905+0000 7fad90a36700 1 -- 172.21.15.38:0/3967393234 >> v2:172.21.15.150:3300/0 conn(0x7fad8c14a850 msgr2=0x7fad8c09cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:38.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.905+0000 7fad90a36700 1 --2- 172.21.15.38:0/3967393234 >> v2:172.21.15.150:3300/0 conn(0x7fad8c14a850 0x7fad8c09cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:38.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.905+0000 7fad90a36700 1 -- 172.21.15.38:0/3967393234 >> v1:172.21.15.38:6789/0 conn(0x7fad8c0b3890 legacy=0x7fad8c0b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:38.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.905+0000 7fad90a36700 1 -- 172.21.15.38:0/3967393234 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8c063730 con 0x7fad8c14da00 2020-06-12T17:48:38.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.905+0000 7fad90a36700 1 --2- 172.21.15.38:0/3967393234 >> v2:172.21.15.38:3300/0 conn(0x7fad8c14da00 0x7fad8c157ad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fad84001450 tx=0x7fad840019c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.905+0000 7fad90a36700 1 --2- 172.21.15.38:0/3967393234 >> v2:172.21.15.38:3300/0 conn(0x7fad8c14da00 0x7fad8c157ad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fad84001450 tx=0x7fad840019c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.905+0000 7fad90a36700 1 --2- 172.21.15.38:0/3967393234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad8c14da00 0x7fad8c157ad0 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7fad84001450 tx=0x7fad840019c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:38.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.906+0000 7fad90a36700 1 --2- 172.21.15.38:0/3967393234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad8c14da00 0x7fad8c157ad0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7fad84001450 tx=0x7fad840019c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.906+0000 7fad897fa700 1 -- 172.21.15.38:0/3967393234 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad84005e50 con 0x7fad8c14da00 2020-06-12T17:48:38.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.906+0000 7fad90a36700 1 --2- 172.21.15.38:0/3967393234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad8c14da00 0x7fad8c157ad0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7fad84001450 tx=0x7fad840019c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.906+0000 7fad92499700 1 -- 172.21.15.38:0/3967393234 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad8c062810 con 0x7fad8c14da00 2020-06-12T17:48:38.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.906+0000 7fad897fa700 1 -- 172.21.15.38:0/3967393234 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad84012350 con 0x7fad8c14da00 2020-06-12T17:48:38.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.906+0000 7fad90a36700 1 --2- 172.21.15.38:0/3967393234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad8c14da00 0x7fad8c157ad0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7fad84001450 tx=0x7fad840019c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.906+0000 7fad897fa700 1 -- 172.21.15.38:0/3967393234 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad84012730 con 0x7fad8c14da00 2020-06-12T17:48:38.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.906+0000 7fad92499700 1 -- 172.21.15.38:0/3967393234 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad8c158170 con 0x7fad8c14da00 2020-06-12T17:48:38.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.906+0000 7fad90a36700 1 --2- 172.21.15.38:0/3967393234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad8c14da00 0x7fad8c157ad0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7fad84001450 tx=0x7fad840019c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.907+0000 7fad92499700 1 -- 172.21.15.38:0/3967393234 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad8c056c30 con 0x7fad8c14da00 2020-06-12T17:48:38.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.907+0000 7fad897fa700 1 -- 172.21.15.38:0/3967393234 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fad84012960 con 0x7fad8c14da00 2020-06-12T17:48:38.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.907+0000 7fad90a36700 1 --2- 172.21.15.38:0/3967393234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad8c14da00 0x7fad8c157ad0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7fad84001450 tx=0x7fad840019c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.907+0000 7fad897fa700 1 --2- 172.21.15.38:0/3967393234 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fad6c04d8f0 0x7fad6c04fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:38.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.907+0000 7fad897fa700 1 -- 172.21.15.38:0/3967393234 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fad840611a0 con 0x7fad8c14da00 2020-06-12T17:48:38.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.908+0000 7fad8bfff700 1 --2- 172.21.15.38:0/3967393234 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fad6c04d8f0 0x7fad6c04fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:38.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.908+0000 7fad8bfff700 1 --2- 172.21.15.38:0/3967393234 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fad6c04d8f0 0x7fad6c04fdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fad7c0088e0 tx=0x7fad7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.908+0000 7fad8bfff700 1 --2- 172.21.15.38:0/3967393234 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fad6c04d8f0 0x7fad6c04fdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fad7c0088e0 tx=0x7fad7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.908+0000 7fad8bfff700 1 --2- 172.21.15.38:0/3967393234 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fad6c04d8f0 0x7fad6c04fdb0 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7fad7c0088e0 tx=0x7fad7c007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:38.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.911+0000 7fad90a36700 1 --2- 172.21.15.38:0/3967393234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad8c14da00 0x7fad8c157ad0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7fad84001450 tx=0x7fad840019c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:38.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:38.911+0000 7fad897fa700 1 -- 172.21.15.38:0/3967393234 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fad8403c880 con 0x7fad8c14da00 2020-06-12T17:48:39.064 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.060+0000 7fad92499700 1 -- 172.21.15.38:0/3967393234 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fad8c05bdc0 con 0x7fad8c14da00 2020-06-12T17:48:39.065 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.061+0000 7fad90a36700 1 --2- 172.21.15.38:0/3967393234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad8c14da00 0x7fad8c157ad0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7fad84001450 tx=0x7fad840019c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.065 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.061+0000 7fad897fa700 1 -- 172.21.15.38:0/3967393234 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7fad8403fea0 con 0x7fad8c14da00 2020-06-12T17:48:39.065 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:39.066 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.062+0000 7fad92499700 1 -- 172.21.15.38:0/3967393234 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fad6c04d8f0 msgr2=0x7fad6c04fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:39.066 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.062+0000 7fad92499700 1 --2- 172.21.15.38:0/3967393234 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fad6c04d8f0 0x7fad6c04fdb0 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7fad7c0088e0 tx=0x7fad7c007e60).stop 2020-06-12T17:48:39.067 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.062+0000 7fad92499700 1 -- 172.21.15.38:0/3967393234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad8c14da00 msgr2=0x7fad8c157ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:39.067 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.062+0000 7fad92499700 1 --2- 172.21.15.38:0/3967393234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad8c14da00 0x7fad8c157ad0 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7fad84001450 tx=0x7fad840019c0).stop 2020-06-12T17:48:39.067 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.062+0000 7fad92499700 1 -- 172.21.15.38:0/3967393234 shutdown_connections 2020-06-12T17:48:39.067 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.062+0000 7fad92499700 1 --2- 172.21.15.38:0/3967393234 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fad6c04d8f0 0x7fad6c04fdb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:39.067 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.062+0000 7fad92499700 1 --2- 172.21.15.38:0/3967393234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad8c14da00 0x7fad8c157ad0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:39.068 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.062+0000 7fad92499700 1 --2- 172.21.15.38:0/3967393234 >> v2:172.21.15.150:3300/0 conn(0x7fad8c14a850 0x7fad8c09cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:39.068 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.062+0000 7fad92499700 1 -- 172.21.15.38:0/3967393234 >> 172.21.15.38:0/3967393234 conn(0x7fad8c0b5a20 msgr2=0x7fad8c099c90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:39.068 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.062+0000 7fad92499700 1 -- 172.21.15.38:0/3967393234 shutdown_connections 2020-06-12T17:48:39.068 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.062+0000 7fad92499700 1 -- 172.21.15.38:0/3967393234 wait complete. 2020-06-12T17:48:39.076 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-06-12T17:48:39.193 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.190+0000 7f77c2c9f700 1 Processor -- start 2020-06-12T17:48:39.194 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.190+0000 7f77c2c9f700 1 -- start start 2020-06-12T17:48:39.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.190+0000 7f77c2c9f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f77bc0b3ac0 0x7f77bc09df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:39.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.190+0000 7f77c2c9f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc142e90 0x7f77bc13bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:39.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.191+0000 7f77c2c9f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77bc09b960 con 0x7f77bc13c3a0 2020-06-12T17:48:39.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.191+0000 7f77c2c9f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77bc09bc00 con 0x7f77bc0b3ac0 2020-06-12T17:48:39.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.191+0000 7f77c2c9f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc0b48f0 con 0x7f77bc142e90 2020-06-12T17:48:39.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.191+0000 7f77bbfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc142e90 0x7f77bc13bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:39.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.191+0000 7f77c0a3b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f77bc0b3ac0 0x7f77bc09df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:39.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.191+0000 7f77bbfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc142e90 0x7f77bc13bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:55850/0 (socket says 172.21.15.38:55850) 2020-06-12T17:48:39.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.191+0000 7f77bbfff700 1 -- 172.21.15.38:0/288670813 learned_addr learned my addr 172.21.15.38:0/288670813 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:39.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.191+0000 7f77bbfff700 1 -- 172.21.15.38:0/288670813 >> v2:172.21.15.150:3300/0 conn(0x7f77bc0b3ac0 msgr2=0x7f77bc09df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:39.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.191+0000 7f77bbfff700 1 --2- 172.21.15.38:0/288670813 >> v2:172.21.15.150:3300/0 conn(0x7f77bc0b3ac0 0x7f77bc09df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:39.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.191+0000 7f77bbfff700 1 -- 172.21.15.38:0/288670813 >> v1:172.21.15.150:6789/0 conn(0x7f77bc13c3a0 legacy=0x7f77bc066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:39.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.191+0000 7f77bbfff700 1 -- 172.21.15.38:0/288670813 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77bc0b3ea0 con 0x7f77bc142e90 2020-06-12T17:48:39.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.191+0000 7f77bbfff700 1 --2- 172.21.15.38:0/288670813 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc142e90 0x7f77bc13bf40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f77ac002f30 tx=0x7f77ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.191+0000 7f77bbfff700 1 --2- 172.21.15.38:0/288670813 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc142e90 0x7f77bc13bf40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f77ac002f30 tx=0x7f77ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.191+0000 7f77bbfff700 1 --2- 172.21.15.38:0/288670813 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc142e90 0x7f77bc13bf40 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f77ac002f30 tx=0x7f77ac007e60).ready entity=mon.2 client_cookie=32f8408e44cc4c46 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:39.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.192+0000 7f77bbfff700 1 --2- 172.21.15.38:0/288670813 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc142e90 0x7f77bc13bf40 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f77ac002f30 tx=0x7f77ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.192+0000 7f77bb7fe700 1 -- 172.21.15.38:0/288670813 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77ac011630 con 0x7f77bc142e90 2020-06-12T17:48:39.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.192+0000 7f77bbfff700 1 --2- 172.21.15.38:0/288670813 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc142e90 0x7f77bc13bf40 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f77ac002f30 tx=0x7f77ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.192+0000 7f77bbfff700 1 --2- 172.21.15.38:0/288670813 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc142e90 0x7f77bc13bf40 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f77ac002f30 tx=0x7f77ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.192+0000 7f77bb7fe700 1 -- 172.21.15.38:0/288670813 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac011790 con 0x7f77bc142e90 2020-06-12T17:48:39.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.192+0000 7f77bb7fe700 1 -- 172.21.15.38:0/288670813 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77ac011bb0 con 0x7f77bc142e90 2020-06-12T17:48:39.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.192+0000 7f77c2c9f700 1 -- 172.21.15.38:0/288670813 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc142e90 msgr2=0x7f77bc13bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:39.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.192+0000 7f77c2c9f700 1 --2- 172.21.15.38:0/288670813 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc142e90 0x7f77bc13bf40 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f77ac002f30 tx=0x7f77ac007e60).stop 2020-06-12T17:48:39.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.192+0000 7f77c2c9f700 1 -- 172.21.15.38:0/288670813 shutdown_connections 2020-06-12T17:48:39.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.192+0000 7f77c2c9f700 1 --2- 172.21.15.38:0/288670813 >> v2:172.21.15.150:3300/0 conn(0x7f77bc0b3ac0 0x7f77bc09df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:39.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.192+0000 7f77c2c9f700 1 --2- 172.21.15.38:0/288670813 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc142e90 0x7f77bc13bf40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:39.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.192+0000 7f77c2c9f700 1 -- 172.21.15.38:0/288670813 >> 172.21.15.38:0/288670813 conn(0x7f77bc0b5a20 msgr2=0x7f77bc05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:39.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.192+0000 7f77c2c9f700 1 -- 172.21.15.38:0/288670813 shutdown_connections 2020-06-12T17:48:39.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.192+0000 7f77c2c9f700 1 -- 172.21.15.38:0/288670813 wait complete. 2020-06-12T17:48:39.203 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.193+0000 7f77c2c9f700 1 Processor -- start 2020-06-12T17:48:39.203 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.193+0000 7f77c2c9f700 1 -- start start 2020-06-12T17:48:39.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.194+0000 7f77c2c9f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc13c3a0 0x7f77bc13bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:39.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.194+0000 7f77c2c9f700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77bc0b0fd0 con 0x7f77bc0b3ac0 2020-06-12T17:48:39.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.194+0000 7f77c2c9f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77bc0b1270 con 0x7f77bc142e90 2020-06-12T17:48:39.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.194+0000 7f77c2c9f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc0b1510 con 0x7f77bc13c3a0 2020-06-12T17:48:39.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.194+0000 7f77c0a3b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f77bc0b3ac0 0x7f77bc13b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38214/0 (socket says 172.21.15.38:38214) 2020-06-12T17:48:39.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.194+0000 7f77c0a3b700 1 -- 172.21.15.38:0/4100752891 learned_addr learned my addr 172.21.15.38:0/4100752891 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:39.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.194+0000 7f77bbfff700 1 --2- 172.21.15.38:0/4100752891 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc13c3a0 0x7f77bc13bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:39.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.194+0000 7f77b9ffb700 1 -- 172.21.15.38:0/4100752891 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3045119546 0 0) 0x7f77bc0b0fd0 con 0x7f77bc0b3ac0 2020-06-12T17:48:39.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.194+0000 7f77b9ffb700 1 -- 172.21.15.38:0/4100752891 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77a0002fe0 con 0x7f77bc0b3ac0 2020-06-12T17:48:39.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.194+0000 7f77b9ffb700 1 -- 172.21.15.38:0/4100752891 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020218985 0 0) 0x7f77bc0b1270 con 0x7f77bc142e90 2020-06-12T17:48:39.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.194+0000 7f77b9ffb700 1 -- 172.21.15.38:0/4100752891 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77bc0b0fd0 con 0x7f77bc142e90 2020-06-12T17:48:39.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.195+0000 7f77bbfff700 1 -- 172.21.15.38:0/4100752891 >> v1:172.21.15.150:6789/0 conn(0x7f77bc142e90 legacy=0x7f77bc0b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:39.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.195+0000 7f77bbfff700 1 -- 172.21.15.38:0/4100752891 >> v1:172.21.15.38:6789/0 conn(0x7f77bc0b3ac0 legacy=0x7f77bc13b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:39.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.195+0000 7f77bbfff700 1 -- 172.21.15.38:0/4100752891 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77bc0b07d0 con 0x7f77bc13c3a0 2020-06-12T17:48:39.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.195+0000 7f77bbfff700 1 --2- 172.21.15.38:0/4100752891 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc13c3a0 0x7f77bc13bb20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f77ac002f30 tx=0x7f77ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.195+0000 7f77bbfff700 1 --2- 172.21.15.38:0/4100752891 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc13c3a0 0x7f77bc13bb20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f77ac002f30 tx=0x7f77ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.195+0000 7f77bbfff700 1 --2- 172.21.15.38:0/4100752891 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc13c3a0 0x7f77bc13bb20 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f77ac002f30 tx=0x7f77ac007e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:39.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.195+0000 7f77bbfff700 1 --2- 172.21.15.38:0/4100752891 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc13c3a0 0x7f77bc13bb20 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f77ac002f30 tx=0x7f77ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.195+0000 7f77b9ffb700 1 -- 172.21.15.38:0/4100752891 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77ac00f910 con 0x7f77bc13c3a0 2020-06-12T17:48:39.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.195+0000 7f77bbfff700 1 --2- 172.21.15.38:0/4100752891 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc13c3a0 0x7f77bc13bb20 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f77ac002f30 tx=0x7f77ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.195+0000 7f77b9ffb700 1 -- 172.21.15.38:0/4100752891 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac011e30 con 0x7f77bc13c3a0 2020-06-12T17:48:39.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.195+0000 7f77bbfff700 1 --2- 172.21.15.38:0/4100752891 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc13c3a0 0x7f77bc13bb20 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f77ac002f30 tx=0x7f77ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.195+0000 7f77c2c9f700 1 -- 172.21.15.38:0/4100752891 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77bc0b0a50 con 0x7f77bc13c3a0 2020-06-12T17:48:39.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.195+0000 7f77b9ffb700 1 -- 172.21.15.38:0/4100752891 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77ac007340 con 0x7f77bc13c3a0 2020-06-12T17:48:39.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.195+0000 7f77c2c9f700 1 -- 172.21.15.38:0/4100752891 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77bc0af6c0 con 0x7f77bc13c3a0 2020-06-12T17:48:39.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.196+0000 7f77bbfff700 1 --2- 172.21.15.38:0/4100752891 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc13c3a0 0x7f77bc13bb20 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f77ac002f30 tx=0x7f77ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.196+0000 7f77c2c9f700 1 -- 172.21.15.38:0/4100752891 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77bc0b16d0 con 0x7f77bc13c3a0 2020-06-12T17:48:39.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.196+0000 7f77b9ffb700 1 -- 172.21.15.38:0/4100752891 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f77ac0056c0 con 0x7f77bc13c3a0 2020-06-12T17:48:39.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.196+0000 7f77bbfff700 1 --2- 172.21.15.38:0/4100752891 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc13c3a0 0x7f77bc13bb20 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f77ac002f30 tx=0x7f77ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.196+0000 7f77b9ffb700 1 --2- 172.21.15.38:0/4100752891 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f77a004da30 0x7f77a004fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:39.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.196+0000 7f77b9ffb700 1 -- 172.21.15.38:0/4100752891 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f77ac0610b0 con 0x7f77bc13c3a0 2020-06-12T17:48:39.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.197+0000 7f77c0a3b700 1 --2- 172.21.15.38:0/4100752891 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f77a004da30 0x7f77a004fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:39.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.197+0000 7f77c0a3b700 1 --2- 172.21.15.38:0/4100752891 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f77a004da30 0x7f77a004fef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f77a4002f30 tx=0x7f77a4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.197+0000 7f77c0a3b700 1 --2- 172.21.15.38:0/4100752891 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f77a004da30 0x7f77a004fef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f77a4002f30 tx=0x7f77a4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.197+0000 7f77c0a3b700 1 --2- 172.21.15.38:0/4100752891 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f77a004da30 0x7f77a004fef0 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f77a4002f30 tx=0x7f77a4007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:39.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.200+0000 7f77bbfff700 1 --2- 172.21.15.38:0/4100752891 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc13c3a0 0x7f77bc13bb20 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f77ac002f30 tx=0x7f77ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.200+0000 7f77b9ffb700 1 -- 172.21.15.38:0/4100752891 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f77ac03c8b0 con 0x7f77bc13c3a0 2020-06-12T17:48:39.356 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.352+0000 7f77c2c9f700 1 -- 172.21.15.38:0/4100752891 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f77bc056c30 con 0x7f77bc13c3a0 2020-06-12T17:48:39.356 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.353+0000 7f77bbfff700 1 --2- 172.21.15.38:0/4100752891 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc13c3a0 0x7f77bc13bb20 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7f77ac002f30 tx=0x7f77ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.353+0000 7f77b9ffb700 1 -- 172.21.15.38:0/4100752891 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f77ac03fed0 con 0x7f77bc13c3a0 2020-06-12T17:48:39.357 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:39.358 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.355+0000 7f77c2c9f700 1 -- 172.21.15.38:0/4100752891 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f77a004da30 msgr2=0x7f77a004fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:39.358 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.355+0000 7f77c2c9f700 1 --2- 172.21.15.38:0/4100752891 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f77a004da30 0x7f77a004fef0 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f77a4002f30 tx=0x7f77a4007e60).stop 2020-06-12T17:48:39.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.355+0000 7f77c2c9f700 1 -- 172.21.15.38:0/4100752891 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc13c3a0 msgr2=0x7f77bc13bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:39.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.355+0000 7f77c2c9f700 1 --2- 172.21.15.38:0/4100752891 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc13c3a0 0x7f77bc13bb20 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f77ac002f30 tx=0x7f77ac007e60).stop 2020-06-12T17:48:39.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.355+0000 7f77c2c9f700 1 -- 172.21.15.38:0/4100752891 shutdown_connections 2020-06-12T17:48:39.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.355+0000 7f77c2c9f700 1 --2- 172.21.15.38:0/4100752891 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f77a004da30 0x7f77a004fef0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:39.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.355+0000 7f77c2c9f700 1 --2- 172.21.15.38:0/4100752891 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77bc13c3a0 0x7f77bc13bb20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:39.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.355+0000 7f77c2c9f700 1 -- 172.21.15.38:0/4100752891 >> 172.21.15.38:0/4100752891 conn(0x7f77bc0b5a20 msgr2=0x7f77bc09cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:39.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.355+0000 7f77c2c9f700 1 -- 172.21.15.38:0/4100752891 shutdown_connections 2020-06-12T17:48:39.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.355+0000 7f77c2c9f700 1 -- 172.21.15.38:0/4100752891 wait complete. 2020-06-12T17:48:39.372 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-06-12T17:48:39.372 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-06-12T17:48:39.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.483+0000 7f6b0106e700 1 Processor -- start 2020-06-12T17:48:39.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.483+0000 7f6b0106e700 1 -- start start 2020-06-12T17:48:39.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.484+0000 7f6b0106e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6afc09dd30 0x7f6afc0b3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:39.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.484+0000 7f6b0106e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6afc05bf20 0x7f6afc061d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:39.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.484+0000 7f6b0106e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6afc0b3b80 con 0x7f6afc062180 2020-06-12T17:48:39.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.484+0000 7f6b0106e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6afc05c3a0 con 0x7f6afc05bf20 2020-06-12T17:48:39.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.484+0000 7f6b0106e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc061880 con 0x7f6afc09dd30 2020-06-12T17:48:39.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.484+0000 7f6afa59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6afc05bf20 0x7f6afc061d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:39.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.484+0000 7f6afa59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6afc05bf20 0x7f6afc061d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36404/0 (socket says 172.21.15.38:36404) 2020-06-12T17:48:39.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.484+0000 7f6afa59c700 1 -- 172.21.15.38:0/463165997 learned_addr learned my addr 172.21.15.38:0/463165997 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:39.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.484+0000 7f6afad9d700 1 --2- 172.21.15.38:0/463165997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6afc09dd30 0x7f6afc0b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:39.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.484+0000 7f6afa59c700 1 -- 172.21.15.38:0/463165997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6afc09dd30 msgr2=0x7f6afc0b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:39.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.484+0000 7f6afa59c700 1 --2- 172.21.15.38:0/463165997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6afc09dd30 0x7f6afc0b3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:39.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.484+0000 7f6afa59c700 1 -- 172.21.15.38:0/463165997 >> v1:172.21.15.150:6789/0 conn(0x7f6afc062180 legacy=0x7f6afc147410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:39.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.484+0000 7f6afa59c700 1 -- 172.21.15.38:0/463165997 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6afc0625d0 con 0x7f6afc05bf20 2020-06-12T17:48:39.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.484+0000 7f6afad9d700 1 --2- 172.21.15.38:0/463165997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6afc09dd30 0x7f6afc0b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:48:39.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.484+0000 7f6afa59c700 1 --2- 172.21.15.38:0/463165997 >> v2:172.21.15.38:3300/0 conn(0x7f6afc05bf20 0x7f6afc061d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6afc060250 tx=0x7f6aec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.484+0000 7f6afa59c700 1 --2- 172.21.15.38:0/463165997 >> v2:172.21.15.38:3300/0 conn(0x7f6afc05bf20 0x7f6afc061d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6afc060250 tx=0x7f6aec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.485+0000 7f6afa59c700 1 --2- 172.21.15.38:0/463165997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6afc05bf20 0x7f6afc061d20 secure :-1 s=READY pgs=249 cs=0 l=1 rx=0x7f6afc060250 tx=0x7f6aec007e60).ready entity=mon.0 client_cookie=26866d2f6cbb890c server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:39.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.485+0000 7f6afa59c700 1 --2- 172.21.15.38:0/463165997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6afc05bf20 0x7f6afc061d20 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7f6afc060250 tx=0x7f6aec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.485+0000 7f6afa59c700 1 --2- 172.21.15.38:0/463165997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6afc05bf20 0x7f6afc061d20 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7f6afc060250 tx=0x7f6aec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.485+0000 7f6afa59c700 1 --2- 172.21.15.38:0/463165997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6afc05bf20 0x7f6afc061d20 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7f6afc060250 tx=0x7f6aec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.485+0000 7f6af9d9b700 1 -- 172.21.15.38:0/463165997 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6aec0116a0 con 0x7f6afc05bf20 2020-06-12T17:48:39.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.485+0000 7f6af9d9b700 1 -- 172.21.15.38:0/463165997 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aec011800 con 0x7f6afc05bf20 2020-06-12T17:48:39.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.485+0000 7f6af9d9b700 1 -- 172.21.15.38:0/463165997 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6aec011c20 con 0x7f6afc05bf20 2020-06-12T17:48:39.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.485+0000 7f6b0106e700 1 -- 172.21.15.38:0/463165997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6afc05bf20 msgr2=0x7f6afc061d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:39.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.485+0000 7f6b0106e700 1 --2- 172.21.15.38:0/463165997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6afc05bf20 0x7f6afc061d20 secure :-1 s=READY pgs=249 cs=0 l=1 rx=0x7f6afc060250 tx=0x7f6aec007e60).stop 2020-06-12T17:48:39.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.485+0000 7f6b0106e700 1 -- 172.21.15.38:0/463165997 shutdown_connections 2020-06-12T17:48:39.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.485+0000 7f6b0106e700 1 --2- 172.21.15.38:0/463165997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6afc09dd30 0x7f6afc0b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:39.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.485+0000 7f6b0106e700 1 --2- 172.21.15.38:0/463165997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6afc05bf20 0x7f6afc061d20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:39.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.485+0000 7f6b0106e700 1 -- 172.21.15.38:0/463165997 >> 172.21.15.38:0/463165997 conn(0x7f6afc0b8420 msgr2=0x7f6afc0b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:39.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.485+0000 7f6b0106e700 1 -- 172.21.15.38:0/463165997 shutdown_connections 2020-06-12T17:48:39.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.485+0000 7f6b0106e700 1 -- 172.21.15.38:0/463165997 wait complete. 2020-06-12T17:48:39.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.486+0000 7f6b0106e700 1 Processor -- start 2020-06-12T17:48:39.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.486+0000 7f6b0106e700 1 -- start start 2020-06-12T17:48:39.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.487+0000 7f6b0106e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6afc05bf20 0x7f6afc0666d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:39.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.487+0000 7f6b0106e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6afc0664e0 con 0x7f6afc09dd30 2020-06-12T17:48:39.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.487+0000 7f6b0106e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6afc065040 con 0x7f6afc062180 2020-06-12T17:48:39.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.487+0000 7f6b0106e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6afc0652e0 con 0x7f6afc05bf20 2020-06-12T17:48:39.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.487+0000 7f6afad9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6afc05bf20 0x7f6afc0666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:39.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.487+0000 7f6afad9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6afc05bf20 0x7f6afc0666d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36410/0 (socket says 172.21.15.38:36410) 2020-06-12T17:48:39.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.487+0000 7f6afad9d700 1 -- 172.21.15.38:0/4041044855 learned_addr learned my addr 172.21.15.38:0/4041044855 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:39.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.487+0000 7f6afb59e700 1 --1- 172.21.15.38:0/4041044855 >> v1:172.21.15.38:6789/0 conn(0x7f6afc09dd30 0x7f6afc09b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38230/0 (socket says 172.21.15.38:38230) 2020-06-12T17:48:39.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.487+0000 7f6afad9d700 1 -- 172.21.15.38:0/4041044855 >> v1:172.21.15.150:6789/0 conn(0x7f6afc062180 legacy=0x7f6afc13ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:39.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.487+0000 7f6afad9d700 1 -- 172.21.15.38:0/4041044855 >> v1:172.21.15.38:6789/0 conn(0x7f6afc09dd30 legacy=0x7f6afc09b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:39.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.487+0000 7f6aebfff700 1 -- 172.21.15.38:0/4041044855 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610488199 0 0) 0x7f6afc0664e0 con 0x7f6afc09dd30 2020-06-12T17:48:39.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.487+0000 7f6afad9d700 1 -- 172.21.15.38:0/4041044855 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6afc065580 con 0x7f6afc05bf20 2020-06-12T17:48:39.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.487+0000 7f6afad9d700 1 --2- 172.21.15.38:0/4041044855 >> v2:172.21.15.38:3300/0 conn(0x7f6afc05bf20 0x7f6afc0666d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6afc066670 tx=0x7f6af0007ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.487+0000 7f6afad9d700 1 --2- 172.21.15.38:0/4041044855 >> v2:172.21.15.38:3300/0 conn(0x7f6afc05bf20 0x7f6afc0666d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6afc066670 tx=0x7f6af0007ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.502 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.487+0000 7f6afad9d700 1 --2- 172.21.15.38:0/4041044855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6afc05bf20 0x7f6afc0666d0 secure :-1 s=READY pgs=251 cs=0 l=1 rx=0x7f6afc066670 tx=0x7f6af0007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:39.502 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.488+0000 7f6afad9d700 1 --2- 172.21.15.38:0/4041044855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6afc05bf20 0x7f6afc0666d0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7f6afc066670 tx=0x7f6af0007ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.502 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.488+0000 7f6afad9d700 1 --2- 172.21.15.38:0/4041044855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6afc05bf20 0x7f6afc0666d0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7f6afc066670 tx=0x7f6af0007ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.502 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.488+0000 7f6aebfff700 1 -- 172.21.15.38:0/4041044855 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6af0008e80 con 0x7f6afc05bf20 2020-06-12T17:48:39.502 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.488+0000 7f6afad9d700 1 --2- 172.21.15.38:0/4041044855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6afc05bf20 0x7f6afc0666d0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7f6afc066670 tx=0x7f6af0007ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.488+0000 7f6aebfff700 1 -- 172.21.15.38:0/4041044855 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af0007160 con 0x7f6afc05bf20 2020-06-12T17:48:39.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.488+0000 7f6b0106e700 1 -- 172.21.15.38:0/4041044855 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6afc13f3e0 con 0x7f6afc05bf20 2020-06-12T17:48:39.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.488+0000 7f6aebfff700 1 -- 172.21.15.38:0/4041044855 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6af0007540 con 0x7f6afc05bf20 2020-06-12T17:48:39.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.488+0000 7f6b0106e700 1 -- 172.21.15.38:0/4041044855 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6afc09d330 con 0x7f6afc05bf20 2020-06-12T17:48:39.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.488+0000 7f6afad9d700 1 --2- 172.21.15.38:0/4041044855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6afc05bf20 0x7f6afc0666d0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7f6afc066670 tx=0x7f6af0007ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.489+0000 7f6b0106e700 1 -- 172.21.15.38:0/4041044855 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6afc056c30 con 0x7f6afc05bf20 2020-06-12T17:48:39.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.489+0000 7f6aebfff700 1 -- 172.21.15.38:0/4041044855 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f6af00059c0 con 0x7f6afc05bf20 2020-06-12T17:48:39.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.489+0000 7f6afad9d700 1 --2- 172.21.15.38:0/4041044855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6afc05bf20 0x7f6afc0666d0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7f6afc066670 tx=0x7f6af0007ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.489+0000 7f6aebfff700 1 --2- 172.21.15.38:0/4041044855 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6ad804d550 0x7f6ad804fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:39.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.489+0000 7f6aebfff700 1 -- 172.21.15.38:0/4041044855 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f6af0060bf0 con 0x7f6afc05bf20 2020-06-12T17:48:39.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.489+0000 7f6afa59c700 1 --2- 172.21.15.38:0/4041044855 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6ad804d550 0x7f6ad804fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:39.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.490+0000 7f6afa59c700 1 --2- 172.21.15.38:0/4041044855 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6ad804d550 0x7f6ad804fa10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6afc060250 tx=0x7f6aec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.490+0000 7f6afa59c700 1 --2- 172.21.15.38:0/4041044855 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6ad804d550 0x7f6ad804fa10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6afc060250 tx=0x7f6aec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.490+0000 7f6afa59c700 1 --2- 172.21.15.38:0/4041044855 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6ad804d550 0x7f6ad804fa10 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f6afc060250 tx=0x7f6aec007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:39.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.493+0000 7f6afad9d700 1 --2- 172.21.15.38:0/4041044855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6afc05bf20 0x7f6afc0666d0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7f6afc066670 tx=0x7f6af0007ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.506 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.493+0000 7f6aebfff700 1 -- 172.21.15.38:0/4041044855 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f6af003c3b0 con 0x7f6afc05bf20 2020-06-12T17:48:39.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.693+0000 7f6b0106e700 1 -- 172.21.15.38:0/4041044855 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6afc0b3890 con 0x7f6afc05bf20 2020-06-12T17:48:39.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.693+0000 7f6afad9d700 1 --2- 172.21.15.38:0/4041044855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6afc05bf20 0x7f6afc0666d0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7f6afc066670 tx=0x7f6af0007ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:39.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.693+0000 7f6aebfff700 1 -- 172.21.15.38:0/4041044855 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2137 (secure 0 0 0) 0x7f6af003f9d0 con 0x7f6afc05bf20 2020-06-12T17:48:39.698 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:39.699 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1134306892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1134306892},{"type":"v1","addr":"172.21.15.150:6835","nonce":1134306892}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-06-12T17:48:14.851844+0000","modified":"2020-06-12T17:48:18.530885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4389":{"gid":4389,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.38:6833/4064318189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":4064318189},{"type":"v1","addr":"172.21.15.38:6833","nonce":4064318189}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-06-12T17:48:39.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.695+0000 7f6b0106e700 1 -- 172.21.15.38:0/4041044855 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6ad804d550 msgr2=0x7f6ad804fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:39.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.695+0000 7f6b0106e700 1 --2- 172.21.15.38:0/4041044855 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6ad804d550 0x7f6ad804fa10 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f6afc060250 tx=0x7f6aec007e60).stop 2020-06-12T17:48:39.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.695+0000 7f6b0106e700 1 -- 172.21.15.38:0/4041044855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6afc05bf20 msgr2=0x7f6afc0666d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:39.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.695+0000 7f6b0106e700 1 --2- 172.21.15.38:0/4041044855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6afc05bf20 0x7f6afc0666d0 secure :-1 s=READY pgs=251 cs=0 l=1 rx=0x7f6afc066670 tx=0x7f6af0007ef0).stop 2020-06-12T17:48:39.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.695+0000 7f6b0106e700 1 -- 172.21.15.38:0/4041044855 shutdown_connections 2020-06-12T17:48:39.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.695+0000 7f6b0106e700 1 --2- 172.21.15.38:0/4041044855 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6ad804d550 0x7f6ad804fa10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:39.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.695+0000 7f6b0106e700 1 --2- 172.21.15.38:0/4041044855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6afc05bf20 0x7f6afc0666d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:39.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.695+0000 7f6b0106e700 1 -- 172.21.15.38:0/4041044855 >> 172.21.15.38:0/4041044855 conn(0x7f6afc0b8420 msgr2=0x7f6afc0b6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:39.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.695+0000 7f6b0106e700 1 -- 172.21.15.38:0/4041044855 shutdown_connections 2020-06-12T17:48:39.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:39.695+0000 7f6b0106e700 1 -- 172.21.15.38:0/4041044855 wait complete. 2020-06-12T17:48:39.702 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 6 2020-06-12T17:48:39.909 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-06-12T17:48:14.851844+0000', 'modified': '2020-06-12T17:48:18.530885+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4389}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4389': {'gid': 4389, 'name': 'a', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.38:6833/4064318189', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6832', 'nonce': 4064318189}, {'type': 'v1', 'addr': '172.21.15.38:6833', 'nonce': 4064318189}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292836696063, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-06-12T17:48:39.910 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-06-12T17:48:39.910 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-06-12T17:48:40.040 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2020-06-12T17:48:40.040 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "8e42a2e7-b187-42c4-a73f-8f812ee62352", 2020-06-12T17:48:40.041 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2020-06-12T17:48:40.041 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 4389, 2020-06-12T17:48:40.042 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2020-06-12T17:48:40.042 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2020-06-12T17:48:40.042 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 22.506721094, 2020-06-12T17:48:40.043 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 6, 2020-06-12T17:48:40.043 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 24, 2020-06-12T17:48:40.043 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 24, 2020-06-12T17:48:40.044 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 22.782699450999999 2020-06-12T17:48:40.044 INFO:teuthology.orchestra.run.smithi038.stdout:} 2020-06-12T17:48:40.049 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "8e42a2e7-b187-42c4-a73f-8f812ee62352", "whoami": 0, "id": 4389, "want_state": "up:active", "state": "up:active", "rank_uptime": 22.506721094, "mdsmap_epoch": 6, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "uptime": 22.782699450999999 } 2020-06-12T17:48:40.049 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-06-12T17:48:40.050 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2020-06-12T17:48:40.050 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.3 at ubuntu@smithi150.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.3... 2020-06-12T17:48:40.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:40.052 INFO:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.3) 2020-06-12T17:48:40.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:40.071 INFO:teuthology.orchestra.run.smithi150:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-06-12T17:48:40.143 INFO:teuthology.orchestra.run.smithi150.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-06-12T17:48:40.144 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-06-12T17:48:40.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:40.145 INFO:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2020-06-12T17:48:40.200 INFO:teuthology.orchestra.run.smithi150.stdout:46 2020-06-12T17:48:40.201 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [46] 2020-06-12T17:48:40.201 INFO:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.3 /home/ubuntu/cephtest/mnt.3) 2020-06-12T17:48:40.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:40.243 INFO:teuthology.orchestra.run.smithi150:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-06-12T17:48:40.273 INFO:teuthology.orchestra.run.smithi150.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-06-12T17:48:40.274 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-06-12T17:48:40.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:40.275 INFO:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2020-06-12T17:48:40.326 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi150.stderr:2020-06-12T17:48:40.323+0000 7fb1e45951c0 -1 init, newargv = 0x55d5b2eca280 newargc=9 2020-06-12T17:48:40.326 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi150.stderr:ceph-fuse[32187]: starting ceph client 2020-06-12T17:48:40.330 INFO:teuthology.orchestra.run.smithi150.stdout:46 2020-06-12T17:48:40.331 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi150.stderr:ceph-fuse[32187]: starting fuse 2020-06-12T17:48:41.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:41.434 INFO:teuthology.orchestra.run.smithi150:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-06-12T17:48:41.465 INFO:teuthology.orchestra.run.smithi150.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-06-12T17:48:41.466 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-06-12T17:48:41.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:41.467 INFO:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2020-06-12T17:48:41.524 INFO:teuthology.orchestra.run.smithi150.stdout:46 2020-06-12T17:48:41.524 INFO:teuthology.orchestra.run.smithi150.stdout:48 2020-06-12T17:48:41.525 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46, 48] 2020-06-12T17:48:41.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:41.526 INFO:teuthology.orchestra.run.smithi150:> sudo python3 -c ' 2020-06-12T17:48:41.526 INFO:teuthology.orchestra.run.smithi150:> import glob 2020-06-12T17:48:41.527 INFO:teuthology.orchestra.run.smithi150:> import re 2020-06-12T17:48:41.528 INFO:teuthology.orchestra.run.smithi150:> import os 2020-06-12T17:48:41.528 INFO:teuthology.orchestra.run.smithi150:> import subprocess 2020-06-12T17:48:41.529 INFO:teuthology.orchestra.run.smithi150:> 2020-06-12T17:48:41.530 INFO:teuthology.orchestra.run.smithi150:> def find_socket(client_name): 2020-06-12T17:48:41.530 INFO:teuthology.orchestra.run.smithi150:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2020-06-12T17:48:41.531 INFO:teuthology.orchestra.run.smithi150:> files = glob.glob(asok_path) 2020-06-12T17:48:41.531 INFO:teuthology.orchestra.run.smithi150:> 2020-06-12T17:48:41.532 INFO:teuthology.orchestra.run.smithi150:> # Given a non-glob path, it better be there 2020-06-12T17:48:41.532 INFO:teuthology.orchestra.run.smithi150:> if "*" not in asok_path: 2020-06-12T17:48:41.533 INFO:teuthology.orchestra.run.smithi150:> assert(len(files) == 1) 2020-06-12T17:48:41.533 INFO:teuthology.orchestra.run.smithi150:> return files[0] 2020-06-12T17:48:41.534 INFO:teuthology.orchestra.run.smithi150:> 2020-06-12T17:48:41.534 INFO:teuthology.orchestra.run.smithi150:> for f in files: 2020-06-12T17:48:41.534 INFO:teuthology.orchestra.run.smithi150:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-06-12T17:48:41.535 INFO:teuthology.orchestra.run.smithi150:> if os.path.exists("/proc/{0}".format(pid)): 2020-06-12T17:48:41.536 INFO:teuthology.orchestra.run.smithi150:> return f 2020-06-12T17:48:41.536 INFO:teuthology.orchestra.run.smithi150:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-06-12T17:48:41.537 INFO:teuthology.orchestra.run.smithi150:> 2020-06-12T17:48:41.537 INFO:teuthology.orchestra.run.smithi150:> print(find_socket("client.3")) 2020-06-12T17:48:41.538 INFO:teuthology.orchestra.run.smithi150:> ' 2020-06-12T17:48:41.620 INFO:teuthology.orchestra.run.smithi150.stdout:/var/run/ceph/ceph-client.3.32187.asok 2020-06-12T17:48:41.624 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.32187.asok 2020-06-12T17:48:41.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:41.627 INFO:teuthology.orchestra.run.smithi150:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.32187.asok status 2020-06-12T17:48:41.732 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2020-06-12T17:48:41.733 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": { 2020-06-12T17:48:41.733 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_sha1": "91d24f498556f86f6d1318d2efd5210c35b36762", 2020-06-12T17:48:41.733 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_version": "ceph version 15.2.3-196-g91d24f4 (91d24f498556f86f6d1318d2efd5210c35b36762) octopus (stable)", 2020-06-12T17:48:41.733 INFO:teuthology.orchestra.run.smithi150.stdout: "entity_id": "3", 2020-06-12T17:48:41.734 INFO:teuthology.orchestra.run.smithi150.stdout: "hostname": "smithi150", 2020-06-12T17:48:41.734 INFO:teuthology.orchestra.run.smithi150.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2020-06-12T17:48:41.734 INFO:teuthology.orchestra.run.smithi150.stdout: "pid": "32187", 2020-06-12T17:48:41.734 INFO:teuthology.orchestra.run.smithi150.stdout: "root": "/" 2020-06-12T17:48:41.734 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2020-06-12T17:48:41.735 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_count": 0, 2020-06-12T17:48:41.735 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_pinned_count": 0, 2020-06-12T17:48:41.735 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 4445, 2020-06-12T17:48:41.735 INFO:teuthology.orchestra.run.smithi150.stdout: "inst": { 2020-06-12T17:48:41.735 INFO:teuthology.orchestra.run.smithi150.stdout: "name": { 2020-06-12T17:48:41.736 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "client", 2020-06-12T17:48:41.736 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4445 2020-06-12T17:48:41.736 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2020-06-12T17:48:41.736 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2020-06-12T17:48:41.736 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2020-06-12T17:48:41.737 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:0", 2020-06-12T17:48:41.737 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 2938195843 2020-06-12T17:48:41.737 INFO:teuthology.orchestra.run.smithi150.stdout: } 2020-06-12T17:48:41.737 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2020-06-12T17:48:41.738 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2020-06-12T17:48:41.738 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2020-06-12T17:48:41.738 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:0", 2020-06-12T17:48:41.738 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 2938195843 2020-06-12T17:48:41.738 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2020-06-12T17:48:41.739 INFO:teuthology.orchestra.run.smithi150.stdout: "inst_str": "client.4445 172.21.15.150:0/2938195843", 2020-06-12T17:48:41.739 INFO:teuthology.orchestra.run.smithi150.stdout: "addr_str": "172.21.15.150:0/2938195843", 2020-06-12T17:48:41.739 INFO:teuthology.orchestra.run.smithi150.stdout: "inode_count": 1, 2020-06-12T17:48:41.739 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_epoch": 6, 2020-06-12T17:48:41.739 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch": 24, 2020-06-12T17:48:41.739 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch_barrier": 0, 2020-06-12T17:48:41.740 INFO:teuthology.orchestra.run.smithi150.stdout: "blacklisted": false 2020-06-12T17:48:41.740 INFO:teuthology.orchestra.run.smithi150.stdout:} 2020-06-12T17:48:41.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:41.741 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:48:41.742 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:48:41.760 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:48:41.761 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:48:41.761 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:41.762 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:48:41.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:41.852 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:48:41.852 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-06-12T17:48:41.918 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:48:41.919 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-06-12T17:48:41.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:41.920 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-06-12T17:48:42.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:42.016 INFO:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:48:42.017 INFO:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.2) 2020-06-12T17:48:42.043 INFO:teuthology.orchestra.run.smithi150.stdout:fuseblk 2020-06-12T17:48:42.044 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2020-06-12T17:48:42.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:42.045 INFO:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.2) 2020-06-12T17:48:42.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:42.128 INFO:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:48:42.128 INFO:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.3) 2020-06-12T17:48:42.186 INFO:teuthology.orchestra.run.smithi150.stdout:fuseblk 2020-06-12T17:48:42.187 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2020-06-12T17:48:42.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:42.188 INFO:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.3) 2020-06-12T17:48:42.262 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2020-06-12T17:48:42.903 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-12T17:48:43.032 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.028+0000 7f82143ba700 1 Processor -- start 2020-06-12T17:48:43.032 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.028+0000 7f82143ba700 1 -- start start 2020-06-12T17:48:43.035 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.029+0000 7f82143ba700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f820c0623f0 0x7f820c0b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:43.035 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.029+0000 7f82143ba700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c05b410 0x7f820c13c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:43.036 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.029+0000 7f82143ba700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f820c09b920 con 0x7f820c13c6b0 2020-06-12T17:48:43.036 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.029+0000 7f82143ba700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f820c142530 con 0x7f820c0623f0 2020-06-12T17:48:43.036 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.029+0000 7f82143ba700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820c067250 con 0x7f820c05b410 2020-06-12T17:48:43.036 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.029+0000 7f8212156700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f820c0623f0 0x7f820c0b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:43.036 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.029+0000 7f8212957700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f820c13c6b0 0x7f820c0b3580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:58970/0 (socket says 172.21.15.38:58970) 2020-06-12T17:48:43.037 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.029+0000 7f8211955700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c05b410 0x7f820c13c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:43.037 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.029+0000 7f8212957700 1 -- 172.21.15.38:0/2232593211 learned_addr learned my addr 172.21.15.38:0/2232593211 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:43.037 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.030+0000 7f8212156700 1 -- 172.21.15.38:0/2232593211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c05b410 msgr2=0x7f820c13c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:43.037 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.030+0000 7f8212156700 1 --2- 172.21.15.38:0/2232593211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c05b410 0x7f820c13c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:43.037 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.030+0000 7f8212156700 1 -- 172.21.15.38:0/2232593211 >> v1:172.21.15.150:6789/0 conn(0x7f820c13c6b0 legacy=0x7f820c0b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:43.038 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.030+0000 7f8212156700 1 -- 172.21.15.38:0/2232593211 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820c05bb20 con 0x7f820c0623f0 2020-06-12T17:48:43.038 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.030+0000 7f8211154700 1 -- 172.21.15.38:0/2232593211 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3144000258 0 0) 0x7f820c09b920 con 0x7f820c13c6b0 2020-06-12T17:48:43.038 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.030+0000 7f8211955700 1 --2- 172.21.15.38:0/2232593211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c05b410 0x7f820c13c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:43.038 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.030+0000 7f8212156700 1 --2- 172.21.15.38:0/2232593211 >> v2:172.21.15.150:3300/0 conn(0x7f820c0623f0 0x7f820c0b49e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8200002f30 tx=0x7f8200007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.039 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.030+0000 7f8212156700 1 --2- 172.21.15.38:0/2232593211 >> v2:172.21.15.150:3300/0 conn(0x7f820c0623f0 0x7f820c0b49e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8200002f30 tx=0x7f8200007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.039 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.030+0000 7f8212156700 1 --2- 172.21.15.38:0/2232593211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f820c0623f0 0x7f820c0b49e0 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7f8200002f30 tx=0x7f8200007e60).ready entity=mon.1 client_cookie=f88a5aa0a462669e server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:43.039 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.030+0000 7f8212156700 1 --2- 172.21.15.38:0/2232593211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f820c0623f0 0x7f820c0b49e0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f8200002f30 tx=0x7f8200007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.039 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.030+0000 7f8211154700 1 -- 172.21.15.38:0/2232593211 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8200011380 con 0x7f820c0623f0 2020-06-12T17:48:43.039 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.030+0000 7f8212156700 1 --2- 172.21.15.38:0/2232593211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f820c0623f0 0x7f820c0b49e0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f8200002f30 tx=0x7f8200007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.039 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.030+0000 7f8211154700 1 -- 172.21.15.38:0/2232593211 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82000114e0 con 0x7f820c0623f0 2020-06-12T17:48:43.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.030+0000 7f8212156700 1 --2- 172.21.15.38:0/2232593211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f820c0623f0 0x7f820c0b49e0 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f8200002f30 tx=0x7f8200007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.030+0000 7f8211154700 1 -- 172.21.15.38:0/2232593211 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82000118c0 con 0x7f820c0623f0 2020-06-12T17:48:43.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.030+0000 7f82143ba700 1 -- 172.21.15.38:0/2232593211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f820c0623f0 msgr2=0x7f820c0b49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:43.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.030+0000 7f82143ba700 1 --2- 172.21.15.38:0/2232593211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f820c0623f0 0x7f820c0b49e0 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7f8200002f30 tx=0x7f8200007e60).stop 2020-06-12T17:48:43.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.031+0000 7f82143ba700 1 -- 172.21.15.38:0/2232593211 shutdown_connections 2020-06-12T17:48:43.041 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.031+0000 7f82143ba700 1 --2- 172.21.15.38:0/2232593211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f820c0623f0 0x7f820c0b49e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:43.041 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.031+0000 7f82143ba700 1 --2- 172.21.15.38:0/2232593211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c05b410 0x7f820c13c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:43.041 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.031+0000 7f82143ba700 1 -- 172.21.15.38:0/2232593211 >> 172.21.15.38:0/2232593211 conn(0x7f820c0b8420 msgr2=0x7f820c0b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:43.041 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.031+0000 7f82143ba700 1 -- 172.21.15.38:0/2232593211 shutdown_connections 2020-06-12T17:48:43.041 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.031+0000 7f82143ba700 1 -- 172.21.15.38:0/2232593211 wait complete. 2020-06-12T17:48:43.045 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.032+0000 7f82143ba700 1 Processor -- start 2020-06-12T17:48:43.046 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.032+0000 7f82143ba700 1 -- start start 2020-06-12T17:48:43.046 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.032+0000 7f82143ba700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f820c0623f0 0x7f820c066ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:43.046 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.032+0000 7f82143ba700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c13c6b0 0x7f820c13f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:43.046 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.032+0000 7f82143ba700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f820c067030 con 0x7f820c05b410 2020-06-12T17:48:43.053 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.032+0000 7f82143ba700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f820c066390 con 0x7f820c0623f0 2020-06-12T17:48:43.053 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.032+0000 7f82143ba700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820c066630 con 0x7f820c13c6b0 2020-06-12T17:48:43.053 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.033+0000 7f8211955700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f820c0623f0 0x7f820c066ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:43.053 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.033+0000 7f8212957700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c13c6b0 0x7f820c13f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:43.053 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.033+0000 7f8211955700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f820c0623f0 0x7f820c066ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:45902/0 (socket says 172.21.15.38:45902) 2020-06-12T17:48:43.054 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.033+0000 7f8212156700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f820c05b410 0x7f820c1330d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:58972/0 (socket says 172.21.15.38:58972) 2020-06-12T17:48:43.054 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.033+0000 7f8211955700 1 -- 172.21.15.38:0/2183750690 learned_addr learned my addr 172.21.15.38:0/2183750690 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:43.054 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.033+0000 7f8212957700 1 -- 172.21.15.38:0/2183750690 >> v2:172.21.15.150:3300/0 conn(0x7f820c0623f0 msgr2=0x7f820c066ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:43.054 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.033+0000 7f8212957700 1 --2- 172.21.15.38:0/2183750690 >> v2:172.21.15.150:3300/0 conn(0x7f820c0623f0 0x7f820c066ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:43.054 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.033+0000 7f8212957700 1 -- 172.21.15.38:0/2183750690 >> v1:172.21.15.150:6789/0 conn(0x7f820c05b410 legacy=0x7f820c1330d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:43.055 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.033+0000 7f81ff7fe700 1 -- 172.21.15.38:0/2183750690 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1893369960 0 0) 0x7f820c067030 con 0x7f820c05b410 2020-06-12T17:48:43.055 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.033+0000 7f8212957700 1 -- 172.21.15.38:0/2183750690 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820c133d00 con 0x7f820c13c6b0 2020-06-12T17:48:43.055 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.033+0000 7f8211955700 1 --2- 172.21.15.38:0/2183750690 >> v2:172.21.15.150:3300/0 conn(0x7f820c0623f0 0x7f820c066ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:43.055 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.033+0000 7f8212957700 1 --2- 172.21.15.38:0/2183750690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c13c6b0 0x7f820c13f410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8204001210 tx=0x7f8204001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.055 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.033+0000 7f8212957700 1 --2- 172.21.15.38:0/2183750690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c13c6b0 0x7f820c13f410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8204001210 tx=0x7f8204001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.056 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.033+0000 7f8212957700 1 --2- 172.21.15.38:0/2183750690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c13c6b0 0x7f820c13f410 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f8204001210 tx=0x7f8204001960).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:43.056 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.033+0000 7f8212957700 1 --2- 172.21.15.38:0/2183750690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c13c6b0 0x7f820c13f410 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f8204001210 tx=0x7f8204001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.056 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.033+0000 7f81ff7fe700 1 -- 172.21.15.38:0/2183750690 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8204005e30 con 0x7f820c13c6b0 2020-06-12T17:48:43.056 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.033+0000 7f8212957700 1 --2- 172.21.15.38:0/2183750690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c13c6b0 0x7f820c13f410 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f8204001210 tx=0x7f8204001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.056 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.033+0000 7f8212957700 1 --2- 172.21.15.38:0/2183750690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c13c6b0 0x7f820c13f410 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f8204001210 tx=0x7f8204001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.057 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.033+0000 7f81ff7fe700 1 -- 172.21.15.38:0/2183750690 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8204012410 con 0x7f820c13c6b0 2020-06-12T17:48:43.057 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.033+0000 7f82143ba700 1 -- 172.21.15.38:0/2183750690 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f820c1337e0 con 0x7f820c13c6b0 2020-06-12T17:48:43.057 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.033+0000 7f81ff7fe700 1 -- 172.21.15.38:0/2183750690 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82040127f0 con 0x7f820c13c6b0 2020-06-12T17:48:43.057 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.033+0000 7f82143ba700 1 -- 172.21.15.38:0/2183750690 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820c0b1f10 con 0x7f820c13c6b0 2020-06-12T17:48:43.057 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.034+0000 7f8212957700 1 --2- 172.21.15.38:0/2183750690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c13c6b0 0x7f820c13f410 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f8204001210 tx=0x7f8204001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.034+0000 7f81ff7fe700 1 -- 172.21.15.38:0/2183750690 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f8204012a60 con 0x7f820c13c6b0 2020-06-12T17:48:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.034+0000 7f8212957700 1 --2- 172.21.15.38:0/2183750690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c13c6b0 0x7f820c13f410 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f8204001210 tx=0x7f8204001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.034+0000 7f82143ba700 1 -- 172.21.15.38:0/2183750690 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f820c056c30 con 0x7f820c13c6b0 2020-06-12T17:48:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.035+0000 7f81ff7fe700 1 --2- 172.21.15.38:0/2183750690 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f81ec04d430 0x7f81ec04f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.035+0000 7f81ff7fe700 1 -- 172.21.15.38:0/2183750690 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f8204061270 con 0x7f820c13c6b0 2020-06-12T17:48:43.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.035+0000 7f8212156700 1 --2- 172.21.15.38:0/2183750690 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f81ec04d430 0x7f81ec04f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:43.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.035+0000 7f8212156700 1 --2- 172.21.15.38:0/2183750690 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f81ec04d430 0x7f81ec04f8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f82000088e0 tx=0x7f8200007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.035+0000 7f8212156700 1 --2- 172.21.15.38:0/2183750690 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f81ec04d430 0x7f81ec04f8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f82000088e0 tx=0x7f8200007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.035+0000 7f8212156700 1 --2- 172.21.15.38:0/2183750690 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f81ec04d430 0x7f81ec04f8f0 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f82000088e0 tx=0x7f8200007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:43.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.038+0000 7f8212957700 1 --2- 172.21.15.38:0/2183750690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c13c6b0 0x7f820c13f410 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f8204001210 tx=0x7f8204001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.038+0000 7f81ff7fe700 1 -- 172.21.15.38:0/2183750690 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f820403ca30 con 0x7f820c13c6b0 2020-06-12T17:48:43.193 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.190+0000 7f82143ba700 1 -- 172.21.15.38:0/2183750690 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f820c0640e0 con 0x7f820c13c6b0 2020-06-12T17:48:43.194 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.191+0000 7f8212957700 1 --2- 172.21.15.38:0/2183750690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c13c6b0 0x7f820c13f410 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f8204001210 tx=0x7f8204001960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.191+0000 7f81ff7fe700 1 -- 172.21.15.38:0/2183750690 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16347 (secure 0 0 0) 0x7f8204040050 con 0x7f820c13c6b0 2020-06-12T17:48:43.195 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:43.195 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":24,"fsid":"8e42a2e7-b187-42c4-a73f-8f812ee62352","created":"2020-06-12T17:47:54.434340+0000","modified":"2020-06-12T17:48:14.851712+0000","last_up_change":"2020-06-12T17:48:03.388718+0000","last_in_change":"2020-06-12T17:48:03.388718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-06-12T17:47:57.558119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-06-12T17:48:07.419264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-06-12T17:48:09.934098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-06-12T17:48:12.497229+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"44ac3dea-67b4-4b9a-bc18-ac511710afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":31038},{"type":"v1","addr":"172.21.15.38:6816","nonce":31038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":31038},{"type":"v1","addr":"172.21.15.38:6819","nonce":31038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":31038},{"type":"v1","addr":"172.21.15.38:6823","nonce":31038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":31038},{"type":"v1","addr":"172.21.15.38:6821","nonce":31038}]},"public_addr":"172.21.15.38:6816/31038","cluster_addr":"172.21.15.38:6819/31038","heartbeat_back_addr":"172.21.15.38:6823/31038","heartbeat_front_addr":"172.21.15.38:6821/31038","state":["exists","up"]},{"osd":1,"uuid":"561f7ced-3fff-4364-8619-6e4ecbc9d256","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":31036},{"type":"v1","addr":"172.21.15.38:6801","nonce":31036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":31036},{"type":"v1","addr":"172.21.15.38:6803","nonce":31036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":31036},{"type":"v1","addr":"172.21.15.38:6807","nonce":31036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":31036},{"type":"v1","addr":"172.21.15.38:6805","nonce":31036}]},"public_addr":"172.21.15.38:6801/31036","cluster_addr":"172.21.15.38:6803/31036","heartbeat_back_addr":"172.21.15.38:6807/31036","heartbeat_front_addr":"172.21.15.38:6805/31036","state":["exists","up"]},{"osd":2,"uuid":"0bb3c806-07af-49f5-b492-d0e33f2de37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":31053},{"type":"v1","addr":"172.21.15.38:6825","nonce":31053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":31053},{"type":"v1","addr":"172.21.15.38:6827","nonce":31053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":31053},{"type":"v1","addr":"172.21.15.38:6831","nonce":31053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":31053},{"type":"v1","addr":"172.21.15.38:6829","nonce":31053}]},"public_addr":"172.21.15.38:6825/31053","cluster_addr":"172.21.15.38:6827/31053","heartbeat_back_addr":"172.21.15.38:6831/31053","heartbeat_front_addr":"172.21.15.38:6829/31053","state":["exists","up"]},{"osd":3,"uuid":"7f6a1e75-7b11-456e-8a4b-510b16226800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":31037},{"type":"v1","addr":"172.21.15.38:6809","nonce":31037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":31037},{"type":"v1","addr":"172.21.15.38:6811","nonce":31037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6815","nonce":31037},{"type":"v1","addr":"172.21.15.38:6817","nonce":31037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":31037},{"type":"v1","addr":"172.21.15.38:6813","nonce":31037}]},"public_addr":"172.21.15.38:6809/31037","cluster_addr":"172.21.15.38:6811/31037","heartbeat_back_addr":"172.21.15.38:6817/31037","heartbeat_front_addr":"172.21.15.38:6813/31037","state":["exists","up"]},{"osd":4,"uuid":"0eca0272-8cfd-469c-a32d-e29730dc0e1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":31294},{"type":"v1","addr":"172.21.15.150:6803","nonce":31294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":31294},{"type":"v1","addr":"172.21.15.150:6805","nonce":31294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":31294},{"type":"v1","addr":"172.21.15.150:6809","nonce":31294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":31294},{"type":"v1","addr":"172.21.15.150:6807","nonce":31294}]},"public_addr":"172.21.15.150:6803/31294","cluster_addr":"172.21.15.150:6805/31294","heartbeat_back_addr":"172.21.15.150:6809/31294","heartbeat_front_addr":"172.21.15.150:6807/31294","state":["exists","up"]},{"osd":5,"uuid":"69d6a7dc-a55a-4ebc-8479-8bb921ddfb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":31295},{"type":"v1","addr":"172.21.15.150:6813","nonce":31295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":31295},{"type":"v1","addr":"172.21.15.150:6816","nonce":31295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":31295},{"type":"v1","addr":"172.21.15.150:6828","nonce":31295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6819","nonce":31295},{"type":"v1","addr":"172.21.15.150:6822","nonce":31295}]},"public_addr":"172.21.15.150:6813/31295","cluster_addr":"172.21.15.150:6816/31295","heartbeat_back_addr":"172.21.15.150:6828/31295","heartbeat_front_addr":"172.21.15.150:6822/31295","state":["exists","up"]},{"osd":6,"uuid":"f0d320f8-c2f0-40bb-b713-526246cf97b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":31297},{"type":"v1","addr":"172.21.15.150:6820","nonce":31297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6823","nonce":31297},{"type":"v1","addr":"172.21.15.150:6827","nonce":31297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":31297},{"type":"v1","addr":"172.21.15.150:6833","nonce":31297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":31297},{"type":"v1","addr":"172.21.15.150:6831","nonce":31297}]},"public_addr":"172.21.15.150:6820/31297","cluster_addr":"172.21.15.150:6827/31297","heartbeat_back_addr":"172.21.15.150:6833/31297","heartbeat_front_addr":"172.21.15.150:6831/31297","state":["exists","up"]},{"osd":7,"uuid":"970b7d02-a189-41b2-96e5-a5a5a57c6476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":31296},{"type":"v1","addr":"172.21.15.150:6812","nonce":31296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":31296},{"type":"v1","addr":"172.21.15.150:6818","nonce":31296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":31296},{"type":"v1","addr":"172.21.15.150:6829","nonce":31296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":31296},{"type":"v1","addr":"172.21.15.150:6824","nonce":31296}]},"public_addr":"172.21.15.150:6812/31296","cluster_addr":"172.21.15.150:6818/31296","heartbeat_back_addr":"172.21.15.150:6829/31296","heartbeat_front_addr":"172.21.15.150:6824/31296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.664300+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.644253+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.651120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.584978+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.561149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.661778+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T17:48:43.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.192+0000 7f82143ba700 1 -- 172.21.15.38:0/2183750690 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f81ec04d430 msgr2=0x7f81ec04f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:43.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.192+0000 7f82143ba700 1 --2- 172.21.15.38:0/2183750690 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f81ec04d430 0x7f81ec04f8f0 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f82000088e0 tx=0x7f8200007e60).stop 2020-06-12T17:48:43.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.192+0000 7f82143ba700 1 -- 172.21.15.38:0/2183750690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c13c6b0 msgr2=0x7f820c13f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:43.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.192+0000 7f82143ba700 1 --2- 172.21.15.38:0/2183750690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c13c6b0 0x7f820c13f410 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f8204001210 tx=0x7f8204001960).stop 2020-06-12T17:48:43.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.192+0000 7f82143ba700 1 -- 172.21.15.38:0/2183750690 shutdown_connections 2020-06-12T17:48:43.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.192+0000 7f82143ba700 1 --2- 172.21.15.38:0/2183750690 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f81ec04d430 0x7f81ec04f8f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:43.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.192+0000 7f82143ba700 1 --2- 172.21.15.38:0/2183750690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c13c6b0 0x7f820c13f410 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:43.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.192+0000 7f82143ba700 1 --2- 172.21.15.38:0/2183750690 >> v2:172.21.15.150:3300/0 conn(0x7f820c0623f0 0x7f820c066ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:43.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.192+0000 7f82143ba700 1 -- 172.21.15.38:0/2183750690 >> 172.21.15.38:0/2183750690 conn(0x7f820c0b8420 msgr2=0x7f820c09d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:43.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.192+0000 7f82143ba700 1 -- 172.21.15.38:0/2183750690 shutdown_connections 2020-06-12T17:48:43.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.192+0000 7f82143ba700 1 -- 172.21.15.38:0/2183750690 wait complete. 2020-06-12T17:48:43.206 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-06-12T17:47:57.558119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-06-12T17:48:07.419264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-06-12T17:48:09.934098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-06-12T17:48:12.497229+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-06-12T17:48:43.207 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-06-12T17:48:43.325 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.321+0000 7f6dc1e80700 1 Processor -- start 2020-06-12T17:48:43.325 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.321+0000 7f6dc1e80700 1 -- start start 2020-06-12T17:48:43.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.322+0000 7f6dc1e80700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6dbc0ad5b0 0x7f6dbc0b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:43.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.322+0000 7f6dc1e80700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6dbc09d8d0 0x7f6dbc1421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:43.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.322+0000 7f6dc1e80700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dbc146d20 con 0x7f6dbc146680 2020-06-12T17:48:43.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.322+0000 7f6dc1e80700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dbc066a80 con 0x7f6dbc09d8d0 2020-06-12T17:48:43.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.322+0000 7f6dc1e80700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dbc146f50 con 0x7f6dbc0ad5b0 2020-06-12T17:48:43.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.322+0000 7f6dbbfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6dbc09d8d0 0x7f6dbc1421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:43.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.322+0000 7f6dbbfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6dbc09d8d0 0x7f6dbc1421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36432/0 (socket says 172.21.15.38:36432) 2020-06-12T17:48:43.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.322+0000 7f6dbbfff700 1 -- 172.21.15.38:0/4061743570 learned_addr learned my addr 172.21.15.38:0/4061743570 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:43.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.322+0000 7f6dbb7fe700 1 --1- 172.21.15.38:0/4061743570 >> v1:172.21.15.38:6789/0 conn(0x7f6dbc146680 0x7f6dbc09d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38248/0 (socket says 172.21.15.38:38248) 2020-06-12T17:48:43.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.322+0000 7f6dbaffd700 1 --2- 172.21.15.38:0/4061743570 >> v2:172.21.15.150:3300/0 conn(0x7f6dbc0ad5b0 0x7f6dbc0b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:43.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.322+0000 7f6dbbfff700 1 -- 172.21.15.38:0/4061743570 >> v2:172.21.15.150:3300/0 conn(0x7f6dbc0ad5b0 msgr2=0x7f6dbc0b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:43.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.322+0000 7f6dbbfff700 1 --2- 172.21.15.38:0/4061743570 >> v2:172.21.15.150:3300/0 conn(0x7f6dbc0ad5b0 0x7f6dbc0b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:43.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.322+0000 7f6dbbfff700 1 -- 172.21.15.38:0/4061743570 >> v1:172.21.15.38:6789/0 conn(0x7f6dbc146680 legacy=0x7f6dbc09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:43.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.322+0000 7f6dba7fc700 1 -- 172.21.15.38:0/4061743570 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1164381136 0 0) 0x7f6dbc146d20 con 0x7f6dbc146680 2020-06-12T17:48:43.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.322+0000 7f6dbbfff700 1 -- 172.21.15.38:0/4061743570 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc146a60 con 0x7f6dbc09d8d0 2020-06-12T17:48:43.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.323+0000 7f6dbbfff700 1 --2- 172.21.15.38:0/4061743570 >> v2:172.21.15.38:3300/0 conn(0x7f6dbc09d8d0 0x7f6dbc1421d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6dbc0b61f0 tx=0x7f6db40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.323+0000 7f6dbbfff700 1 --2- 172.21.15.38:0/4061743570 >> v2:172.21.15.38:3300/0 conn(0x7f6dbc09d8d0 0x7f6dbc1421d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6dbc0b61f0 tx=0x7f6db40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.323+0000 7f6dbbfff700 1 --2- 172.21.15.38:0/4061743570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dbc09d8d0 0x7f6dbc1421d0 secure :-1 s=READY pgs=253 cs=0 l=1 rx=0x7f6dbc0b61f0 tx=0x7f6db40081e0).ready entity=mon.0 client_cookie=b82eb673a4e0e3a6 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:43.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.323+0000 7f6dbbfff700 1 --2- 172.21.15.38:0/4061743570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dbc09d8d0 0x7f6dbc1421d0 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7f6dbc0b61f0 tx=0x7f6db40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.323+0000 7f6dba7fc700 1 -- 172.21.15.38:0/4061743570 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6db400a160 con 0x7f6dbc09d8d0 2020-06-12T17:48:43.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.323+0000 7f6dbbfff700 1 --2- 172.21.15.38:0/4061743570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dbc09d8d0 0x7f6dbc1421d0 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7f6dbc0b61f0 tx=0x7f6db40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.323+0000 7f6dba7fc700 1 -- 172.21.15.38:0/4061743570 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db400a2c0 con 0x7f6dbc09d8d0 2020-06-12T17:48:43.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.323+0000 7f6dbbfff700 1 --2- 172.21.15.38:0/4061743570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dbc09d8d0 0x7f6dbc1421d0 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7f6dbc0b61f0 tx=0x7f6db40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.323+0000 7f6dba7fc700 1 -- 172.21.15.38:0/4061743570 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6db400a660 con 0x7f6dbc09d8d0 2020-06-12T17:48:43.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.323+0000 7f6dc1e80700 1 -- 172.21.15.38:0/4061743570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dbc09d8d0 msgr2=0x7f6dbc1421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:43.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.323+0000 7f6dc1e80700 1 --2- 172.21.15.38:0/4061743570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dbc09d8d0 0x7f6dbc1421d0 secure :-1 s=READY pgs=253 cs=0 l=1 rx=0x7f6dbc0b61f0 tx=0x7f6db40081e0).stop 2020-06-12T17:48:43.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.323+0000 7f6dc1e80700 1 -- 172.21.15.38:0/4061743570 shutdown_connections 2020-06-12T17:48:43.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.323+0000 7f6dc1e80700 1 --2- 172.21.15.38:0/4061743570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dbc09d8d0 0x7f6dbc1421d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:43.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.323+0000 7f6dc1e80700 1 --2- 172.21.15.38:0/4061743570 >> v2:172.21.15.150:3300/0 conn(0x7f6dbc0ad5b0 0x7f6dbc0b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:43.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.323+0000 7f6dc1e80700 1 -- 172.21.15.38:0/4061743570 >> 172.21.15.38:0/4061743570 conn(0x7f6dbc0b5a20 msgr2=0x7f6dbc05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:43.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.323+0000 7f6dc1e80700 1 -- 172.21.15.38:0/4061743570 shutdown_connections 2020-06-12T17:48:43.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.323+0000 7f6dc1e80700 1 -- 172.21.15.38:0/4061743570 wait complete. 2020-06-12T17:48:43.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.324+0000 7f6dc1e80700 1 Processor -- start 2020-06-12T17:48:43.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.324+0000 7f6dc1e80700 1 -- start start 2020-06-12T17:48:43.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.325+0000 7f6dc1e80700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6dbc09d8d0 0x7f6dbc156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:43.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.325+0000 7f6dc1e80700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dbc0ad5b0 0x7f6dbc150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:43.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.325+0000 7f6dc1e80700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dbc153d20 con 0x7f6dbc146680 2020-06-12T17:48:43.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.325+0000 7f6dc1e80700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dbc153fc0 con 0x7f6dbc09d8d0 2020-06-12T17:48:43.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.325+0000 7f6dc1e80700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc154260 con 0x7f6dbc0ad5b0 2020-06-12T17:48:43.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.325+0000 7f6dbb7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6dbc09d8d0 0x7f6dbc156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:43.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.325+0000 7f6dbb7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6dbc09d8d0 0x7f6dbc156b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36438/0 (socket says 172.21.15.38:36438) 2020-06-12T17:48:43.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.325+0000 7f6dbb7fe700 1 -- 172.21.15.38:0/2946871246 learned_addr learned my addr 172.21.15.38:0/2946871246 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:43.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.325+0000 7f6dbaffd700 1 --2- 172.21.15.38:0/2946871246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dbc0ad5b0 0x7f6dbc150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:43.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.325+0000 7f6dbb7fe700 1 -- 172.21.15.38:0/2946871246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dbc0ad5b0 msgr2=0x7f6dbc150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:43.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.325+0000 7f6dbb7fe700 1 --2- 172.21.15.38:0/2946871246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dbc0ad5b0 0x7f6dbc150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:43.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.326+0000 7f6dbb7fe700 1 -- 172.21.15.38:0/2946871246 >> v1:172.21.15.150:6789/0 conn(0x7f6dbc146680 legacy=0x7f6dbc153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:43.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.326+0000 7f6dbb7fe700 1 -- 172.21.15.38:0/2946871246 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc150fc0 con 0x7f6dbc09d8d0 2020-06-12T17:48:43.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.326+0000 7f6dbb7fe700 1 --2- 172.21.15.38:0/2946871246 >> v2:172.21.15.38:3300/0 conn(0x7f6dbc09d8d0 0x7f6dbc156b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6da4000b80 tx=0x7f6da4001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.326+0000 7f6dbb7fe700 1 --2- 172.21.15.38:0/2946871246 >> v2:172.21.15.38:3300/0 conn(0x7f6dbc09d8d0 0x7f6dbc156b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6da4000b80 tx=0x7f6da4001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.326+0000 7f6dbb7fe700 1 --2- 172.21.15.38:0/2946871246 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dbc09d8d0 0x7f6dbc156b70 secure :-1 s=READY pgs=254 cs=0 l=1 rx=0x7f6da4000b80 tx=0x7f6da4001780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:43.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.326+0000 7f6dbb7fe700 1 --2- 172.21.15.38:0/2946871246 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dbc09d8d0 0x7f6dbc156b70 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f6da4000b80 tx=0x7f6da4001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.326+0000 7f6dbb7fe700 1 --2- 172.21.15.38:0/2946871246 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dbc09d8d0 0x7f6dbc156b70 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f6da4000b80 tx=0x7f6da4001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.326+0000 7f6db8ff9700 1 -- 172.21.15.38:0/2946871246 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6da40048d0 con 0x7f6dbc09d8d0 2020-06-12T17:48:43.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.326+0000 7f6dbb7fe700 1 --2- 172.21.15.38:0/2946871246 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dbc09d8d0 0x7f6dbc156b70 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f6da4000b80 tx=0x7f6da4001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.326+0000 7f6db8ff9700 1 -- 172.21.15.38:0/2946871246 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da4004a30 con 0x7f6dbc09d8d0 2020-06-12T17:48:43.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.326+0000 7f6dc1e80700 1 -- 172.21.15.38:0/2946871246 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dbc065920 con 0x7f6dbc09d8d0 2020-06-12T17:48:43.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.326+0000 7f6db8ff9700 1 -- 172.21.15.38:0/2946871246 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6da4004e50 con 0x7f6dbc09d8d0 2020-06-12T17:48:43.354 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.326+0000 7f6dc1e80700 1 -- 172.21.15.38:0/2946871246 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dbc065e10 con 0x7f6dbc09d8d0 2020-06-12T17:48:43.354 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.327+0000 7f6dbb7fe700 1 --2- 172.21.15.38:0/2946871246 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dbc09d8d0 0x7f6dbc156b70 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f6da4000b80 tx=0x7f6da4001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.354 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.327+0000 7f6dc1e80700 1 -- 172.21.15.38:0/2946871246 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dbc056c30 con 0x7f6dbc09d8d0 2020-06-12T17:48:43.355 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.327+0000 7f6db8ff9700 1 -- 172.21.15.38:0/2946871246 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f6da4012330 con 0x7f6dbc09d8d0 2020-06-12T17:48:43.355 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.327+0000 7f6dbb7fe700 1 --2- 172.21.15.38:0/2946871246 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dbc09d8d0 0x7f6dbc156b70 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f6da4000b80 tx=0x7f6da4001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.355 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.327+0000 7f6db8ff9700 1 --2- 172.21.15.38:0/2946871246 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6da004d530 0x7f6da004f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:43.355 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.327+0000 7f6db8ff9700 1 -- 172.21.15.38:0/2946871246 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f6da4060e70 con 0x7f6dbc09d8d0 2020-06-12T17:48:43.355 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.328+0000 7f6dbaffd700 1 --2- 172.21.15.38:0/2946871246 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6da004d530 0x7f6da004f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:43.356 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.328+0000 7f6dbaffd700 1 --2- 172.21.15.38:0/2946871246 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6da004d530 0x7f6da004f9f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6dac002f30 tx=0x7f6dac009f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.356 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.328+0000 7f6dbaffd700 1 --2- 172.21.15.38:0/2946871246 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6da004d530 0x7f6da004f9f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6dac002f30 tx=0x7f6dac009f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.356 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.328+0000 7f6dbaffd700 1 --2- 172.21.15.38:0/2946871246 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6da004d530 0x7f6da004f9f0 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f6dac002f30 tx=0x7f6dac009f30).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:43.356 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.331+0000 7f6dbb7fe700 1 --2- 172.21.15.38:0/2946871246 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dbc09d8d0 0x7f6dbc156b70 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f6da4000b80 tx=0x7f6da4001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.331+0000 7f6db8ff9700 1 -- 172.21.15.38:0/2946871246 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f6da403c5d0 con 0x7f6dbc09d8d0 2020-06-12T17:48:43.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.482+0000 7f6dc1e80700 1 -- 172.21.15.38:0/2946871246 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6dbc13c370 con 0x7f6dbc09d8d0 2020-06-12T17:48:43.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.482+0000 7f6dbb7fe700 1 --2- 172.21.15.38:0/2946871246 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dbc09d8d0 0x7f6dbc156b70 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f6da4000b80 tx=0x7f6da4001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.482+0000 7f6db8ff9700 1 -- 172.21.15.38:0/2946871246 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6da403fbf0 con 0x7f6dbc09d8d0 2020-06-12T17:48:43.487 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2020-06-12T17:48:43.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.484+0000 7f6dc1e80700 1 -- 172.21.15.38:0/2946871246 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6da004d530 msgr2=0x7f6da004f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:43.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.484+0000 7f6dc1e80700 1 --2- 172.21.15.38:0/2946871246 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6da004d530 0x7f6da004f9f0 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f6dac002f30 tx=0x7f6dac009f30).stop 2020-06-12T17:48:43.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.484+0000 7f6dc1e80700 1 -- 172.21.15.38:0/2946871246 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dbc09d8d0 msgr2=0x7f6dbc156b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:43.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.484+0000 7f6dc1e80700 1 --2- 172.21.15.38:0/2946871246 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dbc09d8d0 0x7f6dbc156b70 secure :-1 s=READY pgs=254 cs=0 l=1 rx=0x7f6da4000b80 tx=0x7f6da4001780).stop 2020-06-12T17:48:43.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.484+0000 7f6dc1e80700 1 -- 172.21.15.38:0/2946871246 shutdown_connections 2020-06-12T17:48:43.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.484+0000 7f6dc1e80700 1 --2- 172.21.15.38:0/2946871246 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6da004d530 0x7f6da004f9f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:43.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.484+0000 7f6dc1e80700 1 --2- 172.21.15.38:0/2946871246 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dbc09d8d0 0x7f6dbc156b70 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:43.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.484+0000 7f6dc1e80700 1 --2- 172.21.15.38:0/2946871246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dbc0ad5b0 0x7f6dbc150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:43.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.484+0000 7f6dc1e80700 1 -- 172.21.15.38:0/2946871246 >> 172.21.15.38:0/2946871246 conn(0x7f6dbc0b5a20 msgr2=0x7f6dbc0b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:43.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.484+0000 7f6dc1e80700 1 -- 172.21.15.38:0/2946871246 shutdown_connections 2020-06-12T17:48:43.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.484+0000 7f6dc1e80700 1 -- 172.21.15.38:0/2946871246 wait complete. 2020-06-12T17:48:43.497 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-06-12T17:48:43.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.611+0000 7f85f6bbf700 1 Processor -- start 2020-06-12T17:48:43.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.611+0000 7f85f6bbf700 1 -- start start 2020-06-12T17:48:43.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.612+0000 7f85f6bbf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f85f00b3ac0 0x7f85f009df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:43.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.612+0000 7f85f6bbf700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f85f0142e90 0x7f85f013bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:43.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.612+0000 7f85f6bbf700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f009b960 con 0x7f85f013c3a0 2020-06-12T17:48:43.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.612+0000 7f85f6bbf700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f00b35c0 con 0x7f85f0142e90 2020-06-12T17:48:43.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.612+0000 7f85f6bbf700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f009bc00 con 0x7f85f00b3ac0 2020-06-12T17:48:43.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.612+0000 7f85effff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f85f0142e90 0x7f85f013bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:43.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.612+0000 7f85effff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f85f0142e90 0x7f85f013bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36448/0 (socket says 172.21.15.38:36448) 2020-06-12T17:48:43.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.612+0000 7f85effff700 1 -- 172.21.15.38:0/1251599414 learned_addr learned my addr 172.21.15.38:0/1251599414 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:43.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.612+0000 7f85f495b700 1 --2- 172.21.15.38:0/1251599414 >> v2:172.21.15.150:3300/0 conn(0x7f85f00b3ac0 0x7f85f009df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:43.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.612+0000 7f85effff700 1 -- 172.21.15.38:0/1251599414 >> v2:172.21.15.150:3300/0 conn(0x7f85f00b3ac0 msgr2=0x7f85f009df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:43.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.612+0000 7f85effff700 1 --2- 172.21.15.38:0/1251599414 >> v2:172.21.15.150:3300/0 conn(0x7f85f00b3ac0 0x7f85f009df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:43.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.612+0000 7f85effff700 1 -- 172.21.15.38:0/1251599414 >> v1:172.21.15.150:6789/0 conn(0x7f85f013c3a0 legacy=0x7f85f00b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:43.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.613+0000 7f85effff700 1 -- 172.21.15.38:0/1251599414 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f00b48f0 con 0x7f85f0142e90 2020-06-12T17:48:43.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.613+0000 7f85effff700 1 --2- 172.21.15.38:0/1251599414 >> v2:172.21.15.38:3300/0 conn(0x7f85f0142e90 0x7f85f013bf40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f85f0061380 tx=0x7f85e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.613+0000 7f85effff700 1 --2- 172.21.15.38:0/1251599414 >> v2:172.21.15.38:3300/0 conn(0x7f85f0142e90 0x7f85f013bf40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f85f0061380 tx=0x7f85e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.622 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.613+0000 7f85effff700 1 --2- 172.21.15.38:0/1251599414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85f0142e90 0x7f85f013bf40 secure :-1 s=READY pgs=255 cs=0 l=1 rx=0x7f85f0061380 tx=0x7f85e4007e60).ready entity=mon.0 client_cookie=4382f3fa06b4c01d server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:43.622 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.613+0000 7f85effff700 1 --2- 172.21.15.38:0/1251599414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85f0142e90 0x7f85f013bf40 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7f85f0061380 tx=0x7f85e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.622 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.613+0000 7f85ef7fe700 1 -- 172.21.15.38:0/1251599414 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85e40116a0 con 0x7f85f0142e90 2020-06-12T17:48:43.623 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.613+0000 7f85effff700 1 --2- 172.21.15.38:0/1251599414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85f0142e90 0x7f85f013bf40 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7f85f0061380 tx=0x7f85e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.623 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.613+0000 7f85ef7fe700 1 -- 172.21.15.38:0/1251599414 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e4011800 con 0x7f85f0142e90 2020-06-12T17:48:43.623 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.613+0000 7f85effff700 1 --2- 172.21.15.38:0/1251599414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85f0142e90 0x7f85f013bf40 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7f85f0061380 tx=0x7f85e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.623 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.613+0000 7f85ef7fe700 1 -- 172.21.15.38:0/1251599414 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85e4011be0 con 0x7f85f0142e90 2020-06-12T17:48:43.623 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.613+0000 7f85f6bbf700 1 -- 172.21.15.38:0/1251599414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85f0142e90 msgr2=0x7f85f013bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:43.624 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.613+0000 7f85f6bbf700 1 --2- 172.21.15.38:0/1251599414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85f0142e90 0x7f85f013bf40 secure :-1 s=READY pgs=255 cs=0 l=1 rx=0x7f85f0061380 tx=0x7f85e4007e60).stop 2020-06-12T17:48:43.624 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.613+0000 7f85f6bbf700 1 -- 172.21.15.38:0/1251599414 shutdown_connections 2020-06-12T17:48:43.624 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.613+0000 7f85f6bbf700 1 --2- 172.21.15.38:0/1251599414 >> v2:172.21.15.150:3300/0 conn(0x7f85f00b3ac0 0x7f85f009df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:43.624 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.613+0000 7f85f6bbf700 1 --2- 172.21.15.38:0/1251599414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85f0142e90 0x7f85f013bf40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:43.625 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.613+0000 7f85f6bbf700 1 -- 172.21.15.38:0/1251599414 >> 172.21.15.38:0/1251599414 conn(0x7f85f00b5a20 msgr2=0x7f85f005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:43.625 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.613+0000 7f85f6bbf700 1 -- 172.21.15.38:0/1251599414 shutdown_connections 2020-06-12T17:48:43.625 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.613+0000 7f85f6bbf700 1 -- 172.21.15.38:0/1251599414 wait complete. 2020-06-12T17:48:43.625 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.614+0000 7f85f6bbf700 1 Processor -- start 2020-06-12T17:48:43.625 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.614+0000 7f85f6bbf700 1 -- start start 2020-06-12T17:48:43.629 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.615+0000 7f85f6bbf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85f013c3a0 0x7f85f0065a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:43.629 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.615+0000 7f85f6bbf700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f0061510 con 0x7f85f0142e90 2020-06-12T17:48:43.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.615+0000 7f85f6bbf700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f0061740 con 0x7f85f00b3ac0 2020-06-12T17:48:43.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.615+0000 7f85f6bbf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f00619e0 con 0x7f85f013c3a0 2020-06-12T17:48:43.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.615+0000 7f85f515c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f85f0142e90 0x7f85f0064710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38272/0 (socket says 172.21.15.38:38272) 2020-06-12T17:48:43.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.615+0000 7f85f515c700 1 -- 172.21.15.38:0/1470443368 learned_addr learned my addr 172.21.15.38:0/1470443368 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:43.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.615+0000 7f85effff700 1 --2- 172.21.15.38:0/1470443368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85f013c3a0 0x7f85f0065a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:43.632 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.616+0000 7f85edffb700 1 -- 172.21.15.38:0/1470443368 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1269706190 0 0) 0x7f85f0061510 con 0x7f85f0142e90 2020-06-12T17:48:43.632 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.616+0000 7f85edffb700 1 -- 172.21.15.38:0/1470443368 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85d0002fe0 con 0x7f85f0142e90 2020-06-12T17:48:43.632 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.616+0000 7f85edffb700 1 -- 172.21.15.38:0/1470443368 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400712144 0 0) 0x7f85f0061740 con 0x7f85f00b3ac0 2020-06-12T17:48:43.632 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.616+0000 7f85edffb700 1 -- 172.21.15.38:0/1470443368 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85f0061510 con 0x7f85f00b3ac0 2020-06-12T17:48:43.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.616+0000 7f85effff700 1 -- 172.21.15.38:0/1470443368 >> v1:172.21.15.150:6789/0 conn(0x7f85f00b3ac0 legacy=0x7f85f013b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:43.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.616+0000 7f85effff700 1 -- 172.21.15.38:0/1470443368 >> v1:172.21.15.38:6789/0 conn(0x7f85f0142e90 legacy=0x7f85f0064710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:43.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.616+0000 7f85effff700 1 -- 172.21.15.38:0/1470443368 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f0061c80 con 0x7f85f013c3a0 2020-06-12T17:48:43.634 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.616+0000 7f85effff700 1 --2- 172.21.15.38:0/1470443368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85f013c3a0 0x7f85f0065a40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f85e8002d80 tx=0x7f85e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.635 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.616+0000 7f85effff700 1 --2- 172.21.15.38:0/1470443368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85f013c3a0 0x7f85f0065a40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f85e8002d80 tx=0x7f85e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.635 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.616+0000 7f85effff700 1 --2- 172.21.15.38:0/1470443368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85f013c3a0 0x7f85f0065a40 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f85e8002d80 tx=0x7f85e4007e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:43.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.616+0000 7f85effff700 1 --2- 172.21.15.38:0/1470443368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85f013c3a0 0x7f85f0065a40 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f85e8002d80 tx=0x7f85e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.616+0000 7f85edffb700 1 -- 172.21.15.38:0/1470443368 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85e8002be0 con 0x7f85f013c3a0 2020-06-12T17:48:43.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.616+0000 7f85effff700 1 --2- 172.21.15.38:0/1470443368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85f013c3a0 0x7f85f0065a40 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f85e8002d80 tx=0x7f85e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.637 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.616+0000 7f85effff700 1 --2- 172.21.15.38:0/1470443368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85f013c3a0 0x7f85f0065a40 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f85e8002d80 tx=0x7f85e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.637 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.616+0000 7f85edffb700 1 -- 172.21.15.38:0/1470443368 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e4011b70 con 0x7f85f013c3a0 2020-06-12T17:48:43.637 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.616+0000 7f85f6bbf700 1 -- 172.21.15.38:0/1470443368 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f013bf60 con 0x7f85f013c3a0 2020-06-12T17:48:43.637 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.616+0000 7f85edffb700 1 -- 172.21.15.38:0/1470443368 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85e4011ce0 con 0x7f85f013c3a0 2020-06-12T17:48:43.638 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.616+0000 7f85f6bbf700 1 -- 172.21.15.38:0/1470443368 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f00b28b0 con 0x7f85f013c3a0 2020-06-12T17:48:43.638 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.617+0000 7f85effff700 1 --2- 172.21.15.38:0/1470443368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85f013c3a0 0x7f85f0065a40 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f85e8002d80 tx=0x7f85e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.638 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.617+0000 7f85f6bbf700 1 -- 172.21.15.38:0/1470443368 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f00624a0 con 0x7f85f013c3a0 2020-06-12T17:48:43.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.617+0000 7f85edffb700 1 -- 172.21.15.38:0/1470443368 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f85e40072a0 con 0x7f85f013c3a0 2020-06-12T17:48:43.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.617+0000 7f85effff700 1 --2- 172.21.15.38:0/1470443368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85f013c3a0 0x7f85f0065a40 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f85e8002d80 tx=0x7f85e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.618+0000 7f85edffb700 1 --2- 172.21.15.38:0/1470443368 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f85d004da40 0x7f85d004ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:43.641 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.618+0000 7f85edffb700 1 -- 172.21.15.38:0/1470443368 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f85e4061000 con 0x7f85f013c3a0 2020-06-12T17:48:43.641 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.618+0000 7f85f495b700 1 --2- 172.21.15.38:0/1470443368 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f85d004da40 0x7f85d004ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:43.641 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.618+0000 7f85f495b700 1 --2- 172.21.15.38:0/1470443368 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f85d004da40 0x7f85d004ff00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f85e0001f10 tx=0x7f85e0002340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.642 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.618+0000 7f85f495b700 1 --2- 172.21.15.38:0/1470443368 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f85d004da40 0x7f85d004ff00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f85e0001f10 tx=0x7f85e0002340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.642 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.618+0000 7f85f495b700 1 --2- 172.21.15.38:0/1470443368 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f85d004da40 0x7f85d004ff00 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f85e0001f10 tx=0x7f85e0002340).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:43.642 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.621+0000 7f85effff700 1 --2- 172.21.15.38:0/1470443368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85f013c3a0 0x7f85f0065a40 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f85e8002d80 tx=0x7f85e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.643 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.621+0000 7f85edffb700 1 -- 172.21.15.38:0/1470443368 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f85e403c740 con 0x7f85f013c3a0 2020-06-12T17:48:43.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.772+0000 7f85f6bbf700 1 -- 172.21.15.38:0/1470443368 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f85f00624a0 con 0x7f85f013c3a0 2020-06-12T17:48:43.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.773+0000 7f85effff700 1 --2- 172.21.15.38:0/1470443368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85f013c3a0 0x7f85f0065a40 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f85e8002d80 tx=0x7f85e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.773+0000 7f85edffb700 1 -- 172.21.15.38:0/1470443368 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f85e403fd60 con 0x7f85f013c3a0 2020-06-12T17:48:43.777 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:43.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.774+0000 7f85f6bbf700 1 -- 172.21.15.38:0/1470443368 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f85d004da40 msgr2=0x7f85d004ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:43.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.774+0000 7f85f6bbf700 1 --2- 172.21.15.38:0/1470443368 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f85d004da40 0x7f85d004ff00 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f85e0001f10 tx=0x7f85e0002340).stop 2020-06-12T17:48:43.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.774+0000 7f85f6bbf700 1 -- 172.21.15.38:0/1470443368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85f013c3a0 msgr2=0x7f85f0065a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:43.780 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.774+0000 7f85f6bbf700 1 --2- 172.21.15.38:0/1470443368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85f013c3a0 0x7f85f0065a40 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f85e8002d80 tx=0x7f85e4007e60).stop 2020-06-12T17:48:43.780 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.774+0000 7f85f6bbf700 1 -- 172.21.15.38:0/1470443368 shutdown_connections 2020-06-12T17:48:43.780 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.774+0000 7f85f6bbf700 1 --2- 172.21.15.38:0/1470443368 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f85d004da40 0x7f85d004ff00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:43.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.774+0000 7f85f6bbf700 1 --2- 172.21.15.38:0/1470443368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85f013c3a0 0x7f85f0065a40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:43.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.774+0000 7f85f6bbf700 1 -- 172.21.15.38:0/1470443368 >> 172.21.15.38:0/1470443368 conn(0x7f85f00b5a20 msgr2=0x7f85f0143960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:43.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.774+0000 7f85f6bbf700 1 -- 172.21.15.38:0/1470443368 shutdown_connections 2020-06-12T17:48:43.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.774+0000 7f85f6bbf700 1 -- 172.21.15.38:0/1470443368 wait complete. 2020-06-12T17:48:43.790 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-06-12T17:48:43.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.904+0000 7f49c39d9700 1 Processor -- start 2020-06-12T17:48:43.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.904+0000 7f49c39d9700 1 -- start start 2020-06-12T17:48:43.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.905+0000 7f49c39d9700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f49bc146680 0x7f49bc0ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:43.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.905+0000 7f49c39d9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49bc0b2eb0 0x7f49bc09d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:43.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.905+0000 7f49c39d9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49bc146d20 con 0x7f49bc09d620 2020-06-12T17:48:43.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.905+0000 7f49c39d9700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49bc066a80 con 0x7f49bc146680 2020-06-12T17:48:43.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.905+0000 7f49c39d9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc146f50 con 0x7f49bc0b2eb0 2020-06-12T17:48:43.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.905+0000 7f49c1775700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f49bc146680 0x7f49bc0ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:43.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.905+0000 7f49c1775700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f49bc146680 0x7f49bc0ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36460/0 (socket says 172.21.15.38:36460) 2020-06-12T17:48:43.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.905+0000 7f49c1775700 1 -- 172.21.15.38:0/980238723 learned_addr learned my addr 172.21.15.38:0/980238723 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:43.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.905+0000 7f49c0f74700 1 --2- 172.21.15.38:0/980238723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49bc0b2eb0 0x7f49bc09d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:43.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.905+0000 7f49c1775700 1 -- 172.21.15.38:0/980238723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49bc0b2eb0 msgr2=0x7f49bc09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:43.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.905+0000 7f49c1775700 1 --2- 172.21.15.38:0/980238723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49bc0b2eb0 0x7f49bc09d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:43.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.905+0000 7f49c1775700 1 -- 172.21.15.38:0/980238723 >> v1:172.21.15.150:6789/0 conn(0x7f49bc09d620 legacy=0x7f49bc09b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:43.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.905+0000 7f49c1775700 1 -- 172.21.15.38:0/980238723 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49bc146a60 con 0x7f49bc146680 2020-06-12T17:48:43.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.905+0000 7f49c1775700 1 --2- 172.21.15.38:0/980238723 >> v2:172.21.15.38:3300/0 conn(0x7f49bc146680 0x7f49bc0ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f49b40032b0 tx=0x7f49b40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.905+0000 7f49c1775700 1 --2- 172.21.15.38:0/980238723 >> v2:172.21.15.38:3300/0 conn(0x7f49bc146680 0x7f49bc0ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f49b40032b0 tx=0x7f49b40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.905+0000 7f49c1775700 1 --2- 172.21.15.38:0/980238723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49bc146680 0x7f49bc0ad5b0 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7f49b40032b0 tx=0x7f49b40081e0).ready entity=mon.0 client_cookie=361120e764cab42d server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:43.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.905+0000 7f49c1775700 1 --2- 172.21.15.38:0/980238723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49bc146680 0x7f49bc0ad5b0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7f49b40032b0 tx=0x7f49b40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.905+0000 7f49bbfff700 1 -- 172.21.15.38:0/980238723 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49b4011ea0 con 0x7f49bc146680 2020-06-12T17:48:43.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.905+0000 7f49c1775700 1 --2- 172.21.15.38:0/980238723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49bc146680 0x7f49bc0ad5b0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7f49b40032b0 tx=0x7f49b40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.905+0000 7f49c1775700 1 --2- 172.21.15.38:0/980238723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49bc146680 0x7f49bc0ad5b0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7f49b40032b0 tx=0x7f49b40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.905+0000 7f49bbfff700 1 -- 172.21.15.38:0/980238723 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b400a160 con 0x7f49bc146680 2020-06-12T17:48:43.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.905+0000 7f49bbfff700 1 -- 172.21.15.38:0/980238723 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49b400a580 con 0x7f49bc146680 2020-06-12T17:48:43.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.905+0000 7f49c39d9700 1 -- 172.21.15.38:0/980238723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49bc146680 msgr2=0x7f49bc0ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:43.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.905+0000 7f49c39d9700 1 --2- 172.21.15.38:0/980238723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49bc146680 0x7f49bc0ad5b0 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7f49b40032b0 tx=0x7f49b40081e0).stop 2020-06-12T17:48:43.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.906+0000 7f49c39d9700 1 -- 172.21.15.38:0/980238723 shutdown_connections 2020-06-12T17:48:43.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.906+0000 7f49c39d9700 1 --2- 172.21.15.38:0/980238723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49bc146680 0x7f49bc0ad5b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:43.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.906+0000 7f49c39d9700 1 --2- 172.21.15.38:0/980238723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49bc0b2eb0 0x7f49bc09d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:43.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.906+0000 7f49c39d9700 1 -- 172.21.15.38:0/980238723 >> 172.21.15.38:0/980238723 conn(0x7f49bc0b5a20 msgr2=0x7f49bc05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:43.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.906+0000 7f49c39d9700 1 -- 172.21.15.38:0/980238723 shutdown_connections 2020-06-12T17:48:43.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.906+0000 7f49c39d9700 1 -- 172.21.15.38:0/980238723 wait complete. 2020-06-12T17:48:43.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.907+0000 7f49c39d9700 1 Processor -- start 2020-06-12T17:48:43.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.907+0000 7f49c39d9700 1 -- start start 2020-06-12T17:48:43.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.908+0000 7f49c39d9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f49bc09d620 0x7f49bc0b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:43.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.908+0000 7f49c39d9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49bc146680 0x7f49bc154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:43.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.908+0000 7f49c39d9700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49bc0b2a20 con 0x7f49bc0b2eb0 2020-06-12T17:48:43.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.908+0000 7f49c39d9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49bc064ff0 con 0x7f49bc09d620 2020-06-12T17:48:43.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.908+0000 7f49c39d9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc065290 con 0x7f49bc146680 2020-06-12T17:48:43.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.908+0000 7f49c0f74700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f49bc0b2eb0 0x7f49bc064400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38284/0 (socket says 172.21.15.38:38284) 2020-06-12T17:48:43.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.908+0000 7f49c0f74700 1 -- 172.21.15.38:0/735376404 learned_addr learned my addr 172.21.15.38:0/735376404 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:43.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.908+0000 7f49c1775700 1 --2- 172.21.15.38:0/735376404 >> v2:172.21.15.150:3300/0 conn(0x7f49bc09d620 0x7f49bc0b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:43.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.908+0000 7f49c1f76700 1 --2- 172.21.15.38:0/735376404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49bc146680 0x7f49bc154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:43.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.908+0000 7f49ba7fc700 1 -- 172.21.15.38:0/735376404 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50664718 0 0) 0x7f49bc0b2a20 con 0x7f49bc0b2eb0 2020-06-12T17:48:43.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.908+0000 7f49ba7fc700 1 -- 172.21.15.38:0/735376404 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f499c002fe0 con 0x7f49bc0b2eb0 2020-06-12T17:48:43.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.908+0000 7f49ba7fc700 1 -- 172.21.15.38:0/735376404 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1391505316 0 0) 0x7f499c002fe0 con 0x7f49bc0b2eb0 2020-06-12T17:48:43.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.908+0000 7f49c1f76700 1 -- 172.21.15.38:0/735376404 >> v2:172.21.15.150:3300/0 conn(0x7f49bc09d620 msgr2=0x7f49bc0b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:43.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.908+0000 7f49c1f76700 1 --2- 172.21.15.38:0/735376404 >> v2:172.21.15.150:3300/0 conn(0x7f49bc09d620 0x7f49bc0b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:43.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.908+0000 7f49c1f76700 1 -- 172.21.15.38:0/735376404 >> v1:172.21.15.38:6789/0 conn(0x7f49bc0b2eb0 legacy=0x7f49bc064400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:43.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.908+0000 7f49c1f76700 1 -- 172.21.15.38:0/735376404 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49bc064d30 con 0x7f49bc146680 2020-06-12T17:48:43.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.908+0000 7f49c1f76700 1 --2- 172.21.15.38:0/735376404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49bc146680 0x7f49bc154b30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f49b0001630 tx=0x7f49ac001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.908+0000 7f49c1f76700 1 --2- 172.21.15.38:0/735376404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49bc146680 0x7f49bc154b30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f49b0001630 tx=0x7f49ac001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.908+0000 7f49c1f76700 1 --2- 172.21.15.38:0/735376404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49bc146680 0x7f49bc154b30 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f49b0001630 tx=0x7f49ac001700).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:43.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.908+0000 7f49c1f76700 1 --2- 172.21.15.38:0/735376404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49bc146680 0x7f49bc154b30 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f49b0001630 tx=0x7f49ac001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.909+0000 7f49ba7fc700 1 -- 172.21.15.38:0/735376404 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49ac001ea0 con 0x7f49bc146680 2020-06-12T17:48:43.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.909+0000 7f49c1f76700 1 --2- 172.21.15.38:0/735376404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49bc146680 0x7f49bc154b30 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f49b0001630 tx=0x7f49ac001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.909+0000 7f49c1f76700 1 --2- 172.21.15.38:0/735376404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49bc146680 0x7f49bc154b30 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f49b0001630 tx=0x7f49ac001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.909+0000 7f49ba7fc700 1 -- 172.21.15.38:0/735376404 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ac0069d0 con 0x7f49bc146680 2020-06-12T17:48:43.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.909+0000 7f49c39d9700 1 -- 172.21.15.38:0/735376404 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49bc1555b0 con 0x7f49bc146680 2020-06-12T17:48:43.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.909+0000 7f49ba7fc700 1 -- 172.21.15.38:0/735376404 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49b0001490 con 0x7f49bc146680 2020-06-12T17:48:43.932 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.909+0000 7f49c39d9700 1 -- 172.21.15.38:0/735376404 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49bc1551d0 con 0x7f49bc146680 2020-06-12T17:48:43.932 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.909+0000 7f49c1f76700 1 --2- 172.21.15.38:0/735376404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49bc146680 0x7f49bc154b30 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f49b0001630 tx=0x7f49ac001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.933 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.910+0000 7f49ba7fc700 1 -- 172.21.15.38:0/735376404 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f49ac00a280 con 0x7f49bc146680 2020-06-12T17:48:43.933 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.910+0000 7f49c1f76700 1 --2- 172.21.15.38:0/735376404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49bc146680 0x7f49bc154b30 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f49b0001630 tx=0x7f49ac001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.934 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.910+0000 7f49c39d9700 1 -- 172.21.15.38:0/735376404 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49bc064b10 con 0x7f49bc146680 2020-06-12T17:48:43.934 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.910+0000 7f49ba7fc700 1 --2- 172.21.15.38:0/735376404 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f499c04d900 0x7f499c04fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:43.934 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.910+0000 7f49ba7fc700 1 -- 172.21.15.38:0/735376404 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f49ac060880 con 0x7f49bc146680 2020-06-12T17:48:43.935 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.910+0000 7f49c1775700 1 --2- 172.21.15.38:0/735376404 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f499c04d900 0x7f499c04fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:43.935 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.910+0000 7f49c1775700 1 --2- 172.21.15.38:0/735376404 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f499c04d900 0x7f499c04fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f49b40032b0 tx=0x7f49b40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.935 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.911+0000 7f49c1775700 1 --2- 172.21.15.38:0/735376404 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f499c04d900 0x7f499c04fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f49b40032b0 tx=0x7f49b40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.936 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.911+0000 7f49c1775700 1 --2- 172.21.15.38:0/735376404 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f499c04d900 0x7f499c04fdc0 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7f49b40032b0 tx=0x7f49b40081e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:43.937 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.914+0000 7f49c1f76700 1 --2- 172.21.15.38:0/735376404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49bc146680 0x7f49bc154b30 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f49b0001630 tx=0x7f49ac001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:43.937 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:43.914+0000 7f49ba7fc700 1 -- 172.21.15.38:0/735376404 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f49ac03bfe0 con 0x7f49bc146680 2020-06-12T17:48:44.070 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.067+0000 7f49c39d9700 1 -- 172.21.15.38:0/735376404 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f49bc056c30 con 0x7f49bc146680 2020-06-12T17:48:44.071 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.067+0000 7f49c1f76700 1 --2- 172.21.15.38:0/735376404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49bc146680 0x7f49bc154b30 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f49b0001630 tx=0x7f49ac001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.071 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.067+0000 7f49ba7fc700 1 -- 172.21.15.38:0/735376404 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f49ac03f600 con 0x7f49bc146680 2020-06-12T17:48:44.071 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:44.072 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.069+0000 7f49c39d9700 1 -- 172.21.15.38:0/735376404 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f499c04d900 msgr2=0x7f499c04fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:44.073 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.069+0000 7f49c39d9700 1 --2- 172.21.15.38:0/735376404 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f499c04d900 0x7f499c04fdc0 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7f49b40032b0 tx=0x7f49b40081e0).stop 2020-06-12T17:48:44.074 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.069+0000 7f49c39d9700 1 -- 172.21.15.38:0/735376404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49bc146680 msgr2=0x7f49bc154b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:44.074 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.069+0000 7f49c39d9700 1 --2- 172.21.15.38:0/735376404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49bc146680 0x7f49bc154b30 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f49b0001630 tx=0x7f49ac001700).stop 2020-06-12T17:48:44.074 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.069+0000 7f49c39d9700 1 -- 172.21.15.38:0/735376404 shutdown_connections 2020-06-12T17:48:44.075 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.069+0000 7f49c39d9700 1 --2- 172.21.15.38:0/735376404 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f499c04d900 0x7f499c04fdc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:44.075 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.069+0000 7f49c39d9700 1 --2- 172.21.15.38:0/735376404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49bc146680 0x7f49bc154b30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:44.075 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.069+0000 7f49c39d9700 1 --2- 172.21.15.38:0/735376404 >> v2:172.21.15.150:3300/0 conn(0x7f49bc09d620 0x7f49bc0b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:44.075 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.069+0000 7f49c39d9700 1 -- 172.21.15.38:0/735376404 >> 172.21.15.38:0/735376404 conn(0x7f49bc0b5a20 msgr2=0x7f49bc05b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:44.075 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.069+0000 7f49c39d9700 1 -- 172.21.15.38:0/735376404 shutdown_connections 2020-06-12T17:48:44.076 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.069+0000 7f49c39d9700 1 -- 172.21.15.38:0/735376404 wait complete. 2020-06-12T17:48:44.082 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-06-12T17:48:44.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.197+0000 7fbd3f897700 1 Processor -- start 2020-06-12T17:48:44.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.197+0000 7fbd3f897700 1 -- start start 2020-06-12T17:48:44.204 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.198+0000 7fbd3f897700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd3809d0b0 0x7fbd3813c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:44.205 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.198+0000 7fbd3f897700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd3809b960 con 0x7fbd3809df00 2020-06-12T17:48:44.205 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.198+0000 7fbd3f897700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd3809bc00 con 0x7fbd380b3ac0 2020-06-12T17:48:44.205 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.198+0000 7fbd3f897700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd380b48f0 con 0x7fbd3809d0b0 2020-06-12T17:48:44.205 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.198+0000 7fbd3ce32700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fbd3809df00 0x7fbd38066790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38290/0 (socket says 172.21.15.38:38290) 2020-06-12T17:48:44.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.198+0000 7fbd3ce32700 1 -- 172.21.15.38:0/2380833609 learned_addr learned my addr 172.21.15.38:0/2380833609 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:44.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.198+0000 7fbd3de34700 1 --2- 172.21.15.38:0/2380833609 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd3809d0b0 0x7fbd3813c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:44.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.198+0000 7fbd27fff700 1 -- 172.21.15.38:0/2380833609 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2149323212 0 0) 0x7fbd3809b960 con 0x7fbd3809df00 2020-06-12T17:48:44.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.198+0000 7fbd27fff700 1 -- 172.21.15.38:0/2380833609 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd20003230 con 0x7fbd3809df00 2020-06-12T17:48:44.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd27fff700 1 -- 172.21.15.38:0/2380833609 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1591030195 0 0) 0x7fbd20003230 con 0x7fbd3809df00 2020-06-12T17:48:44.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd27fff700 1 -- 172.21.15.38:0/2380833609 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd3809d0b0 msgr2=0x7fbd3813c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:44.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd27fff700 1 --2- 172.21.15.38:0/2380833609 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd3809d0b0 0x7fbd3813c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:44.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd27fff700 1 -- 172.21.15.38:0/2380833609 >> v1:172.21.15.150:6789/0 conn(0x7fbd380b3ac0 legacy=0x7fbd3813bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:44.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd27fff700 1 -- 172.21.15.38:0/2380833609 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd380b3ea0 con 0x7fbd3809df00 2020-06-12T17:48:44.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd27fff700 1 -- 172.21.15.38:0/2380833609 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fbd340016d0 con 0x7fbd3809df00 2020-06-12T17:48:44.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd27fff700 1 -- 172.21.15.38:0/2380833609 >> v1:172.21.15.38:6789/0 conn(0x7fbd3809df00 legacy=0x7fbd38066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:44.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd27fff700 1 --2- 172.21.15.38:0/2380833609 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd3809d0b0 0x7fbd20003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:44.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd27fff700 1 --2- 172.21.15.38:0/2380833609 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd20003bb0 0x7fbd20004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:44.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd27fff700 1 --2- 172.21.15.38:0/2380833609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd20004590 0x7fbd20004a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:44.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd27fff700 1 -- 172.21.15.38:0/2380833609 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd380b48f0 con 0x7fbd20004590 2020-06-12T17:48:44.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd27fff700 1 -- 172.21.15.38:0/2380833609 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd20004fc0 con 0x7fbd20003bb0 2020-06-12T17:48:44.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd27fff700 1 -- 172.21.15.38:0/2380833609 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd20005180 con 0x7fbd3809d0b0 2020-06-12T17:48:44.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd3de34700 1 --2- 172.21.15.38:0/2380833609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd20004590 0x7fbd20004a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:44.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd3d633700 1 --2- 172.21.15.38:0/2380833609 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd3809d0b0 0x7fbd20003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:44.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd3ce32700 1 --2- 172.21.15.38:0/2380833609 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd20003bb0 0x7fbd20004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:44.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd3de34700 1 -- 172.21.15.38:0/2380833609 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd3809d0b0 msgr2=0x7fbd20003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:44.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd3de34700 1 --2- 172.21.15.38:0/2380833609 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd3809d0b0 0x7fbd20003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:44.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd3de34700 1 -- 172.21.15.38:0/2380833609 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd20003bb0 msgr2=0x7fbd20004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:44.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd3de34700 1 --2- 172.21.15.38:0/2380833609 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd20003bb0 0x7fbd20004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:44.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd3de34700 1 -- 172.21.15.38:0/2380833609 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd20003230 con 0x7fbd20004590 2020-06-12T17:48:44.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd3de34700 1 --2- 172.21.15.38:0/2380833609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd20004590 0x7fbd20004a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbd300032b0 tx=0x7fbd300081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd3de34700 1 --2- 172.21.15.38:0/2380833609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd20004590 0x7fbd20004a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbd300032b0 tx=0x7fbd300081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd3de34700 1 --2- 172.21.15.38:0/2380833609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd20004590 0x7fbd20004a10 secure :-1 s=READY pgs=260 cs=0 l=1 rx=0x7fbd300032b0 tx=0x7fbd300081e0).ready entity=mon.0 client_cookie=4cfcbf7b970e2b server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:44.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd3de34700 1 --2- 172.21.15.38:0/2380833609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd20004590 0x7fbd20004a10 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fbd300032b0 tx=0x7fbd300081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd3de34700 1 --2- 172.21.15.38:0/2380833609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd20004590 0x7fbd20004a10 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fbd300032b0 tx=0x7fbd300081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd27fff700 1 -- 172.21.15.38:0/2380833609 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd30005a40 con 0x7fbd20004590 2020-06-12T17:48:44.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd3de34700 1 --2- 172.21.15.38:0/2380833609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd20004590 0x7fbd20004a10 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7fbd300032b0 tx=0x7fbd300081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd27fff700 1 -- 172.21.15.38:0/2380833609 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd30005ba0 con 0x7fbd20004590 2020-06-12T17:48:44.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd27fff700 1 -- 172.21.15.38:0/2380833609 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd300110c0 con 0x7fbd20004590 2020-06-12T17:48:44.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd3f897700 1 -- 172.21.15.38:0/2380833609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd20004590 msgr2=0x7fbd20004a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:44.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.199+0000 7fbd3f897700 1 --2- 172.21.15.38:0/2380833609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd20004590 0x7fbd20004a10 secure :-1 s=READY pgs=260 cs=0 l=1 rx=0x7fbd300032b0 tx=0x7fbd300081e0).stop 2020-06-12T17:48:44.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.200+0000 7fbd3de34700 1 -- 172.21.15.38:0/2380833609 reap_dead start 2020-06-12T17:48:44.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.200+0000 7fbd3f897700 1 -- 172.21.15.38:0/2380833609 shutdown_connections 2020-06-12T17:48:44.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.200+0000 7fbd3f897700 1 -- 172.21.15.38:0/2380833609 >> 172.21.15.38:0/2380833609 conn(0x7fbd380b5a20 msgr2=0x7fbd3805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:44.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.200+0000 7fbd3f897700 1 -- 172.21.15.38:0/2380833609 shutdown_connections 2020-06-12T17:48:44.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.200+0000 7fbd3f897700 1 -- 172.21.15.38:0/2380833609 wait complete. 2020-06-12T17:48:44.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.201+0000 7fbd3f897700 1 Processor -- start 2020-06-12T17:48:44.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.201+0000 7fbd3f897700 1 -- start start 2020-06-12T17:48:44.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.202+0000 7fbd3f897700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd38066b70 0x7fbd38157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:44.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.202+0000 7fbd3f897700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbd3813b5c0 0x7fbd3813ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:44.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.202+0000 7fbd3f897700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd38144cd0 con 0x7fbd380b6c20 2020-06-12T17:48:44.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.202+0000 7fbd3f897700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd3813be90 con 0x7fbd3813b5c0 2020-06-12T17:48:44.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.202+0000 7fbd3f897700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd381579d0 con 0x7fbd38066b70 2020-06-12T17:48:44.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.202+0000 7fbd3ce32700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd38066b70 0x7fbd38157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:44.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.202+0000 7fbd3de34700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbd3813b5c0 0x7fbd3813ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:44.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.202+0000 7fbd3de34700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbd3813b5c0 0x7fbd3813ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:45964/0 (socket says 172.21.15.38:45964) 2020-06-12T17:48:44.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.202+0000 7fbd3de34700 1 -- 172.21.15.38:0/4100727865 learned_addr learned my addr 172.21.15.38:0/4100727865 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:44.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.202+0000 7fbd3ce32700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd38066b70 0x7fbd38157570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:55944/0 (socket says 172.21.15.38:55944) 2020-06-12T17:48:44.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.202+0000 7fbd3ce32700 1 -- 172.21.15.38:0/4100727865 >> v2:172.21.15.150:3300/0 conn(0x7fbd3813b5c0 msgr2=0x7fbd3813ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:44.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.202+0000 7fbd3ce32700 1 --2- 172.21.15.38:0/4100727865 >> v2:172.21.15.150:3300/0 conn(0x7fbd3813b5c0 0x7fbd3813ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:44.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.202+0000 7fbd3ce32700 1 -- 172.21.15.38:0/4100727865 >> v1:172.21.15.150:6789/0 conn(0x7fbd380b6c20 legacy=0x7fbd381445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:44.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.202+0000 7fbd3ce32700 1 -- 172.21.15.38:0/4100727865 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd380671a0 con 0x7fbd38066b70 2020-06-12T17:48:44.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.202+0000 7fbd3ce32700 1 --2- 172.21.15.38:0/4100727865 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd38066b70 0x7fbd38157570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbd340013e0 tx=0x7fbd3400e940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.202+0000 7fbd3ce32700 1 --2- 172.21.15.38:0/4100727865 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd38066b70 0x7fbd38157570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbd340013e0 tx=0x7fbd3400e940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.202+0000 7fbd3ce32700 1 --2- 172.21.15.38:0/4100727865 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd38066b70 0x7fbd38157570 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7fbd340013e0 tx=0x7fbd3400e940).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:44.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.202+0000 7fbd3ce32700 1 --2- 172.21.15.38:0/4100727865 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd38066b70 0x7fbd38157570 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fbd340013e0 tx=0x7fbd3400e940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.202+0000 7fbd267fc700 1 -- 172.21.15.38:0/4100727865 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd3400c450 con 0x7fbd38066b70 2020-06-12T17:48:44.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.202+0000 7fbd3ce32700 1 --2- 172.21.15.38:0/4100727865 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd38066b70 0x7fbd38157570 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fbd340013e0 tx=0x7fbd3400e940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.203+0000 7fbd3f897700 1 -- 172.21.15.38:0/4100727865 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd38063420 con 0x7fbd38066b70 2020-06-12T17:48:44.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.203+0000 7fbd267fc700 1 -- 172.21.15.38:0/4100727865 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3400c5f0 con 0x7fbd38066b70 2020-06-12T17:48:44.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.203+0000 7fbd3ce32700 1 --2- 172.21.15.38:0/4100727865 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd38066b70 0x7fbd38157570 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fbd340013e0 tx=0x7fbd3400e940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.203+0000 7fbd267fc700 1 -- 172.21.15.38:0/4100727865 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd34011a50 con 0x7fbd38066b70 2020-06-12T17:48:44.222 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.203+0000 7fbd3f897700 1 -- 172.21.15.38:0/4100727865 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd380b7000 con 0x7fbd38066b70 2020-06-12T17:48:44.227 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.203+0000 7fbd3ce32700 1 --2- 172.21.15.38:0/4100727865 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd38066b70 0x7fbd38157570 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fbd340013e0 tx=0x7fbd3400e940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.227 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.204+0000 7fbd3f897700 1 -- 172.21.15.38:0/4100727865 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd38056c30 con 0x7fbd38066b70 2020-06-12T17:48:44.227 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.204+0000 7fbd267fc700 1 -- 172.21.15.38:0/4100727865 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fbd34011cd0 con 0x7fbd38066b70 2020-06-12T17:48:44.227 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.204+0000 7fbd3ce32700 1 --2- 172.21.15.38:0/4100727865 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd38066b70 0x7fbd38157570 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fbd340013e0 tx=0x7fbd3400e940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.228 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.204+0000 7fbd267fc700 1 --2- 172.21.15.38:0/4100727865 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbd1804d4a0 0x7fbd1804f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:44.228 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.204+0000 7fbd267fc700 1 -- 172.21.15.38:0/4100727865 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fbd34060b70 con 0x7fbd38066b70 2020-06-12T17:48:44.228 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.204+0000 7fbd3d633700 1 --2- 172.21.15.38:0/4100727865 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbd1804d4a0 0x7fbd1804f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:44.228 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.204+0000 7fbd3d633700 1 --2- 172.21.15.38:0/4100727865 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbd1804d4a0 0x7fbd1804f960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbd38063a40 tx=0x7fbd280018e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.228 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.204+0000 7fbd3d633700 1 --2- 172.21.15.38:0/4100727865 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbd1804d4a0 0x7fbd1804f960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbd38063a40 tx=0x7fbd280018e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.229 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.204+0000 7fbd3d633700 1 --2- 172.21.15.38:0/4100727865 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbd1804d4a0 0x7fbd1804f960 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7fbd38063a40 tx=0x7fbd280018e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:44.229 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.208+0000 7fbd3ce32700 1 --2- 172.21.15.38:0/4100727865 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd38066b70 0x7fbd38157570 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fbd340013e0 tx=0x7fbd3400e940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.229 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.208+0000 7fbd267fc700 1 -- 172.21.15.38:0/4100727865 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fbd3403c2b0 con 0x7fbd38066b70 2020-06-12T17:48:44.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.360+0000 7fbd3f897700 1 -- 172.21.15.38:0/4100727865 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbd38063880 con 0x7fbd38066b70 2020-06-12T17:48:44.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.361+0000 7fbd3ce32700 1 --2- 172.21.15.38:0/4100727865 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd38066b70 0x7fbd38157570 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fbd340013e0 tx=0x7fbd3400e940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.361+0000 7fbd267fc700 1 -- 172.21.15.38:0/4100727865 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7fbd3403f8d0 con 0x7fbd38066b70 2020-06-12T17:48:44.365 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:44.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.362+0000 7fbd3f897700 1 -- 172.21.15.38:0/4100727865 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbd1804d4a0 msgr2=0x7fbd1804f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:44.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.362+0000 7fbd3f897700 1 --2- 172.21.15.38:0/4100727865 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbd1804d4a0 0x7fbd1804f960 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7fbd38063a40 tx=0x7fbd280018e0).stop 2020-06-12T17:48:44.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.362+0000 7fbd3f897700 1 -- 172.21.15.38:0/4100727865 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd38066b70 msgr2=0x7fbd38157570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:44.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.362+0000 7fbd3f897700 1 --2- 172.21.15.38:0/4100727865 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd38066b70 0x7fbd38157570 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7fbd340013e0 tx=0x7fbd3400e940).stop 2020-06-12T17:48:44.367 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.362+0000 7fbd3f897700 1 -- 172.21.15.38:0/4100727865 shutdown_connections 2020-06-12T17:48:44.367 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.362+0000 7fbd3f897700 1 --2- 172.21.15.38:0/4100727865 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbd1804d4a0 0x7fbd1804f960 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:44.367 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.362+0000 7fbd3f897700 1 --2- 172.21.15.38:0/4100727865 >> v2:172.21.15.150:3300/0 conn(0x7fbd3813b5c0 0x7fbd3813ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:44.367 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.362+0000 7fbd3f897700 1 --2- 172.21.15.38:0/4100727865 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd38066b70 0x7fbd38157570 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:44.367 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.362+0000 7fbd3f897700 1 -- 172.21.15.38:0/4100727865 >> 172.21.15.38:0/4100727865 conn(0x7fbd380b5a20 msgr2=0x7fbd380b4090 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:44.368 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.362+0000 7fbd3f897700 1 -- 172.21.15.38:0/4100727865 shutdown_connections 2020-06-12T17:48:44.368 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.362+0000 7fbd3f897700 1 -- 172.21.15.38:0/4100727865 wait complete. 2020-06-12T17:48:44.376 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-12T17:48:44.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.487+0000 7fe3e6265700 1 Processor -- start 2020-06-12T17:48:44.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.488+0000 7fe3e6265700 1 -- start start 2020-06-12T17:48:44.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.488+0000 7fe3e6265700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe3e0061a80 0x7fe3e009bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:44.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.488+0000 7fe3e6265700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3e00b44a0 0x7fe3e01427e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:44.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.488+0000 7fe3e6265700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3e00b2dc0 con 0x7fe3e0142350 2020-06-12T17:48:44.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.488+0000 7fe3e6265700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3e0142c40 con 0x7fe3e0061a80 2020-06-12T17:48:44.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.488+0000 7fe3e6265700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e009e560 con 0x7fe3e00b44a0 2020-06-12T17:48:44.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.488+0000 7fe3dffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe3e0061a80 0x7fe3e009bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:44.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.488+0000 7fe3dffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe3e0061a80 0x7fe3e009bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36492/0 (socket says 172.21.15.38:36492) 2020-06-12T17:48:44.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.489+0000 7fe3dffff700 1 -- 172.21.15.38:0/1647466710 learned_addr learned my addr 172.21.15.38:0/1647466710 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:44.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.489+0000 7fe3e4802700 1 --2- 172.21.15.38:0/1647466710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3e00b44a0 0x7fe3e01427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:44.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.489+0000 7fe3dffff700 1 -- 172.21.15.38:0/1647466710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3e00b44a0 msgr2=0x7fe3e01427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:44.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.489+0000 7fe3dffff700 1 --2- 172.21.15.38:0/1647466710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3e00b44a0 0x7fe3e01427e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:44.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.489+0000 7fe3dffff700 1 -- 172.21.15.38:0/1647466710 >> v1:172.21.15.150:6789/0 conn(0x7fe3e0142350 legacy=0x7fe3e0146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:44.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.489+0000 7fe3dffff700 1 -- 172.21.15.38:0/1647466710 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e00b29d0 con 0x7fe3e0061a80 2020-06-12T17:48:44.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.489+0000 7fe3dffff700 1 --2- 172.21.15.38:0/1647466710 >> v2:172.21.15.38:3300/0 conn(0x7fe3e0061a80 0x7fe3e009bee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe3d0002f30 tx=0x7fe3d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.489+0000 7fe3dffff700 1 --2- 172.21.15.38:0/1647466710 >> v2:172.21.15.38:3300/0 conn(0x7fe3e0061a80 0x7fe3e009bee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe3d0002f30 tx=0x7fe3d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.489+0000 7fe3dffff700 1 --2- 172.21.15.38:0/1647466710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e0061a80 0x7fe3e009bee0 secure :-1 s=READY pgs=261 cs=0 l=1 rx=0x7fe3d0002f30 tx=0x7fe3d0007e60).ready entity=mon.0 client_cookie=fb798210deb22000 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:44.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.489+0000 7fe3dffff700 1 --2- 172.21.15.38:0/1647466710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e0061a80 0x7fe3e009bee0 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7fe3d0002f30 tx=0x7fe3d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.489+0000 7fe3dffff700 1 --2- 172.21.15.38:0/1647466710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e0061a80 0x7fe3e009bee0 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7fe3d0002f30 tx=0x7fe3d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.489+0000 7fe3dffff700 1 --2- 172.21.15.38:0/1647466710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e0061a80 0x7fe3e009bee0 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7fe3d0002f30 tx=0x7fe3d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.489+0000 7fe3deffd700 1 -- 172.21.15.38:0/1647466710 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3d00116e0 con 0x7fe3e0061a80 2020-06-12T17:48:44.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.489+0000 7fe3deffd700 1 -- 172.21.15.38:0/1647466710 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d0011840 con 0x7fe3e0061a80 2020-06-12T17:48:44.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.489+0000 7fe3deffd700 1 -- 172.21.15.38:0/1647466710 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3d0011c60 con 0x7fe3e0061a80 2020-06-12T17:48:44.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.489+0000 7fe3e6265700 1 -- 172.21.15.38:0/1647466710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e0061a80 msgr2=0x7fe3e009bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:44.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.489+0000 7fe3e6265700 1 --2- 172.21.15.38:0/1647466710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e0061a80 0x7fe3e009bee0 secure :-1 s=READY pgs=261 cs=0 l=1 rx=0x7fe3d0002f30 tx=0x7fe3d0007e60).stop 2020-06-12T17:48:44.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.490+0000 7fe3e6265700 1 -- 172.21.15.38:0/1647466710 shutdown_connections 2020-06-12T17:48:44.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.490+0000 7fe3e6265700 1 --2- 172.21.15.38:0/1647466710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3e00b44a0 0x7fe3e01427e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:44.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.490+0000 7fe3e6265700 1 --2- 172.21.15.38:0/1647466710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e0061a80 0x7fe3e009bee0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:44.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.490+0000 7fe3e6265700 1 -- 172.21.15.38:0/1647466710 >> 172.21.15.38:0/1647466710 conn(0x7fe3e00b8420 msgr2=0x7fe3e00b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:44.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.490+0000 7fe3e6265700 1 -- 172.21.15.38:0/1647466710 shutdown_connections 2020-06-12T17:48:44.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.490+0000 7fe3e6265700 1 -- 172.21.15.38:0/1647466710 wait complete. 2020-06-12T17:48:44.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.491+0000 7fe3e6265700 1 Processor -- start 2020-06-12T17:48:44.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.491+0000 7fe3e6265700 1 -- start start 2020-06-12T17:48:44.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.492+0000 7fe3e6265700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe3e0061a80 0x7fe3e00665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:44.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.492+0000 7fe3e6265700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3e00af620 con 0x7fe3e0142350 2020-06-12T17:48:44.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.492+0000 7fe3e6265700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3e0064210 con 0x7fe3e00b44a0 2020-06-12T17:48:44.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.492+0000 7fe3e6265700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3e00644b0 con 0x7fe3e0061a80 2020-06-12T17:48:44.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.492+0000 7fe3dffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe3e0061a80 0x7fe3e00665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:44.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.492+0000 7fe3dffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe3e0061a80 0x7fe3e00665c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36496/0 (socket says 172.21.15.38:36496) 2020-06-12T17:48:44.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.492+0000 7fe3e4802700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe3e0142350 0x7fe3e0064950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38316/0 (socket says 172.21.15.38:38316) 2020-06-12T17:48:44.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.492+0000 7fe3dffff700 1 -- 172.21.15.38:0/3757411049 learned_addr learned my addr 172.21.15.38:0/3757411049 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:44.506 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.492+0000 7fe3dffff700 1 -- 172.21.15.38:0/3757411049 >> v1:172.21.15.150:6789/0 conn(0x7fe3e00b44a0 legacy=0x7fe3e013f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:44.506 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.492+0000 7fe3dffff700 1 -- 172.21.15.38:0/3757411049 >> v1:172.21.15.38:6789/0 conn(0x7fe3e0142350 legacy=0x7fe3e0064950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:44.506 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.492+0000 7fe3dd7fa700 1 -- 172.21.15.38:0/3757411049 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3448278201 0 0) 0x7fe3e00af620 con 0x7fe3e0142350 2020-06-12T17:48:44.506 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.492+0000 7fe3dffff700 1 -- 172.21.15.38:0/3757411049 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e013f750 con 0x7fe3e0061a80 2020-06-12T17:48:44.506 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.492+0000 7fe3dffff700 1 --2- 172.21.15.38:0/3757411049 >> v2:172.21.15.38:3300/0 conn(0x7fe3e0061a80 0x7fe3e00665c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe3e00ae3a0 tx=0x7fe3d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.492+0000 7fe3dffff700 1 --2- 172.21.15.38:0/3757411049 >> v2:172.21.15.38:3300/0 conn(0x7fe3e0061a80 0x7fe3e00665c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe3e00ae3a0 tx=0x7fe3d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.492+0000 7fe3dffff700 1 --2- 172.21.15.38:0/3757411049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e0061a80 0x7fe3e00665c0 secure :-1 s=READY pgs=263 cs=0 l=1 rx=0x7fe3e00ae3a0 tx=0x7fe3d0007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:44.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.492+0000 7fe3dffff700 1 --2- 172.21.15.38:0/3757411049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e0061a80 0x7fe3e00665c0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7fe3e00ae3a0 tx=0x7fe3d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.492+0000 7fe3dd7fa700 1 -- 172.21.15.38:0/3757411049 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3d0007340 con 0x7fe3e0061a80 2020-06-12T17:48:44.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.492+0000 7fe3dffff700 1 --2- 172.21.15.38:0/3757411049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e0061a80 0x7fe3e00665c0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7fe3e00ae3a0 tx=0x7fe3d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.492+0000 7fe3dd7fa700 1 -- 172.21.15.38:0/3757411049 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d00074a0 con 0x7fe3e0061a80 2020-06-12T17:48:44.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.492+0000 7fe3dffff700 1 --2- 172.21.15.38:0/3757411049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e0061a80 0x7fe3e00665c0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7fe3e00ae3a0 tx=0x7fe3d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.492+0000 7fe3dd7fa700 1 -- 172.21.15.38:0/3757411049 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3d00058b0 con 0x7fe3e0061a80 2020-06-12T17:48:44.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.492+0000 7fe3e6265700 1 -- 172.21.15.38:0/3757411049 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e00b3730 con 0x7fe3e0061a80 2020-06-12T17:48:44.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.493+0000 7fe3e6265700 1 -- 172.21.15.38:0/3757411049 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e00aef10 con 0x7fe3e0061a80 2020-06-12T17:48:44.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.493+0000 7fe3dffff700 1 --2- 172.21.15.38:0/3757411049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e0061a80 0x7fe3e00665c0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7fe3e00ae3a0 tx=0x7fe3d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.493+0000 7fe3e6265700 1 -- 172.21.15.38:0/3757411049 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e0056c30 con 0x7fe3e0061a80 2020-06-12T17:48:44.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.493+0000 7fe3dd7fa700 1 -- 172.21.15.38:0/3757411049 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe3d0005af0 con 0x7fe3e0061a80 2020-06-12T17:48:44.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.494+0000 7fe3dffff700 1 --2- 172.21.15.38:0/3757411049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e0061a80 0x7fe3e00665c0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7fe3e00ae3a0 tx=0x7fe3d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.494+0000 7fe3dd7fa700 1 --2- 172.21.15.38:0/3757411049 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe3c004d370 0x7fe3c004f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:44.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.494+0000 7fe3dd7fa700 1 -- 172.21.15.38:0/3757411049 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fe3d00615f0 con 0x7fe3e0061a80 2020-06-12T17:48:44.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.494+0000 7fe3df7fe700 1 --2- 172.21.15.38:0/3757411049 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe3c004d370 0x7fe3c004f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:44.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.494+0000 7fe3df7fe700 1 --2- 172.21.15.38:0/3757411049 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe3c004d370 0x7fe3c004f830 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe3e00adae0 tx=0x7fe3d40023e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.494+0000 7fe3df7fe700 1 --2- 172.21.15.38:0/3757411049 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe3c004d370 0x7fe3c004f830 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe3e00adae0 tx=0x7fe3d40023e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.494+0000 7fe3df7fe700 1 --2- 172.21.15.38:0/3757411049 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe3c004d370 0x7fe3c004f830 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7fe3e00adae0 tx=0x7fe3d40023e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:44.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.497+0000 7fe3dffff700 1 --2- 172.21.15.38:0/3757411049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e0061a80 0x7fe3e00665c0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7fe3e00ae3a0 tx=0x7fe3d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.511 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.497+0000 7fe3dd7fa700 1 -- 172.21.15.38:0/3757411049 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fe3d003cdf0 con 0x7fe3e0061a80 2020-06-12T17:48:44.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.648+0000 7fe3e6265700 1 -- 172.21.15.38:0/3757411049 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3e009b9f0 con 0x7fe3e0061a80 2020-06-12T17:48:44.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.649+0000 7fe3dffff700 1 --2- 172.21.15.38:0/3757411049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e0061a80 0x7fe3e00665c0 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7fe3e00ae3a0 tx=0x7fe3d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.649+0000 7fe3dd7fa700 1 -- 172.21.15.38:0/3757411049 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16347 (secure 0 0 0) 0x7fe3d0040410 con 0x7fe3e0061a80 2020-06-12T17:48:44.653 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:44.653 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":24,"fsid":"8e42a2e7-b187-42c4-a73f-8f812ee62352","created":"2020-06-12T17:47:54.434340+0000","modified":"2020-06-12T17:48:14.851712+0000","last_up_change":"2020-06-12T17:48:03.388718+0000","last_in_change":"2020-06-12T17:48:03.388718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-06-12T17:47:57.558119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-06-12T17:48:07.419264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-06-12T17:48:09.934098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-06-12T17:48:12.497229+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"44ac3dea-67b4-4b9a-bc18-ac511710afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":31038},{"type":"v1","addr":"172.21.15.38:6816","nonce":31038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":31038},{"type":"v1","addr":"172.21.15.38:6819","nonce":31038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":31038},{"type":"v1","addr":"172.21.15.38:6823","nonce":31038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":31038},{"type":"v1","addr":"172.21.15.38:6821","nonce":31038}]},"public_addr":"172.21.15.38:6816/31038","cluster_addr":"172.21.15.38:6819/31038","heartbeat_back_addr":"172.21.15.38:6823/31038","heartbeat_front_addr":"172.21.15.38:6821/31038","state":["exists","up"]},{"osd":1,"uuid":"561f7ced-3fff-4364-8619-6e4ecbc9d256","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":31036},{"type":"v1","addr":"172.21.15.38:6801","nonce":31036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":31036},{"type":"v1","addr":"172.21.15.38:6803","nonce":31036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":31036},{"type":"v1","addr":"172.21.15.38:6807","nonce":31036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":31036},{"type":"v1","addr":"172.21.15.38:6805","nonce":31036}]},"public_addr":"172.21.15.38:6801/31036","cluster_addr":"172.21.15.38:6803/31036","heartbeat_back_addr":"172.21.15.38:6807/31036","heartbeat_front_addr":"172.21.15.38:6805/31036","state":["exists","up"]},{"osd":2,"uuid":"0bb3c806-07af-49f5-b492-d0e33f2de37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":31053},{"type":"v1","addr":"172.21.15.38:6825","nonce":31053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":31053},{"type":"v1","addr":"172.21.15.38:6827","nonce":31053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":31053},{"type":"v1","addr":"172.21.15.38:6831","nonce":31053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":31053},{"type":"v1","addr":"172.21.15.38:6829","nonce":31053}]},"public_addr":"172.21.15.38:6825/31053","cluster_addr":"172.21.15.38:6827/31053","heartbeat_back_addr":"172.21.15.38:6831/31053","heartbeat_front_addr":"172.21.15.38:6829/31053","state":["exists","up"]},{"osd":3,"uuid":"7f6a1e75-7b11-456e-8a4b-510b16226800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":31037},{"type":"v1","addr":"172.21.15.38:6809","nonce":31037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":31037},{"type":"v1","addr":"172.21.15.38:6811","nonce":31037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6815","nonce":31037},{"type":"v1","addr":"172.21.15.38:6817","nonce":31037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":31037},{"type":"v1","addr":"172.21.15.38:6813","nonce":31037}]},"public_addr":"172.21.15.38:6809/31037","cluster_addr":"172.21.15.38:6811/31037","heartbeat_back_addr":"172.21.15.38:6817/31037","heartbeat_front_addr":"172.21.15.38:6813/31037","state":["exists","up"]},{"osd":4,"uuid":"0eca0272-8cfd-469c-a32d-e29730dc0e1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":31294},{"type":"v1","addr":"172.21.15.150:6803","nonce":31294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":31294},{"type":"v1","addr":"172.21.15.150:6805","nonce":31294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":31294},{"type":"v1","addr":"172.21.15.150:6809","nonce":31294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":31294},{"type":"v1","addr":"172.21.15.150:6807","nonce":31294}]},"public_addr":"172.21.15.150:6803/31294","cluster_addr":"172.21.15.150:6805/31294","heartbeat_back_addr":"172.21.15.150:6809/31294","heartbeat_front_addr":"172.21.15.150:6807/31294","state":["exists","up"]},{"osd":5,"uuid":"69d6a7dc-a55a-4ebc-8479-8bb921ddfb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":31295},{"type":"v1","addr":"172.21.15.150:6813","nonce":31295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":31295},{"type":"v1","addr":"172.21.15.150:6816","nonce":31295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":31295},{"type":"v1","addr":"172.21.15.150:6828","nonce":31295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6819","nonce":31295},{"type":"v1","addr":"172.21.15.150:6822","nonce":31295}]},"public_addr":"172.21.15.150:6813/31295","cluster_addr":"172.21.15.150:6816/31295","heartbeat_back_addr":"172.21.15.150:6828/31295","heartbeat_front_addr":"172.21.15.150:6822/31295","state":["exists","up"]},{"osd":6,"uuid":"f0d320f8-c2f0-40bb-b713-526246cf97b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":31297},{"type":"v1","addr":"172.21.15.150:6820","nonce":31297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6823","nonce":31297},{"type":"v1","addr":"172.21.15.150:6827","nonce":31297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":31297},{"type":"v1","addr":"172.21.15.150:6833","nonce":31297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":31297},{"type":"v1","addr":"172.21.15.150:6831","nonce":31297}]},"public_addr":"172.21.15.150:6820/31297","cluster_addr":"172.21.15.150:6827/31297","heartbeat_back_addr":"172.21.15.150:6833/31297","heartbeat_front_addr":"172.21.15.150:6831/31297","state":["exists","up"]},{"osd":7,"uuid":"970b7d02-a189-41b2-96e5-a5a5a57c6476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":31296},{"type":"v1","addr":"172.21.15.150:6812","nonce":31296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":31296},{"type":"v1","addr":"172.21.15.150:6818","nonce":31296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":31296},{"type":"v1","addr":"172.21.15.150:6829","nonce":31296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":31296},{"type":"v1","addr":"172.21.15.150:6824","nonce":31296}]},"public_addr":"172.21.15.150:6812/31296","cluster_addr":"172.21.15.150:6818/31296","heartbeat_back_addr":"172.21.15.150:6829/31296","heartbeat_front_addr":"172.21.15.150:6824/31296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.664300+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.644253+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.651120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.584978+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.561149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.661778+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T17:48:44.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.650+0000 7fe3e6265700 1 -- 172.21.15.38:0/3757411049 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe3c004d370 msgr2=0x7fe3c004f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:44.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.650+0000 7fe3e6265700 1 --2- 172.21.15.38:0/3757411049 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe3c004d370 0x7fe3c004f830 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7fe3e00adae0 tx=0x7fe3d40023e0).stop 2020-06-12T17:48:44.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.650+0000 7fe3e6265700 1 -- 172.21.15.38:0/3757411049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e0061a80 msgr2=0x7fe3e00665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:44.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.650+0000 7fe3e6265700 1 --2- 172.21.15.38:0/3757411049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e0061a80 0x7fe3e00665c0 secure :-1 s=READY pgs=263 cs=0 l=1 rx=0x7fe3e00ae3a0 tx=0x7fe3d0007e60).stop 2020-06-12T17:48:44.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.650+0000 7fe3e6265700 1 -- 172.21.15.38:0/3757411049 shutdown_connections 2020-06-12T17:48:44.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.650+0000 7fe3e6265700 1 --2- 172.21.15.38:0/3757411049 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe3c004d370 0x7fe3c004f830 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:44.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.650+0000 7fe3e6265700 1 --2- 172.21.15.38:0/3757411049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e0061a80 0x7fe3e00665c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:44.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.650+0000 7fe3e6265700 1 -- 172.21.15.38:0/3757411049 >> 172.21.15.38:0/3757411049 conn(0x7fe3e00b8420 msgr2=0x7fe3e01416d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:44.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.650+0000 7fe3e6265700 1 -- 172.21.15.38:0/3757411049 shutdown_connections 2020-06-12T17:48:44.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.650+0000 7fe3e6265700 1 -- 172.21.15.38:0/3757411049 wait complete. 2020-06-12T17:48:44.664 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-06-12T17:47:57.558119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-06-12T17:48:07.419264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-06-12T17:48:09.934098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-06-12T17:48:12.497229+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-06-12T17:48:44.665 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-06-12T17:48:44.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.779+0000 7f455710a700 1 Processor -- start 2020-06-12T17:48:44.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.779+0000 7f455710a700 1 -- start start 2020-06-12T17:48:44.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.779+0000 7f455710a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45500ad5b0 0x7f45500b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:44.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.779+0000 7f455710a700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4550146d20 con 0x7f4550146680 2020-06-12T17:48:44.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.779+0000 7f455710a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4550066a80 con 0x7f455009d8d0 2020-06-12T17:48:44.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.779+0000 7f455710a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4550146f50 con 0x7f45500ad5b0 2020-06-12T17:48:44.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.780+0000 7f4554ea6700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4550146680 0x7f455009d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38320/0 (socket says 172.21.15.38:38320) 2020-06-12T17:48:44.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.780+0000 7f4554ea6700 1 -- 172.21.15.38:0/277547216 learned_addr learned my addr 172.21.15.38:0/277547216 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:44.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.780+0000 7f454ffff700 1 --2- 172.21.15.38:0/277547216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45500ad5b0 0x7f45500b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:44.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.780+0000 7f454f7fe700 1 -- 172.21.15.38:0/277547216 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3285409261 0 0) 0x7f4550146d20 con 0x7f4550146680 2020-06-12T17:48:44.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.780+0000 7f454f7fe700 1 -- 172.21.15.38:0/277547216 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f453c003230 con 0x7f4550146680 2020-06-12T17:48:44.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.780+0000 7f454f7fe700 1 -- 172.21.15.38:0/277547216 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 243759561 0 0) 0x7f4550066a80 con 0x7f455009d8d0 2020-06-12T17:48:44.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.780+0000 7f454f7fe700 1 -- 172.21.15.38:0/277547216 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4550146d20 con 0x7f455009d8d0 2020-06-12T17:48:44.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.780+0000 7f454f7fe700 1 -- 172.21.15.38:0/277547216 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2242743121 0 0) 0x7f453c003230 con 0x7f4550146680 2020-06-12T17:48:44.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.780+0000 7f454f7fe700 1 -- 172.21.15.38:0/277547216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45500ad5b0 msgr2=0x7f45500b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:44.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.780+0000 7f454f7fe700 1 --2- 172.21.15.38:0/277547216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45500ad5b0 0x7f45500b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:44.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.780+0000 7f454f7fe700 1 -- 172.21.15.38:0/277547216 >> v1:172.21.15.150:6789/0 conn(0x7f455009d8d0 legacy=0x7f45501421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:44.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.780+0000 7f454f7fe700 1 -- 172.21.15.38:0/277547216 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4550146a60 con 0x7f4550146680 2020-06-12T17:48:44.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.780+0000 7f454f7fe700 1 -- 172.21.15.38:0/277547216 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f45400016d0 con 0x7f4550146680 2020-06-12T17:48:44.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.780+0000 7f454f7fe700 1 -- 172.21.15.38:0/277547216 >> v1:172.21.15.38:6789/0 conn(0x7f4550146680 legacy=0x7f455009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:44.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.780+0000 7f454f7fe700 1 --2- 172.21.15.38:0/277547216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45500ad5b0 0x7f453c0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:44.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.780+0000 7f454f7fe700 1 --2- 172.21.15.38:0/277547216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f453c003d40 0x7f453c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:44.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.780+0000 7f454f7fe700 1 --2- 172.21.15.38:0/277547216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f453c004930 0x7f453c004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:44.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.780+0000 7f454f7fe700 1 -- 172.21.15.38:0/277547216 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4550146f50 con 0x7f453c004930 2020-06-12T17:48:44.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.780+0000 7f454f7fe700 1 -- 172.21.15.38:0/277547216 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453c005210 con 0x7f453c003d40 2020-06-12T17:48:44.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.780+0000 7f454f7fe700 1 -- 172.21.15.38:0/277547216 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453c00b720 con 0x7f45500ad5b0 2020-06-12T17:48:44.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.780+0000 7f45556a7700 1 --2- 172.21.15.38:0/277547216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f453c004930 0x7f453c004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:44.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.780+0000 7f4554ea6700 1 --2- 172.21.15.38:0/277547216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45500ad5b0 0x7f453c0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:44.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.780+0000 7f454ffff700 1 --2- 172.21.15.38:0/277547216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f453c003d40 0x7f453c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:44.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.781+0000 7f45556a7700 1 -- 172.21.15.38:0/277547216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45500ad5b0 msgr2=0x7f453c0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:44.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.781+0000 7f45556a7700 1 --2- 172.21.15.38:0/277547216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45500ad5b0 0x7f453c0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:44.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.781+0000 7f45556a7700 1 -- 172.21.15.38:0/277547216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f453c003d40 msgr2=0x7f453c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:44.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.781+0000 7f45556a7700 1 --2- 172.21.15.38:0/277547216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f453c003d40 0x7f453c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:44.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.781+0000 7f45556a7700 1 -- 172.21.15.38:0/277547216 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c003230 con 0x7f453c004930 2020-06-12T17:48:44.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.781+0000 7f45556a7700 1 --2- 172.21.15.38:0/277547216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f453c004930 0x7f453c004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4548001450 tx=0x7f4548001d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.781+0000 7f45556a7700 1 --2- 172.21.15.38:0/277547216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f453c004930 0x7f453c004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4548001450 tx=0x7f4548001d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.781+0000 7f45556a7700 1 --2- 172.21.15.38:0/277547216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f453c004930 0x7f453c004db0 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7f4548001450 tx=0x7f4548001d20).ready entity=mon.0 client_cookie=e4e290dc19a23082 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:44.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.781+0000 7f45556a7700 1 --2- 172.21.15.38:0/277547216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f453c004930 0x7f453c004db0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f4548001450 tx=0x7f4548001d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.781+0000 7f45556a7700 1 --2- 172.21.15.38:0/277547216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f453c004930 0x7f453c004db0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f4548001450 tx=0x7f4548001d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.781+0000 7f454f7fe700 1 -- 172.21.15.38:0/277547216 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4548010dd0 con 0x7f453c004930 2020-06-12T17:48:44.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.781+0000 7f45556a7700 1 --2- 172.21.15.38:0/277547216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f453c004930 0x7f453c004db0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f4548001450 tx=0x7f4548001d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.781+0000 7f454f7fe700 1 -- 172.21.15.38:0/277547216 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4548006860 con 0x7f453c004930 2020-06-12T17:48:44.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.781+0000 7f454f7fe700 1 -- 172.21.15.38:0/277547216 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4548006c40 con 0x7f453c004930 2020-06-12T17:48:44.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.781+0000 7f455710a700 1 -- 172.21.15.38:0/277547216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f453c004930 msgr2=0x7f453c004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:44.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.781+0000 7f455710a700 1 --2- 172.21.15.38:0/277547216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f453c004930 0x7f453c004db0 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7f4548001450 tx=0x7f4548001d20).stop 2020-06-12T17:48:44.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.781+0000 7f45556a7700 1 -- 172.21.15.38:0/277547216 reap_dead start 2020-06-12T17:48:44.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.781+0000 7f455710a700 1 -- 172.21.15.38:0/277547216 shutdown_connections 2020-06-12T17:48:44.800 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.781+0000 7f455710a700 1 -- 172.21.15.38:0/277547216 >> 172.21.15.38:0/277547216 conn(0x7f45500b5a20 msgr2=0x7f455005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:44.800 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.781+0000 7f455710a700 1 -- 172.21.15.38:0/277547216 shutdown_connections 2020-06-12T17:48:44.800 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.782+0000 7f455710a700 1 -- 172.21.15.38:0/277547216 wait complete. 2020-06-12T17:48:44.800 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.782+0000 7f455710a700 1 Processor -- start 2020-06-12T17:48:44.800 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.782+0000 7f455710a700 1 -- start start 2020-06-12T17:48:44.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.783+0000 7f455710a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f45500b7560 0x7f4550065f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:44.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.783+0000 7f455710a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45500b0c50 0x7f455013dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:44.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.783+0000 7f455710a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f455013e340 0x7f45500b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:44.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.783+0000 7f455710a700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4550151280 con 0x7f45500b7560 2020-06-12T17:48:44.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.783+0000 7f455710a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45500b1280 con 0x7f455013e340 2020-06-12T17:48:44.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.783+0000 7f455710a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45500b1520 con 0x7f45500b0c50 2020-06-12T17:48:44.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.783+0000 7f4554ea6700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f45500b7560 0x7f4550065f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:44.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.783+0000 7f4554ea6700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f45500b7560 0x7f4550065f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36516/0 (socket says 172.21.15.38:36516) 2020-06-12T17:48:44.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.783+0000 7f4554ea6700 1 -- 172.21.15.38:0/554815155 learned_addr learned my addr 172.21.15.38:0/554815155 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:44.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.783+0000 7f454ffff700 1 --2- 172.21.15.38:0/554815155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45500b0c50 0x7f455013dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:44.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.783+0000 7f45556a7700 1 --2- 172.21.15.38:0/554815155 >> v2:172.21.15.150:3300/0 conn(0x7f455013e340 0x7f45500b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:44.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.784+0000 7f4554ea6700 1 -- 172.21.15.38:0/554815155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45500b0c50 msgr2=0x7f455013dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:44.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.784+0000 7f4554ea6700 1 --2- 172.21.15.38:0/554815155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45500b0c50 0x7f455013dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:44.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.784+0000 7f4554ea6700 1 -- 172.21.15.38:0/554815155 >> v2:172.21.15.150:3300/0 conn(0x7f455013e340 msgr2=0x7f45500b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:44.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.784+0000 7f4554ea6700 1 --2- 172.21.15.38:0/554815155 >> v2:172.21.15.150:3300/0 conn(0x7f455013e340 0x7f45500b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:44.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.784+0000 7f4554ea6700 1 -- 172.21.15.38:0/554815155 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45500b17c0 con 0x7f45500b7560 2020-06-12T17:48:44.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.784+0000 7f4554ea6700 1 --2- 172.21.15.38:0/554815155 >> v2:172.21.15.38:3300/0 conn(0x7f45500b7560 0x7f4550065f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f45400014a0 tx=0x7f4550146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.784+0000 7f4554ea6700 1 --2- 172.21.15.38:0/554815155 >> v2:172.21.15.38:3300/0 conn(0x7f45500b7560 0x7f4550065f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f45400014a0 tx=0x7f4550146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.805 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.784+0000 7f4554ea6700 1 --2- 172.21.15.38:0/554815155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45500b7560 0x7f4550065f50 secure :-1 s=READY pgs=266 cs=0 l=1 rx=0x7f45400014a0 tx=0x7f4550146220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:44.805 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.784+0000 7f4554ea6700 1 --2- 172.21.15.38:0/554815155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45500b7560 0x7f4550065f50 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7f45400014a0 tx=0x7f4550146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.805 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.784+0000 7f4554ea6700 1 --2- 172.21.15.38:0/554815155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45500b7560 0x7f4550065f50 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7f45400014a0 tx=0x7f4550146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.805 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.784+0000 7f454dffb700 1 -- 172.21.15.38:0/554815155 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f454000e530 con 0x7f45500b7560 2020-06-12T17:48:44.805 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.784+0000 7f4554ea6700 1 --2- 172.21.15.38:0/554815155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45500b7560 0x7f4550065f50 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7f45400014a0 tx=0x7f4550146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.784+0000 7f454dffb700 1 -- 172.21.15.38:0/554815155 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454000e690 con 0x7f45500b7560 2020-06-12T17:48:44.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.784+0000 7f455710a700 1 -- 172.21.15.38:0/554815155 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45500b7940 con 0x7f45500b7560 2020-06-12T17:48:44.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.784+0000 7f454dffb700 1 -- 172.21.15.38:0/554815155 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f454000c9b0 con 0x7f45500b7560 2020-06-12T17:48:44.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.784+0000 7f455710a700 1 -- 172.21.15.38:0/554815155 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45500b3de0 con 0x7f45500b7560 2020-06-12T17:48:44.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.785+0000 7f4554ea6700 1 --2- 172.21.15.38:0/554815155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45500b7560 0x7f4550065f50 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7f45400014a0 tx=0x7f4550146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.807 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.785+0000 7f455710a700 1 -- 172.21.15.38:0/554815155 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4550056c30 con 0x7f45500b7560 2020-06-12T17:48:44.807 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.785+0000 7f454dffb700 1 -- 172.21.15.38:0/554815155 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f454000cc20 con 0x7f45500b7560 2020-06-12T17:48:44.807 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.785+0000 7f4554ea6700 1 --2- 172.21.15.38:0/554815155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45500b7560 0x7f4550065f50 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7f45400014a0 tx=0x7f4550146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.807 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.786+0000 7f454dffb700 1 --2- 172.21.15.38:0/554815155 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f453004d600 0x7f453004fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:44.807 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.786+0000 7f454dffb700 1 -- 172.21.15.38:0/554815155 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f4540060ab0 con 0x7f45500b7560 2020-06-12T17:48:44.808 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.786+0000 7f454ffff700 1 --2- 172.21.15.38:0/554815155 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f453004d600 0x7f453004fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:44.808 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.786+0000 7f454ffff700 1 --2- 172.21.15.38:0/554815155 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f453004d600 0x7f453004fac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4544002f30 tx=0x7f4544007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.809 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.786+0000 7f454ffff700 1 --2- 172.21.15.38:0/554815155 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f453004d600 0x7f453004fac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4544002f30 tx=0x7f4544007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.809 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.786+0000 7f454ffff700 1 --2- 172.21.15.38:0/554815155 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f453004d600 0x7f453004fac0 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f4544002f30 tx=0x7f4544007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:44.809 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.789+0000 7f4554ea6700 1 --2- 172.21.15.38:0/554815155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45500b7560 0x7f4550065f50 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7f45400014a0 tx=0x7f4550146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.810 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.789+0000 7f454dffb700 1 -- 172.21.15.38:0/554815155 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f454003c210 con 0x7f45500b7560 2020-06-12T17:48:44.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.941+0000 7f455710a700 1 -- 172.21.15.38:0/554815155 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f45500b1060 con 0x7f45500b7560 2020-06-12T17:48:44.946 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.942+0000 7f4554ea6700 1 --2- 172.21.15.38:0/554815155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45500b7560 0x7f4550065f50 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7f45400014a0 tx=0x7f4550146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:44.946 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.942+0000 7f454dffb700 1 -- 172.21.15.38:0/554815155 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4540007020 con 0x7f45500b7560 2020-06-12T17:48:44.946 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2020-06-12T17:48:44.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.943+0000 7f455710a700 1 -- 172.21.15.38:0/554815155 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f453004d600 msgr2=0x7f453004fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:44.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.943+0000 7f455710a700 1 --2- 172.21.15.38:0/554815155 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f453004d600 0x7f453004fac0 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f4544002f30 tx=0x7f4544007e60).stop 2020-06-12T17:48:44.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.943+0000 7f455710a700 1 -- 172.21.15.38:0/554815155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45500b7560 msgr2=0x7f4550065f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:44.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.943+0000 7f455710a700 1 --2- 172.21.15.38:0/554815155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45500b7560 0x7f4550065f50 secure :-1 s=READY pgs=266 cs=0 l=1 rx=0x7f45400014a0 tx=0x7f4550146220).stop 2020-06-12T17:48:44.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.943+0000 7f455710a700 1 -- 172.21.15.38:0/554815155 shutdown_connections 2020-06-12T17:48:44.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.943+0000 7f455710a700 1 --2- 172.21.15.38:0/554815155 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f453004d600 0x7f453004fac0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:44.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.943+0000 7f455710a700 1 --2- 172.21.15.38:0/554815155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45500b7560 0x7f4550065f50 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:44.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.943+0000 7f455710a700 1 --2- 172.21.15.38:0/554815155 >> v2:172.21.15.150:3300/0 conn(0x7f455013e340 0x7f45500b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:44.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.943+0000 7f455710a700 1 --2- 172.21.15.38:0/554815155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45500b0c50 0x7f455013dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:44.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.943+0000 7f455710a700 1 -- 172.21.15.38:0/554815155 >> 172.21.15.38:0/554815155 conn(0x7f45500b5a20 msgr2=0x7f4550145510 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:44.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.943+0000 7f455710a700 1 -- 172.21.15.38:0/554815155 shutdown_connections 2020-06-12T17:48:44.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:44.943+0000 7f455710a700 1 -- 172.21.15.38:0/554815155 wait complete. 2020-06-12T17:48:44.957 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-06-12T17:48:45.074 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.071+0000 7f6093686700 1 Processor -- start 2020-06-12T17:48:45.075 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.071+0000 7f6093686700 1 -- start start 2020-06-12T17:48:45.079 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.072+0000 7f6093686700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f608c0ad5b0 0x7f608c0b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:45.079 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.072+0000 7f6093686700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f608c146d20 con 0x7f608c146680 2020-06-12T17:48:45.079 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.072+0000 7f6093686700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f608c066a80 con 0x7f608c09d8d0 2020-06-12T17:48:45.079 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.072+0000 7f6093686700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608c146f50 con 0x7f608c0ad5b0 2020-06-12T17:48:45.079 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.072+0000 7f6091422700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f608c146680 0x7f608c09d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38340/0 (socket says 172.21.15.38:38340) 2020-06-12T17:48:45.080 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.072+0000 7f6091422700 1 -- 172.21.15.38:0/3684644651 learned_addr learned my addr 172.21.15.38:0/3684644651 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:45.080 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.072+0000 7f6090c21700 1 --2- 172.21.15.38:0/3684644651 >> v2:172.21.15.150:3300/0 conn(0x7f608c0ad5b0 0x7f608c0b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:45.080 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.072+0000 7f607ffff700 1 -- 172.21.15.38:0/3684644651 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991627768 0 0) 0x7f608c146d20 con 0x7f608c146680 2020-06-12T17:48:45.080 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.072+0000 7f607ffff700 1 -- 172.21.15.38:0/3684644651 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6074003230 con 0x7f608c146680 2020-06-12T17:48:45.080 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f607ffff700 1 -- 172.21.15.38:0/3684644651 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1089827567 0 0) 0x7f6074003230 con 0x7f608c146680 2020-06-12T17:48:45.081 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f607ffff700 1 -- 172.21.15.38:0/3684644651 >> v2:172.21.15.150:3300/0 conn(0x7f608c0ad5b0 msgr2=0x7f608c0b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:45.081 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f607ffff700 1 --2- 172.21.15.38:0/3684644651 >> v2:172.21.15.150:3300/0 conn(0x7f608c0ad5b0 0x7f608c0b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:45.081 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f607ffff700 1 -- 172.21.15.38:0/3684644651 >> v1:172.21.15.150:6789/0 conn(0x7f608c09d8d0 legacy=0x7f608c1421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:45.081 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f607ffff700 1 -- 172.21.15.38:0/3684644651 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c146a60 con 0x7f608c146680 2020-06-12T17:48:45.081 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f607ffff700 1 -- 172.21.15.38:0/3684644651 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f60800016d0 con 0x7f608c146680 2020-06-12T17:48:45.082 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f607ffff700 1 -- 172.21.15.38:0/3684644651 >> v1:172.21.15.38:6789/0 conn(0x7f608c146680 legacy=0x7f608c09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:45.082 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f607ffff700 1 --2- 172.21.15.38:0/3684644651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6074003720 0x7f6074003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:45.082 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f607ffff700 1 --2- 172.21.15.38:0/3684644651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6074004020 0x7f60740044f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:45.082 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f607ffff700 1 --2- 172.21.15.38:0/3684644651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6074004a60 0x7f6074004f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:45.082 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f607ffff700 1 -- 172.21.15.38:0/3684644651 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608c146f50 con 0x7f6074004a60 2020-06-12T17:48:45.083 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f607ffff700 1 -- 172.21.15.38:0/3684644651 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607400b830 con 0x7f6074003720 2020-06-12T17:48:45.083 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f607ffff700 1 -- 172.21.15.38:0/3684644651 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607400b9f0 con 0x7f6074004020 2020-06-12T17:48:45.083 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f6090c21700 1 --2- 172.21.15.38:0/3684644651 >> v2:172.21.15.150:3300/0 conn(0x7f608c0ad5b0 0x7f608c0b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:45.083 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f6091c23700 1 --2- 172.21.15.38:0/3684644651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6074004a60 0x7f6074004f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:45.083 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f6091422700 1 --2- 172.21.15.38:0/3684644651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6074003720 0x7f6074003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:45.084 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f6090c21700 1 --2- 172.21.15.38:0/3684644651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6074004020 0x7f60740044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:45.084 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f6091c23700 1 -- 172.21.15.38:0/3684644651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6074004020 msgr2=0x7f60740044f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:45.084 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f6091c23700 1 --2- 172.21.15.38:0/3684644651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6074004020 0x7f60740044f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:45.084 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f6091c23700 1 -- 172.21.15.38:0/3684644651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6074003720 msgr2=0x7f6074003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:45.084 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f6091c23700 1 --2- 172.21.15.38:0/3684644651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6074003720 0x7f6074003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:45.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f6091c23700 1 -- 172.21.15.38:0/3684644651 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6074003230 con 0x7f6074004a60 2020-06-12T17:48:45.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f6091c23700 1 --2- 172.21.15.38:0/3684644651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6074004a60 0x7f6074004f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6084001360 tx=0x7f6084001c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f6091c23700 1 -- 172.21.15.38:0/3684644651 reap_dead start 2020-06-12T17:48:45.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f6091c23700 1 --2- 172.21.15.38:0/3684644651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6074004a60 0x7f6074004f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6084001360 tx=0x7f6084001c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f6091c23700 1 --2- 172.21.15.38:0/3684644651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6074004a60 0x7f6074004f10 secure :-1 s=READY pgs=268 cs=0 l=1 rx=0x7f6084001360 tx=0x7f6084001c70).ready entity=mon.0 client_cookie=b66d01010308959a server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:45.092 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f6091c23700 1 --2- 172.21.15.38:0/3684644651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6074004a60 0x7f6074004f10 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7f6084001360 tx=0x7f6084001c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.092 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f6091c23700 1 --2- 172.21.15.38:0/3684644651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6074004a60 0x7f6074004f10 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7f6084001360 tx=0x7f6084001c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.092 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f607ffff700 1 -- 172.21.15.38:0/3684644651 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6084006c40 con 0x7f6074004a60 2020-06-12T17:48:45.092 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.073+0000 7f6091c23700 1 --2- 172.21.15.38:0/3684644651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6074004a60 0x7f6074004f10 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7f6084001360 tx=0x7f6084001c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.093 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.074+0000 7f607ffff700 1 -- 172.21.15.38:0/3684644651 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6084006da0 con 0x7f6074004a60 2020-06-12T17:48:45.093 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.074+0000 7f607ffff700 1 -- 172.21.15.38:0/3684644651 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6084002640 con 0x7f6074004a60 2020-06-12T17:48:45.093 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.074+0000 7f6093686700 1 -- 172.21.15.38:0/3684644651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6074004a60 msgr2=0x7f6074004f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:45.093 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.074+0000 7f6093686700 1 --2- 172.21.15.38:0/3684644651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6074004a60 0x7f6074004f10 secure :-1 s=READY pgs=268 cs=0 l=1 rx=0x7f6084001360 tx=0x7f6084001c70).stop 2020-06-12T17:48:45.093 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.074+0000 7f6093686700 1 -- 172.21.15.38:0/3684644651 shutdown_connections 2020-06-12T17:48:45.094 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.074+0000 7f6093686700 1 --2- 172.21.15.38:0/3684644651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6074004a60 0x7f6074004f10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:45.094 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.074+0000 7f6093686700 1 -- 172.21.15.38:0/3684644651 >> 172.21.15.38:0/3684644651 conn(0x7f608c0b5a20 msgr2=0x7f608c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:45.094 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.074+0000 7f6093686700 1 -- 172.21.15.38:0/3684644651 shutdown_connections 2020-06-12T17:48:45.094 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.074+0000 7f6093686700 1 -- 172.21.15.38:0/3684644651 wait complete. 2020-06-12T17:48:45.094 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.075+0000 7f6093686700 1 Processor -- start 2020-06-12T17:48:45.094 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.075+0000 7f6093686700 1 -- start start 2020-06-12T17:48:45.097 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.076+0000 7f6093686700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6074004a60 0x7f608c063d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:45.098 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.076+0000 7f6093686700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f608c147150 0x7f608c0657a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:45.098 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.076+0000 7f6093686700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f608c065c00 con 0x7f608c0b16c0 2020-06-12T17:48:45.098 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.076+0000 7f6093686700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608c0630e0 con 0x7f608c147150 2020-06-12T17:48:45.098 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.076+0000 7f6093686700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608c065e40 con 0x7f6074004a60 2020-06-12T17:48:45.098 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.076+0000 7f6090c21700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f608c147150 0x7f608c0657a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:45.099 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.076+0000 7f6090c21700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f608c147150 0x7f608c0657a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36538/0 (socket says 172.21.15.38:36538) 2020-06-12T17:48:45.099 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.076+0000 7f6090c21700 1 -- 172.21.15.38:0/3491372248 learned_addr learned my addr 172.21.15.38:0/3491372248 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:45.099 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.076+0000 7f6091422700 1 --2- 172.21.15.38:0/3491372248 >> v2:172.21.15.150:3300/0 conn(0x7f6074004a60 0x7f608c063d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:45.099 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.076+0000 7f6090c21700 1 -- 172.21.15.38:0/3491372248 >> v2:172.21.15.150:3300/0 conn(0x7f6074004a60 msgr2=0x7f608c063d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:45.099 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.076+0000 7f6090c21700 1 --2- 172.21.15.38:0/3491372248 >> v2:172.21.15.150:3300/0 conn(0x7f6074004a60 0x7f608c063d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:45.100 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.076+0000 7f6090c21700 1 -- 172.21.15.38:0/3491372248 >> v1:172.21.15.150:6789/0 conn(0x7f608c0b16c0 legacy=0x7f608c0b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:45.100 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.076+0000 7f6090c21700 1 -- 172.21.15.38:0/3491372248 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c0660e0 con 0x7f608c147150 2020-06-12T17:48:45.100 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.076+0000 7f6090c21700 1 --2- 172.21.15.38:0/3491372248 >> v2:172.21.15.38:3300/0 conn(0x7f608c147150 0x7f608c0657a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f608c0b2b70 tx=0x7f6088007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.100 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.076+0000 7f6090c21700 1 --2- 172.21.15.38:0/3491372248 >> v2:172.21.15.38:3300/0 conn(0x7f608c147150 0x7f608c0657a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f608c0b2b70 tx=0x7f6088007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.100 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.076+0000 7f6090c21700 1 --2- 172.21.15.38:0/3491372248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f608c147150 0x7f608c0657a0 secure :-1 s=READY pgs=269 cs=0 l=1 rx=0x7f608c0b2b70 tx=0x7f6088007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:45.101 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.076+0000 7f6090c21700 1 --2- 172.21.15.38:0/3491372248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f608c147150 0x7f608c0657a0 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f608c0b2b70 tx=0x7f6088007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.101 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.076+0000 7f6090c21700 1 --2- 172.21.15.38:0/3491372248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f608c147150 0x7f608c0657a0 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f608c0b2b70 tx=0x7f6088007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.101 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.076+0000 7f607e7fc700 1 -- 172.21.15.38:0/3491372248 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6088013060 con 0x7f608c147150 2020-06-12T17:48:45.101 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.076+0000 7f6090c21700 1 --2- 172.21.15.38:0/3491372248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f608c147150 0x7f608c0657a0 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f608c0b2b70 tx=0x7f6088007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.101 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.076+0000 7f607e7fc700 1 -- 172.21.15.38:0/3491372248 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6088005aa0 con 0x7f608c147150 2020-06-12T17:48:45.102 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.076+0000 7f6093686700 1 -- 172.21.15.38:0/3491372248 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608c062dd0 con 0x7f608c147150 2020-06-12T17:48:45.102 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.077+0000 7f607e7fc700 1 -- 172.21.15.38:0/3491372248 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6088005e40 con 0x7f608c147150 2020-06-12T17:48:45.102 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.077+0000 7f6093686700 1 -- 172.21.15.38:0/3491372248 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f608c0b2480 con 0x7f608c147150 2020-06-12T17:48:45.102 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.077+0000 7f6090c21700 1 --2- 172.21.15.38:0/3491372248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f608c147150 0x7f608c0657a0 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f608c0b2b70 tx=0x7f6088007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.102 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.078+0000 7f607e7fc700 1 -- 172.21.15.38:0/3491372248 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f6088007180 con 0x7f608c147150 2020-06-12T17:48:45.103 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.078+0000 7f6090c21700 1 --2- 172.21.15.38:0/3491372248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f608c147150 0x7f608c0657a0 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f608c0b2b70 tx=0x7f6088007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.103 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.078+0000 7f6093686700 1 -- 172.21.15.38:0/3491372248 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f608c056c30 con 0x7f608c147150 2020-06-12T17:48:45.103 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.078+0000 7f607e7fc700 1 --2- 172.21.15.38:0/3491372248 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f606c04d590 0x7f606c04fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:45.103 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.078+0000 7f607e7fc700 1 -- 172.21.15.38:0/3491372248 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f6088061450 con 0x7f608c147150 2020-06-12T17:48:45.103 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.078+0000 7f6091422700 1 --2- 172.21.15.38:0/3491372248 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f606c04d590 0x7f606c04fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:45.104 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.078+0000 7f6091422700 1 --2- 172.21.15.38:0/3491372248 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f606c04d590 0x7f606c04fa50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f60800013e0 tx=0x7f608c0aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.104 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.078+0000 7f6091422700 1 --2- 172.21.15.38:0/3491372248 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f606c04d590 0x7f606c04fa50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f60800013e0 tx=0x7f608c0aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.104 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.078+0000 7f6091422700 1 --2- 172.21.15.38:0/3491372248 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f606c04d590 0x7f606c04fa50 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7f60800013e0 tx=0x7f608c0aec70).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:45.104 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.081+0000 7f6090c21700 1 --2- 172.21.15.38:0/3491372248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f608c147150 0x7f608c0657a0 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f608c0b2b70 tx=0x7f6088007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.104 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.081+0000 7f607e7fc700 1 -- 172.21.15.38:0/3491372248 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f608803cc10 con 0x7f608c147150 2020-06-12T17:48:45.235 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.231+0000 7f6093686700 1 -- 172.21.15.38:0/3491372248 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f608c05a5e0 con 0x7f608c147150 2020-06-12T17:48:45.236 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.232+0000 7f6090c21700 1 --2- 172.21.15.38:0/3491372248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f608c147150 0x7f608c0657a0 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f608c0b2b70 tx=0x7f6088007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.236 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.232+0000 7f607e7fc700 1 -- 172.21.15.38:0/3491372248 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6088040230 con 0x7f608c147150 2020-06-12T17:48:45.236 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:45.237 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.233+0000 7f6093686700 1 -- 172.21.15.38:0/3491372248 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f606c04d590 msgr2=0x7f606c04fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:45.237 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.233+0000 7f6093686700 1 --2- 172.21.15.38:0/3491372248 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f606c04d590 0x7f606c04fa50 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7f60800013e0 tx=0x7f608c0aec70).stop 2020-06-12T17:48:45.238 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.233+0000 7f6093686700 1 -- 172.21.15.38:0/3491372248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f608c147150 msgr2=0x7f608c0657a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:45.238 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.233+0000 7f6093686700 1 --2- 172.21.15.38:0/3491372248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f608c147150 0x7f608c0657a0 secure :-1 s=READY pgs=269 cs=0 l=1 rx=0x7f608c0b2b70 tx=0x7f6088007e60).stop 2020-06-12T17:48:45.238 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.233+0000 7f6093686700 1 -- 172.21.15.38:0/3491372248 shutdown_connections 2020-06-12T17:48:45.238 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.233+0000 7f6093686700 1 --2- 172.21.15.38:0/3491372248 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f606c04d590 0x7f606c04fa50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:45.238 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.233+0000 7f6093686700 1 --2- 172.21.15.38:0/3491372248 >> v2:172.21.15.150:3300/0 conn(0x7f6074004a60 0x7f608c063d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:45.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.233+0000 7f6093686700 1 --2- 172.21.15.38:0/3491372248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f608c147150 0x7f608c0657a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:45.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.233+0000 7f6093686700 1 -- 172.21.15.38:0/3491372248 >> 172.21.15.38:0/3491372248 conn(0x7f608c0b5a20 msgr2=0x7f608c144930 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:45.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.233+0000 7f6093686700 1 -- 172.21.15.38:0/3491372248 shutdown_connections 2020-06-12T17:48:45.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.233+0000 7f6093686700 1 -- 172.21.15.38:0/3491372248 wait complete. 2020-06-12T17:48:45.247 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-06-12T17:48:45.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.361+0000 7fd0c107c700 1 Processor -- start 2020-06-12T17:48:45.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.361+0000 7fd0c107c700 1 -- start start 2020-06-12T17:48:45.368 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.362+0000 7fd0c107c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0bc146680 0x7fd0bc0ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:45.368 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.362+0000 7fd0c107c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd0bc09d8d0 0x7fd0bc1421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:45.369 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.362+0000 7fd0c107c700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0bc146d20 con 0x7fd0bc0b2eb0 2020-06-12T17:48:45.369 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.362+0000 7fd0c107c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0bc066a80 con 0x7fd0bc09d8d0 2020-06-12T17:48:45.369 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.362+0000 7fd0c107c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc146f50 con 0x7fd0bc146680 2020-06-12T17:48:45.369 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.362+0000 7fd0ba59c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd0bc0b2eb0 0x7fd0bc09d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38360/0 (socket says 172.21.15.38:38360) 2020-06-12T17:48:45.370 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.362+0000 7fd0ba59c700 1 -- 172.21.15.38:0/3057491054 learned_addr learned my addr 172.21.15.38:0/3057491054 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:45.370 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.362+0000 7fd0bad9d700 1 --2- 172.21.15.38:0/3057491054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0bc146680 0x7fd0bc0ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:45.370 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.362+0000 7fd0bb59e700 1 --2- 172.21.15.38:0/3057491054 >> v2:172.21.15.150:3300/0 conn(0x7fd0bc09d8d0 0x7fd0bc1421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:45.370 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.362+0000 7fd0b9d9b700 1 -- 172.21.15.38:0/3057491054 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129653599 0 0) 0x7fd0bc146d20 con 0x7fd0bc0b2eb0 2020-06-12T17:48:45.370 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.362+0000 7fd0b9d9b700 1 -- 172.21.15.38:0/3057491054 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0a0003230 con 0x7fd0bc0b2eb0 2020-06-12T17:48:45.370 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0b9d9b700 1 -- 172.21.15.38:0/3057491054 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2174914133 0 0) 0x7fd0a0003230 con 0x7fd0bc0b2eb0 2020-06-12T17:48:45.371 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0b9d9b700 1 -- 172.21.15.38:0/3057491054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0bc146680 msgr2=0x7fd0bc0ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:45.371 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0b9d9b700 1 --2- 172.21.15.38:0/3057491054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0bc146680 0x7fd0bc0ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:45.371 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0b9d9b700 1 -- 172.21.15.38:0/3057491054 >> v2:172.21.15.150:3300/0 conn(0x7fd0bc09d8d0 msgr2=0x7fd0bc1421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:45.371 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0b9d9b700 1 --2- 172.21.15.38:0/3057491054 >> v2:172.21.15.150:3300/0 conn(0x7fd0bc09d8d0 0x7fd0bc1421d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:45.371 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0b9d9b700 1 -- 172.21.15.38:0/3057491054 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0bc146a60 con 0x7fd0bc0b2eb0 2020-06-12T17:48:45.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0b9d9b700 1 -- 172.21.15.38:0/3057491054 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fd0ac0016d0 con 0x7fd0bc0b2eb0 2020-06-12T17:48:45.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0b9d9b700 1 -- 172.21.15.38:0/3057491054 >> v1:172.21.15.38:6789/0 conn(0x7fd0bc0b2eb0 legacy=0x7fd0bc09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:45.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0b9d9b700 1 --2- 172.21.15.38:0/3057491054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0bc146680 0x7fd0a0003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:45.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0b9d9b700 1 --2- 172.21.15.38:0/3057491054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0a0003b80 0x7fd0a0003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:45.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0b9d9b700 1 --2- 172.21.15.38:0/3057491054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0a00045c0 0x7fd0a0004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:45.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0b9d9b700 1 -- 172.21.15.38:0/3057491054 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc066a80 con 0x7fd0a00045c0 2020-06-12T17:48:45.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0b9d9b700 1 -- 172.21.15.38:0/3057491054 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc146f50 con 0x7fd0a0003b80 2020-06-12T17:48:45.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0b9d9b700 1 -- 172.21.15.38:0/3057491054 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a0005050 con 0x7fd0bc146680 2020-06-12T17:48:45.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0bb59e700 1 --2- 172.21.15.38:0/3057491054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0a00045c0 0x7fd0a0004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:45.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0bad9d700 1 --2- 172.21.15.38:0/3057491054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0bc146680 0x7fd0a0003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:45.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0ba59c700 1 --2- 172.21.15.38:0/3057491054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0a0003b80 0x7fd0a0003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:45.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0bb59e700 1 -- 172.21.15.38:0/3057491054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0bc146680 msgr2=0x7fd0a0003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:45.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0bb59e700 1 --2- 172.21.15.38:0/3057491054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0bc146680 0x7fd0a0003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:45.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0bb59e700 1 -- 172.21.15.38:0/3057491054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0a0003b80 msgr2=0x7fd0a0003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:45.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0bb59e700 1 --2- 172.21.15.38:0/3057491054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0a0003b80 0x7fd0a0003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:45.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0bb59e700 1 -- 172.21.15.38:0/3057491054 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a0003230 con 0x7fd0a00045c0 2020-06-12T17:48:45.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0bb59e700 1 --2- 172.21.15.38:0/3057491054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0a00045c0 0x7fd0a0004a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd0b40032b0 tx=0x7fd0b40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0bb59e700 1 --2- 172.21.15.38:0/3057491054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0a00045c0 0x7fd0a0004a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd0b40032b0 tx=0x7fd0b40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0bb59e700 1 --2- 172.21.15.38:0/3057491054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0a00045c0 0x7fd0a0004a20 secure :-1 s=READY pgs=271 cs=0 l=1 rx=0x7fd0b40032b0 tx=0x7fd0b40081e0).ready entity=mon.0 client_cookie=c7b2d565bce7fd2b server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:45.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0bb59e700 1 --2- 172.21.15.38:0/3057491054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0a00045c0 0x7fd0a0004a20 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7fd0b40032b0 tx=0x7fd0b40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.376 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0b9d9b700 1 -- 172.21.15.38:0/3057491054 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0b40110c0 con 0x7fd0a00045c0 2020-06-12T17:48:45.376 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0bb59e700 1 --2- 172.21.15.38:0/3057491054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0a00045c0 0x7fd0a0004a20 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7fd0b40032b0 tx=0x7fd0b40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.376 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0bb59e700 1 --2- 172.21.15.38:0/3057491054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0a00045c0 0x7fd0a0004a20 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7fd0b40032b0 tx=0x7fd0b40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.376 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0b9d9b700 1 -- 172.21.15.38:0/3057491054 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b4011220 con 0x7fd0a00045c0 2020-06-12T17:48:45.376 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0b9d9b700 1 -- 172.21.15.38:0/3057491054 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0b4011600 con 0x7fd0a00045c0 2020-06-12T17:48:45.376 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0c107c700 1 -- 172.21.15.38:0/3057491054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0a00045c0 msgr2=0x7fd0a0004a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:45.377 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.363+0000 7fd0c107c700 1 --2- 172.21.15.38:0/3057491054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0a00045c0 0x7fd0a0004a20 secure :-1 s=READY pgs=271 cs=0 l=1 rx=0x7fd0b40032b0 tx=0x7fd0b40081e0).stop 2020-06-12T17:48:45.377 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.364+0000 7fd0bb59e700 1 -- 172.21.15.38:0/3057491054 reap_dead start 2020-06-12T17:48:45.377 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.364+0000 7fd0c107c700 1 -- 172.21.15.38:0/3057491054 shutdown_connections 2020-06-12T17:48:45.377 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.364+0000 7fd0c107c700 1 -- 172.21.15.38:0/3057491054 >> 172.21.15.38:0/3057491054 conn(0x7fd0bc0b5a20 msgr2=0x7fd0bc05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:45.377 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.364+0000 7fd0c107c700 1 -- 172.21.15.38:0/3057491054 shutdown_connections 2020-06-12T17:48:45.378 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.364+0000 7fd0c107c700 1 -- 172.21.15.38:0/3057491054 wait complete. 2020-06-12T17:48:45.378 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.365+0000 7fd0c107c700 1 Processor -- start 2020-06-12T17:48:45.378 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.365+0000 7fd0c107c700 1 -- start start 2020-06-12T17:48:45.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.366+0000 7fd0c107c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd0bc065ec0 0x7fd0bc1573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:45.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.366+0000 7fd0c107c700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0bc0af6a0 con 0x7fd0bc065ae0 2020-06-12T17:48:45.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.366+0000 7fd0c107c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0bc0af910 con 0x7fd0bc153760 2020-06-12T17:48:45.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.366+0000 7fd0c107c700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0bc154320 con 0x7fd0bc065ec0 2020-06-12T17:48:45.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.366+0000 7fd0ba59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd0bc065ec0 0x7fd0bc1573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:45.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.366+0000 7fd0ba59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd0bc065ec0 0x7fd0bc1573e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36558/0 (socket says 172.21.15.38:36558) 2020-06-12T17:48:45.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.366+0000 7fd0bad9d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd0bc065ae0 0x7fd0bc13df60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38372/0 (socket says 172.21.15.38:38372) 2020-06-12T17:48:45.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.366+0000 7fd0ba59c700 1 -- 172.21.15.38:0/2979906780 learned_addr learned my addr 172.21.15.38:0/2979906780 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:45.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.366+0000 7fd0ba59c700 1 -- 172.21.15.38:0/2979906780 >> v1:172.21.15.150:6789/0 conn(0x7fd0bc153760 legacy=0x7fd0bc153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:45.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.366+0000 7fd0ba59c700 1 -- 172.21.15.38:0/2979906780 >> v1:172.21.15.38:6789/0 conn(0x7fd0bc065ae0 legacy=0x7fd0bc13df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:45.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.366+0000 7fd0abfff700 1 -- 172.21.15.38:0/2979906780 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639722018 0 0) 0x7fd0bc0af6a0 con 0x7fd0bc065ae0 2020-06-12T17:48:45.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.366+0000 7fd0ba59c700 1 -- 172.21.15.38:0/2979906780 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0bc0b25d0 con 0x7fd0bc065ec0 2020-06-12T17:48:45.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.366+0000 7fd0ba59c700 1 --2- 172.21.15.38:0/2979906780 >> v2:172.21.15.38:3300/0 conn(0x7fd0bc065ec0 0x7fd0bc1573e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd0bc066320 tx=0x7fd0bc146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.366+0000 7fd0ba59c700 1 --2- 172.21.15.38:0/2979906780 >> v2:172.21.15.38:3300/0 conn(0x7fd0bc065ec0 0x7fd0bc1573e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd0bc066320 tx=0x7fd0bc146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.366+0000 7fd0ba59c700 1 --2- 172.21.15.38:0/2979906780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0bc065ec0 0x7fd0bc1573e0 secure :-1 s=READY pgs=273 cs=0 l=1 rx=0x7fd0bc066320 tx=0x7fd0bc146220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:45.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.366+0000 7fd0ba59c700 1 --2- 172.21.15.38:0/2979906780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0bc065ec0 0x7fd0bc1573e0 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7fd0bc066320 tx=0x7fd0bc146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.366+0000 7fd0ba59c700 1 --2- 172.21.15.38:0/2979906780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0bc065ec0 0x7fd0bc1573e0 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7fd0bc066320 tx=0x7fd0bc146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.366+0000 7fd0abfff700 1 -- 172.21.15.38:0/2979906780 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0ac00cc70 con 0x7fd0bc065ec0 2020-06-12T17:48:45.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.366+0000 7fd0ba59c700 1 --2- 172.21.15.38:0/2979906780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0bc065ec0 0x7fd0bc1573e0 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7fd0bc066320 tx=0x7fd0bc146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.366+0000 7fd0abfff700 1 -- 172.21.15.38:0/2979906780 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ac00cdd0 con 0x7fd0bc065ec0 2020-06-12T17:48:45.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.366+0000 7fd0c107c700 1 -- 172.21.15.38:0/2979906780 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0bc157840 con 0x7fd0bc065ec0 2020-06-12T17:48:45.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.366+0000 7fd0abfff700 1 -- 172.21.15.38:0/2979906780 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0ac00e340 con 0x7fd0bc065ec0 2020-06-12T17:48:45.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.366+0000 7fd0c107c700 1 -- 172.21.15.38:0/2979906780 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0bc0af2f0 con 0x7fd0bc065ec0 2020-06-12T17:48:45.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.367+0000 7fd0ba59c700 1 --2- 172.21.15.38:0/2979906780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0bc065ec0 0x7fd0bc1573e0 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7fd0bc066320 tx=0x7fd0bc146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.367+0000 7fd0c107c700 1 -- 172.21.15.38:0/2979906780 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0bc0b2170 con 0x7fd0bc065ec0 2020-06-12T17:48:45.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.367+0000 7fd0abfff700 1 -- 172.21.15.38:0/2979906780 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fd0ac00e5b0 con 0x7fd0bc065ec0 2020-06-12T17:48:45.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.367+0000 7fd0ba59c700 1 --2- 172.21.15.38:0/2979906780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0bc065ec0 0x7fd0bc1573e0 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7fd0bc066320 tx=0x7fd0bc146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.368+0000 7fd0abfff700 1 --2- 172.21.15.38:0/2979906780 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd09804d4c0 0x7fd09804f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:45.387 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.368+0000 7fd0abfff700 1 -- 172.21.15.38:0/2979906780 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd0ac0611f0 con 0x7fd0bc065ec0 2020-06-12T17:48:45.387 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.368+0000 7fd0bad9d700 1 --2- 172.21.15.38:0/2979906780 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd09804d4c0 0x7fd09804f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:45.387 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.368+0000 7fd0bad9d700 1 --2- 172.21.15.38:0/2979906780 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd09804d4c0 0x7fd09804f980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd0b0007ed0 tx=0x7fd0b0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.387 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.368+0000 7fd0bad9d700 1 --2- 172.21.15.38:0/2979906780 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd09804d4c0 0x7fd09804f980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd0b0007ed0 tx=0x7fd0b0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.387 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.368+0000 7fd0bad9d700 1 --2- 172.21.15.38:0/2979906780 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd09804d4c0 0x7fd09804f980 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7fd0b0007ed0 tx=0x7fd0b0007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:45.388 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.371+0000 7fd0ba59c700 1 --2- 172.21.15.38:0/2979906780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0bc065ec0 0x7fd0bc1573e0 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7fd0bc066320 tx=0x7fd0bc146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.388 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.371+0000 7fd0abfff700 1 -- 172.21.15.38:0/2979906780 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fd0ac03c9b0 con 0x7fd0bc065ec0 2020-06-12T17:48:45.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.522+0000 7fd0c107c700 1 -- 172.21.15.38:0/2979906780 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd0bc056c30 con 0x7fd0bc065ec0 2020-06-12T17:48:45.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.523+0000 7fd0ba59c700 1 --2- 172.21.15.38:0/2979906780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0bc065ec0 0x7fd0bc1573e0 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7fd0bc066320 tx=0x7fd0bc146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.523+0000 7fd0abfff700 1 -- 172.21.15.38:0/2979906780 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd0ac0070e0 con 0x7fd0bc065ec0 2020-06-12T17:48:45.527 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:45.528 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.524+0000 7fd0c107c700 1 -- 172.21.15.38:0/2979906780 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd09804d4c0 msgr2=0x7fd09804f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:45.528 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.524+0000 7fd0c107c700 1 --2- 172.21.15.38:0/2979906780 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd09804d4c0 0x7fd09804f980 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7fd0b0007ed0 tx=0x7fd0b0007e60).stop 2020-06-12T17:48:45.528 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.524+0000 7fd0c107c700 1 -- 172.21.15.38:0/2979906780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0bc065ec0 msgr2=0x7fd0bc1573e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:45.529 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.524+0000 7fd0c107c700 1 --2- 172.21.15.38:0/2979906780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0bc065ec0 0x7fd0bc1573e0 secure :-1 s=READY pgs=273 cs=0 l=1 rx=0x7fd0bc066320 tx=0x7fd0bc146220).stop 2020-06-12T17:48:45.529 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.524+0000 7fd0c107c700 1 -- 172.21.15.38:0/2979906780 shutdown_connections 2020-06-12T17:48:45.529 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.524+0000 7fd0c107c700 1 --2- 172.21.15.38:0/2979906780 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd09804d4c0 0x7fd09804f980 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:45.529 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.524+0000 7fd0c107c700 1 --2- 172.21.15.38:0/2979906780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0bc065ec0 0x7fd0bc1573e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:45.529 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.524+0000 7fd0c107c700 1 -- 172.21.15.38:0/2979906780 >> 172.21.15.38:0/2979906780 conn(0x7fd0bc0b5a20 msgr2=0x7fd0bc05b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:45.530 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.524+0000 7fd0c107c700 1 -- 172.21.15.38:0/2979906780 shutdown_connections 2020-06-12T17:48:45.530 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.524+0000 7fd0c107c700 1 -- 172.21.15.38:0/2979906780 wait complete. 2020-06-12T17:48:45.538 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-06-12T17:48:45.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.652+0000 7ffb82b05700 1 Processor -- start 2020-06-12T17:48:45.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.652+0000 7ffb82b05700 1 -- start start 2020-06-12T17:48:45.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.652+0000 7ffb82b05700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffb7c146680 0x7ffb7c0ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:45.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.652+0000 7ffb82b05700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb7c0b2eb0 0x7ffb7c09d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:45.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.652+0000 7ffb82b05700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ffb7c09d620 0x7ffb7c09da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:45.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.653+0000 7ffb82b05700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb7c146d20 con 0x7ffb7c146680 2020-06-12T17:48:45.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.653+0000 7ffb82b05700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb7c066a80 con 0x7ffb7c09d620 2020-06-12T17:48:45.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.653+0000 7ffb82b05700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c146f50 con 0x7ffb7c0b2eb0 2020-06-12T17:48:45.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.653+0000 7ffb808a1700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffb7c146680 0x7ffb7c0ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:45.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.653+0000 7ffb808a1700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffb7c146680 0x7ffb7c0ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36564/0 (socket says 172.21.15.38:36564) 2020-06-12T17:48:45.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.653+0000 7ffb808a1700 1 -- 172.21.15.38:0/1205830747 learned_addr learned my addr 172.21.15.38:0/1205830747 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:45.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.653+0000 7ffb810a2700 1 --2- 172.21.15.38:0/1205830747 >> v2:172.21.15.150:3300/0 conn(0x7ffb7c09d620 0x7ffb7c09da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:45.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.653+0000 7ffb7bfff700 1 --2- 172.21.15.38:0/1205830747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb7c0b2eb0 0x7ffb7c09d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:45.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.653+0000 7ffb808a1700 1 -- 172.21.15.38:0/1205830747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb7c0b2eb0 msgr2=0x7ffb7c09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:45.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.653+0000 7ffb808a1700 1 --2- 172.21.15.38:0/1205830747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb7c0b2eb0 0x7ffb7c09d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:45.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.653+0000 7ffb808a1700 1 -- 172.21.15.38:0/1205830747 >> v2:172.21.15.150:3300/0 conn(0x7ffb7c09d620 msgr2=0x7ffb7c09da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:45.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.653+0000 7ffb808a1700 1 --2- 172.21.15.38:0/1205830747 >> v2:172.21.15.150:3300/0 conn(0x7ffb7c09d620 0x7ffb7c09da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:45.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.653+0000 7ffb808a1700 1 -- 172.21.15.38:0/1205830747 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c146a60 con 0x7ffb7c146680 2020-06-12T17:48:45.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.653+0000 7ffb810a2700 1 --2- 172.21.15.38:0/1205830747 >> v2:172.21.15.150:3300/0 conn(0x7ffb7c09d620 0x7ffb7c09da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:45.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.653+0000 7ffb7bfff700 1 --2- 172.21.15.38:0/1205830747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb7c0b2eb0 0x7ffb7c09d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:45.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.653+0000 7ffb808a1700 1 --2- 172.21.15.38:0/1205830747 >> v2:172.21.15.38:3300/0 conn(0x7ffb7c146680 0x7ffb7c0ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffb6c002f30 tx=0x7ffb6c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.653+0000 7ffb808a1700 1 --2- 172.21.15.38:0/1205830747 >> v2:172.21.15.38:3300/0 conn(0x7ffb7c146680 0x7ffb7c0ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffb6c002f30 tx=0x7ffb6c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.653+0000 7ffb808a1700 1 --2- 172.21.15.38:0/1205830747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb7c146680 0x7ffb7c0ad5b0 secure :-1 s=READY pgs=274 cs=0 l=1 rx=0x7ffb6c002f30 tx=0x7ffb6c007e60).ready entity=mon.0 client_cookie=889f20e86bd8d464 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:45.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.653+0000 7ffb808a1700 1 --2- 172.21.15.38:0/1205830747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb7c146680 0x7ffb7c0ad5b0 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7ffb6c002f30 tx=0x7ffb6c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.653+0000 7ffb7b7fe700 1 -- 172.21.15.38:0/1205830747 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb6c0116e0 con 0x7ffb7c146680 2020-06-12T17:48:45.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.653+0000 7ffb808a1700 1 --2- 172.21.15.38:0/1205830747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb7c146680 0x7ffb7c0ad5b0 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7ffb6c002f30 tx=0x7ffb6c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.653+0000 7ffb808a1700 1 --2- 172.21.15.38:0/1205830747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb7c146680 0x7ffb7c0ad5b0 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7ffb6c002f30 tx=0x7ffb6c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.653+0000 7ffb7b7fe700 1 -- 172.21.15.38:0/1205830747 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6c011840 con 0x7ffb7c146680 2020-06-12T17:48:45.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.653+0000 7ffb7b7fe700 1 -- 172.21.15.38:0/1205830747 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb6c011be0 con 0x7ffb7c146680 2020-06-12T17:48:45.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.653+0000 7ffb82b05700 1 -- 172.21.15.38:0/1205830747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb7c146680 msgr2=0x7ffb7c0ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:45.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.653+0000 7ffb82b05700 1 --2- 172.21.15.38:0/1205830747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb7c146680 0x7ffb7c0ad5b0 secure :-1 s=READY pgs=274 cs=0 l=1 rx=0x7ffb6c002f30 tx=0x7ffb6c007e60).stop 2020-06-12T17:48:45.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.654+0000 7ffb82b05700 1 -- 172.21.15.38:0/1205830747 shutdown_connections 2020-06-12T17:48:45.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.654+0000 7ffb82b05700 1 --2- 172.21.15.38:0/1205830747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb7c146680 0x7ffb7c0ad5b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:45.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.654+0000 7ffb82b05700 1 --2- 172.21.15.38:0/1205830747 >> v2:172.21.15.150:3300/0 conn(0x7ffb7c09d620 0x7ffb7c09da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:45.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.654+0000 7ffb82b05700 1 --2- 172.21.15.38:0/1205830747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb7c0b2eb0 0x7ffb7c09d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:45.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.654+0000 7ffb82b05700 1 -- 172.21.15.38:0/1205830747 >> 172.21.15.38:0/1205830747 conn(0x7ffb7c0b5a20 msgr2=0x7ffb7c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:45.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.654+0000 7ffb82b05700 1 -- 172.21.15.38:0/1205830747 shutdown_connections 2020-06-12T17:48:45.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.654+0000 7ffb82b05700 1 -- 172.21.15.38:0/1205830747 wait complete. 2020-06-12T17:48:45.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.655+0000 7ffb82b05700 1 Processor -- start 2020-06-12T17:48:45.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.655+0000 7ffb82b05700 1 -- start start 2020-06-12T17:48:45.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.656+0000 7ffb82b05700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb7c09d620 0x7ffb7c061890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:45.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.656+0000 7ffb82b05700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ffb7c146680 0x7ffb7c137c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:45.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.656+0000 7ffb82b05700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb7c0b1470 con 0x7ffb7c0b2eb0 2020-06-12T17:48:45.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.656+0000 7ffb82b05700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb7c0b0360 con 0x7ffb7c146680 2020-06-12T17:48:45.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.656+0000 7ffb82b05700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0625e0 con 0x7ffb7c09d620 2020-06-12T17:48:45.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.656+0000 7ffb810a2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ffb7c146680 0x7ffb7c137c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:45.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.656+0000 7ffb810a2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ffb7c146680 0x7ffb7c137c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:46050/0 (socket says 172.21.15.38:46050) 2020-06-12T17:48:45.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.656+0000 7ffb810a2700 1 -- 172.21.15.38:0/738749996 learned_addr learned my addr 172.21.15.38:0/738749996 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:45.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.656+0000 7ffb808a1700 1 --2- 172.21.15.38:0/738749996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb7c09d620 0x7ffb7c061890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:45.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.656+0000 7ffb808a1700 1 -- 172.21.15.38:0/738749996 >> v2:172.21.15.150:3300/0 conn(0x7ffb7c146680 msgr2=0x7ffb7c137c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:45.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.656+0000 7ffb808a1700 1 --2- 172.21.15.38:0/738749996 >> v2:172.21.15.150:3300/0 conn(0x7ffb7c146680 0x7ffb7c137c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:45.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.656+0000 7ffb808a1700 1 -- 172.21.15.38:0/738749996 >> v1:172.21.15.150:6789/0 conn(0x7ffb7c0b2eb0 legacy=0x7ffb7c137510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:45.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.656+0000 7ffb808a1700 1 -- 172.21.15.38:0/738749996 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c0b10f0 con 0x7ffb7c09d620 2020-06-12T17:48:45.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.656+0000 7ffb810a2700 1 --2- 172.21.15.38:0/738749996 >> v2:172.21.15.150:3300/0 conn(0x7ffb7c146680 0x7ffb7c137c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:45.673 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.656+0000 7ffb808a1700 1 --2- 172.21.15.38:0/738749996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb7c09d620 0x7ffb7c061890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffb6c002f30 tx=0x7ffb6c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.673 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.657+0000 7ffb808a1700 1 --2- 172.21.15.38:0/738749996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb7c09d620 0x7ffb7c061890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffb6c002f30 tx=0x7ffb6c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.673 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.657+0000 7ffb808a1700 1 --2- 172.21.15.38:0/738749996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb7c09d620 0x7ffb7c061890 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7ffb6c002f30 tx=0x7ffb6c007e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:45.673 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.657+0000 7ffb808a1700 1 --2- 172.21.15.38:0/738749996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb7c09d620 0x7ffb7c061890 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7ffb6c002f30 tx=0x7ffb6c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.673 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.657+0000 7ffb79ffb700 1 -- 172.21.15.38:0/738749996 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb6c007150 con 0x7ffb7c09d620 2020-06-12T17:48:45.674 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.657+0000 7ffb808a1700 1 --2- 172.21.15.38:0/738749996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb7c09d620 0x7ffb7c061890 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7ffb6c002f30 tx=0x7ffb6c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.674 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.657+0000 7ffb808a1700 1 --2- 172.21.15.38:0/738749996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb7c09d620 0x7ffb7c061890 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7ffb6c002f30 tx=0x7ffb6c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.674 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.657+0000 7ffb79ffb700 1 -- 172.21.15.38:0/738749996 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6c0072b0 con 0x7ffb7c09d620 2020-06-12T17:48:45.674 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.657+0000 7ffb79ffb700 1 -- 172.21.15.38:0/738749996 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb6c0056c0 con 0x7ffb7c09d620 2020-06-12T17:48:45.674 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.657+0000 7ffb82b05700 1 -- 172.21.15.38:0/738749996 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7c0b0800 con 0x7ffb7c09d620 2020-06-12T17:48:45.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.657+0000 7ffb82b05700 1 -- 172.21.15.38:0/738749996 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb7c0af070 con 0x7ffb7c09d620 2020-06-12T17:48:45.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.658+0000 7ffb808a1700 1 --2- 172.21.15.38:0/738749996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb7c09d620 0x7ffb7c061890 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7ffb6c002f30 tx=0x7ffb6c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.658+0000 7ffb82b05700 1 -- 172.21.15.38:0/738749996 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb7c056c30 con 0x7ffb7c09d620 2020-06-12T17:48:45.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.658+0000 7ffb79ffb700 1 -- 172.21.15.38:0/738749996 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7ffb6c005930 con 0x7ffb7c09d620 2020-06-12T17:48:45.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.658+0000 7ffb808a1700 1 --2- 172.21.15.38:0/738749996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb7c09d620 0x7ffb7c061890 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7ffb6c002f30 tx=0x7ffb6c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.658+0000 7ffb79ffb700 1 --2- 172.21.15.38:0/738749996 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ffb5c04d640 0x7ffb5c04fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:45.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.658+0000 7ffb79ffb700 1 -- 172.21.15.38:0/738749996 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ffb6c0613d0 con 0x7ffb7c09d620 2020-06-12T17:48:45.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.658+0000 7ffb7bfff700 1 --2- 172.21.15.38:0/738749996 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ffb5c04d640 0x7ffb5c04fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:45.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.659+0000 7ffb7bfff700 1 --2- 172.21.15.38:0/738749996 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ffb5c04d640 0x7ffb5c04fb00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffb7c13d1a0 tx=0x7ffb70007ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.659+0000 7ffb7bfff700 1 --2- 172.21.15.38:0/738749996 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ffb5c04d640 0x7ffb5c04fb00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffb7c13d1a0 tx=0x7ffb70007ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.659+0000 7ffb7bfff700 1 --2- 172.21.15.38:0/738749996 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ffb5c04d640 0x7ffb5c04fb00 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7ffb7c13d1a0 tx=0x7ffb70007ad0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:45.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.662+0000 7ffb808a1700 1 --2- 172.21.15.38:0/738749996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb7c09d620 0x7ffb7c061890 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7ffb6c002f30 tx=0x7ffb6c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.662+0000 7ffb79ffb700 1 -- 172.21.15.38:0/738749996 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7ffb6c03cbf0 con 0x7ffb7c09d620 2020-06-12T17:48:45.817 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.814+0000 7ffb82b05700 1 -- 172.21.15.38:0/738749996 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffb7c09bf90 con 0x7ffb7c09d620 2020-06-12T17:48:45.818 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.814+0000 7ffb808a1700 1 --2- 172.21.15.38:0/738749996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb7c09d620 0x7ffb7c061890 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7ffb6c002f30 tx=0x7ffb6c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.818 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.814+0000 7ffb79ffb700 1 -- 172.21.15.38:0/738749996 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7ffb6c040210 con 0x7ffb7c09d620 2020-06-12T17:48:45.819 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:45.820 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.816+0000 7ffb82b05700 1 -- 172.21.15.38:0/738749996 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ffb5c04d640 msgr2=0x7ffb5c04fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:45.820 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.816+0000 7ffb82b05700 1 --2- 172.21.15.38:0/738749996 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ffb5c04d640 0x7ffb5c04fb00 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7ffb7c13d1a0 tx=0x7ffb70007ad0).stop 2020-06-12T17:48:45.820 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.816+0000 7ffb82b05700 1 -- 172.21.15.38:0/738749996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb7c09d620 msgr2=0x7ffb7c061890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:45.820 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.816+0000 7ffb82b05700 1 --2- 172.21.15.38:0/738749996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb7c09d620 0x7ffb7c061890 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7ffb6c002f30 tx=0x7ffb6c007e60).stop 2020-06-12T17:48:45.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.816+0000 7ffb82b05700 1 -- 172.21.15.38:0/738749996 shutdown_connections 2020-06-12T17:48:45.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.816+0000 7ffb82b05700 1 --2- 172.21.15.38:0/738749996 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ffb5c04d640 0x7ffb5c04fb00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:45.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.816+0000 7ffb82b05700 1 --2- 172.21.15.38:0/738749996 >> v2:172.21.15.150:3300/0 conn(0x7ffb7c146680 0x7ffb7c137c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:45.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.816+0000 7ffb82b05700 1 --2- 172.21.15.38:0/738749996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb7c09d620 0x7ffb7c061890 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:45.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.816+0000 7ffb82b05700 1 -- 172.21.15.38:0/738749996 >> 172.21.15.38:0/738749996 conn(0x7ffb7c0b5a20 msgr2=0x7ffb7c09c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:45.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.816+0000 7ffb82b05700 1 -- 172.21.15.38:0/738749996 shutdown_connections 2020-06-12T17:48:45.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.816+0000 7ffb82b05700 1 -- 172.21.15.38:0/738749996 wait complete. 2020-06-12T17:48:45.830 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-12T17:48:45.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.940+0000 7ff77762e700 1 Processor -- start 2020-06-12T17:48:45.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.940+0000 7ff77762e700 1 -- start start 2020-06-12T17:48:45.946 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.941+0000 7ff77762e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff770140490 0x7ff7700b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:45.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.941+0000 7ff77762e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff770146210 0x7ff77005b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:45.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.941+0000 7ff77762e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff770146690 0x7ff77005b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:45.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.941+0000 7ff77762e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7700af010 con 0x7ff770146690 2020-06-12T17:48:45.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.941+0000 7ff77762e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7700af2b0 con 0x7ff770140490 2020-06-12T17:48:45.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.941+0000 7ff77762e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7701497e0 con 0x7ff770146210 2020-06-12T17:48:45.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.941+0000 7ff775bcb700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff770146690 0x7ff77005b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:45.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.941+0000 7ff775bcb700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff770146690 0x7ff77005b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36582/0 (socket says 172.21.15.38:36582) 2020-06-12T17:48:45.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.941+0000 7ff775bcb700 1 -- 172.21.15.38:0/3183511468 learned_addr learned my addr 172.21.15.38:0/3183511468 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:45.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.941+0000 7ff774bc9700 1 --2- 172.21.15.38:0/3183511468 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff770146210 0x7ff77005b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:45.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.941+0000 7ff7753ca700 1 --2- 172.21.15.38:0/3183511468 >> v2:172.21.15.150:3300/0 conn(0x7ff770140490 0x7ff7700b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:45.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.941+0000 7ff775bcb700 1 -- 172.21.15.38:0/3183511468 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff770146210 msgr2=0x7ff77005b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:45.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.941+0000 7ff775bcb700 1 --2- 172.21.15.38:0/3183511468 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff770146210 0x7ff77005b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:45.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.941+0000 7ff775bcb700 1 -- 172.21.15.38:0/3183511468 >> v2:172.21.15.150:3300/0 conn(0x7ff770140490 msgr2=0x7ff7700b8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:45.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.941+0000 7ff775bcb700 1 --2- 172.21.15.38:0/3183511468 >> v2:172.21.15.150:3300/0 conn(0x7ff770140490 0x7ff7700b8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:45.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.941+0000 7ff775bcb700 1 -- 172.21.15.38:0/3183511468 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7700aed10 con 0x7ff770146690 2020-06-12T17:48:45.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.941+0000 7ff7753ca700 1 --2- 172.21.15.38:0/3183511468 >> v2:172.21.15.150:3300/0 conn(0x7ff770140490 0x7ff7700b8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:48:45.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.941+0000 7ff775bcb700 1 --2- 172.21.15.38:0/3183511468 >> v2:172.21.15.38:3300/0 conn(0x7ff770146690 0x7ff77005b880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff7680032b0 tx=0x7ff7680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.941+0000 7ff775bcb700 1 --2- 172.21.15.38:0/3183511468 >> v2:172.21.15.38:3300/0 conn(0x7ff770146690 0x7ff77005b880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff7680032b0 tx=0x7ff7680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.941+0000 7ff775bcb700 1 --2- 172.21.15.38:0/3183511468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146690 0x7ff77005b880 secure :-1 s=READY pgs=275 cs=0 l=1 rx=0x7ff7680032b0 tx=0x7ff7680081e0).ready entity=mon.0 client_cookie=e4632e33c55371ca server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:45.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.942+0000 7ff775bcb700 1 --2- 172.21.15.38:0/3183511468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146690 0x7ff77005b880 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7ff7680032b0 tx=0x7ff7680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.942+0000 7ff75ffff700 1 -- 172.21.15.38:0/3183511468 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff76800a160 con 0x7ff770146690 2020-06-12T17:48:45.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.942+0000 7ff775bcb700 1 --2- 172.21.15.38:0/3183511468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146690 0x7ff77005b880 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7ff7680032b0 tx=0x7ff7680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.942+0000 7ff775bcb700 1 --2- 172.21.15.38:0/3183511468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146690 0x7ff77005b880 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7ff7680032b0 tx=0x7ff7680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.942+0000 7ff75ffff700 1 -- 172.21.15.38:0/3183511468 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76800a2c0 con 0x7ff770146690 2020-06-12T17:48:45.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.942+0000 7ff75ffff700 1 -- 172.21.15.38:0/3183511468 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff76800a660 con 0x7ff770146690 2020-06-12T17:48:45.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.942+0000 7ff77762e700 1 -- 172.21.15.38:0/3183511468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146690 msgr2=0x7ff77005b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:45.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.942+0000 7ff77762e700 1 --2- 172.21.15.38:0/3183511468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146690 0x7ff77005b880 secure :-1 s=READY pgs=275 cs=0 l=1 rx=0x7ff7680032b0 tx=0x7ff7680081e0).stop 2020-06-12T17:48:45.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.942+0000 7ff77762e700 1 -- 172.21.15.38:0/3183511468 shutdown_connections 2020-06-12T17:48:45.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.942+0000 7ff77762e700 1 --2- 172.21.15.38:0/3183511468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146690 0x7ff77005b880 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:45.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.942+0000 7ff77762e700 1 --2- 172.21.15.38:0/3183511468 >> v2:172.21.15.150:3300/0 conn(0x7ff770140490 0x7ff7700b8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:45.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.942+0000 7ff77762e700 1 --2- 172.21.15.38:0/3183511468 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff770146210 0x7ff77005b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:45.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.942+0000 7ff77762e700 1 -- 172.21.15.38:0/3183511468 >> 172.21.15.38:0/3183511468 conn(0x7ff7700b94e0 msgr2=0x7ff7700b98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:45.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.942+0000 7ff77762e700 1 -- 172.21.15.38:0/3183511468 shutdown_connections 2020-06-12T17:48:45.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.942+0000 7ff77762e700 1 -- 172.21.15.38:0/3183511468 wait complete. 2020-06-12T17:48:45.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.943+0000 7ff77762e700 1 Processor -- start 2020-06-12T17:48:45.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.944+0000 7ff77762e700 1 -- start start 2020-06-12T17:48:45.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.944+0000 7ff77762e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff770146210 0x7ff77009d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:45.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.944+0000 7ff77762e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff770146690 0x7ff77009ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:45.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.944+0000 7ff77762e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7701534f0 con 0x7ff770140490 2020-06-12T17:48:45.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.944+0000 7ff77762e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff77009e420 con 0x7ff770146210 2020-06-12T17:48:45.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.944+0000 7ff77762e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77009da40 con 0x7ff770146690 2020-06-12T17:48:45.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.944+0000 7ff7753ca700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff770140490 0x7ff77013e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38400/0 (socket says 172.21.15.38:38400) 2020-06-12T17:48:45.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.944+0000 7ff774bc9700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff770146210 0x7ff77009d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:45.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.944+0000 7ff7753ca700 1 -- 172.21.15.38:0/3174018727 learned_addr learned my addr 172.21.15.38:0/3174018727 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:45.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.945+0000 7ff775bcb700 1 --2- 172.21.15.38:0/3174018727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff770146690 0x7ff77009ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:45.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.945+0000 7ff75e7fc700 1 -- 172.21.15.38:0/3174018727 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228696146 0 0) 0x7ff7701534f0 con 0x7ff770140490 2020-06-12T17:48:45.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.945+0000 7ff774bc9700 1 -- 172.21.15.38:0/3174018727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff770146690 msgr2=0x7ff77009ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:45.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.945+0000 7ff774bc9700 1 --2- 172.21.15.38:0/3174018727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff770146690 0x7ff77009ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:45.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.945+0000 7ff774bc9700 1 -- 172.21.15.38:0/3174018727 >> v1:172.21.15.38:6789/0 conn(0x7ff770140490 legacy=0x7ff77013e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:45.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.945+0000 7ff774bc9700 1 -- 172.21.15.38:0/3174018727 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77009dce0 con 0x7ff770146210 2020-06-12T17:48:45.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.945+0000 7ff775bcb700 1 --2- 172.21.15.38:0/3174018727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff770146690 0x7ff77009ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:48:45.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.945+0000 7ff774bc9700 1 --2- 172.21.15.38:0/3174018727 >> v2:172.21.15.38:3300/0 conn(0x7ff770146210 0x7ff77009d530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff76c002f30 tx=0x7ff76c00e100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.945+0000 7ff774bc9700 1 --2- 172.21.15.38:0/3174018727 >> v2:172.21.15.38:3300/0 conn(0x7ff770146210 0x7ff77009d530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff76c002f30 tx=0x7ff76c00e100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.945+0000 7ff774bc9700 1 --2- 172.21.15.38:0/3174018727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146210 0x7ff77009d530 secure :-1 s=READY pgs=277 cs=0 l=1 rx=0x7ff76c002f30 tx=0x7ff76c00e100).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:45.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.945+0000 7ff774bc9700 1 --2- 172.21.15.38:0/3174018727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146210 0x7ff77009d530 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7ff76c002f30 tx=0x7ff76c00e100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.945+0000 7ff75e7fc700 1 -- 172.21.15.38:0/3174018727 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff76c005e90 con 0x7ff770146210 2020-06-12T17:48:45.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.945+0000 7ff774bc9700 1 --2- 172.21.15.38:0/3174018727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146210 0x7ff77009d530 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7ff76c002f30 tx=0x7ff76c00e100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.945+0000 7ff774bc9700 1 --2- 172.21.15.38:0/3174018727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146210 0x7ff77009d530 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7ff76c002f30 tx=0x7ff76c00e100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.945+0000 7ff75e7fc700 1 -- 172.21.15.38:0/3174018727 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76c007160 con 0x7ff770146210 2020-06-12T17:48:45.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.945+0000 7ff77762e700 1 -- 172.21.15.38:0/3174018727 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff77009df80 con 0x7ff770146210 2020-06-12T17:48:45.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.945+0000 7ff75e7fc700 1 -- 172.21.15.38:0/3174018727 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff76c007500 con 0x7ff770146210 2020-06-12T17:48:45.962 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.945+0000 7ff77762e700 1 -- 172.21.15.38:0/3174018727 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77013eef0 con 0x7ff770146210 2020-06-12T17:48:45.962 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.946+0000 7ff774bc9700 1 --2- 172.21.15.38:0/3174018727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146210 0x7ff77009d530 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7ff76c002f30 tx=0x7ff76c00e100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.962 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.946+0000 7ff75e7fc700 1 -- 172.21.15.38:0/3174018727 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7ff76c00e240 con 0x7ff770146210 2020-06-12T17:48:45.963 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.946+0000 7ff774bc9700 1 --2- 172.21.15.38:0/3174018727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146210 0x7ff77009d530 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7ff76c002f30 tx=0x7ff76c00e100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.963 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.946+0000 7ff77762e700 1 -- 172.21.15.38:0/3174018727 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff77005d2c0 con 0x7ff770146210 2020-06-12T17:48:45.963 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.946+0000 7ff75e7fc700 1 --2- 172.21.15.38:0/3174018727 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff75004d470 0x7ff75004f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:45.963 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.946+0000 7ff75e7fc700 1 -- 172.21.15.38:0/3174018727 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff76c061280 con 0x7ff770146210 2020-06-12T17:48:45.963 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.947+0000 7ff7753ca700 1 --2- 172.21.15.38:0/3174018727 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff75004d470 0x7ff75004f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:45.964 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.947+0000 7ff7753ca700 1 --2- 172.21.15.38:0/3174018727 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff75004d470 0x7ff75004f930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff760003070 tx=0x7ff760002370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.964 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.947+0000 7ff7753ca700 1 --2- 172.21.15.38:0/3174018727 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff75004d470 0x7ff75004f930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff760003070 tx=0x7ff760002370).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.964 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.947+0000 7ff7753ca700 1 --2- 172.21.15.38:0/3174018727 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff75004d470 0x7ff75004f930 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7ff760003070 tx=0x7ff760002370).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:45.964 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.950+0000 7ff774bc9700 1 --2- 172.21.15.38:0/3174018727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146210 0x7ff77009d530 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7ff76c002f30 tx=0x7ff76c00e100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:45.964 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:45.950+0000 7ff75e7fc700 1 -- 172.21.15.38:0/3174018727 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7ff76c03c980 con 0x7ff770146210 2020-06-12T17:48:46.103 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.100+0000 7ff77762e700 1 -- 172.21.15.38:0/3174018727 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff77009e110 con 0x7ff770146210 2020-06-12T17:48:46.104 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.101+0000 7ff774bc9700 1 --2- 172.21.15.38:0/3174018727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146210 0x7ff77009d530 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7ff76c002f30 tx=0x7ff76c00e100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.105 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.101+0000 7ff75e7fc700 1 -- 172.21.15.38:0/3174018727 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16347 (secure 0 0 0) 0x7ff76c00a0d0 con 0x7ff770146210 2020-06-12T17:48:46.106 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:46.106 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":24,"fsid":"8e42a2e7-b187-42c4-a73f-8f812ee62352","created":"2020-06-12T17:47:54.434340+0000","modified":"2020-06-12T17:48:14.851712+0000","last_up_change":"2020-06-12T17:48:03.388718+0000","last_in_change":"2020-06-12T17:48:03.388718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-06-12T17:47:57.558119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-06-12T17:48:07.419264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-06-12T17:48:09.934098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-06-12T17:48:12.497229+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"44ac3dea-67b4-4b9a-bc18-ac511710afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":31038},{"type":"v1","addr":"172.21.15.38:6816","nonce":31038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":31038},{"type":"v1","addr":"172.21.15.38:6819","nonce":31038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":31038},{"type":"v1","addr":"172.21.15.38:6823","nonce":31038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":31038},{"type":"v1","addr":"172.21.15.38:6821","nonce":31038}]},"public_addr":"172.21.15.38:6816/31038","cluster_addr":"172.21.15.38:6819/31038","heartbeat_back_addr":"172.21.15.38:6823/31038","heartbeat_front_addr":"172.21.15.38:6821/31038","state":["exists","up"]},{"osd":1,"uuid":"561f7ced-3fff-4364-8619-6e4ecbc9d256","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":31036},{"type":"v1","addr":"172.21.15.38:6801","nonce":31036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":31036},{"type":"v1","addr":"172.21.15.38:6803","nonce":31036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":31036},{"type":"v1","addr":"172.21.15.38:6807","nonce":31036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":31036},{"type":"v1","addr":"172.21.15.38:6805","nonce":31036}]},"public_addr":"172.21.15.38:6801/31036","cluster_addr":"172.21.15.38:6803/31036","heartbeat_back_addr":"172.21.15.38:6807/31036","heartbeat_front_addr":"172.21.15.38:6805/31036","state":["exists","up"]},{"osd":2,"uuid":"0bb3c806-07af-49f5-b492-d0e33f2de37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":31053},{"type":"v1","addr":"172.21.15.38:6825","nonce":31053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":31053},{"type":"v1","addr":"172.21.15.38:6827","nonce":31053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":31053},{"type":"v1","addr":"172.21.15.38:6831","nonce":31053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":31053},{"type":"v1","addr":"172.21.15.38:6829","nonce":31053}]},"public_addr":"172.21.15.38:6825/31053","cluster_addr":"172.21.15.38:6827/31053","heartbeat_back_addr":"172.21.15.38:6831/31053","heartbeat_front_addr":"172.21.15.38:6829/31053","state":["exists","up"]},{"osd":3,"uuid":"7f6a1e75-7b11-456e-8a4b-510b16226800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":31037},{"type":"v1","addr":"172.21.15.38:6809","nonce":31037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":31037},{"type":"v1","addr":"172.21.15.38:6811","nonce":31037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6815","nonce":31037},{"type":"v1","addr":"172.21.15.38:6817","nonce":31037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":31037},{"type":"v1","addr":"172.21.15.38:6813","nonce":31037}]},"public_addr":"172.21.15.38:6809/31037","cluster_addr":"172.21.15.38:6811/31037","heartbeat_back_addr":"172.21.15.38:6817/31037","heartbeat_front_addr":"172.21.15.38:6813/31037","state":["exists","up"]},{"osd":4,"uuid":"0eca0272-8cfd-469c-a32d-e29730dc0e1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":31294},{"type":"v1","addr":"172.21.15.150:6803","nonce":31294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":31294},{"type":"v1","addr":"172.21.15.150:6805","nonce":31294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":31294},{"type":"v1","addr":"172.21.15.150:6809","nonce":31294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":31294},{"type":"v1","addr":"172.21.15.150:6807","nonce":31294}]},"public_addr":"172.21.15.150:6803/31294","cluster_addr":"172.21.15.150:6805/31294","heartbeat_back_addr":"172.21.15.150:6809/31294","heartbeat_front_addr":"172.21.15.150:6807/31294","state":["exists","up"]},{"osd":5,"uuid":"69d6a7dc-a55a-4ebc-8479-8bb921ddfb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":31295},{"type":"v1","addr":"172.21.15.150:6813","nonce":31295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":31295},{"type":"v1","addr":"172.21.15.150:6816","nonce":31295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":31295},{"type":"v1","addr":"172.21.15.150:6828","nonce":31295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6819","nonce":31295},{"type":"v1","addr":"172.21.15.150:6822","nonce":31295}]},"public_addr":"172.21.15.150:6813/31295","cluster_addr":"172.21.15.150:6816/31295","heartbeat_back_addr":"172.21.15.150:6828/31295","heartbeat_front_addr":"172.21.15.150:6822/31295","state":["exists","up"]},{"osd":6,"uuid":"f0d320f8-c2f0-40bb-b713-526246cf97b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":31297},{"type":"v1","addr":"172.21.15.150:6820","nonce":31297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6823","nonce":31297},{"type":"v1","addr":"172.21.15.150:6827","nonce":31297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":31297},{"type":"v1","addr":"172.21.15.150:6833","nonce":31297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":31297},{"type":"v1","addr":"172.21.15.150:6831","nonce":31297}]},"public_addr":"172.21.15.150:6820/31297","cluster_addr":"172.21.15.150:6827/31297","heartbeat_back_addr":"172.21.15.150:6833/31297","heartbeat_front_addr":"172.21.15.150:6831/31297","state":["exists","up"]},{"osd":7,"uuid":"970b7d02-a189-41b2-96e5-a5a5a57c6476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":31296},{"type":"v1","addr":"172.21.15.150:6812","nonce":31296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":31296},{"type":"v1","addr":"172.21.15.150:6818","nonce":31296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":31296},{"type":"v1","addr":"172.21.15.150:6829","nonce":31296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":31296},{"type":"v1","addr":"172.21.15.150:6824","nonce":31296}]},"public_addr":"172.21.15.150:6812/31296","cluster_addr":"172.21.15.150:6818/31296","heartbeat_back_addr":"172.21.15.150:6829/31296","heartbeat_front_addr":"172.21.15.150:6824/31296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.664300+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.644253+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.651120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.584978+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.561149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.661778+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T17:48:46.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.102+0000 7ff77762e700 1 -- 172.21.15.38:0/3174018727 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff75004d470 msgr2=0x7ff75004f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:46.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.102+0000 7ff77762e700 1 --2- 172.21.15.38:0/3174018727 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff75004d470 0x7ff75004f930 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7ff760003070 tx=0x7ff760002370).stop 2020-06-12T17:48:46.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.102+0000 7ff77762e700 1 -- 172.21.15.38:0/3174018727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146210 msgr2=0x7ff77009d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:46.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.102+0000 7ff77762e700 1 --2- 172.21.15.38:0/3174018727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146210 0x7ff77009d530 secure :-1 s=READY pgs=277 cs=0 l=1 rx=0x7ff76c002f30 tx=0x7ff76c00e100).stop 2020-06-12T17:48:46.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.102+0000 7ff77762e700 1 -- 172.21.15.38:0/3174018727 shutdown_connections 2020-06-12T17:48:46.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.102+0000 7ff77762e700 1 --2- 172.21.15.38:0/3174018727 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff75004d470 0x7ff75004f930 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:46.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.102+0000 7ff77762e700 1 --2- 172.21.15.38:0/3174018727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff770146690 0x7ff77009ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:46.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.102+0000 7ff77762e700 1 --2- 172.21.15.38:0/3174018727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146210 0x7ff77009d530 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:46.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.102+0000 7ff77762e700 1 -- 172.21.15.38:0/3174018727 >> 172.21.15.38:0/3174018727 conn(0x7ff7700b94e0 msgr2=0x7ff7700b54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:46.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.102+0000 7ff77762e700 1 -- 172.21.15.38:0/3174018727 shutdown_connections 2020-06-12T17:48:46.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.102+0000 7ff77762e700 1 -- 172.21.15.38:0/3174018727 wait complete. 2020-06-12T17:48:46.116 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-06-12T17:47:57.558119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-06-12T17:48:07.419264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-06-12T17:48:09.934098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-06-12T17:48:12.497229+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-06-12T17:48:46.117 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-06-12T17:48:46.234 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.230+0000 7f7b4e384700 1 Processor -- start 2020-06-12T17:48:46.234 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.230+0000 7f7b4e384700 1 -- start start 2020-06-12T17:48:46.237 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.231+0000 7f7b4e384700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7b4809df00 0x7f7b4813c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:46.237 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.231+0000 7f7b4e384700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4809b960 con 0x7f7b48142e90 2020-06-12T17:48:46.237 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.231+0000 7f7b4e384700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4809bc00 con 0x7f7b480b3ac0 2020-06-12T17:48:46.238 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.231+0000 7f7b4e384700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b48143270 con 0x7f7b4809df00 2020-06-12T17:48:46.238 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.231+0000 7f7b4c921700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7b48142e90 0x7f7b48066790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38412/0 (socket says 172.21.15.38:38412) 2020-06-12T17:48:46.238 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.231+0000 7f7b4c921700 1 -- 172.21.15.38:0/1742529531 learned_addr learned my addr 172.21.15.38:0/1742529531 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:46.238 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.231+0000 7f7b477fe700 1 --2- 172.21.15.38:0/1742529531 >> v2:172.21.15.150:3300/0 conn(0x7f7b4809df00 0x7f7b4813c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:46.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.232+0000 7f7b46ffd700 1 -- 172.21.15.38:0/1742529531 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349572518 0 0) 0x7f7b4809b960 con 0x7f7b48142e90 2020-06-12T17:48:46.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.232+0000 7f7b46ffd700 1 -- 172.21.15.38:0/1742529531 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b34003230 con 0x7f7b48142e90 2020-06-12T17:48:46.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.232+0000 7f7b46ffd700 1 -- 172.21.15.38:0/1742529531 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312692485 0 0) 0x7f7b4809bc00 con 0x7f7b480b3ac0 2020-06-12T17:48:46.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.232+0000 7f7b46ffd700 1 -- 172.21.15.38:0/1742529531 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b4809b960 con 0x7f7b480b3ac0 2020-06-12T17:48:46.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.232+0000 7f7b477fe700 1 -- 172.21.15.38:0/1742529531 >> v1:172.21.15.150:6789/0 conn(0x7f7b480b3ac0 legacy=0x7f7b4813bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:46.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.232+0000 7f7b477fe700 1 -- 172.21.15.38:0/1742529531 >> v1:172.21.15.38:6789/0 conn(0x7f7b48142e90 legacy=0x7f7b48066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:46.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.232+0000 7f7b46ffd700 1 -- 172.21.15.38:0/1742529531 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1951870763 0 0) 0x7f7b34003230 con 0x7f7b48142e90 2020-06-12T17:48:46.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.232+0000 7f7b477fe700 1 -- 172.21.15.38:0/1742529531 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b480b48f0 con 0x7f7b4809df00 2020-06-12T17:48:46.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.232+0000 7f7b477fe700 1 --2- 172.21.15.38:0/1742529531 >> v2:172.21.15.150:3300/0 conn(0x7f7b4809df00 0x7f7b4813c650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7b40001450 tx=0x7f7b3c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.232+0000 7f7b477fe700 1 --2- 172.21.15.38:0/1742529531 >> v2:172.21.15.150:3300/0 conn(0x7f7b4809df00 0x7f7b4813c650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7b40001450 tx=0x7f7b3c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.232+0000 7f7b477fe700 1 --2- 172.21.15.38:0/1742529531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b4809df00 0x7f7b4813c650 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7f7b40001450 tx=0x7f7b3c007e60).ready entity=mon.1 client_cookie=ce0f6991737d5c6a server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:46.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.232+0000 7f7b477fe700 1 --2- 172.21.15.38:0/1742529531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b4809df00 0x7f7b4813c650 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f7b40001450 tx=0x7f7b3c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.232+0000 7f7b46ffd700 1 -- 172.21.15.38:0/1742529531 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b40001a50 con 0x7f7b4809df00 2020-06-12T17:48:46.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.232+0000 7f7b477fe700 1 --2- 172.21.15.38:0/1742529531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b4809df00 0x7f7b4813c650 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f7b40001450 tx=0x7f7b3c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.232+0000 7f7b477fe700 1 --2- 172.21.15.38:0/1742529531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b4809df00 0x7f7b4813c650 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f7b40001450 tx=0x7f7b3c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.259 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.232+0000 7f7b46ffd700 1 -- 172.21.15.38:0/1742529531 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c008cb0 con 0x7f7b4809df00 2020-06-12T17:48:46.259 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.232+0000 7f7b46ffd700 1 -- 172.21.15.38:0/1742529531 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b3c008e20 con 0x7f7b4809df00 2020-06-12T17:48:46.259 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.232+0000 7f7b4e384700 1 -- 172.21.15.38:0/1742529531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b4809df00 msgr2=0x7f7b4813c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:46.260 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.232+0000 7f7b4e384700 1 --2- 172.21.15.38:0/1742529531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b4809df00 0x7f7b4813c650 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7f7b40001450 tx=0x7f7b3c007e60).stop 2020-06-12T17:48:46.260 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.233+0000 7f7b4e384700 1 -- 172.21.15.38:0/1742529531 shutdown_connections 2020-06-12T17:48:46.260 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.233+0000 7f7b4e384700 1 --2- 172.21.15.38:0/1742529531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b4809df00 0x7f7b4813c650 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:46.260 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.233+0000 7f7b4e384700 1 -- 172.21.15.38:0/1742529531 >> 172.21.15.38:0/1742529531 conn(0x7f7b480b5a20 msgr2=0x7f7b4805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:46.260 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.233+0000 7f7b4e384700 1 -- 172.21.15.38:0/1742529531 shutdown_connections 2020-06-12T17:48:46.261 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.233+0000 7f7b4e384700 1 -- 172.21.15.38:0/1742529531 wait complete. 2020-06-12T17:48:46.261 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.234+0000 7f7b4e384700 1 Processor -- start 2020-06-12T17:48:46.261 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.234+0000 7f7b4e384700 1 -- start start 2020-06-12T17:48:46.269 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.235+0000 7f7b4e384700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7b48142e90 0x7f7b481459f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:46.269 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.235+0000 7f7b4e384700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b48145110 con 0x7f7b480b3ac0 2020-06-12T17:48:46.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.235+0000 7f7b4e384700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b480b0a80 con 0x7f7b4809df00 2020-06-12T17:48:46.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.235+0000 7f7b4e384700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b480b0d20 con 0x7f7b48142e90 2020-06-12T17:48:46.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.235+0000 7f7b477fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7b480b3ac0 0x7f7b480b11c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38416/0 (socket says 172.21.15.38:38416) 2020-06-12T17:48:46.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.235+0000 7f7b477fe700 1 -- 172.21.15.38:0/894164712 learned_addr learned my addr 172.21.15.38:0/894164712 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:46.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.235+0000 7f7b4c921700 1 --2- 172.21.15.38:0/894164712 >> v2:172.21.15.150:3300/0 conn(0x7f7b48142e90 0x7f7b481459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:46.271 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.235+0000 7f7b457fa700 1 -- 172.21.15.38:0/894164712 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 428568693 0 0) 0x7f7b48145110 con 0x7f7b480b3ac0 2020-06-12T17:48:46.271 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.235+0000 7f7b457fa700 1 -- 172.21.15.38:0/894164712 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b28002fe0 con 0x7f7b480b3ac0 2020-06-12T17:48:46.271 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.235+0000 7f7b457fa700 1 -- 172.21.15.38:0/894164712 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741336735 0 0) 0x7f7b480b0a80 con 0x7f7b4809df00 2020-06-12T17:48:46.271 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.235+0000 7f7b457fa700 1 -- 172.21.15.38:0/894164712 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b48145110 con 0x7f7b4809df00 2020-06-12T17:48:46.271 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.235+0000 7f7b457fa700 1 -- 172.21.15.38:0/894164712 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1683729876 0 0) 0x7f7b28002fe0 con 0x7f7b480b3ac0 2020-06-12T17:48:46.272 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.235+0000 7f7b457fa700 1 -- 172.21.15.38:0/894164712 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7b480b0a80 con 0x7f7b480b3ac0 2020-06-12T17:48:46.272 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.235+0000 7f7b457fa700 1 -- 172.21.15.38:0/894164712 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f7b3c008660 con 0x7f7b480b3ac0 2020-06-12T17:48:46.272 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.235+0000 7f7b4c921700 1 -- 172.21.15.38:0/894164712 >> v1:172.21.15.150:6789/0 conn(0x7f7b4809df00 legacy=0x7f7b48140b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:46.272 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.235+0000 7f7b4c921700 1 -- 172.21.15.38:0/894164712 >> v1:172.21.15.38:6789/0 conn(0x7f7b480b3ac0 legacy=0x7f7b480b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:46.272 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.235+0000 7f7b4c921700 1 -- 172.21.15.38:0/894164712 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4814f1b0 con 0x7f7b48142e90 2020-06-12T17:48:46.272 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.235+0000 7f7b4c921700 1 --2- 172.21.15.38:0/894164712 >> v2:172.21.15.150:3300/0 conn(0x7f7b48142e90 0x7f7b481459f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7b40001320 tx=0x7f7b40001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.273 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.235+0000 7f7b4c921700 1 --2- 172.21.15.38:0/894164712 >> v2:172.21.15.150:3300/0 conn(0x7f7b48142e90 0x7f7b481459f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7b40001320 tx=0x7f7b40001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.273 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.235+0000 7f7b4c921700 1 --2- 172.21.15.38:0/894164712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b48142e90 0x7f7b481459f0 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7f7b40001320 tx=0x7f7b40001de0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:46.273 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.235+0000 7f7b4c921700 1 --2- 172.21.15.38:0/894164712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b48142e90 0x7f7b481459f0 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f7b40001320 tx=0x7f7b40001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.273 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.235+0000 7f7b457fa700 1 -- 172.21.15.38:0/894164712 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b4000ccd0 con 0x7f7b48142e90 2020-06-12T17:48:46.274 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.236+0000 7f7b4c921700 1 --2- 172.21.15.38:0/894164712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b48142e90 0x7f7b481459f0 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f7b40001320 tx=0x7f7b40001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.274 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.236+0000 7f7b4e384700 1 -- 172.21.15.38:0/894164712 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b48141210 con 0x7f7b48142e90 2020-06-12T17:48:46.274 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.236+0000 7f7b457fa700 1 -- 172.21.15.38:0/894164712 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4000ce30 con 0x7f7b48142e90 2020-06-12T17:48:46.274 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.236+0000 7f7b4c921700 1 --2- 172.21.15.38:0/894164712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b48142e90 0x7f7b481459f0 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f7b40001320 tx=0x7f7b40001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.274 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.236+0000 7f7b457fa700 1 -- 172.21.15.38:0/894164712 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b40004a60 con 0x7f7b48142e90 2020-06-12T17:48:46.275 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.236+0000 7f7b4e384700 1 -- 172.21.15.38:0/894164712 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b48145590 con 0x7f7b48142e90 2020-06-12T17:48:46.275 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.236+0000 7f7b4c921700 1 --2- 172.21.15.38:0/894164712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b48142e90 0x7f7b481459f0 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f7b40001320 tx=0x7f7b40001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.275 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.237+0000 7f7b4e384700 1 -- 172.21.15.38:0/894164712 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b48144f50 con 0x7f7b48142e90 2020-06-12T17:48:46.275 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.237+0000 7f7b457fa700 1 -- 172.21.15.38:0/894164712 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f7b40004c60 con 0x7f7b48142e90 2020-06-12T17:48:46.275 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.237+0000 7f7b4c921700 1 --2- 172.21.15.38:0/894164712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b48142e90 0x7f7b481459f0 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f7b40001320 tx=0x7f7b40001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.276 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.237+0000 7f7b457fa700 1 --2- 172.21.15.38:0/894164712 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7b2804dc80 0x7f7b28050140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:46.276 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.237+0000 7f7b457fa700 1 -- 172.21.15.38:0/894164712 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f7b40060ab0 con 0x7f7b48142e90 2020-06-12T17:48:46.276 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.237+0000 7f7b47fff700 1 --2- 172.21.15.38:0/894164712 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7b2804dc80 0x7f7b28050140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:46.276 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.237+0000 7f7b47fff700 1 --2- 172.21.15.38:0/894164712 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7b2804dc80 0x7f7b28050140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7b481415d0 tx=0x7f7b380025b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.276 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.238+0000 7f7b47fff700 1 --2- 172.21.15.38:0/894164712 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7b2804dc80 0x7f7b28050140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7b481415d0 tx=0x7f7b380025b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.277 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.238+0000 7f7b47fff700 1 --2- 172.21.15.38:0/894164712 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7b2804dc80 0x7f7b28050140 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f7b481415d0 tx=0x7f7b380025b0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:46.277 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.241+0000 7f7b4c921700 1 --2- 172.21.15.38:0/894164712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b48142e90 0x7f7b481459f0 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f7b40001320 tx=0x7f7b40001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.277 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.241+0000 7f7b457fa700 1 -- 172.21.15.38:0/894164712 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f7b4003c2b0 con 0x7f7b48142e90 2020-06-12T17:48:46.398 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.395+0000 7f7b4e384700 1 -- 172.21.15.38:0/894164712 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7b48056c30 con 0x7f7b48142e90 2020-06-12T17:48:46.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.396+0000 7f7b4c921700 1 --2- 172.21.15.38:0/894164712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b48142e90 0x7f7b481459f0 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f7b40001320 tx=0x7f7b40001de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.396+0000 7f7b457fa700 1 -- 172.21.15.38:0/894164712 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7b4003f8d0 con 0x7f7b48142e90 2020-06-12T17:48:46.400 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2020-06-12T17:48:46.401 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.397+0000 7f7b4e384700 1 -- 172.21.15.38:0/894164712 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7b2804dc80 msgr2=0x7f7b28050140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:46.401 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.397+0000 7f7b4e384700 1 --2- 172.21.15.38:0/894164712 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7b2804dc80 0x7f7b28050140 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f7b481415d0 tx=0x7f7b380025b0).stop 2020-06-12T17:48:46.401 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.397+0000 7f7b4e384700 1 -- 172.21.15.38:0/894164712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b48142e90 msgr2=0x7f7b481459f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:46.401 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.397+0000 7f7b4e384700 1 --2- 172.21.15.38:0/894164712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b48142e90 0x7f7b481459f0 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7f7b40001320 tx=0x7f7b40001de0).stop 2020-06-12T17:48:46.402 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.397+0000 7f7b4e384700 1 -- 172.21.15.38:0/894164712 shutdown_connections 2020-06-12T17:48:46.402 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.397+0000 7f7b4e384700 1 --2- 172.21.15.38:0/894164712 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7b2804dc80 0x7f7b28050140 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:46.402 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.397+0000 7f7b4e384700 1 --2- 172.21.15.38:0/894164712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7b48142e90 0x7f7b481459f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:46.402 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.397+0000 7f7b4e384700 1 -- 172.21.15.38:0/894164712 >> 172.21.15.38:0/894164712 conn(0x7f7b480b5a20 msgr2=0x7f7b480b7940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:46.402 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.397+0000 7f7b4e384700 1 -- 172.21.15.38:0/894164712 shutdown_connections 2020-06-12T17:48:46.402 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.397+0000 7f7b4e384700 1 -- 172.21.15.38:0/894164712 wait complete. 2020-06-12T17:48:46.411 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-06-12T17:48:46.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.524+0000 7fdb1c186700 1 Processor -- start 2020-06-12T17:48:46.528 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.524+0000 7fdb1c186700 1 -- start start 2020-06-12T17:48:46.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.525+0000 7fdb1c186700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb140b3ac0 0x7fdb1409df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:46.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.525+0000 7fdb1c186700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdb1413c650 0x7fdb14066790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:46.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.525+0000 7fdb1c186700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1409b960 con 0x7fdb14142e90 2020-06-12T17:48:46.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.525+0000 7fdb1c186700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb1409bc00 con 0x7fdb1413c650 2020-06-12T17:48:46.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.525+0000 7fdb1c186700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb140b48f0 con 0x7fdb140b3ac0 2020-06-12T17:48:46.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.525+0000 7fdb19721700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fdb14142e90 0x7fdb1413bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38426/0 (socket says 172.21.15.38:38426) 2020-06-12T17:48:46.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.525+0000 7fdb19721700 1 -- 172.21.15.38:0/1761116513 learned_addr learned my addr 172.21.15.38:0/1761116513 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:46.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.525+0000 7fdb19f22700 1 --2- 172.21.15.38:0/1761116513 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb140b3ac0 0x7fdb1409df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:46.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.525+0000 7fdb1a723700 1 --2- 172.21.15.38:0/1761116513 >> v2:172.21.15.150:3300/0 conn(0x7fdb1413c650 0x7fdb14066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:46.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.525+0000 7fdb18f20700 1 -- 172.21.15.38:0/1761116513 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040847149 0 0) 0x7fdb1409b960 con 0x7fdb14142e90 2020-06-12T17:48:46.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.525+0000 7fdb18f20700 1 -- 172.21.15.38:0/1761116513 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdafc003230 con 0x7fdb14142e90 2020-06-12T17:48:46.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.525+0000 7fdb18f20700 1 -- 172.21.15.38:0/1761116513 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2445956340 0 0) 0x7fdafc003230 con 0x7fdb14142e90 2020-06-12T17:48:46.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.525+0000 7fdb18f20700 1 -- 172.21.15.38:0/1761116513 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb140b3ac0 msgr2=0x7fdb1409df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:46.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.525+0000 7fdb18f20700 1 --2- 172.21.15.38:0/1761116513 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb140b3ac0 0x7fdb1409df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:46.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.525+0000 7fdb18f20700 1 -- 172.21.15.38:0/1761116513 >> v2:172.21.15.150:3300/0 conn(0x7fdb1413c650 msgr2=0x7fdb14066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:46.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.525+0000 7fdb18f20700 1 --2- 172.21.15.38:0/1761116513 >> v2:172.21.15.150:3300/0 conn(0x7fdb1413c650 0x7fdb14066790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:46.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.525+0000 7fdb18f20700 1 -- 172.21.15.38:0/1761116513 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb140b3ea0 con 0x7fdb14142e90 2020-06-12T17:48:46.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.525+0000 7fdb18f20700 1 -- 172.21.15.38:0/1761116513 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fdb10001a70 con 0x7fdb14142e90 2020-06-12T17:48:46.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.525+0000 7fdb18f20700 1 -- 172.21.15.38:0/1761116513 >> v1:172.21.15.38:6789/0 conn(0x7fdb14142e90 legacy=0x7fdb1413bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:46.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.526+0000 7fdb18f20700 1 --2- 172.21.15.38:0/1761116513 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdafc003720 0x7fdafc003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:46.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.526+0000 7fdb18f20700 1 --2- 172.21.15.38:0/1761116513 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb140b3ac0 0x7fdafc0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:46.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.526+0000 7fdb18f20700 1 --2- 172.21.15.38:0/1761116513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdafc004930 0x7fdafc004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:46.540 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.526+0000 7fdb18f20700 1 -- 172.21.15.38:0/1761116513 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1409bc00 con 0x7fdafc003720 2020-06-12T17:48:46.540 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.526+0000 7fdb18f20700 1 -- 172.21.15.38:0/1761116513 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb140b48f0 con 0x7fdafc004930 2020-06-12T17:48:46.540 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.526+0000 7fdb18f20700 1 -- 172.21.15.38:0/1761116513 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc005380 con 0x7fdb140b3ac0 2020-06-12T17:48:46.541 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.526+0000 7fdb19f22700 1 --2- 172.21.15.38:0/1761116513 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdafc003720 0x7fdafc003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:46.541 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.526+0000 7fdb19721700 1 --2- 172.21.15.38:0/1761116513 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb140b3ac0 0x7fdafc0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:46.541 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.526+0000 7fdb1a723700 1 --2- 172.21.15.38:0/1761116513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdafc004930 0x7fdafc004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:46.541 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.526+0000 7fdb19f22700 1 -- 172.21.15.38:0/1761116513 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb140b3ac0 msgr2=0x7fdafc0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:46.541 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.526+0000 7fdb19f22700 1 --2- 172.21.15.38:0/1761116513 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb140b3ac0 0x7fdafc0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:46.542 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.526+0000 7fdb19f22700 1 -- 172.21.15.38:0/1761116513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdafc004930 msgr2=0x7fdafc004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:46.542 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.526+0000 7fdb19f22700 1 --2- 172.21.15.38:0/1761116513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdafc004930 0x7fdafc004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:46.542 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.526+0000 7fdb19f22700 1 -- 172.21.15.38:0/1761116513 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc003230 con 0x7fdafc003720 2020-06-12T17:48:46.542 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.526+0000 7fdb19f22700 1 --2- 172.21.15.38:0/1761116513 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdafc003720 0x7fdafc003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdb04002f30 tx=0x7fdb04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.542 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.526+0000 7fdb19f22700 1 --2- 172.21.15.38:0/1761116513 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdafc003720 0x7fdafc003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdb04002f30 tx=0x7fdb04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.543 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.526+0000 7fdb19f22700 1 --2- 172.21.15.38:0/1761116513 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdafc003720 0x7fdafc003b40 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7fdb04002f30 tx=0x7fdb04007e60).ready entity=mon.0 client_cookie=49bfe101819c212e server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:46.543 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.526+0000 7fdb19f22700 1 --2- 172.21.15.38:0/1761116513 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdafc003720 0x7fdafc003b40 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7fdb04002f30 tx=0x7fdb04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.543 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.526+0000 7fdb19f22700 1 --2- 172.21.15.38:0/1761116513 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdafc003720 0x7fdafc003b40 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7fdb04002f30 tx=0x7fdb04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.543 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.526+0000 7fdb18f20700 1 -- 172.21.15.38:0/1761116513 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb04012e30 con 0x7fdafc003720 2020-06-12T17:48:46.543 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.526+0000 7fdb19f22700 1 --2- 172.21.15.38:0/1761116513 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdafc003720 0x7fdafc003b40 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7fdb04002f30 tx=0x7fdb04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.544 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.526+0000 7fdb18f20700 1 -- 172.21.15.38:0/1761116513 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb04008950 con 0x7fdafc003720 2020-06-12T17:48:46.544 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.526+0000 7fdb18f20700 1 -- 172.21.15.38:0/1761116513 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb04008d70 con 0x7fdafc003720 2020-06-12T17:48:46.544 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.526+0000 7fdb1c186700 1 -- 172.21.15.38:0/1761116513 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdafc003720 msgr2=0x7fdafc003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:46.544 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.526+0000 7fdb1c186700 1 --2- 172.21.15.38:0/1761116513 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdafc003720 0x7fdafc003b40 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7fdb04002f30 tx=0x7fdb04007e60).stop 2020-06-12T17:48:46.544 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.526+0000 7fdb1a723700 1 -- 172.21.15.38:0/1761116513 reap_dead start 2020-06-12T17:48:46.545 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.527+0000 7fdb1c186700 1 -- 172.21.15.38:0/1761116513 shutdown_connections 2020-06-12T17:48:46.545 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.527+0000 7fdb1c186700 1 -- 172.21.15.38:0/1761116513 >> 172.21.15.38:0/1761116513 conn(0x7fdb140b5a20 msgr2=0x7fdb1405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:46.546 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.527+0000 7fdb1c186700 1 -- 172.21.15.38:0/1761116513 shutdown_connections 2020-06-12T17:48:46.546 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.527+0000 7fdb1c186700 1 -- 172.21.15.38:0/1761116513 wait complete. 2020-06-12T17:48:46.546 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.528+0000 7fdb1c186700 1 Processor -- start 2020-06-12T17:48:46.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.528+0000 7fdb1c186700 1 -- start start 2020-06-12T17:48:46.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.528+0000 7fdb1c186700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb14145d80 0x7fdb140b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:46.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.528+0000 7fdb1c186700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1413fd80 con 0x7fdb140b1cb0 2020-06-12T17:48:46.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.529+0000 7fdb1c186700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb140b24e0 con 0x7fdb140ae520 2020-06-12T17:48:46.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.529+0000 7fdb1c186700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb14066e10 con 0x7fdb14145d80 2020-06-12T17:48:46.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.529+0000 7fdb1a723700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fdb140b1cb0 0x7fdb14152be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38438/0 (socket says 172.21.15.38:38438) 2020-06-12T17:48:46.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.529+0000 7fdb1a723700 1 -- 172.21.15.38:0/1491913783 learned_addr learned my addr 172.21.15.38:0/1491913783 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:46.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.529+0000 7fdb19f22700 1 --2- 172.21.15.38:0/1491913783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb14145d80 0x7fdb140b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:46.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.529+0000 7fdb02ffd700 1 -- 172.21.15.38:0/1491913783 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612027225 0 0) 0x7fdb1413fd80 con 0x7fdb140b1cb0 2020-06-12T17:48:46.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.529+0000 7fdb02ffd700 1 -- 172.21.15.38:0/1491913783 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaf4002fe0 con 0x7fdb140b1cb0 2020-06-12T17:48:46.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.529+0000 7fdb02ffd700 1 -- 172.21.15.38:0/1491913783 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3514347262 0 0) 0x7fdb140b24e0 con 0x7fdb140ae520 2020-06-12T17:48:46.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.529+0000 7fdb02ffd700 1 -- 172.21.15.38:0/1491913783 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb1413fd80 con 0x7fdb140ae520 2020-06-12T17:48:46.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.529+0000 7fdb19f22700 1 -- 172.21.15.38:0/1491913783 >> v1:172.21.15.150:6789/0 conn(0x7fdb140ae520 legacy=0x7fdb1413f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:46.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.529+0000 7fdb19f22700 1 -- 172.21.15.38:0/1491913783 >> v1:172.21.15.38:6789/0 conn(0x7fdb140b1cb0 legacy=0x7fdb14152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:46.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.529+0000 7fdb19f22700 1 -- 172.21.15.38:0/1491913783 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb14146160 con 0x7fdb14145d80 2020-06-12T17:48:46.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.529+0000 7fdb19f22700 1 --2- 172.21.15.38:0/1491913783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb14145d80 0x7fdb140b0840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdb04002f30 tx=0x7fdb04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.529+0000 7fdb19f22700 1 --2- 172.21.15.38:0/1491913783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb14145d80 0x7fdb140b0840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdb04002f30 tx=0x7fdb04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.529+0000 7fdb19f22700 1 --2- 172.21.15.38:0/1491913783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb14145d80 0x7fdb140b0840 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7fdb04002f30 tx=0x7fdb04007e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:46.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.529+0000 7fdb19f22700 1 --2- 172.21.15.38:0/1491913783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb14145d80 0x7fdb140b0840 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fdb04002f30 tx=0x7fdb04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.529+0000 7fdb02ffd700 1 -- 172.21.15.38:0/1491913783 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb04008e30 con 0x7fdb14145d80 2020-06-12T17:48:46.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.529+0000 7fdb19f22700 1 --2- 172.21.15.38:0/1491913783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb14145d80 0x7fdb140b0840 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fdb04002f30 tx=0x7fdb04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.529+0000 7fdb19f22700 1 --2- 172.21.15.38:0/1491913783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb14145d80 0x7fdb140b0840 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fdb04002f30 tx=0x7fdb04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.529+0000 7fdb02ffd700 1 -- 172.21.15.38:0/1491913783 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0400f400 con 0x7fdb14145d80 2020-06-12T17:48:46.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.529+0000 7fdb02ffd700 1 -- 172.21.15.38:0/1491913783 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb0400f760 con 0x7fdb14145d80 2020-06-12T17:48:46.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.529+0000 7fdb1c186700 1 -- 172.21.15.38:0/1491913783 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb140b2100 con 0x7fdb14145d80 2020-06-12T17:48:46.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.529+0000 7fdb1c186700 1 -- 172.21.15.38:0/1491913783 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb140af240 con 0x7fdb14145d80 2020-06-12T17:48:46.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.530+0000 7fdb19f22700 1 --2- 172.21.15.38:0/1491913783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb14145d80 0x7fdb140b0840 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fdb04002f30 tx=0x7fdb04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.530+0000 7fdb1c186700 1 -- 172.21.15.38:0/1491913783 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb14056c30 con 0x7fdb14145d80 2020-06-12T17:48:46.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.531+0000 7fdb02ffd700 1 -- 172.21.15.38:0/1491913783 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fdb040056c0 con 0x7fdb14145d80 2020-06-12T17:48:46.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.531+0000 7fdb19f22700 1 --2- 172.21.15.38:0/1491913783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb14145d80 0x7fdb140b0840 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fdb04002f30 tx=0x7fdb04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.531+0000 7fdb02ffd700 1 --2- 172.21.15.38:0/1491913783 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdaf404da70 0x7fdaf404ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:46.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.531+0000 7fdb02ffd700 1 -- 172.21.15.38:0/1491913783 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fdb04063090 con 0x7fdb14145d80 2020-06-12T17:48:46.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.531+0000 7fdb19721700 1 --2- 172.21.15.38:0/1491913783 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdaf404da70 0x7fdaf404ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:46.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.531+0000 7fdb19721700 1 --2- 172.21.15.38:0/1491913783 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdaf404da70 0x7fdaf404ff30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdb10001c10 tx=0x7fdb140b61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.531+0000 7fdb19721700 1 --2- 172.21.15.38:0/1491913783 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdaf404da70 0x7fdaf404ff30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdb10001c10 tx=0x7fdb140b61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.531+0000 7fdb19721700 1 --2- 172.21.15.38:0/1491913783 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdaf404da70 0x7fdaf404ff30 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7fdb10001c10 tx=0x7fdb140b61c0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:46.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.535+0000 7fdb19f22700 1 --2- 172.21.15.38:0/1491913783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb14145d80 0x7fdb140b0840 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fdb04002f30 tx=0x7fdb04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.535+0000 7fdb02ffd700 1 -- 172.21.15.38:0/1491913783 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fdb0403e850 con 0x7fdb14145d80 2020-06-12T17:48:46.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.687+0000 7fdb1c186700 1 -- 172.21.15.38:0/1491913783 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdb14146900 con 0x7fdb14145d80 2020-06-12T17:48:46.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.687+0000 7fdb19f22700 1 --2- 172.21.15.38:0/1491913783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb14145d80 0x7fdb140b0840 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fdb04002f30 tx=0x7fdb04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.687+0000 7fdb02ffd700 1 -- 172.21.15.38:0/1491913783 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdb04041e70 con 0x7fdb14145d80 2020-06-12T17:48:46.692 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:46.692 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.689+0000 7fdb1c186700 1 -- 172.21.15.38:0/1491913783 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdaf404da70 msgr2=0x7fdaf404ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:46.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.689+0000 7fdb1c186700 1 --2- 172.21.15.38:0/1491913783 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdaf404da70 0x7fdaf404ff30 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7fdb10001c10 tx=0x7fdb140b61c0).stop 2020-06-12T17:48:46.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.689+0000 7fdb1c186700 1 -- 172.21.15.38:0/1491913783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb14145d80 msgr2=0x7fdb140b0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:46.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.689+0000 7fdb1c186700 1 --2- 172.21.15.38:0/1491913783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb14145d80 0x7fdb140b0840 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7fdb04002f30 tx=0x7fdb04007e60).stop 2020-06-12T17:48:46.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.689+0000 7fdb1c186700 1 -- 172.21.15.38:0/1491913783 shutdown_connections 2020-06-12T17:48:46.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.689+0000 7fdb1c186700 1 --2- 172.21.15.38:0/1491913783 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdaf404da70 0x7fdaf404ff30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:46.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.689+0000 7fdb1c186700 1 --2- 172.21.15.38:0/1491913783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb14145d80 0x7fdb140b0840 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:46.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.689+0000 7fdb1c186700 1 -- 172.21.15.38:0/1491913783 >> 172.21.15.38:0/1491913783 conn(0x7fdb140b5a20 msgr2=0x7fdb140b76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:46.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.689+0000 7fdb1c186700 1 -- 172.21.15.38:0/1491913783 shutdown_connections 2020-06-12T17:48:46.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.689+0000 7fdb1c186700 1 -- 172.21.15.38:0/1491913783 wait complete. 2020-06-12T17:48:46.702 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-06-12T17:48:46.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.817+0000 7fddd49c9700 1 Processor -- start 2020-06-12T17:48:46.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.817+0000 7fddd49c9700 1 -- start start 2020-06-12T17:48:46.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.818+0000 7fddd49c9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd0146680 0x7fddd00ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:46.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.818+0000 7fddd49c9700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fddd009d8d0 0x7fddd01421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:46.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.818+0000 7fddd49c9700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd0146d20 con 0x7fddd00b2eb0 2020-06-12T17:48:46.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.818+0000 7fddd49c9700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd0066a80 con 0x7fddd009d8d0 2020-06-12T17:48:46.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.818+0000 7fddd49c9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd0146f50 con 0x7fddd0146680 2020-06-12T17:48:46.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.818+0000 7fddced9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fddd009d8d0 0x7fddd01421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:46.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.819+0000 7fddcdd9b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fddd00b2eb0 0x7fddd009d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38444/0 (socket says 172.21.15.38:38444) 2020-06-12T17:48:46.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.819+0000 7fddcdd9b700 1 -- 172.21.15.38:0/1220989474 learned_addr learned my addr 172.21.15.38:0/1220989474 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:46.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.819+0000 7fddce59c700 1 --2- 172.21.15.38:0/1220989474 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd0146680 0x7fddd00ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:46.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.819+0000 7fddced9d700 1 -- 172.21.15.38:0/1220989474 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd0146680 msgr2=0x7fddd00ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:46.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.819+0000 7fddced9d700 1 --2- 172.21.15.38:0/1220989474 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd0146680 0x7fddd00ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:46.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.819+0000 7fddced9d700 1 -- 172.21.15.38:0/1220989474 >> v1:172.21.15.38:6789/0 conn(0x7fddd00b2eb0 legacy=0x7fddd009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:46.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.819+0000 7fddced9d700 1 -- 172.21.15.38:0/1220989474 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd0146a60 con 0x7fddd009d8d0 2020-06-12T17:48:46.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.819+0000 7fddcd59a700 1 -- 172.21.15.38:0/1220989474 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3644992875 0 0) 0x7fddd0146d20 con 0x7fddd00b2eb0 2020-06-12T17:48:46.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.819+0000 7fddce59c700 1 --2- 172.21.15.38:0/1220989474 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd0146680 0x7fddd00ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:46.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.819+0000 7fddced9d700 1 --2- 172.21.15.38:0/1220989474 >> v2:172.21.15.38:3300/0 conn(0x7fddd009d8d0 0x7fddd01421d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fddc80032b0 tx=0x7fddc80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.819+0000 7fddced9d700 1 --2- 172.21.15.38:0/1220989474 >> v2:172.21.15.38:3300/0 conn(0x7fddd009d8d0 0x7fddd01421d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fddc80032b0 tx=0x7fddc80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.819+0000 7fddced9d700 1 --2- 172.21.15.38:0/1220989474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd009d8d0 0x7fddd01421d0 secure :-1 s=READY pgs=284 cs=0 l=1 rx=0x7fddc80032b0 tx=0x7fddc80081e0).ready entity=mon.0 client_cookie=86e4bed48bc83cd6 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:46.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.819+0000 7fddced9d700 1 --2- 172.21.15.38:0/1220989474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd009d8d0 0x7fddd01421d0 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7fddc80032b0 tx=0x7fddc80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.819+0000 7fddcd59a700 1 -- 172.21.15.38:0/1220989474 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddc8011e90 con 0x7fddd009d8d0 2020-06-12T17:48:46.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.819+0000 7fddced9d700 1 --2- 172.21.15.38:0/1220989474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd009d8d0 0x7fddd01421d0 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7fddc80032b0 tx=0x7fddc80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.819+0000 7fddced9d700 1 --2- 172.21.15.38:0/1220989474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd009d8d0 0x7fddd01421d0 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7fddc80032b0 tx=0x7fddc80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.819+0000 7fddcd59a700 1 -- 172.21.15.38:0/1220989474 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc800a160 con 0x7fddd009d8d0 2020-06-12T17:48:46.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.819+0000 7fddcd59a700 1 -- 172.21.15.38:0/1220989474 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddc800a540 con 0x7fddd009d8d0 2020-06-12T17:48:46.829 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.819+0000 7fddd49c9700 1 -- 172.21.15.38:0/1220989474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd009d8d0 msgr2=0x7fddd01421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:46.829 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.819+0000 7fddd49c9700 1 --2- 172.21.15.38:0/1220989474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd009d8d0 0x7fddd01421d0 secure :-1 s=READY pgs=284 cs=0 l=1 rx=0x7fddc80032b0 tx=0x7fddc80081e0).stop 2020-06-12T17:48:46.829 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.820+0000 7fddd49c9700 1 -- 172.21.15.38:0/1220989474 shutdown_connections 2020-06-12T17:48:46.829 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.820+0000 7fddd49c9700 1 --2- 172.21.15.38:0/1220989474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd009d8d0 0x7fddd01421d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:46.829 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.820+0000 7fddd49c9700 1 --2- 172.21.15.38:0/1220989474 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd0146680 0x7fddd00ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:46.834 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.820+0000 7fddd49c9700 1 -- 172.21.15.38:0/1220989474 >> 172.21.15.38:0/1220989474 conn(0x7fddd00b5a20 msgr2=0x7fddd005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:46.834 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.820+0000 7fddd49c9700 1 -- 172.21.15.38:0/1220989474 shutdown_connections 2020-06-12T17:48:46.834 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.820+0000 7fddd49c9700 1 -- 172.21.15.38:0/1220989474 wait complete. 2020-06-12T17:48:46.835 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.821+0000 7fddd49c9700 1 Processor -- start 2020-06-12T17:48:46.835 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.821+0000 7fddd49c9700 1 -- start start 2020-06-12T17:48:46.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.821+0000 7fddd49c9700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fddd00b2eb0 0x7fddd00b1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:46.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.821+0000 7fddd49c9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd0146680 0x7fddd0142d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:46.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.821+0000 7fddd49c9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd00b1770 con 0x7fddd009d8d0 2020-06-12T17:48:46.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.821+0000 7fddd49c9700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd0150470 con 0x7fddd00b2eb0 2020-06-12T17:48:46.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.821+0000 7fddd49c9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd0063da0 con 0x7fddd0146680 2020-06-12T17:48:46.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.821+0000 7fddcdd9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fddd00b2eb0 0x7fddd00b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:46.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.821+0000 7fddcdd9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fddd00b2eb0 0x7fddd00b1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36634/0 (socket says 172.21.15.38:36634) 2020-06-12T17:48:46.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.821+0000 7fddcdd9b700 1 -- 172.21.15.38:0/3531848770 learned_addr learned my addr 172.21.15.38:0/3531848770 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:46.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.822+0000 7fddced9d700 1 --2- 172.21.15.38:0/3531848770 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd0146680 0x7fddd0142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:46.840 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.822+0000 7fddcdd9b700 1 -- 172.21.15.38:0/3531848770 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd0146680 msgr2=0x7fddd0142d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:46.840 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.822+0000 7fddcdd9b700 1 --2- 172.21.15.38:0/3531848770 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd0146680 0x7fddd0142d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:46.840 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.822+0000 7fddcdd9b700 1 -- 172.21.15.38:0/3531848770 >> v1:172.21.15.150:6789/0 conn(0x7fddd009d8d0 legacy=0x7fddd0063570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:46.840 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.822+0000 7fddcdd9b700 1 -- 172.21.15.38:0/3531848770 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd0064040 con 0x7fddd00b2eb0 2020-06-12T17:48:46.840 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.822+0000 7fddcdd9b700 1 --2- 172.21.15.38:0/3531848770 >> v2:172.21.15.38:3300/0 conn(0x7fddd00b2eb0 0x7fddd00b1310 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fddd00b1e60 tx=0x7fddc00017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.841 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.822+0000 7fddcdd9b700 1 --2- 172.21.15.38:0/3531848770 >> v2:172.21.15.38:3300/0 conn(0x7fddd00b2eb0 0x7fddd00b1310 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fddd00b1e60 tx=0x7fddc00017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.841 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.822+0000 7fddcdd9b700 1 --2- 172.21.15.38:0/3531848770 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd00b2eb0 0x7fddd00b1310 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7fddd00b1e60 tx=0x7fddc00017a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:46.841 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.822+0000 7fddcdd9b700 1 --2- 172.21.15.38:0/3531848770 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd00b2eb0 0x7fddd00b1310 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fddd00b1e60 tx=0x7fddc00017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.841 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.822+0000 7fddcdd9b700 1 --2- 172.21.15.38:0/3531848770 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd00b2eb0 0x7fddd00b1310 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fddd00b1e60 tx=0x7fddc00017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.841 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.822+0000 7fddbf7fe700 1 -- 172.21.15.38:0/3531848770 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddc000c650 con 0x7fddd00b2eb0 2020-06-12T17:48:46.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.822+0000 7fddcdd9b700 1 --2- 172.21.15.38:0/3531848770 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd00b2eb0 0x7fddd00b1310 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fddd00b1e60 tx=0x7fddc00017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.822+0000 7fddbf7fe700 1 -- 172.21.15.38:0/3531848770 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc000c7b0 con 0x7fddd00b2eb0 2020-06-12T17:48:46.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.822+0000 7fddd49c9700 1 -- 172.21.15.38:0/3531848770 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd00642e0 con 0x7fddd00b2eb0 2020-06-12T17:48:46.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.822+0000 7fddbf7fe700 1 -- 172.21.15.38:0/3531848770 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddc000cb90 con 0x7fddd00b2eb0 2020-06-12T17:48:46.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.822+0000 7fddd49c9700 1 -- 172.21.15.38:0/3531848770 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd01431c0 con 0x7fddd00b2eb0 2020-06-12T17:48:46.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.823+0000 7fddcdd9b700 1 --2- 172.21.15.38:0/3531848770 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd00b2eb0 0x7fddd00b1310 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fddd00b1e60 tx=0x7fddc00017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.823+0000 7fddbf7fe700 1 -- 172.21.15.38:0/3531848770 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fddc000ccf0 con 0x7fddd00b2eb0 2020-06-12T17:48:46.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.823+0000 7fddcdd9b700 1 --2- 172.21.15.38:0/3531848770 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd00b2eb0 0x7fddd00b1310 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fddd00b1e60 tx=0x7fddc00017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.823+0000 7fddd49c9700 1 -- 172.21.15.38:0/3531848770 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd0056c30 con 0x7fddd00b2eb0 2020-06-12T17:48:46.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.823+0000 7fddbf7fe700 1 --2- 172.21.15.38:0/3531848770 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fddac04d660 0x7fddac04fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:46.844 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.823+0000 7fddbf7fe700 1 -- 172.21.15.38:0/3531848770 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fddc0060910 con 0x7fddd00b2eb0 2020-06-12T17:48:46.844 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.824+0000 7fddce59c700 1 --2- 172.21.15.38:0/3531848770 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fddac04d660 0x7fddac04fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:46.844 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.824+0000 7fddce59c700 1 --2- 172.21.15.38:0/3531848770 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fddac04d660 0x7fddac04fb20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fddc4002f30 tx=0x7fddc4009520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.844 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.824+0000 7fddce59c700 1 --2- 172.21.15.38:0/3531848770 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fddac04d660 0x7fddac04fb20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fddc4002f30 tx=0x7fddc4009520).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.844 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.824+0000 7fddce59c700 1 --2- 172.21.15.38:0/3531848770 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fddac04d660 0x7fddac04fb20 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fddc4002f30 tx=0x7fddc4009520).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:46.845 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.827+0000 7fddcdd9b700 1 --2- 172.21.15.38:0/3531848770 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd00b2eb0 0x7fddd00b1310 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fddd00b1e60 tx=0x7fddc00017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.845 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.827+0000 7fddbf7fe700 1 -- 172.21.15.38:0/3531848770 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fddc003bfb0 con 0x7fddd00b2eb0 2020-06-12T17:48:46.979 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.976+0000 7fddd49c9700 1 -- 172.21.15.38:0/3531848770 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fddd00b1770 con 0x7fddd00b2eb0 2020-06-12T17:48:46.980 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.976+0000 7fddcdd9b700 1 --2- 172.21.15.38:0/3531848770 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd00b2eb0 0x7fddd00b1310 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fddd00b1e60 tx=0x7fddc00017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:46.980 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.976+0000 7fddbf7fe700 1 -- 172.21.15.38:0/3531848770 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7fddd00b1770 con 0x7fddd00b2eb0 2020-06-12T17:48:46.980 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:46.981 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.977+0000 7fddd49c9700 1 -- 172.21.15.38:0/3531848770 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fddac04d660 msgr2=0x7fddac04fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:46.982 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.978+0000 7fddd49c9700 1 --2- 172.21.15.38:0/3531848770 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fddac04d660 0x7fddac04fb20 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fddc4002f30 tx=0x7fddc4009520).stop 2020-06-12T17:48:46.982 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.978+0000 7fddd49c9700 1 -- 172.21.15.38:0/3531848770 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd00b2eb0 msgr2=0x7fddd00b1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:46.982 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.978+0000 7fddd49c9700 1 --2- 172.21.15.38:0/3531848770 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd00b2eb0 0x7fddd00b1310 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7fddd00b1e60 tx=0x7fddc00017a0).stop 2020-06-12T17:48:46.982 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.978+0000 7fddd49c9700 1 -- 172.21.15.38:0/3531848770 shutdown_connections 2020-06-12T17:48:46.983 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.978+0000 7fddd49c9700 1 --2- 172.21.15.38:0/3531848770 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fddac04d660 0x7fddac04fb20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:46.983 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.978+0000 7fddd49c9700 1 --2- 172.21.15.38:0/3531848770 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd0146680 0x7fddd0142d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:46.983 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.978+0000 7fddd49c9700 1 --2- 172.21.15.38:0/3531848770 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd00b2eb0 0x7fddd00b1310 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:46.983 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.978+0000 7fddd49c9700 1 -- 172.21.15.38:0/3531848770 >> 172.21.15.38:0/3531848770 conn(0x7fddd00b5a20 msgr2=0x7fddd00b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:46.983 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.978+0000 7fddd49c9700 1 -- 172.21.15.38:0/3531848770 shutdown_connections 2020-06-12T17:48:46.984 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:46.978+0000 7fddd49c9700 1 -- 172.21.15.38:0/3531848770 wait complete. 2020-06-12T17:48:46.991 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-06-12T17:48:47.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.105+0000 7fb37f496700 1 Processor -- start 2020-06-12T17:48:47.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.105+0000 7fb37f496700 1 -- start start 2020-06-12T17:48:47.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.106+0000 7fb37f496700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb3780afb40 0x7fb3780b4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:47.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.106+0000 7fb37f496700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb37805b420 0x7fb37805b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:47.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.106+0000 7fb37f496700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb378066da0 con 0x7fb378142420 2020-06-12T17:48:47.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.106+0000 7fb37f496700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3780b0270 con 0x7fb37805b420 2020-06-12T17:48:47.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.106+0000 7fb37f496700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb378145b70 con 0x7fb3780afb40 2020-06-12T17:48:47.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.106+0000 7fb37dc93700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb37805b420 0x7fb37805b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:47.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.106+0000 7fb37ec95700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb378142420 0x7fb3780b2bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38460/0 (socket says 172.21.15.38:38460) 2020-06-12T17:48:47.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.106+0000 7fb37ec95700 1 -- 172.21.15.38:0/562221954 learned_addr learned my addr 172.21.15.38:0/562221954 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:47.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.106+0000 7fb37e494700 1 --2- 172.21.15.38:0/562221954 >> v2:172.21.15.150:3300/0 conn(0x7fb3780afb40 0x7fb3780b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:47.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.106+0000 7fb37dc93700 1 -- 172.21.15.38:0/562221954 >> v2:172.21.15.150:3300/0 conn(0x7fb3780afb40 msgr2=0x7fb3780b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:47.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.106+0000 7fb37dc93700 1 --2- 172.21.15.38:0/562221954 >> v2:172.21.15.150:3300/0 conn(0x7fb3780afb40 0x7fb3780b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:47.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.106+0000 7fb37dc93700 1 -- 172.21.15.38:0/562221954 >> v1:172.21.15.38:6789/0 conn(0x7fb378142420 legacy=0x7fb3780b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:47.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.106+0000 7fb37dc93700 1 -- 172.21.15.38:0/562221954 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3780aff20 con 0x7fb37805b420 2020-06-12T17:48:47.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.106+0000 7fb37e494700 1 --2- 172.21.15.38:0/562221954 >> v2:172.21.15.150:3300/0 conn(0x7fb3780afb40 0x7fb3780b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:47.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.106+0000 7fb37dc93700 1 --2- 172.21.15.38:0/562221954 >> v2:172.21.15.38:3300/0 conn(0x7fb37805b420 0x7fb37805b8b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb374002f30 tx=0x7fb374007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.106+0000 7fb37dc93700 1 --2- 172.21.15.38:0/562221954 >> v2:172.21.15.38:3300/0 conn(0x7fb37805b420 0x7fb37805b8b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb374002f30 tx=0x7fb374007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.106+0000 7fb37dc93700 1 --2- 172.21.15.38:0/562221954 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb37805b420 0x7fb37805b8b0 secure :-1 s=READY pgs=287 cs=0 l=1 rx=0x7fb374002f30 tx=0x7fb374007e60).ready entity=mon.0 client_cookie=ccc58b74477a0e10 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:47.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.106+0000 7fb37dc93700 1 --2- 172.21.15.38:0/562221954 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb37805b420 0x7fb37805b8b0 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7fb374002f30 tx=0x7fb374007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.106+0000 7fb37d492700 1 -- 172.21.15.38:0/562221954 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb374012540 con 0x7fb37805b420 2020-06-12T17:48:47.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.106+0000 7fb37dc93700 1 --2- 172.21.15.38:0/562221954 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb37805b420 0x7fb37805b8b0 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7fb374002f30 tx=0x7fb374007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.106+0000 7fb37dc93700 1 --2- 172.21.15.38:0/562221954 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb37805b420 0x7fb37805b8b0 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7fb374002f30 tx=0x7fb374007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.106+0000 7fb37d492700 1 -- 172.21.15.38:0/562221954 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3740126a0 con 0x7fb37805b420 2020-06-12T17:48:47.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.106+0000 7fb37d492700 1 -- 172.21.15.38:0/562221954 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb374012a80 con 0x7fb37805b420 2020-06-12T17:48:47.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.106+0000 7fb37f496700 1 -- 172.21.15.38:0/562221954 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb37805b420 msgr2=0x7fb37805b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:47.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.107+0000 7fb37f496700 1 --2- 172.21.15.38:0/562221954 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb37805b420 0x7fb37805b8b0 secure :-1 s=READY pgs=287 cs=0 l=1 rx=0x7fb374002f30 tx=0x7fb374007e60).stop 2020-06-12T17:48:47.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.107+0000 7fb37f496700 1 -- 172.21.15.38:0/562221954 shutdown_connections 2020-06-12T17:48:47.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.107+0000 7fb37f496700 1 --2- 172.21.15.38:0/562221954 >> v2:172.21.15.150:3300/0 conn(0x7fb3780afb40 0x7fb3780b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:47.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.107+0000 7fb37f496700 1 --2- 172.21.15.38:0/562221954 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb37805b420 0x7fb37805b8b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:47.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.107+0000 7fb37f496700 1 -- 172.21.15.38:0/562221954 >> 172.21.15.38:0/562221954 conn(0x7fb3780b4cc0 msgr2=0x7fb3780b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:47.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.107+0000 7fb37f496700 1 -- 172.21.15.38:0/562221954 shutdown_connections 2020-06-12T17:48:47.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.107+0000 7fb37f496700 1 -- 172.21.15.38:0/562221954 wait complete. 2020-06-12T17:48:47.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.108+0000 7fb37f496700 1 Processor -- start 2020-06-12T17:48:47.118 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.108+0000 7fb37f496700 1 -- start start 2020-06-12T17:48:47.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.109+0000 7fb37f496700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb37805b420 0x7fb37813d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:47.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.109+0000 7fb37f496700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3780afb40 0x7fb378144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:47.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.109+0000 7fb37f496700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb378157130 con 0x7fb378142420 2020-06-12T17:48:47.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.109+0000 7fb37f496700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb378144fd0 con 0x7fb37805b420 2020-06-12T17:48:47.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.109+0000 7fb37f496700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3781573d0 con 0x7fb3780afb40 2020-06-12T17:48:47.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.109+0000 7fb37dc93700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3780afb40 0x7fb378144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:47.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.109+0000 7fb37e494700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb37805b420 0x7fb37813d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:47.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.109+0000 7fb37e494700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb37805b420 0x7fb37813d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:46122/0 (socket says 172.21.15.38:46122) 2020-06-12T17:48:47.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.109+0000 7fb37e494700 1 -- 172.21.15.38:0/399604849 learned_addr learned my addr 172.21.15.38:0/399604849 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:47.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.109+0000 7fb37dc93700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3780afb40 0x7fb378144b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:56106/0 (socket says 172.21.15.38:56106) 2020-06-12T17:48:47.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.109+0000 7fb37dc93700 1 -- 172.21.15.38:0/399604849 >> v2:172.21.15.150:3300/0 conn(0x7fb37805b420 msgr2=0x7fb37813d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:47.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.109+0000 7fb37dc93700 1 --2- 172.21.15.38:0/399604849 >> v2:172.21.15.150:3300/0 conn(0x7fb37805b420 0x7fb37813d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:47.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.109+0000 7fb37dc93700 1 -- 172.21.15.38:0/399604849 >> v1:172.21.15.150:6789/0 conn(0x7fb378142420 legacy=0x7fb378065750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:47.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.109+0000 7fb37dc93700 1 -- 172.21.15.38:0/399604849 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb378157670 con 0x7fb3780afb40 2020-06-12T17:48:47.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.109+0000 7fb37e494700 1 --2- 172.21.15.38:0/399604849 >> v2:172.21.15.150:3300/0 conn(0x7fb37805b420 0x7fb37813d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:47.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.109+0000 7fb37dc93700 1 --2- 172.21.15.38:0/399604849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3780afb40 0x7fb378144b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb378133b90 tx=0x7fb374007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.109+0000 7fb37dc93700 1 --2- 172.21.15.38:0/399604849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3780afb40 0x7fb378144b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb378133b90 tx=0x7fb374007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.110+0000 7fb37dc93700 1 --2- 172.21.15.38:0/399604849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3780afb40 0x7fb378144b70 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7fb378133b90 tx=0x7fb374007e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:47.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.110+0000 7fb37dc93700 1 --2- 172.21.15.38:0/399604849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3780afb40 0x7fb378144b70 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fb378133b90 tx=0x7fb374007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.110+0000 7fb3677fe700 1 -- 172.21.15.38:0/399604849 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb374012940 con 0x7fb3780afb40 2020-06-12T17:48:47.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.110+0000 7fb37dc93700 1 --2- 172.21.15.38:0/399604849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3780afb40 0x7fb378144b70 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fb378133b90 tx=0x7fb374007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.110+0000 7fb3677fe700 1 -- 172.21.15.38:0/399604849 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb374012aa0 con 0x7fb3780afb40 2020-06-12T17:48:47.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.110+0000 7fb37dc93700 1 --2- 172.21.15.38:0/399604849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3780afb40 0x7fb378144b70 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fb378133b90 tx=0x7fb374007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.110+0000 7fb37f496700 1 -- 172.21.15.38:0/399604849 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3781111e0 con 0x7fb3780afb40 2020-06-12T17:48:47.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.110+0000 7fb3677fe700 1 -- 172.21.15.38:0/399604849 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb374007340 con 0x7fb3780afb40 2020-06-12T17:48:47.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.110+0000 7fb37f496700 1 -- 172.21.15.38:0/399604849 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb378157b10 con 0x7fb3780afb40 2020-06-12T17:48:47.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.111+0000 7fb37dc93700 1 --2- 172.21.15.38:0/399604849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3780afb40 0x7fb378144b70 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fb378133b90 tx=0x7fb374007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.111+0000 7fb37f496700 1 -- 172.21.15.38:0/399604849 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb378157800 con 0x7fb3780afb40 2020-06-12T17:48:47.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.111+0000 7fb3677fe700 1 -- 172.21.15.38:0/399604849 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fb37400e0c0 con 0x7fb3780afb40 2020-06-12T17:48:47.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.111+0000 7fb37dc93700 1 --2- 172.21.15.38:0/399604849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3780afb40 0x7fb378144b70 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fb378133b90 tx=0x7fb374007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.111+0000 7fb3677fe700 1 --2- 172.21.15.38:0/399604849 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb35804d600 0x7fb35804fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:47.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.111+0000 7fb3677fe700 1 -- 172.21.15.38:0/399604849 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fb3740610b0 con 0x7fb3780afb40 2020-06-12T17:48:47.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.111+0000 7fb37e494700 1 --2- 172.21.15.38:0/399604849 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb35804d600 0x7fb35804fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:47.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.112+0000 7fb37e494700 1 --2- 172.21.15.38:0/399604849 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb35804d600 0x7fb35804fac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb368007920 tx=0x7fb36800e0a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.112+0000 7fb37e494700 1 --2- 172.21.15.38:0/399604849 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb35804d600 0x7fb35804fac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb368007920 tx=0x7fb36800e0a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.112+0000 7fb37e494700 1 --2- 172.21.15.38:0/399604849 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb35804d600 0x7fb35804fac0 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7fb368007920 tx=0x7fb36800e0a0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:47.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.115+0000 7fb37dc93700 1 --2- 172.21.15.38:0/399604849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3780afb40 0x7fb378144b70 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fb378133b90 tx=0x7fb374007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.115+0000 7fb3677fe700 1 -- 172.21.15.38:0/399604849 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fb37403c960 con 0x7fb3780afb40 2020-06-12T17:48:47.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.267+0000 7fb37f496700 1 -- 172.21.15.38:0/399604849 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb378056c30 con 0x7fb3780afb40 2020-06-12T17:48:47.271 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.268+0000 7fb37dc93700 1 --2- 172.21.15.38:0/399604849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3780afb40 0x7fb378144b70 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fb378133b90 tx=0x7fb374007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.272 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.268+0000 7fb3677fe700 1 -- 172.21.15.38:0/399604849 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7fb37403ff80 con 0x7fb3780afb40 2020-06-12T17:48:47.272 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:47.273 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.269+0000 7fb37f496700 1 -- 172.21.15.38:0/399604849 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb35804d600 msgr2=0x7fb35804fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:47.273 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.269+0000 7fb37f496700 1 --2- 172.21.15.38:0/399604849 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb35804d600 0x7fb35804fac0 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7fb368007920 tx=0x7fb36800e0a0).stop 2020-06-12T17:48:47.273 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.269+0000 7fb37f496700 1 -- 172.21.15.38:0/399604849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3780afb40 msgr2=0x7fb378144b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:47.274 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.269+0000 7fb37f496700 1 --2- 172.21.15.38:0/399604849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3780afb40 0x7fb378144b70 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7fb378133b90 tx=0x7fb374007e60).stop 2020-06-12T17:48:47.274 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.269+0000 7fb37f496700 1 -- 172.21.15.38:0/399604849 shutdown_connections 2020-06-12T17:48:47.274 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.269+0000 7fb37f496700 1 --2- 172.21.15.38:0/399604849 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb35804d600 0x7fb35804fac0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:47.274 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.269+0000 7fb37f496700 1 --2- 172.21.15.38:0/399604849 >> v2:172.21.15.150:3300/0 conn(0x7fb37805b420 0x7fb37813d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:47.274 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.269+0000 7fb37f496700 1 --2- 172.21.15.38:0/399604849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3780afb40 0x7fb378144b70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:47.275 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.269+0000 7fb37f496700 1 -- 172.21.15.38:0/399604849 >> 172.21.15.38:0/399604849 conn(0x7fb3780b4cc0 msgr2=0x7fb3780b8110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:47.275 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.269+0000 7fb37f496700 1 -- 172.21.15.38:0/399604849 shutdown_connections 2020-06-12T17:48:47.275 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.269+0000 7fb37f496700 1 -- 172.21.15.38:0/399604849 wait complete. 2020-06-12T17:48:47.283 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-12T17:48:47.398 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.395+0000 7fc32d85f700 1 Processor -- start 2020-06-12T17:48:47.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.395+0000 7fc32d85f700 1 -- start start 2020-06-12T17:48:47.401 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.396+0000 7fc32d85f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc32805bf20 0x7fc3280b0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:47.402 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.396+0000 7fc32d85f700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3280b1200 con 0x7fc3280b0ce0 2020-06-12T17:48:47.402 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.396+0000 7fc32d85f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3280b14a0 con 0x7fc3280b2c30 2020-06-12T17:48:47.402 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.396+0000 7fc32d85f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3280b1740 con 0x7fc32805bf20 2020-06-12T17:48:47.402 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.396+0000 7fc327fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc3280b0ce0 0x7fc3281465b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38470/0 (socket says 172.21.15.38:38470) 2020-06-12T17:48:47.403 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.396+0000 7fc327fff700 1 -- 172.21.15.38:0/4291367886 learned_addr learned my addr 172.21.15.38:0/4291367886 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:47.403 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.396+0000 7fc32c85d700 1 --2- 172.21.15.38:0/4291367886 >> v2:172.21.15.150:3300/0 conn(0x7fc32805bf20 0x7fc3280b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:47.403 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.396+0000 7fc3277fe700 1 -- 172.21.15.38:0/4291367886 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2792925828 0 0) 0x7fc3280b1200 con 0x7fc3280b0ce0 2020-06-12T17:48:47.403 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.396+0000 7fc3277fe700 1 -- 172.21.15.38:0/4291367886 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc308003230 con 0x7fc3280b0ce0 2020-06-12T17:48:47.403 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.396+0000 7fc32c85d700 1 -- 172.21.15.38:0/4291367886 >> v1:172.21.15.150:6789/0 conn(0x7fc3280b2c30 legacy=0x7fc3280b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:47.404 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.396+0000 7fc3277fe700 1 -- 172.21.15.38:0/4291367886 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3169358636 0 0) 0x7fc308003230 con 0x7fc3280b0ce0 2020-06-12T17:48:47.404 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.396+0000 7fc32c85d700 1 -- 172.21.15.38:0/4291367886 >> v1:172.21.15.38:6789/0 conn(0x7fc3280b0ce0 legacy=0x7fc3281465b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:47.404 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.396+0000 7fc32c85d700 1 -- 172.21.15.38:0/4291367886 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32805c300 con 0x7fc32805bf20 2020-06-12T17:48:47.404 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.396+0000 7fc32c85d700 1 --2- 172.21.15.38:0/4291367886 >> v2:172.21.15.150:3300/0 conn(0x7fc32805bf20 0x7fc3280b0880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc318001870 tx=0x7fc3200081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.404 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.396+0000 7fc32c85d700 1 --2- 172.21.15.38:0/4291367886 >> v2:172.21.15.150:3300/0 conn(0x7fc32805bf20 0x7fc3280b0880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc318001870 tx=0x7fc3200081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.404 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.397+0000 7fc32c85d700 1 --2- 172.21.15.38:0/4291367886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc32805bf20 0x7fc3280b0880 secure :-1 s=READY pgs=197 cs=0 l=1 rx=0x7fc318001870 tx=0x7fc3200081e0).ready entity=mon.1 client_cookie=f487626576802ecd server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:47.405 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.397+0000 7fc32c85d700 1 --2- 172.21.15.38:0/4291367886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc32805bf20 0x7fc3280b0880 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7fc318001870 tx=0x7fc3200081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.405 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.397+0000 7fc3277fe700 1 -- 172.21.15.38:0/4291367886 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3180016d0 con 0x7fc32805bf20 2020-06-12T17:48:47.405 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.397+0000 7fc32c85d700 1 --2- 172.21.15.38:0/4291367886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc32805bf20 0x7fc3280b0880 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7fc318001870 tx=0x7fc3200081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.405 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.397+0000 7fc3277fe700 1 -- 172.21.15.38:0/4291367886 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3200109d0 con 0x7fc32805bf20 2020-06-12T17:48:47.405 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.397+0000 7fc32c85d700 1 --2- 172.21.15.38:0/4291367886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc32805bf20 0x7fc3280b0880 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7fc318001870 tx=0x7fc3200081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.406 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.397+0000 7fc3277fe700 1 -- 172.21.15.38:0/4291367886 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc320010d30 con 0x7fc32805bf20 2020-06-12T17:48:47.406 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.397+0000 7fc32d85f700 1 -- 172.21.15.38:0/4291367886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc32805bf20 msgr2=0x7fc3280b0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:47.406 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.397+0000 7fc32d85f700 1 --2- 172.21.15.38:0/4291367886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc32805bf20 0x7fc3280b0880 secure :-1 s=READY pgs=197 cs=0 l=1 rx=0x7fc318001870 tx=0x7fc3200081e0).stop 2020-06-12T17:48:47.406 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.397+0000 7fc32d85f700 1 -- 172.21.15.38:0/4291367886 shutdown_connections 2020-06-12T17:48:47.406 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.397+0000 7fc32d85f700 1 --2- 172.21.15.38:0/4291367886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc32805bf20 0x7fc3280b0880 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:47.407 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.397+0000 7fc32d85f700 1 -- 172.21.15.38:0/4291367886 >> 172.21.15.38:0/4291367886 conn(0x7fc3280b8cf0 msgr2=0x7fc3280b4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:47.407 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.397+0000 7fc32d85f700 1 -- 172.21.15.38:0/4291367886 shutdown_connections 2020-06-12T17:48:47.407 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.397+0000 7fc32d85f700 1 -- 172.21.15.38:0/4291367886 wait complete. 2020-06-12T17:48:47.407 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.398+0000 7fc32d85f700 1 Processor -- start 2020-06-12T17:48:47.407 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.398+0000 7fc32d85f700 1 -- start start 2020-06-12T17:48:47.412 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.399+0000 7fc32d85f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3280b2c30 0x7fc328153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:47.412 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.399+0000 7fc32d85f700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc328141470 con 0x7fc3280b0ce0 2020-06-12T17:48:47.412 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.399+0000 7fc32d85f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3281416a0 con 0x7fc32805bf20 2020-06-12T17:48:47.412 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.399+0000 7fc32d85f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc328147f50 con 0x7fc3280b2c30 2020-06-12T17:48:47.412 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.399+0000 7fc327fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc3280b0ce0 0x7fc328147840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38478/0 (socket says 172.21.15.38:38478) 2020-06-12T17:48:47.413 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.399+0000 7fc327fff700 1 -- 172.21.15.38:0/2903424050 learned_addr learned my addr 172.21.15.38:0/2903424050 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:47.413 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.399+0000 7fc32d05e700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3280b2c30 0x7fc328153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:47.413 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.399+0000 7fc325ffb700 1 -- 172.21.15.38:0/2903424050 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3505152157 0 0) 0x7fc328141470 con 0x7fc3280b0ce0 2020-06-12T17:48:47.413 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.399+0000 7fc325ffb700 1 -- 172.21.15.38:0/2903424050 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc30c002fe0 con 0x7fc3280b0ce0 2020-06-12T17:48:47.414 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc325ffb700 1 -- 172.21.15.38:0/2903424050 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243307640 0 0) 0x7fc3281416a0 con 0x7fc32805bf20 2020-06-12T17:48:47.414 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc325ffb700 1 -- 172.21.15.38:0/2903424050 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc328141470 con 0x7fc32805bf20 2020-06-12T17:48:47.415 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc325ffb700 1 -- 172.21.15.38:0/2903424050 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2876644561 0 0) 0x7fc30c002fe0 con 0x7fc3280b0ce0 2020-06-12T17:48:47.415 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc325ffb700 1 -- 172.21.15.38:0/2903424050 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc3281416a0 con 0x7fc3280b0ce0 2020-06-12T17:48:47.415 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc325ffb700 1 -- 172.21.15.38:0/2903424050 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fc3180012b0 con 0x7fc3280b0ce0 2020-06-12T17:48:47.415 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc325ffb700 1 -- 172.21.15.38:0/2903424050 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3280b2c30 msgr2=0x7fc328153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:47.415 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc325ffb700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3280b2c30 0x7fc328153710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:47.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc325ffb700 1 -- 172.21.15.38:0/2903424050 >> v1:172.21.15.150:6789/0 conn(0x7fc32805bf20 legacy=0x7fc328148840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:47.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc325ffb700 1 -- 172.21.15.38:0/2903424050 >> v1:172.21.15.38:6789/0 conn(0x7fc3280b0ce0 legacy=0x7fc328147840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:47.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc325ffb700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc30c004b20 0x7fc30c004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:47.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc325ffb700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc30c003ab0 0x7fc30c003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:47.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc325ffb700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc30c004350 0x7fc30c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:47.417 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc325ffb700 1 -- 172.21.15.38:0/2903424050 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc328147f50 con 0x7fc30c003ab0 2020-06-12T17:48:47.417 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc325ffb700 1 -- 172.21.15.38:0/2903424050 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c00bbb0 con 0x7fc30c004350 2020-06-12T17:48:47.417 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc325ffb700 1 -- 172.21.15.38:0/2903424050 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c00bcf0 con 0x7fc30c004b20 2020-06-12T17:48:47.417 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc32d05e700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3280b2c30 0x7fc328153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:47.417 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc327fff700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc30c003ab0 0x7fc30c003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:47.418 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc32c85d700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc30c004b20 0x7fc30c004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:47.418 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc32d05e700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc30c004350 0x7fc30c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:47.418 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc327fff700 1 -- 172.21.15.38:0/2903424050 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc30c004b20 msgr2=0x7fc30c004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:47.418 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc327fff700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc30c004b20 0x7fc30c004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:47.418 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc327fff700 1 -- 172.21.15.38:0/2903424050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc30c004350 msgr2=0x7fc30c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:47.419 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc327fff700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc30c004350 0x7fc30c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:47.419 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc327fff700 1 -- 172.21.15.38:0/2903424050 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc328141940 con 0x7fc30c003ab0 2020-06-12T17:48:47.419 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc32d05e700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc30c004350 0x7fc30c00b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:47.419 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc32d85f700 1 -- 172.21.15.38:0/2903424050 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc328146ab0 con 0x7fc30c003ab0 2020-06-12T17:48:47.419 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc327fff700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc30c003ab0 0x7fc30c003ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc318001760 tx=0x7fc31800ed40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.419 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc32d85f700 1 -- 172.21.15.38:0/2903424050 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc328153950 con 0x7fc30c003ab0 2020-06-12T17:48:47.420 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc327fff700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc30c003ab0 0x7fc30c003ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc318001760 tx=0x7fc31800ed40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.420 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc327fff700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc30c003ab0 0x7fc30c003ef0 secure :-1 s=READY pgs=290 cs=0 l=1 rx=0x7fc318001760 tx=0x7fc31800ed40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:47.420 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc327fff700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc30c003ab0 0x7fc30c003ef0 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7fc318001760 tx=0x7fc31800ed40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.420 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc325ffb700 1 -- 172.21.15.38:0/2903424050 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc318008580 con 0x7fc30c003ab0 2020-06-12T17:48:47.420 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc327fff700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc30c003ab0 0x7fc30c003ef0 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7fc318001760 tx=0x7fc31800ed40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc325ffb700 1 -- 172.21.15.38:0/2903424050 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc318006ab0 con 0x7fc30c003ab0 2020-06-12T17:48:47.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc327fff700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc30c003ab0 0x7fc30c003ef0 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7fc318001760 tx=0x7fc31800ed40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.400+0000 7fc325ffb700 1 -- 172.21.15.38:0/2903424050 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc318006e90 con 0x7fc30c003ab0 2020-06-12T17:48:47.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.401+0000 7fc327fff700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc30c003ab0 0x7fc30c003ef0 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7fc318001760 tx=0x7fc31800ed40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.401+0000 7fc325ffb700 1 -- 172.21.15.38:0/2903424050 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fc31800a920 con 0x7fc30c003ab0 2020-06-12T17:48:47.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.401+0000 7fc32d85f700 1 -- 172.21.15.38:0/2903424050 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc300003340 con 0x7fc30c003ab0 2020-06-12T17:48:47.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.401+0000 7fc327fff700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc30c003ab0 0x7fc30c003ef0 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7fc318001760 tx=0x7fc31800ed40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.402+0000 7fc325ffb700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc30c056020 0x7fc30c0584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:47.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.402+0000 7fc325ffb700 1 -- 172.21.15.38:0/2903424050 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc318061820 con 0x7fc30c003ab0 2020-06-12T17:48:47.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.402+0000 7fc32c85d700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc30c056020 0x7fc30c0584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:47.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.402+0000 7fc32c85d700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc30c056020 0x7fc30c0584e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc320008840 tx=0x7fc3200081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.402+0000 7fc32c85d700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc30c056020 0x7fc30c0584e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc320008840 tx=0x7fc3200081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.402+0000 7fc32c85d700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc30c056020 0x7fc30c0584e0 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7fc320008840 tx=0x7fc3200081e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:47.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.405+0000 7fc327fff700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc30c003ab0 0x7fc30c003ef0 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7fc318001760 tx=0x7fc31800ed40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.405+0000 7fc325ffb700 1 -- 172.21.15.38:0/2903424050 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fc31803cf60 con 0x7fc30c003ab0 2020-06-12T17:48:47.467 INFO:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-06-12T17:48:47.470 INFO:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-06-12T17:48:47.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.563+0000 7fc32d85f700 1 -- 172.21.15.38:0/2903424050 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3000021d0 con 0x7fc30c003ab0 2020-06-12T17:48:47.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.563+0000 7fc327fff700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc30c003ab0 0x7fc30c003ef0 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7fc318001760 tx=0x7fc31800ed40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.563+0000 7fc325ffb700 1 -- 172.21.15.38:0/2903424050 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16347 (secure 0 0 0) 0x7fc318040580 con 0x7fc30c003ab0 2020-06-12T17:48:47.567 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:47.568 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":24,"fsid":"8e42a2e7-b187-42c4-a73f-8f812ee62352","created":"2020-06-12T17:47:54.434340+0000","modified":"2020-06-12T17:48:14.851712+0000","last_up_change":"2020-06-12T17:48:03.388718+0000","last_in_change":"2020-06-12T17:48:03.388718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-06-12T17:47:57.558119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-06-12T17:48:07.419264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-06-12T17:48:09.934098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-06-12T17:48:12.497229+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"44ac3dea-67b4-4b9a-bc18-ac511710afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":31038},{"type":"v1","addr":"172.21.15.38:6816","nonce":31038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":31038},{"type":"v1","addr":"172.21.15.38:6819","nonce":31038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":31038},{"type":"v1","addr":"172.21.15.38:6823","nonce":31038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":31038},{"type":"v1","addr":"172.21.15.38:6821","nonce":31038}]},"public_addr":"172.21.15.38:6816/31038","cluster_addr":"172.21.15.38:6819/31038","heartbeat_back_addr":"172.21.15.38:6823/31038","heartbeat_front_addr":"172.21.15.38:6821/31038","state":["exists","up"]},{"osd":1,"uuid":"561f7ced-3fff-4364-8619-6e4ecbc9d256","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":31036},{"type":"v1","addr":"172.21.15.38:6801","nonce":31036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":31036},{"type":"v1","addr":"172.21.15.38:6803","nonce":31036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":31036},{"type":"v1","addr":"172.21.15.38:6807","nonce":31036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":31036},{"type":"v1","addr":"172.21.15.38:6805","nonce":31036}]},"public_addr":"172.21.15.38:6801/31036","cluster_addr":"172.21.15.38:6803/31036","heartbeat_back_addr":"172.21.15.38:6807/31036","heartbeat_front_addr":"172.21.15.38:6805/31036","state":["exists","up"]},{"osd":2,"uuid":"0bb3c806-07af-49f5-b492-d0e33f2de37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":31053},{"type":"v1","addr":"172.21.15.38:6825","nonce":31053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":31053},{"type":"v1","addr":"172.21.15.38:6827","nonce":31053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":31053},{"type":"v1","addr":"172.21.15.38:6831","nonce":31053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":31053},{"type":"v1","addr":"172.21.15.38:6829","nonce":31053}]},"public_addr":"172.21.15.38:6825/31053","cluster_addr":"172.21.15.38:6827/31053","heartbeat_back_addr":"172.21.15.38:6831/31053","heartbeat_front_addr":"172.21.15.38:6829/31053","state":["exists","up"]},{"osd":3,"uuid":"7f6a1e75-7b11-456e-8a4b-510b16226800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":31037},{"type":"v1","addr":"172.21.15.38:6809","nonce":31037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":31037},{"type":"v1","addr":"172.21.15.38:6811","nonce":31037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6815","nonce":31037},{"type":"v1","addr":"172.21.15.38:6817","nonce":31037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":31037},{"type":"v1","addr":"172.21.15.38:6813","nonce":31037}]},"public_addr":"172.21.15.38:6809/31037","cluster_addr":"172.21.15.38:6811/31037","heartbeat_back_addr":"172.21.15.38:6817/31037","heartbeat_front_addr":"172.21.15.38:6813/31037","state":["exists","up"]},{"osd":4,"uuid":"0eca0272-8cfd-469c-a32d-e29730dc0e1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":31294},{"type":"v1","addr":"172.21.15.150:6803","nonce":31294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":31294},{"type":"v1","addr":"172.21.15.150:6805","nonce":31294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":31294},{"type":"v1","addr":"172.21.15.150:6809","nonce":31294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":31294},{"type":"v1","addr":"172.21.15.150:6807","nonce":31294}]},"public_addr":"172.21.15.150:6803/31294","cluster_addr":"172.21.15.150:6805/31294","heartbeat_back_addr":"172.21.15.150:6809/31294","heartbeat_front_addr":"172.21.15.150:6807/31294","state":["exists","up"]},{"osd":5,"uuid":"69d6a7dc-a55a-4ebc-8479-8bb921ddfb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":31295},{"type":"v1","addr":"172.21.15.150:6813","nonce":31295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":31295},{"type":"v1","addr":"172.21.15.150:6816","nonce":31295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":31295},{"type":"v1","addr":"172.21.15.150:6828","nonce":31295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6819","nonce":31295},{"type":"v1","addr":"172.21.15.150:6822","nonce":31295}]},"public_addr":"172.21.15.150:6813/31295","cluster_addr":"172.21.15.150:6816/31295","heartbeat_back_addr":"172.21.15.150:6828/31295","heartbeat_front_addr":"172.21.15.150:6822/31295","state":["exists","up"]},{"osd":6,"uuid":"f0d320f8-c2f0-40bb-b713-526246cf97b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":31297},{"type":"v1","addr":"172.21.15.150:6820","nonce":31297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6823","nonce":31297},{"type":"v1","addr":"172.21.15.150:6827","nonce":31297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":31297},{"type":"v1","addr":"172.21.15.150:6833","nonce":31297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":31297},{"type":"v1","addr":"172.21.15.150:6831","nonce":31297}]},"public_addr":"172.21.15.150:6820/31297","cluster_addr":"172.21.15.150:6827/31297","heartbeat_back_addr":"172.21.15.150:6833/31297","heartbeat_front_addr":"172.21.15.150:6831/31297","state":["exists","up"]},{"osd":7,"uuid":"970b7d02-a189-41b2-96e5-a5a5a57c6476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":31296},{"type":"v1","addr":"172.21.15.150:6812","nonce":31296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":31296},{"type":"v1","addr":"172.21.15.150:6818","nonce":31296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":31296},{"type":"v1","addr":"172.21.15.150:6829","nonce":31296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":31296},{"type":"v1","addr":"172.21.15.150:6824","nonce":31296}]},"public_addr":"172.21.15.150:6812/31296","cluster_addr":"172.21.15.150:6818/31296","heartbeat_back_addr":"172.21.15.150:6829/31296","heartbeat_front_addr":"172.21.15.150:6824/31296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.664300+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.644253+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.651120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.584978+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.561149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.661778+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T17:48:47.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.565+0000 7fc32d85f700 1 -- 172.21.15.38:0/2903424050 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc30c056020 msgr2=0x7fc30c0584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:47.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.565+0000 7fc32d85f700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc30c056020 0x7fc30c0584e0 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7fc320008840 tx=0x7fc3200081e0).stop 2020-06-12T17:48:47.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.565+0000 7fc32d85f700 1 -- 172.21.15.38:0/2903424050 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc30c003ab0 msgr2=0x7fc30c003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:47.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.565+0000 7fc32d85f700 1 --2- 172.21.15.38:0/2903424050 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc30c003ab0 0x7fc30c003ef0 secure :-1 s=READY pgs=290 cs=0 l=1 rx=0x7fc318001760 tx=0x7fc31800ed40).stop 2020-06-12T17:48:47.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.565+0000 7fc32d05e700 1 -- 172.21.15.38:0/2903424050 reap_dead start 2020-06-12T17:48:47.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.565+0000 7fc32d05e700 1 -- 172.21.15.38:0/2903424050 reap_dead start 2020-06-12T17:48:47.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.565+0000 7fc32d85f700 1 -- 172.21.15.38:0/2903424050 shutdown_connections 2020-06-12T17:48:47.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.565+0000 7fc32d85f700 1 -- 172.21.15.38:0/2903424050 >> 172.21.15.38:0/2903424050 conn(0x7fc3280b8cf0 msgr2=0x7fc32805ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:47.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.565+0000 7fc32d85f700 1 -- 172.21.15.38:0/2903424050 shutdown_connections 2020-06-12T17:48:47.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.565+0000 7fc32d85f700 1 -- 172.21.15.38:0/2903424050 wait complete. 2020-06-12T17:48:47.579 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-06-12T17:47:57.558119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-06-12T17:48:07.419264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-06-12T17:48:09.934098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-06-12T17:48:12.497229+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-06-12T17:48:47.580 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-06-12T17:48:47.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.733+0000 7f0ee40a0700 1 Processor -- start 2020-06-12T17:48:47.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.733+0000 7f0ee40a0700 1 -- start start 2020-06-12T17:48:47.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.734+0000 7f0ee40a0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0edc0ad5b0 0x7f0edc0b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:47.740 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.734+0000 7f0ee40a0700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0edc09d8d0 0x7f0edc1421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:47.740 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.734+0000 7f0ee40a0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0edc146d20 con 0x7f0edc146680 2020-06-12T17:48:47.740 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.734+0000 7f0ee40a0700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0edc066a80 con 0x7f0edc09d8d0 2020-06-12T17:48:47.740 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.734+0000 7f0ee40a0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc146f50 con 0x7f0edc0ad5b0 2020-06-12T17:48:47.740 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.734+0000 7f0ee263d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0edc09d8d0 0x7f0edc1421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:47.741 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.734+0000 7f0ee263d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0edc09d8d0 0x7f0edc1421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36674/0 (socket says 172.21.15.38:36674) 2020-06-12T17:48:47.741 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.734+0000 7f0ee263d700 1 -- 172.21.15.38:0/1936621524 learned_addr learned my addr 172.21.15.38:0/1936621524 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:47.741 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.734+0000 7f0ee163b700 1 --2- 172.21.15.38:0/1936621524 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0edc0ad5b0 0x7f0edc0b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:47.741 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.734+0000 7f0ee263d700 1 -- 172.21.15.38:0/1936621524 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0edc0ad5b0 msgr2=0x7f0edc0b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:47.741 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.734+0000 7f0ee263d700 1 --2- 172.21.15.38:0/1936621524 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0edc0ad5b0 0x7f0edc0b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:47.742 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.734+0000 7f0ee263d700 1 -- 172.21.15.38:0/1936621524 >> v1:172.21.15.150:6789/0 conn(0x7f0edc146680 legacy=0x7f0edc09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:47.742 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.734+0000 7f0ee263d700 1 -- 172.21.15.38:0/1936621524 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0edc146a60 con 0x7f0edc09d8d0 2020-06-12T17:48:47.742 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.734+0000 7f0ee163b700 1 --2- 172.21.15.38:0/1936621524 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0edc0ad5b0 0x7f0edc0b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:48:47.742 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.734+0000 7f0ee263d700 1 --2- 172.21.15.38:0/1936621524 >> v2:172.21.15.38:3300/0 conn(0x7f0edc09d8d0 0x7f0edc1421d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0edc0ada10 tx=0x7f0ed4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.742 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.734+0000 7f0ee263d700 1 --2- 172.21.15.38:0/1936621524 >> v2:172.21.15.38:3300/0 conn(0x7f0edc09d8d0 0x7f0edc1421d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0edc0ada10 tx=0x7f0ed4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.743 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.734+0000 7f0ee263d700 1 --2- 172.21.15.38:0/1936621524 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0edc09d8d0 0x7f0edc1421d0 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7f0edc0ada10 tx=0x7f0ed4007e60).ready entity=mon.0 client_cookie=8fa91f879207d292 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:47.743 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.735+0000 7f0ee263d700 1 --2- 172.21.15.38:0/1936621524 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0edc09d8d0 0x7f0edc1421d0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f0edc0ada10 tx=0x7f0ed4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.743 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.735+0000 7f0ee0e3a700 1 -- 172.21.15.38:0/1936621524 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ed40116a0 con 0x7f0edc09d8d0 2020-06-12T17:48:47.743 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.735+0000 7f0ee263d700 1 --2- 172.21.15.38:0/1936621524 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0edc09d8d0 0x7f0edc1421d0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f0edc0ada10 tx=0x7f0ed4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.743 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.735+0000 7f0ee263d700 1 --2- 172.21.15.38:0/1936621524 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0edc09d8d0 0x7f0edc1421d0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f0edc0ada10 tx=0x7f0ed4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.744 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.735+0000 7f0ee0e3a700 1 -- 172.21.15.38:0/1936621524 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed4011800 con 0x7f0edc09d8d0 2020-06-12T17:48:47.744 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.735+0000 7f0ee0e3a700 1 -- 172.21.15.38:0/1936621524 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ed4011c20 con 0x7f0edc09d8d0 2020-06-12T17:48:47.744 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.735+0000 7f0ee40a0700 1 -- 172.21.15.38:0/1936621524 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0edc09d8d0 msgr2=0x7f0edc1421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:47.744 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.735+0000 7f0ee40a0700 1 --2- 172.21.15.38:0/1936621524 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0edc09d8d0 0x7f0edc1421d0 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7f0edc0ada10 tx=0x7f0ed4007e60).stop 2020-06-12T17:48:47.744 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.735+0000 7f0ee40a0700 1 -- 172.21.15.38:0/1936621524 shutdown_connections 2020-06-12T17:48:47.745 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.735+0000 7f0ee40a0700 1 --2- 172.21.15.38:0/1936621524 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0edc09d8d0 0x7f0edc1421d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:47.745 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.735+0000 7f0ee40a0700 1 --2- 172.21.15.38:0/1936621524 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0edc0ad5b0 0x7f0edc0b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:47.745 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.735+0000 7f0ee40a0700 1 -- 172.21.15.38:0/1936621524 >> 172.21.15.38:0/1936621524 conn(0x7f0edc0b5a20 msgr2=0x7f0edc05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:47.745 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.735+0000 7f0ee40a0700 1 -- 172.21.15.38:0/1936621524 shutdown_connections 2020-06-12T17:48:47.745 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.735+0000 7f0ee40a0700 1 -- 172.21.15.38:0/1936621524 wait complete. 2020-06-12T17:48:47.746 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.736+0000 7f0ee40a0700 1 Processor -- start 2020-06-12T17:48:47.746 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.736+0000 7f0ee40a0700 1 -- start start 2020-06-12T17:48:47.750 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.737+0000 7f0ee40a0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0edc0ad5b0 0x7f0edc142da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:47.756 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.737+0000 7f0ee40a0700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0edc08fa20 con 0x7f0edc146680 2020-06-12T17:48:47.756 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.737+0000 7f0ee40a0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0edc139750 con 0x7f0edc09d8d0 2020-06-12T17:48:47.756 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.737+0000 7f0ee40a0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0edc1399f0 con 0x7f0edc0ad5b0 2020-06-12T17:48:47.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.737+0000 7f0ee263d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f0edc146680 0x7f0edc151160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38500/0 (socket says 172.21.15.38:38500) 2020-06-12T17:48:47.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.737+0000 7f0ee263d700 1 -- 172.21.15.38:0/2219170443 learned_addr learned my addr 172.21.15.38:0/2219170443 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:47.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.737+0000 7f0ee163b700 1 --2- 172.21.15.38:0/2219170443 >> v2:172.21.15.150:3300/0 conn(0x7f0edc0ad5b0 0x7f0edc142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:47.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.737+0000 7f0ecaffd700 1 -- 172.21.15.38:0/2219170443 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525974865 0 0) 0x7f0edc08fa20 con 0x7f0edc146680 2020-06-12T17:48:47.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.737+0000 7f0ecaffd700 1 -- 172.21.15.38:0/2219170443 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ebc002fe0 con 0x7f0edc146680 2020-06-12T17:48:47.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.737+0000 7f0ecaffd700 1 -- 172.21.15.38:0/2219170443 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 463689623 0 0) 0x7f0ebc002fe0 con 0x7f0edc146680 2020-06-12T17:48:47.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.737+0000 7f0ecaffd700 1 -- 172.21.15.38:0/2219170443 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0edc08fa20 con 0x7f0edc146680 2020-06-12T17:48:47.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.737+0000 7f0ecaffd700 1 -- 172.21.15.38:0/2219170443 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f0ed40085c0 con 0x7f0edc146680 2020-06-12T17:48:47.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.737+0000 7f0ecaffd700 1 -- 172.21.15.38:0/2219170443 >> v2:172.21.15.150:3300/0 conn(0x7f0edc0ad5b0 msgr2=0x7f0edc142da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:47.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.737+0000 7f0ecaffd700 1 --2- 172.21.15.38:0/2219170443 >> v2:172.21.15.150:3300/0 conn(0x7f0edc0ad5b0 0x7f0edc142da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:47.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ecaffd700 1 -- 172.21.15.38:0/2219170443 >> v1:172.21.15.150:6789/0 conn(0x7f0edc09d8d0 legacy=0x7f0edc142690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:47.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ecaffd700 1 -- 172.21.15.38:0/2219170443 >> v1:172.21.15.38:6789/0 conn(0x7f0edc146680 legacy=0x7f0edc151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:47.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ecaffd700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ebc0049b0 0x7f0ebc004df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:47.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ecaffd700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ebc003920 0x7f0ebc003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:47.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ecaffd700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ebc0041c0 0x7f0ebc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:47.760 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ecaffd700 1 -- 172.21.15.38:0/2219170443 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc1399f0 con 0x7f0ebc003920 2020-06-12T17:48:47.760 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ecaffd700 1 -- 172.21.15.38:0/2219170443 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc00bbb0 con 0x7f0ebc0049b0 2020-06-12T17:48:47.760 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ecaffd700 1 -- 172.21.15.38:0/2219170443 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc00bcf0 con 0x7f0ebc0041c0 2020-06-12T17:48:47.760 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ee163b700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ebc003920 0x7f0ebc003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:47.760 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ee1e3c700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ebc0049b0 0x7f0ebc004df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:47.760 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ee263d700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ebc0041c0 0x7f0ebc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:47.761 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ee163b700 1 -- 172.21.15.38:0/2219170443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ebc0041c0 msgr2=0x7f0ebc00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:47.761 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ee163b700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ebc0041c0 0x7f0ebc00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:47.761 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ee163b700 1 -- 172.21.15.38:0/2219170443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ebc0049b0 msgr2=0x7f0ebc004df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:47.761 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ee163b700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ebc0049b0 0x7f0ebc004df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:47.761 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ee163b700 1 -- 172.21.15.38:0/2219170443 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0edc139c90 con 0x7f0ebc003920 2020-06-12T17:48:47.762 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ee40a0700 1 -- 172.21.15.38:0/2219170443 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0edc0b1d20 con 0x7f0ebc003920 2020-06-12T17:48:47.762 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ee263d700 1 -- 172.21.15.38:0/2219170443 reap_dead start 2020-06-12T17:48:47.762 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ee163b700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ebc003920 0x7f0ebc003d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0ed80032b0 tx=0x7f0ed800e360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.762 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ee40a0700 1 -- 172.21.15.38:0/2219170443 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0edc139140 con 0x7f0ebc003920 2020-06-12T17:48:47.762 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ee163b700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ebc003920 0x7f0ebc003d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0ed80032b0 tx=0x7f0ed800e360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.763 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ee163b700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ebc003920 0x7f0ebc003d60 secure :-1 s=READY pgs=293 cs=0 l=1 rx=0x7f0ed80032b0 tx=0x7f0ed800e360).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:47.763 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ee163b700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ebc003920 0x7f0ebc003d60 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7f0ed80032b0 tx=0x7f0ed800e360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.763 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ee163b700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ebc003920 0x7f0ebc003d60 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7f0ed80032b0 tx=0x7f0ed800e360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.763 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ee163b700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ebc003920 0x7f0ebc003d60 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7f0ed80032b0 tx=0x7f0ed800e360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.763 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ecaffd700 1 -- 172.21.15.38:0/2219170443 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ed8011e30 con 0x7f0ebc003920 2020-06-12T17:48:47.764 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ecaffd700 1 -- 172.21.15.38:0/2219170443 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed8005a40 con 0x7f0ebc003920 2020-06-12T17:48:47.764 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.738+0000 7f0ecaffd700 1 -- 172.21.15.38:0/2219170443 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ed8005e20 con 0x7f0ebc003920 2020-06-12T17:48:47.764 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.739+0000 7f0ee163b700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ebc003920 0x7f0ebc003d60 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7f0ed80032b0 tx=0x7f0ed800e360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.764 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.739+0000 7f0ee40a0700 1 -- 172.21.15.38:0/2219170443 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb8003340 con 0x7f0ebc003920 2020-06-12T17:48:47.764 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.739+0000 7f0ecaffd700 1 -- 172.21.15.38:0/2219170443 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f0ed8007180 con 0x7f0ebc003920 2020-06-12T17:48:47.765 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.739+0000 7f0ee163b700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ebc003920 0x7f0ebc003d60 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7f0ed80032b0 tx=0x7f0ed800e360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.765 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.740+0000 7f0ecaffd700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0ebc0515f0 0x7f0ebc053ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:47.765 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.740+0000 7f0ecaffd700 1 -- 172.21.15.38:0/2219170443 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f0ed8061030 con 0x7f0ebc003920 2020-06-12T17:48:47.765 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.740+0000 7f0ee1e3c700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0ebc0515f0 0x7f0ebc053ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:47.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.740+0000 7f0ee1e3c700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0ebc0515f0 0x7f0ebc053ab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0edc066240 tx=0x7f0ecc007db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.740+0000 7f0ee1e3c700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0ebc0515f0 0x7f0ebc053ab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0edc066240 tx=0x7f0ecc007db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.740+0000 7f0ee1e3c700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0ebc0515f0 0x7f0ebc053ab0 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7f0edc066240 tx=0x7f0ecc007db0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:47.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.743+0000 7f0ee163b700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ebc003920 0x7f0ebc003d60 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7f0ed80032b0 tx=0x7f0ed800e360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.743+0000 7f0ecaffd700 1 -- 172.21.15.38:0/2219170443 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f0ed803c7f0 con 0x7f0ebc003920 2020-06-12T17:48:47.898 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.894+0000 7f0ee40a0700 1 -- 172.21.15.38:0/2219170443 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0eb8002220 con 0x7f0ebc003920 2020-06-12T17:48:47.898 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.894+0000 7f0ee163b700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ebc003920 0x7f0ebc003d60 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7f0ed80032b0 tx=0x7f0ed800e360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:47.898 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.894+0000 7f0ecaffd700 1 -- 172.21.15.38:0/2219170443 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0ed803fe10 con 0x7f0ebc003920 2020-06-12T17:48:47.899 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2020-06-12T17:48:47.900 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.896+0000 7f0ee40a0700 1 -- 172.21.15.38:0/2219170443 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0ebc0515f0 msgr2=0x7f0ebc053ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:47.900 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.896+0000 7f0ee40a0700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0ebc0515f0 0x7f0ebc053ab0 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7f0edc066240 tx=0x7f0ecc007db0).stop 2020-06-12T17:48:47.900 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.896+0000 7f0ee40a0700 1 -- 172.21.15.38:0/2219170443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ebc003920 msgr2=0x7f0ebc003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:47.900 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.896+0000 7f0ee40a0700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ebc003920 0x7f0ebc003d60 secure :-1 s=READY pgs=293 cs=0 l=1 rx=0x7f0ed80032b0 tx=0x7f0ed800e360).stop 2020-06-12T17:48:47.900 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.896+0000 7f0ee40a0700 1 -- 172.21.15.38:0/2219170443 shutdown_connections 2020-06-12T17:48:47.901 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.896+0000 7f0ee40a0700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0ebc0515f0 0x7f0ebc053ab0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:47.901 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.896+0000 7f0ee40a0700 1 --2- 172.21.15.38:0/2219170443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ebc003920 0x7f0ebc003d60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:47.901 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.896+0000 7f0ee40a0700 1 -- 172.21.15.38:0/2219170443 >> 172.21.15.38:0/2219170443 conn(0x7f0edc0b5a20 msgr2=0x7f0edc1458f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:47.901 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.896+0000 7f0ee40a0700 1 -- 172.21.15.38:0/2219170443 shutdown_connections 2020-06-12T17:48:47.901 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:47.896+0000 7f0ee40a0700 1 -- 172.21.15.38:0/2219170443 wait complete. 2020-06-12T17:48:47.909 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-06-12T17:48:48.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.023+0000 7ff7c8f67700 1 Processor -- start 2020-06-12T17:48:48.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.023+0000 7ff7c8f67700 1 -- start start 2020-06-12T17:48:48.029 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.024+0000 7ff7c8f67700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff7c40ad5b0 0x7ff7c40b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:48.029 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.024+0000 7ff7c8f67700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff7c409d8d0 0x7ff7c41421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:48.030 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.024+0000 7ff7c8f67700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c4146d20 con 0x7ff7c4146680 2020-06-12T17:48:48.030 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.024+0000 7ff7c8f67700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c4066a80 con 0x7ff7c409d8d0 2020-06-12T17:48:48.030 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.024+0000 7ff7c8f67700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c4146f50 con 0x7ff7c40ad5b0 2020-06-12T17:48:48.030 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.024+0000 7ff7c2d9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff7c409d8d0 0x7ff7c41421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:48.030 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.024+0000 7ff7c2d9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff7c409d8d0 0x7ff7c41421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36694/0 (socket says 172.21.15.38:36694) 2020-06-12T17:48:48.031 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.024+0000 7ff7c2d9d700 1 -- 172.21.15.38:0/1125989974 learned_addr learned my addr 172.21.15.38:0/1125989974 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:48.031 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.024+0000 7ff7c1d9b700 1 --2- 172.21.15.38:0/1125989974 >> v2:172.21.15.150:3300/0 conn(0x7ff7c40ad5b0 0x7ff7c40b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:48.031 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.024+0000 7ff7c2d9d700 1 -- 172.21.15.38:0/1125989974 >> v2:172.21.15.150:3300/0 conn(0x7ff7c40ad5b0 msgr2=0x7ff7c40b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:48.031 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.024+0000 7ff7c2d9d700 1 --2- 172.21.15.38:0/1125989974 >> v2:172.21.15.150:3300/0 conn(0x7ff7c40ad5b0 0x7ff7c40b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:48.031 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.024+0000 7ff7c2d9d700 1 -- 172.21.15.38:0/1125989974 >> v1:172.21.15.150:6789/0 conn(0x7ff7c4146680 legacy=0x7ff7c409d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.024+0000 7ff7c2d9d700 1 -- 172.21.15.38:0/1125989974 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c4146a60 con 0x7ff7c409d8d0 2020-06-12T17:48:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.024+0000 7ff7c2d9d700 1 --2- 172.21.15.38:0/1125989974 >> v2:172.21.15.38:3300/0 conn(0x7ff7c409d8d0 0x7ff7c41421d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff7c4061380 tx=0x7ff7bc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.024+0000 7ff7c2d9d700 1 --2- 172.21.15.38:0/1125989974 >> v2:172.21.15.38:3300/0 conn(0x7ff7c409d8d0 0x7ff7c41421d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff7c4061380 tx=0x7ff7bc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.024+0000 7ff7c2d9d700 1 --2- 172.21.15.38:0/1125989974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7c409d8d0 0x7ff7c41421d0 secure :-1 s=READY pgs=294 cs=0 l=1 rx=0x7ff7c4061380 tx=0x7ff7bc0081e0).ready entity=mon.0 client_cookie=8b8bc6c55d20e046 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.025+0000 7ff7c2d9d700 1 --2- 172.21.15.38:0/1125989974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7c409d8d0 0x7ff7c41421d0 secure :-1 s=THROTTLE_DONE pgs=294 cs=0 l=1 rx=0x7ff7c4061380 tx=0x7ff7bc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.033 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.025+0000 7ff7c159a700 1 -- 172.21.15.38:0/1125989974 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7bc00a160 con 0x7ff7c409d8d0 2020-06-12T17:48:48.033 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.025+0000 7ff7c2d9d700 1 --2- 172.21.15.38:0/1125989974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7c409d8d0 0x7ff7c41421d0 secure :-1 s=THROTTLE_DONE pgs=294 cs=0 l=1 rx=0x7ff7c4061380 tx=0x7ff7bc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.033 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.025+0000 7ff7c2d9d700 1 --2- 172.21.15.38:0/1125989974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7c409d8d0 0x7ff7c41421d0 secure :-1 s=THROTTLE_DONE pgs=294 cs=0 l=1 rx=0x7ff7c4061380 tx=0x7ff7bc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.033 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.025+0000 7ff7c159a700 1 -- 172.21.15.38:0/1125989974 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc00a2c0 con 0x7ff7c409d8d0 2020-06-12T17:48:48.033 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.025+0000 7ff7c159a700 1 -- 172.21.15.38:0/1125989974 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7bc00a6a0 con 0x7ff7c409d8d0 2020-06-12T17:48:48.034 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.025+0000 7ff7c8f67700 1 -- 172.21.15.38:0/1125989974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7c409d8d0 msgr2=0x7ff7c41421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:48.034 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.025+0000 7ff7c8f67700 1 --2- 172.21.15.38:0/1125989974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7c409d8d0 0x7ff7c41421d0 secure :-1 s=READY pgs=294 cs=0 l=1 rx=0x7ff7c4061380 tx=0x7ff7bc0081e0).stop 2020-06-12T17:48:48.034 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.025+0000 7ff7c8f67700 1 -- 172.21.15.38:0/1125989974 shutdown_connections 2020-06-12T17:48:48.034 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.025+0000 7ff7c8f67700 1 --2- 172.21.15.38:0/1125989974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7c409d8d0 0x7ff7c41421d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:48.034 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.025+0000 7ff7c8f67700 1 --2- 172.21.15.38:0/1125989974 >> v2:172.21.15.150:3300/0 conn(0x7ff7c40ad5b0 0x7ff7c40b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:48.034 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.025+0000 7ff7c8f67700 1 -- 172.21.15.38:0/1125989974 >> 172.21.15.38:0/1125989974 conn(0x7ff7c40b5a20 msgr2=0x7ff7c405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:48.035 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.025+0000 7ff7c8f67700 1 -- 172.21.15.38:0/1125989974 shutdown_connections 2020-06-12T17:48:48.035 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.025+0000 7ff7c8f67700 1 -- 172.21.15.38:0/1125989974 wait complete. 2020-06-12T17:48:48.038 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.026+0000 7ff7c8f67700 1 Processor -- start 2020-06-12T17:48:48.038 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.026+0000 7ff7c8f67700 1 -- start start 2020-06-12T17:48:48.038 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.027+0000 7ff7c8f67700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff7c40ad5b0 0x7ff7c41404f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:48.039 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.027+0000 7ff7c8f67700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7c4146680 0x7ff7c4140950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:48.039 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.027+0000 7ff7c8f67700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c4065470 con 0x7ff7c409d8d0 2020-06-12T17:48:48.039 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.027+0000 7ff7c8f67700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c4065260 con 0x7ff7c40ad5b0 2020-06-12T17:48:48.039 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.027+0000 7ff7c8f67700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c40b2490 con 0x7ff7c4146680 2020-06-12T17:48:48.039 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.027+0000 7ff7c1d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff7c40ad5b0 0x7ff7c41404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:48.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.027+0000 7ff7c259c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff7c409d8d0 0x7ff7c4061890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38514/0 (socket says 172.21.15.38:38514) 2020-06-12T17:48:48.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.027+0000 7ff7c259c700 1 -- 172.21.15.38:0/2726827273 learned_addr learned my addr 172.21.15.38:0/2726827273 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:48.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.027+0000 7ff7c2d9d700 1 --2- 172.21.15.38:0/2726827273 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7c4146680 0x7ff7c4140950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:48.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.027+0000 7ff7c1d9b700 1 -- 172.21.15.38:0/2726827273 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7c4146680 msgr2=0x7ff7c4140950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:48.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.027+0000 7ff7c1d9b700 1 --2- 172.21.15.38:0/2726827273 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7c4146680 0x7ff7c4140950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:48.041 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.027+0000 7ff7c1d9b700 1 -- 172.21.15.38:0/2726827273 >> v1:172.21.15.38:6789/0 conn(0x7ff7c409d8d0 legacy=0x7ff7c4061890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:48.041 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.027+0000 7ff7b37fe700 1 -- 172.21.15.38:0/2726827273 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3131184729 0 0) 0x7ff7c4065470 con 0x7ff7c409d8d0 2020-06-12T17:48:48.041 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.027+0000 7ff7c1d9b700 1 -- 172.21.15.38:0/2726827273 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c4064e50 con 0x7ff7c40ad5b0 2020-06-12T17:48:48.041 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.027+0000 7ff7c1d9b700 1 --2- 172.21.15.38:0/2726827273 >> v2:172.21.15.38:3300/0 conn(0x7ff7c40ad5b0 0x7ff7c41404f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff7b4002f30 tx=0x7ff7b400e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.041 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.027+0000 7ff7c1d9b700 1 --2- 172.21.15.38:0/2726827273 >> v2:172.21.15.38:3300/0 conn(0x7ff7c40ad5b0 0x7ff7c41404f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff7b4002f30 tx=0x7ff7b400e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.042 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.027+0000 7ff7c1d9b700 1 --2- 172.21.15.38:0/2726827273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7c40ad5b0 0x7ff7c41404f0 secure :-1 s=READY pgs=296 cs=0 l=1 rx=0x7ff7b4002f30 tx=0x7ff7b400e150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:48.042 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.028+0000 7ff7c1d9b700 1 --2- 172.21.15.38:0/2726827273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7c40ad5b0 0x7ff7c41404f0 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7ff7b4002f30 tx=0x7ff7b400e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.042 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.028+0000 7ff7c1d9b700 1 --2- 172.21.15.38:0/2726827273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7c40ad5b0 0x7ff7c41404f0 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7ff7b4002f30 tx=0x7ff7b400e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.042 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.028+0000 7ff7b37fe700 1 -- 172.21.15.38:0/2726827273 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7b4005e90 con 0x7ff7c40ad5b0 2020-06-12T17:48:48.042 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.028+0000 7ff7c1d9b700 1 --2- 172.21.15.38:0/2726827273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7c40ad5b0 0x7ff7c41404f0 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7ff7b4002f30 tx=0x7ff7b400e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.043 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.028+0000 7ff7b37fe700 1 -- 172.21.15.38:0/2726827273 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b4007160 con 0x7ff7c40ad5b0 2020-06-12T17:48:48.043 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.028+0000 7ff7c8f67700 1 -- 172.21.15.38:0/2726827273 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c4140db0 con 0x7ff7c40ad5b0 2020-06-12T17:48:48.043 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.028+0000 7ff7b37fe700 1 -- 172.21.15.38:0/2726827273 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7b4007540 con 0x7ff7c40ad5b0 2020-06-12T17:48:48.043 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.028+0000 7ff7c8f67700 1 -- 172.21.15.38:0/2726827273 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c4061fa0 con 0x7ff7c40ad5b0 2020-06-12T17:48:48.043 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.028+0000 7ff7c1d9b700 1 --2- 172.21.15.38:0/2726827273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7c40ad5b0 0x7ff7c41404f0 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7ff7b4002f30 tx=0x7ff7b400e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.044 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.029+0000 7ff7b37fe700 1 -- 172.21.15.38:0/2726827273 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7ff7b4013060 con 0x7ff7c40ad5b0 2020-06-12T17:48:48.044 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.029+0000 7ff7c1d9b700 1 --2- 172.21.15.38:0/2726827273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7c40ad5b0 0x7ff7c41404f0 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7ff7b4002f30 tx=0x7ff7b400e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.044 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.029+0000 7ff7c8f67700 1 -- 172.21.15.38:0/2726827273 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c4065040 con 0x7ff7c40ad5b0 2020-06-12T17:48:48.044 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.029+0000 7ff7b37fe700 1 --2- 172.21.15.38:0/2726827273 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff7a004d530 0x7ff7a004f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:48.044 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.029+0000 7ff7b37fe700 1 -- 172.21.15.38:0/2726827273 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff7b4060f60 con 0x7ff7c40ad5b0 2020-06-12T17:48:48.045 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.029+0000 7ff7c259c700 1 --2- 172.21.15.38:0/2726827273 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff7a004d530 0x7ff7a004f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:48.045 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.029+0000 7ff7c259c700 1 --2- 172.21.15.38:0/2726827273 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff7a004d530 0x7ff7a004f9f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff7b8002260 tx=0x7ff7b8002660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.045 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.030+0000 7ff7c259c700 1 --2- 172.21.15.38:0/2726827273 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff7a004d530 0x7ff7a004f9f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff7b8002260 tx=0x7ff7b8002660).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.045 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.030+0000 7ff7c259c700 1 --2- 172.21.15.38:0/2726827273 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff7a004d530 0x7ff7a004f9f0 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7ff7b8002260 tx=0x7ff7b8002660).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:48.045 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.032+0000 7ff7c1d9b700 1 --2- 172.21.15.38:0/2726827273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7c40ad5b0 0x7ff7c41404f0 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7ff7b4002f30 tx=0x7ff7b400e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.046 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.032+0000 7ff7b37fe700 1 -- 172.21.15.38:0/2726827273 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7ff7b403c780 con 0x7ff7c40ad5b0 2020-06-12T17:48:48.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.183+0000 7ff7c8f67700 1 -- 172.21.15.38:0/2726827273 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff7c4056c30 con 0x7ff7c40ad5b0 2020-06-12T17:48:48.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.183+0000 7ff7c1d9b700 1 --2- 172.21.15.38:0/2726827273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7c40ad5b0 0x7ff7c41404f0 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7ff7b4002f30 tx=0x7ff7b400e150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.183+0000 7ff7b37fe700 1 -- 172.21.15.38:0/2726827273 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff7b400a0e0 con 0x7ff7c40ad5b0 2020-06-12T17:48:48.187 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:48.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.184+0000 7ff7c8f67700 1 -- 172.21.15.38:0/2726827273 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff7a004d530 msgr2=0x7ff7a004f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:48.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.184+0000 7ff7c8f67700 1 --2- 172.21.15.38:0/2726827273 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff7a004d530 0x7ff7a004f9f0 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7ff7b8002260 tx=0x7ff7b8002660).stop 2020-06-12T17:48:48.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.184+0000 7ff7c8f67700 1 -- 172.21.15.38:0/2726827273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7c40ad5b0 msgr2=0x7ff7c41404f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:48.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.184+0000 7ff7c8f67700 1 --2- 172.21.15.38:0/2726827273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7c40ad5b0 0x7ff7c41404f0 secure :-1 s=READY pgs=296 cs=0 l=1 rx=0x7ff7b4002f30 tx=0x7ff7b400e150).stop 2020-06-12T17:48:48.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.184+0000 7ff7c8f67700 1 -- 172.21.15.38:0/2726827273 shutdown_connections 2020-06-12T17:48:48.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.184+0000 7ff7c8f67700 1 --2- 172.21.15.38:0/2726827273 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff7a004d530 0x7ff7a004f9f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:48.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.184+0000 7ff7c8f67700 1 --2- 172.21.15.38:0/2726827273 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7c4146680 0x7ff7c4140950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:48.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.184+0000 7ff7c8f67700 1 --2- 172.21.15.38:0/2726827273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7c40ad5b0 0x7ff7c41404f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:48.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.184+0000 7ff7c8f67700 1 -- 172.21.15.38:0/2726827273 >> 172.21.15.38:0/2726827273 conn(0x7ff7c40b5a20 msgr2=0x7ff7c4143df0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:48.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.184+0000 7ff7c8f67700 1 -- 172.21.15.38:0/2726827273 shutdown_connections 2020-06-12T17:48:48.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.184+0000 7ff7c8f67700 1 -- 172.21.15.38:0/2726827273 wait complete. 2020-06-12T17:48:48.198 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-06-12T17:48:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.312+0000 7f54cddaf700 1 Processor -- start 2020-06-12T17:48:48.316 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.312+0000 7f54cddaf700 1 -- start start 2020-06-12T17:48:48.318 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.313+0000 7f54cddaf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f54c80a2460 0x7f54c80a2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:48.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.313+0000 7f54cddaf700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c805f7a0 con 0x7f54c8146060 2020-06-12T17:48:48.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.313+0000 7f54cddaf700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c805fa40 con 0x7f54c813fc90 2020-06-12T17:48:48.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.313+0000 7f54cddaf700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c805f2b0 con 0x7f54c80a2460 2020-06-12T17:48:48.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.313+0000 7f54bffff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f54c8146060 0x7f54c809d8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38524/0 (socket says 172.21.15.38:38524) 2020-06-12T17:48:48.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.313+0000 7f54bffff700 1 -- 172.21.15.38:0/1414437385 learned_addr learned my addr 172.21.15.38:0/1414437385 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:48.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.313+0000 7f54c77fe700 1 --2- 172.21.15.38:0/1414437385 >> v2:172.21.15.150:3300/0 conn(0x7f54c80a2460 0x7f54c80a2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:48.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.313+0000 7f54c6ffd700 1 -- 172.21.15.38:0/1414437385 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1773563395 0 0) 0x7f54c805f7a0 con 0x7f54c8146060 2020-06-12T17:48:48.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.313+0000 7f54c6ffd700 1 -- 172.21.15.38:0/1414437385 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54a8003230 con 0x7f54c8146060 2020-06-12T17:48:48.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.313+0000 7f54c77fe700 1 -- 172.21.15.38:0/1414437385 >> v1:172.21.15.150:6789/0 conn(0x7f54c813fc90 legacy=0x7f54c805fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:48.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.313+0000 7f54c77fe700 1 -- 172.21.15.38:0/1414437385 >> v1:172.21.15.38:6789/0 conn(0x7f54c8146060 legacy=0x7f54c809d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:48.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.313+0000 7f54c6ffd700 1 -- 172.21.15.38:0/1414437385 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2529101603 0 0) 0x7f54a8003230 con 0x7f54c8146060 2020-06-12T17:48:48.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.313+0000 7f54c77fe700 1 -- 172.21.15.38:0/1414437385 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c809dfc0 con 0x7f54c80a2460 2020-06-12T17:48:48.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.313+0000 7f54c77fe700 1 --2- 172.21.15.38:0/1414437385 >> v2:172.21.15.150:3300/0 conn(0x7f54c80a2460 0x7f54c80a2840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f54b0001870 tx=0x7f54b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.314+0000 7f54c77fe700 1 --2- 172.21.15.38:0/1414437385 >> v2:172.21.15.150:3300/0 conn(0x7f54c80a2460 0x7f54c80a2840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f54b0001870 tx=0x7f54b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.314+0000 7f54c77fe700 1 --2- 172.21.15.38:0/1414437385 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54c80a2460 0x7f54c80a2840 secure :-1 s=READY pgs=203 cs=0 l=1 rx=0x7f54b0001870 tx=0x7f54b8007e60).ready entity=mon.1 client_cookie=da65f8abcfbd563b server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:48.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.314+0000 7f54c77fe700 1 --2- 172.21.15.38:0/1414437385 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54c80a2460 0x7f54c80a2840 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7f54b0001870 tx=0x7f54b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.314+0000 7f54c6ffd700 1 -- 172.21.15.38:0/1414437385 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54b00016d0 con 0x7f54c80a2460 2020-06-12T17:48:48.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.314+0000 7f54c77fe700 1 --2- 172.21.15.38:0/1414437385 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54c80a2460 0x7f54c80a2840 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7f54b0001870 tx=0x7f54b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.314+0000 7f54c77fe700 1 --2- 172.21.15.38:0/1414437385 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54c80a2460 0x7f54c80a2840 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7f54b0001870 tx=0x7f54b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.323 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.314+0000 7f54c6ffd700 1 -- 172.21.15.38:0/1414437385 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b8008cb0 con 0x7f54c80a2460 2020-06-12T17:48:48.323 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.314+0000 7f54c6ffd700 1 -- 172.21.15.38:0/1414437385 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54b8008e20 con 0x7f54c80a2460 2020-06-12T17:48:48.323 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.314+0000 7f54cddaf700 1 -- 172.21.15.38:0/1414437385 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54c80a2460 msgr2=0x7f54c80a2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:48.323 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.314+0000 7f54cddaf700 1 --2- 172.21.15.38:0/1414437385 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54c80a2460 0x7f54c80a2840 secure :-1 s=READY pgs=203 cs=0 l=1 rx=0x7f54b0001870 tx=0x7f54b8007e60).stop 2020-06-12T17:48:48.323 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.314+0000 7f54cddaf700 1 -- 172.21.15.38:0/1414437385 shutdown_connections 2020-06-12T17:48:48.323 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.314+0000 7f54cddaf700 1 --2- 172.21.15.38:0/1414437385 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54c80a2460 0x7f54c80a2840 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:48.324 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.314+0000 7f54cddaf700 1 -- 172.21.15.38:0/1414437385 >> 172.21.15.38:0/1414437385 conn(0x7f54c805b450 msgr2=0x7f54c805b860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:48.324 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.314+0000 7f54cddaf700 1 -- 172.21.15.38:0/1414437385 shutdown_connections 2020-06-12T17:48:48.324 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.314+0000 7f54cddaf700 1 -- 172.21.15.38:0/1414437385 wait complete. 2020-06-12T17:48:48.324 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.315+0000 7f54cddaf700 1 Processor -- start 2020-06-12T17:48:48.324 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.315+0000 7f54cddaf700 1 -- start start 2020-06-12T17:48:48.327 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.316+0000 7f54cddaf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54c80a2460 0x7f54c813b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:48.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.316+0000 7f54cddaf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f54c8146060 0x7f54c8143810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:48.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.316+0000 7f54cddaf700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c813d360 con 0x7f54c813fc90 2020-06-12T17:48:48.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.316+0000 7f54cddaf700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c813d600 con 0x7f54c8146060 2020-06-12T17:48:48.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.316+0000 7f54cddaf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c813d8a0 con 0x7f54c80a2460 2020-06-12T17:48:48.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.316+0000 7f54c77fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54c80a2460 0x7f54c813b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:48.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.316+0000 7f54c7fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f54c8146060 0x7f54c8143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:48.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.316+0000 7f54c77fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54c80a2460 0x7f54c813b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:56170/0 (socket says 172.21.15.38:56170) 2020-06-12T17:48:48.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.316+0000 7f54c77fe700 1 -- 172.21.15.38:0/1937759054 learned_addr learned my addr 172.21.15.38:0/1937759054 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:48.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.317+0000 7f54c77fe700 1 -- 172.21.15.38:0/1937759054 >> v2:172.21.15.150:3300/0 conn(0x7f54c8146060 msgr2=0x7f54c8143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:48.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.317+0000 7f54c77fe700 1 --2- 172.21.15.38:0/1937759054 >> v2:172.21.15.150:3300/0 conn(0x7f54c8146060 0x7f54c8143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:48.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.317+0000 7f54c77fe700 1 -- 172.21.15.38:0/1937759054 >> v1:172.21.15.150:6789/0 conn(0x7f54c813fc90 legacy=0x7f54c813cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:48.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.317+0000 7f54c77fe700 1 -- 172.21.15.38:0/1937759054 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c813b840 con 0x7f54c80a2460 2020-06-12T17:48:48.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.317+0000 7f54c57fa700 1 -- 172.21.15.38:0/1937759054 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1372834905 0 0) 0x7f54c813d360 con 0x7f54c813fc90 2020-06-12T17:48:48.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.317+0000 7f54c7fff700 1 --2- 172.21.15.38:0/1937759054 >> v2:172.21.15.150:3300/0 conn(0x7f54c8146060 0x7f54c8143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:48.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.317+0000 7f54c77fe700 1 --2- 172.21.15.38:0/1937759054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54c80a2460 0x7f54c813b3e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f54b0001870 tx=0x7f54b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.317+0000 7f54c77fe700 1 --2- 172.21.15.38:0/1937759054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54c80a2460 0x7f54c813b3e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f54b0001870 tx=0x7f54b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.317+0000 7f54c77fe700 1 --2- 172.21.15.38:0/1937759054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54c80a2460 0x7f54c813b3e0 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f54b0001870 tx=0x7f54b8007e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:48.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.317+0000 7f54c77fe700 1 --2- 172.21.15.38:0/1937759054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54c80a2460 0x7f54c813b3e0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f54b0001870 tx=0x7f54b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.317+0000 7f54c57fa700 1 -- 172.21.15.38:0/1937759054 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54b8007350 con 0x7f54c80a2460 2020-06-12T17:48:48.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.317+0000 7f54c77fe700 1 --2- 172.21.15.38:0/1937759054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54c80a2460 0x7f54c813b3e0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f54b0001870 tx=0x7f54b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.317+0000 7f54c57fa700 1 -- 172.21.15.38:0/1937759054 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b80074b0 con 0x7f54c80a2460 2020-06-12T17:48:48.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.317+0000 7f54c77fe700 1 --2- 172.21.15.38:0/1937759054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54c80a2460 0x7f54c813b3e0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f54b0001870 tx=0x7f54b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.317+0000 7f54cddaf700 1 -- 172.21.15.38:0/1937759054 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c8140cf0 con 0x7f54c80a2460 2020-06-12T17:48:48.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.317+0000 7f54c57fa700 1 -- 172.21.15.38:0/1937759054 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54b8011b10 con 0x7f54c80a2460 2020-06-12T17:48:48.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.317+0000 7f54cddaf700 1 -- 172.21.15.38:0/1937759054 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c8147120 con 0x7f54c80a2460 2020-06-12T17:48:48.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.318+0000 7f54c77fe700 1 --2- 172.21.15.38:0/1937759054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54c80a2460 0x7f54c813b3e0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f54b0001870 tx=0x7f54b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.318+0000 7f54cddaf700 1 -- 172.21.15.38:0/1937759054 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c8056c30 con 0x7f54c80a2460 2020-06-12T17:48:48.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.319+0000 7f54c57fa700 1 -- 172.21.15.38:0/1937759054 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f54b8012060 con 0x7f54c80a2460 2020-06-12T17:48:48.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.319+0000 7f54c77fe700 1 --2- 172.21.15.38:0/1937759054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54c80a2460 0x7f54c813b3e0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f54b0001870 tx=0x7f54b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.319+0000 7f54c57fa700 1 --2- 172.21.15.38:0/1937759054 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f54ac04d440 0x7f54ac04f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:48.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.319+0000 7f54c57fa700 1 -- 172.21.15.38:0/1937759054 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f54b8061740 con 0x7f54c80a2460 2020-06-12T17:48:48.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.319+0000 7f54bffff700 1 --2- 172.21.15.38:0/1937759054 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f54ac04d440 0x7f54ac04f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:48.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.320+0000 7f54bffff700 1 --2- 172.21.15.38:0/1937759054 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f54ac04d440 0x7f54ac04f900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f54b00018b0 tx=0x7f54b0001dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.320+0000 7f54bffff700 1 --2- 172.21.15.38:0/1937759054 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f54ac04d440 0x7f54ac04f900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f54b00018b0 tx=0x7f54b0001dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.320+0000 7f54bffff700 1 --2- 172.21.15.38:0/1937759054 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f54ac04d440 0x7f54ac04f900 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7f54b00018b0 tx=0x7f54b0001dc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:48.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.323+0000 7f54c77fe700 1 --2- 172.21.15.38:0/1937759054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54c80a2460 0x7f54c813b3e0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f54b0001870 tx=0x7f54b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.323+0000 7f54c57fa700 1 -- 172.21.15.38:0/1937759054 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f54b803cf40 con 0x7f54c80a2460 2020-06-12T17:48:48.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.478+0000 7f54cddaf700 1 -- 172.21.15.38:0/1937759054 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f54c8145ae0 con 0x7f54c80a2460 2020-06-12T17:48:48.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.479+0000 7f54c77fe700 1 --2- 172.21.15.38:0/1937759054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54c80a2460 0x7f54c813b3e0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f54b0001870 tx=0x7f54b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.479+0000 7f54c57fa700 1 -- 172.21.15.38:0/1937759054 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f54b8040560 con 0x7f54c80a2460 2020-06-12T17:48:48.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.480+0000 7f54cddaf700 1 -- 172.21.15.38:0/1937759054 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f54ac04d440 msgr2=0x7f54ac04f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:48.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.480+0000 7f54cddaf700 1 --2- 172.21.15.38:0/1937759054 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f54ac04d440 0x7f54ac04f900 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7f54b00018b0 tx=0x7f54b0001dc0).stop 2020-06-12T17:48:48.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.480+0000 7f54cddaf700 1 -- 172.21.15.38:0/1937759054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54c80a2460 msgr2=0x7f54c813b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:48.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.480+0000 7f54cddaf700 1 --2- 172.21.15.38:0/1937759054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54c80a2460 0x7f54c813b3e0 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f54b0001870 tx=0x7f54b8007e60).stop 2020-06-12T17:48:48.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.481+0000 7f54cddaf700 1 -- 172.21.15.38:0/1937759054 shutdown_connections 2020-06-12T17:48:48.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.481+0000 7f54cddaf700 1 --2- 172.21.15.38:0/1937759054 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f54ac04d440 0x7f54ac04f900 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:48.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.481+0000 7f54cddaf700 1 --2- 172.21.15.38:0/1937759054 >> v2:172.21.15.150:3300/0 conn(0x7f54c8146060 0x7f54c8143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:48.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.481+0000 7f54cddaf700 1 --2- 172.21.15.38:0/1937759054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54c80a2460 0x7f54c813b3e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:48.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.481+0000 7f54cddaf700 1 -- 172.21.15.38:0/1937759054 >> 172.21.15.38:0/1937759054 conn(0x7f54c805b450 msgr2=0x7f54c806a440 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:48.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.481+0000 7f54cddaf700 1 -- 172.21.15.38:0/1937759054 shutdown_connections 2020-06-12T17:48:48.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.481+0000 7f54cddaf700 1 -- 172.21.15.38:0/1937759054 wait complete. 2020-06-12T17:48:48.490 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:48.494 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-06-12T17:48:48.611 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.608+0000 7f949f1cb700 1 Processor -- start 2020-06-12T17:48:48.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.608+0000 7f949f1cb700 1 -- start start 2020-06-12T17:48:48.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.609+0000 7f949f1cb700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f94980b2820 0x7f94980b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:48.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.609+0000 7f949f1cb700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9498146400 con 0x7f949809e400 2020-06-12T17:48:48.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.609+0000 7f949f1cb700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94981466a0 con 0x7f9498140300 2020-06-12T17:48:48.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.609+0000 7f949f1cb700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f949809c7c0 con 0x7f94980b2820 2020-06-12T17:48:48.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.609+0000 7f949d768700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f94980b2820 0x7f94980b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:48.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.609+0000 7f9497fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f949809e400 0x7f94980b2eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38538/0 (socket says 172.21.15.38:38538) 2020-06-12T17:48:48.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.609+0000 7f9497fff700 1 -- 172.21.15.38:0/2742718412 learned_addr learned my addr 172.21.15.38:0/2742718412 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:48.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.609+0000 7f949d768700 1 -- 172.21.15.38:0/2742718412 >> v1:172.21.15.150:6789/0 conn(0x7f9498140300 legacy=0x7f94980b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:48.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.609+0000 7f949d768700 1 -- 172.21.15.38:0/2742718412 >> v1:172.21.15.38:6789/0 conn(0x7f949809e400 legacy=0x7f94980b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:48.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.609+0000 7f94977fe700 1 -- 172.21.15.38:0/2742718412 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 669708246 0 0) 0x7f9498146400 con 0x7f949809e400 2020-06-12T17:48:48.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.609+0000 7f949d768700 1 -- 172.21.15.38:0/2742718412 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9498146940 con 0x7f94980b2820 2020-06-12T17:48:48.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.609+0000 7f949d768700 1 --2- 172.21.15.38:0/2742718412 >> v2:172.21.15.38:3300/0 conn(0x7f94980b2820 0x7f94980b35c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f949809d950 tx=0x7f94900081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.609+0000 7f949d768700 1 --2- 172.21.15.38:0/2742718412 >> v2:172.21.15.38:3300/0 conn(0x7f94980b2820 0x7f94980b35c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f949809d950 tx=0x7f94900081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.609+0000 7f949d768700 1 --2- 172.21.15.38:0/2742718412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94980b2820 0x7f94980b35c0 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7f949809d950 tx=0x7f94900081e0).ready entity=mon.0 client_cookie=5fd4523a59751d4e server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:48.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.609+0000 7f949d768700 1 --2- 172.21.15.38:0/2742718412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94980b2820 0x7f94980b35c0 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f949809d950 tx=0x7f94900081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.609+0000 7f94977fe700 1 -- 172.21.15.38:0/2742718412 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9490011e50 con 0x7f94980b2820 2020-06-12T17:48:48.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.609+0000 7f949d768700 1 --2- 172.21.15.38:0/2742718412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94980b2820 0x7f94980b35c0 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f949809d950 tx=0x7f94900081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.609+0000 7f94977fe700 1 -- 172.21.15.38:0/2742718412 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949000a160 con 0x7f94980b2820 2020-06-12T17:48:48.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.609+0000 7f949d768700 1 --2- 172.21.15.38:0/2742718412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94980b2820 0x7f94980b35c0 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f949809d950 tx=0x7f94900081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.609+0000 7f94977fe700 1 -- 172.21.15.38:0/2742718412 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f949000a540 con 0x7f94980b2820 2020-06-12T17:48:48.622 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.609+0000 7f949f1cb700 1 -- 172.21.15.38:0/2742718412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94980b2820 msgr2=0x7f94980b35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:48.622 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.609+0000 7f949f1cb700 1 --2- 172.21.15.38:0/2742718412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94980b2820 0x7f94980b35c0 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7f949809d950 tx=0x7f94900081e0).stop 2020-06-12T17:48:48.623 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.610+0000 7f949f1cb700 1 -- 172.21.15.38:0/2742718412 shutdown_connections 2020-06-12T17:48:48.623 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.610+0000 7f949f1cb700 1 --2- 172.21.15.38:0/2742718412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94980b2820 0x7f94980b35c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:48.623 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.610+0000 7f949f1cb700 1 -- 172.21.15.38:0/2742718412 >> 172.21.15.38:0/2742718412 conn(0x7f94980b5a20 msgr2=0x7f949805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:48.623 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.610+0000 7f949f1cb700 1 -- 172.21.15.38:0/2742718412 shutdown_connections 2020-06-12T17:48:48.623 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.610+0000 7f949f1cb700 1 -- 172.21.15.38:0/2742718412 wait complete. 2020-06-12T17:48:48.624 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.611+0000 7f949f1cb700 1 Processor -- start 2020-06-12T17:48:48.624 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.611+0000 7f949f1cb700 1 -- start start 2020-06-12T17:48:48.625 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.612+0000 7f949f1cb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94980b2820 0x7f9498066840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:48.625 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.612+0000 7f949f1cb700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9498066e70 con 0x7f949809e400 2020-06-12T17:48:48.625 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.612+0000 7f949f1cb700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9498143ee0 con 0x7f9498140300 2020-06-12T17:48:48.625 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.612+0000 7f949f1cb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9498144180 con 0x7f94980b2820 2020-06-12T17:48:48.625 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.612+0000 7f949cf67700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f949809e400 0x7f949813f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38542/0 (socket says 172.21.15.38:38542) 2020-06-12T17:48:48.626 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.612+0000 7f949cf67700 1 -- 172.21.15.38:0/3889168871 learned_addr learned my addr 172.21.15.38:0/3889168871 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:48.626 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.612+0000 7f9497fff700 1 --2- 172.21.15.38:0/3889168871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94980b2820 0x7f9498066840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:48.626 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.612+0000 7f9495ffb700 1 -- 172.21.15.38:0/3889168871 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3253259319 0 0) 0x7f9498066e70 con 0x7f949809e400 2020-06-12T17:48:48.626 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.612+0000 7f9495ffb700 1 -- 172.21.15.38:0/3889168871 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9480002fe0 con 0x7f949809e400 2020-06-12T17:48:48.626 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.612+0000 7f9495ffb700 1 -- 172.21.15.38:0/3889168871 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229079649 0 0) 0x7f9498143ee0 con 0x7f9498140300 2020-06-12T17:48:48.627 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.612+0000 7f9495ffb700 1 -- 172.21.15.38:0/3889168871 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9498066e70 con 0x7f9498140300 2020-06-12T17:48:48.627 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.612+0000 7f9495ffb700 1 -- 172.21.15.38:0/3889168871 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1727727009 0 0) 0x7f9480002fe0 con 0x7f949809e400 2020-06-12T17:48:48.627 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.612+0000 7f9495ffb700 1 -- 172.21.15.38:0/3889168871 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9498143ee0 con 0x7f949809e400 2020-06-12T17:48:48.627 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.612+0000 7f9495ffb700 1 -- 172.21.15.38:0/3889168871 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f948c002910 con 0x7f949809e400 2020-06-12T17:48:48.627 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.612+0000 7f9497fff700 1 -- 172.21.15.38:0/3889168871 >> v1:172.21.15.150:6789/0 conn(0x7f9498140300 legacy=0x7f9498144620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:48.628 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.612+0000 7f9497fff700 1 -- 172.21.15.38:0/3889168871 >> v1:172.21.15.38:6789/0 conn(0x7f949809e400 legacy=0x7f949813f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:48.628 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.612+0000 7f9497fff700 1 -- 172.21.15.38:0/3889168871 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949813fc10 con 0x7f94980b2820 2020-06-12T17:48:48.628 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.613+0000 7f9497fff700 1 --2- 172.21.15.38:0/3889168871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94980b2820 0x7f9498066840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9484000b80 tx=0x7f94840016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.628 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.613+0000 7f9497fff700 1 --2- 172.21.15.38:0/3889168871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94980b2820 0x7f9498066840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9484000b80 tx=0x7f94840016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.628 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.613+0000 7f9497fff700 1 --2- 172.21.15.38:0/3889168871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94980b2820 0x7f9498066840 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f9484000b80 tx=0x7f94840016e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:48.629 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.613+0000 7f9497fff700 1 --2- 172.21.15.38:0/3889168871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94980b2820 0x7f9498066840 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f9484000b80 tx=0x7f94840016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.629 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.613+0000 7f9495ffb700 1 -- 172.21.15.38:0/3889168871 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9484005a90 con 0x7f94980b2820 2020-06-12T17:48:48.629 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.613+0000 7f9497fff700 1 --2- 172.21.15.38:0/3889168871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94980b2820 0x7f9498066840 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f9484000b80 tx=0x7f94840016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.629 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.613+0000 7f9495ffb700 1 -- 172.21.15.38:0/3889168871 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9484005bf0 con 0x7f94980b2820 2020-06-12T17:48:48.629 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.613+0000 7f9497fff700 1 --2- 172.21.15.38:0/3889168871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94980b2820 0x7f9498066840 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f9484000b80 tx=0x7f94840016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.613+0000 7f949f1cb700 1 -- 172.21.15.38:0/3889168871 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9498141260 con 0x7f94980b2820 2020-06-12T17:48:48.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.613+0000 7f9495ffb700 1 -- 172.21.15.38:0/3889168871 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94840060c0 con 0x7f94980b2820 2020-06-12T17:48:48.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.613+0000 7f949f1cb700 1 -- 172.21.15.38:0/3889168871 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9498142de0 con 0x7f94980b2820 2020-06-12T17:48:48.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.614+0000 7f9497fff700 1 --2- 172.21.15.38:0/3889168871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94980b2820 0x7f9498066840 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f9484000b80 tx=0x7f94840016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.614+0000 7f949f1cb700 1 -- 172.21.15.38:0/3889168871 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9498066ca0 con 0x7f94980b2820 2020-06-12T17:48:48.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.614+0000 7f9495ffb700 1 -- 172.21.15.38:0/3889168871 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f948400a320 con 0x7f94980b2820 2020-06-12T17:48:48.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.614+0000 7f9497fff700 1 --2- 172.21.15.38:0/3889168871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94980b2820 0x7f9498066840 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f9484000b80 tx=0x7f94840016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.632 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.614+0000 7f9495ffb700 1 --2- 172.21.15.38:0/3889168871 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f948004dcd0 0x7f9480050190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:48.632 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.614+0000 7f9495ffb700 1 -- 172.21.15.38:0/3889168871 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f9484060b50 con 0x7f94980b2820 2020-06-12T17:48:48.632 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.615+0000 7f949cf67700 1 --2- 172.21.15.38:0/3889168871 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f948004dcd0 0x7f9480050190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:48.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.615+0000 7f949cf67700 1 --2- 172.21.15.38:0/3889168871 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f948004dcd0 0x7f9480050190 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f948c0026e0 tx=0x7f948c002dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.615+0000 7f949cf67700 1 --2- 172.21.15.38:0/3889168871 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f948004dcd0 0x7f9480050190 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f948c0026e0 tx=0x7f948c002dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.615+0000 7f949cf67700 1 --2- 172.21.15.38:0/3889168871 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f948004dcd0 0x7f9480050190 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7f948c0026e0 tx=0x7f948c002dd0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:48.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.618+0000 7f9497fff700 1 --2- 172.21.15.38:0/3889168871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94980b2820 0x7f9498066840 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f9484000b80 tx=0x7f94840016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.618+0000 7f9495ffb700 1 -- 172.21.15.38:0/3889168871 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f9484064e60 con 0x7f94980b2820 2020-06-12T17:48:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.768+0000 7f949f1cb700 1 -- 172.21.15.38:0/3889168871 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f949813fda0 con 0x7f94980b2820 2020-06-12T17:48:48.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.768+0000 7f9497fff700 1 --2- 172.21.15.38:0/3889168871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94980b2820 0x7f9498066840 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f9484000b80 tx=0x7f94840016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:48.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.769+0000 7f9495ffb700 1 -- 172.21.15.38:0/3889168871 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f949813fda0 con 0x7f94980b2820 2020-06-12T17:48:48.772 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:48.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.770+0000 7f949f1cb700 1 -- 172.21.15.38:0/3889168871 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f948004dcd0 msgr2=0x7f9480050190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:48.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.770+0000 7f949f1cb700 1 --2- 172.21.15.38:0/3889168871 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f948004dcd0 0x7f9480050190 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7f948c0026e0 tx=0x7f948c002dd0).stop 2020-06-12T17:48:48.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.770+0000 7f949f1cb700 1 -- 172.21.15.38:0/3889168871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94980b2820 msgr2=0x7f9498066840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:48.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.770+0000 7f949f1cb700 1 --2- 172.21.15.38:0/3889168871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94980b2820 0x7f9498066840 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f9484000b80 tx=0x7f94840016e0).stop 2020-06-12T17:48:48.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.770+0000 7f949f1cb700 1 -- 172.21.15.38:0/3889168871 shutdown_connections 2020-06-12T17:48:48.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.770+0000 7f949f1cb700 1 --2- 172.21.15.38:0/3889168871 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f948004dcd0 0x7f9480050190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:48.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.770+0000 7f949f1cb700 1 --2- 172.21.15.38:0/3889168871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94980b2820 0x7f9498066840 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:48.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.770+0000 7f949f1cb700 1 -- 172.21.15.38:0/3889168871 >> 172.21.15.38:0/3889168871 conn(0x7f94980b5a20 msgr2=0x7f9498145ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:48.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.770+0000 7f949f1cb700 1 -- 172.21.15.38:0/3889168871 shutdown_connections 2020-06-12T17:48:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.770+0000 7f949f1cb700 1 -- 172.21.15.38:0/3889168871 wait complete. 2020-06-12T17:48:48.880 INFO:tasks.cephfs_test_runner:Starting test: test_async_subvolume_rm (tasks.cephfs.test_volumes.TestVolumes) 2020-06-12T17:48:48.882 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_async_subvolume_rm' 2020-06-12T17:48:48.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.995+0000 7f64762e6700 1 Processor -- start 2020-06-12T17:48:48.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.995+0000 7f64762e6700 1 -- start start 2020-06-12T17:48:49.001 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.996+0000 7f64762e6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6470061a80 0x7f647009bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:49.002 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.996+0000 7f64762e6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64700b44a0 0x7f64701427e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:49.002 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.996+0000 7f64762e6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64700b2dc0 con 0x7f6470142350 2020-06-12T17:48:49.002 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.996+0000 7f64762e6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6470142c40 con 0x7f6470061a80 2020-06-12T17:48:49.002 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.996+0000 7f64762e6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647009e560 con 0x7f64700b44a0 2020-06-12T17:48:49.002 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.996+0000 7f646ffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6470061a80 0x7f647009bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:49.003 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.996+0000 7f6474883700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64700b44a0 0x7f64701427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:49.003 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.996+0000 7f646ffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6470061a80 0x7f647009bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:46210/0 (socket says 172.21.15.38:46210) 2020-06-12T17:48:49.003 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.996+0000 7f6474883700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64700b44a0 0x7f64701427e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:56196/0 (socket says 172.21.15.38:56196) 2020-06-12T17:48:49.003 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.996+0000 7f646ffff700 1 -- 172.21.15.38:0/4069238818 learned_addr learned my addr 172.21.15.38:0/4069238818 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:49.003 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.996+0000 7f646f7fe700 1 --1- 172.21.15.38:0/4069238818 >> v1:172.21.15.150:6789/0 conn(0x7f6470142350 0x7f6470146380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:59284/0 (socket says 172.21.15.38:59284) 2020-06-12T17:48:49.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.996+0000 7f6474883700 1 -- 172.21.15.38:0/4069238818 >> v2:172.21.15.150:3300/0 conn(0x7f6470061a80 msgr2=0x7f647009bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:49.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.996+0000 7f6474883700 1 --2- 172.21.15.38:0/4069238818 >> v2:172.21.15.150:3300/0 conn(0x7f6470061a80 0x7f647009bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:49.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.996+0000 7f6474883700 1 -- 172.21.15.38:0/4069238818 >> v1:172.21.15.150:6789/0 conn(0x7f6470142350 legacy=0x7f6470146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:49.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.996+0000 7f6474883700 1 -- 172.21.15.38:0/4069238818 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64700b29d0 con 0x7f64700b44a0 2020-06-12T17:48:49.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.996+0000 7f646ffff700 1 --2- 172.21.15.38:0/4069238818 >> v2:172.21.15.150:3300/0 conn(0x7f6470061a80 0x7f647009bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:49.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.996+0000 7f6474883700 1 --2- 172.21.15.38:0/4069238818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64700b44a0 0x7f64701427e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f64680032b0 tx=0x7f64680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:49.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.996+0000 7f6474883700 1 --2- 172.21.15.38:0/4069238818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64700b44a0 0x7f64701427e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f64680032b0 tx=0x7f64680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:49.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.996+0000 7f6474883700 1 --2- 172.21.15.38:0/4069238818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64700b44a0 0x7f64701427e0 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f64680032b0 tx=0x7f64680081e0).ready entity=mon.2 client_cookie=ad96f3d4ec6b39d2 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:49.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.997+0000 7f6474883700 1 --2- 172.21.15.38:0/4069238818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64700b44a0 0x7f64701427e0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f64680032b0 tx=0x7f64680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:49.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.997+0000 7f646effd700 1 -- 172.21.15.38:0/4069238818 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f646800c160 con 0x7f64700b44a0 2020-06-12T17:48:49.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.997+0000 7f6474883700 1 --2- 172.21.15.38:0/4069238818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64700b44a0 0x7f64701427e0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f64680032b0 tx=0x7f64680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:49.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.997+0000 7f6474883700 1 --2- 172.21.15.38:0/4069238818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64700b44a0 0x7f64701427e0 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f64680032b0 tx=0x7f64680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:49.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.997+0000 7f646effd700 1 -- 172.21.15.38:0/4069238818 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646800c2c0 con 0x7f64700b44a0 2020-06-12T17:48:49.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.997+0000 7f646effd700 1 -- 172.21.15.38:0/4069238818 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f646800c6e0 con 0x7f64700b44a0 2020-06-12T17:48:49.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.997+0000 7f64762e6700 1 -- 172.21.15.38:0/4069238818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64700b44a0 msgr2=0x7f64701427e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:49.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.997+0000 7f64762e6700 1 --2- 172.21.15.38:0/4069238818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64700b44a0 0x7f64701427e0 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f64680032b0 tx=0x7f64680081e0).stop 2020-06-12T17:48:49.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.997+0000 7f64762e6700 1 -- 172.21.15.38:0/4069238818 shutdown_connections 2020-06-12T17:48:49.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.997+0000 7f64762e6700 1 --2- 172.21.15.38:0/4069238818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64700b44a0 0x7f64701427e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:49.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.997+0000 7f64762e6700 1 --2- 172.21.15.38:0/4069238818 >> v2:172.21.15.150:3300/0 conn(0x7f6470061a80 0x7f647009bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:49.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.997+0000 7f64762e6700 1 -- 172.21.15.38:0/4069238818 >> 172.21.15.38:0/4069238818 conn(0x7f64700b8420 msgr2=0x7f64700b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:49.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.997+0000 7f64762e6700 1 -- 172.21.15.38:0/4069238818 shutdown_connections 2020-06-12T17:48:49.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.997+0000 7f64762e6700 1 -- 172.21.15.38:0/4069238818 wait complete. 2020-06-12T17:48:49.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.998+0000 7f64762e6700 1 Processor -- start 2020-06-12T17:48:49.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.998+0000 7f64762e6700 1 -- start start 2020-06-12T17:48:49.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.999+0000 7f64762e6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6470061a80 0x7f647005aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:49.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.999+0000 7f64762e6700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6470142350 0x7f64701408b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:49.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.999+0000 7f64762e6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647005b320 con 0x7f64700b44a0 2020-06-12T17:48:49.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.999+0000 7f64762e6700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64700aed90 con 0x7f6470142350 2020-06-12T17:48:49.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.999+0000 7f64762e6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6470066350 con 0x7f6470061a80 2020-06-12T17:48:49.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.999+0000 7f6474883700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6470142350 0x7f64701408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:49.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.999+0000 7f6474883700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6470142350 0x7f64701408b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36744/0 (socket says 172.21.15.38:36744) 2020-06-12T17:48:49.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.999+0000 7f6474883700 1 -- 172.21.15.38:0/2353990634 learned_addr learned my addr 172.21.15.38:0/2353990634 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:49.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.999+0000 7f646ffff700 1 --2- 172.21.15.38:0/2353990634 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6470061a80 0x7f647005aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:49.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.999+0000 7f6474883700 1 -- 172.21.15.38:0/2353990634 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6470061a80 msgr2=0x7f647005aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:49.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.999+0000 7f6474883700 1 --2- 172.21.15.38:0/2353990634 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6470061a80 0x7f647005aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:49.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.999+0000 7f6474883700 1 -- 172.21.15.38:0/2353990634 >> v1:172.21.15.150:6789/0 conn(0x7f64700b44a0 legacy=0x7f6470065990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:49.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.999+0000 7f6474883700 1 -- 172.21.15.38:0/2353990634 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64700aef80 con 0x7f6470142350 2020-06-12T17:48:49.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.999+0000 7f6474883700 1 --2- 172.21.15.38:0/2353990634 >> v2:172.21.15.38:3300/0 conn(0x7f6470142350 0x7f64701408b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f64680032b0 tx=0x7f64680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:49.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.999+0000 7f6474883700 1 --2- 172.21.15.38:0/2353990634 >> v2:172.21.15.38:3300/0 conn(0x7f6470142350 0x7f64701408b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f64680032b0 tx=0x7f64680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:49.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:48.999+0000 7f6474883700 1 --2- 172.21.15.38:0/2353990634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6470142350 0x7f64701408b0 secure :-1 s=READY pgs=301 cs=0 l=1 rx=0x7f64680032b0 tx=0x7f64680081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:49.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.000+0000 7f6474883700 1 --2- 172.21.15.38:0/2353990634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6470142350 0x7f64701408b0 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f64680032b0 tx=0x7f64680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:49.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.000+0000 7f646d7fa700 1 -- 172.21.15.38:0/2353990634 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6468005c30 con 0x7f6470142350 2020-06-12T17:48:49.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.000+0000 7f6474883700 1 --2- 172.21.15.38:0/2353990634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6470142350 0x7f64701408b0 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f64680032b0 tx=0x7f64680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:49.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.000+0000 7f6474883700 1 --2- 172.21.15.38:0/2353990634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6470142350 0x7f64701408b0 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f64680032b0 tx=0x7f64680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:49.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.000+0000 7f646d7fa700 1 -- 172.21.15.38:0/2353990634 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6468005d90 con 0x7f6470142350 2020-06-12T17:48:49.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.000+0000 7f64762e6700 1 -- 172.21.15.38:0/2353990634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64700660a0 con 0x7f6470142350 2020-06-12T17:48:49.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.000+0000 7f646d7fa700 1 -- 172.21.15.38:0/2353990634 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6468007340 con 0x7f6470142350 2020-06-12T17:48:49.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.000+0000 7f64762e6700 1 -- 172.21.15.38:0/2353990634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64700649d0 con 0x7f6470142350 2020-06-12T17:48:49.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.000+0000 7f6474883700 1 --2- 172.21.15.38:0/2353990634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6470142350 0x7f64701408b0 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f64680032b0 tx=0x7f64680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:49.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.001+0000 7f64762e6700 1 -- 172.21.15.38:0/2353990634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6470056c30 con 0x7f6470142350 2020-06-12T17:48:49.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.001+0000 7f646d7fa700 1 -- 172.21.15.38:0/2353990634 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f64680075b0 con 0x7f6470142350 2020-06-12T17:48:49.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.001+0000 7f6474883700 1 --2- 172.21.15.38:0/2353990634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6470142350 0x7f64701408b0 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f64680032b0 tx=0x7f64680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:49.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.001+0000 7f646d7fa700 1 --2- 172.21.15.38:0/2353990634 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f645004d640 0x7f645004fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:49.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.001+0000 7f646d7fa700 1 -- 172.21.15.38:0/2353990634 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f6468063a40 con 0x7f6470142350 2020-06-12T17:48:49.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.001+0000 7f646ffff700 1 --2- 172.21.15.38:0/2353990634 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f645004d640 0x7f645004fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:49.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.001+0000 7f646ffff700 1 --2- 172.21.15.38:0/2353990634 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f645004d640 0x7f645004fb00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6460002f30 tx=0x7f6460007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:49.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.002+0000 7f646ffff700 1 --2- 172.21.15.38:0/2353990634 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f645004d640 0x7f645004fb00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6460002f30 tx=0x7f6460007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:49.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.002+0000 7f646ffff700 1 --2- 172.21.15.38:0/2353990634 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f645004d640 0x7f645004fb00 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f6460002f30 tx=0x7f6460007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:49.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.004+0000 7f6474883700 1 --2- 172.21.15.38:0/2353990634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6470142350 0x7f64701408b0 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f64680032b0 tx=0x7f64680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:49.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.005+0000 7f646d7fa700 1 -- 172.21.15.38:0/2353990634 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f646803f260 con 0x7f6470142350 2020-06-12T17:48:49.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.209+0000 7f64762e6700 1 -- 172.21.15.38:0/2353990634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_async_subvolume_rm"]} v 0) v1 -- 0x7f647005a5e0 con 0x7f6470142350 2020-06-12T17:48:49.316 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.312+0000 7f6474883700 1 --2- 172.21.15.38:0/2353990634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6470142350 0x7f64701408b0 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f64680032b0 tx=0x7f64680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:49.316 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.312+0000 7f646d7fa700 1 -- 172.21.15.38:0/2353990634 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_async_subvolume_rm"]}]=0 v53) v1 ==== 143+0+0 (secure 0 0 0) 0x7f6468042880 con 0x7f6470142350 2020-06-12T17:48:49.318 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.314+0000 7f64762e6700 1 -- 172.21.15.38:0/2353990634 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f645004d640 msgr2=0x7f645004fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:49.318 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.314+0000 7f64762e6700 1 --2- 172.21.15.38:0/2353990634 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f645004d640 0x7f645004fb00 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7f6460002f30 tx=0x7f6460007e60).stop 2020-06-12T17:48:49.318 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.314+0000 7f64762e6700 1 -- 172.21.15.38:0/2353990634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6470142350 msgr2=0x7f64701408b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:49.318 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.314+0000 7f64762e6700 1 --2- 172.21.15.38:0/2353990634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6470142350 0x7f64701408b0 secure :-1 s=READY pgs=301 cs=0 l=1 rx=0x7f64680032b0 tx=0x7f64680081e0).stop 2020-06-12T17:48:49.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.314+0000 7f64762e6700 1 -- 172.21.15.38:0/2353990634 shutdown_connections 2020-06-12T17:48:49.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.314+0000 7f64762e6700 1 --2- 172.21.15.38:0/2353990634 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f645004d640 0x7f645004fb00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:49.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.314+0000 7f64762e6700 1 --2- 172.21.15.38:0/2353990634 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6470061a80 0x7f647005aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:49.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.314+0000 7f64762e6700 1 --2- 172.21.15.38:0/2353990634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6470142350 0x7f64701408b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:49.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.314+0000 7f64762e6700 1 -- 172.21.15.38:0/2353990634 >> 172.21.15.38:0/2353990634 conn(0x7f64700b8420 msgr2=0x7f6470066d10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:49.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.314+0000 7f64762e6700 1 -- 172.21.15.38:0/2353990634 shutdown_connections 2020-06-12T17:48:49.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:49.314+0000 7f64762e6700 1 -- 172.21.15.38:0/2353990634 wait complete. 2020-06-12T17:48:49.328 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-06-12T17:48:49.329 INFO:teuthology.orchestra.run.smithi038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-06-12T17:48:49.396 INFO:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-06-12T17:48:49.467 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-06-12T17:48:49.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:49.468 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:48:49.468 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:48:49.484 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:48:49.485 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:48:49.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:49.486 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:48:49.486 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:48:49.539 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:48:49.539 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:48:49.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:49.541 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:48:49.541 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:48:49.594 INFO:teuthology.orchestra.run.smithi038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2020-06-12T17:48:49.595 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-06-12T17:48:49.595 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2020-06-12T17:48:49.596 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi038.front.sepia.ceph.com... 2020-06-12T17:48:49.596 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-06-12T17:48:49.597 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:48:49.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:49.676 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:48:49.677 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:48:49.741 INFO:teuthology.orchestra.run.smithi038.stdout:ext2/ext3 2020-06-12T17:48:49.741 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-06-12T17:48:49.742 INFO:teuthology.orchestra.run:waiting for 900 2020-06-12T17:48:49.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-06-12T17:48:49.743 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:48:49.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:49.802 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:48:49.802 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-06-12T17:48:49.856 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:48:49.857 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-06-12T17:48:49.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:49.858 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:48:49.858 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-06-12T17:48:49.910 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:48:49.912 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-06-12T17:48:49.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:49.913 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:48:49.913 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-06-12T17:48:49.971 INFO:teuthology.orchestra.run.smithi038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': Transport endpoint is not connected 2020-06-12T17:48:49.971 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-06-12T17:48:49.972 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.1 2020-06-12T17:48:49.972 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi038.front.sepia.ceph.com... 2020-06-12T17:48:49.973 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-06-12T17:48:49.973 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2020-06-12T17:48:50.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:50.063 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:48:50.064 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-06-12T17:48:50.078 INFO:teuthology.orchestra.run.smithi038.stdout:ext2/ext3 2020-06-12T17:48:50.079 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-06-12T17:48:50.079 INFO:teuthology.orchestra.run:waiting for 900 2020-06-12T17:48:50.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-06-12T17:48:50.080 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-06-12T17:48:50.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:50.133 INFO:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:48:50.133 INFO:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.2) 2020-06-12T17:48:50.152 INFO:teuthology.orchestra.run.smithi150.stdout:fuseblk 2020-06-12T17:48:50.153 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2020-06-12T17:48:50.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:50.154 INFO:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:48:50.155 INFO:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.2) 2020-06-12T17:48:50.209 INFO:teuthology.orchestra.run.smithi150.stdout:fuseblk 2020-06-12T17:48:50.210 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2020-06-12T17:48:50.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:50.212 INFO:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:48:50.213 INFO:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.2) 2020-06-12T17:48:50.271 INFO:teuthology.orchestra.run.smithi150.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': Transport endpoint is not connected 2020-06-12T17:48:50.271 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-06-12T17:48:50.272 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.2 2020-06-12T17:48:50.273 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi150.front.sepia.ceph.com... 2020-06-12T17:48:50.274 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-06-12T17:48:50.275 INFO:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.2) 2020-06-12T17:48:50.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:50.351 INFO:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:48:50.352 INFO:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.2) 2020-06-12T17:48:50.406 INFO:teuthology.orchestra.run.smithi150.stdout:ext2/ext3 2020-06-12T17:48:50.406 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-06-12T17:48:50.407 INFO:teuthology.orchestra.run:waiting for 900 2020-06-12T17:48:50.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-06-12T17:48:50.408 INFO:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2020-06-12T17:48:50.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:50.462 INFO:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:48:50.463 INFO:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.3) 2020-06-12T17:48:50.519 INFO:teuthology.orchestra.run.smithi150.stdout:fuseblk 2020-06-12T17:48:50.520 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2020-06-12T17:48:50.520 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:50.521 INFO:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:48:50.522 INFO:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.3) 2020-06-12T17:48:50.574 INFO:teuthology.orchestra.run.smithi150.stdout:fuseblk 2020-06-12T17:48:50.575 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2020-06-12T17:48:50.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:50.576 INFO:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:48:50.576 INFO:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.3) 2020-06-12T17:48:50.629 INFO:teuthology.orchestra.run.smithi150.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.3': Transport endpoint is not connected 2020-06-12T17:48:50.630 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-06-12T17:48:50.630 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.3 2020-06-12T17:48:50.631 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi150.front.sepia.ceph.com... 2020-06-12T17:48:50.631 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-06-12T17:48:50.631 INFO:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.3) 2020-06-12T17:48:50.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:48:50.709 INFO:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:48:50.709 INFO:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.3) 2020-06-12T17:48:50.762 INFO:teuthology.orchestra.run.smithi150.stdout:ext2/ext3 2020-06-12T17:48:50.763 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-06-12T17:48:50.763 INFO:teuthology.orchestra.run:waiting for 900 2020-06-12T17:48:50.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-06-12T17:48:50.764 INFO:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2020-06-12T17:48:50.821 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-06-12T17:48:50.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.946+0000 7fc2ba661700 1 Processor -- start 2020-06-12T17:48:50.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.946+0000 7fc2ba661700 1 -- start start 2020-06-12T17:48:50.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.946+0000 7fc2ba661700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc2b40b6aa0 0x7fc2b4143990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:50.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.946+0000 7fc2ba661700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b4148010 con 0x7fc2b4063c90 2020-06-12T17:48:50.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.946+0000 7fc2ba661700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b41482b0 con 0x7fc2b40b61f0 2020-06-12T17:48:50.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.946+0000 7fc2ba661700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b4064070 con 0x7fc2b40b6aa0 2020-06-12T17:48:50.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.947+0000 7fc2b3fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc2b4063c90 0x7fc2b4143280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38564/0 (socket says 172.21.15.38:38564) 2020-06-12T17:48:50.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.947+0000 7fc2b3fff700 1 -- 172.21.15.38:0/3745609108 learned_addr learned my addr 172.21.15.38:0/3745609108 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:50.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.947+0000 7fc2b8bfe700 1 --2- 172.21.15.38:0/3745609108 >> v2:172.21.15.150:3300/0 conn(0x7fc2b40b6aa0 0x7fc2b4143990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:50.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.947+0000 7fc2b37fe700 1 -- 172.21.15.38:0/3745609108 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3124936673 0 0) 0x7fc2b4148010 con 0x7fc2b4063c90 2020-06-12T17:48:50.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.947+0000 7fc2b37fe700 1 -- 172.21.15.38:0/3745609108 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc294003230 con 0x7fc2b4063c90 2020-06-12T17:48:50.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.947+0000 7fc2b8bfe700 1 -- 172.21.15.38:0/3745609108 >> v1:172.21.15.150:6789/0 conn(0x7fc2b40b61f0 legacy=0x7fc2b405ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:50.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.947+0000 7fc2b8bfe700 1 -- 172.21.15.38:0/3745609108 >> v1:172.21.15.38:6789/0 conn(0x7fc2b4063c90 legacy=0x7fc2b4143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:50.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.947+0000 7fc2b37fe700 1 -- 172.21.15.38:0/3745609108 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1604393987 0 0) 0x7fc2b41482b0 con 0x7fc2b40b61f0 2020-06-12T17:48:50.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.947+0000 7fc2b8bfe700 1 -- 172.21.15.38:0/3745609108 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b405c3b0 con 0x7fc2b40b6aa0 2020-06-12T17:48:50.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.947+0000 7fc2b8bfe700 1 --2- 172.21.15.38:0/3745609108 >> v2:172.21.15.150:3300/0 conn(0x7fc2b40b6aa0 0x7fc2b4143990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc2ac0032b0 tx=0x7fc2ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:50.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.947+0000 7fc2b8bfe700 1 --2- 172.21.15.38:0/3745609108 >> v2:172.21.15.150:3300/0 conn(0x7fc2b40b6aa0 0x7fc2b4143990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc2ac0032b0 tx=0x7fc2ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:50.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.947+0000 7fc2b8bfe700 1 --2- 172.21.15.38:0/3745609108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2b40b6aa0 0x7fc2b4143990 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7fc2ac0032b0 tx=0x7fc2ac0081e0).ready entity=mon.1 client_cookie=64cec34371b1aba9 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:50.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.947+0000 7fc2b8bfe700 1 --2- 172.21.15.38:0/3745609108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2b40b6aa0 0x7fc2b4143990 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7fc2ac0032b0 tx=0x7fc2ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:50.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.947+0000 7fc2b37fe700 1 -- 172.21.15.38:0/3745609108 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2ac011de0 con 0x7fc2b40b6aa0 2020-06-12T17:48:50.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.947+0000 7fc2b8bfe700 1 --2- 172.21.15.38:0/3745609108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2b40b6aa0 0x7fc2b4143990 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7fc2ac0032b0 tx=0x7fc2ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:50.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.947+0000 7fc2b37fe700 1 -- 172.21.15.38:0/3745609108 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ac00a160 con 0x7fc2b40b6aa0 2020-06-12T17:48:50.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.947+0000 7fc2b8bfe700 1 --2- 172.21.15.38:0/3745609108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2b40b6aa0 0x7fc2b4143990 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7fc2ac0032b0 tx=0x7fc2ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:50.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.947+0000 7fc2b37fe700 1 -- 172.21.15.38:0/3745609108 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2ac00a4c0 con 0x7fc2b40b6aa0 2020-06-12T17:48:50.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.948+0000 7fc2ba661700 1 -- 172.21.15.38:0/3745609108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2b40b6aa0 msgr2=0x7fc2b4143990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:50.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.948+0000 7fc2ba661700 1 --2- 172.21.15.38:0/3745609108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2b40b6aa0 0x7fc2b4143990 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7fc2ac0032b0 tx=0x7fc2ac0081e0).stop 2020-06-12T17:48:50.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.948+0000 7fc2ba661700 1 -- 172.21.15.38:0/3745609108 shutdown_connections 2020-06-12T17:48:50.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.948+0000 7fc2ba661700 1 --2- 172.21.15.38:0/3745609108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2b40b6aa0 0x7fc2b4143990 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:50.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.948+0000 7fc2ba661700 1 -- 172.21.15.38:0/3745609108 >> 172.21.15.38:0/3745609108 conn(0x7fc2b40ba630 msgr2=0x7fc2b40baa40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:50.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.948+0000 7fc2ba661700 1 -- 172.21.15.38:0/3745609108 shutdown_connections 2020-06-12T17:48:50.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.948+0000 7fc2ba661700 1 -- 172.21.15.38:0/3745609108 wait complete. 2020-06-12T17:48:50.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.949+0000 7fc2ba661700 1 Processor -- start 2020-06-12T17:48:50.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.949+0000 7fc2ba661700 1 -- start start 2020-06-12T17:48:50.964 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.950+0000 7fc2ba661700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2b40b6aa0 0x7fc2b4142320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:50.964 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.950+0000 7fc2ba661700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b4144550 con 0x7fc2b4063c90 2020-06-12T17:48:50.965 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.950+0000 7fc2ba661700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b41428e0 con 0x7fc2b40b61f0 2020-06-12T17:48:50.965 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.950+0000 7fc2ba661700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b4145ff0 con 0x7fc2b40b6aa0 2020-06-12T17:48:50.965 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.950+0000 7fc2b3fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc2b4063c90 0x7fc2b41458e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38570/0 (socket says 172.21.15.38:38570) 2020-06-12T17:48:50.965 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.950+0000 7fc2b3fff700 1 -- 172.21.15.38:0/3788054724 learned_addr learned my addr 172.21.15.38:0/3788054724 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:50.966 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.950+0000 7fc2b8bfe700 1 --2- 172.21.15.38:0/3788054724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2b40b6aa0 0x7fc2b4142320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:50.967 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.950+0000 7fc2b1ffb700 1 -- 172.21.15.38:0/3788054724 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1668863839 0 0) 0x7fc2b4144550 con 0x7fc2b4063c90 2020-06-12T17:48:50.967 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.950+0000 7fc2b1ffb700 1 -- 172.21.15.38:0/3788054724 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc298002fe0 con 0x7fc2b4063c90 2020-06-12T17:48:50.967 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.950+0000 7fc2b1ffb700 1 -- 172.21.15.38:0/3788054724 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1241126709 0 0) 0x7fc2b41428e0 con 0x7fc2b40b61f0 2020-06-12T17:48:50.967 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.950+0000 7fc2b1ffb700 1 -- 172.21.15.38:0/3788054724 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2b4144550 con 0x7fc2b40b61f0 2020-06-12T17:48:50.968 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.950+0000 7fc2b1ffb700 1 -- 172.21.15.38:0/3788054724 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1452744944 0 0) 0x7fc298002fe0 con 0x7fc2b4063c90 2020-06-12T17:48:50.976 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.950+0000 7fc2b8bfe700 1 -- 172.21.15.38:0/3788054724 >> v1:172.21.15.150:6789/0 conn(0x7fc2b40b61f0 legacy=0x7fc2b4146560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:50.976 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.950+0000 7fc2b8bfe700 1 -- 172.21.15.38:0/3788054724 >> v1:172.21.15.38:6789/0 conn(0x7fc2b4063c90 legacy=0x7fc2b41458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:50.976 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.950+0000 7fc2b8bfe700 1 -- 172.21.15.38:0/3788054724 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b4144780 con 0x7fc2b40b6aa0 2020-06-12T17:48:50.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.950+0000 7fc2b8bfe700 1 --2- 172.21.15.38:0/3788054724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2b40b6aa0 0x7fc2b4142320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc2a4000f10 tx=0x7fc2ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:50.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.951+0000 7fc2b8bfe700 1 --2- 172.21.15.38:0/3788054724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2b40b6aa0 0x7fc2b4142320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc2a4000f10 tx=0x7fc2ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:50.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.951+0000 7fc2b8bfe700 1 --2- 172.21.15.38:0/3788054724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2b40b6aa0 0x7fc2b4142320 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7fc2a4000f10 tx=0x7fc2ac0081e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:50.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.951+0000 7fc2b8bfe700 1 --2- 172.21.15.38:0/3788054724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2b40b6aa0 0x7fc2b4142320 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7fc2a4000f10 tx=0x7fc2ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:50.978 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.951+0000 7fc2b1ffb700 1 -- 172.21.15.38:0/3788054724 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2a4001880 con 0x7fc2b40b6aa0 2020-06-12T17:48:50.978 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.951+0000 7fc2b8bfe700 1 --2- 172.21.15.38:0/3788054724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2b40b6aa0 0x7fc2b4142320 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7fc2a4000f10 tx=0x7fc2ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:50.978 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.951+0000 7fc2b8bfe700 1 --2- 172.21.15.38:0/3788054724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2b40b6aa0 0x7fc2b4142320 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7fc2a4000f10 tx=0x7fc2ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:50.978 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.951+0000 7fc2b1ffb700 1 -- 172.21.15.38:0/3788054724 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ac008a60 con 0x7fc2b40b6aa0 2020-06-12T17:48:50.978 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.951+0000 7fc2b1ffb700 1 -- 172.21.15.38:0/3788054724 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2ac005c30 con 0x7fc2b40b6aa0 2020-06-12T17:48:50.979 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.951+0000 7fc2ba661700 1 -- 172.21.15.38:0/3788054724 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b4146c70 con 0x7fc2b40b6aa0 2020-06-12T17:48:50.979 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.951+0000 7fc2ba661700 1 -- 172.21.15.38:0/3788054724 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b40a02a0 con 0x7fc2b40b6aa0 2020-06-12T17:48:50.979 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.951+0000 7fc2b8bfe700 1 --2- 172.21.15.38:0/3788054724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2b40b6aa0 0x7fc2b4142320 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7fc2a4000f10 tx=0x7fc2ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:50.979 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.952+0000 7fc2ba661700 1 -- 172.21.15.38:0/3788054724 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b4144980 con 0x7fc2b40b6aa0 2020-06-12T17:48:50.979 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.952+0000 7fc2b1ffb700 1 -- 172.21.15.38:0/3788054724 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fc2ac007c00 con 0x7fc2b40b6aa0 2020-06-12T17:48:50.980 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.952+0000 7fc2b8bfe700 1 --2- 172.21.15.38:0/3788054724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2b40b6aa0 0x7fc2b4142320 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7fc2a4000f10 tx=0x7fc2ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:50.980 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.952+0000 7fc2b1ffb700 1 --2- 172.21.15.38:0/3788054724 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc29804da00 0x7fc29804fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:50.980 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.952+0000 7fc2b1ffb700 1 -- 172.21.15.38:0/3788054724 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc2ac061780 con 0x7fc2b40b6aa0 2020-06-12T17:48:50.980 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.952+0000 7fc2b3fff700 1 --2- 172.21.15.38:0/3788054724 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc29804da00 0x7fc29804fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:50.981 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.952+0000 7fc2b3fff700 1 --2- 172.21.15.38:0/3788054724 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc29804da00 0x7fc29804fec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc2a4005540 tx=0x7fc2a4001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:50.981 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.953+0000 7fc2b3fff700 1 --2- 172.21.15.38:0/3788054724 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc29804da00 0x7fc29804fec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc2a4005540 tx=0x7fc2a4001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:50.981 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.953+0000 7fc2b3fff700 1 --2- 172.21.15.38:0/3788054724 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc29804da00 0x7fc29804fec0 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7fc2a4005540 tx=0x7fc2a4001dd0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:50.981 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.956+0000 7fc2b8bfe700 1 --2- 172.21.15.38:0/3788054724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2b40b6aa0 0x7fc2b4142320 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7fc2a4000f10 tx=0x7fc2ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:50.981 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:50.956+0000 7fc2b1ffb700 1 -- 172.21.15.38:0/3788054724 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fc2b4144980 con 0x7fc2b40b6aa0 2020-06-12T17:48:51.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.108+0000 7fc2ba661700 1 -- 172.21.15.38:0/3788054724 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc2b4144980 con 0x7fc2b40b6aa0 2020-06-12T17:48:51.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.110+0000 7fc2b8bfe700 1 --2- 172.21.15.38:0/3788054724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2b40b6aa0 0x7fc2b4142320 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7fc2a4000f10 tx=0x7fc2ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.110+0000 7fc2b1ffb700 1 -- 172.21.15.38:0/3788054724 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v24) v1 ==== 81+0+34113 (secure 0 0 0) 0x7fc2b4144980 con 0x7fc2b40b6aa0 2020-06-12T17:48:51.114 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:51.114 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2020-06-12T17:48:51.114 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 24, 2020-06-12T17:48:51.115 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "8e42a2e7-b187-42c4-a73f-8f812ee62352", 2020-06-12T17:48:51.115 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2020-06-12T17:47:54.434340+0000", 2020-06-12T17:48:51.115 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2020-06-12T17:48:14.851712+0000", 2020-06-12T17:48:51.115 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2020-06-12T17:48:03.388718+0000", 2020-06-12T17:48:51.115 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2020-06-12T17:48:03.388718+0000", 2020-06-12T17:48:51.116 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-06-12T17:48:51.116 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2020-06-12T17:48:51.116 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2020-06-12T17:48:51.116 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2020-06-12T17:48:51.116 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2020-06-12T17:48:51.117 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2020-06-12T17:48:51.117 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2020-06-12T17:48:51.117 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2020-06-12T17:48:51.117 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 5, 2020-06-12T17:48:51.117 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.94999998807907104, 2020-06-12T17:48:51.118 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-06-12T17:48:51.118 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.85000002384185791, 2020-06-12T17:48:51.118 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2020-06-12T17:48:51.118 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 4, 2020-06-12T17:48:51.118 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2020-06-12T17:48:51.119 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "jewel", 2020-06-12T17:48:51.119 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2020-06-12T17:48:51.119 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "octopus", 2020-06-12T17:48:51.119 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2020-06-12T17:48:51.119 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.120 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2020-06-12T17:48:51.120 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "device_health_metrics", 2020-06-12T17:48:51.120 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2020-06-12T17:47:57.558119+0000", 2020-06-12T17:48:51.120 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2020-06-12T17:48:51.121 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2020-06-12T17:48:51.121 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2020-06-12T17:48:51.121 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2020-06-12T17:48:51.121 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2020-06-12T17:48:51.121 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2020-06-12T17:48:51.122 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2020-06-12T17:48:51.122 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2020-06-12T17:48:51.122 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2020-06-12T17:48:51.122 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2020-06-12T17:48:51.122 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2020-06-12T17:48:51.123 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2020-06-12T17:48:51.123 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2020-06-12T17:48:51.123 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2020-06-12T17:48:51.123 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2020-06-12T17:48:51.123 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2020-06-12T17:48:51.124 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2020-06-12T17:48:51.124 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2020-06-12T17:48:51.124 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2020-06-12T17:48:51.124 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2020-06-12T17:48:51.124 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.125 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "15", 2020-06-12T17:48:51.125 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2020-06-12T17:48:51.125 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2020-06-12T17:48:51.125 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2020-06-12T17:48:51.125 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2020-06-12T17:48:51.127 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2020-06-12T17:48:51.127 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2020-06-12T17:48:51.127 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2020-06-12T17:48:51.127 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2020-06-12T17:48:51.127 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2020-06-12T17:48:51.128 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2020-06-12T17:48:51.128 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2020-06-12T17:48:51.128 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2020-06-12T17:48:51.128 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2020-06-12T17:48:51.128 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2020-06-12T17:48:51.129 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2020-06-12T17:48:51.129 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2020-06-12T17:48:51.129 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2020-06-12T17:48:51.129 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2020-06-12T17:48:51.129 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-06-12T17:48:51.130 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-06-12T17:48:51.130 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2020-06-12T17:48:51.130 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2020-06-12T17:48:51.130 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2020-06-12T17:48:51.130 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2020-06-12T17:48:51.131 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2020-06-12T17:48:51.131 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2020-06-12T17:48:51.131 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.131 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2020-06-12T17:48:51.131 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2020-06-12T17:48:51.131 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2020-06-12T17:48:51.132 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2020-06-12T17:48:51.132 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2020-06-12T17:48:51.132 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2020-06-12T17:48:51.132 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2020-06-12T17:48:51.132 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2020-06-12T17:48:51.133 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2020-06-12T17:48:51.133 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2020-06-12T17:48:51.133 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2020-06-12T17:48:51.133 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2020-06-12T17:48:51.133 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2020-06-12T17:48:51.134 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.134 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2020-06-12T17:48:51.134 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_devicehealth": {} 2020-06-12T17:48:51.134 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.134 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.135 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.135 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 2, 2020-06-12T17:48:51.135 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "rbd", 2020-06-12T17:48:51.135 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2020-06-12T17:48:07.419264+0000", 2020-06-12T17:48:51.135 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2020-06-12T17:48:51.136 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2020-06-12T17:48:51.136 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2020-06-12T17:48:51.136 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2020-06-12T17:48:51.136 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2020-06-12T17:48:51.136 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2020-06-12T17:48:51.136 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2020-06-12T17:48:51.137 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2020-06-12T17:48:51.137 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 8, 2020-06-12T17:48:51.137 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 8, 2020-06-12T17:48:51.137 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 8, 2020-06-12T17:48:51.137 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 8, 2020-06-12T17:48:51.138 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 8, 2020-06-12T17:48:51.138 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2020-06-12T17:48:51.138 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2020-06-12T17:48:51.138 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2020-06-12T17:48:51.139 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2020-06-12T17:48:51.139 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2020-06-12T17:48:51.139 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2020-06-12T17:48:51.139 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2020-06-12T17:48:51.139 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.139 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "18", 2020-06-12T17:48:51.140 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2020-06-12T17:48:51.140 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2020-06-12T17:48:51.140 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2020-06-12T17:48:51.140 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2020-06-12T17:48:51.140 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2020-06-12T17:48:51.141 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2020-06-12T17:48:51.141 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2020-06-12T17:48:51.141 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2020-06-12T17:48:51.141 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2020-06-12T17:48:51.141 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2020-06-12T17:48:51.143 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2020-06-12T17:48:51.143 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2020-06-12T17:48:51.143 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2020-06-12T17:48:51.143 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2020-06-12T17:48:51.144 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2020-06-12T17:48:51.144 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2020-06-12T17:48:51.144 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2020-06-12T17:48:51.144 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2020-06-12T17:48:51.144 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-06-12T17:48:51.144 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-06-12T17:48:51.145 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2020-06-12T17:48:51.145 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2020-06-12T17:48:51.145 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2020-06-12T17:48:51.145 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2020-06-12T17:48:51.145 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2020-06-12T17:48:51.146 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2020-06-12T17:48:51.146 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.146 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2020-06-12T17:48:51.146 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2020-06-12T17:48:51.146 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2020-06-12T17:48:51.147 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2020-06-12T17:48:51.147 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2020-06-12T17:48:51.147 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2020-06-12T17:48:51.147 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2020-06-12T17:48:51.147 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2020-06-12T17:48:51.148 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2020-06-12T17:48:51.148 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2020-06-12T17:48:51.148 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2020-06-12T17:48:51.148 INFO:teuthology.orchestra.run.smithi038.stdout: "options": {}, 2020-06-12T17:48:51.148 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2020-06-12T17:48:51.148 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd": {} 2020-06-12T17:48:51.149 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.149 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.149 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.150 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 3, 2020-06-12T17:48:51.150 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2020-06-12T17:48:51.150 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2020-06-12T17:48:09.934098+0000", 2020-06-12T17:48:51.150 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2020-06-12T17:48:51.151 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2020-06-12T17:48:51.151 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2020-06-12T17:48:51.151 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2020-06-12T17:48:51.152 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2020-06-12T17:48:51.152 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2020-06-12T17:48:51.152 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2020-06-12T17:48:51.154 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2020-06-12T17:48:51.154 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 8, 2020-06-12T17:48:51.154 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 8, 2020-06-12T17:48:51.155 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 8, 2020-06-12T17:48:51.155 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 8, 2020-06-12T17:48:51.155 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 8, 2020-06-12T17:48:51.155 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2020-06-12T17:48:51.155 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2020-06-12T17:48:51.156 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2020-06-12T17:48:51.156 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2020-06-12T17:48:51.156 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2020-06-12T17:48:51.156 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2020-06-12T17:48:51.156 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2020-06-12T17:48:51.157 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.157 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "24", 2020-06-12T17:48:51.157 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2020-06-12T17:48:51.157 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2020-06-12T17:48:51.157 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2020-06-12T17:48:51.158 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2020-06-12T17:48:51.158 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2020-06-12T17:48:51.158 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2020-06-12T17:48:51.158 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2020-06-12T17:48:51.158 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2020-06-12T17:48:51.159 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2020-06-12T17:48:51.159 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2020-06-12T17:48:51.159 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2020-06-12T17:48:51.159 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2020-06-12T17:48:51.160 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2020-06-12T17:48:51.160 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2020-06-12T17:48:51.160 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2020-06-12T17:48:51.160 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2020-06-12T17:48:51.161 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2020-06-12T17:48:51.161 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2020-06-12T17:48:51.161 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-06-12T17:48:51.161 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-06-12T17:48:51.161 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2020-06-12T17:48:51.162 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2020-06-12T17:48:51.162 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2020-06-12T17:48:51.162 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2020-06-12T17:48:51.162 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2020-06-12T17:48:51.162 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2020-06-12T17:48:51.162 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.163 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2020-06-12T17:48:51.163 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2020-06-12T17:48:51.163 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2020-06-12T17:48:51.163 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2020-06-12T17:48:51.163 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2020-06-12T17:48:51.164 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2020-06-12T17:48:51.164 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2020-06-12T17:48:51.164 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2020-06-12T17:48:51.165 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2020-06-12T17:48:51.165 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2020-06-12T17:48:51.165 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2020-06-12T17:48:51.165 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2020-06-12T17:48:51.165 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2020-06-12T17:48:51.166 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2020-06-12T17:48:51.166 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2020-06-12T17:48:51.166 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.166 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2020-06-12T17:48:51.166 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2020-06-12T17:48:51.167 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2020-06-12T17:48:51.167 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.167 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.167 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.167 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.167 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 4, 2020-06-12T17:48:51.168 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2020-06-12T17:48:51.168 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2020-06-12T17:48:12.497229+0000", 2020-06-12T17:48:51.168 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 5, 2020-06-12T17:48:51.168 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,ec_overwrites", 2020-06-12T17:48:51.168 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 3, 2020-06-12T17:48:51.169 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 4, 2020-06-12T17:48:51.169 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 3, 2020-06-12T17:48:51.169 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 1, 2020-06-12T17:48:51.169 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2020-06-12T17:48:51.169 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2020-06-12T17:48:51.170 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 8, 2020-06-12T17:48:51.170 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 8, 2020-06-12T17:48:51.170 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 8, 2020-06-12T17:48:51.170 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 8, 2020-06-12T17:48:51.170 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 8, 2020-06-12T17:48:51.171 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2020-06-12T17:48:51.171 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2020-06-12T17:48:51.171 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2020-06-12T17:48:51.171 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2020-06-12T17:48:51.171 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2020-06-12T17:48:51.171 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2020-06-12T17:48:51.172 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2020-06-12T17:48:51.172 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.172 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "24", 2020-06-12T17:48:51.172 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2020-06-12T17:48:51.172 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2020-06-12T17:48:51.173 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2020-06-12T17:48:51.173 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2020-06-12T17:48:51.173 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2020-06-12T17:48:51.173 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2020-06-12T17:48:51.173 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2020-06-12T17:48:51.174 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2020-06-12T17:48:51.174 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2020-06-12T17:48:51.174 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2020-06-12T17:48:51.174 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2020-06-12T17:48:51.174 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2020-06-12T17:48:51.174 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2020-06-12T17:48:51.175 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2020-06-12T17:48:51.175 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2020-06-12T17:48:51.175 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2020-06-12T17:48:51.175 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2020-06-12T17:48:51.175 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2020-06-12T17:48:51.176 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-06-12T17:48:51.176 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-06-12T17:48:51.176 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2020-06-12T17:48:51.177 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2020-06-12T17:48:51.177 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2020-06-12T17:48:51.177 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "cephfs_data", 2020-06-12T17:48:51.178 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2020-06-12T17:48:51.178 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2020-06-12T17:48:51.178 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.178 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2020-06-12T17:48:51.178 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2020-06-12T17:48:51.179 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2020-06-12T17:48:51.179 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2020-06-12T17:48:51.179 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2020-06-12T17:48:51.179 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2020-06-12T17:48:51.179 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2020-06-12T17:48:51.180 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2020-06-12T17:48:51.180 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 8192, 2020-06-12T17:48:51.180 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2020-06-12T17:48:51.180 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2020-06-12T17:48:51.180 INFO:teuthology.orchestra.run.smithi038.stdout: "options": {}, 2020-06-12T17:48:51.181 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2020-06-12T17:48:51.181 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2020-06-12T17:48:51.181 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2020-06-12T17:48:51.181 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.181 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.181 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.182 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2020-06-12T17:48:51.182 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2020-06-12T17:48:51.182 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.182 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2020-06-12T17:48:51.182 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "44ac3dea-67b4-4b9a-bc18-ac511710afe1", 2020-06-12T17:48:51.183 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2020-06-12T17:48:51.183 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2020-06-12T17:48:51.183 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2020-06-12T17:48:51.183 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2020-06-12T17:48:51.183 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2020-06-12T17:48:51.184 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2020-06-12T17:48:51.184 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2020-06-12T17:48:51.184 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 19, 2020-06-12T17:48:51.184 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2020-06-12T17:48:51.184 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2020-06-12T17:48:51.184 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2020-06-12T17:48:51.185 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.185 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.185 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.185 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2020-06-12T17:48:51.185 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31038 2020-06-12T17:48:51.186 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.186 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.186 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.187 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2020-06-12T17:48:51.187 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31038 2020-06-12T17:48:51.187 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.187 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.187 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.188 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2020-06-12T17:48:51.188 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.188 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.188 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.188 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2020-06-12T17:48:51.189 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31038 2020-06-12T17:48:51.189 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.189 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.189 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.189 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2020-06-12T17:48:51.190 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31038 2020-06-12T17:48:51.190 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.190 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.190 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.191 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2020-06-12T17:48:51.191 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.191 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.191 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.191 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2020-06-12T17:48:51.192 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31038 2020-06-12T17:48:51.192 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.192 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.192 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.192 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2020-06-12T17:48:51.192 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31038 2020-06-12T17:48:51.193 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.193 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.193 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.193 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2020-06-12T17:48:51.193 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.194 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.194 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.194 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2020-06-12T17:48:51.194 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31038 2020-06-12T17:48:51.194 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.195 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.195 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.195 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2020-06-12T17:48:51.195 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31038 2020-06-12T17:48:51.195 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.195 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.196 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.196 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6816/31038", 2020-06-12T17:48:51.196 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/31038", 2020-06-12T17:48:51.196 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/31038", 2020-06-12T17:48:51.197 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/31038", 2020-06-12T17:48:51.197 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2020-06-12T17:48:51.197 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2020-06-12T17:48:51.197 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2020-06-12T17:48:51.198 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.198 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.198 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.198 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2020-06-12T17:48:51.198 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "561f7ced-3fff-4364-8619-6e4ecbc9d256", 2020-06-12T17:48:51.199 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2020-06-12T17:48:51.199 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2020-06-12T17:48:51.199 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2020-06-12T17:48:51.199 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2020-06-12T17:48:51.199 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2020-06-12T17:48:51.200 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2020-06-12T17:48:51.200 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2020-06-12T17:48:51.200 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 13, 2020-06-12T17:48:51.200 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2020-06-12T17:48:51.201 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2020-06-12T17:48:51.201 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2020-06-12T17:48:51.201 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.201 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.201 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.202 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2020-06-12T17:48:51.202 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31036 2020-06-12T17:48:51.202 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.202 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.202 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.202 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2020-06-12T17:48:51.203 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31036 2020-06-12T17:48:51.203 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.203 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.203 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.203 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2020-06-12T17:48:51.204 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.204 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.204 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.204 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2020-06-12T17:48:51.204 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31036 2020-06-12T17:48:51.204 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.205 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.205 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.205 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2020-06-12T17:48:51.205 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31036 2020-06-12T17:48:51.205 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.206 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.206 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.206 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2020-06-12T17:48:51.206 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.206 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.207 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.207 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2020-06-12T17:48:51.207 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31036 2020-06-12T17:48:51.208 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.208 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.208 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.208 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2020-06-12T17:48:51.209 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31036 2020-06-12T17:48:51.209 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.209 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.209 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.209 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2020-06-12T17:48:51.210 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.210 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.210 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.210 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2020-06-12T17:48:51.210 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31036 2020-06-12T17:48:51.210 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.211 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.211 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.211 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2020-06-12T17:48:51.211 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31036 2020-06-12T17:48:51.211 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.212 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.212 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.212 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/31036", 2020-06-12T17:48:51.212 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/31036", 2020-06-12T17:48:51.212 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/31036", 2020-06-12T17:48:51.212 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/31036", 2020-06-12T17:48:51.213 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2020-06-12T17:48:51.213 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2020-06-12T17:48:51.213 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2020-06-12T17:48:51.213 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.213 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.214 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.214 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2020-06-12T17:48:51.214 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "0bb3c806-07af-49f5-b492-d0e33f2de37c", 2020-06-12T17:48:51.214 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2020-06-12T17:48:51.214 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2020-06-12T17:48:51.215 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2020-06-12T17:48:51.215 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2020-06-12T17:48:51.215 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2020-06-12T17:48:51.215 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2020-06-12T17:48:51.215 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2020-06-12T17:48:51.215 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 22, 2020-06-12T17:48:51.216 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2020-06-12T17:48:51.216 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2020-06-12T17:48:51.216 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2020-06-12T17:48:51.216 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.216 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.217 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.217 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2020-06-12T17:48:51.217 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31053 2020-06-12T17:48:51.217 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.218 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.218 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.218 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2020-06-12T17:48:51.218 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31053 2020-06-12T17:48:51.219 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.219 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.219 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.219 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2020-06-12T17:48:51.219 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.220 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.220 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.220 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2020-06-12T17:48:51.220 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31053 2020-06-12T17:48:51.220 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.220 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.221 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.221 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2020-06-12T17:48:51.221 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31053 2020-06-12T17:48:51.221 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.221 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.222 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.222 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2020-06-12T17:48:51.222 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.222 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.222 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.223 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2020-06-12T17:48:51.223 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31053 2020-06-12T17:48:51.223 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.223 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.223 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.224 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2020-06-12T17:48:51.224 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31053 2020-06-12T17:48:51.224 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.224 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.224 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.224 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2020-06-12T17:48:51.225 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.225 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.225 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.225 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2020-06-12T17:48:51.225 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31053 2020-06-12T17:48:51.226 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.226 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.226 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.226 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2020-06-12T17:48:51.226 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31053 2020-06-12T17:48:51.226 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.227 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.227 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.227 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/31053", 2020-06-12T17:48:51.227 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/31053", 2020-06-12T17:48:51.227 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/31053", 2020-06-12T17:48:51.228 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/31053", 2020-06-12T17:48:51.228 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2020-06-12T17:48:51.228 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2020-06-12T17:48:51.229 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2020-06-12T17:48:51.229 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.229 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.230 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.230 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2020-06-12T17:48:51.230 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "7f6a1e75-7b11-456e-8a4b-510b16226800", 2020-06-12T17:48:51.230 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2020-06-12T17:48:51.230 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2020-06-12T17:48:51.231 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2020-06-12T17:48:51.231 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2020-06-12T17:48:51.231 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2020-06-12T17:48:51.231 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2020-06-12T17:48:51.231 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2020-06-12T17:48:51.232 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 22, 2020-06-12T17:48:51.232 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2020-06-12T17:48:51.232 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2020-06-12T17:48:51.232 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2020-06-12T17:48:51.232 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.232 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.233 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.233 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2020-06-12T17:48:51.233 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31037 2020-06-12T17:48:51.233 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.233 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.234 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.234 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2020-06-12T17:48:51.234 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31037 2020-06-12T17:48:51.234 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.234 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.235 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.235 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2020-06-12T17:48:51.235 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.235 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.235 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.236 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2020-06-12T17:48:51.236 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31037 2020-06-12T17:48:51.236 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.236 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.236 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.236 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2020-06-12T17:48:51.237 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31037 2020-06-12T17:48:51.237 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.237 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.237 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.237 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2020-06-12T17:48:51.238 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.238 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.239 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.239 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2020-06-12T17:48:51.239 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31037 2020-06-12T17:48:51.239 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.240 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.240 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.240 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2020-06-12T17:48:51.240 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31037 2020-06-12T17:48:51.240 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.241 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.241 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.241 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2020-06-12T17:48:51.241 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.241 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.242 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.242 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2020-06-12T17:48:51.242 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31037 2020-06-12T17:48:51.242 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.242 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.242 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.243 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2020-06-12T17:48:51.243 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31037 2020-06-12T17:48:51.243 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.243 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.243 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.244 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/31037", 2020-06-12T17:48:51.244 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/31037", 2020-06-12T17:48:51.244 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6817/31037", 2020-06-12T17:48:51.244 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/31037", 2020-06-12T17:48:51.244 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2020-06-12T17:48:51.245 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2020-06-12T17:48:51.245 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2020-06-12T17:48:51.245 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.245 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.245 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.246 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2020-06-12T17:48:51.246 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "0eca0272-8cfd-469c-a32d-e29730dc0e1d", 2020-06-12T17:48:51.246 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2020-06-12T17:48:51.246 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2020-06-12T17:48:51.246 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2020-06-12T17:48:51.247 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2020-06-12T17:48:51.247 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2020-06-12T17:48:51.247 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2020-06-12T17:48:51.247 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2020-06-12T17:48:51.247 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 22, 2020-06-12T17:48:51.248 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2020-06-12T17:48:51.248 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2020-06-12T17:48:51.248 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2020-06-12T17:48:51.248 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.248 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.249 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.249 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6802", 2020-06-12T17:48:51.249 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31294 2020-06-12T17:48:51.249 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.249 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.250 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.250 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6803", 2020-06-12T17:48:51.250 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31294 2020-06-12T17:48:51.250 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.250 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.251 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.251 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2020-06-12T17:48:51.251 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.251 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.251 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.251 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6804", 2020-06-12T17:48:51.252 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31294 2020-06-12T17:48:51.252 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.252 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.252 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.252 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6805", 2020-06-12T17:48:51.253 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31294 2020-06-12T17:48:51.253 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.253 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.253 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.253 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2020-06-12T17:48:51.253 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.254 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.254 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.254 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6808", 2020-06-12T17:48:51.254 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31294 2020-06-12T17:48:51.254 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.255 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.255 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.255 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6809", 2020-06-12T17:48:51.255 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31294 2020-06-12T17:48:51.255 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.256 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.256 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.256 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2020-06-12T17:48:51.256 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.256 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.256 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.257 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6806", 2020-06-12T17:48:51.257 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31294 2020-06-12T17:48:51.257 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.257 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.257 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.258 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6807", 2020-06-12T17:48:51.258 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31294 2020-06-12T17:48:51.258 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.258 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.258 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.259 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.150:6803/31294", 2020-06-12T17:48:51.259 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.150:6805/31294", 2020-06-12T17:48:51.259 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.150:6809/31294", 2020-06-12T17:48:51.259 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.150:6807/31294", 2020-06-12T17:48:51.260 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2020-06-12T17:48:51.260 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2020-06-12T17:48:51.260 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2020-06-12T17:48:51.260 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.260 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.260 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.261 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2020-06-12T17:48:51.261 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "69d6a7dc-a55a-4ebc-8479-8bb921ddfb65", 2020-06-12T17:48:51.261 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2020-06-12T17:48:51.261 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2020-06-12T17:48:51.261 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2020-06-12T17:48:51.262 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2020-06-12T17:48:51.262 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2020-06-12T17:48:51.262 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2020-06-12T17:48:51.262 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2020-06-12T17:48:51.262 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 22, 2020-06-12T17:48:51.263 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2020-06-12T17:48:51.263 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2020-06-12T17:48:51.263 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2020-06-12T17:48:51.263 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.263 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.263 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.264 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6811", 2020-06-12T17:48:51.264 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31295 2020-06-12T17:48:51.264 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.264 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.264 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.265 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6813", 2020-06-12T17:48:51.265 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31295 2020-06-12T17:48:51.265 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.265 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.265 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.266 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2020-06-12T17:48:51.266 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.266 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.266 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.266 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6814", 2020-06-12T17:48:51.266 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31295 2020-06-12T17:48:51.267 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.267 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.267 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.267 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6816", 2020-06-12T17:48:51.267 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31295 2020-06-12T17:48:51.268 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.268 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.268 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.268 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2020-06-12T17:48:51.268 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.269 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.269 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.269 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6825", 2020-06-12T17:48:51.269 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31295 2020-06-12T17:48:51.269 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.270 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.270 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.270 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6828", 2020-06-12T17:48:51.270 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31295 2020-06-12T17:48:51.270 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.270 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.271 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.271 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2020-06-12T17:48:51.271 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.271 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.271 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.272 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6819", 2020-06-12T17:48:51.272 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31295 2020-06-12T17:48:51.272 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.272 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.272 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.273 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6822", 2020-06-12T17:48:51.273 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31295 2020-06-12T17:48:51.273 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.273 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.273 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.273 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.150:6813/31295", 2020-06-12T17:48:51.274 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.150:6816/31295", 2020-06-12T17:48:51.274 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.150:6828/31295", 2020-06-12T17:48:51.274 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.150:6822/31295", 2020-06-12T17:48:51.274 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2020-06-12T17:48:51.274 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2020-06-12T17:48:51.275 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2020-06-12T17:48:51.275 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.275 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.275 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.275 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2020-06-12T17:48:51.275 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "f0d320f8-c2f0-40bb-b713-526246cf97b4", 2020-06-12T17:48:51.276 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2020-06-12T17:48:51.276 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2020-06-12T17:48:51.276 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2020-06-12T17:48:51.276 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2020-06-12T17:48:51.276 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2020-06-12T17:48:51.277 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2020-06-12T17:48:51.277 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2020-06-12T17:48:51.277 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 22, 2020-06-12T17:48:51.277 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2020-06-12T17:48:51.277 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2020-06-12T17:48:51.278 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2020-06-12T17:48:51.278 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.278 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.278 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.278 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6817", 2020-06-12T17:48:51.278 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31297 2020-06-12T17:48:51.279 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.279 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.279 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.279 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6820", 2020-06-12T17:48:51.279 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31297 2020-06-12T17:48:51.280 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.280 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.280 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.280 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2020-06-12T17:48:51.280 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.281 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.281 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.281 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6823", 2020-06-12T17:48:51.282 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31297 2020-06-12T17:48:51.282 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.282 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.282 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.283 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6827", 2020-06-12T17:48:51.283 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31297 2020-06-12T17:48:51.283 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.283 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.283 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.283 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2020-06-12T17:48:51.284 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.284 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.284 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.284 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6832", 2020-06-12T17:48:51.284 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31297 2020-06-12T17:48:51.285 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.285 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.285 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.285 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6833", 2020-06-12T17:48:51.286 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31297 2020-06-12T17:48:51.286 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.286 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.286 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.286 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2020-06-12T17:48:51.287 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.287 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.287 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.287 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6830", 2020-06-12T17:48:51.287 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31297 2020-06-12T17:48:51.288 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.288 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.288 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.288 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6831", 2020-06-12T17:48:51.289 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31297 2020-06-12T17:48:51.289 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.289 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.289 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.289 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.150:6820/31297", 2020-06-12T17:48:51.290 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.150:6827/31297", 2020-06-12T17:48:51.290 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.150:6833/31297", 2020-06-12T17:48:51.290 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.150:6831/31297", 2020-06-12T17:48:51.290 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2020-06-12T17:48:51.290 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2020-06-12T17:48:51.290 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2020-06-12T17:48:51.291 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.291 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.291 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.291 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2020-06-12T17:48:51.291 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "970b7d02-a189-41b2-96e5-a5a5a57c6476", 2020-06-12T17:48:51.292 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2020-06-12T17:48:51.292 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2020-06-12T17:48:51.292 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2020-06-12T17:48:51.292 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2020-06-12T17:48:51.292 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2020-06-12T17:48:51.292 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2020-06-12T17:48:51.293 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2020-06-12T17:48:51.293 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 16, 2020-06-12T17:48:51.293 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2020-06-12T17:48:51.293 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2020-06-12T17:48:51.293 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2020-06-12T17:48:51.294 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.294 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.294 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.294 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6810", 2020-06-12T17:48:51.294 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31296 2020-06-12T17:48:51.295 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.295 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.295 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.295 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6812", 2020-06-12T17:48:51.295 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31296 2020-06-12T17:48:51.296 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.297 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.297 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.297 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2020-06-12T17:48:51.297 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.297 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.298 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.298 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6815", 2020-06-12T17:48:51.298 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31296 2020-06-12T17:48:51.298 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.298 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.299 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.299 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6818", 2020-06-12T17:48:51.299 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31296 2020-06-12T17:48:51.299 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.299 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.300 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.300 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2020-06-12T17:48:51.300 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.300 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.300 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.300 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6826", 2020-06-12T17:48:51.301 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31296 2020-06-12T17:48:51.301 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.301 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.301 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.301 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6829", 2020-06-12T17:48:51.302 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31296 2020-06-12T17:48:51.302 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.302 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.302 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.302 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2020-06-12T17:48:51.303 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2020-06-12T17:48:51.303 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.303 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2020-06-12T17:48:51.303 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6821", 2020-06-12T17:48:51.303 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31296 2020-06-12T17:48:51.304 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.304 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.304 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:48:51.304 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.150:6824", 2020-06-12T17:48:51.304 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 31296 2020-06-12T17:48:51.304 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.305 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.305 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.305 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.150:6812/31296", 2020-06-12T17:48:51.305 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.150:6818/31296", 2020-06-12T17:48:51.305 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.150:6829/31296", 2020-06-12T17:48:51.306 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.150:6824/31296", 2020-06-12T17:48:51.306 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2020-06-12T17:48:51.306 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2020-06-12T17:48:51.306 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2020-06-12T17:48:51.306 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:51.307 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.307 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2020-06-12T17:48:51.307 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2020-06-12T17:48:51.307 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.307 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2020-06-12T17:48:51.308 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2020-06-12T17:48:51.308 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2020-06-12T17:48:51.308 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2020-06-12T17:48:51.308 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138292836696063, 2020-06-12T17:48:51.308 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2020-06-12T17:48:51.309 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2020-06-12T17:48:01.664300+0000", 2020-06-12T17:48:51.309 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2020-06-12T17:48:51.309 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.309 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.309 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2020-06-12T17:48:51.309 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2020-06-12T17:48:51.310 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2020-06-12T17:48:51.310 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2020-06-12T17:48:51.310 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138292836696063, 2020-06-12T17:48:51.310 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2020-06-12T17:48:51.310 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2020-06-12T17:48:01.644253+0000", 2020-06-12T17:48:51.311 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2020-06-12T17:48:51.311 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.311 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.311 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2020-06-12T17:48:51.311 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2020-06-12T17:48:51.311 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2020-06-12T17:48:51.312 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2020-06-12T17:48:51.312 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138292836696063, 2020-06-12T17:48:51.312 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2020-06-12T17:48:51.312 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2020-06-12T17:48:01.651120+0000", 2020-06-12T17:48:51.312 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2020-06-12T17:48:51.313 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.313 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.313 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2020-06-12T17:48:51.313 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2020-06-12T17:48:51.313 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2020-06-12T17:48:51.314 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2020-06-12T17:48:51.314 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138292836696063, 2020-06-12T17:48:51.314 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2020-06-12T17:48:51.314 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2020-06-12T17:48:01.584978+0000", 2020-06-12T17:48:51.315 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2020-06-12T17:48:51.315 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.315 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.315 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2020-06-12T17:48:51.316 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2020-06-12T17:48:51.316 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2020-06-12T17:48:51.316 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2020-06-12T17:48:51.316 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138292836696063, 2020-06-12T17:48:51.316 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2020-06-12T17:48:51.316 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2020-06-12T17:48:01.628786+0000", 2020-06-12T17:48:51.317 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2020-06-12T17:48:51.317 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.317 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.317 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2020-06-12T17:48:51.317 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2020-06-12T17:48:51.318 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2020-06-12T17:48:51.318 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2020-06-12T17:48:51.318 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138292836696063, 2020-06-12T17:48:51.318 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2020-06-12T17:48:51.318 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2020-06-12T17:48:01.561149+0000", 2020-06-12T17:48:51.318 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2020-06-12T17:48:51.319 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.319 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.319 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2020-06-12T17:48:51.319 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2020-06-12T17:48:51.319 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2020-06-12T17:48:51.320 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2020-06-12T17:48:51.320 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138292836696063, 2020-06-12T17:48:51.320 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2020-06-12T17:48:51.320 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2020-06-12T17:48:01.661778+0000", 2020-06-12T17:48:51.320 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2020-06-12T17:48:51.321 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.321 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:51.321 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2020-06-12T17:48:51.321 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2020-06-12T17:48:51.321 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2020-06-12T17:48:51.322 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2020-06-12T17:48:51.322 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138292836696063, 2020-06-12T17:48:51.322 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2020-06-12T17:48:51.322 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2020-06-12T17:48:01.628606+0000", 2020-06-12T17:48:51.322 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2020-06-12T17:48:51.322 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.323 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2020-06-12T17:48:51.323 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2020-06-12T17:48:51.323 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2020-06-12T17:48:51.323 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2020-06-12T17:48:51.323 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2020-06-12T17:48:51.324 INFO:teuthology.orchestra.run.smithi038.stdout: "blacklist": {}, 2020-06-12T17:48:51.324 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2020-06-12T17:48:51.324 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs_data": { 2020-06-12T17:48:51.324 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-device-class": "", 2020-06-12T17:48:51.324 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2020-06-12T17:48:51.324 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-root": "default", 2020-06-12T17:48:51.325 INFO:teuthology.orchestra.run.smithi038.stdout: "jerasure-per-chunk-alignment": "false", 2020-06-12T17:48:51.325 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2020-06-12T17:48:51.325 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "2", 2020-06-12T17:48:51.325 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2020-06-12T17:48:51.325 INFO:teuthology.orchestra.run.smithi038.stdout: "ruleset-failure-domain": "osd", 2020-06-12T17:48:51.326 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van", 2020-06-12T17:48:51.326 INFO:teuthology.orchestra.run.smithi038.stdout: "w": "8" 2020-06-12T17:48:51.326 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.326 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2020-06-12T17:48:51.326 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2020-06-12T17:48:51.327 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2020-06-12T17:48:51.327 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2020-06-12T17:48:51.327 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2020-06-12T17:48:51.327 INFO:teuthology.orchestra.run.smithi038.stdout: "ruleset-failure-domain": "osd", 2020-06-12T17:48:51.327 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2020-06-12T17:48:51.327 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:51.328 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:51.328 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2020-06-12T17:48:51.328 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2020-06-12T17:48:51.328 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2020-06-12T17:48:51.328 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2020-06-12T17:48:51.329 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {} 2020-06-12T17:48:51.329 INFO:teuthology.orchestra.run.smithi038.stdout:} 2020-06-12T17:48:51.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.111+0000 7fc2ba661700 1 -- 172.21.15.38:0/3788054724 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc29804da00 msgr2=0x7fc29804fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:51.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.111+0000 7fc2ba661700 1 --2- 172.21.15.38:0/3788054724 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc29804da00 0x7fc29804fec0 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7fc2a4005540 tx=0x7fc2a4001dd0).stop 2020-06-12T17:48:51.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.111+0000 7fc2ba661700 1 -- 172.21.15.38:0/3788054724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2b40b6aa0 msgr2=0x7fc2b4142320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:51.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.111+0000 7fc2ba661700 1 --2- 172.21.15.38:0/3788054724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2b40b6aa0 0x7fc2b4142320 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7fc2a4000f10 tx=0x7fc2ac0081e0).stop 2020-06-12T17:48:51.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.111+0000 7fc2ba661700 1 -- 172.21.15.38:0/3788054724 shutdown_connections 2020-06-12T17:48:51.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.111+0000 7fc2ba661700 1 --2- 172.21.15.38:0/3788054724 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc29804da00 0x7fc29804fec0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:51.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.111+0000 7fc2ba661700 1 --2- 172.21.15.38:0/3788054724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2b40b6aa0 0x7fc2b4142320 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:51.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.111+0000 7fc2ba661700 1 -- 172.21.15.38:0/3788054724 >> 172.21.15.38:0/3788054724 conn(0x7fc2b40ba630 msgr2=0x7fc2b4066680 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:51.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.111+0000 7fc2ba661700 1 -- 172.21.15.38:0/3788054724 shutdown_connections 2020-06-12T17:48:51.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.111+0000 7fc2ba661700 1 -- 172.21.15.38:0/3788054724 wait complete. 2020-06-12T17:48:51.333 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-06-12T17:48:51.449 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.446+0000 7ff253f26700 1 Processor -- start 2020-06-12T17:48:51.450 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.446+0000 7ff253f26700 1 -- start start 2020-06-12T17:48:51.455 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.447+0000 7ff253f26700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff24c061a80 0x7ff24c09bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:51.455 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.447+0000 7ff253f26700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff24c142350 0x7ff24c1427b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:51.455 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.447+0000 7ff253f26700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff24c0b2dc0 con 0x7ff24c146380 2020-06-12T17:48:51.455 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.447+0000 7ff253f26700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff24c09e560 con 0x7ff24c061a80 2020-06-12T17:48:51.456 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.447+0000 7ff253f26700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff24c0b29d0 con 0x7ff24c142350 2020-06-12T17:48:51.456 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.447+0000 7ff251cc2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff24c061a80 0x7ff24c09bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:51.456 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.447+0000 7ff251cc2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff24c061a80 0x7ff24c09bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36762/0 (socket says 172.21.15.38:36762) 2020-06-12T17:48:51.456 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.447+0000 7ff2524c3700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff24c146380 0x7ff24c146810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38578/0 (socket says 172.21.15.38:38578) 2020-06-12T17:48:51.456 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.447+0000 7ff251cc2700 1 -- 172.21.15.38:0/1956595804 learned_addr learned my addr 172.21.15.38:0/1956595804 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:51.457 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.447+0000 7ff2514c1700 1 --2- 172.21.15.38:0/1956595804 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff24c142350 0x7ff24c1427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:51.457 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.447+0000 7ff251cc2700 1 -- 172.21.15.38:0/1956595804 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff24c142350 msgr2=0x7ff24c1427b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:51.457 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.447+0000 7ff251cc2700 1 --2- 172.21.15.38:0/1956595804 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff24c142350 0x7ff24c1427b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:51.457 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.447+0000 7ff251cc2700 1 -- 172.21.15.38:0/1956595804 >> v1:172.21.15.38:6789/0 conn(0x7ff24c146380 legacy=0x7ff24c146810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:51.457 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.447+0000 7ff251cc2700 1 -- 172.21.15.38:0/1956595804 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff24c0b2ff0 con 0x7ff24c061a80 2020-06-12T17:48:51.457 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.447+0000 7ff250cc0700 1 -- 172.21.15.38:0/1956595804 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2842295426 0 0) 0x7ff24c0b2dc0 con 0x7ff24c146380 2020-06-12T17:48:51.458 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.447+0000 7ff251cc2700 1 --2- 172.21.15.38:0/1956595804 >> v2:172.21.15.38:3300/0 conn(0x7ff24c061a80 0x7ff24c09bee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff23c002f30 tx=0x7ff23c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.458 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.447+0000 7ff251cc2700 1 --2- 172.21.15.38:0/1956595804 >> v2:172.21.15.38:3300/0 conn(0x7ff24c061a80 0x7ff24c09bee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff23c002f30 tx=0x7ff23c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.458 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.447+0000 7ff251cc2700 1 --2- 172.21.15.38:0/1956595804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff24c061a80 0x7ff24c09bee0 secure :-1 s=READY pgs=305 cs=0 l=1 rx=0x7ff23c002f30 tx=0x7ff23c007e60).ready entity=mon.0 client_cookie=11427a1d01b476bd server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:51.458 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.448+0000 7ff251cc2700 1 --2- 172.21.15.38:0/1956595804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff24c061a80 0x7ff24c09bee0 secure :-1 s=THROTTLE_DONE pgs=305 cs=0 l=1 rx=0x7ff23c002f30 tx=0x7ff23c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.458 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.448+0000 7ff250cc0700 1 -- 172.21.15.38:0/1956595804 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff23c011630 con 0x7ff24c061a80 2020-06-12T17:48:51.459 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.448+0000 7ff251cc2700 1 --2- 172.21.15.38:0/1956595804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff24c061a80 0x7ff24c09bee0 secure :-1 s=THROTTLE_DONE pgs=305 cs=0 l=1 rx=0x7ff23c002f30 tx=0x7ff23c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.459 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.448+0000 7ff251cc2700 1 --2- 172.21.15.38:0/1956595804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff24c061a80 0x7ff24c09bee0 secure :-1 s=THROTTLE_DONE pgs=305 cs=0 l=1 rx=0x7ff23c002f30 tx=0x7ff23c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.459 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.448+0000 7ff250cc0700 1 -- 172.21.15.38:0/1956595804 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23c011790 con 0x7ff24c061a80 2020-06-12T17:48:51.459 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.448+0000 7ff250cc0700 1 -- 172.21.15.38:0/1956595804 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff23c011b70 con 0x7ff24c061a80 2020-06-12T17:48:51.459 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.448+0000 7ff253f26700 1 -- 172.21.15.38:0/1956595804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff24c061a80 msgr2=0x7ff24c09bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:51.460 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.448+0000 7ff253f26700 1 --2- 172.21.15.38:0/1956595804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff24c061a80 0x7ff24c09bee0 secure :-1 s=READY pgs=305 cs=0 l=1 rx=0x7ff23c002f30 tx=0x7ff23c007e60).stop 2020-06-12T17:48:51.460 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.448+0000 7ff253f26700 1 -- 172.21.15.38:0/1956595804 shutdown_connections 2020-06-12T17:48:51.460 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.448+0000 7ff253f26700 1 --2- 172.21.15.38:0/1956595804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff24c061a80 0x7ff24c09bee0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:51.460 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.448+0000 7ff253f26700 1 --2- 172.21.15.38:0/1956595804 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff24c142350 0x7ff24c1427b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:51.460 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.448+0000 7ff253f26700 1 -- 172.21.15.38:0/1956595804 >> 172.21.15.38:0/1956595804 conn(0x7ff24c0b8420 msgr2=0x7ff24c0b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:51.461 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.448+0000 7ff253f26700 1 -- 172.21.15.38:0/1956595804 shutdown_connections 2020-06-12T17:48:51.461 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.448+0000 7ff253f26700 1 -- 172.21.15.38:0/1956595804 wait complete. 2020-06-12T17:48:51.461 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.449+0000 7ff253f26700 1 Processor -- start 2020-06-12T17:48:51.461 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.449+0000 7ff253f26700 1 -- start start 2020-06-12T17:48:51.461 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.450+0000 7ff253f26700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff24c061a80 0x7ff24c0b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:51.462 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.450+0000 7ff253f26700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff24c142350 0x7ff24c153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:51.462 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.450+0000 7ff253f26700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff24c147eb0 con 0x7ff24c146380 2020-06-12T17:48:51.462 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.450+0000 7ff253f26700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff24c148150 con 0x7ff24c061a80 2020-06-12T17:48:51.462 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.450+0000 7ff253f26700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff24c0adf50 con 0x7ff24c142350 2020-06-12T17:48:51.462 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.450+0000 7ff251cc2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff24c061a80 0x7ff24c0b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:51.463 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.450+0000 7ff251cc2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff24c061a80 0x7ff24c0b0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36768/0 (socket says 172.21.15.38:36768) 2020-06-12T17:48:51.463 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.450+0000 7ff2524c3700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff24c146380 0x7ff24c147480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38588/0 (socket says 172.21.15.38:38588) 2020-06-12T17:48:51.463 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.450+0000 7ff251cc2700 1 -- 172.21.15.38:0/1187108027 learned_addr learned my addr 172.21.15.38:0/1187108027 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:51.463 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.450+0000 7ff2514c1700 1 --2- 172.21.15.38:0/1187108027 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff24c142350 0x7ff24c153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:51.463 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.450+0000 7ff251cc2700 1 -- 172.21.15.38:0/1187108027 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff24c142350 msgr2=0x7ff24c153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:51.464 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.450+0000 7ff251cc2700 1 --2- 172.21.15.38:0/1187108027 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff24c142350 0x7ff24c153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:51.464 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.450+0000 7ff251cc2700 1 -- 172.21.15.38:0/1187108027 >> v1:172.21.15.38:6789/0 conn(0x7ff24c146380 legacy=0x7ff24c147480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:51.464 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.450+0000 7ff23affd700 1 -- 172.21.15.38:0/1187108027 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536800751 0 0) 0x7ff24c147eb0 con 0x7ff24c146380 2020-06-12T17:48:51.464 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.450+0000 7ff251cc2700 1 -- 172.21.15.38:0/1187108027 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff24c147b90 con 0x7ff24c061a80 2020-06-12T17:48:51.464 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.450+0000 7ff2514c1700 1 --2- 172.21.15.38:0/1187108027 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff24c142350 0x7ff24c153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:51.464 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.450+0000 7ff251cc2700 1 --2- 172.21.15.38:0/1187108027 >> v2:172.21.15.38:3300/0 conn(0x7ff24c061a80 0x7ff24c0b0850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff23c002f30 tx=0x7ff23c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.465 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.450+0000 7ff251cc2700 1 --2- 172.21.15.38:0/1187108027 >> v2:172.21.15.38:3300/0 conn(0x7ff24c061a80 0x7ff24c0b0850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff23c002f30 tx=0x7ff23c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.465 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.450+0000 7ff251cc2700 1 --2- 172.21.15.38:0/1187108027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff24c061a80 0x7ff24c0b0850 secure :-1 s=READY pgs=307 cs=0 l=1 rx=0x7ff23c002f30 tx=0x7ff23c007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:51.465 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.451+0000 7ff251cc2700 1 --2- 172.21.15.38:0/1187108027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff24c061a80 0x7ff24c0b0850 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7ff23c002f30 tx=0x7ff23c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.465 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.451+0000 7ff251cc2700 1 --2- 172.21.15.38:0/1187108027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff24c061a80 0x7ff24c0b0850 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7ff23c002f30 tx=0x7ff23c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.465 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.451+0000 7ff23affd700 1 -- 172.21.15.38:0/1187108027 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff23c011b30 con 0x7ff24c061a80 2020-06-12T17:48:51.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.451+0000 7ff251cc2700 1 --2- 172.21.15.38:0/1187108027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff24c061a80 0x7ff24c0b0850 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7ff23c002f30 tx=0x7ff23c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.451+0000 7ff23affd700 1 -- 172.21.15.38:0/1187108027 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23c007150 con 0x7ff24c061a80 2020-06-12T17:48:51.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.451+0000 7ff253f26700 1 -- 172.21.15.38:0/1187108027 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff24c0b17f0 con 0x7ff24c061a80 2020-06-12T17:48:51.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.451+0000 7ff23affd700 1 -- 172.21.15.38:0/1187108027 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff23c0074b0 con 0x7ff24c061a80 2020-06-12T17:48:51.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.451+0000 7ff253f26700 1 -- 172.21.15.38:0/1187108027 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff24c153f10 con 0x7ff24c061a80 2020-06-12T17:48:51.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.451+0000 7ff251cc2700 1 --2- 172.21.15.38:0/1187108027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff24c061a80 0x7ff24c0b0850 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7ff23c002f30 tx=0x7ff23c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.452+0000 7ff23affd700 1 -- 172.21.15.38:0/1187108027 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7ff23c0056c0 con 0x7ff24c061a80 2020-06-12T17:48:51.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.452+0000 7ff251cc2700 1 --2- 172.21.15.38:0/1187108027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff24c061a80 0x7ff24c0b0850 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7ff23c002f30 tx=0x7ff23c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.452+0000 7ff253f26700 1 -- 172.21.15.38:0/1187108027 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff24c067b20 con 0x7ff24c061a80 2020-06-12T17:48:51.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.452+0000 7ff23affd700 1 --2- 172.21.15.38:0/1187108027 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff22c04d4f0 0x7ff22c04f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:51.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.452+0000 7ff23affd700 1 -- 172.21.15.38:0/1187108027 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff23c061450 con 0x7ff24c061a80 2020-06-12T17:48:51.470 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.452+0000 7ff2514c1700 1 --2- 172.21.15.38:0/1187108027 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff22c04d4f0 0x7ff22c04f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:51.470 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.452+0000 7ff2514c1700 1 --2- 172.21.15.38:0/1187108027 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff22c04d4f0 0x7ff22c04f9b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff2480032b0 tx=0x7ff2480081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.470 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.453+0000 7ff2514c1700 1 --2- 172.21.15.38:0/1187108027 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff22c04d4f0 0x7ff22c04f9b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff2480032b0 tx=0x7ff2480081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.470 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.453+0000 7ff2514c1700 1 --2- 172.21.15.38:0/1187108027 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff22c04d4f0 0x7ff22c04f9b0 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7ff2480032b0 tx=0x7ff2480081e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:51.470 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.455+0000 7ff251cc2700 1 --2- 172.21.15.38:0/1187108027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff24c061a80 0x7ff24c0b0850 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7ff23c002f30 tx=0x7ff23c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.471 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.455+0000 7ff23affd700 1 -- 172.21.15.38:0/1187108027 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7ff23c03cc70 con 0x7ff24c061a80 2020-06-12T17:48:51.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.658+0000 7ff253f26700 1 -- 172.21.15.38:0/1187108027 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff24c147d20 con 0x7ff24c061a80 2020-06-12T17:48:51.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.658+0000 7ff251cc2700 1 --2- 172.21.15.38:0/1187108027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff24c061a80 0x7ff24c0b0850 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7ff23c002f30 tx=0x7ff23c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.658+0000 7ff23affd700 1 -- 172.21.15.38:0/1187108027 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2137 (secure 0 0 0) 0x7ff23c040290 con 0x7ff24c061a80 2020-06-12T17:48:51.663 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:51.663 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1134306892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1134306892},{"type":"v1","addr":"172.21.15.150:6835","nonce":1134306892}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-06-12T17:48:14.851844+0000","modified":"2020-06-12T17:48:18.530885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4389":{"gid":4389,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.38:6833/4064318189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":4064318189},{"type":"v1","addr":"172.21.15.38:6833","nonce":4064318189}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-06-12T17:48:51.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.660+0000 7ff253f26700 1 -- 172.21.15.38:0/1187108027 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff22c04d4f0 msgr2=0x7ff22c04f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:51.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.660+0000 7ff253f26700 1 --2- 172.21.15.38:0/1187108027 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff22c04d4f0 0x7ff22c04f9b0 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7ff2480032b0 tx=0x7ff2480081e0).stop 2020-06-12T17:48:51.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.660+0000 7ff253f26700 1 -- 172.21.15.38:0/1187108027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff24c061a80 msgr2=0x7ff24c0b0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:51.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.660+0000 7ff253f26700 1 --2- 172.21.15.38:0/1187108027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff24c061a80 0x7ff24c0b0850 secure :-1 s=READY pgs=307 cs=0 l=1 rx=0x7ff23c002f30 tx=0x7ff23c007e60).stop 2020-06-12T17:48:51.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.660+0000 7ff253f26700 1 -- 172.21.15.38:0/1187108027 shutdown_connections 2020-06-12T17:48:51.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.660+0000 7ff253f26700 1 --2- 172.21.15.38:0/1187108027 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff22c04d4f0 0x7ff22c04f9b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:51.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.660+0000 7ff253f26700 1 --2- 172.21.15.38:0/1187108027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff24c061a80 0x7ff24c0b0850 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:51.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.660+0000 7ff253f26700 1 --2- 172.21.15.38:0/1187108027 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff24c142350 0x7ff24c153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:51.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.660+0000 7ff253f26700 1 -- 172.21.15.38:0/1187108027 >> 172.21.15.38:0/1187108027 conn(0x7ff24c0b8420 msgr2=0x7ff24c0b6320 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:51.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.660+0000 7ff253f26700 1 -- 172.21.15.38:0/1187108027 shutdown_connections 2020-06-12T17:48:51.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.660+0000 7ff253f26700 1 -- 172.21.15.38:0/1187108027 wait complete. 2020-06-12T17:48:51.666 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 6 2020-06-12T17:48:51.674 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-06-12T17:48:51.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.786+0000 7f2905187700 1 Processor -- start 2020-06-12T17:48:51.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.786+0000 7f2905187700 1 -- start start 2020-06-12T17:48:51.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.787+0000 7f2905187700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29001401f0 0x7f290009cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:51.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.787+0000 7f2905187700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f29000adaf0 0x7f2900146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:51.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.787+0000 7f2905187700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29000aecd0 con 0x7f29000b3f40 2020-06-12T17:48:51.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.787+0000 7f2905187700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f290009d420 con 0x7f29000adaf0 2020-06-12T17:48:51.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.787+0000 7f2905187700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f290009d6c0 con 0x7f29001401f0 2020-06-12T17:48:51.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.787+0000 7f28fe59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f29000adaf0 0x7f2900146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:51.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.787+0000 7f28fe59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f29000adaf0 0x7f2900146cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36776/0 (socket says 172.21.15.38:36776) 2020-06-12T17:48:51.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.787+0000 7f28fe59c700 1 -- 172.21.15.38:0/2065365429 learned_addr learned my addr 172.21.15.38:0/2065365429 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:51.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.787+0000 7f28fed9d700 1 --2- 172.21.15.38:0/2065365429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29001401f0 0x7f290009cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:51.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.787+0000 7f28fe59c700 1 -- 172.21.15.38:0/2065365429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29001401f0 msgr2=0x7f290009cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:51.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.787+0000 7f28fe59c700 1 --2- 172.21.15.38:0/2065365429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29001401f0 0x7f290009cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:51.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.787+0000 7f28fe59c700 1 -- 172.21.15.38:0/2065365429 >> v1:172.21.15.150:6789/0 conn(0x7f29000b3f40 legacy=0x7f2900143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:51.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.787+0000 7f28fe59c700 1 -- 172.21.15.38:0/2065365429 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29000adf70 con 0x7f29000adaf0 2020-06-12T17:48:51.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.787+0000 7f28fe59c700 1 --2- 172.21.15.38:0/2065365429 >> v2:172.21.15.38:3300/0 conn(0x7f29000adaf0 0x7f2900146cf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f28f0002f30 tx=0x7f28f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.787+0000 7f28fe59c700 1 --2- 172.21.15.38:0/2065365429 >> v2:172.21.15.38:3300/0 conn(0x7f29000adaf0 0x7f2900146cf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f28f0002f30 tx=0x7f28f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.787+0000 7f28fe59c700 1 --2- 172.21.15.38:0/2065365429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29000adaf0 0x7f2900146cf0 secure :-1 s=READY pgs=308 cs=0 l=1 rx=0x7f28f0002f30 tx=0x7f28f0007e60).ready entity=mon.0 client_cookie=b0c6c9cdd2bd8211 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:51.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.788+0000 7f28fe59c700 1 --2- 172.21.15.38:0/2065365429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29000adaf0 0x7f2900146cf0 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7f28f0002f30 tx=0x7f28f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.788+0000 7f28fe59c700 1 --2- 172.21.15.38:0/2065365429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29000adaf0 0x7f2900146cf0 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7f28f0002f30 tx=0x7f28f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.788+0000 7f28fdd9b700 1 -- 172.21.15.38:0/2065365429 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28f00116e0 con 0x7f29000adaf0 2020-06-12T17:48:51.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.788+0000 7f28fe59c700 1 --2- 172.21.15.38:0/2065365429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29000adaf0 0x7f2900146cf0 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7f28f0002f30 tx=0x7f28f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.788+0000 7f28fdd9b700 1 -- 172.21.15.38:0/2065365429 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f0011840 con 0x7f29000adaf0 2020-06-12T17:48:51.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.788+0000 7f28fdd9b700 1 -- 172.21.15.38:0/2065365429 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28f0011c60 con 0x7f29000adaf0 2020-06-12T17:48:51.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.788+0000 7f2905187700 1 -- 172.21.15.38:0/2065365429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29000adaf0 msgr2=0x7f2900146cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:51.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.788+0000 7f2905187700 1 --2- 172.21.15.38:0/2065365429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29000adaf0 0x7f2900146cf0 secure :-1 s=READY pgs=308 cs=0 l=1 rx=0x7f28f0002f30 tx=0x7f28f0007e60).stop 2020-06-12T17:48:51.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.788+0000 7f2905187700 1 -- 172.21.15.38:0/2065365429 shutdown_connections 2020-06-12T17:48:51.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.788+0000 7f2905187700 1 --2- 172.21.15.38:0/2065365429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29001401f0 0x7f290009cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:51.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.788+0000 7f2905187700 1 --2- 172.21.15.38:0/2065365429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29000adaf0 0x7f2900146cf0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:51.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.788+0000 7f2905187700 1 -- 172.21.15.38:0/2065365429 >> 172.21.15.38:0/2065365429 conn(0x7f29000b8410 msgr2=0x7f29000b8820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:51.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.788+0000 7f2905187700 1 -- 172.21.15.38:0/2065365429 shutdown_connections 2020-06-12T17:48:51.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.788+0000 7f2905187700 1 -- 172.21.15.38:0/2065365429 wait complete. 2020-06-12T17:48:51.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.789+0000 7f2905187700 1 Processor -- start 2020-06-12T17:48:51.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.789+0000 7f2905187700 1 -- start start 2020-06-12T17:48:51.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.790+0000 7f2905187700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f29000adaf0 0x7f2900143e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:51.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.790+0000 7f2905187700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f29000b3f40 0x7f29000b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:51.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.790+0000 7f2905187700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29000b2710 con 0x7f29001401f0 2020-06-12T17:48:51.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.790+0000 7f2905187700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2900066240 con 0x7f29000b3f40 2020-06-12T17:48:51.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.790+0000 7f2905187700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29000664e0 con 0x7f29000adaf0 2020-06-12T17:48:51.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.790+0000 7f28fe59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f29000b3f40 0x7f29000b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:51.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.790+0000 7f28fe59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f29000b3f40 0x7f29000b22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36784/0 (socket says 172.21.15.38:36784) 2020-06-12T17:48:51.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.790+0000 7f28fe59c700 1 -- 172.21.15.38:0/2401680181 learned_addr learned my addr 172.21.15.38:0/2401680181 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:51.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.790+0000 7f28fed9d700 1 --2- 172.21.15.38:0/2401680181 >> v2:172.21.15.150:3300/0 conn(0x7f29000adaf0 0x7f2900143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:51.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.790+0000 7f28fe59c700 1 -- 172.21.15.38:0/2401680181 >> v2:172.21.15.150:3300/0 conn(0x7f29000adaf0 msgr2=0x7f2900143e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:51.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.790+0000 7f28fe59c700 1 --2- 172.21.15.38:0/2401680181 >> v2:172.21.15.150:3300/0 conn(0x7f29000adaf0 0x7f2900143e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:51.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.790+0000 7f28fe59c700 1 -- 172.21.15.38:0/2401680181 >> v1:172.21.15.150:6789/0 conn(0x7f29001401f0 legacy=0x7f29000b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:51.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.790+0000 7f28fe59c700 1 -- 172.21.15.38:0/2401680181 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2900156ac0 con 0x7f29000b3f40 2020-06-12T17:48:51.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.790+0000 7f28fe59c700 1 --2- 172.21.15.38:0/2401680181 >> v2:172.21.15.38:3300/0 conn(0x7f29000b3f40 0x7f29000b22b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f28f0002f30 tx=0x7f28f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.805 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.790+0000 7f28fe59c700 1 --2- 172.21.15.38:0/2401680181 >> v2:172.21.15.38:3300/0 conn(0x7f29000b3f40 0x7f29000b22b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f28f0002f30 tx=0x7f28f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.805 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.790+0000 7f28fe59c700 1 --2- 172.21.15.38:0/2401680181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29000b3f40 0x7f29000b22b0 secure :-1 s=READY pgs=309 cs=0 l=1 rx=0x7f28f0002f30 tx=0x7f28f0007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:51.805 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.791+0000 7f28fe59c700 1 --2- 172.21.15.38:0/2401680181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29000b3f40 0x7f29000b22b0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f28f0002f30 tx=0x7f28f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.805 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.791+0000 7f28effff700 1 -- 172.21.15.38:0/2401680181 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28f0011ca0 con 0x7f29000b3f40 2020-06-12T17:48:51.805 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.791+0000 7f28fe59c700 1 --2- 172.21.15.38:0/2401680181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29000b3f40 0x7f29000b22b0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f28f0002f30 tx=0x7f28f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.791+0000 7f28fe59c700 1 --2- 172.21.15.38:0/2401680181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29000b3f40 0x7f29000b22b0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f28f0002f30 tx=0x7f28f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.791+0000 7f28effff700 1 -- 172.21.15.38:0/2401680181 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f0007340 con 0x7f29000b3f40 2020-06-12T17:48:51.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.791+0000 7f2905187700 1 -- 172.21.15.38:0/2401680181 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29000b0960 con 0x7f29000b3f40 2020-06-12T17:48:51.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.791+0000 7f28effff700 1 -- 172.21.15.38:0/2401680181 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28f00056c0 con 0x7f29000b3f40 2020-06-12T17:48:51.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.791+0000 7f2905187700 1 -- 172.21.15.38:0/2401680181 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29001450e0 con 0x7f29000b3f40 2020-06-12T17:48:51.807 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.791+0000 7f28fe59c700 1 --2- 172.21.15.38:0/2401680181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29000b3f40 0x7f29000b22b0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f28f0002f30 tx=0x7f28f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.807 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.792+0000 7f2905187700 1 -- 172.21.15.38:0/2401680181 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2900056c30 con 0x7f29000b3f40 2020-06-12T17:48:51.807 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.792+0000 7f28effff700 1 -- 172.21.15.38:0/2401680181 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f28f0005930 con 0x7f29000b3f40 2020-06-12T17:48:51.807 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.792+0000 7f28fe59c700 1 --2- 172.21.15.38:0/2401680181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29000b3f40 0x7f29000b22b0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f28f0002f30 tx=0x7f28f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.807 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.792+0000 7f28effff700 1 --2- 172.21.15.38:0/2401680181 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f28dc04d5d0 0x7f28dc04fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:51.808 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.792+0000 7f28effff700 1 -- 172.21.15.38:0/2401680181 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f28f0061450 con 0x7f29000b3f40 2020-06-12T17:48:51.808 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.792+0000 7f28fed9d700 1 --2- 172.21.15.38:0/2401680181 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f28dc04d5d0 0x7f28dc04fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:51.808 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.793+0000 7f28fed9d700 1 --2- 172.21.15.38:0/2401680181 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f28dc04d5d0 0x7f28dc04fa90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f28f4002f30 tx=0x7f28f400e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.808 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.793+0000 7f28fed9d700 1 --2- 172.21.15.38:0/2401680181 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f28dc04d5d0 0x7f28dc04fa90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f28f4002f30 tx=0x7f28f400e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.808 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.793+0000 7f28fed9d700 1 --2- 172.21.15.38:0/2401680181 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f28dc04d5d0 0x7f28dc04fa90 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f28f4002f30 tx=0x7f28f400e0c0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:51.808 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.796+0000 7f28fe59c700 1 --2- 172.21.15.38:0/2401680181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29000b3f40 0x7f29000b22b0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f28f0002f30 tx=0x7f28f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:51.809 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.796+0000 7f28effff700 1 -- 172.21.15.38:0/2401680181 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f28f003cc70 con 0x7f29000b3f40 2020-06-12T17:48:52.001 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:51.998+0000 7f2905187700 1 -- 172.21.15.38:0/2401680181 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f29001568d0 con 0x7f29000b3f40 2020-06-12T17:48:52.339 INFO:tasks.ceph.mon.a.smithi038.stderr:2020-06-12T17:48:52.325+0000 7fa8b7f23700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-06-12T17:48:52.370 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.332+0000 7f28fe59c700 1 --2- 172.21.15.38:0/2401680181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29000b3f40 0x7f29000b22b0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f28f0002f30 tx=0x7f28f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.371 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.332+0000 7f28effff700 1 -- 172.21.15.38:0/2401680181 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7f28f0040290 con 0x7f29000b3f40 2020-06-12T17:48:52.371 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.334+0000 7f2905187700 1 -- 172.21.15.38:0/2401680181 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f28dc04d5d0 msgr2=0x7f28dc04fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:52.371 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.334+0000 7f2905187700 1 --2- 172.21.15.38:0/2401680181 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f28dc04d5d0 0x7f28dc04fa90 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f28f4002f30 tx=0x7f28f400e0c0).stop 2020-06-12T17:48:52.371 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.334+0000 7f2905187700 1 -- 172.21.15.38:0/2401680181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29000b3f40 msgr2=0x7f29000b22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:52.371 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.334+0000 7f2905187700 1 --2- 172.21.15.38:0/2401680181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29000b3f40 0x7f29000b22b0 secure :-1 s=READY pgs=309 cs=0 l=1 rx=0x7f28f0002f30 tx=0x7f28f0007e60).stop 2020-06-12T17:48:52.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.334+0000 7f2905187700 1 -- 172.21.15.38:0/2401680181 shutdown_connections 2020-06-12T17:48:52.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.334+0000 7f2905187700 1 --2- 172.21.15.38:0/2401680181 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f28dc04d5d0 0x7f28dc04fa90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:52.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.334+0000 7f2905187700 1 --2- 172.21.15.38:0/2401680181 >> v2:172.21.15.150:3300/0 conn(0x7f29000adaf0 0x7f2900143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:52.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.334+0000 7f2905187700 1 --2- 172.21.15.38:0/2401680181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29000b3f40 0x7f29000b22b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:52.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.334+0000 7f2905187700 1 -- 172.21.15.38:0/2401680181 >> 172.21.15.38:0/2401680181 conn(0x7f29000b8410 msgr2=0x7f29000b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:52.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.334+0000 7f2905187700 1 -- 172.21.15.38:0/2401680181 shutdown_connections 2020-06-12T17:48:52.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.334+0000 7f2905187700 1 -- 172.21.15.38:0/2401680181 wait complete. 2020-06-12T17:48:52.373 INFO:teuthology.orchestra.run.smithi038.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-06-12T17:48:52.374 INFO:tasks.ceph.mds.a.smithi038.stdout:starting mds.a at 2020-06-12T17:48:52.375 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-06-12T17:48:52.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.489+0000 7f214f59e700 1 Processor -- start 2020-06-12T17:48:52.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.489+0000 7f214f59e700 1 -- start start 2020-06-12T17:48:52.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.490+0000 7f214f59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f215005bf20 0x7f21500b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:52.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.490+0000 7f214f59e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2150143350 con 0x7f2150064de0 2020-06-12T17:48:52.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.490+0000 7f214f59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21501435f0 con 0x7f2150142b60 2020-06-12T17:48:52.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.490+0000 7f214f59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2150143890 con 0x7f215005bf20 2020-06-12T17:48:52.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.490+0000 7f214ed9d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f2150064de0 0x7f2150065250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38622/0 (socket says 172.21.15.38:38622) 2020-06-12T17:48:52.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.490+0000 7f214ed9d700 1 -- 172.21.15.38:0/2629057331 learned_addr learned my addr 172.21.15.38:0/2629057331 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:52.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.490+0000 7f214e59c700 1 --2- 172.21.15.38:0/2629057331 >> v2:172.21.15.150:3300/0 conn(0x7f215005bf20 0x7f21500b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:52.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.490+0000 7f214d59a700 1 -- 172.21.15.38:0/2629057331 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2810558924 0 0) 0x7f2150143350 con 0x7f2150064de0 2020-06-12T17:48:52.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.490+0000 7f214d59a700 1 -- 172.21.15.38:0/2629057331 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2134003230 con 0x7f2150064de0 2020-06-12T17:48:52.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.490+0000 7f214d59a700 1 -- 172.21.15.38:0/2629057331 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2201502021 0 0) 0x7f2134003230 con 0x7f2150064de0 2020-06-12T17:48:52.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.490+0000 7f214d59a700 1 -- 172.21.15.38:0/2629057331 >> v2:172.21.15.150:3300/0 conn(0x7f215005bf20 msgr2=0x7f21500b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:52.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.490+0000 7f214d59a700 1 --2- 172.21.15.38:0/2629057331 >> v2:172.21.15.150:3300/0 conn(0x7f215005bf20 0x7f21500b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:52.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.490+0000 7f214d59a700 1 -- 172.21.15.38:0/2629057331 >> v1:172.21.15.150:6789/0 conn(0x7f2150142b60 legacy=0x7f215013c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:52.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.490+0000 7f214d59a700 1 -- 172.21.15.38:0/2629057331 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215005c300 con 0x7f2150064de0 2020-06-12T17:48:52.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.490+0000 7f214d59a700 1 -- 172.21.15.38:0/2629057331 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f2148001a50 con 0x7f2150064de0 2020-06-12T17:48:52.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.490+0000 7f214d59a700 1 -- 172.21.15.38:0/2629057331 >> v1:172.21.15.38:6789/0 conn(0x7f2150064de0 legacy=0x7f2150065250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:52.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.490+0000 7f214d59a700 1 --2- 172.21.15.38:0/2629057331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2134003720 0x7f2134003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:52.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.490+0000 7f214d59a700 1 --2- 172.21.15.38:0/2629057331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21340044d0 0x7f2134004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:52.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.490+0000 7f214d59a700 1 --2- 172.21.15.38:0/2629057331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2134004db0 0x7f213400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:52.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.490+0000 7f214d59a700 1 -- 172.21.15.38:0/2629057331 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2150143890 con 0x7f2134003720 2020-06-12T17:48:52.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.490+0000 7f214d59a700 1 -- 172.21.15.38:0/2629057331 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21340041c0 con 0x7f21340044d0 2020-06-12T17:48:52.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.490+0000 7f214d59a700 1 -- 172.21.15.38:0/2629057331 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213400bb80 con 0x7f2134004db0 2020-06-12T17:48:52.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.491+0000 7f214e59c700 1 --2- 172.21.15.38:0/2629057331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2134003720 0x7f2134003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:52.511 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.491+0000 7f214dd9b700 1 --2- 172.21.15.38:0/2629057331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21340044d0 0x7f2134004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:52.511 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.491+0000 7f214ed9d700 1 --2- 172.21.15.38:0/2629057331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2134004db0 0x7f213400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:52.511 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.491+0000 7f214e59c700 1 -- 172.21.15.38:0/2629057331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2134004db0 msgr2=0x7f213400b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:52.511 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.491+0000 7f214e59c700 1 --2- 172.21.15.38:0/2629057331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2134004db0 0x7f213400b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:52.512 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.491+0000 7f214e59c700 1 -- 172.21.15.38:0/2629057331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21340044d0 msgr2=0x7f2134004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:52.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.491+0000 7f214e59c700 1 --2- 172.21.15.38:0/2629057331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21340044d0 0x7f2134004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:52.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.491+0000 7f214e59c700 1 -- 172.21.15.38:0/2629057331 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2134003230 con 0x7f2134003720 2020-06-12T17:48:52.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.491+0000 7f214ed9d700 1 -- 172.21.15.38:0/2629057331 reap_dead start 2020-06-12T17:48:52.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.491+0000 7f214e59c700 1 --2- 172.21.15.38:0/2629057331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2134003720 0x7f2134003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2140002f30 tx=0x7f2140007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.491+0000 7f214e59c700 1 --2- 172.21.15.38:0/2629057331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2134003720 0x7f2134003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2140002f30 tx=0x7f2140007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.491+0000 7f214e59c700 1 --2- 172.21.15.38:0/2629057331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2134003720 0x7f2134003b40 secure :-1 s=READY pgs=315 cs=0 l=1 rx=0x7f2140002f30 tx=0x7f2140007e60).ready entity=mon.0 client_cookie=262dae86e984327c server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:52.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.491+0000 7f214e59c700 1 --2- 172.21.15.38:0/2629057331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2134003720 0x7f2134003b40 secure :-1 s=THROTTLE_DONE pgs=315 cs=0 l=1 rx=0x7f2140002f30 tx=0x7f2140007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.491+0000 7f214d59a700 1 -- 172.21.15.38:0/2629057331 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2140008d30 con 0x7f2134003720 2020-06-12T17:48:52.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.491+0000 7f214e59c700 1 --2- 172.21.15.38:0/2629057331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2134003720 0x7f2134003b40 secure :-1 s=THROTTLE_DONE pgs=315 cs=0 l=1 rx=0x7f2140002f30 tx=0x7f2140007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.491+0000 7f214e59c700 1 --2- 172.21.15.38:0/2629057331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2134003720 0x7f2134003b40 secure :-1 s=THROTTLE_DONE pgs=315 cs=0 l=1 rx=0x7f2140002f30 tx=0x7f2140007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.491+0000 7f214d59a700 1 -- 172.21.15.38:0/2629057331 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2140008e90 con 0x7f2134003720 2020-06-12T17:48:52.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.491+0000 7f214d59a700 1 -- 172.21.15.38:0/2629057331 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2140010ae0 con 0x7f2134003720 2020-06-12T17:48:52.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.491+0000 7f214f59e700 1 -- 172.21.15.38:0/2629057331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2134003720 msgr2=0x7f2134003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:52.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.491+0000 7f214f59e700 1 --2- 172.21.15.38:0/2629057331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2134003720 0x7f2134003b40 secure :-1 s=READY pgs=315 cs=0 l=1 rx=0x7f2140002f30 tx=0x7f2140007e60).stop 2020-06-12T17:48:52.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.492+0000 7f214f59e700 1 -- 172.21.15.38:0/2629057331 shutdown_connections 2020-06-12T17:48:52.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.492+0000 7f214f59e700 1 --2- 172.21.15.38:0/2629057331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2134003720 0x7f2134003b40 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:52.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.492+0000 7f214f59e700 1 -- 172.21.15.38:0/2629057331 >> 172.21.15.38:0/2629057331 conn(0x7f21500b8cf0 msgr2=0x7f21500b4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:52.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.492+0000 7f214f59e700 1 -- 172.21.15.38:0/2629057331 shutdown_connections 2020-06-12T17:48:52.517 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.492+0000 7f214f59e700 1 -- 172.21.15.38:0/2629057331 wait complete. 2020-06-12T17:48:52.517 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.493+0000 7f214f59e700 1 Processor -- start 2020-06-12T17:48:52.518 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.493+0000 7f214f59e700 1 -- start start 2020-06-12T17:48:52.518 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.493+0000 7f214f59e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2134003720 0x7f2150143a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:52.518 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.493+0000 7f214f59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21501465a0 0x7f2150156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:52.518 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.493+0000 7f214f59e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21500b33a0 con 0x7f21500b2f40 2020-06-12T17:48:52.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.493+0000 7f214f59e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f215013e220 con 0x7f2134003720 2020-06-12T17:48:52.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.493+0000 7f214f59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2150145e60 con 0x7f21501465a0 2020-06-12T17:48:52.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.493+0000 7f214e59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2134003720 0x7f2150143a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:52.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.493+0000 7f214dd9b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f21500b2f40 0x7f2150136ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38630/0 (socket says 172.21.15.38:38630) 2020-06-12T17:48:52.520 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.493+0000 7f214dd9b700 1 -- 172.21.15.38:0/82629888 learned_addr learned my addr 172.21.15.38:0/82629888 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:52.520 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.494+0000 7f214ed9d700 1 --2- 172.21.15.38:0/82629888 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21501465a0 0x7f2150156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:52.520 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.494+0000 7f214e59c700 1 -- 172.21.15.38:0/82629888 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21501465a0 msgr2=0x7f2150156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:52.520 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.494+0000 7f214e59c700 1 --2- 172.21.15.38:0/82629888 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21501465a0 0x7f2150156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:52.520 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.494+0000 7f214e59c700 1 -- 172.21.15.38:0/82629888 >> v1:172.21.15.38:6789/0 conn(0x7f21500b2f40 legacy=0x7f2150136ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:52.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.494+0000 7f214e59c700 1 -- 172.21.15.38:0/82629888 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2150146100 con 0x7f2134003720 2020-06-12T17:48:52.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.494+0000 7f213f7fe700 1 -- 172.21.15.38:0/82629888 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722943394 0 0) 0x7f21501435f0 con 0x7f21500b2f40 2020-06-12T17:48:52.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.494+0000 7f214e59c700 1 --2- 172.21.15.38:0/82629888 >> v2:172.21.15.38:3300/0 conn(0x7f2134003720 0x7f2150143a90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2140002f30 tx=0x7f2140007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.494+0000 7f214e59c700 1 --2- 172.21.15.38:0/82629888 >> v2:172.21.15.38:3300/0 conn(0x7f2134003720 0x7f2150143a90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2140002f30 tx=0x7f2140007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.494+0000 7f214e59c700 1 --2- 172.21.15.38:0/82629888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2134003720 0x7f2150143a90 secure :-1 s=READY pgs=317 cs=0 l=1 rx=0x7f2140002f30 tx=0x7f2140007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:52.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.494+0000 7f214e59c700 1 --2- 172.21.15.38:0/82629888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2134003720 0x7f2150143a90 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f2140002f30 tx=0x7f2140007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.494+0000 7f213f7fe700 1 -- 172.21.15.38:0/82629888 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f214000f5f0 con 0x7f2134003720 2020-06-12T17:48:52.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.494+0000 7f214e59c700 1 --2- 172.21.15.38:0/82629888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2134003720 0x7f2150143a90 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f2140002f30 tx=0x7f2140007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.494+0000 7f214e59c700 1 --2- 172.21.15.38:0/82629888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2134003720 0x7f2150143a90 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f2140002f30 tx=0x7f2140007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.494+0000 7f213f7fe700 1 -- 172.21.15.38:0/82629888 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214000f750 con 0x7f2134003720 2020-06-12T17:48:52.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.494+0000 7f213f7fe700 1 -- 172.21.15.38:0/82629888 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21400058b0 con 0x7f2134003720 2020-06-12T17:48:52.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.494+0000 7f214f59e700 1 -- 172.21.15.38:0/82629888 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2150146a00 con 0x7f2134003720 2020-06-12T17:48:52.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.494+0000 7f214f59e700 1 -- 172.21.15.38:0/82629888 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21501448c0 con 0x7f2134003720 2020-06-12T17:48:52.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.495+0000 7f214e59c700 1 --2- 172.21.15.38:0/82629888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2134003720 0x7f2150143a90 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f2140002f30 tx=0x7f2140007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.495+0000 7f213f7fe700 1 -- 172.21.15.38:0/82629888 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f2140005ae0 con 0x7f2134003720 2020-06-12T17:48:52.528 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.495+0000 7f214e59c700 1 --2- 172.21.15.38:0/82629888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2134003720 0x7f2150143a90 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f2140002f30 tx=0x7f2140007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.528 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.495+0000 7f214f59e700 1 -- 172.21.15.38:0/82629888 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f215013e060 con 0x7f2134003720 2020-06-12T17:48:52.528 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.495+0000 7f213f7fe700 1 --2- 172.21.15.38:0/82629888 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f212c04d580 0x7f212c04fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:52.528 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.495+0000 7f213f7fe700 1 -- 172.21.15.38:0/82629888 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f2140061360 con 0x7f2134003720 2020-06-12T17:48:52.528 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.496+0000 7f214dd9b700 1 --2- 172.21.15.38:0/82629888 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f212c04d580 0x7f212c04fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:52.529 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.496+0000 7f214dd9b700 1 --2- 172.21.15.38:0/82629888 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f212c04d580 0x7f212c04fa40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2144000fa0 tx=0x7f21440018d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.529 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.496+0000 7f214dd9b700 1 --2- 172.21.15.38:0/82629888 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f212c04d580 0x7f212c04fa40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2144000fa0 tx=0x7f21440018d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.529 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.496+0000 7f214dd9b700 1 --2- 172.21.15.38:0/82629888 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f212c04d580 0x7f212c04fa40 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7f2144000fa0 tx=0x7f21440018d0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:52.529 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.499+0000 7f214e59c700 1 --2- 172.21.15.38:0/82629888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2134003720 0x7f2150143a90 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f2140002f30 tx=0x7f2140007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.529 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.499+0000 7f213f7fe700 1 -- 172.21.15.38:0/82629888 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f214003cb80 con 0x7f2134003720 2020-06-12T17:48:52.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.700+0000 7f214f59e700 1 -- 172.21.15.38:0/82629888 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2150146290 con 0x7f2134003720 2020-06-12T17:48:52.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.700+0000 7f214e59c700 1 --2- 172.21.15.38:0/82629888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2134003720 0x7f2150143a90 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f2140002f30 tx=0x7f2140007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.700+0000 7f213f7fe700 1 -- 172.21.15.38:0/82629888 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+1777 (secure 0 0 0) 0x7f21400401a0 con 0x7f2134003720 2020-06-12T17:48:52.704 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:52.705 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1134306892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1134306892},{"type":"v1","addr":"172.21.15.150:6835","nonce":1134306892}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":7,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-06-12T17:48:14.851844+0000","modified":"2020-06-12T17:48:52.326165+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-06-12T17:48:52.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.702+0000 7f214f59e700 1 -- 172.21.15.38:0/82629888 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f212c04d580 msgr2=0x7f212c04fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:52.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.702+0000 7f214f59e700 1 --2- 172.21.15.38:0/82629888 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f212c04d580 0x7f212c04fa40 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7f2144000fa0 tx=0x7f21440018d0).stop 2020-06-12T17:48:52.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.702+0000 7f214f59e700 1 -- 172.21.15.38:0/82629888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2134003720 msgr2=0x7f2150143a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:52.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.702+0000 7f214f59e700 1 --2- 172.21.15.38:0/82629888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2134003720 0x7f2150143a90 secure :-1 s=READY pgs=317 cs=0 l=1 rx=0x7f2140002f30 tx=0x7f2140007e60).stop 2020-06-12T17:48:52.707 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.702+0000 7f214f59e700 1 -- 172.21.15.38:0/82629888 shutdown_connections 2020-06-12T17:48:52.707 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.702+0000 7f214f59e700 1 --2- 172.21.15.38:0/82629888 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f212c04d580 0x7f212c04fa40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:52.707 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.702+0000 7f214f59e700 1 --2- 172.21.15.38:0/82629888 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21501465a0 0x7f2150156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:52.707 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.702+0000 7f214f59e700 1 --2- 172.21.15.38:0/82629888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2134003720 0x7f2150143a90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:52.707 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.702+0000 7f214f59e700 1 -- 172.21.15.38:0/82629888 >> 172.21.15.38:0/82629888 conn(0x7f21500b8cf0 msgr2=0x7f21500652f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:52.708 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.702+0000 7f214f59e700 1 -- 172.21.15.38:0/82629888 shutdown_connections 2020-06-12T17:48:52.708 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.702+0000 7f214f59e700 1 -- 172.21.15.38:0/82629888 wait complete. 2020-06-12T17:48:52.708 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 7 2020-06-12T17:48:52.716 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-06-12T17:48:52.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.830+0000 7f2684e90700 1 Processor -- start 2020-06-12T17:48:52.834 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.830+0000 7f2684e90700 1 -- start start 2020-06-12T17:48:52.836 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.831+0000 7f2684e90700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2680146680 0x7f26800ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.831+0000 7f2684e90700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26800b2eb0 0x7f268009d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.831+0000 7f2684e90700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2680146d20 con 0x7f268009d620 2020-06-12T17:48:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.831+0000 7f2684e90700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2680066a80 con 0x7f2680146680 2020-06-12T17:48:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.831+0000 7f2684e90700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2680146f50 con 0x7f26800b2eb0 2020-06-12T17:48:52.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.831+0000 7f267e59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2680146680 0x7f26800ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:52.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.831+0000 7f267e59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2680146680 0x7f26800ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36822/0 (socket says 172.21.15.38:36822) 2020-06-12T17:48:52.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.831+0000 7f267e59c700 1 -- 172.21.15.38:0/2022011677 learned_addr learned my addr 172.21.15.38:0/2022011677 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:52.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.831+0000 7f267dd9b700 1 --2- 172.21.15.38:0/2022011677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26800b2eb0 0x7f268009d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:52.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.831+0000 7f267e59c700 1 -- 172.21.15.38:0/2022011677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26800b2eb0 msgr2=0x7f268009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:52.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.831+0000 7f267e59c700 1 --2- 172.21.15.38:0/2022011677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26800b2eb0 0x7f268009d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:52.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.831+0000 7f267e59c700 1 -- 172.21.15.38:0/2022011677 >> v1:172.21.15.150:6789/0 conn(0x7f268009d620 legacy=0x7f268009b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:52.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.831+0000 7f267e59c700 1 -- 172.21.15.38:0/2022011677 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2680146a60 con 0x7f2680146680 2020-06-12T17:48:52.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.832+0000 7f267e59c700 1 --2- 172.21.15.38:0/2022011677 >> v2:172.21.15.38:3300/0 conn(0x7f2680146680 0x7f26800ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2674002f30 tx=0x7f2674007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.832+0000 7f267e59c700 1 --2- 172.21.15.38:0/2022011677 >> v2:172.21.15.38:3300/0 conn(0x7f2680146680 0x7f26800ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2674002f30 tx=0x7f2674007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.832+0000 7f267e59c700 1 --2- 172.21.15.38:0/2022011677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2680146680 0x7f26800ad5b0 secure :-1 s=READY pgs=318 cs=0 l=1 rx=0x7f2674002f30 tx=0x7f2674007e60).ready entity=mon.0 client_cookie=6d4e88c848b39a2d server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.832+0000 7f267e59c700 1 --2- 172.21.15.38:0/2022011677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2680146680 0x7f26800ad5b0 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7f2674002f30 tx=0x7f2674007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.832+0000 7f267e59c700 1 --2- 172.21.15.38:0/2022011677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2680146680 0x7f26800ad5b0 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7f2674002f30 tx=0x7f2674007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.832+0000 7f267d59a700 1 -- 172.21.15.38:0/2022011677 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26740116e0 con 0x7f2680146680 2020-06-12T17:48:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.832+0000 7f267e59c700 1 --2- 172.21.15.38:0/2022011677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2680146680 0x7f26800ad5b0 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7f2674002f30 tx=0x7f2674007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.841 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.832+0000 7f267d59a700 1 -- 172.21.15.38:0/2022011677 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2674011840 con 0x7f2680146680 2020-06-12T17:48:52.841 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.832+0000 7f267d59a700 1 -- 172.21.15.38:0/2022011677 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2674011c60 con 0x7f2680146680 2020-06-12T17:48:52.841 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.832+0000 7f2684e90700 1 -- 172.21.15.38:0/2022011677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2680146680 msgr2=0x7f26800ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:52.841 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.832+0000 7f2684e90700 1 --2- 172.21.15.38:0/2022011677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2680146680 0x7f26800ad5b0 secure :-1 s=READY pgs=318 cs=0 l=1 rx=0x7f2674002f30 tx=0x7f2674007e60).stop 2020-06-12T17:48:52.841 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.832+0000 7f2684e90700 1 -- 172.21.15.38:0/2022011677 shutdown_connections 2020-06-12T17:48:52.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.832+0000 7f2684e90700 1 --2- 172.21.15.38:0/2022011677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2680146680 0x7f26800ad5b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:52.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.832+0000 7f2684e90700 1 --2- 172.21.15.38:0/2022011677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26800b2eb0 0x7f268009d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:52.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.832+0000 7f2684e90700 1 -- 172.21.15.38:0/2022011677 >> 172.21.15.38:0/2022011677 conn(0x7f26800b5a20 msgr2=0x7f268005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:52.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.832+0000 7f2684e90700 1 -- 172.21.15.38:0/2022011677 shutdown_connections 2020-06-12T17:48:52.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.832+0000 7f2684e90700 1 -- 172.21.15.38:0/2022011677 wait complete. 2020-06-12T17:48:52.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.833+0000 7f2684e90700 1 Processor -- start 2020-06-12T17:48:52.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.833+0000 7f2684e90700 1 -- start start 2020-06-12T17:48:52.846 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.834+0000 7f2684e90700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f268009d620 0x7f26800663b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:52.846 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.834+0000 7f2684e90700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f26800b2eb0 0x7f26800afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:52.846 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.834+0000 7f2684e90700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26800b1210 con 0x7f2680146680 2020-06-12T17:48:52.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.834+0000 7f2684e90700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26800b1470 con 0x7f26800b2eb0 2020-06-12T17:48:52.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.834+0000 7f2684e90700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26800b0350 con 0x7f268009d620 2020-06-12T17:48:52.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.834+0000 7f267dd9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f26800b2eb0 0x7f26800afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:52.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.834+0000 7f267dd9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f26800b2eb0 0x7f26800afad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36832/0 (socket says 172.21.15.38:36832) 2020-06-12T17:48:52.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.834+0000 7f267dd9b700 1 -- 172.21.15.38:0/269833979 learned_addr learned my addr 172.21.15.38:0/269833979 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:52.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.834+0000 7f267e59c700 1 --2- 172.21.15.38:0/269833979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f268009d620 0x7f26800663b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:52.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.834+0000 7f267dd9b700 1 -- 172.21.15.38:0/269833979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f268009d620 msgr2=0x7f26800663b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:52.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.834+0000 7f267dd9b700 1 --2- 172.21.15.38:0/269833979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f268009d620 0x7f26800663b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:52.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.834+0000 7f267dd9b700 1 -- 172.21.15.38:0/269833979 >> v1:172.21.15.150:6789/0 conn(0x7f2680146680 legacy=0x7f26800618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:52.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.834+0000 7f267dd9b700 1 -- 172.21.15.38:0/269833979 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2680061ff0 con 0x7f26800b2eb0 2020-06-12T17:48:52.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.835+0000 7f267dd9b700 1 --2- 172.21.15.38:0/269833979 >> v2:172.21.15.38:3300/0 conn(0x7f26800b2eb0 0x7f26800afad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2670002f30 tx=0x7f267000e210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.835+0000 7f267dd9b700 1 --2- 172.21.15.38:0/269833979 >> v2:172.21.15.38:3300/0 conn(0x7f26800b2eb0 0x7f26800afad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2670002f30 tx=0x7f267000e210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.835+0000 7f267dd9b700 1 --2- 172.21.15.38:0/269833979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26800b2eb0 0x7f26800afad0 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7f2670002f30 tx=0x7f267000e210).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:52.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.835+0000 7f267dd9b700 1 --2- 172.21.15.38:0/269833979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26800b2eb0 0x7f26800afad0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f2670002f30 tx=0x7f267000e210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.850 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.835+0000 7f267dd9b700 1 --2- 172.21.15.38:0/269833979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26800b2eb0 0x7f26800afad0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f2670002f30 tx=0x7f267000e210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.850 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.835+0000 7f266f7fe700 1 -- 172.21.15.38:0/269833979 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2670012850 con 0x7f26800b2eb0 2020-06-12T17:48:52.850 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.835+0000 7f267dd9b700 1 --2- 172.21.15.38:0/269833979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26800b2eb0 0x7f26800afad0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f2670002f30 tx=0x7f267000e210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.850 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.835+0000 7f266f7fe700 1 -- 172.21.15.38:0/269833979 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26700129b0 con 0x7f26800b2eb0 2020-06-12T17:48:52.851 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.835+0000 7f2684e90700 1 -- 172.21.15.38:0/269833979 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26800aff30 con 0x7f26800b2eb0 2020-06-12T17:48:52.851 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.835+0000 7f266f7fe700 1 -- 172.21.15.38:0/269833979 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2670012dd0 con 0x7f26800b2eb0 2020-06-12T17:48:52.851 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.835+0000 7f2684e90700 1 -- 172.21.15.38:0/269833979 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26800aeef0 con 0x7f26800b2eb0 2020-06-12T17:48:52.851 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.835+0000 7f267dd9b700 1 --2- 172.21.15.38:0/269833979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26800b2eb0 0x7f26800afad0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f2670002f30 tx=0x7f267000e210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.852 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.836+0000 7f266f7fe700 1 -- 172.21.15.38:0/269833979 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f2670007170 con 0x7f26800b2eb0 2020-06-12T17:48:52.852 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.836+0000 7f267dd9b700 1 --2- 172.21.15.38:0/269833979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26800b2eb0 0x7f26800afad0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f2670002f30 tx=0x7f267000e210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.852 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.836+0000 7f2684e90700 1 -- 172.21.15.38:0/269833979 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2680056c30 con 0x7f26800b2eb0 2020-06-12T17:48:52.853 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.836+0000 7f266f7fe700 1 --2- 172.21.15.38:0/269833979 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f265c04d560 0x7f265c04fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:52.853 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.837+0000 7f266f7fe700 1 -- 172.21.15.38:0/269833979 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f26700610b0 con 0x7f26800b2eb0 2020-06-12T17:48:52.853 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.837+0000 7f267e59c700 1 --2- 172.21.15.38:0/269833979 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f265c04d560 0x7f265c04fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:52.853 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.837+0000 7f267e59c700 1 --2- 172.21.15.38:0/269833979 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f265c04d560 0x7f265c04fa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2674002f30 tx=0x7f2674007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.853 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.837+0000 7f267e59c700 1 --2- 172.21.15.38:0/269833979 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f265c04d560 0x7f265c04fa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2674002f30 tx=0x7f2674007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.854 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.837+0000 7f267e59c700 1 --2- 172.21.15.38:0/269833979 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f265c04d560 0x7f265c04fa20 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f2674002f30 tx=0x7f2674007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:52.854 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.840+0000 7f267dd9b700 1 --2- 172.21.15.38:0/269833979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26800b2eb0 0x7f26800afad0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f2670002f30 tx=0x7f267000e210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:52.854 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:52.840+0000 7f266f7fe700 1 -- 172.21.15.38:0/269833979 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f267003c870 con 0x7f26800b2eb0 2020-06-12T17:48:53.045 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.041+0000 7f2684e90700 1 -- 172.21.15.38:0/269833979 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f268005a5e0 con 0x7f26800b2eb0 2020-06-12T17:48:53.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.334+0000 7f267dd9b700 1 --2- 172.21.15.38:0/269833979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26800b2eb0 0x7f26800afad0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f2670002f30 tx=0x7f267000e210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:53.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.334+0000 7f266f7fe700 1 -- 172.21.15.38:0/269833979 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f267003fe90 con 0x7f26800b2eb0 2020-06-12T17:48:53.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.336+0000 7f2684e90700 1 -- 172.21.15.38:0/269833979 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f265c04d560 msgr2=0x7f265c04fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:53.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.336+0000 7f2684e90700 1 --2- 172.21.15.38:0/269833979 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f265c04d560 0x7f265c04fa20 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f2674002f30 tx=0x7f2674007e60).stop 2020-06-12T17:48:53.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.336+0000 7f2684e90700 1 -- 172.21.15.38:0/269833979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26800b2eb0 msgr2=0x7f26800afad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:53.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.336+0000 7f2684e90700 1 --2- 172.21.15.38:0/269833979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26800b2eb0 0x7f26800afad0 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7f2670002f30 tx=0x7f267000e210).stop 2020-06-12T17:48:53.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.336+0000 7f2684e90700 1 -- 172.21.15.38:0/269833979 shutdown_connections 2020-06-12T17:48:53.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.336+0000 7f2684e90700 1 --2- 172.21.15.38:0/269833979 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f265c04d560 0x7f265c04fa20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:53.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.336+0000 7f2684e90700 1 --2- 172.21.15.38:0/269833979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f268009d620 0x7f26800663b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:53.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.336+0000 7f2684e90700 1 --2- 172.21.15.38:0/269833979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26800b2eb0 0x7f26800afad0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:53.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.336+0000 7f2684e90700 1 -- 172.21.15.38:0/269833979 >> 172.21.15.38:0/269833979 conn(0x7f26800b5a20 msgr2=0x7f268009b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:53.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.336+0000 7f2684e90700 1 -- 172.21.15.38:0/269833979 shutdown_connections 2020-06-12T17:48:53.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.336+0000 7f2684e90700 1 -- 172.21.15.38:0/269833979 wait complete. 2020-06-12T17:48:53.351 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-06-12T17:48:53.471 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.467+0000 7f47f9179700 1 Processor -- start 2020-06-12T17:48:53.471 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.467+0000 7f47f9179700 1 -- start start 2020-06-12T17:48:53.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.468+0000 7f47f9179700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f47f4065d70 0x7f47f4066580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:53.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.468+0000 7f47f9179700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f47f4140090 0x7f47f4145f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:53.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.468+0000 7f47f9179700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f414a2e0 con 0x7f47f40b4690 2020-06-12T17:48:53.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.468+0000 7f47f9179700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f40aef40 con 0x7f47f4140090 2020-06-12T17:48:53.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.468+0000 7f47f9179700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f4066150 con 0x7f47f4065d70 2020-06-12T17:48:53.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.468+0000 7f47f8978700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f47f4140090 0x7f47f4145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:53.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.468+0000 7f47ebfff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f47f40b4690 0x7f47f413f980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38654/0 (socket says 172.21.15.38:38654) 2020-06-12T17:48:53.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.468+0000 7f47ebfff700 1 -- 172.21.15.38:0/2182608467 learned_addr learned my addr 172.21.15.38:0/2182608467 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:53.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.469+0000 7f47f3fff700 1 --2- 172.21.15.38:0/2182608467 >> v2:172.21.15.150:3300/0 conn(0x7f47f4065d70 0x7f47f4066580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:53.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.469+0000 7f47f8978700 1 -- 172.21.15.38:0/2182608467 >> v2:172.21.15.150:3300/0 conn(0x7f47f4065d70 msgr2=0x7f47f4066580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:53.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.469+0000 7f47f8978700 1 --2- 172.21.15.38:0/2182608467 >> v2:172.21.15.150:3300/0 conn(0x7f47f4065d70 0x7f47f4066580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:53.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.469+0000 7f47f8978700 1 -- 172.21.15.38:0/2182608467 >> v1:172.21.15.38:6789/0 conn(0x7f47f40b4690 legacy=0x7f47f413f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:53.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.469+0000 7f47f8978700 1 -- 172.21.15.38:0/2182608467 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f40af3e0 con 0x7f47f4140090 2020-06-12T17:48:53.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.469+0000 7f47f37fe700 1 -- 172.21.15.38:0/2182608467 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597026311 0 0) 0x7f47f414a2e0 con 0x7f47f40b4690 2020-06-12T17:48:53.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.469+0000 7f47f3fff700 1 --2- 172.21.15.38:0/2182608467 >> v2:172.21.15.150:3300/0 conn(0x7f47f4065d70 0x7f47f4066580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:48:53.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.469+0000 7f47f8978700 1 --2- 172.21.15.38:0/2182608467 >> v2:172.21.15.38:3300/0 conn(0x7f47f4140090 0x7f47f4145f80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f47ec0032b0 tx=0x7f47ec0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:53.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.469+0000 7f47f8978700 1 --2- 172.21.15.38:0/2182608467 >> v2:172.21.15.38:3300/0 conn(0x7f47f4140090 0x7f47f4145f80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f47ec0032b0 tx=0x7f47ec0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:53.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.469+0000 7f47f8978700 1 --2- 172.21.15.38:0/2182608467 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47f4140090 0x7f47f4145f80 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7f47ec0032b0 tx=0x7f47ec0081e0).ready entity=mon.0 client_cookie=a358562beba3dfd0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:53.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.469+0000 7f47f8978700 1 --2- 172.21.15.38:0/2182608467 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47f4140090 0x7f47f4145f80 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7f47ec0032b0 tx=0x7f47ec0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:53.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.469+0000 7f47f37fe700 1 -- 172.21.15.38:0/2182608467 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47ec011e90 con 0x7f47f4140090 2020-06-12T17:48:53.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.469+0000 7f47f8978700 1 --2- 172.21.15.38:0/2182608467 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47f4140090 0x7f47f4145f80 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7f47ec0032b0 tx=0x7f47ec0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:53.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.469+0000 7f47f8978700 1 --2- 172.21.15.38:0/2182608467 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47f4140090 0x7f47f4145f80 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7f47ec0032b0 tx=0x7f47ec0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:53.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.469+0000 7f47f37fe700 1 -- 172.21.15.38:0/2182608467 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ec00a160 con 0x7f47f4140090 2020-06-12T17:48:53.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.469+0000 7f47f37fe700 1 -- 172.21.15.38:0/2182608467 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47ec00a500 con 0x7f47f4140090 2020-06-12T17:48:53.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.469+0000 7f47f9179700 1 -- 172.21.15.38:0/2182608467 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47f4140090 msgr2=0x7f47f4145f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:53.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.469+0000 7f47f9179700 1 --2- 172.21.15.38:0/2182608467 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47f4140090 0x7f47f4145f80 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7f47ec0032b0 tx=0x7f47ec0081e0).stop 2020-06-12T17:48:53.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.469+0000 7f47f9179700 1 -- 172.21.15.38:0/2182608467 shutdown_connections 2020-06-12T17:48:53.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.469+0000 7f47f9179700 1 --2- 172.21.15.38:0/2182608467 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47f4140090 0x7f47f4145f80 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:53.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.469+0000 7f47f9179700 1 --2- 172.21.15.38:0/2182608467 >> v2:172.21.15.150:3300/0 conn(0x7f47f4065d70 0x7f47f4066580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:53.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.469+0000 7f47f9179700 1 -- 172.21.15.38:0/2182608467 >> 172.21.15.38:0/2182608467 conn(0x7f47f40b4cc0 msgr2=0x7f47f40b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:53.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.469+0000 7f47f9179700 1 -- 172.21.15.38:0/2182608467 shutdown_connections 2020-06-12T17:48:53.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.470+0000 7f47f9179700 1 -- 172.21.15.38:0/2182608467 wait complete. 2020-06-12T17:48:53.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.470+0000 7f47f9179700 1 Processor -- start 2020-06-12T17:48:53.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.470+0000 7f47f9179700 1 -- start start 2020-06-12T17:48:53.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.471+0000 7f47f9179700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47f40b4690 0x7f47f40b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:53.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.471+0000 7f47f9179700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f4143f70 con 0x7f47f4065d70 2020-06-12T17:48:53.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.471+0000 7f47f9179700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f4144210 con 0x7f47f4140090 2020-06-12T17:48:53.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.471+0000 7f47f9179700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f40af780 con 0x7f47f40b4690 2020-06-12T17:48:53.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.471+0000 7f47f3fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f47f4065d70 0x7f47f413e0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38660/0 (socket says 172.21.15.38:38660) 2020-06-12T17:48:53.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.471+0000 7f47f3fff700 1 -- 172.21.15.38:0/3530259734 learned_addr learned my addr 172.21.15.38:0/3530259734 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:53.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.471+0000 7f47f1ffb700 1 -- 172.21.15.38:0/3530259734 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2004449050 0 0) 0x7f47f4143f70 con 0x7f47f4065d70 2020-06-12T17:48:53.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.471+0000 7f47f1ffb700 1 -- 172.21.15.38:0/3530259734 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47d8002fe0 con 0x7f47f4065d70 2020-06-12T17:48:53.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.471+0000 7f47ebfff700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47f40b4690 0x7f47f40b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:53.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47f1ffb700 1 -- 172.21.15.38:0/3530259734 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3473041701 0 0) 0x7f47d8002fe0 con 0x7f47f4065d70 2020-06-12T17:48:53.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47f1ffb700 1 -- 172.21.15.38:0/3530259734 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f47f4143f70 con 0x7f47f4065d70 2020-06-12T17:48:53.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47f1ffb700 1 -- 172.21.15.38:0/3530259734 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f47e40026d0 con 0x7f47f4065d70 2020-06-12T17:48:53.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47f1ffb700 1 -- 172.21.15.38:0/3530259734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47f40b4690 msgr2=0x7f47f40b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:53.502 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47f1ffb700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47f40b4690 0x7f47f40b20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:53.502 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47f1ffb700 1 -- 172.21.15.38:0/3530259734 >> v1:172.21.15.150:6789/0 conn(0x7f47f4140090 legacy=0x7f47f40afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:53.502 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47f1ffb700 1 -- 172.21.15.38:0/3530259734 >> v1:172.21.15.38:6789/0 conn(0x7f47f4065d70 legacy=0x7f47f413e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:53.502 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47f1ffb700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47d80049b0 0x7f47d8004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:53.502 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47f1ffb700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47f40b4690 0x7f47d8003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:53.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47f1ffb700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47d8003d80 0x7f47d8004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:53.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47f1ffb700 1 -- 172.21.15.38:0/3530259734 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f40af780 con 0x7f47d80049b0 2020-06-12T17:48:53.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47f1ffb700 1 -- 172.21.15.38:0/3530259734 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d8004780 con 0x7f47d8003d80 2020-06-12T17:48:53.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47f1ffb700 1 -- 172.21.15.38:0/3530259734 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d80053c0 con 0x7f47f40b4690 2020-06-12T17:48:53.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47f3fff700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47d80049b0 0x7f47d8004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:53.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47f8978700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47d8003d80 0x7f47d8004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:53.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47ebfff700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47f40b4690 0x7f47d8003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:53.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47f3fff700 1 -- 172.21.15.38:0/3530259734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47f40b4690 msgr2=0x7f47d8003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:53.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47f3fff700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47f40b4690 0x7f47d8003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:53.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47f3fff700 1 -- 172.21.15.38:0/3530259734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47d8003d80 msgr2=0x7f47d8004200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:53.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47f3fff700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47d8003d80 0x7f47d8004200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:53.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47f3fff700 1 -- 172.21.15.38:0/3530259734 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f413e7e0 con 0x7f47d80049b0 2020-06-12T17:48:53.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47f9179700 1 -- 172.21.15.38:0/3530259734 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f4143bf0 con 0x7f47d80049b0 2020-06-12T17:48:53.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47f9179700 1 -- 172.21.15.38:0/3530259734 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f40b0330 con 0x7f47d80049b0 2020-06-12T17:48:53.506 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47f3fff700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47d80049b0 0x7f47d8004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f47e4002460 tx=0x7f47e40113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:53.506 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47f3fff700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47d80049b0 0x7f47d8004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f47e4002460 tx=0x7f47e40113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:53.506 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47f3fff700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47d80049b0 0x7f47d8004dd0 secure :-1 s=READY pgs=323 cs=0 l=1 rx=0x7f47e4002460 tx=0x7f47e40113e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:53.506 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.472+0000 7f47f3fff700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47d80049b0 0x7f47d8004dd0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f47e4002460 tx=0x7f47e40113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:53.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.473+0000 7f47f1ffb700 1 -- 172.21.15.38:0/3530259734 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47e400ce00 con 0x7f47d80049b0 2020-06-12T17:48:53.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.473+0000 7f47f3fff700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47d80049b0 0x7f47d8004dd0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f47e4002460 tx=0x7f47e40113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:53.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.473+0000 7f47f3fff700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47d80049b0 0x7f47d8004dd0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f47e4002460 tx=0x7f47e40113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:53.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.473+0000 7f47f1ffb700 1 -- 172.21.15.38:0/3530259734 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e4011970 con 0x7f47d80049b0 2020-06-12T17:48:53.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.473+0000 7f47f1ffb700 1 -- 172.21.15.38:0/3530259734 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47e4011d90 con 0x7f47d80049b0 2020-06-12T17:48:53.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.473+0000 7f47f3fff700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47d80049b0 0x7f47d8004dd0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f47e4002460 tx=0x7f47e40113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:53.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.473+0000 7f47f9179700 1 -- 172.21.15.38:0/3530259734 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47cc003340 con 0x7f47d80049b0 2020-06-12T17:48:53.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.474+0000 7f47f1ffb700 1 -- 172.21.15.38:0/3530259734 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f47e40056c0 con 0x7f47d80049b0 2020-06-12T17:48:53.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.474+0000 7f47f3fff700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47d80049b0 0x7f47d8004dd0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f47e4002460 tx=0x7f47e40113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:53.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.474+0000 7f47f1ffb700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f47d8055810 0x7f47d8057cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:53.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.474+0000 7f47f1ffb700 1 -- 172.21.15.38:0/3530259734 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f47e4061070 con 0x7f47d80049b0 2020-06-12T17:48:53.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.474+0000 7f47ebfff700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f47d8055810 0x7f47d8057cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:53.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.474+0000 7f47ebfff700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f47d8055810 0x7f47d8057cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f47dc000b80 tx=0x7f47dc0016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:53.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.474+0000 7f47ebfff700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f47d8055810 0x7f47d8057cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f47dc000b80 tx=0x7f47dc0016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:53.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.474+0000 7f47ebfff700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f47d8055810 0x7f47d8057cd0 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7f47dc000b80 tx=0x7f47dc0016e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:53.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.477+0000 7f47f3fff700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47d80049b0 0x7f47d8004dd0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f47e4002460 tx=0x7f47e40113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:53.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.477+0000 7f47f1ffb700 1 -- 172.21.15.38:0/3530259734 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f47e403c7b0 con 0x7f47d80049b0 2020-06-12T17:48:53.632 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:53.629+0000 7f47f9179700 1 -- 172.21.15.38:0/3530259734 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f47cc002280 con 0x7f47d80049b0 2020-06-12T17:48:54.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.345+0000 7f47f3fff700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47d80049b0 0x7f47d8004dd0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7f47e4002460 tx=0x7f47e40113e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:54.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.345+0000 7f47f1ffb700 1 -- 172.21.15.38:0/3530259734 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 185+0+0 (secure 0 0 0) 0x7f47e403fdd0 con 0x7f47d80049b0 2020-06-12T17:48:54.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.348+0000 7f47f9179700 1 -- 172.21.15.38:0/3530259734 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f47d8055810 msgr2=0x7f47d8057cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:54.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.348+0000 7f47f9179700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f47d8055810 0x7f47d8057cd0 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7f47dc000b80 tx=0x7f47dc0016e0).stop 2020-06-12T17:48:54.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.348+0000 7f47f9179700 1 -- 172.21.15.38:0/3530259734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47d80049b0 msgr2=0x7f47d8004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:54.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.348+0000 7f47f9179700 1 --2- 172.21.15.38:0/3530259734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47d80049b0 0x7f47d8004dd0 secure :-1 s=READY pgs=323 cs=0 l=1 rx=0x7f47e4002460 tx=0x7f47e40113e0).stop 2020-06-12T17:48:54.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.348+0000 7f47f8978700 1 -- 172.21.15.38:0/3530259734 reap_dead start 2020-06-12T17:48:54.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.348+0000 7f47f8978700 1 -- 172.21.15.38:0/3530259734 reap_dead start 2020-06-12T17:48:54.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.348+0000 7f47f9179700 1 -- 172.21.15.38:0/3530259734 shutdown_connections 2020-06-12T17:48:54.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.348+0000 7f47f9179700 1 -- 172.21.15.38:0/3530259734 >> 172.21.15.38:0/3530259734 conn(0x7f47f40b4cc0 msgr2=0x7f47f40b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:54.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.348+0000 7f47f9179700 1 -- 172.21.15.38:0/3530259734 shutdown_connections 2020-06-12T17:48:54.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.348+0000 7f47f9179700 1 -- 172.21.15.38:0/3530259734 wait complete. 2020-06-12T17:48:54.354 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' removed 2020-06-12T17:48:54.364 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-06-12T17:48:54.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.485+0000 7f3dfcbe9700 1 Processor -- start 2020-06-12T17:48:54.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.485+0000 7f3dfcbe9700 1 -- start start 2020-06-12T17:48:54.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.486+0000 7f3dfcbe9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3df809d0b0 0x7f3df813c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:54.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.486+0000 7f3dfcbe9700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df809b960 con 0x7f3df809df00 2020-06-12T17:48:54.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.486+0000 7f3dfcbe9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df809bc00 con 0x7f3df80b3ac0 2020-06-12T17:48:54.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.486+0000 7f3dfcbe9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df80b48f0 con 0x7f3df809d0b0 2020-06-12T17:48:54.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.486+0000 7f3df5d9b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f3df809df00 0x7f3df8066790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38674/0 (socket says 172.21.15.38:38674) 2020-06-12T17:48:54.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.486+0000 7f3df5d9b700 1 -- 172.21.15.38:0/1990306081 learned_addr learned my addr 172.21.15.38:0/1990306081 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:54.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.486+0000 7f3df6d9d700 1 --2- 172.21.15.38:0/1990306081 >> v2:172.21.15.150:3300/0 conn(0x7f3df809d0b0 0x7f3df813c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:54.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.487+0000 7f3df559a700 1 -- 172.21.15.38:0/1990306081 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1791907600 0 0) 0x7f3df809b960 con 0x7f3df809df00 2020-06-12T17:48:54.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.487+0000 7f3df559a700 1 -- 172.21.15.38:0/1990306081 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ddc003230 con 0x7f3df809df00 2020-06-12T17:48:54.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.487+0000 7f3df559a700 1 -- 172.21.15.38:0/1990306081 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3139444799 0 0) 0x7f3ddc003230 con 0x7f3df809df00 2020-06-12T17:48:54.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.487+0000 7f3df559a700 1 -- 172.21.15.38:0/1990306081 >> v2:172.21.15.150:3300/0 conn(0x7f3df809d0b0 msgr2=0x7f3df813c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:54.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.487+0000 7f3df559a700 1 --2- 172.21.15.38:0/1990306081 >> v2:172.21.15.150:3300/0 conn(0x7f3df809d0b0 0x7f3df813c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:54.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.487+0000 7f3df559a700 1 -- 172.21.15.38:0/1990306081 >> v1:172.21.15.150:6789/0 conn(0x7f3df80b3ac0 legacy=0x7f3df813bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:54.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.487+0000 7f3df559a700 1 -- 172.21.15.38:0/1990306081 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df80b3ea0 con 0x7f3df809df00 2020-06-12T17:48:54.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.487+0000 7f3df559a700 1 -- 172.21.15.38:0/1990306081 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f3de80016d0 con 0x7f3df809df00 2020-06-12T17:48:54.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.487+0000 7f3df559a700 1 -- 172.21.15.38:0/1990306081 >> v1:172.21.15.38:6789/0 conn(0x7f3df809df00 legacy=0x7f3df8066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:54.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.487+0000 7f3df559a700 1 --2- 172.21.15.38:0/1990306081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ddc003720 0x7f3ddc003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:54.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.487+0000 7f3df559a700 1 --2- 172.21.15.38:0/1990306081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ddc0044d0 0x7f3ddc004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:54.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.487+0000 7f3df559a700 1 --2- 172.21.15.38:0/1990306081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ddc004db0 0x7f3ddc00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:54.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.487+0000 7f3df559a700 1 -- 172.21.15.38:0/1990306081 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df80b48f0 con 0x7f3ddc0044d0 2020-06-12T17:48:54.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.487+0000 7f3df559a700 1 -- 172.21.15.38:0/1990306081 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc0041c0 con 0x7f3ddc004db0 2020-06-12T17:48:54.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.487+0000 7f3df559a700 1 -- 172.21.15.38:0/1990306081 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc00bb80 con 0x7f3ddc003720 2020-06-12T17:48:54.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.487+0000 7f3df5d9b700 1 --2- 172.21.15.38:0/1990306081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ddc0044d0 0x7f3ddc004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:54.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.487+0000 7f3df6d9d700 1 --2- 172.21.15.38:0/1990306081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ddc004db0 0x7f3ddc00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:54.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.487+0000 7f3df659c700 1 --2- 172.21.15.38:0/1990306081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ddc003720 0x7f3ddc003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:54.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.487+0000 7f3df5d9b700 1 -- 172.21.15.38:0/1990306081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ddc003720 msgr2=0x7f3ddc003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:54.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.487+0000 7f3df5d9b700 1 --2- 172.21.15.38:0/1990306081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ddc003720 0x7f3ddc003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:54.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.487+0000 7f3df5d9b700 1 -- 172.21.15.38:0/1990306081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ddc004db0 msgr2=0x7f3ddc00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:54.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.487+0000 7f3df5d9b700 1 --2- 172.21.15.38:0/1990306081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ddc004db0 0x7f3ddc00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:54.502 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.487+0000 7f3df6d9d700 1 -- 172.21.15.38:0/1990306081 reap_dead start 2020-06-12T17:48:54.502 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.487+0000 7f3df5d9b700 1 -- 172.21.15.38:0/1990306081 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc003230 con 0x7f3ddc0044d0 2020-06-12T17:48:54.502 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.487+0000 7f3df5d9b700 1 --2- 172.21.15.38:0/1990306081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ddc0044d0 0x7f3ddc004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3de80013e0 tx=0x7f3df8142490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:54.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.488+0000 7f3df5d9b700 1 --2- 172.21.15.38:0/1990306081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ddc0044d0 0x7f3ddc004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3de80013e0 tx=0x7f3df8142490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:54.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.488+0000 7f3df5d9b700 1 --2- 172.21.15.38:0/1990306081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ddc0044d0 0x7f3ddc004950 secure :-1 s=READY pgs=325 cs=0 l=1 rx=0x7f3de80013e0 tx=0x7f3df8142490).ready entity=mon.0 client_cookie=f8bedb4d9167de30 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:54.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.488+0000 7f3df5d9b700 1 --2- 172.21.15.38:0/1990306081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ddc0044d0 0x7f3ddc004950 secure :-1 s=THROTTLE_DONE pgs=325 cs=0 l=1 rx=0x7f3de80013e0 tx=0x7f3df8142490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:54.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.488+0000 7f3df5d9b700 1 --2- 172.21.15.38:0/1990306081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ddc0044d0 0x7f3ddc004950 secure :-1 s=THROTTLE_DONE pgs=325 cs=0 l=1 rx=0x7f3de80013e0 tx=0x7f3df8142490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:54.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.488+0000 7f3df559a700 1 -- 172.21.15.38:0/1990306081 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3de8010d80 con 0x7f3ddc0044d0 2020-06-12T17:48:54.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.488+0000 7f3df559a700 1 -- 172.21.15.38:0/1990306081 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de80055e0 con 0x7f3ddc0044d0 2020-06-12T17:48:54.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.488+0000 7f3df5d9b700 1 --2- 172.21.15.38:0/1990306081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ddc0044d0 0x7f3ddc004950 secure :-1 s=THROTTLE_DONE pgs=325 cs=0 l=1 rx=0x7f3de80013e0 tx=0x7f3df8142490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:54.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.488+0000 7f3df559a700 1 -- 172.21.15.38:0/1990306081 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3de8005980 con 0x7f3ddc0044d0 2020-06-12T17:48:54.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.488+0000 7f3dfcbe9700 1 -- 172.21.15.38:0/1990306081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ddc0044d0 msgr2=0x7f3ddc004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:54.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.488+0000 7f3dfcbe9700 1 --2- 172.21.15.38:0/1990306081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ddc0044d0 0x7f3ddc004950 secure :-1 s=READY pgs=325 cs=0 l=1 rx=0x7f3de80013e0 tx=0x7f3df8142490).stop 2020-06-12T17:48:54.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.488+0000 7f3dfcbe9700 1 -- 172.21.15.38:0/1990306081 shutdown_connections 2020-06-12T17:48:54.506 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.488+0000 7f3dfcbe9700 1 --2- 172.21.15.38:0/1990306081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ddc0044d0 0x7f3ddc004950 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:54.506 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.488+0000 7f3dfcbe9700 1 -- 172.21.15.38:0/1990306081 >> 172.21.15.38:0/1990306081 conn(0x7f3df80b5a20 msgr2=0x7f3df805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:54.506 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.488+0000 7f3dfcbe9700 1 -- 172.21.15.38:0/1990306081 shutdown_connections 2020-06-12T17:48:54.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.488+0000 7f3dfcbe9700 1 -- 172.21.15.38:0/1990306081 wait complete. 2020-06-12T17:48:54.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.489+0000 7f3dfcbe9700 1 Processor -- start 2020-06-12T17:48:54.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.489+0000 7f3dfcbe9700 1 -- start start 2020-06-12T17:48:54.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.490+0000 7f3dfcbe9700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3ddc0044d0 0x7f3df80b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:54.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.490+0000 7f3dfcbe9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3df80b1e20 0x7f3df81349d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:54.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.490+0000 7f3dfcbe9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df80b2450 con 0x7f3df813fa50 2020-06-12T17:48:54.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.490+0000 7f3dfcbe9700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df80638c0 con 0x7f3ddc0044d0 2020-06-12T17:48:54.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.490+0000 7f3dfcbe9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df8063b60 con 0x7f3df80b1e20 2020-06-12T17:48:54.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.490+0000 7f3df659c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3ddc0044d0 0x7f3df80b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:54.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.490+0000 7f3df659c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3ddc0044d0 0x7f3df80b06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36870/0 (socket says 172.21.15.38:36870) 2020-06-12T17:48:54.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.490+0000 7f3df659c700 1 -- 172.21.15.38:0/2243445420 learned_addr learned my addr 172.21.15.38:0/2243445420 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:54.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.490+0000 7f3df6d9d700 1 --2- 172.21.15.38:0/2243445420 >> v2:172.21.15.150:3300/0 conn(0x7f3df80b1e20 0x7f3df81349d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:54.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.490+0000 7f3df659c700 1 -- 172.21.15.38:0/2243445420 >> v2:172.21.15.150:3300/0 conn(0x7f3df80b1e20 msgr2=0x7f3df81349d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:54.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.490+0000 7f3df659c700 1 --2- 172.21.15.38:0/2243445420 >> v2:172.21.15.150:3300/0 conn(0x7f3df80b1e20 0x7f3df81349d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:54.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.490+0000 7f3df659c700 1 -- 172.21.15.38:0/2243445420 >> v1:172.21.15.150:6789/0 conn(0x7f3df813fa50 legacy=0x7f3df81342c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:54.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.490+0000 7f3df659c700 1 -- 172.21.15.38:0/2243445420 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df8063e00 con 0x7f3ddc0044d0 2020-06-12T17:48:54.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.490+0000 7f3df659c700 1 --2- 172.21.15.38:0/2243445420 >> v2:172.21.15.38:3300/0 conn(0x7f3ddc0044d0 0x7f3df80b06e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3df80ae340 tx=0x7f3dec001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:54.511 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.490+0000 7f3df659c700 1 --2- 172.21.15.38:0/2243445420 >> v2:172.21.15.38:3300/0 conn(0x7f3ddc0044d0 0x7f3df80b06e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3df80ae340 tx=0x7f3dec001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:54.511 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.490+0000 7f3df659c700 1 --2- 172.21.15.38:0/2243445420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ddc0044d0 0x7f3df80b06e0 secure :-1 s=READY pgs=326 cs=0 l=1 rx=0x7f3df80ae340 tx=0x7f3dec001840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:54.511 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.491+0000 7f3df659c700 1 --2- 172.21.15.38:0/2243445420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ddc0044d0 0x7f3df80b06e0 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f3df80ae340 tx=0x7f3dec001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:54.511 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.491+0000 7f3df659c700 1 --2- 172.21.15.38:0/2243445420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ddc0044d0 0x7f3df80b06e0 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f3df80ae340 tx=0x7f3dec001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:54.511 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.491+0000 7f3de77fe700 1 -- 172.21.15.38:0/2243445420 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dec001e60 con 0x7f3ddc0044d0 2020-06-12T17:48:54.512 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.491+0000 7f3df659c700 1 --2- 172.21.15.38:0/2243445420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ddc0044d0 0x7f3df80b06e0 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f3df80ae340 tx=0x7f3dec001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:54.512 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.491+0000 7f3de77fe700 1 -- 172.21.15.38:0/2243445420 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dec00c840 con 0x7f3ddc0044d0 2020-06-12T17:48:54.512 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.491+0000 7f3dfcbe9700 1 -- 172.21.15.38:0/2243445420 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df8134e30 con 0x7f3ddc0044d0 2020-06-12T17:48:54.512 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.491+0000 7f3de77fe700 1 -- 172.21.15.38:0/2243445420 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dec00cba0 con 0x7f3ddc0044d0 2020-06-12T17:48:54.512 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.491+0000 7f3dfcbe9700 1 -- 172.21.15.38:0/2243445420 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df8158330 con 0x7f3ddc0044d0 2020-06-12T17:48:54.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.491+0000 7f3df659c700 1 --2- 172.21.15.38:0/2243445420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ddc0044d0 0x7f3df80b06e0 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f3df80ae340 tx=0x7f3dec001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:54.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.492+0000 7f3de77fe700 1 -- 172.21.15.38:0/2243445420 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f3dec013060 con 0x7f3ddc0044d0 2020-06-12T17:48:54.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.492+0000 7f3df659c700 1 --2- 172.21.15.38:0/2243445420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ddc0044d0 0x7f3df80b06e0 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f3df80ae340 tx=0x7f3dec001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:54.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.492+0000 7f3dfcbe9700 1 -- 172.21.15.38:0/2243445420 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df8056c30 con 0x7f3ddc0044d0 2020-06-12T17:48:54.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.492+0000 7f3de77fe700 1 --2- 172.21.15.38:0/2243445420 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3dd404d590 0x7f3dd404fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:54.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.492+0000 7f3de77fe700 1 -- 172.21.15.38:0/2243445420 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6079+0+0 (secure 0 0 0) 0x7f3dec060c70 con 0x7f3ddc0044d0 2020-06-12T17:48:54.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.492+0000 7f3df5d9b700 1 --2- 172.21.15.38:0/2243445420 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3dd404d590 0x7f3dd404fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:54.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.492+0000 7f3df5d9b700 1 --2- 172.21.15.38:0/2243445420 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3dd404d590 0x7f3dd404fa50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3df8062dd0 tx=0x7f3df8142490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:54.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.492+0000 7f3df5d9b700 1 --2- 172.21.15.38:0/2243445420 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3dd404d590 0x7f3dd404fa50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3df8062dd0 tx=0x7f3df8142490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:54.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.492+0000 7f3df5d9b700 1 --2- 172.21.15.38:0/2243445420 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3dd404d590 0x7f3dd404fa50 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7f3df8062dd0 tx=0x7f3df8142490).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:54.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.495+0000 7f3df659c700 1 --2- 172.21.15.38:0/2243445420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ddc0044d0 0x7f3df80b06e0 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f3df80ae340 tx=0x7f3dec001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:54.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.495+0000 7f3de77fe700 1 -- 172.21.15.38:0/2243445420 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f3dec03c3d0 con 0x7f3ddc0044d0 2020-06-12T17:48:54.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:54.648+0000 7f3dfcbe9700 1 -- 172.21.15.38:0/2243445420 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3df805a5e0 con 0x7f3ddc0044d0 2020-06-12T17:48:55.361 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.357+0000 7f3df659c700 1 --2- 172.21.15.38:0/2243445420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ddc0044d0 0x7f3df80b06e0 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f3df80ae340 tx=0x7f3dec001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:55.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.357+0000 7f3de77fe700 1 -- 172.21.15.38:0/2243445420 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 173+0+0 (secure 0 0 0) 0x7f3dec03f9f0 con 0x7f3ddc0044d0 2020-06-12T17:48:55.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.360+0000 7f3dfcbe9700 1 -- 172.21.15.38:0/2243445420 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3dd404d590 msgr2=0x7f3dd404fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:55.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.360+0000 7f3dfcbe9700 1 --2- 172.21.15.38:0/2243445420 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3dd404d590 0x7f3dd404fa50 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7f3df8062dd0 tx=0x7f3df8142490).stop 2020-06-12T17:48:55.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.360+0000 7f3dfcbe9700 1 -- 172.21.15.38:0/2243445420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ddc0044d0 msgr2=0x7f3df80b06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:55.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.360+0000 7f3dfcbe9700 1 --2- 172.21.15.38:0/2243445420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ddc0044d0 0x7f3df80b06e0 secure :-1 s=READY pgs=326 cs=0 l=1 rx=0x7f3df80ae340 tx=0x7f3dec001840).stop 2020-06-12T17:48:55.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.360+0000 7f3dfcbe9700 1 -- 172.21.15.38:0/2243445420 shutdown_connections 2020-06-12T17:48:55.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.360+0000 7f3dfcbe9700 1 --2- 172.21.15.38:0/2243445420 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3dd404d590 0x7f3dd404fa50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:55.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.360+0000 7f3dfcbe9700 1 --2- 172.21.15.38:0/2243445420 >> v2:172.21.15.150:3300/0 conn(0x7f3df80b1e20 0x7f3df81349d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:55.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.360+0000 7f3dfcbe9700 1 --2- 172.21.15.38:0/2243445420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ddc0044d0 0x7f3df80b06e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:55.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.360+0000 7f3dfcbe9700 1 -- 172.21.15.38:0/2243445420 >> 172.21.15.38:0/2243445420 conn(0x7f3df80b5a20 msgr2=0x7f3df80b77a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:55.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.360+0000 7f3dfcbe9700 1 -- 172.21.15.38:0/2243445420 shutdown_connections 2020-06-12T17:48:55.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.361+0000 7f3dfcbe9700 1 -- 172.21.15.38:0/2243445420 wait complete. 2020-06-12T17:48:55.366 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' removed 2020-06-12T17:48:55.377 INFO:tasks.ceph.mds.a:Restarting daemon 2020-06-12T17:48:55.378 INFO:tasks.ceph.mds.a:Stopping old one... 2020-06-12T17:48:55.378 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-06-12T17:48:55.378 INFO:teuthology.orchestra.run:waiting for 300 2020-06-12T17:48:55.379 INFO:tasks.ceph.mds.b:Restarting daemon 2020-06-12T17:48:55.379 INFO:tasks.ceph.mds.b:Stopping old one... 2020-06-12T17:48:55.379 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-06-12T17:48:55.379 INFO:teuthology.orchestra.run:waiting for 300 2020-06-12T17:48:55.388 INFO:tasks.ceph.mds.a:Stopped 2020-06-12T17:48:55.389 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-06-12T17:48:55.390 INFO:tasks.ceph.mds.b:Stopped 2020-06-12T17:48:55.390 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-06-12T17:48:55.430 INFO:tasks.ceph.mds.a:Started 2020-06-12T17:48:55.431 DEBUG:teuthology.parallel:result is None 2020-06-12T17:48:55.433 INFO:tasks.ceph.mds.b:Started 2020-06-12T17:48:55.433 DEBUG:teuthology.parallel:result is None 2020-06-12T17:48:55.434 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-06-12T17:48:55.514 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2020-06-12T17:48:55.517 INFO:tasks.ceph.mds.a.smithi038.stdout:starting mds.a at 2020-06-12T17:48:55.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.556+0000 7f6fb89ac700 1 Processor -- start 2020-06-12T17:48:55.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.556+0000 7f6fb89ac700 1 -- start start 2020-06-12T17:48:55.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.557+0000 7f6fb89ac700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6fb405b7a0 0x7f6fb4146070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:55.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.557+0000 7f6fb89ac700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6fb41464d0 0x7f6fb4064fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:55.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.557+0000 7f6fb89ac700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb40b2ba0 con 0x7f6fb4065400 2020-06-12T17:48:55.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.557+0000 7f6fb89ac700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb4145970 con 0x7f6fb41464d0 2020-06-12T17:48:55.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.557+0000 7f6fb89ac700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb4065890 con 0x7f6fb405b7a0 2020-06-12T17:48:55.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.557+0000 7f6fb2ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6fb41464d0 0x7f6fb4064fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:55.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.557+0000 7f6fb3fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6fb4065400 0x7f6fb4062780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38708/0 (socket says 172.21.15.38:38708) 2020-06-12T17:48:55.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.557+0000 7f6fb3fff700 1 -- 172.21.15.38:0/4075681459 learned_addr learned my addr 172.21.15.38:0/4075681459 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:55.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.557+0000 7f6fb37fe700 1 --2- 172.21.15.38:0/4075681459 >> v2:172.21.15.150:3300/0 conn(0x7f6fb405b7a0 0x7f6fb4146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:55.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.557+0000 7f6fb2ffd700 1 -- 172.21.15.38:0/4075681459 >> v2:172.21.15.150:3300/0 conn(0x7f6fb405b7a0 msgr2=0x7f6fb4146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:55.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.557+0000 7f6fb2ffd700 1 --2- 172.21.15.38:0/4075681459 >> v2:172.21.15.150:3300/0 conn(0x7f6fb405b7a0 0x7f6fb4146070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:55.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.557+0000 7f6fb2ffd700 1 -- 172.21.15.38:0/4075681459 >> v1:172.21.15.38:6789/0 conn(0x7f6fb4065400 legacy=0x7f6fb4062780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:55.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.557+0000 7f6fb2ffd700 1 -- 172.21.15.38:0/4075681459 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb40b2dd0 con 0x7f6fb41464d0 2020-06-12T17:48:55.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.557+0000 7f6fb27fc700 1 -- 172.21.15.38:0/4075681459 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407387337 0 0) 0x7f6fb40b2ba0 con 0x7f6fb4065400 2020-06-12T17:48:55.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.557+0000 7f6fb37fe700 1 --2- 172.21.15.38:0/4075681459 >> v2:172.21.15.150:3300/0 conn(0x7f6fb405b7a0 0x7f6fb4146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:55.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.557+0000 7f6fb2ffd700 1 --2- 172.21.15.38:0/4075681459 >> v2:172.21.15.38:3300/0 conn(0x7f6fb41464d0 0x7f6fb4064fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6fb4064eb0 tx=0x7f6f9c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:55.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.557+0000 7f6fb2ffd700 1 --2- 172.21.15.38:0/4075681459 >> v2:172.21.15.38:3300/0 conn(0x7f6fb41464d0 0x7f6fb4064fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6fb4064eb0 tx=0x7f6f9c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:55.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.557+0000 7f6fb2ffd700 1 --2- 172.21.15.38:0/4075681459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fb41464d0 0x7f6fb4064fa0 secure :-1 s=READY pgs=332 cs=0 l=1 rx=0x7f6fb4064eb0 tx=0x7f6f9c007e60).ready entity=mon.0 client_cookie=864e1fe7cceb04b9 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:55.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.557+0000 7f6fb2ffd700 1 --2- 172.21.15.38:0/4075681459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fb41464d0 0x7f6fb4064fa0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f6fb4064eb0 tx=0x7f6f9c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:55.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.557+0000 7f6fb27fc700 1 -- 172.21.15.38:0/4075681459 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f9c0113f0 con 0x7f6fb41464d0 2020-06-12T17:48:55.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.557+0000 7f6fb2ffd700 1 --2- 172.21.15.38:0/4075681459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fb41464d0 0x7f6fb4064fa0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f6fb4064eb0 tx=0x7f6f9c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:55.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.557+0000 7f6fb2ffd700 1 --2- 172.21.15.38:0/4075681459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fb41464d0 0x7f6fb4064fa0 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f6fb4064eb0 tx=0x7f6f9c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:55.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.557+0000 7f6fb27fc700 1 -- 172.21.15.38:0/4075681459 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9c011550 con 0x7f6fb41464d0 2020-06-12T17:48:55.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.557+0000 7f6fb27fc700 1 -- 172.21.15.38:0/4075681459 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f9c011930 con 0x7f6fb41464d0 2020-06-12T17:48:55.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.557+0000 7f6fb89ac700 1 -- 172.21.15.38:0/4075681459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fb41464d0 msgr2=0x7f6fb4064fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:55.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.557+0000 7f6fb89ac700 1 --2- 172.21.15.38:0/4075681459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fb41464d0 0x7f6fb4064fa0 secure :-1 s=READY pgs=332 cs=0 l=1 rx=0x7f6fb4064eb0 tx=0x7f6f9c007e60).stop 2020-06-12T17:48:55.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.558+0000 7f6fb89ac700 1 -- 172.21.15.38:0/4075681459 shutdown_connections 2020-06-12T17:48:55.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.558+0000 7f6fb89ac700 1 --2- 172.21.15.38:0/4075681459 >> v2:172.21.15.150:3300/0 conn(0x7f6fb405b7a0 0x7f6fb4146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:55.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.558+0000 7f6fb89ac700 1 --2- 172.21.15.38:0/4075681459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fb41464d0 0x7f6fb4064fa0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:55.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.558+0000 7f6fb89ac700 1 -- 172.21.15.38:0/4075681459 >> 172.21.15.38:0/4075681459 conn(0x7f6fb4061460 msgr2=0x7f6fb4061870 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:55.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.558+0000 7f6fb89ac700 1 -- 172.21.15.38:0/4075681459 shutdown_connections 2020-06-12T17:48:55.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.558+0000 7f6fb89ac700 1 -- 172.21.15.38:0/4075681459 wait complete. 2020-06-12T17:48:55.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.559+0000 7f6fb89ac700 1 Processor -- start 2020-06-12T17:48:55.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.559+0000 7f6fb89ac700 1 -- start start 2020-06-12T17:48:55.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.560+0000 7f6fb89ac700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6fb405b7a0 0x7f6fb40af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:55.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.560+0000 7f6fb89ac700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6fb41464d0 0x7f6fb40b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:55.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.560+0000 7f6fb89ac700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb40b0980 con 0x7f6fb4065400 2020-06-12T17:48:55.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.560+0000 7f6fb89ac700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb4155370 con 0x7f6fb41464d0 2020-06-12T17:48:55.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.560+0000 7f6fb89ac700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb4155610 con 0x7f6fb405b7a0 2020-06-12T17:48:55.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.560+0000 7f6fb3fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6fb41464d0 0x7f6fb40b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:55.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.560+0000 7f6fb3fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6fb41464d0 0x7f6fb40b21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36898/0 (socket says 172.21.15.38:36898) 2020-06-12T17:48:55.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.560+0000 7f6fb3fff700 1 -- 172.21.15.38:0/3656694037 learned_addr learned my addr 172.21.15.38:0/3656694037 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:55.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.560+0000 7f6fb37fe700 1 --2- 172.21.15.38:0/3656694037 >> v2:172.21.15.150:3300/0 conn(0x7f6fb405b7a0 0x7f6fb40af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:55.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.560+0000 7f6fb3fff700 1 -- 172.21.15.38:0/3656694037 >> v2:172.21.15.150:3300/0 conn(0x7f6fb405b7a0 msgr2=0x7f6fb40af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:55.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.560+0000 7f6fb3fff700 1 --2- 172.21.15.38:0/3656694037 >> v2:172.21.15.150:3300/0 conn(0x7f6fb405b7a0 0x7f6fb40af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:55.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.560+0000 7f6fb3fff700 1 -- 172.21.15.38:0/3656694037 >> v1:172.21.15.150:6789/0 conn(0x7f6fb4065400 legacy=0x7f6fb413cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:55.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.560+0000 7f6fb3fff700 1 -- 172.21.15.38:0/3656694037 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb40acf50 con 0x7f6fb41464d0 2020-06-12T17:48:55.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.560+0000 7f6fb3fff700 1 --2- 172.21.15.38:0/3656694037 >> v2:172.21.15.38:3300/0 conn(0x7f6fb41464d0 0x7f6fb40b21e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6fa4000e90 tx=0x7f6fa4001730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:55.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.560+0000 7f6fb3fff700 1 --2- 172.21.15.38:0/3656694037 >> v2:172.21.15.38:3300/0 conn(0x7f6fb41464d0 0x7f6fb40b21e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6fa4000e90 tx=0x7f6fa4001730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:55.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.560+0000 7f6fb3fff700 1 --2- 172.21.15.38:0/3656694037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fb41464d0 0x7f6fb40b21e0 secure :-1 s=READY pgs=333 cs=0 l=1 rx=0x7f6fa4000e90 tx=0x7f6fa4001730).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:55.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.561+0000 7f6fb3fff700 1 --2- 172.21.15.38:0/3656694037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fb41464d0 0x7f6fb40b21e0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f6fa4000e90 tx=0x7f6fa4001730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:55.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.561+0000 7f6fb0ff9700 1 -- 172.21.15.38:0/3656694037 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fa4005ca0 con 0x7f6fb41464d0 2020-06-12T17:48:55.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.561+0000 7f6fb3fff700 1 --2- 172.21.15.38:0/3656694037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fb41464d0 0x7f6fb40b21e0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f6fa4000e90 tx=0x7f6fa4001730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:55.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.561+0000 7f6fb3fff700 1 --2- 172.21.15.38:0/3656694037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fb41464d0 0x7f6fb40b21e0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f6fa4000e90 tx=0x7f6fa4001730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:55.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.561+0000 7f6fb0ff9700 1 -- 172.21.15.38:0/3656694037 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa4005e00 con 0x7f6fb41464d0 2020-06-12T17:48:55.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.561+0000 7f6fb89ac700 1 -- 172.21.15.38:0/3656694037 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb413d1d0 con 0x7f6fb41464d0 2020-06-12T17:48:55.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.561+0000 7f6fb0ff9700 1 -- 172.21.15.38:0/3656694037 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fa40062b0 con 0x7f6fb41464d0 2020-06-12T17:48:55.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.561+0000 7f6fb89ac700 1 -- 172.21.15.38:0/3656694037 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb40ad390 con 0x7f6fb41464d0 2020-06-12T17:48:55.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.561+0000 7f6fb3fff700 1 --2- 172.21.15.38:0/3656694037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fb41464d0 0x7f6fb40b21e0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f6fa4000e90 tx=0x7f6fa4001730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:55.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.562+0000 7f6fb89ac700 1 -- 172.21.15.38:0/3656694037 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb4056c30 con 0x7f6fb41464d0 2020-06-12T17:48:55.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.562+0000 7f6fb0ff9700 1 -- 172.21.15.38:0/3656694037 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f6fa4006520 con 0x7f6fb41464d0 2020-06-12T17:48:55.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.562+0000 7f6fb3fff700 1 --2- 172.21.15.38:0/3656694037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fb41464d0 0x7f6fb40b21e0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f6fa4000e90 tx=0x7f6fa4001730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:55.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.562+0000 7f6fb0ff9700 1 --2- 172.21.15.38:0/3656694037 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6f9804d5d0 0x7f6f9804fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:55.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.562+0000 7f6fb0ff9700 1 -- 172.21.15.38:0/3656694037 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f6fa4060ee0 con 0x7f6fb41464d0 2020-06-12T17:48:55.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.562+0000 7f6fb37fe700 1 --2- 172.21.15.38:0/3656694037 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6f9804d5d0 0x7f6f9804fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:55.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.563+0000 7f6fb37fe700 1 --2- 172.21.15.38:0/3656694037 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6f9804d5d0 0x7f6f9804fa90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6fac0032b0 tx=0x7f6fac00e3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:55.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.563+0000 7f6fb37fe700 1 --2- 172.21.15.38:0/3656694037 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6f9804d5d0 0x7f6f9804fa90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6fac0032b0 tx=0x7f6fac00e3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:55.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.563+0000 7f6fb37fe700 1 --2- 172.21.15.38:0/3656694037 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6f9804d5d0 0x7f6f9804fa90 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f6fac0032b0 tx=0x7f6fac00e3a0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:55.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.566+0000 7f6fb3fff700 1 --2- 172.21.15.38:0/3656694037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fb41464d0 0x7f6fb40b21e0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f6fa4000e90 tx=0x7f6fa4001730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:55.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.566+0000 7f6fb0ff9700 1 -- 172.21.15.38:0/3656694037 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f6fa403c640 con 0x7f6fb41464d0 2020-06-12T17:48:55.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:55.733+0000 7f6fb89ac700 1 -- 172.21.15.38:0/3656694037 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f6fb406aa70 con 0x7f6fb41464d0 2020-06-12T17:48:56.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.554+0000 7f6fb3fff700 1 --2- 172.21.15.38:0/3656694037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fb41464d0 0x7f6fb40b21e0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f6fa4000e90 tx=0x7f6fa4001730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:56.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.554+0000 7f6fb0ff9700 1 -- 172.21.15.38:0/3656694037 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v29) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6fa403fc60 con 0x7f6fb41464d0 2020-06-12T17:48:56.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.556+0000 7f6fb89ac700 1 -- 172.21.15.38:0/3656694037 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6f9804d5d0 msgr2=0x7f6f9804fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:56.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.556+0000 7f6fb89ac700 1 --2- 172.21.15.38:0/3656694037 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6f9804d5d0 0x7f6f9804fa90 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f6fac0032b0 tx=0x7f6fac00e3a0).stop 2020-06-12T17:48:56.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.556+0000 7f6fb89ac700 1 -- 172.21.15.38:0/3656694037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fb41464d0 msgr2=0x7f6fb40b21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:56.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.556+0000 7f6fb89ac700 1 --2- 172.21.15.38:0/3656694037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fb41464d0 0x7f6fb40b21e0 secure :-1 s=READY pgs=333 cs=0 l=1 rx=0x7f6fa4000e90 tx=0x7f6fa4001730).stop 2020-06-12T17:48:56.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.556+0000 7f6fb89ac700 1 -- 172.21.15.38:0/3656694037 shutdown_connections 2020-06-12T17:48:56.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.556+0000 7f6fb89ac700 1 --2- 172.21.15.38:0/3656694037 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6f9804d5d0 0x7f6f9804fa90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:56.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.556+0000 7f6fb89ac700 1 --2- 172.21.15.38:0/3656694037 >> v2:172.21.15.150:3300/0 conn(0x7f6fb405b7a0 0x7f6fb40af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:56.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.556+0000 7f6fb89ac700 1 --2- 172.21.15.38:0/3656694037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fb41464d0 0x7f6fb40b21e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:56.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.556+0000 7f6fb89ac700 1 -- 172.21.15.38:0/3656694037 >> 172.21.15.38:0/3656694037 conn(0x7f6fb4061460 msgr2=0x7f6fb4062220 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:56.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.557+0000 7f6fb89ac700 1 -- 172.21.15.38:0/3656694037 shutdown_connections 2020-06-12T17:48:56.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.557+0000 7f6fb89ac700 1 -- 172.21.15.38:0/3656694037 wait complete. 2020-06-12T17:48:56.564 INFO:teuthology.orchestra.run.smithi038.stderr: removed all blacklist entries 2020-06-12T17:48:56.573 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2020-06-12T17:48:56.574 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-06-12T17:48:56.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.692+0000 7fb8187bc700 1 Processor -- start 2020-06-12T17:48:56.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.692+0000 7fb8187bc700 1 -- start start 2020-06-12T17:48:56.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.693+0000 7fb8187bc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb810143850 0x7fb8100a1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:56.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.693+0000 7fb8187bc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb810146ae0 0x7fb81009fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:56.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.693+0000 7fb8187bc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8100a0f90 con 0x7fb810143470 2020-06-12T17:48:56.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.693+0000 7fb8187bc700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8100a1230 con 0x7fb810146ae0 2020-06-12T17:48:56.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.693+0000 7fb8187bc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8100a14d0 con 0x7fb810143850 2020-06-12T17:48:56.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.693+0000 7fb816d59700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb810146ae0 0x7fb81009fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:56.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.693+0000 7fb816d59700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb810146ae0 0x7fb81009fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36906/0 (socket says 172.21.15.38:36906) 2020-06-12T17:48:56.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.693+0000 7fb816d59700 1 -- 172.21.15.38:0/3919783292 learned_addr learned my addr 172.21.15.38:0/3919783292 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:56.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.693+0000 7fb815d57700 1 --2- 172.21.15.38:0/3919783292 >> v2:172.21.15.150:3300/0 conn(0x7fb810143850 0x7fb8100a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:56.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.694+0000 7fb816d59700 1 -- 172.21.15.38:0/3919783292 >> v2:172.21.15.150:3300/0 conn(0x7fb810143850 msgr2=0x7fb8100a1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:56.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.694+0000 7fb816d59700 1 --2- 172.21.15.38:0/3919783292 >> v2:172.21.15.150:3300/0 conn(0x7fb810143850 0x7fb8100a1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:56.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.694+0000 7fb816d59700 1 -- 172.21.15.38:0/3919783292 >> v1:172.21.15.150:6789/0 conn(0x7fb810143470 legacy=0x7fb8100bcf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:56.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.694+0000 7fb816d59700 1 -- 172.21.15.38:0/3919783292 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8100a0cd0 con 0x7fb810146ae0 2020-06-12T17:48:56.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.694+0000 7fb816d59700 1 --2- 172.21.15.38:0/3919783292 >> v2:172.21.15.38:3300/0 conn(0x7fb810146ae0 0x7fb81009fa10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb810060f70 tx=0x7fb8080081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:56.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.694+0000 7fb816d59700 1 --2- 172.21.15.38:0/3919783292 >> v2:172.21.15.38:3300/0 conn(0x7fb810146ae0 0x7fb81009fa10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb810060f70 tx=0x7fb8080081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:56.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.694+0000 7fb816d59700 1 --2- 172.21.15.38:0/3919783292 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb810146ae0 0x7fb81009fa10 secure :-1 s=READY pgs=334 cs=0 l=1 rx=0x7fb810060f70 tx=0x7fb8080081e0).ready entity=mon.0 client_cookie=18aae96b96d9d687 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:56.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.694+0000 7fb816d59700 1 --2- 172.21.15.38:0/3919783292 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb810146ae0 0x7fb81009fa10 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fb810060f70 tx=0x7fb8080081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:56.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.694+0000 7fb816d59700 1 --2- 172.21.15.38:0/3919783292 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb810146ae0 0x7fb81009fa10 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fb810060f70 tx=0x7fb8080081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:56.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.694+0000 7fb816d59700 1 --2- 172.21.15.38:0/3919783292 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb810146ae0 0x7fb81009fa10 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7fb810060f70 tx=0x7fb8080081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:56.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.694+0000 7fb815556700 1 -- 172.21.15.38:0/3919783292 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb808011e60 con 0x7fb810146ae0 2020-06-12T17:48:56.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.694+0000 7fb815556700 1 -- 172.21.15.38:0/3919783292 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80800a160 con 0x7fb810146ae0 2020-06-12T17:48:56.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.694+0000 7fb815556700 1 -- 172.21.15.38:0/3919783292 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb80800a540 con 0x7fb810146ae0 2020-06-12T17:48:56.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.694+0000 7fb8187bc700 1 -- 172.21.15.38:0/3919783292 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb810146ae0 msgr2=0x7fb81009fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:56.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.694+0000 7fb8187bc700 1 --2- 172.21.15.38:0/3919783292 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb810146ae0 0x7fb81009fa10 secure :-1 s=READY pgs=334 cs=0 l=1 rx=0x7fb810060f70 tx=0x7fb8080081e0).stop 2020-06-12T17:48:56.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.694+0000 7fb8187bc700 1 -- 172.21.15.38:0/3919783292 shutdown_connections 2020-06-12T17:48:56.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.694+0000 7fb8187bc700 1 --2- 172.21.15.38:0/3919783292 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb810146ae0 0x7fb81009fa10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:56.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.694+0000 7fb8187bc700 1 --2- 172.21.15.38:0/3919783292 >> v2:172.21.15.150:3300/0 conn(0x7fb810143850 0x7fb8100a1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:56.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.694+0000 7fb8187bc700 1 -- 172.21.15.38:0/3919783292 >> 172.21.15.38:0/3919783292 conn(0x7fb810066040 msgr2=0x7fb8100bc840 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:56.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.695+0000 7fb8187bc700 1 -- 172.21.15.38:0/3919783292 shutdown_connections 2020-06-12T17:48:56.705 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.695+0000 7fb8187bc700 1 -- 172.21.15.38:0/3919783292 wait complete. 2020-06-12T17:48:56.705 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.695+0000 7fb8187bc700 1 Processor -- start 2020-06-12T17:48:56.705 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.695+0000 7fb8187bc700 1 -- start start 2020-06-12T17:48:56.708 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.696+0000 7fb8187bc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb810143470 0x7fb810148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:56.709 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.696+0000 7fb8187bc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb810143850 0x7fb810142620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:56.709 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.696+0000 7fb8187bc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb810157a90 con 0x7fb810146ae0 2020-06-12T17:48:56.709 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.696+0000 7fb8187bc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb810157d30 con 0x7fb810143470 2020-06-12T17:48:56.709 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.696+0000 7fb8187bc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb81014b070 con 0x7fb810143850 2020-06-12T17:48:56.710 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.696+0000 7fb815d57700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb810143850 0x7fb810142620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:56.710 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.696+0000 7fb816558700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb810143470 0x7fb810148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:56.710 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.696+0000 7fb816558700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb810143470 0x7fb810148c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:46384/0 (socket says 172.21.15.38:46384) 2020-06-12T17:48:56.710 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.696+0000 7fb816558700 1 -- 172.21.15.38:0/422373219 learned_addr learned my addr 172.21.15.38:0/422373219 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:56.711 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.696+0000 7fb815d57700 1 --2- 172.21.15.38:0/422373219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb810143850 0x7fb810142620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:56368/0 (socket says 172.21.15.38:56368) 2020-06-12T17:48:56.711 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.697+0000 7fb815d57700 1 -- 172.21.15.38:0/422373219 >> v2:172.21.15.150:3300/0 conn(0x7fb810143470 msgr2=0x7fb810148c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:56.711 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.697+0000 7fb815d57700 1 --2- 172.21.15.38:0/422373219 >> v2:172.21.15.150:3300/0 conn(0x7fb810143470 0x7fb810148c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:56.711 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.697+0000 7fb815d57700 1 -- 172.21.15.38:0/422373219 >> v1:172.21.15.150:6789/0 conn(0x7fb810146ae0 legacy=0x7fb810156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:56.711 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.697+0000 7fb815d57700 1 -- 172.21.15.38:0/422373219 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb810149080 con 0x7fb810143850 2020-06-12T17:48:56.712 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.697+0000 7fb816558700 1 --2- 172.21.15.38:0/422373219 >> v2:172.21.15.150:3300/0 conn(0x7fb810143470 0x7fb810148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:56.712 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.697+0000 7fb815d57700 1 --2- 172.21.15.38:0/422373219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb810143850 0x7fb810142620 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb80c002f30 tx=0x7fb80c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:56.712 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.697+0000 7fb815d57700 1 --2- 172.21.15.38:0/422373219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb810143850 0x7fb810142620 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb80c002f30 tx=0x7fb80c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:56.712 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.697+0000 7fb815d57700 1 --2- 172.21.15.38:0/422373219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb810143850 0x7fb810142620 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7fb80c002f30 tx=0x7fb80c007e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:56.712 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.697+0000 7fb815d57700 1 --2- 172.21.15.38:0/422373219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb810143850 0x7fb810142620 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fb80c002f30 tx=0x7fb80c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:56.713 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.697+0000 7fb7ff7fe700 1 -- 172.21.15.38:0/422373219 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb80c007530 con 0x7fb810143850 2020-06-12T17:48:56.713 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.697+0000 7fb815d57700 1 --2- 172.21.15.38:0/422373219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb810143850 0x7fb810142620 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fb80c002f30 tx=0x7fb80c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:56.713 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.697+0000 7fb7ff7fe700 1 -- 172.21.15.38:0/422373219 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80c0056c0 con 0x7fb810143850 2020-06-12T17:48:56.713 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.697+0000 7fb815d57700 1 --2- 172.21.15.38:0/422373219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb810143850 0x7fb810142620 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fb80c002f30 tx=0x7fb80c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:56.713 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.697+0000 7fb8187bc700 1 -- 172.21.15.38:0/422373219 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb810142a80 con 0x7fb810143850 2020-06-12T17:48:56.714 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.697+0000 7fb7ff7fe700 1 -- 172.21.15.38:0/422373219 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb80c005ae0 con 0x7fb810143850 2020-06-12T17:48:56.714 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.697+0000 7fb8187bc700 1 -- 172.21.15.38:0/422373219 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb81014b510 con 0x7fb810143850 2020-06-12T17:48:56.714 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.698+0000 7fb815d57700 1 --2- 172.21.15.38:0/422373219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb810143850 0x7fb810142620 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fb80c002f30 tx=0x7fb80c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:56.714 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.698+0000 7fb8187bc700 1 -- 172.21.15.38:0/422373219 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb810157900 con 0x7fb810143850 2020-06-12T17:48:56.714 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.698+0000 7fb7ff7fe700 1 -- 172.21.15.38:0/422373219 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fb80c0125c0 con 0x7fb810143850 2020-06-12T17:48:56.715 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.698+0000 7fb815d57700 1 --2- 172.21.15.38:0/422373219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb810143850 0x7fb810142620 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fb80c002f30 tx=0x7fb80c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:56.715 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.699+0000 7fb7ff7fe700 1 --2- 172.21.15.38:0/422373219 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb7f004d560 0x7fb7f004fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:56.715 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.699+0000 7fb7ff7fe700 1 -- 172.21.15.38:0/422373219 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fb80c00d0c0 con 0x7fb810143850 2020-06-12T17:48:56.715 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.699+0000 7fb816558700 1 --2- 172.21.15.38:0/422373219 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb7f004d560 0x7fb7f004fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:56.715 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.699+0000 7fb816558700 1 --2- 172.21.15.38:0/422373219 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb7f004d560 0x7fb7f004fa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb810060050 tx=0x7fb800001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:56.716 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.699+0000 7fb816558700 1 --2- 172.21.15.38:0/422373219 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb7f004d560 0x7fb7f004fa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb810060050 tx=0x7fb800001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:56.716 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.699+0000 7fb816558700 1 --2- 172.21.15.38:0/422373219 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb7f004d560 0x7fb7f004fa20 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7fb810060050 tx=0x7fb800001820).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:56.716 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.703+0000 7fb815d57700 1 --2- 172.21.15.38:0/422373219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb810143850 0x7fb810142620 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fb80c002f30 tx=0x7fb80c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:56.716 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.703+0000 7fb7ff7fe700 1 -- 172.21.15.38:0/422373219 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fb80c03c7b0 con 0x7fb810143850 2020-06-12T17:48:56.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.907+0000 7fb8187bc700 1 -- 172.21.15.38:0/422373219 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb810056c30 con 0x7fb810143850 2020-06-12T17:48:56.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.908+0000 7fb815d57700 1 --2- 172.21.15.38:0/422373219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb810143850 0x7fb810142620 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fb80c002f30 tx=0x7fb80c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:56.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.908+0000 7fb7ff7fe700 1 -- 172.21.15.38:0/422373219 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v5) v1 ==== 80+0+5917 (secure 0 0 0) 0x7fb80c03fdd0 con 0x7fb810143850 2020-06-12T17:48:56.912 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:56.913 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2020-06-12T17:48:56.913 INFO:teuthology.orchestra.run.smithi038.stdout: "auth_dump": [ 2020-06-12T17:48:56.913 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:56.913 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.a", 2020-06-12T17:48:56.913 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQCnv+NetUq6ChAAYQPBJ6S6dadZWggx+9xYDQ==", 2020-06-12T17:48:56.914 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2020-06-12T17:48:56.914 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2020-06-12T17:48:56.914 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2020-06-12T17:48:56.914 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2020-06-12T17:48:56.914 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2020-06-12T17:48:56.915 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:56.915 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:56.915 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:56.915 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.b", 2020-06-12T17:48:56.915 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQCnv+NeAbhcEBAAwKupqvC/x6/SoCyea1LQdQ==", 2020-06-12T17:48:56.915 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2020-06-12T17:48:56.916 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2020-06-12T17:48:56.916 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2020-06-12T17:48:56.916 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2020-06-12T17:48:56.916 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2020-06-12T17:48:56.916 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:56.917 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:56.917 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:56.917 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.0", 2020-06-12T17:48:56.917 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQCtv+Ne1LupNBAACyqpp1WZsLzp9tX4zLQmiA==", 2020-06-12T17:48:56.917 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2020-06-12T17:48:56.918 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2020-06-12T17:48:56.918 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2020-06-12T17:48:56.918 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2020-06-12T17:48:56.918 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:56.918 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:56.919 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:56.919 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.1", 2020-06-12T17:48:56.919 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQCwv+NeRJdxFRAAF4eLPnEDtcXAx56CnrLluw==", 2020-06-12T17:48:56.919 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2020-06-12T17:48:56.919 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2020-06-12T17:48:56.919 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2020-06-12T17:48:56.920 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2020-06-12T17:48:56.920 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:56.920 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:56.920 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:56.920 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.2", 2020-06-12T17:48:56.921 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQCyv+NeQCkeMxAAXktIztrjtSbO+U8YmYcVfA==", 2020-06-12T17:48:56.921 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2020-06-12T17:48:56.921 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2020-06-12T17:48:56.921 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2020-06-12T17:48:56.921 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2020-06-12T17:48:56.922 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:56.922 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:56.922 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:56.922 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.3", 2020-06-12T17:48:56.922 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQC1v+NewhXBExAAtae8v030uE3T0NXlXB0+uQ==", 2020-06-12T17:48:56.922 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2020-06-12T17:48:56.923 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2020-06-12T17:48:56.923 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2020-06-12T17:48:56.923 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2020-06-12T17:48:56.923 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:56.923 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:56.924 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:56.924 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.4", 2020-06-12T17:48:56.924 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQC6v+Ne7VbXJxAA0Wg1onQBsrtr8j12+tjBCQ==", 2020-06-12T17:48:56.924 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2020-06-12T17:48:56.924 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2020-06-12T17:48:56.925 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2020-06-12T17:48:56.925 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2020-06-12T17:48:56.925 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:56.925 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:56.925 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:56.925 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.5", 2020-06-12T17:48:56.926 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQC9v+Nei1mDChAAVUM5OnwEF97d5TOz719e5Q==", 2020-06-12T17:48:56.926 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2020-06-12T17:48:56.926 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2020-06-12T17:48:56.926 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2020-06-12T17:48:56.926 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2020-06-12T17:48:56.927 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:56.927 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:56.927 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:56.927 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.6", 2020-06-12T17:48:56.928 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQC/v+NeTzdNJhAAWKB++wt8tsIdFCBrVDah8Q==", 2020-06-12T17:48:56.928 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2020-06-12T17:48:56.928 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2020-06-12T17:48:56.928 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2020-06-12T17:48:56.928 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2020-06-12T17:48:56.929 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:56.929 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:56.929 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:56.929 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.7", 2020-06-12T17:48:56.929 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQDCv+NePy1PBhAAl/KCl4V5HGerrNqtUcuWZA==", 2020-06-12T17:48:56.930 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2020-06-12T17:48:56.930 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2020-06-12T17:48:56.930 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2020-06-12T17:48:56.930 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2020-06-12T17:48:56.930 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:56.930 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:56.931 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:56.931 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.0", 2020-06-12T17:48:56.931 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQCnv+Ne3nDsFBAASnLDV+jcHoQr6RsEIg0Anw==", 2020-06-12T17:48:56.931 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2020-06-12T17:48:56.931 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2020-06-12T17:48:56.932 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2020-06-12T17:48:56.932 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2020-06-12T17:48:56.932 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2020-06-12T17:48:56.932 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:56.932 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:56.933 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:56.933 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.1", 2020-06-12T17:48:56.933 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQCnv+NeOayqGBAAhRj+GpsCNRN1FNDwoYl73A==", 2020-06-12T17:48:56.933 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2020-06-12T17:48:56.933 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2020-06-12T17:48:56.933 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2020-06-12T17:48:56.934 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2020-06-12T17:48:56.934 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2020-06-12T17:48:56.934 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:56.934 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:56.934 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:56.935 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.2", 2020-06-12T17:48:56.935 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQCnv+NejrhEHBAAIrSYVLX1dapoRSBxrjYY8A==", 2020-06-12T17:48:56.935 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2020-06-12T17:48:56.935 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2020-06-12T17:48:56.935 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2020-06-12T17:48:56.936 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2020-06-12T17:48:56.936 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2020-06-12T17:48:56.936 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:56.936 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:56.936 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:56.936 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.3", 2020-06-12T17:48:56.937 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQCnv+NeQwX1IRAAMO/lpYu2RZqyL0d2iOIiFQ==", 2020-06-12T17:48:56.937 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2020-06-12T17:48:56.937 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2020-06-12T17:48:56.937 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2020-06-12T17:48:56.937 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2020-06-12T17:48:56.938 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2020-06-12T17:48:56.938 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:56.938 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:56.938 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:56.938 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.admin", 2020-06-12T17:48:56.939 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQCmv+NemqbBHBAAifMJh8A0qoPpyFiO8xZp5w==", 2020-06-12T17:48:56.939 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2020-06-12T17:48:56.939 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2020-06-12T17:48:56.939 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2020-06-12T17:48:56.939 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2020-06-12T17:48:56.939 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2020-06-12T17:48:56.940 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:56.940 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:56.940 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:56.940 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.bootstrap-mds", 2020-06-12T17:48:56.940 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQDKv+Ne1QjqGRAABQ+TrHnBduJEz/0bXY8J6Q==", 2020-06-12T17:48:56.941 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2020-06-12T17:48:56.941 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile bootstrap-mds" 2020-06-12T17:48:56.941 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:56.941 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:56.941 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:56.942 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.bootstrap-mgr", 2020-06-12T17:48:56.942 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQDKv+NenxPqGRAAMa/7SOXn+hUGvJXyCPJHAw==", 2020-06-12T17:48:56.942 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2020-06-12T17:48:56.942 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile bootstrap-mgr" 2020-06-12T17:48:56.942 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:56.943 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:56.943 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:56.943 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.bootstrap-osd", 2020-06-12T17:48:56.943 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQDKv+NeZR7qGRAAcij5vSRKcjR4+qZ9yCDhQw==", 2020-06-12T17:48:56.943 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2020-06-12T17:48:56.943 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile bootstrap-osd" 2020-06-12T17:48:56.944 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:56.944 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:56.944 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:56.944 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.bootstrap-rbd", 2020-06-12T17:48:56.944 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQDKv+Ne5CbqGRAAB7UkviXvVkv4B/NZN/GYvw==", 2020-06-12T17:48:56.945 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2020-06-12T17:48:56.945 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile bootstrap-rbd" 2020-06-12T17:48:56.945 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:56.945 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:56.945 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:56.945 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.bootstrap-rbd-mirror", 2020-06-12T17:48:56.946 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQDKv+Ne0C/qGRAAJSk2uzpM/9SyHQLa886eCw==", 2020-06-12T17:48:56.946 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2020-06-12T17:48:56.946 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2020-06-12T17:48:56.946 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:56.946 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:56.947 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:56.947 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.bootstrap-rgw", 2020-06-12T17:48:56.948 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQDKv+NegzjqGRAA7fKdV8wgw4i6oGTVWnJ3/Q==", 2020-06-12T17:48:56.948 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2020-06-12T17:48:56.948 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile bootstrap-rgw" 2020-06-12T17:48:56.948 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:56.949 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:56.949 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:56.949 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mgr.x", 2020-06-12T17:48:56.949 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQCnv+NeDlTtBhAACH1rQaHupywTQmzzGRw0AQ==", 2020-06-12T17:48:56.950 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2020-06-12T17:48:56.950 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2020-06-12T17:48:56.950 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile mgr", 2020-06-12T17:48:56.950 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2020-06-12T17:48:56.951 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:56.951 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:48:56.951 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:48:56.951 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mgr.y", 2020-06-12T17:48:56.951 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQCmv+NeS5XPOhAA8VbBJ/BMbE/kLdyZ9Mix2A==", 2020-06-12T17:48:56.952 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2020-06-12T17:48:56.952 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2020-06-12T17:48:56.952 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile mgr", 2020-06-12T17:48:56.952 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2020-06-12T17:48:56.952 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:56.952 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:48:56.953 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2020-06-12T17:48:56.953 INFO:teuthology.orchestra.run.smithi038.stdout:} 2020-06-12T17:48:56.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.909+0000 7fb8187bc700 1 -- 172.21.15.38:0/422373219 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb7f004d560 msgr2=0x7fb7f004fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:56.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.909+0000 7fb8187bc700 1 --2- 172.21.15.38:0/422373219 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb7f004d560 0x7fb7f004fa20 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7fb810060050 tx=0x7fb800001820).stop 2020-06-12T17:48:56.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.909+0000 7fb8187bc700 1 -- 172.21.15.38:0/422373219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb810143850 msgr2=0x7fb810142620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:56.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.909+0000 7fb8187bc700 1 --2- 172.21.15.38:0/422373219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb810143850 0x7fb810142620 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7fb80c002f30 tx=0x7fb80c007e60).stop 2020-06-12T17:48:56.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.910+0000 7fb8187bc700 1 -- 172.21.15.38:0/422373219 shutdown_connections 2020-06-12T17:48:56.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.910+0000 7fb8187bc700 1 --2- 172.21.15.38:0/422373219 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb7f004d560 0x7fb7f004fa20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:56.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.910+0000 7fb8187bc700 1 --2- 172.21.15.38:0/422373219 >> v2:172.21.15.150:3300/0 conn(0x7fb810143470 0x7fb810148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:56.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.910+0000 7fb8187bc700 1 --2- 172.21.15.38:0/422373219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb810143850 0x7fb810142620 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:56.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.910+0000 7fb8187bc700 1 -- 172.21.15.38:0/422373219 >> 172.21.15.38:0/422373219 conn(0x7fb810066040 msgr2=0x7fb8100b8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:56.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.910+0000 7fb8187bc700 1 -- 172.21.15.38:0/422373219 shutdown_connections 2020-06-12T17:48:56.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:56.910+0000 7fb8187bc700 1 -- 172.21.15.38:0/422373219 wait complete. 2020-06-12T17:48:56.957 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-mds 2020-06-12T17:48:57.073 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.070+0000 7f5638565700 1 Processor -- start 2020-06-12T17:48:57.074 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.070+0000 7f5638565700 1 -- start start 2020-06-12T17:48:57.076 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.071+0000 7f5638565700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f563009df50 0x7f563009b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:57.077 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.071+0000 7f5638565700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5630066a80 0x7f56300aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:57.077 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.071+0000 7f5638565700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56300ad7b0 con 0x7f563009db70 2020-06-12T17:48:57.077 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.071+0000 7f5638565700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5630144ee0 con 0x7f5630066a80 2020-06-12T17:48:57.077 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.071+0000 7f5638565700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56301449a0 con 0x7f563009df50 2020-06-12T17:48:57.077 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.071+0000 7f5636b02700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5630066a80 0x7f56300aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:57.078 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.071+0000 7f5636301700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f563009db70 0x7f5630141040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38732/0 (socket says 172.21.15.38:38732) 2020-06-12T17:48:57.078 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.071+0000 7f5636301700 1 -- 172.21.15.38:0/309361112 learned_addr learned my addr 172.21.15.38:0/309361112 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:57.078 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.071+0000 7f5635b00700 1 --2- 172.21.15.38:0/309361112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f563009df50 0x7f563009b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:57.078 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.071+0000 7f5636b02700 1 -- 172.21.15.38:0/309361112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f563009df50 msgr2=0x7f563009b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:57.078 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.071+0000 7f56352ff700 1 -- 172.21.15.38:0/309361112 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1996007908 0 0) 0x7f56300ad7b0 con 0x7f563009db70 2020-06-12T17:48:57.079 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.071+0000 7f5636b02700 1 --2- 172.21.15.38:0/309361112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f563009df50 0x7f563009b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:57.079 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.071+0000 7f5636b02700 1 -- 172.21.15.38:0/309361112 >> v1:172.21.15.38:6789/0 conn(0x7f563009db70 legacy=0x7f5630141040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:57.079 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.071+0000 7f5636b02700 1 -- 172.21.15.38:0/309361112 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5630144c40 con 0x7f5630066a80 2020-06-12T17:48:57.079 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.071+0000 7f5635b00700 1 --2- 172.21.15.38:0/309361112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f563009df50 0x7f563009b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:48:57.079 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.071+0000 7f5636b02700 1 --2- 172.21.15.38:0/309361112 >> v2:172.21.15.38:3300/0 conn(0x7f5630066a80 0x7f56300aebc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f56280032b0 tx=0x7f56280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.080 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.071+0000 7f5636b02700 1 --2- 172.21.15.38:0/309361112 >> v2:172.21.15.38:3300/0 conn(0x7f5630066a80 0x7f56300aebc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f56280032b0 tx=0x7f56280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.080 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.071+0000 7f5636b02700 1 --2- 172.21.15.38:0/309361112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5630066a80 0x7f56300aebc0 secure :-1 s=READY pgs=336 cs=0 l=1 rx=0x7f56280032b0 tx=0x7f56280081e0).ready entity=mon.0 client_cookie=d651f0efe1fde1b4 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:57.080 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.071+0000 7f5636b02700 1 --2- 172.21.15.38:0/309361112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5630066a80 0x7f56300aebc0 secure :-1 s=THROTTLE_DONE pgs=336 cs=0 l=1 rx=0x7f56280032b0 tx=0x7f56280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.080 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.071+0000 7f56352ff700 1 -- 172.21.15.38:0/309361112 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5628011e90 con 0x7f5630066a80 2020-06-12T17:48:57.080 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.071+0000 7f5636b02700 1 --2- 172.21.15.38:0/309361112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5630066a80 0x7f56300aebc0 secure :-1 s=THROTTLE_DONE pgs=336 cs=0 l=1 rx=0x7f56280032b0 tx=0x7f56280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.081 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.071+0000 7f5636b02700 1 --2- 172.21.15.38:0/309361112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5630066a80 0x7f56300aebc0 secure :-1 s=THROTTLE_DONE pgs=336 cs=0 l=1 rx=0x7f56280032b0 tx=0x7f56280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.081 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.071+0000 7f56352ff700 1 -- 172.21.15.38:0/309361112 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562800a160 con 0x7f5630066a80 2020-06-12T17:48:57.081 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.071+0000 7f56352ff700 1 -- 172.21.15.38:0/309361112 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f562800a540 con 0x7f5630066a80 2020-06-12T17:48:57.081 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.071+0000 7f5638565700 1 -- 172.21.15.38:0/309361112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5630066a80 msgr2=0x7f56300aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:57.081 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.071+0000 7f5638565700 1 --2- 172.21.15.38:0/309361112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5630066a80 0x7f56300aebc0 secure :-1 s=READY pgs=336 cs=0 l=1 rx=0x7f56280032b0 tx=0x7f56280081e0).stop 2020-06-12T17:48:57.082 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.072+0000 7f5638565700 1 -- 172.21.15.38:0/309361112 shutdown_connections 2020-06-12T17:48:57.082 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.072+0000 7f5638565700 1 --2- 172.21.15.38:0/309361112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5630066a80 0x7f56300aebc0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:57.082 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.072+0000 7f5638565700 1 --2- 172.21.15.38:0/309361112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f563009df50 0x7f563009b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:57.082 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.072+0000 7f5638565700 1 -- 172.21.15.38:0/309361112 >> 172.21.15.38:0/309361112 conn(0x7f56300b8410 msgr2=0x7f56300b8820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:57.082 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.072+0000 7f5638565700 1 -- 172.21.15.38:0/309361112 shutdown_connections 2020-06-12T17:48:57.082 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.072+0000 7f5638565700 1 -- 172.21.15.38:0/309361112 wait complete. 2020-06-12T17:48:57.083 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.073+0000 7f5638565700 1 Processor -- start 2020-06-12T17:48:57.083 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.073+0000 7f5638565700 1 -- start start 2020-06-12T17:48:57.086 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.074+0000 7f5638565700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f563009df50 0x7f563009a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:57.086 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.074+0000 7f5638565700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563009d100 con 0x7f5630066a80 2020-06-12T17:48:57.086 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.074+0000 7f5638565700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563009d3a0 con 0x7f563009db70 2020-06-12T17:48:57.086 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.074+0000 7f5638565700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f563009d640 con 0x7f563009df50 2020-06-12T17:48:57.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.074+0000 7f5636301700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f5630066a80 0x7f5630142050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38738/0 (socket says 172.21.15.38:38738) 2020-06-12T17:48:57.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.074+0000 7f5636301700 1 -- 172.21.15.38:0/677059720 learned_addr learned my addr 172.21.15.38:0/677059720 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:57.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.074+0000 7f5636b02700 1 --2- 172.21.15.38:0/677059720 >> v2:172.21.15.38:3300/0 conn(0x7f563009df50 0x7f563009a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:57.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.074+0000 7f561f7fe700 1 -- 172.21.15.38:0/677059720 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2313688727 0 0) 0x7f563009d100 con 0x7f5630066a80 2020-06-12T17:48:57.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.074+0000 7f561f7fe700 1 -- 172.21.15.38:0/677059720 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5610002fe0 con 0x7f5630066a80 2020-06-12T17:48:57.088 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.074+0000 7f5636b02700 1 -- 172.21.15.38:0/677059720 >> v1:172.21.15.150:6789/0 conn(0x7f563009db70 legacy=0x7f56300b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:57.088 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.074+0000 7f5636b02700 1 -- 172.21.15.38:0/677059720 >> v1:172.21.15.38:6789/0 conn(0x7f5630066a80 legacy=0x7f5630142050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:57.088 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.074+0000 7f5636b02700 1 -- 172.21.15.38:0/677059720 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56300907c0 con 0x7f563009df50 2020-06-12T17:48:57.088 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.074+0000 7f5636b02700 1 --2- 172.21.15.38:0/677059720 >> v2:172.21.15.38:3300/0 conn(0x7f563009df50 0x7f563009a710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f563008fb70 tx=0x7f56280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.088 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.074+0000 7f5636b02700 1 --2- 172.21.15.38:0/677059720 >> v2:172.21.15.38:3300/0 conn(0x7f563009df50 0x7f563009a710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f563008fb70 tx=0x7f56280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.089 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.074+0000 7f5636b02700 1 --2- 172.21.15.38:0/677059720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f563009df50 0x7f563009a710 secure :-1 s=READY pgs=338 cs=0 l=1 rx=0x7f563008fb70 tx=0x7f56280081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:57.089 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.074+0000 7f5636b02700 1 --2- 172.21.15.38:0/677059720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f563009df50 0x7f563009a710 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f563008fb70 tx=0x7f56280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.089 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.074+0000 7f561f7fe700 1 -- 172.21.15.38:0/677059720 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5628005c30 con 0x7f563009df50 2020-06-12T17:48:57.089 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.074+0000 7f5636b02700 1 --2- 172.21.15.38:0/677059720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f563009df50 0x7f563009a710 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f563008fb70 tx=0x7f56280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.089 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.074+0000 7f5636b02700 1 --2- 172.21.15.38:0/677059720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f563009df50 0x7f563009a710 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f563008fb70 tx=0x7f56280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.074+0000 7f561f7fe700 1 -- 172.21.15.38:0/677059720 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5628005d90 con 0x7f563009df50 2020-06-12T17:48:57.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.074+0000 7f5638565700 1 -- 172.21.15.38:0/677059720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56300b7fd0 con 0x7f563009df50 2020-06-12T17:48:57.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.074+0000 7f561f7fe700 1 -- 172.21.15.38:0/677059720 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5628007340 con 0x7f563009df50 2020-06-12T17:48:57.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.074+0000 7f5638565700 1 -- 172.21.15.38:0/677059720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f563009ce30 con 0x7f563009df50 2020-06-12T17:48:57.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.075+0000 7f5636b02700 1 --2- 172.21.15.38:0/677059720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f563009df50 0x7f563009a710 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f563008fb70 tx=0x7f56280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.091 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.075+0000 7f561f7fe700 1 -- 172.21.15.38:0/677059720 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f5628007530 con 0x7f563009df50 2020-06-12T17:48:57.091 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.075+0000 7f5636b02700 1 --2- 172.21.15.38:0/677059720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f563009df50 0x7f563009a710 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f563008fb70 tx=0x7f56280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.091 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.075+0000 7f5638565700 1 -- 172.21.15.38:0/677059720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5630092090 con 0x7f563009df50 2020-06-12T17:48:57.091 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.076+0000 7f561f7fe700 1 --2- 172.21.15.38:0/677059720 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f561004d9b0 0x7f561004fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:57.091 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.076+0000 7f561f7fe700 1 -- 172.21.15.38:0/677059720 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f5628061ea0 con 0x7f563009df50 2020-06-12T17:48:57.092 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.076+0000 7f5636301700 1 --2- 172.21.15.38:0/677059720 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f561004d9b0 0x7f561004fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:57.092 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.076+0000 7f5636301700 1 --2- 172.21.15.38:0/677059720 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f561004d9b0 0x7f561004fe70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f562c000ff0 tx=0x7f562c001580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.092 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.076+0000 7f5636301700 1 --2- 172.21.15.38:0/677059720 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f561004d9b0 0x7f561004fe70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f562c000ff0 tx=0x7f562c001580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.092 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.076+0000 7f5636301700 1 --2- 172.21.15.38:0/677059720 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f561004d9b0 0x7f561004fe70 secure :-1 s=READY pgs=146 cs=0 l=1 rx=0x7f562c000ff0 tx=0x7f562c001580).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:57.092 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.079+0000 7f5636b02700 1 --2- 172.21.15.38:0/677059720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f563009df50 0x7f563009a710 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f563008fb70 tx=0x7f56280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.093 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.079+0000 7f561f7fe700 1 -- 172.21.15.38:0/677059720 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f5630092090 con 0x7f563009df50 2020-06-12T17:48:57.293 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.290+0000 7f5638565700 1 -- 172.21.15.38:0/677059720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f5630092090 con 0x7f563009df50 2020-06-12T17:48:57.296 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.293+0000 7f5636b02700 1 --2- 172.21.15.38:0/677059720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f563009df50 0x7f563009a710 secure :-1 s=THROTTLE_DONE pgs=338 cs=0 l=1 rx=0x7f563008fb70 tx=0x7f56280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.297 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.293+0000 7f561f7fe700 1 -- 172.21.15.38:0/677059720 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v6) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5630092090 con 0x7f563009df50 2020-06-12T17:48:57.299 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.295+0000 7f5638565700 1 -- 172.21.15.38:0/677059720 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f561004d9b0 msgr2=0x7f561004fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:57.299 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.295+0000 7f5638565700 1 --2- 172.21.15.38:0/677059720 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f561004d9b0 0x7f561004fe70 secure :-1 s=READY pgs=146 cs=0 l=1 rx=0x7f562c000ff0 tx=0x7f562c001580).stop 2020-06-12T17:48:57.299 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.295+0000 7f5638565700 1 -- 172.21.15.38:0/677059720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f563009df50 msgr2=0x7f563009a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:57.299 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.295+0000 7f5638565700 1 --2- 172.21.15.38:0/677059720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f563009df50 0x7f563009a710 secure :-1 s=READY pgs=338 cs=0 l=1 rx=0x7f563008fb70 tx=0x7f56280081e0).stop 2020-06-12T17:48:57.299 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.295+0000 7f5638565700 1 -- 172.21.15.38:0/677059720 shutdown_connections 2020-06-12T17:48:57.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.295+0000 7f5638565700 1 --2- 172.21.15.38:0/677059720 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f561004d9b0 0x7f561004fe70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:57.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.295+0000 7f5638565700 1 --2- 172.21.15.38:0/677059720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f563009df50 0x7f563009a710 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:57.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.295+0000 7f5638565700 1 -- 172.21.15.38:0/677059720 >> 172.21.15.38:0/677059720 conn(0x7f56300b8410 msgr2=0x7f5630143450 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:57.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.295+0000 7f5638565700 1 -- 172.21.15.38:0/677059720 shutdown_connections 2020-06-12T17:48:57.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.295+0000 7f5638565700 1 -- 172.21.15.38:0/677059720 wait complete. 2020-06-12T17:48:57.301 INFO:teuthology.orchestra.run.smithi038.stderr:updated 2020-06-12T17:48:57.309 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-mgr 2020-06-12T17:48:57.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.422+0000 7feea378a700 1 Processor -- start 2020-06-12T17:48:57.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.422+0000 7feea378a700 1 -- start start 2020-06-12T17:48:57.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.422+0000 7feea378a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee9c066eb0 0x7fee9c0b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:57.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.422+0000 7feea378a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fee9c05b420 0x7fee9c05b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:57.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.423+0000 7feea378a700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee9c1424b0 con 0x7fee9c05ab90 2020-06-12T17:48:57.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.423+0000 7feea378a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee9c0b4950 con 0x7fee9c05b420 2020-06-12T17:48:57.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.423+0000 7feea378a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c067290 con 0x7fee9c066eb0 2020-06-12T17:48:57.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.423+0000 7feea1d27700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fee9c05ab90 0x7fee9c09b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38750/0 (socket says 172.21.15.38:38750) 2020-06-12T17:48:57.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.423+0000 7feea1d27700 1 -- 172.21.15.38:0/2165087079 learned_addr learned my addr 172.21.15.38:0/2165087079 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:57.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.423+0000 7feea1526700 1 --2- 172.21.15.38:0/2165087079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee9c066eb0 0x7fee9c0b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:57.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.423+0000 7feea0d25700 1 --2- 172.21.15.38:0/2165087079 >> v2:172.21.15.150:3300/0 conn(0x7fee9c05b420 0x7fee9c05b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:57.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.423+0000 7fee8bfff700 1 -- 172.21.15.38:0/2165087079 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020983211 0 0) 0x7fee9c1424b0 con 0x7fee9c05ab90 2020-06-12T17:48:57.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.423+0000 7fee8bfff700 1 -- 172.21.15.38:0/2165087079 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee84003230 con 0x7fee9c05ab90 2020-06-12T17:48:57.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.423+0000 7fee8bfff700 1 -- 172.21.15.38:0/2165087079 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3905148407 0 0) 0x7fee84003230 con 0x7fee9c05ab90 2020-06-12T17:48:57.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.423+0000 7fee8bfff700 1 -- 172.21.15.38:0/2165087079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee9c066eb0 msgr2=0x7fee9c0b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:57.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.423+0000 7fee8bfff700 1 --2- 172.21.15.38:0/2165087079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee9c066eb0 0x7fee9c0b44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:57.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.423+0000 7fee8bfff700 1 -- 172.21.15.38:0/2165087079 >> v2:172.21.15.150:3300/0 conn(0x7fee9c05b420 msgr2=0x7fee9c05b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:57.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.423+0000 7fee8bfff700 1 --2- 172.21.15.38:0/2165087079 >> v2:172.21.15.150:3300/0 conn(0x7fee9c05b420 0x7fee9c05b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:57.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.423+0000 7fee8bfff700 1 -- 172.21.15.38:0/2165087079 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c0b3bc0 con 0x7fee9c05ab90 2020-06-12T17:48:57.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.423+0000 7fee8bfff700 1 -- 172.21.15.38:0/2165087079 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fee94001a50 con 0x7fee9c05ab90 2020-06-12T17:48:57.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.423+0000 7fee8bfff700 1 -- 172.21.15.38:0/2165087079 >> v1:172.21.15.38:6789/0 conn(0x7fee9c05ab90 legacy=0x7fee9c09b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:57.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.423+0000 7fee8bfff700 1 --2- 172.21.15.38:0/2165087079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee9c066eb0 0x7fee84003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:57.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.423+0000 7fee8bfff700 1 --2- 172.21.15.38:0/2165087079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee84003b80 0x7fee84003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:57.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.423+0000 7fee8bfff700 1 --2- 172.21.15.38:0/2165087079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee840045c0 0x7fee84004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:57.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.423+0000 7fee8bfff700 1 -- 172.21.15.38:0/2165087079 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c0b4950 con 0x7fee84003b80 2020-06-12T17:48:57.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.423+0000 7fee8bfff700 1 -- 172.21.15.38:0/2165087079 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c067290 con 0x7fee840045c0 2020-06-12T17:48:57.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.423+0000 7fee8bfff700 1 -- 172.21.15.38:0/2165087079 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee84005050 con 0x7fee9c066eb0 2020-06-12T17:48:57.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.423+0000 7feea0d25700 1 --2- 172.21.15.38:0/2165087079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee84003b80 0x7fee84003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:57.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.424+0000 7feea1d27700 1 --2- 172.21.15.38:0/2165087079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee840045c0 0x7fee84004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:57.435 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.424+0000 7feea1526700 1 --2- 172.21.15.38:0/2165087079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee9c066eb0 0x7fee84003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:57.435 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.424+0000 7feea0d25700 1 -- 172.21.15.38:0/2165087079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee9c066eb0 msgr2=0x7fee84003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:57.435 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.424+0000 7feea0d25700 1 --2- 172.21.15.38:0/2165087079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee9c066eb0 0x7fee84003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:57.435 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.424+0000 7feea0d25700 1 -- 172.21.15.38:0/2165087079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee840045c0 msgr2=0x7fee84004a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:57.435 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.424+0000 7feea0d25700 1 --2- 172.21.15.38:0/2165087079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee840045c0 0x7fee84004a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:57.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.424+0000 7feea0d25700 1 -- 172.21.15.38:0/2165087079 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee84003230 con 0x7fee84003b80 2020-06-12T17:48:57.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.424+0000 7feea0d25700 1 --2- 172.21.15.38:0/2165087079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee84003b80 0x7fee84003fe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fee8c008910 tx=0x7fee8c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.424+0000 7feea0d25700 1 --2- 172.21.15.38:0/2165087079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee84003b80 0x7fee84003fe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fee8c008910 tx=0x7fee8c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.424+0000 7feea0d25700 1 --2- 172.21.15.38:0/2165087079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee84003b80 0x7fee84003fe0 secure :-1 s=READY pgs=340 cs=0 l=1 rx=0x7fee8c008910 tx=0x7fee8c007e60).ready entity=mon.0 client_cookie=24327feace0ea1b6 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:57.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.424+0000 7feea0d25700 1 --2- 172.21.15.38:0/2165087079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee84003b80 0x7fee84003fe0 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7fee8c008910 tx=0x7fee8c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.437 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.424+0000 7feea0d25700 1 --2- 172.21.15.38:0/2165087079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee84003b80 0x7fee84003fe0 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7fee8c008910 tx=0x7fee8c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.437 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.424+0000 7fee8bfff700 1 -- 172.21.15.38:0/2165087079 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee8c008d50 con 0x7fee84003b80 2020-06-12T17:48:57.437 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.424+0000 7feea0d25700 1 --2- 172.21.15.38:0/2165087079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee84003b80 0x7fee84003fe0 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7fee8c008910 tx=0x7fee8c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.437 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.424+0000 7fee8bfff700 1 -- 172.21.15.38:0/2165087079 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8c010830 con 0x7fee84003b80 2020-06-12T17:48:57.437 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.424+0000 7fee8bfff700 1 -- 172.21.15.38:0/2165087079 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee8c010c10 con 0x7fee84003b80 2020-06-12T17:48:57.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.424+0000 7feea378a700 1 -- 172.21.15.38:0/2165087079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee84003b80 msgr2=0x7fee84003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:57.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.424+0000 7feea378a700 1 --2- 172.21.15.38:0/2165087079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee84003b80 0x7fee84003fe0 secure :-1 s=READY pgs=340 cs=0 l=1 rx=0x7fee8c008910 tx=0x7fee8c007e60).stop 2020-06-12T17:48:57.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.424+0000 7feea1d27700 1 -- 172.21.15.38:0/2165087079 reap_dead start 2020-06-12T17:48:57.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.425+0000 7feea378a700 1 -- 172.21.15.38:0/2165087079 shutdown_connections 2020-06-12T17:48:57.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.425+0000 7feea378a700 1 -- 172.21.15.38:0/2165087079 >> 172.21.15.38:0/2165087079 conn(0x7fee9c0b8410 msgr2=0x7fee9c0b8820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:57.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.425+0000 7feea378a700 1 -- 172.21.15.38:0/2165087079 shutdown_connections 2020-06-12T17:48:57.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.425+0000 7feea378a700 1 -- 172.21.15.38:0/2165087079 wait complete. 2020-06-12T17:48:57.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.426+0000 7feea378a700 1 Processor -- start 2020-06-12T17:48:57.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.426+0000 7feea378a700 1 -- start start 2020-06-12T17:48:57.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.426+0000 7feea378a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fee9c150670 0x7fee9c0af170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:57.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.426+0000 7feea378a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee9c140b80 0x7fee9c131f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:57.444 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.426+0000 7feea378a700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee9c064330 con 0x7fee9c150a50 2020-06-12T17:48:57.444 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.426+0000 7feea378a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee9c066740 con 0x7fee9c150670 2020-06-12T17:48:57.444 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.426+0000 7feea378a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c0af730 con 0x7fee9c140b80 2020-06-12T17:48:57.444 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.426+0000 7feea0d25700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fee9c150a50 0x7fee9c140470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38760/0 (socket says 172.21.15.38:38760) 2020-06-12T17:48:57.444 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.426+0000 7feea0d25700 1 -- 172.21.15.38:0/3524627106 learned_addr learned my addr 172.21.15.38:0/3524627106 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:57.445 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7feea1526700 1 --2- 172.21.15.38:0/3524627106 >> v2:172.21.15.150:3300/0 conn(0x7fee9c150670 0x7fee9c0af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:57.445 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7feea1d27700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee9c140b80 0x7fee9c131f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:57.445 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7fee8a7fc700 1 -- 172.21.15.38:0/3524627106 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307033882 0 0) 0x7fee9c064330 con 0x7fee9c150a50 2020-06-12T17:48:57.445 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7fee8a7fc700 1 -- 172.21.15.38:0/3524627106 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee7c002fe0 con 0x7fee9c150a50 2020-06-12T17:48:57.445 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7fee8a7fc700 1 -- 172.21.15.38:0/3524627106 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3651485982 0 0) 0x7fee7c002fe0 con 0x7fee9c150a50 2020-06-12T17:48:57.446 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7fee8a7fc700 1 -- 172.21.15.38:0/3524627106 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fee9c064330 con 0x7fee9c150a50 2020-06-12T17:48:57.446 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7fee8a7fc700 1 -- 172.21.15.38:0/3524627106 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fee8c007fa0 con 0x7fee9c150a50 2020-06-12T17:48:57.446 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7fee8a7fc700 1 -- 172.21.15.38:0/3524627106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee9c140b80 msgr2=0x7fee9c131f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:57.446 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7fee8a7fc700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee9c140b80 0x7fee9c131f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:57.446 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7fee8a7fc700 1 -- 172.21.15.38:0/3524627106 >> v2:172.21.15.150:3300/0 conn(0x7fee9c150670 msgr2=0x7fee9c0af170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:57.447 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7fee8a7fc700 1 --2- 172.21.15.38:0/3524627106 >> v2:172.21.15.150:3300/0 conn(0x7fee9c150670 0x7fee9c0af170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:57.447 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7fee8a7fc700 1 -- 172.21.15.38:0/3524627106 >> v1:172.21.15.38:6789/0 conn(0x7fee9c150a50 legacy=0x7fee9c140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:57.447 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7fee8a7fc700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee7c0049b0 0x7fee7c004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:57.447 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7fee8a7fc700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee7c0052a0 0x7fee7c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:57.447 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7fee8a7fc700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee7c004000 0x7fee7c004440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:57.448 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7fee8a7fc700 1 -- 172.21.15.38:0/3524627106 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c066740 con 0x7fee7c004000 2020-06-12T17:48:57.448 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7fee8a7fc700 1 -- 172.21.15.38:0/3524627106 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c0af730 con 0x7fee7c0049b0 2020-06-12T17:48:57.448 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7fee8a7fc700 1 -- 172.21.15.38:0/3524627106 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c00b980 con 0x7fee7c0052a0 2020-06-12T17:48:57.448 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7feea1d27700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee9c140b80 0x7fee9c131f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:57.448 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7feea1526700 1 --2- 172.21.15.38:0/3524627106 >> v2:172.21.15.150:3300/0 conn(0x7fee9c150670 0x7fee9c0af170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:57.449 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7feea1d27700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee7c004000 0x7fee7c004440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:57.449 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7feea0d25700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee7c0052a0 0x7fee7c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:57.449 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7feea1526700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee7c0049b0 0x7fee7c004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:57.449 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7feea1d27700 1 -- 172.21.15.38:0/3524627106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee7c0052a0 msgr2=0x7fee7c0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:57.449 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7feea1d27700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee7c0052a0 0x7fee7c0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:57.450 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7feea1d27700 1 -- 172.21.15.38:0/3524627106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee7c0049b0 msgr2=0x7fee7c004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:57.450 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7feea1d27700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee7c0049b0 0x7fee7c004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:57.450 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7feea1d27700 1 -- 172.21.15.38:0/3524627106 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c061700 con 0x7fee7c004000 2020-06-12T17:48:57.450 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7feea0d25700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee7c0052a0 0x7fee7c0039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:57.450 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7feea378a700 1 -- 172.21.15.38:0/3524627106 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee9c061930 con 0x7fee7c004000 2020-06-12T17:48:57.451 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7feea1526700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee7c0049b0 0x7fee7c004dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:57.451 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7feea1d27700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee7c004000 0x7fee7c004440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fee94001450 tx=0x7fee9c09e510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.451 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.427+0000 7feea1d27700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee7c004000 0x7fee7c004440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fee94001450 tx=0x7fee9c09e510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.451 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.428+0000 7feea1d27700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee7c004000 0x7fee7c004440 secure :-1 s=READY pgs=342 cs=0 l=1 rx=0x7fee94001450 tx=0x7fee9c09e510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:57.451 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.428+0000 7feea378a700 1 -- 172.21.15.38:0/3524627106 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee9c131f50 con 0x7fee7c004000 2020-06-12T17:48:57.452 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.428+0000 7feea1d27700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee7c004000 0x7fee7c004440 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7fee94001450 tx=0x7fee9c09e510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.452 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.428+0000 7fee8a7fc700 1 -- 172.21.15.38:0/3524627106 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee94011870 con 0x7fee7c004000 2020-06-12T17:48:57.452 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.428+0000 7feea1d27700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee7c004000 0x7fee7c004440 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7fee94001450 tx=0x7fee9c09e510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.453 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.428+0000 7feea1d27700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee7c004000 0x7fee7c004440 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7fee94001450 tx=0x7fee9c09e510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.453 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.428+0000 7fee8a7fc700 1 -- 172.21.15.38:0/3524627106 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee940119d0 con 0x7fee7c004000 2020-06-12T17:48:57.453 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.428+0000 7fee8a7fc700 1 -- 172.21.15.38:0/3524627106 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee94011d30 con 0x7fee7c004000 2020-06-12T17:48:57.453 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.428+0000 7feea1d27700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee7c004000 0x7fee7c004440 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7fee94001450 tx=0x7fee9c09e510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.453 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.428+0000 7feea378a700 1 -- 172.21.15.38:0/3524627106 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee9c061ac0 con 0x7fee7c004000 2020-06-12T17:48:57.454 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.429+0000 7fee8a7fc700 1 -- 172.21.15.38:0/3524627106 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fee94007180 con 0x7fee7c004000 2020-06-12T17:48:57.454 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.429+0000 7feea1d27700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee7c004000 0x7fee7c004440 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7fee94001450 tx=0x7fee9c09e510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.454 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.429+0000 7fee8a7fc700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fee7c055c90 0x7fee7c058150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:57.454 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.429+0000 7fee8a7fc700 1 -- 172.21.15.38:0/3524627106 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fee94060a70 con 0x7fee7c004000 2020-06-12T17:48:57.454 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.429+0000 7feea1526700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fee7c055c90 0x7fee7c058150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:57.455 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.429+0000 7feea1526700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fee7c055c90 0x7fee7c058150 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fee98002f30 tx=0x7fee98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.455 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.429+0000 7feea1526700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fee7c055c90 0x7fee7c058150 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fee98002f30 tx=0x7fee98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.455 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.429+0000 7feea1526700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fee7c055c90 0x7fee7c058150 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7fee98002f30 tx=0x7fee98007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:57.455 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.432+0000 7feea1d27700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee7c004000 0x7fee7c004440 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7fee94001450 tx=0x7fee9c09e510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.455 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.432+0000 7fee8a7fc700 1 -- 172.21.15.38:0/3524627106 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fee9403c170 con 0x7fee7c004000 2020-06-12T17:48:57.638 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.635+0000 7feea378a700 1 -- 172.21.15.38:0/3524627106 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fee9c056c30 con 0x7fee7c004000 2020-06-12T17:48:57.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.642+0000 7feea1d27700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee7c004000 0x7fee7c004440 secure :-1 s=THROTTLE_DONE pgs=342 cs=0 l=1 rx=0x7fee94001450 tx=0x7fee9c09e510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.642+0000 7fee8a7fc700 1 -- 172.21.15.38:0/3524627106 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7fee9403f790 con 0x7fee7c004000 2020-06-12T17:48:57.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.644+0000 7feea378a700 1 -- 172.21.15.38:0/3524627106 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fee7c055c90 msgr2=0x7fee7c058150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:57.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.644+0000 7feea378a700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fee7c055c90 0x7fee7c058150 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7fee98002f30 tx=0x7fee98007e60).stop 2020-06-12T17:48:57.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.644+0000 7feea378a700 1 -- 172.21.15.38:0/3524627106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee7c004000 msgr2=0x7fee7c004440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:57.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.644+0000 7feea378a700 1 --2- 172.21.15.38:0/3524627106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee7c004000 0x7fee7c004440 secure :-1 s=READY pgs=342 cs=0 l=1 rx=0x7fee94001450 tx=0x7fee9c09e510).stop 2020-06-12T17:48:57.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.644+0000 7feea1d27700 1 -- 172.21.15.38:0/3524627106 reap_dead start 2020-06-12T17:48:57.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.644+0000 7feea1d27700 1 -- 172.21.15.38:0/3524627106 reap_dead start 2020-06-12T17:48:57.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.644+0000 7feea378a700 1 -- 172.21.15.38:0/3524627106 shutdown_connections 2020-06-12T17:48:57.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.644+0000 7feea378a700 1 -- 172.21.15.38:0/3524627106 >> 172.21.15.38:0/3524627106 conn(0x7fee9c0b8410 msgr2=0x7fee9c144f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:57.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.644+0000 7feea378a700 1 -- 172.21.15.38:0/3524627106 shutdown_connections 2020-06-12T17:48:57.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.644+0000 7feea378a700 1 -- 172.21.15.38:0/3524627106 wait complete. 2020-06-12T17:48:57.650 INFO:teuthology.orchestra.run.smithi038.stderr:updated 2020-06-12T17:48:57.658 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-osd 2020-06-12T17:48:57.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.769+0000 7f97907dd700 1 Processor -- start 2020-06-12T17:48:57.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.770+0000 7f97907dd700 1 -- start start 2020-06-12T17:48:57.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.770+0000 7f97907dd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9788066eb0 0x7f97880b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:57.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.770+0000 7f97907dd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f978805b420 0x7f978805b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:57.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.770+0000 7f97907dd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f978805ab90 0x7f978809b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:57.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.770+0000 7f97907dd700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97880b4950 con 0x7f9788066eb0 2020-06-12T17:48:57.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.770+0000 7f97907dd700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97881424b0 con 0x7f978805ab90 2020-06-12T17:48:57.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.770+0000 7f97907dd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9788067290 con 0x7f978805b420 2020-06-12T17:48:57.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.771+0000 7f978e579700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9788066eb0 0x7f97880b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:57.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.771+0000 7f978e579700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9788066eb0 0x7f97880b44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36956/0 (socket says 172.21.15.38:36956) 2020-06-12T17:48:57.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.771+0000 7f978e579700 1 -- 172.21.15.38:0/1065024158 learned_addr learned my addr 172.21.15.38:0/1065024158 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:57.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.771+0000 7f978ed7a700 1 --2- 172.21.15.38:0/1065024158 >> v2:172.21.15.150:3300/0 conn(0x7f978805ab90 0x7f978809b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:57.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.771+0000 7f978dd78700 1 --2- 172.21.15.38:0/1065024158 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f978805b420 0x7f978805b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:57.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.771+0000 7f978e579700 1 -- 172.21.15.38:0/1065024158 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f978805b420 msgr2=0x7f978805b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:57.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.771+0000 7f978e579700 1 --2- 172.21.15.38:0/1065024158 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f978805b420 0x7f978805b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:57.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.771+0000 7f978e579700 1 -- 172.21.15.38:0/1065024158 >> v2:172.21.15.150:3300/0 conn(0x7f978805ab90 msgr2=0x7f978809b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:57.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.771+0000 7f978e579700 1 --2- 172.21.15.38:0/1065024158 >> v2:172.21.15.150:3300/0 conn(0x7f978805ab90 0x7f978809b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:57.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.771+0000 7f978e579700 1 -- 172.21.15.38:0/1065024158 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97880b3bc0 con 0x7f9788066eb0 2020-06-12T17:48:57.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.771+0000 7f978dd78700 1 --2- 172.21.15.38:0/1065024158 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f978805b420 0x7f978805b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:48:57.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.771+0000 7f978ed7a700 1 --2- 172.21.15.38:0/1065024158 >> v2:172.21.15.150:3300/0 conn(0x7f978805ab90 0x7f978809b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:48:57.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.771+0000 7f978e579700 1 --2- 172.21.15.38:0/1065024158 >> v2:172.21.15.38:3300/0 conn(0x7f9788066eb0 0x7f97880b44f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9778002f30 tx=0x7f9778007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.771+0000 7f978e579700 1 --2- 172.21.15.38:0/1065024158 >> v2:172.21.15.38:3300/0 conn(0x7f9788066eb0 0x7f97880b44f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9778002f30 tx=0x7f9778007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.771+0000 7f978e579700 1 --2- 172.21.15.38:0/1065024158 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9788066eb0 0x7f97880b44f0 secure :-1 s=READY pgs=343 cs=0 l=1 rx=0x7f9778002f30 tx=0x7f9778007e60).ready entity=mon.0 client_cookie=8d666e0649eb3c51 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:57.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.771+0000 7f978e579700 1 --2- 172.21.15.38:0/1065024158 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9788066eb0 0x7f97880b44f0 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7f9778002f30 tx=0x7f9778007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.771+0000 7f978e579700 1 --2- 172.21.15.38:0/1065024158 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9788066eb0 0x7f97880b44f0 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7f9778002f30 tx=0x7f9778007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.771+0000 7f978d577700 1 -- 172.21.15.38:0/1065024158 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97780116e0 con 0x7f9788066eb0 2020-06-12T17:48:57.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.771+0000 7f978e579700 1 --2- 172.21.15.38:0/1065024158 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9788066eb0 0x7f97880b44f0 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7f9778002f30 tx=0x7f9778007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.771+0000 7f978d577700 1 -- 172.21.15.38:0/1065024158 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9778011840 con 0x7f9788066eb0 2020-06-12T17:48:57.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.771+0000 7f978d577700 1 -- 172.21.15.38:0/1065024158 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9778011be0 con 0x7f9788066eb0 2020-06-12T17:48:57.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.771+0000 7f97907dd700 1 -- 172.21.15.38:0/1065024158 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9788066eb0 msgr2=0x7f97880b44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:57.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.771+0000 7f97907dd700 1 --2- 172.21.15.38:0/1065024158 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9788066eb0 0x7f97880b44f0 secure :-1 s=READY pgs=343 cs=0 l=1 rx=0x7f9778002f30 tx=0x7f9778007e60).stop 2020-06-12T17:48:57.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.772+0000 7f97907dd700 1 -- 172.21.15.38:0/1065024158 shutdown_connections 2020-06-12T17:48:57.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.772+0000 7f97907dd700 1 --2- 172.21.15.38:0/1065024158 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9788066eb0 0x7f97880b44f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:57.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.772+0000 7f97907dd700 1 --2- 172.21.15.38:0/1065024158 >> v2:172.21.15.150:3300/0 conn(0x7f978805ab90 0x7f978809b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:57.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.772+0000 7f97907dd700 1 --2- 172.21.15.38:0/1065024158 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f978805b420 0x7f978805b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:57.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.772+0000 7f97907dd700 1 -- 172.21.15.38:0/1065024158 >> 172.21.15.38:0/1065024158 conn(0x7f97880b8410 msgr2=0x7f97880b8820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:57.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.772+0000 7f97907dd700 1 -- 172.21.15.38:0/1065024158 shutdown_connections 2020-06-12T17:48:57.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.772+0000 7f97907dd700 1 -- 172.21.15.38:0/1065024158 wait complete. 2020-06-12T17:48:57.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.773+0000 7f97907dd700 1 Processor -- start 2020-06-12T17:48:57.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.773+0000 7f97907dd700 1 -- start start 2020-06-12T17:48:57.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.773+0000 7f97907dd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f978805ab90 0x7f9788141ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:57.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.773+0000 7f97907dd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f978805b420 0x7f9788140c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:57.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.773+0000 7f97907dd700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9788141080 con 0x7f9788066eb0 2020-06-12T17:48:57.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.773+0000 7f97907dd700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97881419a0 con 0x7f978805b420 2020-06-12T17:48:57.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.773+0000 7f97907dd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978813f3c0 con 0x7f978805ab90 2020-06-12T17:48:57.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.774+0000 7f978ed7a700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f9788066eb0 0x7f9788141290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38780/0 (socket says 172.21.15.38:38780) 2020-06-12T17:48:57.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.774+0000 7f978ed7a700 1 -- 172.21.15.38:0/4243728985 learned_addr learned my addr 172.21.15.38:0/4243728985 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:57.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.774+0000 7f978dd78700 1 --2- 172.21.15.38:0/4243728985 >> v2:172.21.15.150:3300/0 conn(0x7f978805b420 0x7f9788140c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:57.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.774+0000 7f978e579700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f978805ab90 0x7f9788141ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:57.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.774+0000 7f97777fe700 1 -- 172.21.15.38:0/4243728985 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895454465 0 0) 0x7f9780002320 con 0x7f9788066eb0 2020-06-12T17:48:57.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.774+0000 7f97777fe700 1 -- 172.21.15.38:0/4243728985 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9768002fe0 con 0x7f9788066eb0 2020-06-12T17:48:57.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.774+0000 7f97777fe700 1 -- 172.21.15.38:0/4243728985 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1962117970 0 0) 0x7f9768002fe0 con 0x7f9788066eb0 2020-06-12T17:48:57.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.774+0000 7f97777fe700 1 -- 172.21.15.38:0/4243728985 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9780002320 con 0x7f9788066eb0 2020-06-12T17:48:57.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.774+0000 7f97777fe700 1 -- 172.21.15.38:0/4243728985 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f9780002bb0 con 0x7f9788066eb0 2020-06-12T17:48:57.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.774+0000 7f97777fe700 1 -- 172.21.15.38:0/4243728985 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f978805ab90 msgr2=0x7f9788141ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:57.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.774+0000 7f97777fe700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f978805ab90 0x7f9788141ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:57.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.774+0000 7f97777fe700 1 -- 172.21.15.38:0/4243728985 >> v2:172.21.15.150:3300/0 conn(0x7f978805b420 msgr2=0x7f9788140c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:57.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.774+0000 7f97777fe700 1 --2- 172.21.15.38:0/4243728985 >> v2:172.21.15.150:3300/0 conn(0x7f978805b420 0x7f9788140c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:57.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.774+0000 7f97777fe700 1 -- 172.21.15.38:0/4243728985 >> v1:172.21.15.38:6789/0 conn(0x7f9788066eb0 legacy=0x7f9788141290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:57.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.774+0000 7f97777fe700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9768004a80 0x7f9768004e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:57.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.774+0000 7f97777fe700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f978805ab90 0x7f9768003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:57.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.774+0000 7f97777fe700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9768003d80 0x7f9768004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:57.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.774+0000 7f97777fe700 1 -- 172.21.15.38:0/4243728985 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97881419a0 con 0x7f9768003d80 2020-06-12T17:48:57.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.774+0000 7f97777fe700 1 -- 172.21.15.38:0/4243728985 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978813f3c0 con 0x7f9768004a80 2020-06-12T17:48:57.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.774+0000 7f97777fe700 1 -- 172.21.15.38:0/4243728985 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9768004660 con 0x7f978805ab90 2020-06-12T17:48:57.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.774+0000 7f978ed7a700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9768003d80 0x7f9768004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:57.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.774+0000 7f978e579700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9768004a80 0x7f9768004e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:57.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.774+0000 7f978dd78700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f978805ab90 0x7f9768003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:57.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.775+0000 7f978ed7a700 1 -- 172.21.15.38:0/4243728985 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f978805ab90 msgr2=0x7f9768003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:57.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.775+0000 7f978ed7a700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f978805ab90 0x7f9768003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:57.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.775+0000 7f978ed7a700 1 -- 172.21.15.38:0/4243728985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9768004a80 msgr2=0x7f9768004e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:57.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.775+0000 7f978ed7a700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9768004a80 0x7f9768004e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:57.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.775+0000 7f978ed7a700 1 -- 172.21.15.38:0/4243728985 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978813bad0 con 0x7f9768003d80 2020-06-12T17:48:57.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.775+0000 7f97907dd700 1 -- 172.21.15.38:0/4243728985 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f978813f0b0 con 0x7f9768003d80 2020-06-12T17:48:57.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.775+0000 7f978ed7a700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9768003d80 0x7f9768004200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9780002940 tx=0x7f978000ef20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.775+0000 7f97907dd700 1 -- 172.21.15.38:0/4243728985 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9788138450 con 0x7f9768003d80 2020-06-12T17:48:57.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.775+0000 7f978ed7a700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9768003d80 0x7f9768004200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9780002940 tx=0x7f978000ef20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.775+0000 7f978ed7a700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9768003d80 0x7f9768004200 secure :-1 s=READY pgs=345 cs=0 l=1 rx=0x7f9780002940 tx=0x7f978000ef20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:57.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.775+0000 7f978ed7a700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9768003d80 0x7f9768004200 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7f9780002940 tx=0x7f978000ef20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.775+0000 7f97777fe700 1 -- 172.21.15.38:0/4243728985 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97800125f0 con 0x7f9768003d80 2020-06-12T17:48:57.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.775+0000 7f978ed7a700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9768003d80 0x7f9768004200 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7f9780002940 tx=0x7f978000ef20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.775+0000 7f978ed7a700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9768003d80 0x7f9768004200 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7f9780002940 tx=0x7f978000ef20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.775+0000 7f97777fe700 1 -- 172.21.15.38:0/4243728985 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9780012750 con 0x7f9768003d80 2020-06-12T17:48:57.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.775+0000 7f97777fe700 1 -- 172.21.15.38:0/4243728985 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9780012b70 con 0x7f9768003d80 2020-06-12T17:48:57.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.775+0000 7f978ed7a700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9768003d80 0x7f9768004200 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7f9780002940 tx=0x7f978000ef20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.800 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.776+0000 7f97907dd700 1 -- 172.21.15.38:0/4243728985 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f978813bf40 con 0x7f9768003d80 2020-06-12T17:48:57.800 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.776+0000 7f97777fe700 1 -- 172.21.15.38:0/4243728985 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f978000e160 con 0x7f9768003d80 2020-06-12T17:48:57.800 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.776+0000 7f978ed7a700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9768003d80 0x7f9768004200 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7f9780002940 tx=0x7f978000ef20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.800 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.776+0000 7f97777fe700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9768055860 0x7f9768057d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:57.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.776+0000 7f97777fe700 1 -- 172.21.15.38:0/4243728985 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f9780061ab0 con 0x7f9768003d80 2020-06-12T17:48:57.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.776+0000 7f978e579700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9768055860 0x7f9768057d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:57.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.777+0000 7f978e579700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9768055860 0x7f9768057d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9778002f30 tx=0x7f9778007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.777+0000 7f978e579700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9768055860 0x7f9768057d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9778002f30 tx=0x7f9778007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.777+0000 7f978e579700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9768055860 0x7f9768057d20 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7f9778002f30 tx=0x7f9778007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:57.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.780+0000 7f978ed7a700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9768003d80 0x7f9768004200 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7f9780002940 tx=0x7f978000ef20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.780+0000 7f97777fe700 1 -- 172.21.15.38:0/4243728985 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f978003d210 con 0x7f9768003d80 2020-06-12T17:48:57.989 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.985+0000 7f97907dd700 1 -- 172.21.15.38:0/4243728985 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f9788141f20 con 0x7f9768003d80 2020-06-12T17:48:57.996 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.993+0000 7f978ed7a700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9768003d80 0x7f9768004200 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7f9780002940 tx=0x7f978000ef20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:57.996 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.993+0000 7f97777fe700 1 -- 172.21.15.38:0/4243728985 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9780040830 con 0x7f9768003d80 2020-06-12T17:48:57.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.994+0000 7f97907dd700 1 -- 172.21.15.38:0/4243728985 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9768055860 msgr2=0x7f9768057d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:57.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.994+0000 7f97907dd700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9768055860 0x7f9768057d20 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7f9778002f30 tx=0x7f9778007e60).stop 2020-06-12T17:48:57.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.994+0000 7f97907dd700 1 -- 172.21.15.38:0/4243728985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9768003d80 msgr2=0x7f9768004200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:57.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.994+0000 7f97907dd700 1 --2- 172.21.15.38:0/4243728985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9768003d80 0x7f9768004200 secure :-1 s=READY pgs=345 cs=0 l=1 rx=0x7f9780002940 tx=0x7f978000ef20).stop 2020-06-12T17:48:57.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.994+0000 7f978ed7a700 1 -- 172.21.15.38:0/4243728985 reap_dead start 2020-06-12T17:48:57.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.994+0000 7f978ed7a700 1 -- 172.21.15.38:0/4243728985 reap_dead start 2020-06-12T17:48:57.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.994+0000 7f97907dd700 1 -- 172.21.15.38:0/4243728985 shutdown_connections 2020-06-12T17:48:57.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.994+0000 7f97907dd700 1 -- 172.21.15.38:0/4243728985 >> 172.21.15.38:0/4243728985 conn(0x7f97880b8410 msgr2=0x7f97880b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:58.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.994+0000 7f97907dd700 1 -- 172.21.15.38:0/4243728985 shutdown_connections 2020-06-12T17:48:58.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:57.994+0000 7f97907dd700 1 -- 172.21.15.38:0/4243728985 wait complete. 2020-06-12T17:48:58.000 INFO:teuthology.orchestra.run.smithi038.stderr:updated 2020-06-12T17:48:58.008 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-rbd 2020-06-12T17:48:58.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.120+0000 7f8da23ec700 1 Processor -- start 2020-06-12T17:48:58.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.120+0000 7f8da23ec700 1 -- start start 2020-06-12T17:48:58.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.120+0000 7f8da23ec700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8d9c13cda0 0x7f8d9c05ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:58.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.120+0000 7f8da23ec700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8d9c143580 0x7f8d9c065880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:58.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.121+0000 7f8da23ec700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d9c065ce0 0x7f8d9c1461c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:58.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.121+0000 7f8da23ec700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d9c13d180 con 0x7f8d9c143580 2020-06-12T17:48:58.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.121+0000 7f8da23ec700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d9c143a00 con 0x7f8d9c13cda0 2020-06-12T17:48:58.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.121+0000 7f8da23ec700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c0644d0 con 0x7f8d9c065ce0 2020-06-12T17:48:58.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.121+0000 7f8da0be9700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8d9c143580 0x7f8d9c065880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:58.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.121+0000 7f8da0be9700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8d9c143580 0x7f8d9c065880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36974/0 (socket says 172.21.15.38:36974) 2020-06-12T17:48:58.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.121+0000 7f8da0be9700 1 -- 172.21.15.38:0/1026928304 learned_addr learned my addr 172.21.15.38:0/1026928304 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:58.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.121+0000 7f8da13ea700 1 --2- 172.21.15.38:0/1026928304 >> v2:172.21.15.150:3300/0 conn(0x7f8d9c13cda0 0x7f8d9c05ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:58.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.121+0000 7f8da1beb700 1 --2- 172.21.15.38:0/1026928304 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d9c065ce0 0x7f8d9c1461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:58.129 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.121+0000 7f8da0be9700 1 -- 172.21.15.38:0/1026928304 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d9c065ce0 msgr2=0x7f8d9c1461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:58.129 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.121+0000 7f8da0be9700 1 --2- 172.21.15.38:0/1026928304 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d9c065ce0 0x7f8d9c1461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:58.129 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.121+0000 7f8da0be9700 1 -- 172.21.15.38:0/1026928304 >> v2:172.21.15.150:3300/0 conn(0x7f8d9c13cda0 msgr2=0x7f8d9c05ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:58.129 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.121+0000 7f8da0be9700 1 --2- 172.21.15.38:0/1026928304 >> v2:172.21.15.150:3300/0 conn(0x7f8d9c13cda0 0x7f8d9c05ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:58.129 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.121+0000 7f8da0be9700 1 -- 172.21.15.38:0/1026928304 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9c066170 con 0x7f8d9c143580 2020-06-12T17:48:58.130 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.121+0000 7f8da0be9700 1 --2- 172.21.15.38:0/1026928304 >> v2:172.21.15.38:3300/0 conn(0x7f8d9c143580 0x7f8d9c065880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8d98002f30 tx=0x7f8d98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.130 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.121+0000 7f8da0be9700 1 --2- 172.21.15.38:0/1026928304 >> v2:172.21.15.38:3300/0 conn(0x7f8d9c143580 0x7f8d9c065880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8d98002f30 tx=0x7f8d98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.130 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.121+0000 7f8da0be9700 1 --2- 172.21.15.38:0/1026928304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d9c143580 0x7f8d9c065880 secure :-1 s=READY pgs=346 cs=0 l=1 rx=0x7f8d98002f30 tx=0x7f8d98007e60).ready entity=mon.0 client_cookie=c1729d6611b00867 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:58.130 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.121+0000 7f8da0be9700 1 --2- 172.21.15.38:0/1026928304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d9c143580 0x7f8d9c065880 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f8d98002f30 tx=0x7f8d98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.130 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.121+0000 7f8da0be9700 1 --2- 172.21.15.38:0/1026928304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d9c143580 0x7f8d9c065880 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f8d98002f30 tx=0x7f8d98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.121+0000 7f8d8bfff700 1 -- 172.21.15.38:0/1026928304 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d98011580 con 0x7f8d9c143580 2020-06-12T17:48:58.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.121+0000 7f8da0be9700 1 --2- 172.21.15.38:0/1026928304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d9c143580 0x7f8d9c065880 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f8d98002f30 tx=0x7f8d98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.121+0000 7f8d8bfff700 1 -- 172.21.15.38:0/1026928304 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d980116e0 con 0x7f8d9c143580 2020-06-12T17:48:58.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.121+0000 7f8d8bfff700 1 -- 172.21.15.38:0/1026928304 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d98011ac0 con 0x7f8d9c143580 2020-06-12T17:48:58.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.121+0000 7f8da23ec700 1 -- 172.21.15.38:0/1026928304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d9c143580 msgr2=0x7f8d9c065880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:58.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.121+0000 7f8da23ec700 1 --2- 172.21.15.38:0/1026928304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d9c143580 0x7f8d9c065880 secure :-1 s=READY pgs=346 cs=0 l=1 rx=0x7f8d98002f30 tx=0x7f8d98007e60).stop 2020-06-12T17:48:58.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.122+0000 7f8da23ec700 1 -- 172.21.15.38:0/1026928304 shutdown_connections 2020-06-12T17:48:58.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.122+0000 7f8da23ec700 1 --2- 172.21.15.38:0/1026928304 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d9c065ce0 0x7f8d9c1461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:58.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.122+0000 7f8da23ec700 1 --2- 172.21.15.38:0/1026928304 >> v2:172.21.15.150:3300/0 conn(0x7f8d9c13cda0 0x7f8d9c05ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:58.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.122+0000 7f8da23ec700 1 --2- 172.21.15.38:0/1026928304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d9c143580 0x7f8d9c065880 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:58.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.122+0000 7f8da23ec700 1 -- 172.21.15.38:0/1026928304 >> 172.21.15.38:0/1026928304 conn(0x7f8d9c061460 msgr2=0x7f8d9c061870 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:58.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.122+0000 7f8da23ec700 1 -- 172.21.15.38:0/1026928304 shutdown_connections 2020-06-12T17:48:58.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.122+0000 7f8da23ec700 1 -- 172.21.15.38:0/1026928304 wait complete. 2020-06-12T17:48:58.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.123+0000 7f8da23ec700 1 Processor -- start 2020-06-12T17:48:58.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.123+0000 7f8da23ec700 1 -- start start 2020-06-12T17:48:58.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.124+0000 7f8da23ec700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d9c065ce0 0x7f8d9c13e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:58.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.124+0000 7f8da23ec700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d9c141a40 con 0x7f8d9c13cda0 2020-06-12T17:48:58.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.124+0000 7f8da23ec700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d9c141ce0 con 0x7f8d9c143580 2020-06-12T17:48:58.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.124+0000 7f8da23ec700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c12b390 con 0x7f8d9c065ce0 2020-06-12T17:48:58.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.124+0000 7f8da0be9700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8d9c13cda0 0x7f8d9c12ac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38794/0 (socket says 172.21.15.38:38794) 2020-06-12T17:48:58.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.124+0000 7f8da0be9700 1 -- 172.21.15.38:0/2656635750 learned_addr learned my addr 172.21.15.38:0/2656635750 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:58.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.124+0000 7f8d8a7fc700 1 -- 172.21.15.38:0/2656635750 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2844367116 0 0) 0x7f8d9c141a40 con 0x7f8d9c13cda0 2020-06-12T17:48:58.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.124+0000 7f8da13ea700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d9c065ce0 0x7f8d9c13e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:58.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.124+0000 7f8d8a7fc700 1 -- 172.21.15.38:0/2656635750 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d7c002fe0 con 0x7f8d9c13cda0 2020-06-12T17:48:58.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.124+0000 7f8d8a7fc700 1 -- 172.21.15.38:0/2656635750 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 39794484 0 0) 0x7f8d7c002fe0 con 0x7f8d9c13cda0 2020-06-12T17:48:58.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.124+0000 7f8d8a7fc700 1 -- 172.21.15.38:0/2656635750 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8d9c141a40 con 0x7f8d9c13cda0 2020-06-12T17:48:58.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.124+0000 7f8d8a7fc700 1 -- 172.21.15.38:0/2656635750 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f8d980085c0 con 0x7f8d9c13cda0 2020-06-12T17:48:58.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.124+0000 7f8d8a7fc700 1 -- 172.21.15.38:0/2656635750 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d9c065ce0 msgr2=0x7f8d9c13e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:58.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.124+0000 7f8d8a7fc700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d9c065ce0 0x7f8d9c13e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:58.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.124+0000 7f8d8a7fc700 1 -- 172.21.15.38:0/2656635750 >> v1:172.21.15.150:6789/0 conn(0x7f8d9c143580 legacy=0x7f8d9c0b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:58.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.124+0000 7f8d8a7fc700 1 -- 172.21.15.38:0/2656635750 >> v1:172.21.15.38:6789/0 conn(0x7f8d9c13cda0 legacy=0x7f8d9c12ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:58.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.124+0000 7f8d8a7fc700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d9c065ce0 0x7f8d7c0049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:58.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.124+0000 7f8d8a7fc700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d7c004e10 0x7f8d7c005230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:58.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.124+0000 7f8d8a7fc700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d7c003a30 0x7f8d7c003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:58.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.124+0000 7f8d8a7fc700 1 -- 172.21.15.38:0/2656635750 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c12b390 con 0x7f8d7c004e10 2020-06-12T17:48:58.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.124+0000 7f8d8a7fc700 1 -- 172.21.15.38:0/2656635750 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c0044f0 con 0x7f8d7c003a30 2020-06-12T17:48:58.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.124+0000 7f8d8a7fc700 1 -- 172.21.15.38:0/2656635750 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c0046b0 con 0x7f8d9c065ce0 2020-06-12T17:48:58.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.125+0000 7f8da0be9700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d7c004e10 0x7f8d7c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:58.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.125+0000 7f8da13ea700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d9c065ce0 0x7f8d7c0049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:58.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.125+0000 7f8da1beb700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d7c003a30 0x7f8d7c003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:58.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.125+0000 7f8da0be9700 1 -- 172.21.15.38:0/2656635750 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d9c065ce0 msgr2=0x7f8d7c0049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:58.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.125+0000 7f8da0be9700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d9c065ce0 0x7f8d7c0049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:58.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.125+0000 7f8da0be9700 1 -- 172.21.15.38:0/2656635750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d7c003a30 msgr2=0x7f8d7c003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:58.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.125+0000 7f8da0be9700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d7c003a30 0x7f8d7c003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:58.144 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.125+0000 7f8da0be9700 1 -- 172.21.15.38:0/2656635750 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9c12b4d0 con 0x7f8d7c004e10 2020-06-12T17:48:58.144 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.125+0000 7f8da23ec700 1 -- 172.21.15.38:0/2656635750 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d9c13e580 con 0x7f8d7c004e10 2020-06-12T17:48:58.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.125+0000 7f8da0be9700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d7c004e10 0x7f8d7c005230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8d980082e0 tx=0x7f8d98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.125+0000 7f8da0be9700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d7c004e10 0x7f8d7c005230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8d980082e0 tx=0x7f8d98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.125+0000 7f8da0be9700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d7c004e10 0x7f8d7c005230 secure :-1 s=READY pgs=348 cs=0 l=1 rx=0x7f8d980082e0 tx=0x7f8d98007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:58.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.125+0000 7f8da0be9700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d7c004e10 0x7f8d7c005230 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f8d980082e0 tx=0x7f8d98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.125+0000 7f8d8a7fc700 1 -- 172.21.15.38:0/2656635750 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d98007530 con 0x7f8d7c004e10 2020-06-12T17:48:58.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.125+0000 7f8da0be9700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d7c004e10 0x7f8d7c005230 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f8d980082e0 tx=0x7f8d98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.125+0000 7f8da23ec700 1 -- 172.21.15.38:0/2656635750 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d9c1413a0 con 0x7f8d7c004e10 2020-06-12T17:48:58.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.125+0000 7f8da0be9700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d7c004e10 0x7f8d7c005230 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f8d980082e0 tx=0x7f8d98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.125+0000 7f8d8a7fc700 1 -- 172.21.15.38:0/2656635750 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d980056c0 con 0x7f8d7c004e10 2020-06-12T17:48:58.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.125+0000 7f8d8a7fc700 1 -- 172.21.15.38:0/2656635750 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d98005aa0 con 0x7f8d7c004e10 2020-06-12T17:48:58.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.126+0000 7f8da0be9700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d7c004e10 0x7f8d7c005230 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f8d980082e0 tx=0x7f8d98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.126+0000 7f8d8a7fc700 1 -- 172.21.15.38:0/2656635750 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f8d98005c00 con 0x7f8d7c004e10 2020-06-12T17:48:58.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.126+0000 7f8da0be9700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d7c004e10 0x7f8d7c005230 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f8d980082e0 tx=0x7f8d98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.126+0000 7f8da23ec700 1 -- 172.21.15.38:0/2656635750 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d9c056c30 con 0x7f8d7c004e10 2020-06-12T17:48:58.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.126+0000 7f8d8a7fc700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8d7c0558b0 0x7f8d7c057d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:58.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.126+0000 7f8d8a7fc700 1 -- 172.21.15.38:0/2656635750 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f8d98061ee0 con 0x7f8d7c004e10 2020-06-12T17:48:58.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.126+0000 7f8da13ea700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8d7c0558b0 0x7f8d7c057d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:58.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.127+0000 7f8da13ea700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8d7c0558b0 0x7f8d7c057d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8d8c002f30 tx=0x7f8d8c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.127+0000 7f8da13ea700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8d7c0558b0 0x7f8d7c057d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8d8c002f30 tx=0x7f8d8c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.127+0000 7f8da13ea700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8d7c0558b0 0x7f8d7c057d70 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f8d8c002f30 tx=0x7f8d8c007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:58.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.130+0000 7f8da0be9700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d7c004e10 0x7f8d7c005230 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f8d980082e0 tx=0x7f8d98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.130+0000 7f8d8a7fc700 1 -- 172.21.15.38:0/2656635750 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f8d9803d700 con 0x7f8d7c004e10 2020-06-12T17:48:58.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.337+0000 7f8da23ec700 1 -- 172.21.15.38:0/2656635750 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f8d9c147010 con 0x7f8d7c004e10 2020-06-12T17:48:58.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.345+0000 7f8da0be9700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d7c004e10 0x7f8d7c005230 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f8d980082e0 tx=0x7f8d98007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.345+0000 7f8d8a7fc700 1 -- 172.21.15.38:0/2656635750 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8d98040d20 con 0x7f8d7c004e10 2020-06-12T17:48:58.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.346+0000 7f8da23ec700 1 -- 172.21.15.38:0/2656635750 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8d7c0558b0 msgr2=0x7f8d7c057d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:58.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.346+0000 7f8da23ec700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8d7c0558b0 0x7f8d7c057d70 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f8d8c002f30 tx=0x7f8d8c007e60).stop 2020-06-12T17:48:58.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.346+0000 7f8da23ec700 1 -- 172.21.15.38:0/2656635750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d7c004e10 msgr2=0x7f8d7c005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:58.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.346+0000 7f8da23ec700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d7c004e10 0x7f8d7c005230 secure :-1 s=READY pgs=348 cs=0 l=1 rx=0x7f8d980082e0 tx=0x7f8d98007e60).stop 2020-06-12T17:48:58.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.346+0000 7f8da1beb700 1 -- 172.21.15.38:0/2656635750 reap_dead start 2020-06-12T17:48:58.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.346+0000 7f8da23ec700 1 -- 172.21.15.38:0/2656635750 shutdown_connections 2020-06-12T17:48:58.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.346+0000 7f8da23ec700 1 --2- 172.21.15.38:0/2656635750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d7c004e10 0x7f8d7c005230 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:58.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.346+0000 7f8da23ec700 1 -- 172.21.15.38:0/2656635750 >> 172.21.15.38:0/2656635750 conn(0x7f8d9c061460 msgr2=0x7f8d9c12ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:58.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.346+0000 7f8da23ec700 1 -- 172.21.15.38:0/2656635750 shutdown_connections 2020-06-12T17:48:58.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.346+0000 7f8da23ec700 1 -- 172.21.15.38:0/2656635750 wait complete. 2020-06-12T17:48:58.352 INFO:teuthology.orchestra.run.smithi038.stderr:updated 2020-06-12T17:48:58.360 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-rbd-mirror 2020-06-12T17:48:58.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.472+0000 7f08c93f5700 1 Processor -- start 2020-06-12T17:48:58.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.472+0000 7f08c93f5700 1 -- start start 2020-06-12T17:48:58.478 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.473+0000 7f08c93f5700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f08c409df50 0x7f08c409b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:58.479 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.473+0000 7f08c93f5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08c4066a80 0x7f08c40aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:58.479 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.473+0000 7f08c93f5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c40ad7b0 con 0x7f08c409db70 2020-06-12T17:48:58.479 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.473+0000 7f08c93f5700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c4144ee0 con 0x7f08c409df50 2020-06-12T17:48:58.479 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.473+0000 7f08c93f5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c41449a0 con 0x7f08c4066a80 2020-06-12T17:48:58.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.473+0000 7f08c27fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f08c409df50 0x7f08c409b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:58.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.473+0000 7f08c27fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f08c409df50 0x7f08c409b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36994/0 (socket says 172.21.15.38:36994) 2020-06-12T17:48:58.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.473+0000 7f08c27fc700 1 -- 172.21.15.38:0/715094521 learned_addr learned my addr 172.21.15.38:0/715094521 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:58.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.473+0000 7f08c37fe700 1 --2- 172.21.15.38:0/715094521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08c4066a80 0x7f08c40aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:58.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.473+0000 7f08c27fc700 1 -- 172.21.15.38:0/715094521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08c4066a80 msgr2=0x7f08c40aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:58.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.473+0000 7f08c27fc700 1 --2- 172.21.15.38:0/715094521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08c4066a80 0x7f08c40aebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:58.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.473+0000 7f08c27fc700 1 -- 172.21.15.38:0/715094521 >> v1:172.21.15.150:6789/0 conn(0x7f08c409db70 legacy=0x7f08c4141040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:58.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.473+0000 7f08c27fc700 1 -- 172.21.15.38:0/715094521 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c4144c40 con 0x7f08c409df50 2020-06-12T17:48:58.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.473+0000 7f08c27fc700 1 --2- 172.21.15.38:0/715094521 >> v2:172.21.15.38:3300/0 conn(0x7f08c409df50 0x7f08c409b120 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f08c409e590 tx=0x7f08ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.473+0000 7f08c27fc700 1 --2- 172.21.15.38:0/715094521 >> v2:172.21.15.38:3300/0 conn(0x7f08c409df50 0x7f08c409b120 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f08c409e590 tx=0x7f08ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.473+0000 7f08c27fc700 1 --2- 172.21.15.38:0/715094521 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08c409df50 0x7f08c409b120 secure :-1 s=READY pgs=349 cs=0 l=1 rx=0x7f08c409e590 tx=0x7f08ac007e60).ready entity=mon.0 client_cookie=724b1c80794dbc20 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:58.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.473+0000 7f08c27fc700 1 --2- 172.21.15.38:0/715094521 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08c409df50 0x7f08c409b120 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7f08c409e590 tx=0x7f08ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.473+0000 7f08c27fc700 1 --2- 172.21.15.38:0/715094521 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08c409df50 0x7f08c409b120 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7f08c409e590 tx=0x7f08ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.473+0000 7f08c1ffb700 1 -- 172.21.15.38:0/715094521 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08ac0116e0 con 0x7f08c409df50 2020-06-12T17:48:58.483 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.473+0000 7f08c27fc700 1 --2- 172.21.15.38:0/715094521 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08c409df50 0x7f08c409b120 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7f08c409e590 tx=0x7f08ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.483 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.473+0000 7f08c1ffb700 1 -- 172.21.15.38:0/715094521 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ac011840 con 0x7f08c409df50 2020-06-12T17:48:58.483 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.474+0000 7f08c1ffb700 1 -- 172.21.15.38:0/715094521 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08ac011c60 con 0x7f08c409df50 2020-06-12T17:48:58.483 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.474+0000 7f08c93f5700 1 -- 172.21.15.38:0/715094521 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08c409df50 msgr2=0x7f08c409b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:58.483 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.474+0000 7f08c93f5700 1 --2- 172.21.15.38:0/715094521 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08c409df50 0x7f08c409b120 secure :-1 s=READY pgs=349 cs=0 l=1 rx=0x7f08c409e590 tx=0x7f08ac007e60).stop 2020-06-12T17:48:58.484 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.474+0000 7f08c93f5700 1 -- 172.21.15.38:0/715094521 shutdown_connections 2020-06-12T17:48:58.484 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.474+0000 7f08c93f5700 1 --2- 172.21.15.38:0/715094521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08c4066a80 0x7f08c40aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:58.484 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.474+0000 7f08c93f5700 1 --2- 172.21.15.38:0/715094521 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08c409df50 0x7f08c409b120 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:58.484 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.474+0000 7f08c93f5700 1 -- 172.21.15.38:0/715094521 >> 172.21.15.38:0/715094521 conn(0x7f08c40b8410 msgr2=0x7f08c40b8820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:58.484 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.474+0000 7f08c93f5700 1 -- 172.21.15.38:0/715094521 shutdown_connections 2020-06-12T17:48:58.484 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.474+0000 7f08c93f5700 1 -- 172.21.15.38:0/715094521 wait complete. 2020-06-12T17:48:58.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.475+0000 7f08c93f5700 1 Processor -- start 2020-06-12T17:48:58.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.475+0000 7f08c93f5700 1 -- start start 2020-06-12T17:48:58.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.476+0000 7f08c93f5700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f08c409db70 0x7f08c4065fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:58.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.476+0000 7f08c93f5700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c40649e0 con 0x7f08c409df50 2020-06-12T17:48:58.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.476+0000 7f08c93f5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c4064c80 con 0x7f08c4066a80 2020-06-12T17:48:58.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.476+0000 7f08c93f5700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c40625e0 con 0x7f08c409db70 2020-06-12T17:48:58.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.476+0000 7f08c27fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f08c409db70 0x7f08c4065fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:58.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.476+0000 7f08c37fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f08c409df50 0x7f08c4142050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38816/0 (socket says 172.21.15.38:38816) 2020-06-12T17:48:58.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.476+0000 7f08c27fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f08c409db70 0x7f08c4065fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36998/0 (socket says 172.21.15.38:36998) 2020-06-12T17:48:58.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.476+0000 7f08c37fe700 1 -- 172.21.15.38:0/348067035 learned_addr learned my addr 172.21.15.38:0/348067035 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:58.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.476+0000 7f08c27fc700 1 -- 172.21.15.38:0/348067035 >> v1:172.21.15.150:6789/0 conn(0x7f08c4066a80 legacy=0x7f08c4151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:58.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.476+0000 7f08c27fc700 1 -- 172.21.15.38:0/348067035 >> v1:172.21.15.38:6789/0 conn(0x7f08c409df50 legacy=0x7f08c4142050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:58.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.476+0000 7f08bbfff700 1 -- 172.21.15.38:0/348067035 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1883018428 0 0) 0x7f08c40649e0 con 0x7f08c409df50 2020-06-12T17:48:58.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.476+0000 7f08c27fc700 1 -- 172.21.15.38:0/348067035 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c4064f20 con 0x7f08c409db70 2020-06-12T17:48:58.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.476+0000 7f08c27fc700 1 --2- 172.21.15.38:0/348067035 >> v2:172.21.15.38:3300/0 conn(0x7f08c409db70 0x7f08c4065fc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f08c409e590 tx=0x7f08ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.476+0000 7f08c27fc700 1 --2- 172.21.15.38:0/348067035 >> v2:172.21.15.38:3300/0 conn(0x7f08c409db70 0x7f08c4065fc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f08c409e590 tx=0x7f08ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.476+0000 7f08c27fc700 1 --2- 172.21.15.38:0/348067035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08c409db70 0x7f08c4065fc0 secure :-1 s=READY pgs=351 cs=0 l=1 rx=0x7f08c409e590 tx=0x7f08ac007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:58.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.476+0000 7f08c27fc700 1 --2- 172.21.15.38:0/348067035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08c409db70 0x7f08c4065fc0 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f08c409e590 tx=0x7f08ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.476+0000 7f08bbfff700 1 -- 172.21.15.38:0/348067035 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08ac0058b0 con 0x7f08c409db70 2020-06-12T17:48:58.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.476+0000 7f08c27fc700 1 --2- 172.21.15.38:0/348067035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08c409db70 0x7f08c4065fc0 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f08c409e590 tx=0x7f08ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.476+0000 7f08c27fc700 1 --2- 172.21.15.38:0/348067035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08c409db70 0x7f08c4065fc0 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f08c409e590 tx=0x7f08ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.476+0000 7f08bbfff700 1 -- 172.21.15.38:0/348067035 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ac005a10 con 0x7f08c409db70 2020-06-12T17:48:58.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.476+0000 7f08c93f5700 1 -- 172.21.15.38:0/348067035 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c40653c0 con 0x7f08c409db70 2020-06-12T17:48:58.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.476+0000 7f08bbfff700 1 -- 172.21.15.38:0/348067035 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08ac005d70 con 0x7f08c409db70 2020-06-12T17:48:58.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.476+0000 7f08c93f5700 1 -- 172.21.15.38:0/348067035 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c4064650 con 0x7f08c409db70 2020-06-12T17:48:58.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.477+0000 7f08c27fc700 1 --2- 172.21.15.38:0/348067035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08c409db70 0x7f08c4065fc0 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f08c409e590 tx=0x7f08ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.477+0000 7f08c93f5700 1 -- 172.21.15.38:0/348067035 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c40650b0 con 0x7f08c409db70 2020-06-12T17:48:58.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.477+0000 7f08bbfff700 1 -- 172.21.15.38:0/348067035 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f08ac015250 con 0x7f08c409db70 2020-06-12T17:48:58.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.477+0000 7f08c27fc700 1 --2- 172.21.15.38:0/348067035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08c409db70 0x7f08c4065fc0 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f08c409e590 tx=0x7f08ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.478+0000 7f08bbfff700 1 --2- 172.21.15.38:0/348067035 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f08a804d4b0 0x7f08a804f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:58.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.478+0000 7f08bbfff700 1 -- 172.21.15.38:0/348067035 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f08ac0611e0 con 0x7f08c409db70 2020-06-12T17:48:58.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.478+0000 7f08c2ffd700 1 --2- 172.21.15.38:0/348067035 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f08a804d4b0 0x7f08a804f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:58.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.478+0000 7f08c2ffd700 1 --2- 172.21.15.38:0/348067035 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f08a804d4b0 0x7f08a804f970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f08c4063680 tx=0x7f08bc002780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.478+0000 7f08c2ffd700 1 --2- 172.21.15.38:0/348067035 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f08a804d4b0 0x7f08a804f970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f08c4063680 tx=0x7f08bc002780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.478+0000 7f08c2ffd700 1 --2- 172.21.15.38:0/348067035 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f08a804d4b0 0x7f08a804f970 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f08c4063680 tx=0x7f08bc002780).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:58.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.481+0000 7f08c27fc700 1 --2- 172.21.15.38:0/348067035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08c409db70 0x7f08c4065fc0 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f08c409e590 tx=0x7f08ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.481+0000 7f08bbfff700 1 -- 172.21.15.38:0/348067035 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f08ac03c940 con 0x7f08c409db70 2020-06-12T17:48:58.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.685+0000 7f08c93f5700 1 -- 172.21.15.38:0/348067035 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f08c4056c30 con 0x7f08c409db70 2020-06-12T17:48:58.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.692+0000 7f08c27fc700 1 --2- 172.21.15.38:0/348067035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08c409db70 0x7f08c4065fc0 secure :-1 s=THROTTLE_DONE pgs=351 cs=0 l=1 rx=0x7f08c409e590 tx=0x7f08ac007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.692+0000 7f08bbfff700 1 -- 172.21.15.38:0/348067035 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f08ac03ff60 con 0x7f08c409db70 2020-06-12T17:48:58.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.693+0000 7f08c93f5700 1 -- 172.21.15.38:0/348067035 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f08a804d4b0 msgr2=0x7f08a804f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:58.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.693+0000 7f08c93f5700 1 --2- 172.21.15.38:0/348067035 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f08a804d4b0 0x7f08a804f970 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f08c4063680 tx=0x7f08bc002780).stop 2020-06-12T17:48:58.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.693+0000 7f08c93f5700 1 -- 172.21.15.38:0/348067035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08c409db70 msgr2=0x7f08c4065fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:58.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.693+0000 7f08c93f5700 1 --2- 172.21.15.38:0/348067035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08c409db70 0x7f08c4065fc0 secure :-1 s=READY pgs=351 cs=0 l=1 rx=0x7f08c409e590 tx=0x7f08ac007e60).stop 2020-06-12T17:48:58.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.694+0000 7f08c93f5700 1 -- 172.21.15.38:0/348067035 shutdown_connections 2020-06-12T17:48:58.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.694+0000 7f08c93f5700 1 --2- 172.21.15.38:0/348067035 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f08a804d4b0 0x7f08a804f970 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:58.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.694+0000 7f08c93f5700 1 --2- 172.21.15.38:0/348067035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08c409db70 0x7f08c4065fc0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:58.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.694+0000 7f08c93f5700 1 -- 172.21.15.38:0/348067035 >> 172.21.15.38:0/348067035 conn(0x7f08c40b8410 msgr2=0x7f08c4143ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:58.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.694+0000 7f08c93f5700 1 -- 172.21.15.38:0/348067035 shutdown_connections 2020-06-12T17:48:58.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.694+0000 7f08c93f5700 1 -- 172.21.15.38:0/348067035 wait complete. 2020-06-12T17:48:58.699 INFO:teuthology.orchestra.run.smithi038.stderr:updated 2020-06-12T17:48:58.707 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-rgw 2020-06-12T17:48:58.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.819+0000 7fc745a2f700 1 Processor -- start 2020-06-12T17:48:58.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.819+0000 7fc745a2f700 1 -- start start 2020-06-12T17:48:58.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.820+0000 7fc745a2f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc7401401f0 0x7fc74009cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:58.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.820+0000 7fc745a2f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc740146cf0 0x7fc740143020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:58.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.820+0000 7fc745a2f700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7400aecd0 con 0x7fc7400adaf0 2020-06-12T17:48:58.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.820+0000 7fc745a2f700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74009d420 con 0x7fc7401401f0 2020-06-12T17:48:58.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.820+0000 7fc745a2f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74009d6c0 con 0x7fc740146cf0 2020-06-12T17:48:58.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.820+0000 7fc73effd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc7401401f0 0x7fc74009cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:58.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.820+0000 7fc73e7fc700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc7400adaf0 0x7fc7400b3f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38820/0 (socket says 172.21.15.38:38820) 2020-06-12T17:48:58.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.820+0000 7fc73e7fc700 1 -- 172.21.15.38:0/2454118155 learned_addr learned my addr 172.21.15.38:0/2454118155 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:58.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.820+0000 7fc73f7fe700 1 --2- 172.21.15.38:0/2454118155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc740146cf0 0x7fc740143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:58.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.820+0000 7fc73effd700 1 -- 172.21.15.38:0/2454118155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc740146cf0 msgr2=0x7fc740143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:58.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.820+0000 7fc73effd700 1 --2- 172.21.15.38:0/2454118155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc740146cf0 0x7fc740143020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:58.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.820+0000 7fc73effd700 1 -- 172.21.15.38:0/2454118155 >> v1:172.21.15.38:6789/0 conn(0x7fc7400adaf0 legacy=0x7fc7400b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:58.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.820+0000 7fc73effd700 1 -- 172.21.15.38:0/2454118155 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7400adf80 con 0x7fc7401401f0 2020-06-12T17:48:58.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.820+0000 7fc73dffb700 1 -- 172.21.15.38:0/2454118155 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677458887 0 0) 0x7fc7400aecd0 con 0x7fc7400adaf0 2020-06-12T17:48:58.829 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.820+0000 7fc73effd700 1 --2- 172.21.15.38:0/2454118155 >> v2:172.21.15.38:3300/0 conn(0x7fc7401401f0 0x7fc74009cf10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc734002f30 tx=0x7fc734007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.829 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.820+0000 7fc73effd700 1 --2- 172.21.15.38:0/2454118155 >> v2:172.21.15.38:3300/0 conn(0x7fc7401401f0 0x7fc74009cf10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc734002f30 tx=0x7fc734007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.829 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.820+0000 7fc73effd700 1 --2- 172.21.15.38:0/2454118155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7401401f0 0x7fc74009cf10 secure :-1 s=READY pgs=353 cs=0 l=1 rx=0x7fc734002f30 tx=0x7fc734007e60).ready entity=mon.0 client_cookie=4acf89f653981671 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:58.829 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.821+0000 7fc73effd700 1 --2- 172.21.15.38:0/2454118155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7401401f0 0x7fc74009cf10 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7fc734002f30 tx=0x7fc734007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.829 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.821+0000 7fc73dffb700 1 -- 172.21.15.38:0/2454118155 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc734011380 con 0x7fc7401401f0 2020-06-12T17:48:58.830 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.821+0000 7fc73effd700 1 --2- 172.21.15.38:0/2454118155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7401401f0 0x7fc74009cf10 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7fc734002f30 tx=0x7fc734007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.830 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.821+0000 7fc73dffb700 1 -- 172.21.15.38:0/2454118155 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7340114e0 con 0x7fc7401401f0 2020-06-12T17:48:58.830 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.821+0000 7fc73effd700 1 --2- 172.21.15.38:0/2454118155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7401401f0 0x7fc74009cf10 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7fc734002f30 tx=0x7fc734007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.830 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.821+0000 7fc73dffb700 1 -- 172.21.15.38:0/2454118155 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7340118c0 con 0x7fc7401401f0 2020-06-12T17:48:58.830 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.821+0000 7fc745a2f700 1 -- 172.21.15.38:0/2454118155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7401401f0 msgr2=0x7fc74009cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:58.830 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.821+0000 7fc745a2f700 1 --2- 172.21.15.38:0/2454118155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7401401f0 0x7fc74009cf10 secure :-1 s=READY pgs=353 cs=0 l=1 rx=0x7fc734002f30 tx=0x7fc734007e60).stop 2020-06-12T17:48:58.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.821+0000 7fc745a2f700 1 -- 172.21.15.38:0/2454118155 shutdown_connections 2020-06-12T17:48:58.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.821+0000 7fc745a2f700 1 --2- 172.21.15.38:0/2454118155 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc740146cf0 0x7fc740143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:58.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.821+0000 7fc745a2f700 1 --2- 172.21.15.38:0/2454118155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc7401401f0 0x7fc74009cf10 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:58.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.821+0000 7fc745a2f700 1 -- 172.21.15.38:0/2454118155 >> 172.21.15.38:0/2454118155 conn(0x7fc7400b8410 msgr2=0x7fc7400b8820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:58.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.821+0000 7fc745a2f700 1 -- 172.21.15.38:0/2454118155 shutdown_connections 2020-06-12T17:48:58.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.821+0000 7fc745a2f700 1 -- 172.21.15.38:0/2454118155 wait complete. 2020-06-12T17:48:58.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.822+0000 7fc745a2f700 1 Processor -- start 2020-06-12T17:48:58.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.822+0000 7fc745a2f700 1 -- start start 2020-06-12T17:48:58.835 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.823+0000 7fc745a2f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc7400adaf0 0x7fc7401548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:58.836 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.823+0000 7fc745a2f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7401401f0 0x7fc7401512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:58.836 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.823+0000 7fc745a2f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc740146cf0 0x7fc74005aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:58.836 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.823+0000 7fc745a2f700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74013e1d0 con 0x7fc740146cf0 2020-06-12T17:48:58.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.823+0000 7fc745a2f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7400b1ae0 con 0x7fc7400adaf0 2020-06-12T17:48:58.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.823+0000 7fc745a2f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc740151740 con 0x7fc7401401f0 2020-06-12T17:48:58.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.823+0000 7fc73f7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc740146cf0 0x7fc74005aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:58.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.823+0000 7fc73f7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc740146cf0 0x7fc74005aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37014/0 (socket says 172.21.15.38:37014) 2020-06-12T17:48:58.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.823+0000 7fc73f7fe700 1 -- 172.21.15.38:0/1936594213 learned_addr learned my addr 172.21.15.38:0/1936594213 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:58.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.823+0000 7fc73effd700 1 --2- 172.21.15.38:0/1936594213 >> v2:172.21.15.150:3300/0 conn(0x7fc7400adaf0 0x7fc7401548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:58.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.823+0000 7fc73e7fc700 1 --2- 172.21.15.38:0/1936594213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7401401f0 0x7fc7401512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:58.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.823+0000 7fc73f7fe700 1 -- 172.21.15.38:0/1936594213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7401401f0 msgr2=0x7fc7401512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:58.840 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.823+0000 7fc73f7fe700 1 --2- 172.21.15.38:0/1936594213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7401401f0 0x7fc7401512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:58.840 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.823+0000 7fc73f7fe700 1 -- 172.21.15.38:0/1936594213 >> v2:172.21.15.150:3300/0 conn(0x7fc7400adaf0 msgr2=0x7fc7401548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:58.840 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.823+0000 7fc73f7fe700 1 --2- 172.21.15.38:0/1936594213 >> v2:172.21.15.150:3300/0 conn(0x7fc7400adaf0 0x7fc7401548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:58.840 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.823+0000 7fc73f7fe700 1 -- 172.21.15.38:0/1936594213 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74005b320 con 0x7fc740146cf0 2020-06-12T17:48:58.840 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.823+0000 7fc73e7fc700 1 --2- 172.21.15.38:0/1936594213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7401401f0 0x7fc7401512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:48:58.841 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.823+0000 7fc73f7fe700 1 --2- 172.21.15.38:0/1936594213 >> v2:172.21.15.38:3300/0 conn(0x7fc740146cf0 0x7fc74005aec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc738002f30 tx=0x7fc738007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.841 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.823+0000 7fc73f7fe700 1 --2- 172.21.15.38:0/1936594213 >> v2:172.21.15.38:3300/0 conn(0x7fc740146cf0 0x7fc74005aec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc738002f30 tx=0x7fc738007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.841 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.823+0000 7fc73f7fe700 1 --2- 172.21.15.38:0/1936594213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc740146cf0 0x7fc74005aec0 secure :-1 s=READY pgs=354 cs=0 l=1 rx=0x7fc738002f30 tx=0x7fc738007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:58.841 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.824+0000 7fc73f7fe700 1 --2- 172.21.15.38:0/1936594213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc740146cf0 0x7fc74005aec0 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7fc738002f30 tx=0x7fc738007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.841 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.824+0000 7fc72ffff700 1 -- 172.21.15.38:0/1936594213 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc738007530 con 0x7fc740146cf0 2020-06-12T17:48:58.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.824+0000 7fc73f7fe700 1 --2- 172.21.15.38:0/1936594213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc740146cf0 0x7fc74005aec0 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7fc738002f30 tx=0x7fc738007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.824+0000 7fc73f7fe700 1 --2- 172.21.15.38:0/1936594213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc740146cf0 0x7fc74005aec0 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7fc738002f30 tx=0x7fc738007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.824+0000 7fc72ffff700 1 -- 172.21.15.38:0/1936594213 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7380056c0 con 0x7fc740146cf0 2020-06-12T17:48:58.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.824+0000 7fc745a2f700 1 -- 172.21.15.38:0/1936594213 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc740151980 con 0x7fc740146cf0 2020-06-12T17:48:58.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.824+0000 7fc72ffff700 1 -- 172.21.15.38:0/1936594213 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc738005aa0 con 0x7fc740146cf0 2020-06-12T17:48:58.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.824+0000 7fc745a2f700 1 -- 172.21.15.38:0/1936594213 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc740155060 con 0x7fc740146cf0 2020-06-12T17:48:58.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.824+0000 7fc73f7fe700 1 --2- 172.21.15.38:0/1936594213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc740146cf0 0x7fc74005aec0 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7fc738002f30 tx=0x7fc738007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.825+0000 7fc745a2f700 1 -- 172.21.15.38:0/1936594213 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc740151d30 con 0x7fc740146cf0 2020-06-12T17:48:58.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.825+0000 7fc72ffff700 1 -- 172.21.15.38:0/1936594213 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fc738005c00 con 0x7fc740146cf0 2020-06-12T17:48:58.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.825+0000 7fc73f7fe700 1 --2- 172.21.15.38:0/1936594213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc740146cf0 0x7fc74005aec0 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7fc738002f30 tx=0x7fc738007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.825+0000 7fc72ffff700 1 --2- 172.21.15.38:0/1936594213 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc71c04d630 0x7fc71c04faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:58.844 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.825+0000 7fc72ffff700 1 -- 172.21.15.38:0/1936594213 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fc73800d0c0 con 0x7fc740146cf0 2020-06-12T17:48:58.844 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.825+0000 7fc73effd700 1 --2- 172.21.15.38:0/1936594213 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc71c04d630 0x7fc71c04faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:58.844 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.826+0000 7fc73effd700 1 --2- 172.21.15.38:0/1936594213 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc71c04d630 0x7fc71c04faf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc734002f30 tx=0x7fc734007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.844 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.826+0000 7fc73effd700 1 --2- 172.21.15.38:0/1936594213 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc71c04d630 0x7fc71c04faf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc734002f30 tx=0x7fc734007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.844 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.826+0000 7fc73effd700 1 --2- 172.21.15.38:0/1936594213 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc71c04d630 0x7fc71c04faf0 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7fc734002f30 tx=0x7fc734007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:58.845 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.828+0000 7fc73f7fe700 1 --2- 172.21.15.38:0/1936594213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc740146cf0 0x7fc74005aec0 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7fc738002f30 tx=0x7fc738007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:58.845 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:58.828+0000 7fc72ffff700 1 -- 172.21.15.38:0/1936594213 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fc73803c680 con 0x7fc740146cf0 2020-06-12T17:48:59.038 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.034+0000 7fc745a2f700 1 -- 172.21.15.38:0/1936594213 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fc74005b320 con 0x7fc740146cf0 2020-06-12T17:48:59.045 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.042+0000 7fc73f7fe700 1 --2- 172.21.15.38:0/1936594213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc740146cf0 0x7fc74005aec0 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7fc738002f30 tx=0x7fc738007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.045 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.042+0000 7fc72ffff700 1 -- 172.21.15.38:0/1936594213 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc74005b320 con 0x7fc740146cf0 2020-06-12T17:48:59.047 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.043+0000 7fc745a2f700 1 -- 172.21.15.38:0/1936594213 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc71c04d630 msgr2=0x7fc71c04faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:59.047 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.043+0000 7fc745a2f700 1 --2- 172.21.15.38:0/1936594213 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc71c04d630 0x7fc71c04faf0 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7fc734002f30 tx=0x7fc734007e60).stop 2020-06-12T17:48:59.047 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.043+0000 7fc745a2f700 1 -- 172.21.15.38:0/1936594213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc740146cf0 msgr2=0x7fc74005aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:59.048 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.043+0000 7fc745a2f700 1 --2- 172.21.15.38:0/1936594213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc740146cf0 0x7fc74005aec0 secure :-1 s=READY pgs=354 cs=0 l=1 rx=0x7fc738002f30 tx=0x7fc738007e60).stop 2020-06-12T17:48:59.048 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.043+0000 7fc745a2f700 1 -- 172.21.15.38:0/1936594213 shutdown_connections 2020-06-12T17:48:59.048 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.043+0000 7fc745a2f700 1 --2- 172.21.15.38:0/1936594213 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc71c04d630 0x7fc71c04faf0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:59.048 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.043+0000 7fc745a2f700 1 --2- 172.21.15.38:0/1936594213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc740146cf0 0x7fc74005aec0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:59.048 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.043+0000 7fc745a2f700 1 --2- 172.21.15.38:0/1936594213 >> v2:172.21.15.150:3300/0 conn(0x7fc7400adaf0 0x7fc7401548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:59.049 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.043+0000 7fc745a2f700 1 --2- 172.21.15.38:0/1936594213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7401401f0 0x7fc7401512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:59.049 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.043+0000 7fc745a2f700 1 -- 172.21.15.38:0/1936594213 >> 172.21.15.38:0/1936594213 conn(0x7fc7400b8410 msgr2=0x7fc74013f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:59.049 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.043+0000 7fc745a2f700 1 -- 172.21.15.38:0/1936594213 shutdown_connections 2020-06-12T17:48:59.049 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.043+0000 7fc745a2f700 1 -- 172.21.15.38:0/1936594213 wait complete. 2020-06-12T17:48:59.050 INFO:teuthology.orchestra.run.smithi038.stderr:updated 2020-06-12T17:48:59.057 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-12T17:48:59.183 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.169+0000 7fa668432700 1 Processor -- start 2020-06-12T17:48:59.184 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.169+0000 7fa668432700 1 -- start start 2020-06-12T17:48:59.184 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.170+0000 7fa668432700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6600623f0 0x7fa6600b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:59.185 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.170+0000 7fa668432700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa660145b00 0x7fa660145f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:59.185 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.170+0000 7fa668432700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66009b920 con 0x7fa66005b410 2020-06-12T17:48:59.185 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.170+0000 7fa668432700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa660067250 con 0x7fa660145b00 2020-06-12T17:48:59.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.170+0000 7fa668432700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66005bb20 con 0x7fa6600623f0 2020-06-12T17:48:59.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.170+0000 7fa6669cf700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa660145b00 0x7fa660145f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:59.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.170+0000 7fa6669cf700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa660145b00 0x7fa660145f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37018/0 (socket says 172.21.15.38:37018) 2020-06-12T17:48:59.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.170+0000 7fa6669cf700 1 -- 172.21.15.38:0/3927605842 learned_addr learned my addr 172.21.15.38:0/3927605842 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:48:59.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.170+0000 7fa6661ce700 1 --2- 172.21.15.38:0/3927605842 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6600623f0 0x7fa6600b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:59.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.170+0000 7fa6669cf700 1 -- 172.21.15.38:0/3927605842 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6600623f0 msgr2=0x7fa6600b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:59.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.170+0000 7fa6669cf700 1 --2- 172.21.15.38:0/3927605842 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6600623f0 0x7fa6600b49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:59.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.170+0000 7fa6669cf700 1 -- 172.21.15.38:0/3927605842 >> v1:172.21.15.150:6789/0 conn(0x7fa66005b410 legacy=0x7fa66013c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:59.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.170+0000 7fa6669cf700 1 -- 172.21.15.38:0/3927605842 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66005b890 con 0x7fa660145b00 2020-06-12T17:48:59.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.170+0000 7fa6661ce700 1 --2- 172.21.15.38:0/3927605842 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6600623f0 0x7fa6600b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:48:59.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.170+0000 7fa6669cf700 1 --2- 172.21.15.38:0/3927605842 >> v2:172.21.15.38:3300/0 conn(0x7fa660145b00 0x7fa660145f60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa6580032b0 tx=0x7fa6580081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.170+0000 7fa6669cf700 1 --2- 172.21.15.38:0/3927605842 >> v2:172.21.15.38:3300/0 conn(0x7fa660145b00 0x7fa660145f60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa6580032b0 tx=0x7fa6580081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.170+0000 7fa6669cf700 1 --2- 172.21.15.38:0/3927605842 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa660145b00 0x7fa660145f60 secure :-1 s=READY pgs=355 cs=0 l=1 rx=0x7fa6580032b0 tx=0x7fa6580081e0).ready entity=mon.0 client_cookie=54748fee0f59c206 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:59.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.171+0000 7fa6669cf700 1 --2- 172.21.15.38:0/3927605842 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa660145b00 0x7fa660145f60 secure :-1 s=THROTTLE_DONE pgs=355 cs=0 l=1 rx=0x7fa6580032b0 tx=0x7fa6580081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.171+0000 7fa6669cf700 1 --2- 172.21.15.38:0/3927605842 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa660145b00 0x7fa660145f60 secure :-1 s=THROTTLE_DONE pgs=355 cs=0 l=1 rx=0x7fa6580032b0 tx=0x7fa6580081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.171+0000 7fa6651cc700 1 -- 172.21.15.38:0/3927605842 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa65800a160 con 0x7fa660145b00 2020-06-12T17:48:59.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.171+0000 7fa6669cf700 1 --2- 172.21.15.38:0/3927605842 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa660145b00 0x7fa660145f60 secure :-1 s=THROTTLE_DONE pgs=355 cs=0 l=1 rx=0x7fa6580032b0 tx=0x7fa6580081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.192 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.171+0000 7fa6651cc700 1 -- 172.21.15.38:0/3927605842 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65800a2c0 con 0x7fa660145b00 2020-06-12T17:48:59.192 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.171+0000 7fa6651cc700 1 -- 172.21.15.38:0/3927605842 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa65800a6e0 con 0x7fa660145b00 2020-06-12T17:48:59.192 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.171+0000 7fa668432700 1 -- 172.21.15.38:0/3927605842 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa660145b00 msgr2=0x7fa660145f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:59.193 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.171+0000 7fa668432700 1 --2- 172.21.15.38:0/3927605842 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa660145b00 0x7fa660145f60 secure :-1 s=READY pgs=355 cs=0 l=1 rx=0x7fa6580032b0 tx=0x7fa6580081e0).stop 2020-06-12T17:48:59.193 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.171+0000 7fa668432700 1 -- 172.21.15.38:0/3927605842 shutdown_connections 2020-06-12T17:48:59.193 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.171+0000 7fa668432700 1 --2- 172.21.15.38:0/3927605842 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6600623f0 0x7fa6600b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:59.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.171+0000 7fa668432700 1 --2- 172.21.15.38:0/3927605842 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa660145b00 0x7fa660145f60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:59.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.171+0000 7fa668432700 1 -- 172.21.15.38:0/3927605842 >> 172.21.15.38:0/3927605842 conn(0x7fa6600b8420 msgr2=0x7fa6600b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:59.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.171+0000 7fa668432700 1 -- 172.21.15.38:0/3927605842 shutdown_connections 2020-06-12T17:48:59.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.171+0000 7fa668432700 1 -- 172.21.15.38:0/3927605842 wait complete. 2020-06-12T17:48:59.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.172+0000 7fa668432700 1 Processor -- start 2020-06-12T17:48:59.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.172+0000 7fa668432700 1 -- start start 2020-06-12T17:48:59.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.173+0000 7fa668432700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6600623f0 0x7fa660066680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:59.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.173+0000 7fa668432700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa660065b40 con 0x7fa66005b410 2020-06-12T17:48:59.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.173+0000 7fa668432700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa660065de0 con 0x7fa660145b00 2020-06-12T17:48:59.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.173+0000 7fa668432700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66013dc00 con 0x7fa6600623f0 2020-06-12T17:48:59.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.173+0000 7fa6661ce700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa66005b410 0x7fa6600650e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38840/0 (socket says 172.21.15.38:38840) 2020-06-12T17:48:59.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.173+0000 7fa6661ce700 1 -- 172.21.15.38:0/929192128 learned_addr learned my addr 172.21.15.38:0/929192128 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:59.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.173+0000 7fa6659cd700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6600623f0 0x7fa660066680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:59.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.173+0000 7fa64f7fe700 1 -- 172.21.15.38:0/929192128 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1151598353 0 0) 0x7fa660065b40 con 0x7fa66005b410 2020-06-12T17:48:59.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.173+0000 7fa64f7fe700 1 -- 172.21.15.38:0/929192128 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa640002fe0 con 0x7fa66005b410 2020-06-12T17:48:59.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.173+0000 7fa64f7fe700 1 -- 172.21.15.38:0/929192128 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2863080072 0 0) 0x7fa660065de0 con 0x7fa660145b00 2020-06-12T17:48:59.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.173+0000 7fa64f7fe700 1 -- 172.21.15.38:0/929192128 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa660065b40 con 0x7fa660145b00 2020-06-12T17:48:59.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.173+0000 7fa64f7fe700 1 -- 172.21.15.38:0/929192128 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3961496367 0 0) 0x7fa640002fe0 con 0x7fa66005b410 2020-06-12T17:48:59.203 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.173+0000 7fa64f7fe700 1 -- 172.21.15.38:0/929192128 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa660065de0 con 0x7fa66005b410 2020-06-12T17:48:59.203 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.173+0000 7fa64f7fe700 1 -- 172.21.15.38:0/929192128 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fa6500026d0 con 0x7fa66005b410 2020-06-12T17:48:59.203 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.173+0000 7fa64f7fe700 1 -- 172.21.15.38:0/929192128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6600623f0 msgr2=0x7fa660066680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:59.203 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.173+0000 7fa64f7fe700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6600623f0 0x7fa660066680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:59.204 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.173+0000 7fa64f7fe700 1 -- 172.21.15.38:0/929192128 >> v1:172.21.15.150:6789/0 conn(0x7fa660145b00 legacy=0x7fa660143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:59.204 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.173+0000 7fa64f7fe700 1 -- 172.21.15.38:0/929192128 >> v1:172.21.15.38:6789/0 conn(0x7fa66005b410 legacy=0x7fa6600650e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:59.204 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.173+0000 7fa64f7fe700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa640004b20 0x7fa640004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:59.204 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.173+0000 7fa64f7fe700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa640003ab0 0x7fa640003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:59.205 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.173+0000 7fa64f7fe700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa640004350 0x7fa64000b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:59.205 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.173+0000 7fa64f7fe700 1 -- 172.21.15.38:0/929192128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66013dc00 con 0x7fa640004b20 2020-06-12T17:48:59.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.173+0000 7fa64f7fe700 1 -- 172.21.15.38:0/929192128 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa640004800 con 0x7fa640003ab0 2020-06-12T17:48:59.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.173+0000 7fa64f7fe700 1 -- 172.21.15.38:0/929192128 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64000bbb0 con 0x7fa640004350 2020-06-12T17:48:59.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.174+0000 7fa6659cd700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6600623f0 0x7fa660066680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:48:59.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.174+0000 7fa6661ce700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa640004b20 0x7fa640004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:59.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.174+0000 7fa6669cf700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa640004350 0x7fa64000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:59.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.174+0000 7fa6659cd700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa640003ab0 0x7fa640003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:59.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.174+0000 7fa6661ce700 1 -- 172.21.15.38:0/929192128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa640004350 msgr2=0x7fa64000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:59.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.174+0000 7fa6661ce700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa640004350 0x7fa64000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:59.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.174+0000 7fa6661ce700 1 -- 172.21.15.38:0/929192128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa640003ab0 msgr2=0x7fa640003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:59.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.174+0000 7fa6661ce700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa640003ab0 0x7fa640003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:59.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.174+0000 7fa6661ce700 1 -- 172.21.15.38:0/929192128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6600657f0 con 0x7fa640004b20 2020-06-12T17:48:59.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.174+0000 7fa668432700 1 -- 172.21.15.38:0/929192128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66013d830 con 0x7fa640004b20 2020-06-12T17:48:59.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.174+0000 7fa6661ce700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa640004b20 0x7fa640004f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa6500024a0 tx=0x7fa650002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.174+0000 7fa668432700 1 -- 172.21.15.38:0/929192128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa660066840 con 0x7fa640004b20 2020-06-12T17:48:59.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.174+0000 7fa6661ce700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa640004b20 0x7fa640004f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa6500024a0 tx=0x7fa650002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.174+0000 7fa6661ce700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa640004b20 0x7fa640004f40 secure :-1 s=READY pgs=357 cs=0 l=1 rx=0x7fa6500024a0 tx=0x7fa650002e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:59.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.174+0000 7fa6661ce700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa640004b20 0x7fa640004f40 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7fa6500024a0 tx=0x7fa650002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.174+0000 7fa64f7fe700 1 -- 172.21.15.38:0/929192128 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa65000ca20 con 0x7fa640004b20 2020-06-12T17:48:59.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.174+0000 7fa6661ce700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa640004b20 0x7fa640004f40 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7fa6500024a0 tx=0x7fa650002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.174+0000 7fa64f7fe700 1 -- 172.21.15.38:0/929192128 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65000cbc0 con 0x7fa640004b20 2020-06-12T17:48:59.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.174+0000 7fa6661ce700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa640004b20 0x7fa640004f40 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7fa6500024a0 tx=0x7fa650002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.174+0000 7fa64f7fe700 1 -- 172.21.15.38:0/929192128 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6500056c0 con 0x7fa640004b20 2020-06-12T17:48:59.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.175+0000 7fa6661ce700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa640004b20 0x7fa640004f40 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7fa6500024a0 tx=0x7fa650002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.175+0000 7fa668432700 1 -- 172.21.15.38:0/929192128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa66013c580 con 0x7fa640004b20 2020-06-12T17:48:59.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.175+0000 7fa64f7fe700 1 -- 172.21.15.38:0/929192128 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fa650005820 con 0x7fa640004b20 2020-06-12T17:48:59.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.175+0000 7fa6661ce700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa640004b20 0x7fa640004f40 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7fa6500024a0 tx=0x7fa650002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.176+0000 7fa64f7fe700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa640055df0 0x7fa6400582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:59.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.176+0000 7fa64f7fe700 1 -- 172.21.15.38:0/929192128 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fa650061330 con 0x7fa640004b20 2020-06-12T17:48:59.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.176+0000 7fa6659cd700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa640055df0 0x7fa6400582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:59.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.176+0000 7fa6659cd700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa640055df0 0x7fa6400582b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa65c000b20 tx=0x7fa65c001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.176+0000 7fa6659cd700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa640055df0 0x7fa6400582b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa65c000b20 tx=0x7fa65c001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.176+0000 7fa6659cd700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa640055df0 0x7fa6400582b0 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7fa65c000b20 tx=0x7fa65c001760).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:59.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.179+0000 7fa6661ce700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa640004b20 0x7fa640004f40 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7fa6500024a0 tx=0x7fa650002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.179+0000 7fa64f7fe700 1 -- 172.21.15.38:0/929192128 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fa66013c580 con 0x7fa640004b20 2020-06-12T17:48:59.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.330+0000 7fa668432700 1 -- 172.21.15.38:0/929192128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa66013c580 con 0x7fa640004b20 2020-06-12T17:48:59.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.331+0000 7fa6661ce700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa640004b20 0x7fa640004f40 secure :-1 s=THROTTLE_DONE pgs=357 cs=0 l=1 rx=0x7fa6500024a0 tx=0x7fa650002e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.331+0000 7fa64f7fe700 1 -- 172.21.15.38:0/929192128 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+13462 (secure 0 0 0) 0x7fa66013c580 con 0x7fa640004b20 2020-06-12T17:48:59.335 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:48:59.336 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":29,"fsid":"8e42a2e7-b187-42c4-a73f-8f812ee62352","created":"2020-06-12T17:47:54.434340+0000","modified":"2020-06-12T17:48:56.538783+0000","last_up_change":"2020-06-12T17:48:03.388718+0000","last_in_change":"2020-06-12T17:48:03.388718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-06-12T17:47:57.558119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-06-12T17:48:07.419264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"44ac3dea-67b4-4b9a-bc18-ac511710afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":31038},{"type":"v1","addr":"172.21.15.38:6816","nonce":31038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":31038},{"type":"v1","addr":"172.21.15.38:6819","nonce":31038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":31038},{"type":"v1","addr":"172.21.15.38:6823","nonce":31038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":31038},{"type":"v1","addr":"172.21.15.38:6821","nonce":31038}]},"public_addr":"172.21.15.38:6816/31038","cluster_addr":"172.21.15.38:6819/31038","heartbeat_back_addr":"172.21.15.38:6823/31038","heartbeat_front_addr":"172.21.15.38:6821/31038","state":["exists","up"]},{"osd":1,"uuid":"561f7ced-3fff-4364-8619-6e4ecbc9d256","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":31036},{"type":"v1","addr":"172.21.15.38:6801","nonce":31036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":31036},{"type":"v1","addr":"172.21.15.38:6803","nonce":31036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":31036},{"type":"v1","addr":"172.21.15.38:6807","nonce":31036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":31036},{"type":"v1","addr":"172.21.15.38:6805","nonce":31036}]},"public_addr":"172.21.15.38:6801/31036","cluster_addr":"172.21.15.38:6803/31036","heartbeat_back_addr":"172.21.15.38:6807/31036","heartbeat_front_addr":"172.21.15.38:6805/31036","state":["exists","up"]},{"osd":2,"uuid":"0bb3c806-07af-49f5-b492-d0e33f2de37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":31053},{"type":"v1","addr":"172.21.15.38:6825","nonce":31053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":31053},{"type":"v1","addr":"172.21.15.38:6827","nonce":31053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":31053},{"type":"v1","addr":"172.21.15.38:6831","nonce":31053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":31053},{"type":"v1","addr":"172.21.15.38:6829","nonce":31053}]},"public_addr":"172.21.15.38:6825/31053","cluster_addr":"172.21.15.38:6827/31053","heartbeat_back_addr":"172.21.15.38:6831/31053","heartbeat_front_addr":"172.21.15.38:6829/31053","state":["exists","up"]},{"osd":3,"uuid":"7f6a1e75-7b11-456e-8a4b-510b16226800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":31037},{"type":"v1","addr":"172.21.15.38:6809","nonce":31037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":31037},{"type":"v1","addr":"172.21.15.38:6811","nonce":31037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6815","nonce":31037},{"type":"v1","addr":"172.21.15.38:6817","nonce":31037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":31037},{"type":"v1","addr":"172.21.15.38:6813","nonce":31037}]},"public_addr":"172.21.15.38:6809/31037","cluster_addr":"172.21.15.38:6811/31037","heartbeat_back_addr":"172.21.15.38:6817/31037","heartbeat_front_addr":"172.21.15.38:6813/31037","state":["exists","up"]},{"osd":4,"uuid":"0eca0272-8cfd-469c-a32d-e29730dc0e1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":31294},{"type":"v1","addr":"172.21.15.150:6803","nonce":31294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":31294},{"type":"v1","addr":"172.21.15.150:6805","nonce":31294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":31294},{"type":"v1","addr":"172.21.15.150:6809","nonce":31294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":31294},{"type":"v1","addr":"172.21.15.150:6807","nonce":31294}]},"public_addr":"172.21.15.150:6803/31294","cluster_addr":"172.21.15.150:6805/31294","heartbeat_back_addr":"172.21.15.150:6809/31294","heartbeat_front_addr":"172.21.15.150:6807/31294","state":["exists","up"]},{"osd":5,"uuid":"69d6a7dc-a55a-4ebc-8479-8bb921ddfb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":31295},{"type":"v1","addr":"172.21.15.150:6813","nonce":31295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":31295},{"type":"v1","addr":"172.21.15.150:6816","nonce":31295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":31295},{"type":"v1","addr":"172.21.15.150:6828","nonce":31295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6819","nonce":31295},{"type":"v1","addr":"172.21.15.150:6822","nonce":31295}]},"public_addr":"172.21.15.150:6813/31295","cluster_addr":"172.21.15.150:6816/31295","heartbeat_back_addr":"172.21.15.150:6828/31295","heartbeat_front_addr":"172.21.15.150:6822/31295","state":["exists","up"]},{"osd":6,"uuid":"f0d320f8-c2f0-40bb-b713-526246cf97b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":31297},{"type":"v1","addr":"172.21.15.150:6820","nonce":31297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6823","nonce":31297},{"type":"v1","addr":"172.21.15.150:6827","nonce":31297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":31297},{"type":"v1","addr":"172.21.15.150:6833","nonce":31297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":31297},{"type":"v1","addr":"172.21.15.150:6831","nonce":31297}]},"public_addr":"172.21.15.150:6820/31297","cluster_addr":"172.21.15.150:6827/31297","heartbeat_back_addr":"172.21.15.150:6833/31297","heartbeat_front_addr":"172.21.15.150:6831/31297","state":["exists","up"]},{"osd":7,"uuid":"970b7d02-a189-41b2-96e5-a5a5a57c6476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":31296},{"type":"v1","addr":"172.21.15.150:6812","nonce":31296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":31296},{"type":"v1","addr":"172.21.15.150:6818","nonce":31296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":31296},{"type":"v1","addr":"172.21.15.150:6829","nonce":31296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":31296},{"type":"v1","addr":"172.21.15.150:6824","nonce":31296}]},"public_addr":"172.21.15.150:6812/31296","cluster_addr":"172.21.15.150:6818/31296","heartbeat_back_addr":"172.21.15.150:6829/31296","heartbeat_front_addr":"172.21.15.150:6824/31296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.664300+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.644253+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.651120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.584978+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.561149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.661778+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T17:48:59.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.332+0000 7fa668432700 1 -- 172.21.15.38:0/929192128 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa640055df0 msgr2=0x7fa6400582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:59.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.332+0000 7fa668432700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa640055df0 0x7fa6400582b0 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7fa65c000b20 tx=0x7fa65c001760).stop 2020-06-12T17:48:59.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.332+0000 7fa668432700 1 -- 172.21.15.38:0/929192128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa640004b20 msgr2=0x7fa640004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:59.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.332+0000 7fa668432700 1 --2- 172.21.15.38:0/929192128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa640004b20 0x7fa640004f40 secure :-1 s=READY pgs=357 cs=0 l=1 rx=0x7fa6500024a0 tx=0x7fa650002e70).stop 2020-06-12T17:48:59.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.332+0000 7fa6669cf700 1 -- 172.21.15.38:0/929192128 reap_dead start 2020-06-12T17:48:59.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.332+0000 7fa668432700 1 -- 172.21.15.38:0/929192128 shutdown_connections 2020-06-12T17:48:59.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.332+0000 7fa668432700 1 -- 172.21.15.38:0/929192128 >> 172.21.15.38:0/929192128 conn(0x7fa6600b8420 msgr2=0x7fa66009dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:59.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.332+0000 7fa668432700 1 -- 172.21.15.38:0/929192128 shutdown_connections 2020-06-12T17:48:59.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.332+0000 7fa668432700 1 -- 172.21.15.38:0/929192128 wait complete. 2020-06-12T17:48:59.346 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-06-12T17:47:57.558119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-06-12T17:48:07.419264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-06-12T17:48:59.348 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-06-12T17:48:59.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.462+0000 7f3b169c2700 1 Processor -- start 2020-06-12T17:48:59.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.462+0000 7f3b169c2700 1 -- start start 2020-06-12T17:48:59.474 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.463+0000 7f3b169c2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3b100ad5b0 0x7f3b100b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:59.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.463+0000 7f3b169c2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3b1009d8d0 0x7f3b101421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:59.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.463+0000 7f3b169c2700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b10146d20 con 0x7f3b10146680 2020-06-12T17:48:59.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.463+0000 7f3b169c2700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b10066a80 con 0x7f3b100ad5b0 2020-06-12T17:48:59.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.463+0000 7f3b169c2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b10146f50 con 0x7f3b1009d8d0 2020-06-12T17:48:59.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.463+0000 7f3b07fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3b100ad5b0 0x7f3b100b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:59.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.463+0000 7f3b0ffff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f3b10146680 0x7f3b1009d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38854/0 (socket says 172.21.15.38:38854) 2020-06-12T17:48:59.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.463+0000 7f3b0ffff700 1 -- 172.21.15.38:0/2471207712 learned_addr learned my addr 172.21.15.38:0/2471207712 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:59.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.463+0000 7f3b14f5f700 1 --2- 172.21.15.38:0/2471207712 >> v2:172.21.15.150:3300/0 conn(0x7f3b1009d8d0 0x7f3b101421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:59.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.463+0000 7f3b07fff700 1 -- 172.21.15.38:0/2471207712 >> v2:172.21.15.150:3300/0 conn(0x7f3b1009d8d0 msgr2=0x7f3b101421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:59.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.463+0000 7f3b07fff700 1 --2- 172.21.15.38:0/2471207712 >> v2:172.21.15.150:3300/0 conn(0x7f3b1009d8d0 0x7f3b101421d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:59.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.463+0000 7f3b07fff700 1 -- 172.21.15.38:0/2471207712 >> v1:172.21.15.38:6789/0 conn(0x7f3b10146680 legacy=0x7f3b1009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:59.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.463+0000 7f3b0f7fe700 1 -- 172.21.15.38:0/2471207712 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496326998 0 0) 0x7f3b10146d20 con 0x7f3b10146680 2020-06-12T17:48:59.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.463+0000 7f3b07fff700 1 -- 172.21.15.38:0/2471207712 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b10146a60 con 0x7f3b100ad5b0 2020-06-12T17:48:59.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.463+0000 7f3b07fff700 1 --2- 172.21.15.38:0/2471207712 >> v2:172.21.15.38:3300/0 conn(0x7f3b100ad5b0 0x7f3b100b2eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3af8002f30 tx=0x7f3af8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.478 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.463+0000 7f3b07fff700 1 --2- 172.21.15.38:0/2471207712 >> v2:172.21.15.38:3300/0 conn(0x7f3b100ad5b0 0x7f3b100b2eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3af8002f30 tx=0x7f3af8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.478 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.463+0000 7f3b07fff700 1 --2- 172.21.15.38:0/2471207712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b100ad5b0 0x7f3b100b2eb0 secure :-1 s=READY pgs=359 cs=0 l=1 rx=0x7f3af8002f30 tx=0x7f3af8007e60).ready entity=mon.0 client_cookie=290a1eba0aa6bd29 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:59.478 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.464+0000 7f3b07fff700 1 --2- 172.21.15.38:0/2471207712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b100ad5b0 0x7f3b100b2eb0 secure :-1 s=THROTTLE_DONE pgs=359 cs=0 l=1 rx=0x7f3af8002f30 tx=0x7f3af8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.478 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.464+0000 7f3b0f7fe700 1 -- 172.21.15.38:0/2471207712 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3af8011430 con 0x7f3b100ad5b0 2020-06-12T17:48:59.478 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.464+0000 7f3b07fff700 1 --2- 172.21.15.38:0/2471207712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b100ad5b0 0x7f3b100b2eb0 secure :-1 s=THROTTLE_DONE pgs=359 cs=0 l=1 rx=0x7f3af8002f30 tx=0x7f3af8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.479 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.464+0000 7f3b0f7fe700 1 -- 172.21.15.38:0/2471207712 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af8011590 con 0x7f3b100ad5b0 2020-06-12T17:48:59.479 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.464+0000 7f3b07fff700 1 --2- 172.21.15.38:0/2471207712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b100ad5b0 0x7f3b100b2eb0 secure :-1 s=THROTTLE_DONE pgs=359 cs=0 l=1 rx=0x7f3af8002f30 tx=0x7f3af8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.479 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.464+0000 7f3b169c2700 1 -- 172.21.15.38:0/2471207712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b100ad5b0 msgr2=0x7f3b100b2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:59.479 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.464+0000 7f3b0f7fe700 1 -- 172.21.15.38:0/2471207712 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3af8011930 con 0x7f3b100ad5b0 2020-06-12T17:48:59.479 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.464+0000 7f3b169c2700 1 --2- 172.21.15.38:0/2471207712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b100ad5b0 0x7f3b100b2eb0 secure :-1 s=READY pgs=359 cs=0 l=1 rx=0x7f3af8002f30 tx=0x7f3af8007e60).stop 2020-06-12T17:48:59.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.464+0000 7f3b169c2700 1 -- 172.21.15.38:0/2471207712 shutdown_connections 2020-06-12T17:48:59.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.464+0000 7f3b169c2700 1 --2- 172.21.15.38:0/2471207712 >> v2:172.21.15.150:3300/0 conn(0x7f3b1009d8d0 0x7f3b101421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:59.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.464+0000 7f3b169c2700 1 --2- 172.21.15.38:0/2471207712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b100ad5b0 0x7f3b100b2eb0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:59.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.464+0000 7f3b169c2700 1 -- 172.21.15.38:0/2471207712 >> 172.21.15.38:0/2471207712 conn(0x7f3b100b5a20 msgr2=0x7f3b1005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:59.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.464+0000 7f3b169c2700 1 -- 172.21.15.38:0/2471207712 shutdown_connections 2020-06-12T17:48:59.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.464+0000 7f3b169c2700 1 -- 172.21.15.38:0/2471207712 wait complete. 2020-06-12T17:48:59.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.465+0000 7f3b169c2700 1 Processor -- start 2020-06-12T17:48:59.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.465+0000 7f3b169c2700 1 -- start start 2020-06-12T17:48:59.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.466+0000 7f3b169c2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3b1009d8d0 0x7f3b100b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:59.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.466+0000 7f3b169c2700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b100b0ce0 con 0x7f3b10146680 2020-06-12T17:48:59.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.466+0000 7f3b169c2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b100b1860 con 0x7f3b100ad5b0 2020-06-12T17:48:59.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.466+0000 7f3b169c2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b10153700 con 0x7f3b1009d8d0 2020-06-12T17:48:59.483 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.466+0000 7f3b14f5f700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f3b10146680 0x7f3b10153e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38862/0 (socket says 172.21.15.38:38862) 2020-06-12T17:48:59.483 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.466+0000 7f3b14f5f700 1 -- 172.21.15.38:0/268333102 learned_addr learned my addr 172.21.15.38:0/268333102 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:59.483 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.466+0000 7f3b0ffff700 1 --2- 172.21.15.38:0/268333102 >> v2:172.21.15.150:3300/0 conn(0x7f3b1009d8d0 0x7f3b100b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:59.483 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.466+0000 7f3b0dffb700 1 -- 172.21.15.38:0/268333102 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 92782794 0 0) 0x7f3b08001260 con 0x7f3b10146680 2020-06-12T17:48:59.484 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.466+0000 7f3b0dffb700 1 -- 172.21.15.38:0/268333102 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3af4002fe0 con 0x7f3b10146680 2020-06-12T17:48:59.484 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.466+0000 7f3b0dffb700 1 -- 172.21.15.38:0/268333102 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2162289622 0 0) 0x7f3af4002fe0 con 0x7f3b10146680 2020-06-12T17:48:59.484 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.466+0000 7f3b0dffb700 1 -- 172.21.15.38:0/268333102 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3b08001260 con 0x7f3b10146680 2020-06-12T17:48:59.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.466+0000 7f3b0dffb700 1 -- 172.21.15.38:0/268333102 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f3b08001a70 con 0x7f3b10146680 2020-06-12T17:48:59.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.466+0000 7f3b0ffff700 1 -- 172.21.15.38:0/268333102 >> v1:172.21.15.150:6789/0 conn(0x7f3b100ad5b0 legacy=0x7f3b101429b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:59.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.466+0000 7f3b0ffff700 1 -- 172.21.15.38:0/268333102 >> v1:172.21.15.38:6789/0 conn(0x7f3b10146680 legacy=0x7f3b10153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:59.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.466+0000 7f3b0ffff700 1 -- 172.21.15.38:0/268333102 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b101539a0 con 0x7f3b1009d8d0 2020-06-12T17:48:59.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.466+0000 7f3b0ffff700 1 --2- 172.21.15.38:0/268333102 >> v2:172.21.15.150:3300/0 conn(0x7f3b1009d8d0 0x7f3b100b0ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3af8007ed0 tx=0x7f3b00001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.467+0000 7f3b0ffff700 1 --2- 172.21.15.38:0/268333102 >> v2:172.21.15.150:3300/0 conn(0x7f3b1009d8d0 0x7f3b100b0ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3af8007ed0 tx=0x7f3b00001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.467+0000 7f3b0ffff700 1 --2- 172.21.15.38:0/268333102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b1009d8d0 0x7f3b100b0ea0 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7f3af8007ed0 tx=0x7f3b00001680).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:59.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.467+0000 7f3b0ffff700 1 --2- 172.21.15.38:0/268333102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b1009d8d0 0x7f3b100b0ea0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f3af8007ed0 tx=0x7f3b00001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.467+0000 7f3b0dffb700 1 -- 172.21.15.38:0/268333102 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b00005b80 con 0x7f3b1009d8d0 2020-06-12T17:48:59.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.467+0000 7f3b0ffff700 1 --2- 172.21.15.38:0/268333102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b1009d8d0 0x7f3b100b0ea0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f3af8007ed0 tx=0x7f3b00001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.467+0000 7f3b0dffb700 1 -- 172.21.15.38:0/268333102 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b00005ce0 con 0x7f3b1009d8d0 2020-06-12T17:48:59.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.467+0000 7f3b0ffff700 1 --2- 172.21.15.38:0/268333102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b1009d8d0 0x7f3b100b0ea0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f3af8007ed0 tx=0x7f3b00001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.467+0000 7f3b169c2700 1 -- 172.21.15.38:0/268333102 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b10150a10 con 0x7f3b1009d8d0 2020-06-12T17:48:59.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.467+0000 7f3b0dffb700 1 -- 172.21.15.38:0/268333102 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b00005e50 con 0x7f3b1009d8d0 2020-06-12T17:48:59.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.467+0000 7f3b169c2700 1 -- 172.21.15.38:0/268333102 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b1013df60 con 0x7f3b1009d8d0 2020-06-12T17:48:59.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.467+0000 7f3b0ffff700 1 --2- 172.21.15.38:0/268333102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b1009d8d0 0x7f3b100b0ea0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f3af8007ed0 tx=0x7f3b00001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.468+0000 7f3b169c2700 1 -- 172.21.15.38:0/268333102 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b10067b20 con 0x7f3b1009d8d0 2020-06-12T17:48:59.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.468+0000 7f3b0ffff700 1 --2- 172.21.15.38:0/268333102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b1009d8d0 0x7f3b100b0ea0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f3af8007ed0 tx=0x7f3b00001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.468+0000 7f3b0dffb700 1 -- 172.21.15.38:0/268333102 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f3b0000a320 con 0x7f3b1009d8d0 2020-06-12T17:48:59.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.468+0000 7f3b0dffb700 1 --2- 172.21.15.38:0/268333102 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3af404db20 0x7f3af404ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:59.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.468+0000 7f3b0dffb700 1 -- 172.21.15.38:0/268333102 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f3b00060c90 con 0x7f3b1009d8d0 2020-06-12T17:48:59.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.469+0000 7f3b07fff700 1 --2- 172.21.15.38:0/268333102 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3af404db20 0x7f3af404ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:59.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.469+0000 7f3b07fff700 1 --2- 172.21.15.38:0/268333102 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3af404db20 0x7f3af404ffe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3af8010200 tx=0x7f3af8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.469+0000 7f3b07fff700 1 --2- 172.21.15.38:0/268333102 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3af404db20 0x7f3af404ffe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3af8010200 tx=0x7f3af8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.469+0000 7f3b07fff700 1 --2- 172.21.15.38:0/268333102 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3af404db20 0x7f3af404ffe0 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7f3af8010200 tx=0x7f3af8007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:59.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.472+0000 7f3b0ffff700 1 --2- 172.21.15.38:0/268333102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b1009d8d0 0x7f3b100b0ea0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f3af8007ed0 tx=0x7f3b00001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.472+0000 7f3b0dffb700 1 -- 172.21.15.38:0/268333102 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f3b0003c2d0 con 0x7f3b1009d8d0 2020-06-12T17:48:59.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.625+0000 7f3b169c2700 1 -- 172.21.15.38:0/268333102 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3b10056c30 con 0x7f3b1009d8d0 2020-06-12T17:48:59.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.627+0000 7f3b0ffff700 1 --2- 172.21.15.38:0/268333102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b1009d8d0 0x7f3b100b0ea0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f3af8007ed0 tx=0x7f3b00001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.627+0000 7f3b0dffb700 1 -- 172.21.15.38:0/268333102 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v30) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3b0003f8f0 con 0x7f3b1009d8d0 2020-06-12T17:48:59.631 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2020-06-12T17:48:59.632 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.627+0000 7f3b169c2700 1 -- 172.21.15.38:0/268333102 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3af404db20 msgr2=0x7f3af404ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:59.632 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.627+0000 7f3b169c2700 1 --2- 172.21.15.38:0/268333102 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3af404db20 0x7f3af404ffe0 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7f3af8010200 tx=0x7f3af8007e60).stop 2020-06-12T17:48:59.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.627+0000 7f3b169c2700 1 -- 172.21.15.38:0/268333102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b1009d8d0 msgr2=0x7f3b100b0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:59.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.627+0000 7f3b169c2700 1 --2- 172.21.15.38:0/268333102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b1009d8d0 0x7f3b100b0ea0 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7f3af8007ed0 tx=0x7f3b00001680).stop 2020-06-12T17:48:59.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.628+0000 7f3b169c2700 1 -- 172.21.15.38:0/268333102 shutdown_connections 2020-06-12T17:48:59.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.628+0000 7f3b169c2700 1 --2- 172.21.15.38:0/268333102 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3af404db20 0x7f3af404ffe0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:59.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.628+0000 7f3b169c2700 1 --2- 172.21.15.38:0/268333102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b1009d8d0 0x7f3b100b0ea0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:59.634 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.628+0000 7f3b169c2700 1 -- 172.21.15.38:0/268333102 >> 172.21.15.38:0/268333102 conn(0x7f3b100b5a20 msgr2=0x7f3b10144e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:59.634 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.628+0000 7f3b169c2700 1 -- 172.21.15.38:0/268333102 shutdown_connections 2020-06-12T17:48:59.634 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.628+0000 7f3b169c2700 1 -- 172.21.15.38:0/268333102 wait complete. 2020-06-12T17:48:59.642 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-06-12T17:48:59.760 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.756+0000 7f222c888700 1 Processor -- start 2020-06-12T17:48:59.761 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.756+0000 7f222c888700 1 -- start start 2020-06-12T17:48:59.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.756+0000 7f222c888700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f22280b3ac0 0x7f222809df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:59.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.757+0000 7f222c888700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f222813c650 0x7f2228066790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:48:59.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.757+0000 7f222c888700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222809b960 con 0x7f2228142e90 2020-06-12T17:48:59.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.757+0000 7f222c888700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f222809bc00 con 0x7f22280b3ac0 2020-06-12T17:48:59.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.757+0000 7f222c888700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22280b48f0 con 0x7f222813c650 2020-06-12T17:48:59.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.757+0000 7f222659c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f22280b3ac0 0x7f222809df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:59.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.757+0000 7f221ffff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f2228142e90 0x7f222813bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38868/0 (socket says 172.21.15.38:38868) 2020-06-12T17:48:59.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.757+0000 7f222659c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f22280b3ac0 0x7f222809df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37052/0 (socket says 172.21.15.38:37052) 2020-06-12T17:48:59.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.757+0000 7f221ffff700 1 -- 172.21.15.38:0/3605793608 learned_addr learned my addr 172.21.15.38:0/3605793608 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:59.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.757+0000 7f2226d9d700 1 --2- 172.21.15.38:0/3605793608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f222813c650 0x7f2228066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:59.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.757+0000 7f222659c700 1 -- 172.21.15.38:0/3605793608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f222813c650 msgr2=0x7f2228066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:48:59.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.757+0000 7f222659c700 1 --2- 172.21.15.38:0/3605793608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f222813c650 0x7f2228066790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:59.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.757+0000 7f222659c700 1 -- 172.21.15.38:0/3605793608 >> v1:172.21.15.38:6789/0 conn(0x7f2228142e90 legacy=0x7f222813bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:59.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.757+0000 7f2225d9b700 1 -- 172.21.15.38:0/3605793608 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 63894233 0 0) 0x7f222809b960 con 0x7f2228142e90 2020-06-12T17:48:59.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.757+0000 7f222659c700 1 -- 172.21.15.38:0/3605793608 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22280b3ea0 con 0x7f22280b3ac0 2020-06-12T17:48:59.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.757+0000 7f222659c700 1 --2- 172.21.15.38:0/3605793608 >> v2:172.21.15.38:3300/0 conn(0x7f22280b3ac0 0x7f222809df00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2218002f30 tx=0x7f2218007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.757+0000 7f222659c700 1 --2- 172.21.15.38:0/3605793608 >> v2:172.21.15.38:3300/0 conn(0x7f22280b3ac0 0x7f222809df00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2218002f30 tx=0x7f2218007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.757+0000 7f222659c700 1 --2- 172.21.15.38:0/3605793608 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22280b3ac0 0x7f222809df00 secure :-1 s=READY pgs=362 cs=0 l=1 rx=0x7f2218002f30 tx=0x7f2218007e60).ready entity=mon.0 client_cookie=96f98684d3f957da server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:59.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.757+0000 7f222659c700 1 --2- 172.21.15.38:0/3605793608 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22280b3ac0 0x7f222809df00 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7f2218002f30 tx=0x7f2218007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.757+0000 7f2225d9b700 1 -- 172.21.15.38:0/3605793608 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f221800ae80 con 0x7f22280b3ac0 2020-06-12T17:48:59.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.757+0000 7f222659c700 1 --2- 172.21.15.38:0/3605793608 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22280b3ac0 0x7f222809df00 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7f2218002f30 tx=0x7f2218007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.757+0000 7f222659c700 1 --2- 172.21.15.38:0/3605793608 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22280b3ac0 0x7f222809df00 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7f2218002f30 tx=0x7f2218007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.757+0000 7f2225d9b700 1 -- 172.21.15.38:0/3605793608 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2218013970 con 0x7f22280b3ac0 2020-06-12T17:48:59.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.757+0000 7f2225d9b700 1 -- 172.21.15.38:0/3605793608 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2218013d10 con 0x7f22280b3ac0 2020-06-12T17:48:59.780 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.757+0000 7f222c888700 1 -- 172.21.15.38:0/3605793608 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22280b3ac0 msgr2=0x7f222809df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:59.780 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.757+0000 7f222c888700 1 --2- 172.21.15.38:0/3605793608 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22280b3ac0 0x7f222809df00 secure :-1 s=READY pgs=362 cs=0 l=1 rx=0x7f2218002f30 tx=0x7f2218007e60).stop 2020-06-12T17:48:59.780 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.758+0000 7f222c888700 1 -- 172.21.15.38:0/3605793608 shutdown_connections 2020-06-12T17:48:59.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.758+0000 7f222c888700 1 --2- 172.21.15.38:0/3605793608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f222813c650 0x7f2228066790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:48:59.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.758+0000 7f222c888700 1 --2- 172.21.15.38:0/3605793608 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22280b3ac0 0x7f222809df00 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:59.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.758+0000 7f222c888700 1 -- 172.21.15.38:0/3605793608 >> 172.21.15.38:0/3605793608 conn(0x7f22280b5a20 msgr2=0x7f222805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:59.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.758+0000 7f222c888700 1 -- 172.21.15.38:0/3605793608 shutdown_connections 2020-06-12T17:48:59.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.758+0000 7f222c888700 1 -- 172.21.15.38:0/3605793608 wait complete. 2020-06-12T17:48:59.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.759+0000 7f222c888700 1 Processor -- start 2020-06-12T17:48:59.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.759+0000 7f222c888700 1 -- start start 2020-06-12T17:48:59.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.760+0000 7f222c888700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f222813c650 0x7f2228066770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:59.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.760+0000 7f222c888700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2228142e90 0x7f22280b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:59.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.760+0000 7f222c888700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222813d460 con 0x7f22280b3ac0 2020-06-12T17:48:59.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.760+0000 7f222c888700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2228066f00 con 0x7f222813c650 2020-06-12T17:48:59.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.760+0000 7f222c888700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22280671a0 con 0x7f2228142e90 2020-06-12T17:48:59.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.760+0000 7f222659c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f22280b3ac0 0x7f222813b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38872/0 (socket says 172.21.15.38:38872) 2020-06-12T17:48:59.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.760+0000 7f222659c700 1 -- 172.21.15.38:0/3071805055 learned_addr learned my addr 172.21.15.38:0/3071805055 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:48:59.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.760+0000 7f221ffff700 1 --2- 172.21.15.38:0/3071805055 >> v2:172.21.15.38:3300/0 conn(0x7f222813c650 0x7f2228066770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:59.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.760+0000 7f2226d9d700 1 --2- 172.21.15.38:0/3071805055 >> v2:172.21.15.150:3300/0 conn(0x7f2228142e90 0x7f22280b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:59.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.760+0000 7f221ffff700 1 -- 172.21.15.38:0/3071805055 >> v2:172.21.15.150:3300/0 conn(0x7f2228142e90 msgr2=0x7f22280b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:59.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.760+0000 7f221ffff700 1 --2- 172.21.15.38:0/3071805055 >> v2:172.21.15.150:3300/0 conn(0x7f2228142e90 0x7f22280b2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:59.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.760+0000 7f221ffff700 1 -- 172.21.15.38:0/3071805055 >> v1:172.21.15.38:6789/0 conn(0x7f22280b3ac0 legacy=0x7f222813b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:59.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.760+0000 7f221ffff700 1 -- 172.21.15.38:0/3071805055 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2228066c40 con 0x7f222813c650 2020-06-12T17:48:59.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.760+0000 7f221f7fe700 1 -- 172.21.15.38:0/3071805055 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588242656 0 0) 0x7f222813d460 con 0x7f22280b3ac0 2020-06-12T17:48:59.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.760+0000 7f221ffff700 1 --2- 172.21.15.38:0/3071805055 >> v2:172.21.15.38:3300/0 conn(0x7f222813c650 0x7f2228066770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2210000b80 tx=0x7f22100016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.760+0000 7f221ffff700 1 --2- 172.21.15.38:0/3071805055 >> v2:172.21.15.38:3300/0 conn(0x7f222813c650 0x7f2228066770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2210000b80 tx=0x7f22100016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.760+0000 7f221ffff700 1 --2- 172.21.15.38:0/3071805055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f222813c650 0x7f2228066770 secure :-1 s=READY pgs=364 cs=0 l=1 rx=0x7f2210000b80 tx=0x7f22100016e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:59.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.760+0000 7f221ffff700 1 --2- 172.21.15.38:0/3071805055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f222813c650 0x7f2228066770 secure :-1 s=THROTTLE_DONE pgs=364 cs=0 l=1 rx=0x7f2210000b80 tx=0x7f22100016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.760+0000 7f221ffff700 1 --2- 172.21.15.38:0/3071805055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f222813c650 0x7f2228066770 secure :-1 s=THROTTLE_DONE pgs=364 cs=0 l=1 rx=0x7f2210000b80 tx=0x7f22100016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.760+0000 7f221f7fe700 1 -- 172.21.15.38:0/3071805055 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2210005ca0 con 0x7f222813c650 2020-06-12T17:48:59.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.760+0000 7f221ffff700 1 --2- 172.21.15.38:0/3071805055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f222813c650 0x7f2228066770 secure :-1 s=THROTTLE_DONE pgs=364 cs=0 l=1 rx=0x7f2210000b80 tx=0x7f22100016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.760+0000 7f221f7fe700 1 -- 172.21.15.38:0/3071805055 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2210005e00 con 0x7f222813c650 2020-06-12T17:48:59.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.760+0000 7f222c888700 1 -- 172.21.15.38:0/3071805055 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f222813bd30 con 0x7f222813c650 2020-06-12T17:48:59.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.760+0000 7f221f7fe700 1 -- 172.21.15.38:0/3071805055 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22100062b0 con 0x7f222813c650 2020-06-12T17:48:59.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.760+0000 7f222c888700 1 -- 172.21.15.38:0/3071805055 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2228146720 con 0x7f222813c650 2020-06-12T17:48:59.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.761+0000 7f221ffff700 1 --2- 172.21.15.38:0/3071805055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f222813c650 0x7f2228066770 secure :-1 s=THROTTLE_DONE pgs=364 cs=0 l=1 rx=0x7f2210000b80 tx=0x7f22100016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.762+0000 7f222c888700 1 -- 172.21.15.38:0/3071805055 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22280672e0 con 0x7f222813c650 2020-06-12T17:48:59.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.762+0000 7f221f7fe700 1 -- 172.21.15.38:0/3071805055 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f2210006520 con 0x7f222813c650 2020-06-12T17:48:59.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.762+0000 7f221ffff700 1 --2- 172.21.15.38:0/3071805055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f222813c650 0x7f2228066770 secure :-1 s=THROTTLE_DONE pgs=364 cs=0 l=1 rx=0x7f2210000b80 tx=0x7f22100016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.762+0000 7f221f7fe700 1 --2- 172.21.15.38:0/3071805055 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f220c04d350 0x7f220c04f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:48:59.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.762+0000 7f221f7fe700 1 -- 172.21.15.38:0/3071805055 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f2210060e00 con 0x7f222813c650 2020-06-12T17:48:59.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.762+0000 7f222659c700 1 --2- 172.21.15.38:0/3071805055 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f220c04d350 0x7f220c04f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:48:59.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.762+0000 7f222659c700 1 --2- 172.21.15.38:0/3071805055 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f220c04d350 0x7f220c04f810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f22180082e0 tx=0x7f2218007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.763+0000 7f222659c700 1 --2- 172.21.15.38:0/3071805055 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f220c04d350 0x7f220c04f810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f22180082e0 tx=0x7f2218007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.763+0000 7f222659c700 1 --2- 172.21.15.38:0/3071805055 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f220c04d350 0x7f220c04f810 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f22180082e0 tx=0x7f2218007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:48:59.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.765+0000 7f221ffff700 1 --2- 172.21.15.38:0/3071805055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f222813c650 0x7f2228066770 secure :-1 s=THROTTLE_DONE pgs=364 cs=0 l=1 rx=0x7f2210000b80 tx=0x7f22100016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.765+0000 7f221f7fe700 1 -- 172.21.15.38:0/3071805055 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f22280672e0 con 0x7f222813c650 2020-06-12T17:48:59.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.915+0000 7f222c888700 1 -- 172.21.15.38:0/3071805055 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f22280672e0 con 0x7f222813c650 2020-06-12T17:48:59.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.915+0000 7f221ffff700 1 --2- 172.21.15.38:0/3071805055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f222813c650 0x7f2228066770 secure :-1 s=THROTTLE_DONE pgs=364 cs=0 l=1 rx=0x7f2210000b80 tx=0x7f22100016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:48:59.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.915+0000 7f221f7fe700 1 -- 172.21.15.38:0/3071805055 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f22280672e0 con 0x7f222813c650 2020-06-12T17:48:59.921 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:48:59.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.917+0000 7f222c888700 1 -- 172.21.15.38:0/3071805055 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f220c04d350 msgr2=0x7f220c04f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:59.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.917+0000 7f222c888700 1 --2- 172.21.15.38:0/3071805055 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f220c04d350 0x7f220c04f810 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f22180082e0 tx=0x7f2218007e60).stop 2020-06-12T17:48:59.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.917+0000 7f222c888700 1 -- 172.21.15.38:0/3071805055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f222813c650 msgr2=0x7f2228066770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:48:59.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.917+0000 7f222c888700 1 --2- 172.21.15.38:0/3071805055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f222813c650 0x7f2228066770 secure :-1 s=READY pgs=364 cs=0 l=1 rx=0x7f2210000b80 tx=0x7f22100016e0).stop 2020-06-12T17:48:59.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.917+0000 7f222c888700 1 -- 172.21.15.38:0/3071805055 shutdown_connections 2020-06-12T17:48:59.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.917+0000 7f222c888700 1 --2- 172.21.15.38:0/3071805055 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f220c04d350 0x7f220c04f810 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:59.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.917+0000 7f222c888700 1 --2- 172.21.15.38:0/3071805055 >> v2:172.21.15.150:3300/0 conn(0x7f2228142e90 0x7f22280b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:59.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.917+0000 7f222c888700 1 --2- 172.21.15.38:0/3071805055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f222813c650 0x7f2228066770 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:48:59.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.917+0000 7f222c888700 1 -- 172.21.15.38:0/3071805055 >> 172.21.15.38:0/3071805055 conn(0x7f22280b5a20 msgr2=0x7f222809cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:48:59.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.917+0000 7f222c888700 1 -- 172.21.15.38:0/3071805055 shutdown_connections 2020-06-12T17:48:59.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:48:59.917+0000 7f222c888700 1 -- 172.21.15.38:0/3071805055 wait complete. 2020-06-12T17:48:59.932 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-06-12T17:49:00.046 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.042+0000 7efeebef1700 1 Processor -- start 2020-06-12T17:49:00.047 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.042+0000 7efeebef1700 1 -- start start 2020-06-12T17:49:00.054 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.043+0000 7efeebef1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efee405b680 0x7efee409eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:00.055 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.043+0000 7efeebef1700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee4146360 con 0x7efee414a0a0 2020-06-12T17:49:00.055 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.043+0000 7efeebef1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee4146600 con 0x7efee413fd90 2020-06-12T17:49:00.055 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.043+0000 7efeebef1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee4146170 con 0x7efee405b680 2020-06-12T17:49:00.055 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.043+0000 7efee948c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7efee414a0a0 0x7efee4146aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38880/0 (socket says 172.21.15.38:38880) 2020-06-12T17:49:00.055 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.043+0000 7efee948c700 1 -- 172.21.15.38:0/3098094300 learned_addr learned my addr 172.21.15.38:0/3098094300 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:00.056 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.043+0000 7efee8c8b700 1 -- 172.21.15.38:0/3098094300 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 504718313 0 0) 0x7efee4146360 con 0x7efee414a0a0 2020-06-12T17:49:00.056 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.043+0000 7efee9c8d700 1 --2- 172.21.15.38:0/3098094300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efee405b680 0x7efee409eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:00.056 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.043+0000 7efee8c8b700 1 -- 172.21.15.38:0/3098094300 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efecc003230 con 0x7efee414a0a0 2020-06-12T17:49:00.056 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee8c8b700 1 -- 172.21.15.38:0/3098094300 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4160172721 0 0) 0x7efecc003230 con 0x7efee414a0a0 2020-06-12T17:49:00.056 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee8c8b700 1 -- 172.21.15.38:0/3098094300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efee405b680 msgr2=0x7efee409eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:00.057 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee8c8b700 1 --2- 172.21.15.38:0/3098094300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efee405b680 0x7efee409eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:00.057 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee8c8b700 1 -- 172.21.15.38:0/3098094300 >> v1:172.21.15.150:6789/0 conn(0x7efee413fd90 legacy=0x7efee405fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:00.057 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee8c8b700 1 -- 172.21.15.38:0/3098094300 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee405ba60 con 0x7efee414a0a0 2020-06-12T17:49:00.057 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee8c8b700 1 -- 172.21.15.38:0/3098094300 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7efee00016d0 con 0x7efee414a0a0 2020-06-12T17:49:00.057 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee8c8b700 1 -- 172.21.15.38:0/3098094300 >> v1:172.21.15.38:6789/0 conn(0x7efee414a0a0 legacy=0x7efee4146aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:00.058 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee8c8b700 1 --2- 172.21.15.38:0/3098094300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efecc003750 0x7efecc003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:00.058 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee8c8b700 1 --2- 172.21.15.38:0/3098094300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efecc004090 0x7efecc004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:00.058 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee8c8b700 1 --2- 172.21.15.38:0/3098094300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efee405b680 0x7efecc004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:00.058 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee8c8b700 1 -- 172.21.15.38:0/3098094300 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc004f80 con 0x7efecc003750 2020-06-12T17:49:00.058 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee8c8b700 1 -- 172.21.15.38:0/3098094300 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc0050f0 con 0x7efecc004090 2020-06-12T17:49:00.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee8c8b700 1 -- 172.21.15.38:0/3098094300 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efecc0052b0 con 0x7efee405b680 2020-06-12T17:49:00.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee9c8d700 1 --2- 172.21.15.38:0/3098094300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efecc003750 0x7efecc003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:00.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee948c700 1 --2- 172.21.15.38:0/3098094300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efecc004090 0x7efecc004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:00.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efeea48e700 1 --2- 172.21.15.38:0/3098094300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efee405b680 0x7efecc004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:00.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee9c8d700 1 -- 172.21.15.38:0/3098094300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efee405b680 msgr2=0x7efecc004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:00.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee9c8d700 1 --2- 172.21.15.38:0/3098094300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efee405b680 0x7efecc004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:00.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee9c8d700 1 -- 172.21.15.38:0/3098094300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efecc004090 msgr2=0x7efecc004570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:00.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee9c8d700 1 --2- 172.21.15.38:0/3098094300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efecc004090 0x7efecc004570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:00.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee9c8d700 1 -- 172.21.15.38:0/3098094300 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc003230 con 0x7efecc003750 2020-06-12T17:49:00.061 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee9c8d700 1 --2- 172.21.15.38:0/3098094300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efecc003750 0x7efecc003b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efed4002f30 tx=0x7efed4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.061 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee9c8d700 1 --2- 172.21.15.38:0/3098094300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efecc003750 0x7efecc003b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efed4002f30 tx=0x7efed4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.061 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee9c8d700 1 --2- 172.21.15.38:0/3098094300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efecc003750 0x7efecc003b70 secure :-1 s=READY pgs=366 cs=0 l=1 rx=0x7efed4002f30 tx=0x7efed4007e60).ready entity=mon.0 client_cookie=7471e3fff099a7b0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:00.061 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee9c8d700 1 --2- 172.21.15.38:0/3098094300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efecc003750 0x7efecc003b70 secure :-1 s=THROTTLE_DONE pgs=366 cs=0 l=1 rx=0x7efed4002f30 tx=0x7efed4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.061 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee8c8b700 1 -- 172.21.15.38:0/3098094300 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efed4008d30 con 0x7efecc003750 2020-06-12T17:49:00.062 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee9c8d700 1 --2- 172.21.15.38:0/3098094300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efecc003750 0x7efecc003b70 secure :-1 s=THROTTLE_DONE pgs=366 cs=0 l=1 rx=0x7efed4002f30 tx=0x7efed4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.062 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee9c8d700 1 --2- 172.21.15.38:0/3098094300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efecc003750 0x7efecc003b70 secure :-1 s=THROTTLE_DONE pgs=366 cs=0 l=1 rx=0x7efed4002f30 tx=0x7efed4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.062 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee8c8b700 1 -- 172.21.15.38:0/3098094300 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed4008e90 con 0x7efecc003750 2020-06-12T17:49:00.062 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efee8c8b700 1 -- 172.21.15.38:0/3098094300 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efed4010ae0 con 0x7efecc003750 2020-06-12T17:49:00.062 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efeebef1700 1 -- 172.21.15.38:0/3098094300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efecc003750 msgr2=0x7efecc003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:00.063 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efeebef1700 1 --2- 172.21.15.38:0/3098094300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efecc003750 0x7efecc003b70 secure :-1 s=READY pgs=366 cs=0 l=1 rx=0x7efed4002f30 tx=0x7efed4007e60).stop 2020-06-12T17:49:00.063 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.044+0000 7efeea48e700 1 -- 172.21.15.38:0/3098094300 reap_dead start 2020-06-12T17:49:00.063 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.045+0000 7efeebef1700 1 -- 172.21.15.38:0/3098094300 shutdown_connections 2020-06-12T17:49:00.063 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.045+0000 7efeebef1700 1 -- 172.21.15.38:0/3098094300 >> 172.21.15.38:0/3098094300 conn(0x7efee40b92b0 msgr2=0x7efee40b96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:00.063 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.045+0000 7efeebef1700 1 -- 172.21.15.38:0/3098094300 shutdown_connections 2020-06-12T17:49:00.064 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.045+0000 7efeebef1700 1 -- 172.21.15.38:0/3098094300 wait complete. 2020-06-12T17:49:00.064 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.046+0000 7efeebef1700 1 Processor -- start 2020-06-12T17:49:00.064 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.046+0000 7efeebef1700 1 -- start start 2020-06-12T17:49:00.064 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efeebef1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efee40b5fa0 0x7efee409fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:00.065 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efeebef1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efee40a1ac0 0x7efee4147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:00.065 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efeebef1700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee40a2230 con 0x7efee4147980 2020-06-12T17:49:00.065 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efeebef1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee40b6380 con 0x7efee40b5fa0 2020-06-12T17:49:00.065 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efeebef1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee40a1f90 con 0x7efee40a1ac0 2020-06-12T17:49:00.065 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efeea48e700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7efee4147980 0x7efee4156b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38896/0 (socket says 172.21.15.38:38896) 2020-06-12T17:49:00.066 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efeea48e700 1 -- 172.21.15.38:0/1545489536 learned_addr learned my addr 172.21.15.38:0/1545489536 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:00.066 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efee9c8d700 1 --2- 172.21.15.38:0/1545489536 >> v2:172.21.15.150:3300/0 conn(0x7efee40b5fa0 0x7efee409fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:00.066 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efee948c700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efee40a1ac0 0x7efee4147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:00.066 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efed2ffd700 1 -- 172.21.15.38:0/1545489536 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 503892628 0 0) 0x7efee40a2230 con 0x7efee4147980 2020-06-12T17:49:00.066 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efed2ffd700 1 -- 172.21.15.38:0/1545489536 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efec4002fe0 con 0x7efee4147980 2020-06-12T17:49:00.067 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efed2ffd700 1 -- 172.21.15.38:0/1545489536 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3126696066 0 0) 0x7efec4002fe0 con 0x7efee4147980 2020-06-12T17:49:00.067 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efed2ffd700 1 -- 172.21.15.38:0/1545489536 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efee40a2230 con 0x7efee4147980 2020-06-12T17:49:00.067 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efed2ffd700 1 -- 172.21.15.38:0/1545489536 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7efedc001fc0 con 0x7efee4147980 2020-06-12T17:49:00.067 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efed2ffd700 1 -- 172.21.15.38:0/1545489536 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efee40a1ac0 msgr2=0x7efee4147520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:00.067 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efed2ffd700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efee40a1ac0 0x7efee4147520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:00.068 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efed2ffd700 1 -- 172.21.15.38:0/1545489536 >> v2:172.21.15.150:3300/0 conn(0x7efee40b5fa0 msgr2=0x7efee409fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:00.068 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efed2ffd700 1 --2- 172.21.15.38:0/1545489536 >> v2:172.21.15.150:3300/0 conn(0x7efee40b5fa0 0x7efee409fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:00.068 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efed2ffd700 1 -- 172.21.15.38:0/1545489536 >> v1:172.21.15.38:6789/0 conn(0x7efee4147980 legacy=0x7efee4156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:00.068 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efed2ffd700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efee40a1ac0 0x7efec40049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:00.068 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efed2ffd700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efec4004e10 0x7efec4003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:00.068 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efed2ffd700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efec4003d80 0x7efec40041c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:00.069 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efed2ffd700 1 -- 172.21.15.38:0/1545489536 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee40b6380 con 0x7efec4003d80 2020-06-12T17:49:00.069 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efed2ffd700 1 -- 172.21.15.38:0/1545489536 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee40a1f90 con 0x7efec4004e10 2020-06-12T17:49:00.069 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efed2ffd700 1 -- 172.21.15.38:0/1545489536 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec4005550 con 0x7efee40a1ac0 2020-06-12T17:49:00.069 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efeea48e700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efec4003d80 0x7efec40041c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:00.069 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efee9c8d700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efee40a1ac0 0x7efec40049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:00.070 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.047+0000 7efee948c700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efec4004e10 0x7efec4003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:00.070 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.048+0000 7efeea48e700 1 -- 172.21.15.38:0/1545489536 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efee40a1ac0 msgr2=0x7efec40049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:00.070 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.048+0000 7efeea48e700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efee40a1ac0 0x7efec40049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:00.070 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.048+0000 7efeea48e700 1 -- 172.21.15.38:0/1545489536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efec4004e10 msgr2=0x7efec4003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:00.070 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.048+0000 7efeea48e700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efec4004e10 0x7efec4003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:00.071 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.048+0000 7efeea48e700 1 -- 172.21.15.38:0/1545489536 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee40b3dc0 con 0x7efec4003d80 2020-06-12T17:49:00.071 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.048+0000 7efeebef1700 1 -- 172.21.15.38:0/1545489536 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee41491e0 con 0x7efec4003d80 2020-06-12T17:49:00.071 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.048+0000 7efeea48e700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efec4003d80 0x7efec40041c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efedc000b20 tx=0x7efedc00e9c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.071 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.048+0000 7efeebef1700 1 -- 172.21.15.38:0/1545489536 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee41476e0 con 0x7efec4003d80 2020-06-12T17:49:00.071 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.048+0000 7efeea48e700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efec4003d80 0x7efec40041c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efedc000b20 tx=0x7efedc00e9c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.072 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.048+0000 7efeea48e700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efec4003d80 0x7efec40041c0 secure :-1 s=READY pgs=368 cs=0 l=1 rx=0x7efedc000b20 tx=0x7efedc00e9c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:00.072 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.048+0000 7efeea48e700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efec4003d80 0x7efec40041c0 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7efedc000b20 tx=0x7efedc00e9c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.072 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.048+0000 7efed2ffd700 1 -- 172.21.15.38:0/1545489536 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efedc00eca0 con 0x7efec4003d80 2020-06-12T17:49:00.072 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.048+0000 7efeea48e700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efec4003d80 0x7efec40041c0 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7efedc000b20 tx=0x7efedc00e9c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.072 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.048+0000 7efeea48e700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efec4003d80 0x7efec40041c0 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7efedc000b20 tx=0x7efedc00e9c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.073 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.048+0000 7efed2ffd700 1 -- 172.21.15.38:0/1545489536 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efedc00ee00 con 0x7efec4003d80 2020-06-12T17:49:00.073 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.048+0000 7efed2ffd700 1 -- 172.21.15.38:0/1545489536 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efedc008b50 con 0x7efec4003d80 2020-06-12T17:49:00.073 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.048+0000 7efeea48e700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efec4003d80 0x7efec40041c0 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7efedc000b20 tx=0x7efedc00e9c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.073 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.049+0000 7efeea48e700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efec4003d80 0x7efec40041c0 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7efedc000b20 tx=0x7efedc00e9c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.073 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.049+0000 7efed2ffd700 1 -- 172.21.15.38:0/1545489536 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7efedc008cb0 con 0x7efec4003d80 2020-06-12T17:49:00.074 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.049+0000 7efeebef1700 1 -- 172.21.15.38:0/1545489536 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee4056c30 con 0x7efec4003d80 2020-06-12T17:49:00.074 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.049+0000 7efed2ffd700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efec40555d0 0x7efec4057a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:00.074 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.049+0000 7efed2ffd700 1 -- 172.21.15.38:0/1545489536 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5600+0+0 (secure 0 0 0) 0x7efedc061040 con 0x7efec4003d80 2020-06-12T17:49:00.074 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.049+0000 7efee9c8d700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efec40555d0 0x7efec4057a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:00.074 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.050+0000 7efee9c8d700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efec40555d0 0x7efec4057a90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efed4002f30 tx=0x7efed4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.075 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.050+0000 7efee9c8d700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efec40555d0 0x7efec4057a90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efed4002f30 tx=0x7efed4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.075 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.050+0000 7efee9c8d700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efec40555d0 0x7efec4057a90 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7efed4002f30 tx=0x7efed4007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:00.075 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.053+0000 7efeea48e700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efec4003d80 0x7efec40041c0 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7efedc000b20 tx=0x7efedc00e9c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.076 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.053+0000 7efed2ffd700 1 -- 172.21.15.38:0/1545489536 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7efedc03c7a0 con 0x7efec4003d80 2020-06-12T17:49:00.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.205+0000 7efeebef1700 1 -- 172.21.15.38:0/1545489536 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efee409f490 con 0x7efec4003d80 2020-06-12T17:49:00.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.205+0000 7efeea48e700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efec4003d80 0x7efec40041c0 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7efedc000b20 tx=0x7efedc00e9c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.205+0000 7efed2ffd700 1 -- 172.21.15.38:0/1545489536 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+143 (secure 0 0 0) 0x7efedc03fdc0 con 0x7efec4003d80 2020-06-12T17:49:00.211 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:49:00.211 INFO:teuthology.orchestra.run.smithi038.stdout:[ 2020-06-12T17:49:00.211 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:49:00.211 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 1, 2020-06-12T17:49:00.212 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": "device_health_metrics" 2020-06-12T17:49:00.212 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:49:00.212 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:49:00.212 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 2, 2020-06-12T17:49:00.212 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": "rbd" 2020-06-12T17:49:00.213 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:49:00.213 INFO:teuthology.orchestra.run.smithi038.stdout:] 2020-06-12T17:49:00.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.207+0000 7efeebef1700 1 -- 172.21.15.38:0/1545489536 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efec40555d0 msgr2=0x7efec4057a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:00.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.207+0000 7efeebef1700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efec40555d0 0x7efec4057a90 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7efed4002f30 tx=0x7efed4007e60).stop 2020-06-12T17:49:00.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.207+0000 7efeebef1700 1 -- 172.21.15.38:0/1545489536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efec4003d80 msgr2=0x7efec40041c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:00.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.207+0000 7efeebef1700 1 --2- 172.21.15.38:0/1545489536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efec4003d80 0x7efec40041c0 secure :-1 s=READY pgs=368 cs=0 l=1 rx=0x7efedc000b20 tx=0x7efedc00e9c0).stop 2020-06-12T17:49:00.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.207+0000 7efeea48e700 1 -- 172.21.15.38:0/1545489536 reap_dead start 2020-06-12T17:49:00.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.207+0000 7efeea48e700 1 -- 172.21.15.38:0/1545489536 reap_dead start 2020-06-12T17:49:00.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.207+0000 7efeebef1700 1 -- 172.21.15.38:0/1545489536 shutdown_connections 2020-06-12T17:49:00.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.207+0000 7efeebef1700 1 -- 172.21.15.38:0/1545489536 >> 172.21.15.38:0/1545489536 conn(0x7efee40b92b0 msgr2=0x7efee40b96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:00.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.207+0000 7efeebef1700 1 -- 172.21.15.38:0/1545489536 shutdown_connections 2020-06-12T17:49:00.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.207+0000 7efeebef1700 1 -- 172.21.15.38:0/1545489536 wait complete. 2020-06-12T17:49:00.221 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-06-12T17:49:00.222 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-06-12T17:49:00.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.335+0000 7f9f9bfff700 1 Processor -- start 2020-06-12T17:49:00.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.335+0000 7f9f9bfff700 1 -- start start 2020-06-12T17:49:00.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.335+0000 7f9f9bfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9f9c0afb40 0x7f9f9c0b4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:00.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.335+0000 7f9f9bfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f9c05b420 0x7f9f9c05b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:00.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.336+0000 7f9f9bfff700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9c066da0 con 0x7f9f9c142420 2020-06-12T17:49:00.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.336+0000 7f9f9bfff700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f9c0b0270 con 0x7f9f9c0afb40 2020-06-12T17:49:00.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.336+0000 7f9f9bfff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c145b70 con 0x7f9f9c05b420 2020-06-12T17:49:00.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.336+0000 7f9f9affd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9f9c0afb40 0x7f9f9c0b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:00.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.336+0000 7f9f9b7fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f9f9c142420 0x7f9f9c0b2bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38908/0 (socket says 172.21.15.38:38908) 2020-06-12T17:49:00.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.336+0000 7f9f9b7fe700 1 -- 172.21.15.38:0/891355094 learned_addr learned my addr 172.21.15.38:0/891355094 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:00.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.336+0000 7f9f9a7fc700 1 --2- 172.21.15.38:0/891355094 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f9c05b420 0x7f9f9c05b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:00.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.336+0000 7f9f9affd700 1 -- 172.21.15.38:0/891355094 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f9c05b420 msgr2=0x7f9f9c05b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:00.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.336+0000 7f9f9affd700 1 --2- 172.21.15.38:0/891355094 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f9c05b420 0x7f9f9c05b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:00.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.336+0000 7f9f9affd700 1 -- 172.21.15.38:0/891355094 >> v1:172.21.15.38:6789/0 conn(0x7f9f9c142420 legacy=0x7f9f9c0b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:00.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.336+0000 7f9f99ffb700 1 -- 172.21.15.38:0/891355094 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657619430 0 0) 0x7f9f9c066da0 con 0x7f9f9c142420 2020-06-12T17:49:00.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.336+0000 7f9f9affd700 1 -- 172.21.15.38:0/891355094 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c0aff20 con 0x7f9f9c0afb40 2020-06-12T17:49:00.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.336+0000 7f9f9affd700 1 --2- 172.21.15.38:0/891355094 >> v2:172.21.15.38:3300/0 conn(0x7f9f9c0afb40 0x7f9f9c0b4130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9f84002f30 tx=0x7f9f84007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.336+0000 7f9f9affd700 1 --2- 172.21.15.38:0/891355094 >> v2:172.21.15.38:3300/0 conn(0x7f9f9c0afb40 0x7f9f9c0b4130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9f84002f30 tx=0x7f9f84007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.336+0000 7f9f9affd700 1 --2- 172.21.15.38:0/891355094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f9c0afb40 0x7f9f9c0b4130 secure :-1 s=READY pgs=370 cs=0 l=1 rx=0x7f9f84002f30 tx=0x7f9f84007e60).ready entity=mon.0 client_cookie=7dac345cf2948309 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:00.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.336+0000 7f9f9affd700 1 --2- 172.21.15.38:0/891355094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f9c0afb40 0x7f9f9c0b4130 secure :-1 s=THROTTLE_DONE pgs=370 cs=0 l=1 rx=0x7f9f84002f30 tx=0x7f9f84007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.336+0000 7f9f99ffb700 1 -- 172.21.15.38:0/891355094 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f84011380 con 0x7f9f9c0afb40 2020-06-12T17:49:00.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.336+0000 7f9f9affd700 1 --2- 172.21.15.38:0/891355094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f9c0afb40 0x7f9f9c0b4130 secure :-1 s=THROTTLE_DONE pgs=370 cs=0 l=1 rx=0x7f9f84002f30 tx=0x7f9f84007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.336+0000 7f9f99ffb700 1 -- 172.21.15.38:0/891355094 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f840114e0 con 0x7f9f9c0afb40 2020-06-12T17:49:00.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.336+0000 7f9f9affd700 1 --2- 172.21.15.38:0/891355094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f9c0afb40 0x7f9f9c0b4130 secure :-1 s=THROTTLE_DONE pgs=370 cs=0 l=1 rx=0x7f9f84002f30 tx=0x7f9f84007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.336+0000 7f9f9bfff700 1 -- 172.21.15.38:0/891355094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f9c0afb40 msgr2=0x7f9f9c0b4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:00.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.336+0000 7f9f99ffb700 1 -- 172.21.15.38:0/891355094 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f840118c0 con 0x7f9f9c0afb40 2020-06-12T17:49:00.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.336+0000 7f9f9bfff700 1 --2- 172.21.15.38:0/891355094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f9c0afb40 0x7f9f9c0b4130 secure :-1 s=READY pgs=370 cs=0 l=1 rx=0x7f9f84002f30 tx=0x7f9f84007e60).stop 2020-06-12T17:49:00.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.337+0000 7f9f9bfff700 1 -- 172.21.15.38:0/891355094 shutdown_connections 2020-06-12T17:49:00.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.337+0000 7f9f9bfff700 1 --2- 172.21.15.38:0/891355094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f9c0afb40 0x7f9f9c0b4130 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:00.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.337+0000 7f9f9bfff700 1 --2- 172.21.15.38:0/891355094 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f9c05b420 0x7f9f9c05b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:00.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.337+0000 7f9f9bfff700 1 -- 172.21.15.38:0/891355094 >> 172.21.15.38:0/891355094 conn(0x7f9f9c0b4cc0 msgr2=0x7f9f9c0b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:00.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.337+0000 7f9f9bfff700 1 -- 172.21.15.38:0/891355094 shutdown_connections 2020-06-12T17:49:00.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.337+0000 7f9f9bfff700 1 -- 172.21.15.38:0/891355094 wait complete. 2020-06-12T17:49:00.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.338+0000 7f9f9bfff700 1 Processor -- start 2020-06-12T17:49:00.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.338+0000 7f9f9bfff700 1 -- start start 2020-06-12T17:49:00.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.339+0000 7f9f9bfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f9c05b420 0x7f9f9c133320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:00.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.339+0000 7f9f9bfff700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9c13d1d0 con 0x7f9f9c0afb40 2020-06-12T17:49:00.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.339+0000 7f9f9bfff700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9c13d470 con 0x7f9f9c142420 2020-06-12T17:49:00.354 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.339+0000 7f9f9bfff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c13d710 con 0x7f9f9c05b420 2020-06-12T17:49:00.354 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.339+0000 7f9f9a7fc700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f9f9c0afb40 0x7f9f9c1321a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38912/0 (socket says 172.21.15.38:38912) 2020-06-12T17:49:00.354 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.339+0000 7f9f9a7fc700 1 -- 172.21.15.38:0/459492732 learned_addr learned my addr 172.21.15.38:0/459492732 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:00.354 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.339+0000 7f9f9affd700 1 --2- 172.21.15.38:0/459492732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f9c05b420 0x7f9f9c133320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:00.354 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.339+0000 7f9f93fff700 1 -- 172.21.15.38:0/459492732 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288704942 0 0) 0x7f9f9c13d1d0 con 0x7f9f9c0afb40 2020-06-12T17:49:00.355 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.339+0000 7f9f93fff700 1 -- 172.21.15.38:0/459492732 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f80002fe0 con 0x7f9f9c0afb40 2020-06-12T17:49:00.355 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.339+0000 7f9f93fff700 1 -- 172.21.15.38:0/459492732 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 236667107 0 0) 0x7f9f9c13d470 con 0x7f9f9c142420 2020-06-12T17:49:00.355 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.339+0000 7f9f93fff700 1 -- 172.21.15.38:0/459492732 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f9c13d1d0 con 0x7f9f9c142420 2020-06-12T17:49:00.355 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.339+0000 7f9f93fff700 1 -- 172.21.15.38:0/459492732 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4247583187 0 0) 0x7f9f80002fe0 con 0x7f9f9c0afb40 2020-06-12T17:49:00.355 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.339+0000 7f9f9affd700 1 -- 172.21.15.38:0/459492732 >> v1:172.21.15.150:6789/0 conn(0x7f9f9c142420 legacy=0x7f9f9c0b7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:00.356 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.339+0000 7f9f9affd700 1 -- 172.21.15.38:0/459492732 >> v1:172.21.15.38:6789/0 conn(0x7f9f9c0afb40 legacy=0x7f9f9c1321a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:00.356 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.339+0000 7f9f9affd700 1 -- 172.21.15.38:0/459492732 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c153520 con 0x7f9f9c05b420 2020-06-12T17:49:00.356 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.339+0000 7f9f9affd700 1 --2- 172.21.15.38:0/459492732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f9c05b420 0x7f9f9c133320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9f8c0032b0 tx=0x7f9f84007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.356 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.339+0000 7f9f9affd700 1 --2- 172.21.15.38:0/459492732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f9c05b420 0x7f9f9c133320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9f8c0032b0 tx=0x7f9f84007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.356 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.339+0000 7f9f9affd700 1 --2- 172.21.15.38:0/459492732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f9c05b420 0x7f9f9c133320 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f9f8c0032b0 tx=0x7f9f84007e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:00.356 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.340+0000 7f9f9affd700 1 --2- 172.21.15.38:0/459492732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f9c05b420 0x7f9f9c133320 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f9f8c0032b0 tx=0x7f9f84007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.340+0000 7f9f93fff700 1 -- 172.21.15.38:0/459492732 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f8c001810 con 0x7f9f9c05b420 2020-06-12T17:49:00.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.340+0000 7f9f9affd700 1 --2- 172.21.15.38:0/459492732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f9c05b420 0x7f9f9c133320 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f9f8c0032b0 tx=0x7f9f84007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.340+0000 7f9f9bfff700 1 -- 172.21.15.38:0/459492732 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9c1328b0 con 0x7f9f9c05b420 2020-06-12T17:49:00.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.340+0000 7f9f9affd700 1 --2- 172.21.15.38:0/459492732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f9c05b420 0x7f9f9c133320 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f9f8c0032b0 tx=0x7f9f84007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.340+0000 7f9f93fff700 1 -- 172.21.15.38:0/459492732 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f84011590 con 0x7f9f9c05b420 2020-06-12T17:49:00.358 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.340+0000 7f9f93fff700 1 -- 172.21.15.38:0/459492732 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f840118f0 con 0x7f9f9c05b420 2020-06-12T17:49:00.358 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.340+0000 7f9f9bfff700 1 -- 172.21.15.38:0/459492732 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9c13ccf0 con 0x7f9f9c05b420 2020-06-12T17:49:00.358 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.340+0000 7f9f9affd700 1 --2- 172.21.15.38:0/459492732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f9c05b420 0x7f9f9c133320 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f9f8c0032b0 tx=0x7f9f84007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.358 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.341+0000 7f9f9bfff700 1 -- 172.21.15.38:0/459492732 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f9c153770 con 0x7f9f9c05b420 2020-06-12T17:49:00.358 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.341+0000 7f9f93fff700 1 -- 172.21.15.38:0/459492732 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f9f84007150 con 0x7f9f9c05b420 2020-06-12T17:49:00.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.341+0000 7f9f9affd700 1 --2- 172.21.15.38:0/459492732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f9c05b420 0x7f9f9c133320 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f9f8c0032b0 tx=0x7f9f84007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.341+0000 7f9f93fff700 1 --2- 172.21.15.38:0/459492732 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9f8004da00 0x7f9f8004fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:00.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.341+0000 7f9f93fff700 1 -- 172.21.15.38:0/459492732 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f9f84060fe0 con 0x7f9f9c05b420 2020-06-12T17:49:00.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.341+0000 7f9f9a7fc700 1 --2- 172.21.15.38:0/459492732 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9f8004da00 0x7f9f8004fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:00.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.341+0000 7f9f9a7fc700 1 --2- 172.21.15.38:0/459492732 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9f8004da00 0x7f9f8004fec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9f8c001970 tx=0x7f9f8c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.342+0000 7f9f9a7fc700 1 --2- 172.21.15.38:0/459492732 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9f8004da00 0x7f9f8004fec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9f8c001970 tx=0x7f9f8c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.342+0000 7f9f9a7fc700 1 --2- 172.21.15.38:0/459492732 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9f8004da00 0x7f9f8004fec0 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7f9f8c001970 tx=0x7f9f8c0081e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:00.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.345+0000 7f9f9affd700 1 --2- 172.21.15.38:0/459492732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f9c05b420 0x7f9f9c133320 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f9f8c0032b0 tx=0x7f9f84007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:00.361 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.345+0000 7f9f93fff700 1 -- 172.21.15.38:0/459492732 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f9f9c153770 con 0x7f9f9c05b420 2020-06-12T17:49:00.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:00.498+0000 7f9f9bfff700 1 -- 172.21.15.38:0/459492732 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f9f9c13cff0 con 0x7f9f9c05b420 2020-06-12T17:49:01.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.340+0000 7f9f9affd700 1 --2- 172.21.15.38:0/459492732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f9c05b420 0x7f9f9c133320 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f9f8c0032b0 tx=0x7f9f84007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:01.397 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.393+0000 7f9f9affd700 1 --2- 172.21.15.38:0/459492732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f9c05b420 0x7f9f9c133320 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f9f8c0032b0 tx=0x7f9f84007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:01.398 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.393+0000 7f9f93fff700 1 -- 172.21.15.38:0/459492732 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v31) v1 ==== 133+0+0 (secure 0 0 0) 0x7f9f8403c7e0 con 0x7f9f9c05b420 2020-06-12T17:49:01.400 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.395+0000 7f9f9bfff700 1 -- 172.21.15.38:0/459492732 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9f8004da00 msgr2=0x7f9f8004fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:01.400 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.395+0000 7f9f9bfff700 1 --2- 172.21.15.38:0/459492732 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9f8004da00 0x7f9f8004fec0 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7f9f8c001970 tx=0x7f9f8c0081e0).stop 2020-06-12T17:49:01.400 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.395+0000 7f9f9bfff700 1 -- 172.21.15.38:0/459492732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f9c05b420 msgr2=0x7f9f9c133320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:01.400 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.395+0000 7f9f9bfff700 1 --2- 172.21.15.38:0/459492732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f9c05b420 0x7f9f9c133320 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f9f8c0032b0 tx=0x7f9f84007e60).stop 2020-06-12T17:49:01.400 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.395+0000 7f9f9bfff700 1 -- 172.21.15.38:0/459492732 shutdown_connections 2020-06-12T17:49:01.401 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.395+0000 7f9f9bfff700 1 --2- 172.21.15.38:0/459492732 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9f8004da00 0x7f9f8004fec0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:01.401 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.395+0000 7f9f9bfff700 1 --2- 172.21.15.38:0/459492732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f9c05b420 0x7f9f9c133320 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:01.401 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.395+0000 7f9f9bfff700 1 -- 172.21.15.38:0/459492732 >> 172.21.15.38:0/459492732 conn(0x7f9f9c0b4cc0 msgr2=0x7f9f9c0b2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:01.401 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.395+0000 7f9f9bfff700 1 -- 172.21.15.38:0/459492732 shutdown_connections 2020-06-12T17:49:01.402 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.395+0000 7f9f9bfff700 1 -- 172.21.15.38:0/459492732 wait complete. 2020-06-12T17:49:01.402 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' created 2020-06-12T17:49:01.413 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-06-12T17:49:01.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.534+0000 7f2ba52d2700 1 Processor -- start 2020-06-12T17:49:01.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.534+0000 7f2ba52d2700 1 -- start start 2020-06-12T17:49:01.541 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.535+0000 7f2ba52d2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ba00b3ac0 0x7f2ba009df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:01.541 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.535+0000 7f2ba52d2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2ba013c650 0x7f2ba0066790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:01.542 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.535+0000 7f2ba52d2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba009b960 con 0x7f2ba0142e90 2020-06-12T17:49:01.542 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.535+0000 7f2ba52d2700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba009bc00 con 0x7f2ba013c650 2020-06-12T17:49:01.542 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.535+0000 7f2ba52d2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba00b48f0 con 0x7f2ba00b3ac0 2020-06-12T17:49:01.542 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.535+0000 7f2b9f7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2ba013c650 0x7f2ba0066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:01.543 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.535+0000 7f2b9f7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2ba013c650 0x7f2ba0066790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37106/0 (socket says 172.21.15.38:37106) 2020-06-12T17:49:01.543 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.535+0000 7f2b9f7fe700 1 -- 172.21.15.38:0/3190881852 learned_addr learned my addr 172.21.15.38:0/3190881852 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:01.543 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.535+0000 7f2b9effd700 1 --2- 172.21.15.38:0/3190881852 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ba00b3ac0 0x7f2ba009df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:01.543 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.536+0000 7f2b9f7fe700 1 -- 172.21.15.38:0/3190881852 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ba00b3ac0 msgr2=0x7f2ba009df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:01.543 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.536+0000 7f2b9f7fe700 1 --2- 172.21.15.38:0/3190881852 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ba00b3ac0 0x7f2ba009df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:01.544 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.536+0000 7f2b9f7fe700 1 -- 172.21.15.38:0/3190881852 >> v1:172.21.15.150:6789/0 conn(0x7f2ba0142e90 legacy=0x7f2ba013bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:01.544 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.536+0000 7f2b9f7fe700 1 -- 172.21.15.38:0/3190881852 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba00b3ea0 con 0x7f2ba013c650 2020-06-12T17:49:01.544 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.536+0000 7f2b9dffb700 1 -- 172.21.15.38:0/3190881852 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 101530254 0 0) 0x7f2ba009b960 con 0x7f2ba0142e90 2020-06-12T17:49:01.544 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.536+0000 7f2b9f7fe700 1 --2- 172.21.15.38:0/3190881852 >> v2:172.21.15.38:3300/0 conn(0x7f2ba013c650 0x7f2ba0066790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2b980032b0 tx=0x7f2b980081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:01.544 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.536+0000 7f2b9f7fe700 1 --2- 172.21.15.38:0/3190881852 >> v2:172.21.15.38:3300/0 conn(0x7f2ba013c650 0x7f2ba0066790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2b980032b0 tx=0x7f2b980081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:01.544 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.536+0000 7f2b9f7fe700 1 --2- 172.21.15.38:0/3190881852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ba013c650 0x7f2ba0066790 secure :-1 s=READY pgs=372 cs=0 l=1 rx=0x7f2b980032b0 tx=0x7f2b980081e0).ready entity=mon.0 client_cookie=efebe32a8f723205 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:01.545 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.536+0000 7f2b9f7fe700 1 --2- 172.21.15.38:0/3190881852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ba013c650 0x7f2ba0066790 secure :-1 s=THROTTLE_DONE pgs=372 cs=0 l=1 rx=0x7f2b980032b0 tx=0x7f2b980081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:01.545 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.536+0000 7f2b9dffb700 1 -- 172.21.15.38:0/3190881852 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b98011ea0 con 0x7f2ba013c650 2020-06-12T17:49:01.545 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.536+0000 7f2b9f7fe700 1 --2- 172.21.15.38:0/3190881852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ba013c650 0x7f2ba0066790 secure :-1 s=THROTTLE_DONE pgs=372 cs=0 l=1 rx=0x7f2b980032b0 tx=0x7f2b980081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:01.546 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.536+0000 7f2b9dffb700 1 -- 172.21.15.38:0/3190881852 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9800a160 con 0x7f2ba013c650 2020-06-12T17:49:01.546 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.536+0000 7f2b9f7fe700 1 --2- 172.21.15.38:0/3190881852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ba013c650 0x7f2ba0066790 secure :-1 s=THROTTLE_DONE pgs=372 cs=0 l=1 rx=0x7f2b980032b0 tx=0x7f2b980081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:01.546 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.536+0000 7f2b9dffb700 1 -- 172.21.15.38:0/3190881852 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b9800a500 con 0x7f2ba013c650 2020-06-12T17:49:01.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.536+0000 7f2ba52d2700 1 -- 172.21.15.38:0/3190881852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ba013c650 msgr2=0x7f2ba0066790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:01.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.536+0000 7f2ba52d2700 1 --2- 172.21.15.38:0/3190881852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ba013c650 0x7f2ba0066790 secure :-1 s=READY pgs=372 cs=0 l=1 rx=0x7f2b980032b0 tx=0x7f2b980081e0).stop 2020-06-12T17:49:01.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.537+0000 7f2ba52d2700 1 -- 172.21.15.38:0/3190881852 shutdown_connections 2020-06-12T17:49:01.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.537+0000 7f2ba52d2700 1 --2- 172.21.15.38:0/3190881852 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ba00b3ac0 0x7f2ba009df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:01.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.537+0000 7f2ba52d2700 1 --2- 172.21.15.38:0/3190881852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ba013c650 0x7f2ba0066790 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:01.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.537+0000 7f2ba52d2700 1 -- 172.21.15.38:0/3190881852 >> 172.21.15.38:0/3190881852 conn(0x7f2ba00b5a20 msgr2=0x7f2ba005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:01.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.537+0000 7f2ba52d2700 1 -- 172.21.15.38:0/3190881852 shutdown_connections 2020-06-12T17:49:01.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.537+0000 7f2ba52d2700 1 -- 172.21.15.38:0/3190881852 wait complete. 2020-06-12T17:49:01.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.538+0000 7f2ba52d2700 1 Processor -- start 2020-06-12T17:49:01.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.538+0000 7f2ba52d2700 1 -- start start 2020-06-12T17:49:01.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2ba52d2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2ba00b3ac0 0x7f2ba00af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:01.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2ba52d2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ba013c650 0x7f2ba00b7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:01.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2ba52d2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2ba0142e90 0x7f2ba00aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:01.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2ba52d2700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba00ae4b0 con 0x7f2ba00b3ac0 2020-06-12T17:49:01.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2ba52d2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba00ae690 con 0x7f2ba0142e90 2020-06-12T17:49:01.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2ba52d2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba00ae930 con 0x7f2ba013c650 2020-06-12T17:49:01.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2b9effd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2ba00b3ac0 0x7f2ba00af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:01.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2b9effd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2ba00b3ac0 0x7f2ba00af7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37110/0 (socket says 172.21.15.38:37110) 2020-06-12T17:49:01.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2b9effd700 1 -- 172.21.15.38:0/1007804529 learned_addr learned my addr 172.21.15.38:0/1007804529 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:01.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2b9e7fc700 1 --2- 172.21.15.38:0/1007804529 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ba013c650 0x7f2ba00b7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:01.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2b9f7fe700 1 --2- 172.21.15.38:0/1007804529 >> v2:172.21.15.150:3300/0 conn(0x7f2ba0142e90 0x7f2ba00aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:01.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2b9effd700 1 -- 172.21.15.38:0/1007804529 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ba013c650 msgr2=0x7f2ba00b7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:01.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2b9effd700 1 --2- 172.21.15.38:0/1007804529 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ba013c650 0x7f2ba00b7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:01.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2b9effd700 1 -- 172.21.15.38:0/1007804529 >> v2:172.21.15.150:3300/0 conn(0x7f2ba0142e90 msgr2=0x7f2ba00aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:01.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2b9effd700 1 --2- 172.21.15.38:0/1007804529 >> v2:172.21.15.150:3300/0 conn(0x7f2ba0142e90 0x7f2ba00aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:01.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2b9effd700 1 -- 172.21.15.38:0/1007804529 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba01467d0 con 0x7f2ba00b3ac0 2020-06-12T17:49:01.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2b9effd700 1 --2- 172.21.15.38:0/1007804529 >> v2:172.21.15.38:3300/0 conn(0x7f2ba00b3ac0 0x7f2ba00af7b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2b94003070 tx=0x7f2b94007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:01.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2b9effd700 1 --2- 172.21.15.38:0/1007804529 >> v2:172.21.15.38:3300/0 conn(0x7f2ba00b3ac0 0x7f2ba00af7b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2b94003070 tx=0x7f2b94007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:01.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2b9effd700 1 --2- 172.21.15.38:0/1007804529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ba00b3ac0 0x7f2ba00af7b0 secure :-1 s=READY pgs=373 cs=0 l=1 rx=0x7f2b94003070 tx=0x7f2b94007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:01.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2b9effd700 1 --2- 172.21.15.38:0/1007804529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ba00b3ac0 0x7f2ba00af7b0 secure :-1 s=THROTTLE_DONE pgs=373 cs=0 l=1 rx=0x7f2b94003070 tx=0x7f2b94007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:01.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2b8ffff700 1 -- 172.21.15.38:0/1007804529 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b94007540 con 0x7f2ba00b3ac0 2020-06-12T17:49:01.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2b9effd700 1 --2- 172.21.15.38:0/1007804529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ba00b3ac0 0x7f2ba00af7b0 secure :-1 s=THROTTLE_DONE pgs=373 cs=0 l=1 rx=0x7f2b94003070 tx=0x7f2b94007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:01.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2b9effd700 1 --2- 172.21.15.38:0/1007804529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ba00b3ac0 0x7f2ba00af7b0 secure :-1 s=THROTTLE_DONE pgs=373 cs=0 l=1 rx=0x7f2b94003070 tx=0x7f2b94007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:01.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2b8ffff700 1 -- 172.21.15.38:0/1007804529 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b940058a0 con 0x7f2ba00b3ac0 2020-06-12T17:49:01.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2ba52d2700 1 -- 172.21.15.38:0/1007804529 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba00af230 con 0x7f2ba00b3ac0 2020-06-12T17:49:01.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2b8ffff700 1 -- 172.21.15.38:0/1007804529 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b94005c80 con 0x7f2ba00b3ac0 2020-06-12T17:49:01.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.539+0000 7f2ba52d2700 1 -- 172.21.15.38:0/1007804529 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba00b1450 con 0x7f2ba00b3ac0 2020-06-12T17:49:01.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.540+0000 7f2b9effd700 1 --2- 172.21.15.38:0/1007804529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ba00b3ac0 0x7f2ba00af7b0 secure :-1 s=THROTTLE_DONE pgs=373 cs=0 l=1 rx=0x7f2b94003070 tx=0x7f2b94007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:01.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.540+0000 7f2ba52d2700 1 -- 172.21.15.38:0/1007804529 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba0056c30 con 0x7f2ba00b3ac0 2020-06-12T17:49:01.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.541+0000 7f2b8ffff700 1 -- 172.21.15.38:0/1007804529 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f2b9400e320 con 0x7f2ba00b3ac0 2020-06-12T17:49:01.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.541+0000 7f2b9effd700 1 --2- 172.21.15.38:0/1007804529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ba00b3ac0 0x7f2ba00af7b0 secure :-1 s=THROTTLE_DONE pgs=373 cs=0 l=1 rx=0x7f2b94003070 tx=0x7f2b94007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:01.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.541+0000 7f2b8ffff700 1 --2- 172.21.15.38:0/1007804529 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2b7c04d6a0 0x7f2b7c04fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:01.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.541+0000 7f2b8ffff700 1 -- 172.21.15.38:0/1007804529 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f2b94060f50 con 0x7f2ba00b3ac0 2020-06-12T17:49:01.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.541+0000 7f2b9e7fc700 1 --2- 172.21.15.38:0/1007804529 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2b7c04d6a0 0x7f2b7c04fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:01.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.541+0000 7f2b9e7fc700 1 --2- 172.21.15.38:0/1007804529 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2b7c04d6a0 0x7f2b7c04fb60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2b90000b80 tx=0x7f2b900017c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:01.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.541+0000 7f2b9e7fc700 1 --2- 172.21.15.38:0/1007804529 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2b7c04d6a0 0x7f2b7c04fb60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2b90000b80 tx=0x7f2b900017c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:01.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.541+0000 7f2b9e7fc700 1 --2- 172.21.15.38:0/1007804529 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2b7c04d6a0 0x7f2b7c04fb60 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7f2b90000b80 tx=0x7f2b900017c0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:01.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.544+0000 7f2b9effd700 1 --2- 172.21.15.38:0/1007804529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ba00b3ac0 0x7f2ba00af7b0 secure :-1 s=THROTTLE_DONE pgs=373 cs=0 l=1 rx=0x7f2b94003070 tx=0x7f2b94007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:01.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.544+0000 7f2b8ffff700 1 -- 172.21.15.38:0/1007804529 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f2b9403c6b0 con 0x7f2ba00b3ac0 2020-06-12T17:49:01.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:01.695+0000 7f2ba52d2700 1 -- 172.21.15.38:0/1007804529 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f2ba01428f0 con 0x7f2ba00b3ac0 2020-06-12T17:49:02.402 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.398+0000 7f2b9effd700 1 --2- 172.21.15.38:0/1007804529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ba00b3ac0 0x7f2ba00af7b0 secure :-1 s=THROTTLE_DONE pgs=373 cs=0 l=1 rx=0x7f2b94003070 tx=0x7f2b94007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.403 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.398+0000 7f2b8ffff700 1 -- 172.21.15.38:0/1007804529 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v32) v1 ==== 125+0+0 (secure 0 0 0) 0x7f2b9403fcd0 con 0x7f2ba00b3ac0 2020-06-12T17:49:02.406 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.401+0000 7f2ba52d2700 1 -- 172.21.15.38:0/1007804529 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2b7c04d6a0 msgr2=0x7f2b7c04fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:02.407 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.402+0000 7f2ba52d2700 1 --2- 172.21.15.38:0/1007804529 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2b7c04d6a0 0x7f2b7c04fb60 secure :-1 s=READY pgs=158 cs=0 l=1 rx=0x7f2b90000b80 tx=0x7f2b900017c0).stop 2020-06-12T17:49:02.407 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.402+0000 7f2ba52d2700 1 -- 172.21.15.38:0/1007804529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ba00b3ac0 msgr2=0x7f2ba00af7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:02.407 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.402+0000 7f2ba52d2700 1 --2- 172.21.15.38:0/1007804529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ba00b3ac0 0x7f2ba00af7b0 secure :-1 s=READY pgs=373 cs=0 l=1 rx=0x7f2b94003070 tx=0x7f2b94007e60).stop 2020-06-12T17:49:02.407 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.402+0000 7f2ba52d2700 1 -- 172.21.15.38:0/1007804529 shutdown_connections 2020-06-12T17:49:02.407 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.402+0000 7f2ba52d2700 1 --2- 172.21.15.38:0/1007804529 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2b7c04d6a0 0x7f2b7c04fb60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:02.408 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.402+0000 7f2ba52d2700 1 --2- 172.21.15.38:0/1007804529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ba00b3ac0 0x7f2ba00af7b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:02.408 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.402+0000 7f2ba52d2700 1 --2- 172.21.15.38:0/1007804529 >> v2:172.21.15.150:3300/0 conn(0x7f2ba0142e90 0x7f2ba00aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:02.408 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.402+0000 7f2ba52d2700 1 --2- 172.21.15.38:0/1007804529 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ba013c650 0x7f2ba00b7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:02.408 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.402+0000 7f2ba52d2700 1 -- 172.21.15.38:0/1007804529 >> 172.21.15.38:0/1007804529 conn(0x7f2ba00b5a20 msgr2=0x7f2ba00b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:02.409 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.402+0000 7f2ba52d2700 1 -- 172.21.15.38:0/1007804529 shutdown_connections 2020-06-12T17:49:02.409 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.402+0000 7f2ba52d2700 1 -- 172.21.15.38:0/1007804529 wait complete. 2020-06-12T17:49:02.410 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' created 2020-06-12T17:49:02.422 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-06-12T17:49:02.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.544+0000 7f4266f3f700 1 Processor -- start 2020-06-12T17:49:02.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.544+0000 7f4266f3f700 1 -- start start 2020-06-12T17:49:02.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.544+0000 7f4266f3f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4260149ba0 0x7f4260149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:02.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.544+0000 7f4266f3f700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f426005c8e0 con 0x7f426005b0a0 2020-06-12T17:49:02.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.544+0000 7f4266f3f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4260149700 con 0x7f4260065420 2020-06-12T17:49:02.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.544+0000 7f4266f3f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42601467a0 con 0x7f4260149ba0 2020-06-12T17:49:02.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.545+0000 7f425ffff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f426005b0a0 0x7f42600b7070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38934/0 (socket says 172.21.15.38:38934) 2020-06-12T17:49:02.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.545+0000 7f425ffff700 1 -- 172.21.15.38:0/2052685338 learned_addr learned my addr 172.21.15.38:0/2052685338 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:02.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.545+0000 7f42654dc700 1 --2- 172.21.15.38:0/2052685338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4260149ba0 0x7f4260149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:02.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.545+0000 7f425f7fe700 1 -- 172.21.15.38:0/2052685338 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1368088546 0 0) 0x7f426005c8e0 con 0x7f426005b0a0 2020-06-12T17:49:02.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.545+0000 7f425f7fe700 1 -- 172.21.15.38:0/2052685338 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f424c003230 con 0x7f426005b0a0 2020-06-12T17:49:02.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.545+0000 7f425f7fe700 1 -- 172.21.15.38:0/2052685338 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377982181 0 0) 0x7f4260149700 con 0x7f4260065420 2020-06-12T17:49:02.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.545+0000 7f425f7fe700 1 -- 172.21.15.38:0/2052685338 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f426005c8e0 con 0x7f4260065420 2020-06-12T17:49:02.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.545+0000 7f425f7fe700 1 -- 172.21.15.38:0/2052685338 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1425589708 0 0) 0x7f424c003230 con 0x7f426005b0a0 2020-06-12T17:49:02.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.545+0000 7f42654dc700 1 -- 172.21.15.38:0/2052685338 >> v1:172.21.15.150:6789/0 conn(0x7f4260065420 legacy=0x7f4260146090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:02.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.545+0000 7f42654dc700 1 -- 172.21.15.38:0/2052685338 >> v1:172.21.15.38:6789/0 conn(0x7f426005b0a0 legacy=0x7f42600b7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:02.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.545+0000 7f42654dc700 1 -- 172.21.15.38:0/2052685338 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426005cb80 con 0x7f4260149ba0 2020-06-12T17:49:02.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.545+0000 7f42654dc700 1 --2- 172.21.15.38:0/2052685338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4260149ba0 0x7f4260149ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4254001870 tx=0x7f42580081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.545+0000 7f42654dc700 1 --2- 172.21.15.38:0/2052685338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4260149ba0 0x7f4260149ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4254001870 tx=0x7f42580081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.545+0000 7f42654dc700 1 --2- 172.21.15.38:0/2052685338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4260149ba0 0x7f4260149ff0 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f4254001870 tx=0x7f42580081e0).ready entity=mon.2 client_cookie=25672cfb9bd85cdd server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:02.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.545+0000 7f42654dc700 1 --2- 172.21.15.38:0/2052685338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4260149ba0 0x7f4260149ff0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f4254001870 tx=0x7f42580081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.545+0000 7f425f7fe700 1 -- 172.21.15.38:0/2052685338 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42540016d0 con 0x7f4260149ba0 2020-06-12T17:49:02.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.545+0000 7f42654dc700 1 --2- 172.21.15.38:0/2052685338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4260149ba0 0x7f4260149ff0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f4254001870 tx=0x7f42580081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.546+0000 7f425f7fe700 1 -- 172.21.15.38:0/2052685338 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4258010a10 con 0x7f4260149ba0 2020-06-12T17:49:02.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.546+0000 7f42654dc700 1 --2- 172.21.15.38:0/2052685338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4260149ba0 0x7f4260149ff0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f4254001870 tx=0x7f42580081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.546+0000 7f425f7fe700 1 -- 172.21.15.38:0/2052685338 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4258010d70 con 0x7f4260149ba0 2020-06-12T17:49:02.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.546+0000 7f4266f3f700 1 -- 172.21.15.38:0/2052685338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4260149ba0 msgr2=0x7f4260149ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:02.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.546+0000 7f4266f3f700 1 --2- 172.21.15.38:0/2052685338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4260149ba0 0x7f4260149ff0 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f4254001870 tx=0x7f42580081e0).stop 2020-06-12T17:49:02.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.546+0000 7f4266f3f700 1 -- 172.21.15.38:0/2052685338 shutdown_connections 2020-06-12T17:49:02.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.546+0000 7f4266f3f700 1 --2- 172.21.15.38:0/2052685338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4260149ba0 0x7f4260149ff0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:02.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.546+0000 7f4266f3f700 1 -- 172.21.15.38:0/2052685338 >> 172.21.15.38:0/2052685338 conn(0x7f42600ba610 msgr2=0x7f42600baa20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:02.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.546+0000 7f4266f3f700 1 -- 172.21.15.38:0/2052685338 shutdown_connections 2020-06-12T17:49:02.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.546+0000 7f4266f3f700 1 -- 172.21.15.38:0/2052685338 wait complete. 2020-06-12T17:49:02.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.547+0000 7f4266f3f700 1 Processor -- start 2020-06-12T17:49:02.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.547+0000 7f4266f3f700 1 -- start start 2020-06-12T17:49:02.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.548+0000 7f4266f3f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f426005b0a0 0x7f426009fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:02.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.548+0000 7f4266f3f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4260065420 0x7f426013f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:02.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.548+0000 7f4266f3f700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4260147820 con 0x7f4260149ba0 2020-06-12T17:49:02.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.548+0000 7f4266f3f700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42600a0490 con 0x7f426005b0a0 2020-06-12T17:49:02.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.548+0000 7f4266f3f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4260157bb0 con 0x7f4260065420 2020-06-12T17:49:02.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.548+0000 7f4264cdb700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f426005b0a0 0x7f426009fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:02.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.548+0000 7f42654dc700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4260149ba0 0x7f426013fac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38944/0 (socket says 172.21.15.38:38944) 2020-06-12T17:49:02.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.548+0000 7f42654dc700 1 -- 172.21.15.38:0/1970734400 learned_addr learned my addr 172.21.15.38:0/1970734400 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:02.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.548+0000 7f425ffff700 1 --2- 172.21.15.38:0/1970734400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4260065420 0x7f426013f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:02.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.548+0000 7f4264cdb700 1 -- 172.21.15.38:0/1970734400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4260065420 msgr2=0x7f426013f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:02.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.548+0000 7f4264cdb700 1 --2- 172.21.15.38:0/1970734400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4260065420 0x7f426013f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:02.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.548+0000 7f4264cdb700 1 -- 172.21.15.38:0/1970734400 >> v1:172.21.15.38:6789/0 conn(0x7f4260149ba0 legacy=0x7f426013fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:02.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.548+0000 7f4264cdb700 1 -- 172.21.15.38:0/1970734400 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4260157980 con 0x7f426005b0a0 2020-06-12T17:49:02.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.548+0000 7f425dffb700 1 -- 172.21.15.38:0/1970734400 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967593671 0 0) 0x7f4260147820 con 0x7f4260149ba0 2020-06-12T17:49:02.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.548+0000 7f425ffff700 1 --2- 172.21.15.38:0/1970734400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4260065420 0x7f426013f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:49:02.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.548+0000 7f4264cdb700 1 --2- 172.21.15.38:0/1970734400 >> v2:172.21.15.38:3300/0 conn(0x7f426005b0a0 0x7f426009fca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f42500010d0 tx=0x7f42500027b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.548+0000 7f4264cdb700 1 --2- 172.21.15.38:0/1970734400 >> v2:172.21.15.38:3300/0 conn(0x7f426005b0a0 0x7f426009fca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f42500010d0 tx=0x7f42500027b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.548+0000 7f4264cdb700 1 --2- 172.21.15.38:0/1970734400 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f426005b0a0 0x7f426009fca0 secure :-1 s=READY pgs=376 cs=0 l=1 rx=0x7f42500010d0 tx=0x7f42500027b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:02.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.549+0000 7f4264cdb700 1 --2- 172.21.15.38:0/1970734400 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f426005b0a0 0x7f426009fca0 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7f42500010d0 tx=0x7f42500027b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.549+0000 7f425dffb700 1 -- 172.21.15.38:0/1970734400 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4250006bc0 con 0x7f426005b0a0 2020-06-12T17:49:02.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.549+0000 7f4264cdb700 1 --2- 172.21.15.38:0/1970734400 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f426005b0a0 0x7f426009fca0 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7f42500010d0 tx=0x7f42500027b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.549+0000 7f425dffb700 1 -- 172.21.15.38:0/1970734400 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4250006d60 con 0x7f426005b0a0 2020-06-12T17:49:02.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.549+0000 7f4264cdb700 1 --2- 172.21.15.38:0/1970734400 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f426005b0a0 0x7f426009fca0 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7f42500010d0 tx=0x7f42500027b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.549+0000 7f4266f3f700 1 -- 172.21.15.38:0/1970734400 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42600a0100 con 0x7f426005b0a0 2020-06-12T17:49:02.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.549+0000 7f425dffb700 1 -- 172.21.15.38:0/1970734400 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4250008350 con 0x7f426005b0a0 2020-06-12T17:49:02.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.549+0000 7f4266f3f700 1 -- 172.21.15.38:0/1970734400 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4260144620 con 0x7f426005b0a0 2020-06-12T17:49:02.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.549+0000 7f4264cdb700 1 --2- 172.21.15.38:0/1970734400 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f426005b0a0 0x7f426009fca0 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7f42500010d0 tx=0x7f42500027b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.550+0000 7f4266f3f700 1 -- 172.21.15.38:0/1970734400 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4260056c30 con 0x7f426005b0a0 2020-06-12T17:49:02.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.550+0000 7f425dffb700 1 -- 172.21.15.38:0/1970734400 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f4250008610 con 0x7f426005b0a0 2020-06-12T17:49:02.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.550+0000 7f4264cdb700 1 --2- 172.21.15.38:0/1970734400 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f426005b0a0 0x7f426009fca0 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7f42500010d0 tx=0x7f42500027b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.550+0000 7f425dffb700 1 --2- 172.21.15.38:0/1970734400 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f424004d340 0x7f424004f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:02.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.550+0000 7f425dffb700 1 -- 172.21.15.38:0/1970734400 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f4250061090 con 0x7f426005b0a0 2020-06-12T17:49:02.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.550+0000 7f425ffff700 1 --2- 172.21.15.38:0/1970734400 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f424004d340 0x7f424004f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:02.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.551+0000 7f425ffff700 1 --2- 172.21.15.38:0/1970734400 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f424004d340 0x7f424004f800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4254000fa0 tx=0x7f4254001280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.551+0000 7f425ffff700 1 --2- 172.21.15.38:0/1970734400 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f424004d340 0x7f424004f800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4254000fa0 tx=0x7f4254001280).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.551+0000 7f425ffff700 1 --2- 172.21.15.38:0/1970734400 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f424004d340 0x7f424004f800 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7f4254000fa0 tx=0x7f4254001280).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:02.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.554+0000 7f4264cdb700 1 --2- 172.21.15.38:0/1970734400 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f426005b0a0 0x7f426009fca0 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7f42500010d0 tx=0x7f42500027b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.554+0000 7f425dffb700 1 -- 172.21.15.38:0/1970734400 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f425003c770 con 0x7f426005b0a0 2020-06-12T17:49:02.761 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.757+0000 7f4266f3f700 1 -- 172.21.15.38:0/1970734400 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f426005c620 con 0x7f426005b0a0 2020-06-12T17:49:02.766 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.762+0000 7f4264cdb700 1 --2- 172.21.15.38:0/1970734400 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f426005b0a0 0x7f426009fca0 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7f42500010d0 tx=0x7f42500027b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.767 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.762+0000 7f425dffb700 1 -- 172.21.15.38:0/1970734400 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 5 and data pool 6 v11) v1 ==== 187+0+0 (secure 0 0 0) 0x7f425003fd90 con 0x7f426005b0a0 2020-06-12T17:49:02.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.765+0000 7f4266f3f700 1 -- 172.21.15.38:0/1970734400 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f424004d340 msgr2=0x7f424004f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:02.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.765+0000 7f4266f3f700 1 --2- 172.21.15.38:0/1970734400 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f424004d340 0x7f424004f800 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7f4254000fa0 tx=0x7f4254001280).stop 2020-06-12T17:49:02.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.765+0000 7f4266f3f700 1 -- 172.21.15.38:0/1970734400 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f426005b0a0 msgr2=0x7f426009fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:02.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.765+0000 7f4266f3f700 1 --2- 172.21.15.38:0/1970734400 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f426005b0a0 0x7f426009fca0 secure :-1 s=READY pgs=376 cs=0 l=1 rx=0x7f42500010d0 tx=0x7f42500027b0).stop 2020-06-12T17:49:02.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.766+0000 7f4266f3f700 1 -- 172.21.15.38:0/1970734400 shutdown_connections 2020-06-12T17:49:02.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.766+0000 7f4266f3f700 1 --2- 172.21.15.38:0/1970734400 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f424004d340 0x7f424004f800 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:02.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.766+0000 7f4266f3f700 1 --2- 172.21.15.38:0/1970734400 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f426005b0a0 0x7f426009fca0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:02.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.766+0000 7f4266f3f700 1 --2- 172.21.15.38:0/1970734400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4260065420 0x7f426013f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:02.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.766+0000 7f4266f3f700 1 -- 172.21.15.38:0/1970734400 >> 172.21.15.38:0/1970734400 conn(0x7f42600ba610 msgr2=0x7f42600b5320 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:02.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.767+0000 7f4266f3f700 1 -- 172.21.15.38:0/1970734400 shutdown_connections 2020-06-12T17:49:02.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.768+0000 7f4266f3f700 1 -- 172.21.15.38:0/1970734400 wait complete. 2020-06-12T17:49:02.773 INFO:teuthology.orchestra.run.smithi038.stderr:new fs with metadata pool 5 and data pool 6 2020-06-12T17:49:02.786 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-12T17:49:02.901 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.896+0000 7f23875b8700 1 Processor -- start 2020-06-12T17:49:02.901 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.897+0000 7f23875b8700 1 -- start start 2020-06-12T17:49:02.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.897+0000 7f23875b8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f238005b0c0 0x7f23801454d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:02.909 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.897+0000 7f23875b8700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f238005c670 con 0x7f23800b3ea0 2020-06-12T17:49:02.909 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.897+0000 7f23875b8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f238005c910 con 0x7f2380145930 2020-06-12T17:49:02.909 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.897+0000 7f23875b8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23800b4280 con 0x7f238005b0c0 2020-06-12T17:49:02.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.897+0000 7f2385354700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f23800b3ea0 0x7f238014a050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38948/0 (socket says 172.21.15.38:38948) 2020-06-12T17:49:02.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.897+0000 7f2385354700 1 -- 172.21.15.38:0/2349886108 learned_addr learned my addr 172.21.15.38:0/2349886108 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:02.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.897+0000 7f2384b53700 1 --2- 172.21.15.38:0/2349886108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f238005b0c0 0x7f23801454d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:02.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f236ffff700 1 -- 172.21.15.38:0/2349886108 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 185502306 0 0) 0x7f238005c670 con 0x7f23800b3ea0 2020-06-12T17:49:02.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f236ffff700 1 -- 172.21.15.38:0/2349886108 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2368003230 con 0x7f23800b3ea0 2020-06-12T17:49:02.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f236ffff700 1 -- 172.21.15.38:0/2349886108 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882304895 0 0) 0x7f238005c910 con 0x7f2380145930 2020-06-12T17:49:02.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f236ffff700 1 -- 172.21.15.38:0/2349886108 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f238005c670 con 0x7f2380145930 2020-06-12T17:49:02.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f236ffff700 1 -- 172.21.15.38:0/2349886108 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1156740274 0 0) 0x7f2368003230 con 0x7f23800b3ea0 2020-06-12T17:49:02.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f236ffff700 1 -- 172.21.15.38:0/2349886108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f238005b0c0 msgr2=0x7f23801454d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:02.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f236ffff700 1 --2- 172.21.15.38:0/2349886108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f238005b0c0 0x7f23801454d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:02.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f236ffff700 1 -- 172.21.15.38:0/2349886108 >> v1:172.21.15.150:6789/0 conn(0x7f2380145930 legacy=0x7f23800b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:02.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f236ffff700 1 -- 172.21.15.38:0/2349886108 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2380145da0 con 0x7f23800b3ea0 2020-06-12T17:49:02.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f236ffff700 1 -- 172.21.15.38:0/2349886108 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f2378001a50 con 0x7f23800b3ea0 2020-06-12T17:49:02.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f236ffff700 1 -- 172.21.15.38:0/2349886108 >> v1:172.21.15.38:6789/0 conn(0x7f23800b3ea0 legacy=0x7f238014a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:02.913 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f236ffff700 1 --2- 172.21.15.38:0/2349886108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f238005b0c0 0x7f23680038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:02.913 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f236ffff700 1 --2- 172.21.15.38:0/2349886108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2368003d40 0x7f23680044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:02.913 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f236ffff700 1 --2- 172.21.15.38:0/2349886108 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2368004930 0x7f2368004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:02.913 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f236ffff700 1 -- 172.21.15.38:0/2349886108 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23800b4280 con 0x7f2368004930 2020-06-12T17:49:02.913 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f236ffff700 1 -- 172.21.15.38:0/2349886108 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2368005210 con 0x7f2368003d40 2020-06-12T17:49:02.914 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f236ffff700 1 -- 172.21.15.38:0/2349886108 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236800b720 con 0x7f238005b0c0 2020-06-12T17:49:02.914 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f2385b55700 1 --2- 172.21.15.38:0/2349886108 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2368004930 0x7f2368004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:02.914 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f2385354700 1 --2- 172.21.15.38:0/2349886108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f238005b0c0 0x7f23680038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:02.914 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f2384b53700 1 --2- 172.21.15.38:0/2349886108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2368003d40 0x7f23680044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:02.914 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f2385b55700 1 -- 172.21.15.38:0/2349886108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f238005b0c0 msgr2=0x7f23680038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:02.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f2385b55700 1 --2- 172.21.15.38:0/2349886108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f238005b0c0 0x7f23680038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:02.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f2385b55700 1 -- 172.21.15.38:0/2349886108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2368003d40 msgr2=0x7f23680044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:02.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f2385b55700 1 --2- 172.21.15.38:0/2349886108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2368003d40 0x7f23680044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:02.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f2385b55700 1 -- 172.21.15.38:0/2349886108 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2368003230 con 0x7f2368004930 2020-06-12T17:49:02.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f2384b53700 1 --2- 172.21.15.38:0/2349886108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2368003d40 0x7f23680044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:49:02.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.898+0000 7f2385b55700 1 --2- 172.21.15.38:0/2349886108 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2368004930 0x7f2368004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f237c0010d0 tx=0x7f237c0019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.899+0000 7f2385b55700 1 --2- 172.21.15.38:0/2349886108 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2368004930 0x7f2368004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f237c0010d0 tx=0x7f237c0019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.899+0000 7f2385b55700 1 --2- 172.21.15.38:0/2349886108 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2368004930 0x7f2368004db0 secure :-1 s=READY pgs=378 cs=0 l=1 rx=0x7f237c0010d0 tx=0x7f237c0019a0).ready entity=mon.0 client_cookie=c20990fafbf7b12 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:02.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.899+0000 7f2385b55700 1 --2- 172.21.15.38:0/2349886108 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2368004930 0x7f2368004db0 secure :-1 s=THROTTLE_DONE pgs=378 cs=0 l=1 rx=0x7f237c0010d0 tx=0x7f237c0019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.899+0000 7f236ffff700 1 -- 172.21.15.38:0/2349886108 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f237c011b40 con 0x7f2368004930 2020-06-12T17:49:02.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.899+0000 7f2385b55700 1 --2- 172.21.15.38:0/2349886108 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2368004930 0x7f2368004db0 secure :-1 s=THROTTLE_DONE pgs=378 cs=0 l=1 rx=0x7f237c0010d0 tx=0x7f237c0019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.899+0000 7f2385b55700 1 --2- 172.21.15.38:0/2349886108 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2368004930 0x7f2368004db0 secure :-1 s=THROTTLE_DONE pgs=378 cs=0 l=1 rx=0x7f237c0010d0 tx=0x7f237c0019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.899+0000 7f236ffff700 1 -- 172.21.15.38:0/2349886108 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237c011ce0 con 0x7f2368004930 2020-06-12T17:49:02.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.899+0000 7f236ffff700 1 -- 172.21.15.38:0/2349886108 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f237c0066d0 con 0x7f2368004930 2020-06-12T17:49:02.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.899+0000 7f23875b8700 1 -- 172.21.15.38:0/2349886108 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2368004930 msgr2=0x7f2368004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:02.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.899+0000 7f23875b8700 1 --2- 172.21.15.38:0/2349886108 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2368004930 0x7f2368004db0 secure :-1 s=READY pgs=378 cs=0 l=1 rx=0x7f237c0010d0 tx=0x7f237c0019a0).stop 2020-06-12T17:49:02.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.899+0000 7f2385b55700 1 -- 172.21.15.38:0/2349886108 reap_dead start 2020-06-12T17:49:02.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.899+0000 7f23875b8700 1 -- 172.21.15.38:0/2349886108 shutdown_connections 2020-06-12T17:49:02.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.899+0000 7f23875b8700 1 -- 172.21.15.38:0/2349886108 >> 172.21.15.38:0/2349886108 conn(0x7f23800ba630 msgr2=0x7f23800baa40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:02.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.899+0000 7f23875b8700 1 -- 172.21.15.38:0/2349886108 shutdown_connections 2020-06-12T17:49:02.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.899+0000 7f23875b8700 1 -- 172.21.15.38:0/2349886108 wait complete. 2020-06-12T17:49:02.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.900+0000 7f23875b8700 1 Processor -- start 2020-06-12T17:49:02.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.900+0000 7f23875b8700 1 -- start start 2020-06-12T17:49:02.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.901+0000 7f23875b8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f23800602a0 0x7f23801540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:02.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.901+0000 7f23875b8700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2380157390 0x7f238009fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:02.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.901+0000 7f23875b8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23800a0080 0x7f2380143430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:02.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.901+0000 7f23875b8700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2380153430 con 0x7f2380157390 2020-06-12T17:49:02.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.901+0000 7f23875b8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23801536d0 con 0x7f23800602a0 2020-06-12T17:49:02.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.901+0000 7f23875b8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2380153970 con 0x7f23800a0080 2020-06-12T17:49:02.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.901+0000 7f2384b53700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2380157390 0x7f238009fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:02.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.901+0000 7f2384b53700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2380157390 0x7f238009fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37146/0 (socket says 172.21.15.38:37146) 2020-06-12T17:49:02.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.901+0000 7f2384b53700 1 -- 172.21.15.38:0/2530805486 learned_addr learned my addr 172.21.15.38:0/2530805486 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:02.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.901+0000 7f2385354700 1 --2- 172.21.15.38:0/2530805486 >> v2:172.21.15.150:3300/0 conn(0x7f23800602a0 0x7f23801540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:02.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.901+0000 7f2385b55700 1 --2- 172.21.15.38:0/2530805486 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23800a0080 0x7f2380143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:02.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.901+0000 7f2384b53700 1 -- 172.21.15.38:0/2530805486 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23800a0080 msgr2=0x7f2380143430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:02.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.901+0000 7f2384b53700 1 --2- 172.21.15.38:0/2530805486 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23800a0080 0x7f2380143430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:02.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.901+0000 7f2384b53700 1 -- 172.21.15.38:0/2530805486 >> v2:172.21.15.150:3300/0 conn(0x7f23800602a0 msgr2=0x7f23801540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:02.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.901+0000 7f2384b53700 1 --2- 172.21.15.38:0/2530805486 >> v2:172.21.15.150:3300/0 conn(0x7f23800602a0 0x7f23801540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:02.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.901+0000 7f2384b53700 1 -- 172.21.15.38:0/2530805486 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2380153c10 con 0x7f2380157390 2020-06-12T17:49:02.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.901+0000 7f2385354700 1 --2- 172.21.15.38:0/2530805486 >> v2:172.21.15.150:3300/0 conn(0x7f23800602a0 0x7f23801540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:49:02.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.901+0000 7f2385b55700 1 --2- 172.21.15.38:0/2530805486 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23800a0080 0x7f2380143430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:49:02.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.901+0000 7f2384b53700 1 --2- 172.21.15.38:0/2530805486 >> v2:172.21.15.38:3300/0 conn(0x7f2380157390 0x7f238009fc20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2370002f30 tx=0x7f2370007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.901+0000 7f2384b53700 1 --2- 172.21.15.38:0/2530805486 >> v2:172.21.15.38:3300/0 conn(0x7f2380157390 0x7f238009fc20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2370002f30 tx=0x7f2370007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.901+0000 7f2384b53700 1 --2- 172.21.15.38:0/2530805486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2380157390 0x7f238009fc20 secure :-1 s=READY pgs=379 cs=0 l=1 rx=0x7f2370002f30 tx=0x7f2370007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:02.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.902+0000 7f2384b53700 1 --2- 172.21.15.38:0/2530805486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2380157390 0x7f238009fc20 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f2370002f30 tx=0x7f2370007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.902+0000 7f2384b53700 1 --2- 172.21.15.38:0/2530805486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2380157390 0x7f238009fc20 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f2370002f30 tx=0x7f2370007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.902+0000 7f236e7fc700 1 -- 172.21.15.38:0/2530805486 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2370005e90 con 0x7f2380157390 2020-06-12T17:49:02.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.902+0000 7f2384b53700 1 --2- 172.21.15.38:0/2530805486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2380157390 0x7f238009fc20 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f2370002f30 tx=0x7f2370007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.902+0000 7f236e7fc700 1 -- 172.21.15.38:0/2530805486 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2370007160 con 0x7f2380157390 2020-06-12T17:49:02.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.902+0000 7f23875b8700 1 -- 172.21.15.38:0/2530805486 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23800a04f0 con 0x7f2380157390 2020-06-12T17:49:02.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.902+0000 7f236e7fc700 1 -- 172.21.15.38:0/2530805486 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2370007540 con 0x7f2380157390 2020-06-12T17:49:02.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.902+0000 7f23875b8700 1 -- 172.21.15.38:0/2530805486 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2380141c10 con 0x7f2380157390 2020-06-12T17:49:02.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.902+0000 7f2384b53700 1 --2- 172.21.15.38:0/2530805486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2380157390 0x7f238009fc20 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f2370002f30 tx=0x7f2370007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.903+0000 7f236e7fc700 1 -- 172.21.15.38:0/2530805486 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f237000b250 con 0x7f2380157390 2020-06-12T17:49:02.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.903+0000 7f2384b53700 1 --2- 172.21.15.38:0/2530805486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2380157390 0x7f238009fc20 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f2370002f30 tx=0x7f2370007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.903+0000 7f23875b8700 1 -- 172.21.15.38:0/2530805486 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2380056c30 con 0x7f2380157390 2020-06-12T17:49:02.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.903+0000 7f236e7fc700 1 --2- 172.21.15.38:0/2530805486 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f236004d600 0x7f236004fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:02.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.903+0000 7f236e7fc700 1 -- 172.21.15.38:0/2530805486 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2370060f70 con 0x7f2380157390 2020-06-12T17:49:02.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.903+0000 7f2385354700 1 --2- 172.21.15.38:0/2530805486 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f236004d600 0x7f236004fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:02.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.904+0000 7f2385354700 1 --2- 172.21.15.38:0/2530805486 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f236004d600 0x7f236004fac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2378001820 tx=0x7f237800ebd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.904+0000 7f2385354700 1 --2- 172.21.15.38:0/2530805486 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f236004d600 0x7f236004fac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2378001820 tx=0x7f237800ebd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.904+0000 7f2385354700 1 --2- 172.21.15.38:0/2530805486 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f236004d600 0x7f236004fac0 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f2378001820 tx=0x7f237800ebd0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:02.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.906+0000 7f2384b53700 1 --2- 172.21.15.38:0/2530805486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2380157390 0x7f238009fc20 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f2370002f30 tx=0x7f2370007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:02.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:02.906+0000 7f236e7fc700 1 -- 172.21.15.38:0/2530805486 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f237003c6d0 con 0x7f2380157390 2020-06-12T17:49:03.061 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.057+0000 7f23875b8700 1 -- 172.21.15.38:0/2530805486 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23800a07f0 con 0x7f2380157390 2020-06-12T17:49:03.062 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.058+0000 7f2384b53700 1 --2- 172.21.15.38:0/2530805486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2380157390 0x7f238009fc20 secure :-1 s=THROTTLE_DONE pgs=379 cs=0 l=1 rx=0x7f2370002f30 tx=0x7f2370007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.063 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.058+0000 7f236e7fc700 1 -- 172.21.15.38:0/2530805486 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16332 (secure 0 0 0) 0x7f237003fcf0 con 0x7f2380157390 2020-06-12T17:49:03.063 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:49:03.063 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":33,"fsid":"8e42a2e7-b187-42c4-a73f-8f812ee62352","created":"2020-06-12T17:47:54.434340+0000","modified":"2020-06-12T17:49:02.759335+0000","last_up_change":"2020-06-12T17:48:03.388718+0000","last_in_change":"2020-06-12T17:48:03.388718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-06-12T17:47:57.558119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-06-12T17:48:07.419264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2020-06-12T17:49:00.516131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2020-06-12T17:49:01.711699+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"44ac3dea-67b4-4b9a-bc18-ac511710afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":31038},{"type":"v1","addr":"172.21.15.38:6816","nonce":31038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":31038},{"type":"v1","addr":"172.21.15.38:6819","nonce":31038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":31038},{"type":"v1","addr":"172.21.15.38:6823","nonce":31038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":31038},{"type":"v1","addr":"172.21.15.38:6821","nonce":31038}]},"public_addr":"172.21.15.38:6816/31038","cluster_addr":"172.21.15.38:6819/31038","heartbeat_back_addr":"172.21.15.38:6823/31038","heartbeat_front_addr":"172.21.15.38:6821/31038","state":["exists","up"]},{"osd":1,"uuid":"561f7ced-3fff-4364-8619-6e4ecbc9d256","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":31036},{"type":"v1","addr":"172.21.15.38:6801","nonce":31036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":31036},{"type":"v1","addr":"172.21.15.38:6803","nonce":31036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":31036},{"type":"v1","addr":"172.21.15.38:6807","nonce":31036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":31036},{"type":"v1","addr":"172.21.15.38:6805","nonce":31036}]},"public_addr":"172.21.15.38:6801/31036","cluster_addr":"172.21.15.38:6803/31036","heartbeat_back_addr":"172.21.15.38:6807/31036","heartbeat_front_addr":"172.21.15.38:6805/31036","state":["exists","up"]},{"osd":2,"uuid":"0bb3c806-07af-49f5-b492-d0e33f2de37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":31053},{"type":"v1","addr":"172.21.15.38:6825","nonce":31053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":31053},{"type":"v1","addr":"172.21.15.38:6827","nonce":31053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":31053},{"type":"v1","addr":"172.21.15.38:6831","nonce":31053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":31053},{"type":"v1","addr":"172.21.15.38:6829","nonce":31053}]},"public_addr":"172.21.15.38:6825/31053","cluster_addr":"172.21.15.38:6827/31053","heartbeat_back_addr":"172.21.15.38:6831/31053","heartbeat_front_addr":"172.21.15.38:6829/31053","state":["exists","up"]},{"osd":3,"uuid":"7f6a1e75-7b11-456e-8a4b-510b16226800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":31037},{"type":"v1","addr":"172.21.15.38:6809","nonce":31037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":31037},{"type":"v1","addr":"172.21.15.38:6811","nonce":31037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6815","nonce":31037},{"type":"v1","addr":"172.21.15.38:6817","nonce":31037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":31037},{"type":"v1","addr":"172.21.15.38:6813","nonce":31037}]},"public_addr":"172.21.15.38:6809/31037","cluster_addr":"172.21.15.38:6811/31037","heartbeat_back_addr":"172.21.15.38:6817/31037","heartbeat_front_addr":"172.21.15.38:6813/31037","state":["exists","up"]},{"osd":4,"uuid":"0eca0272-8cfd-469c-a32d-e29730dc0e1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":31294},{"type":"v1","addr":"172.21.15.150:6803","nonce":31294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":31294},{"type":"v1","addr":"172.21.15.150:6805","nonce":31294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":31294},{"type":"v1","addr":"172.21.15.150:6809","nonce":31294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":31294},{"type":"v1","addr":"172.21.15.150:6807","nonce":31294}]},"public_addr":"172.21.15.150:6803/31294","cluster_addr":"172.21.15.150:6805/31294","heartbeat_back_addr":"172.21.15.150:6809/31294","heartbeat_front_addr":"172.21.15.150:6807/31294","state":["exists","up"]},{"osd":5,"uuid":"69d6a7dc-a55a-4ebc-8479-8bb921ddfb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":31295},{"type":"v1","addr":"172.21.15.150:6813","nonce":31295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":31295},{"type":"v1","addr":"172.21.15.150:6816","nonce":31295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":31295},{"type":"v1","addr":"172.21.15.150:6828","nonce":31295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6819","nonce":31295},{"type":"v1","addr":"172.21.15.150:6822","nonce":31295}]},"public_addr":"172.21.15.150:6813/31295","cluster_addr":"172.21.15.150:6816/31295","heartbeat_back_addr":"172.21.15.150:6828/31295","heartbeat_front_addr":"172.21.15.150:6822/31295","state":["exists","up"]},{"osd":6,"uuid":"f0d320f8-c2f0-40bb-b713-526246cf97b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":31297},{"type":"v1","addr":"172.21.15.150:6820","nonce":31297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6823","nonce":31297},{"type":"v1","addr":"172.21.15.150:6827","nonce":31297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":31297},{"type":"v1","addr":"172.21.15.150:6833","nonce":31297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":31297},{"type":"v1","addr":"172.21.15.150:6831","nonce":31297}]},"public_addr":"172.21.15.150:6820/31297","cluster_addr":"172.21.15.150:6827/31297","heartbeat_back_addr":"172.21.15.150:6833/31297","heartbeat_front_addr":"172.21.15.150:6831/31297","state":["exists","up"]},{"osd":7,"uuid":"970b7d02-a189-41b2-96e5-a5a5a57c6476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":31296},{"type":"v1","addr":"172.21.15.150:6812","nonce":31296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":31296},{"type":"v1","addr":"172.21.15.150:6818","nonce":31296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":31296},{"type":"v1","addr":"172.21.15.150:6829","nonce":31296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":31296},{"type":"v1","addr":"172.21.15.150:6824","nonce":31296}]},"public_addr":"172.21.15.150:6812/31296","cluster_addr":"172.21.15.150:6818/31296","heartbeat_back_addr":"172.21.15.150:6829/31296","heartbeat_front_addr":"172.21.15.150:6824/31296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.664300+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.644253+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.651120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.584978+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.561149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.661778+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T17:49:03.065 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.059+0000 7f23875b8700 1 -- 172.21.15.38:0/2530805486 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f236004d600 msgr2=0x7f236004fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:03.065 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.059+0000 7f23875b8700 1 --2- 172.21.15.38:0/2530805486 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f236004d600 0x7f236004fac0 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f2378001820 tx=0x7f237800ebd0).stop 2020-06-12T17:49:03.065 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.059+0000 7f23875b8700 1 -- 172.21.15.38:0/2530805486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2380157390 msgr2=0x7f238009fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:03.065 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.059+0000 7f23875b8700 1 --2- 172.21.15.38:0/2530805486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2380157390 0x7f238009fc20 secure :-1 s=READY pgs=379 cs=0 l=1 rx=0x7f2370002f30 tx=0x7f2370007e60).stop 2020-06-12T17:49:03.065 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.059+0000 7f23875b8700 1 -- 172.21.15.38:0/2530805486 shutdown_connections 2020-06-12T17:49:03.066 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.059+0000 7f23875b8700 1 --2- 172.21.15.38:0/2530805486 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f236004d600 0x7f236004fac0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:03.066 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.059+0000 7f23875b8700 1 --2- 172.21.15.38:0/2530805486 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23800a0080 0x7f2380143430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:03.066 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.059+0000 7f23875b8700 1 --2- 172.21.15.38:0/2530805486 >> v2:172.21.15.150:3300/0 conn(0x7f23800602a0 0x7f23801540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:03.066 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.059+0000 7f23875b8700 1 --2- 172.21.15.38:0/2530805486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2380157390 0x7f238009fc20 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:03.067 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.059+0000 7f23875b8700 1 -- 172.21.15.38:0/2530805486 >> 172.21.15.38:0/2530805486 conn(0x7f23800ba630 msgr2=0x7f2380140b00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:03.067 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.059+0000 7f23875b8700 1 -- 172.21.15.38:0/2530805486 shutdown_connections 2020-06-12T17:49:03.067 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.059+0000 7f23875b8700 1 -- 172.21.15.38:0/2530805486 wait complete. 2020-06-12T17:49:03.074 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-12T17:49:03.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.184+0000 7f061e250700 1 Processor -- start 2020-06-12T17:49:03.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.184+0000 7f061e250700 1 -- start start 2020-06-12T17:49:03.192 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.185+0000 7f061e250700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0618061a80 0x7f06180b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:03.192 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.185+0000 7f061e250700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f06180b41f0 0x7f061809df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:03.192 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.185+0000 7f061e250700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f061809e3b0 0x7f06181456d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:03.193 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.185+0000 7f061e250700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06180b4750 con 0x7f06180b41f0 2020-06-12T17:49:03.193 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.185+0000 7f061e250700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f061809d810 con 0x7f0618061a80 2020-06-12T17:49:03.193 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.185+0000 7f061e250700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061809dab0 con 0x7f061809e3b0 2020-06-12T17:49:03.193 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.185+0000 7f0616ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f06180b41f0 0x7f061809df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:03.193 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.185+0000 7f0616ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f06180b41f0 0x7f061809df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37152/0 (socket says 172.21.15.38:37152) 2020-06-12T17:49:03.194 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.185+0000 7f0616ffd700 1 -- 172.21.15.38:0/1579556438 learned_addr learned my addr 172.21.15.38:0/1579556438 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:03.194 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.186+0000 7f0617fff700 1 --2- 172.21.15.38:0/1579556438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f061809e3b0 0x7f06181456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:03.194 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.186+0000 7f06177fe700 1 --2- 172.21.15.38:0/1579556438 >> v2:172.21.15.150:3300/0 conn(0x7f0618061a80 0x7f06180b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:03.194 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.186+0000 7f0616ffd700 1 -- 172.21.15.38:0/1579556438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f061809e3b0 msgr2=0x7f06181456d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:03.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.186+0000 7f0616ffd700 1 --2- 172.21.15.38:0/1579556438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f061809e3b0 0x7f06181456d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:03.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.186+0000 7f0616ffd700 1 -- 172.21.15.38:0/1579556438 >> v2:172.21.15.150:3300/0 conn(0x7f0618061a80 msgr2=0x7f06180b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:03.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.186+0000 7f0616ffd700 1 --2- 172.21.15.38:0/1579556438 >> v2:172.21.15.150:3300/0 conn(0x7f0618061a80 0x7f06180b38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:03.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.186+0000 7f0616ffd700 1 -- 172.21.15.38:0/1579556438 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0618061e60 con 0x7f06180b41f0 2020-06-12T17:49:03.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.186+0000 7f0616ffd700 1 --2- 172.21.15.38:0/1579556438 >> v2:172.21.15.38:3300/0 conn(0x7f06180b41f0 0x7f061809df50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f060c002f30 tx=0x7f060c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.186+0000 7f0616ffd700 1 --2- 172.21.15.38:0/1579556438 >> v2:172.21.15.38:3300/0 conn(0x7f06180b41f0 0x7f061809df50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f060c002f30 tx=0x7f060c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.186+0000 7f0616ffd700 1 --2- 172.21.15.38:0/1579556438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06180b41f0 0x7f061809df50 secure :-1 s=READY pgs=380 cs=0 l=1 rx=0x7f060c002f30 tx=0x7f060c007e60).ready entity=mon.0 client_cookie=f6380ec75bc82add server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:03.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.186+0000 7f0616ffd700 1 --2- 172.21.15.38:0/1579556438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06180b41f0 0x7f061809df50 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f060c002f30 tx=0x7f060c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.186+0000 7f06167fc700 1 -- 172.21.15.38:0/1579556438 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f060c0116e0 con 0x7f06180b41f0 2020-06-12T17:49:03.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.186+0000 7f0616ffd700 1 --2- 172.21.15.38:0/1579556438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06180b41f0 0x7f061809df50 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f060c002f30 tx=0x7f060c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.186+0000 7f0616ffd700 1 --2- 172.21.15.38:0/1579556438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06180b41f0 0x7f061809df50 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f060c002f30 tx=0x7f060c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.186+0000 7f06167fc700 1 -- 172.21.15.38:0/1579556438 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060c011840 con 0x7f06180b41f0 2020-06-12T17:49:03.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.186+0000 7f06167fc700 1 -- 172.21.15.38:0/1579556438 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f060c011c20 con 0x7f06180b41f0 2020-06-12T17:49:03.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.186+0000 7f061e250700 1 -- 172.21.15.38:0/1579556438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06180b41f0 msgr2=0x7f061809df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:03.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.186+0000 7f061e250700 1 --2- 172.21.15.38:0/1579556438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06180b41f0 0x7f061809df50 secure :-1 s=READY pgs=380 cs=0 l=1 rx=0x7f060c002f30 tx=0x7f060c007e60).stop 2020-06-12T17:49:03.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.186+0000 7f061e250700 1 -- 172.21.15.38:0/1579556438 shutdown_connections 2020-06-12T17:49:03.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.186+0000 7f061e250700 1 --2- 172.21.15.38:0/1579556438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f061809e3b0 0x7f06181456d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:03.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.186+0000 7f061e250700 1 --2- 172.21.15.38:0/1579556438 >> v2:172.21.15.150:3300/0 conn(0x7f0618061a80 0x7f06180b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:03.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.186+0000 7f061e250700 1 --2- 172.21.15.38:0/1579556438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06180b41f0 0x7f061809df50 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:03.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.186+0000 7f061e250700 1 -- 172.21.15.38:0/1579556438 >> 172.21.15.38:0/1579556438 conn(0x7f06180b8420 msgr2=0x7f06180b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:03.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.187+0000 7f061e250700 1 -- 172.21.15.38:0/1579556438 shutdown_connections 2020-06-12T17:49:03.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.187+0000 7f061e250700 1 -- 172.21.15.38:0/1579556438 wait complete. 2020-06-12T17:49:03.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.188+0000 7f061e250700 1 Processor -- start 2020-06-12T17:49:03.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.188+0000 7f061e250700 1 -- start start 2020-06-12T17:49:03.204 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.188+0000 7f061e250700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0618061a80 0x7f06180b2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:03.205 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.188+0000 7f061e250700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0618153900 con 0x7f06180b41f0 2020-06-12T17:49:03.205 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.188+0000 7f061e250700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0618153ba0 con 0x7f061809e3b0 2020-06-12T17:49:03.205 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.188+0000 7f061e250700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0618153e40 con 0x7f0618061a80 2020-06-12T17:49:03.205 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.189+0000 7f0617fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f06180b41f0 0x7f0618154720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38976/0 (socket says 172.21.15.38:38976) 2020-06-12T17:49:03.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.189+0000 7f0617fff700 1 -- 172.21.15.38:0/1512206034 learned_addr learned my addr 172.21.15.38:0/1512206034 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:03.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.189+0000 7f06177fe700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0618061a80 0x7f06180b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:03.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.189+0000 7f0614ff9700 1 -- 172.21.15.38:0/1512206034 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301882471 0 0) 0x7f0618153900 con 0x7f06180b41f0 2020-06-12T17:49:03.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.189+0000 7f0614ff9700 1 -- 172.21.15.38:0/1512206034 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05f8002fe0 con 0x7f06180b41f0 2020-06-12T17:49:03.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.189+0000 7f0614ff9700 1 -- 172.21.15.38:0/1512206034 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1514617701 0 0) 0x7f0618153ba0 con 0x7f061809e3b0 2020-06-12T17:49:03.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.189+0000 7f0614ff9700 1 -- 172.21.15.38:0/1512206034 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0618153900 con 0x7f061809e3b0 2020-06-12T17:49:03.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.189+0000 7f0614ff9700 1 -- 172.21.15.38:0/1512206034 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2810317185 0 0) 0x7f05f8002fe0 con 0x7f06180b41f0 2020-06-12T17:49:03.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.189+0000 7f0614ff9700 1 -- 172.21.15.38:0/1512206034 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0618153ba0 con 0x7f06180b41f0 2020-06-12T17:49:03.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.189+0000 7f0614ff9700 1 -- 172.21.15.38:0/1512206034 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f06100018d0 con 0x7f06180b41f0 2020-06-12T17:49:03.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.189+0000 7f0614ff9700 1 -- 172.21.15.38:0/1512206034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0618061a80 msgr2=0x7f06180b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:03.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.189+0000 7f0614ff9700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0618061a80 0x7f06180b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:03.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.189+0000 7f0614ff9700 1 -- 172.21.15.38:0/1512206034 >> v1:172.21.15.150:6789/0 conn(0x7f061809e3b0 legacy=0x7f061808f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:03.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.189+0000 7f0614ff9700 1 -- 172.21.15.38:0/1512206034 >> v1:172.21.15.38:6789/0 conn(0x7f06180b41f0 legacy=0x7f0618154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:03.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.189+0000 7f0614ff9700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05f8004b20 0x7f05f8004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:03.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.189+0000 7f0614ff9700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05f8003ab0 0x7f05f8003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:03.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.189+0000 7f0614ff9700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05f8004460 0x7f05f800b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:03.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.189+0000 7f0614ff9700 1 -- 172.21.15.38:0/1512206034 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0618153e40 con 0x7f05f8004b20 2020-06-12T17:49:03.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.189+0000 7f0614ff9700 1 -- 172.21.15.38:0/1512206034 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f800bbb0 con 0x7f05f8003ab0 2020-06-12T17:49:03.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.189+0000 7f0614ff9700 1 -- 172.21.15.38:0/1512206034 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f800bd70 con 0x7f05f8004460 2020-06-12T17:49:03.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.189+0000 7f06177fe700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0618061a80 0x7f06180b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:49:03.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.189+0000 7f06177fe700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05f8004b20 0x7f05f8004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:03.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.189+0000 7f0616ffd700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05f8003ab0 0x7f05f8003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:03.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.189+0000 7f0617fff700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05f8004460 0x7f05f800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:03.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.190+0000 7f06177fe700 1 -- 172.21.15.38:0/1512206034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05f8004460 msgr2=0x7f05f800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:03.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.190+0000 7f06177fe700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05f8004460 0x7f05f800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:03.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.190+0000 7f06177fe700 1 -- 172.21.15.38:0/1512206034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05f8003ab0 msgr2=0x7f05f8003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:03.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.190+0000 7f06177fe700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05f8003ab0 0x7f05f8003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:03.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.190+0000 7f06177fe700 1 -- 172.21.15.38:0/1512206034 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06181535b0 con 0x7f05f8004b20 2020-06-12T17:49:03.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.190+0000 7f061e250700 1 -- 172.21.15.38:0/1512206034 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f061808f860 con 0x7f05f8004b20 2020-06-12T17:49:03.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.190+0000 7f06177fe700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05f8004b20 0x7f05f8004f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0608002f30 tx=0x7f060800e030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.190+0000 7f061e250700 1 -- 172.21.15.38:0/1512206034 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06180b0b80 con 0x7f05f8004b20 2020-06-12T17:49:03.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.190+0000 7f06177fe700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05f8004b20 0x7f05f8004f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0608002f30 tx=0x7f060800e030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.190+0000 7f06177fe700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05f8004b20 0x7f05f8004f40 secure :-1 s=READY pgs=382 cs=0 l=1 rx=0x7f0608002f30 tx=0x7f060800e030).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:03.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.190+0000 7f06177fe700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05f8004b20 0x7f05f8004f40 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7f0608002f30 tx=0x7f060800e030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.190+0000 7f0614ff9700 1 -- 172.21.15.38:0/1512206034 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0608007560 con 0x7f05f8004b20 2020-06-12T17:49:03.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.190+0000 7f06177fe700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05f8004b20 0x7f05f8004f40 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7f0608002f30 tx=0x7f060800e030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.190+0000 7f0614ff9700 1 -- 172.21.15.38:0/1512206034 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06080056c0 con 0x7f05f8004b20 2020-06-12T17:49:03.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.190+0000 7f06177fe700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05f8004b20 0x7f05f8004f40 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7f0608002f30 tx=0x7f060800e030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.190+0000 7f0614ff9700 1 -- 172.21.15.38:0/1512206034 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0608005a60 con 0x7f05f8004b20 2020-06-12T17:49:03.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.190+0000 7f06177fe700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05f8004b20 0x7f05f8004f40 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7f0608002f30 tx=0x7f060800e030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.191+0000 7f061e250700 1 -- 172.21.15.38:0/1512206034 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f4003340 con 0x7f05f8004b20 2020-06-12T17:49:03.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.191+0000 7f0614ff9700 1 -- 172.21.15.38:0/1512206034 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f0608005bc0 con 0x7f05f8004b20 2020-06-12T17:49:03.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.191+0000 7f06177fe700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05f8004b20 0x7f05f8004f40 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7f0608002f30 tx=0x7f060800e030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.191+0000 7f0614ff9700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f05f80560b0 0x7f05f8058570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:03.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.191+0000 7f0614ff9700 1 -- 172.21.15.38:0/1512206034 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f060800f070 con 0x7f05f8004b20 2020-06-12T17:49:03.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.191+0000 7f0616ffd700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f05f80560b0 0x7f05f8058570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:03.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.191+0000 7f0616ffd700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f05f80560b0 0x7f05f8058570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f060c007ed0 tx=0x7f060c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.192+0000 7f0616ffd700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f05f80560b0 0x7f05f8058570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f060c007ed0 tx=0x7f060c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.192+0000 7f0616ffd700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f05f80560b0 0x7f05f8058570 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f060c007ed0 tx=0x7f060c007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:03.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.194+0000 7f06177fe700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05f8004b20 0x7f05f8004f40 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7f0608002f30 tx=0x7f060800e030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.195+0000 7f0614ff9700 1 -- 172.21.15.38:0/1512206034 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f060803c430 con 0x7f05f8004b20 2020-06-12T17:49:03.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.346+0000 7f061e250700 1 -- 172.21.15.38:0/1512206034 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05f40021d0 con 0x7f05f8004b20 2020-06-12T17:49:03.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.347+0000 7f06177fe700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05f8004b20 0x7f05f8004f40 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7f0608002f30 tx=0x7f060800e030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.347+0000 7f0614ff9700 1 -- 172.21.15.38:0/1512206034 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16332 (secure 0 0 0) 0x7f060803fa50 con 0x7f05f8004b20 2020-06-12T17:49:03.352 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:49:03.352 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":33,"fsid":"8e42a2e7-b187-42c4-a73f-8f812ee62352","created":"2020-06-12T17:47:54.434340+0000","modified":"2020-06-12T17:49:02.759335+0000","last_up_change":"2020-06-12T17:48:03.388718+0000","last_in_change":"2020-06-12T17:48:03.388718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-06-12T17:47:57.558119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-06-12T17:48:07.419264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2020-06-12T17:49:00.516131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2020-06-12T17:49:01.711699+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"44ac3dea-67b4-4b9a-bc18-ac511710afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":31038},{"type":"v1","addr":"172.21.15.38:6816","nonce":31038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":31038},{"type":"v1","addr":"172.21.15.38:6819","nonce":31038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":31038},{"type":"v1","addr":"172.21.15.38:6823","nonce":31038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":31038},{"type":"v1","addr":"172.21.15.38:6821","nonce":31038}]},"public_addr":"172.21.15.38:6816/31038","cluster_addr":"172.21.15.38:6819/31038","heartbeat_back_addr":"172.21.15.38:6823/31038","heartbeat_front_addr":"172.21.15.38:6821/31038","state":["exists","up"]},{"osd":1,"uuid":"561f7ced-3fff-4364-8619-6e4ecbc9d256","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":31036},{"type":"v1","addr":"172.21.15.38:6801","nonce":31036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":31036},{"type":"v1","addr":"172.21.15.38:6803","nonce":31036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":31036},{"type":"v1","addr":"172.21.15.38:6807","nonce":31036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":31036},{"type":"v1","addr":"172.21.15.38:6805","nonce":31036}]},"public_addr":"172.21.15.38:6801/31036","cluster_addr":"172.21.15.38:6803/31036","heartbeat_back_addr":"172.21.15.38:6807/31036","heartbeat_front_addr":"172.21.15.38:6805/31036","state":["exists","up"]},{"osd":2,"uuid":"0bb3c806-07af-49f5-b492-d0e33f2de37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":31053},{"type":"v1","addr":"172.21.15.38:6825","nonce":31053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":31053},{"type":"v1","addr":"172.21.15.38:6827","nonce":31053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":31053},{"type":"v1","addr":"172.21.15.38:6831","nonce":31053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":31053},{"type":"v1","addr":"172.21.15.38:6829","nonce":31053}]},"public_addr":"172.21.15.38:6825/31053","cluster_addr":"172.21.15.38:6827/31053","heartbeat_back_addr":"172.21.15.38:6831/31053","heartbeat_front_addr":"172.21.15.38:6829/31053","state":["exists","up"]},{"osd":3,"uuid":"7f6a1e75-7b11-456e-8a4b-510b16226800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":31037},{"type":"v1","addr":"172.21.15.38:6809","nonce":31037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":31037},{"type":"v1","addr":"172.21.15.38:6811","nonce":31037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6815","nonce":31037},{"type":"v1","addr":"172.21.15.38:6817","nonce":31037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":31037},{"type":"v1","addr":"172.21.15.38:6813","nonce":31037}]},"public_addr":"172.21.15.38:6809/31037","cluster_addr":"172.21.15.38:6811/31037","heartbeat_back_addr":"172.21.15.38:6817/31037","heartbeat_front_addr":"172.21.15.38:6813/31037","state":["exists","up"]},{"osd":4,"uuid":"0eca0272-8cfd-469c-a32d-e29730dc0e1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":31294},{"type":"v1","addr":"172.21.15.150:6803","nonce":31294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":31294},{"type":"v1","addr":"172.21.15.150:6805","nonce":31294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":31294},{"type":"v1","addr":"172.21.15.150:6809","nonce":31294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":31294},{"type":"v1","addr":"172.21.15.150:6807","nonce":31294}]},"public_addr":"172.21.15.150:6803/31294","cluster_addr":"172.21.15.150:6805/31294","heartbeat_back_addr":"172.21.15.150:6809/31294","heartbeat_front_addr":"172.21.15.150:6807/31294","state":["exists","up"]},{"osd":5,"uuid":"69d6a7dc-a55a-4ebc-8479-8bb921ddfb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":31295},{"type":"v1","addr":"172.21.15.150:6813","nonce":31295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":31295},{"type":"v1","addr":"172.21.15.150:6816","nonce":31295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":31295},{"type":"v1","addr":"172.21.15.150:6828","nonce":31295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6819","nonce":31295},{"type":"v1","addr":"172.21.15.150:6822","nonce":31295}]},"public_addr":"172.21.15.150:6813/31295","cluster_addr":"172.21.15.150:6816/31295","heartbeat_back_addr":"172.21.15.150:6828/31295","heartbeat_front_addr":"172.21.15.150:6822/31295","state":["exists","up"]},{"osd":6,"uuid":"f0d320f8-c2f0-40bb-b713-526246cf97b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":31297},{"type":"v1","addr":"172.21.15.150:6820","nonce":31297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6823","nonce":31297},{"type":"v1","addr":"172.21.15.150:6827","nonce":31297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":31297},{"type":"v1","addr":"172.21.15.150:6833","nonce":31297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":31297},{"type":"v1","addr":"172.21.15.150:6831","nonce":31297}]},"public_addr":"172.21.15.150:6820/31297","cluster_addr":"172.21.15.150:6827/31297","heartbeat_back_addr":"172.21.15.150:6833/31297","heartbeat_front_addr":"172.21.15.150:6831/31297","state":["exists","up"]},{"osd":7,"uuid":"970b7d02-a189-41b2-96e5-a5a5a57c6476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":31296},{"type":"v1","addr":"172.21.15.150:6812","nonce":31296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":31296},{"type":"v1","addr":"172.21.15.150:6818","nonce":31296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":31296},{"type":"v1","addr":"172.21.15.150:6829","nonce":31296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":31296},{"type":"v1","addr":"172.21.15.150:6824","nonce":31296}]},"public_addr":"172.21.15.150:6812/31296","cluster_addr":"172.21.15.150:6818/31296","heartbeat_back_addr":"172.21.15.150:6829/31296","heartbeat_front_addr":"172.21.15.150:6824/31296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.664300+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.644253+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.651120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.584978+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.561149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.661778+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T17:49:03.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.348+0000 7f061e250700 1 -- 172.21.15.38:0/1512206034 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f05f80560b0 msgr2=0x7f05f8058570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:03.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.348+0000 7f061e250700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f05f80560b0 0x7f05f8058570 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f060c007ed0 tx=0x7f060c007e60).stop 2020-06-12T17:49:03.354 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.348+0000 7f061e250700 1 -- 172.21.15.38:0/1512206034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05f8004b20 msgr2=0x7f05f8004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:03.354 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.348+0000 7f061e250700 1 --2- 172.21.15.38:0/1512206034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f05f8004b20 0x7f05f8004f40 secure :-1 s=READY pgs=382 cs=0 l=1 rx=0x7f0608002f30 tx=0x7f060800e030).stop 2020-06-12T17:49:03.354 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.348+0000 7f0617fff700 1 -- 172.21.15.38:0/1512206034 reap_dead start 2020-06-12T17:49:03.354 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.348+0000 7f0617fff700 1 -- 172.21.15.38:0/1512206034 reap_dead start 2020-06-12T17:49:03.355 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.348+0000 7f061e250700 1 -- 172.21.15.38:0/1512206034 shutdown_connections 2020-06-12T17:49:03.355 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.348+0000 7f061e250700 1 -- 172.21.15.38:0/1512206034 >> 172.21.15.38:0/1512206034 conn(0x7f06180b8420 msgr2=0x7f0618144a30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:03.355 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.348+0000 7f061e250700 1 -- 172.21.15.38:0/1512206034 shutdown_connections 2020-06-12T17:49:03.355 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.348+0000 7f061e250700 1 -- 172.21.15.38:0/1512206034 wait complete. 2020-06-12T17:49:03.363 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-06-12T17:49:03.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.477+0000 7f6861a3e700 1 Processor -- start 2020-06-12T17:49:03.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.477+0000 7f6861a3e700 1 -- start start 2020-06-12T17:49:03.484 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.478+0000 7f6861a3e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f685c146680 0x7f685c0ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:03.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.478+0000 7f6861a3e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f685c0b2eb0 0x7f685c09d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:03.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.478+0000 7f6861a3e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685c146d20 con 0x7f685c09d620 2020-06-12T17:49:03.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.478+0000 7f6861a3e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f685c066a80 con 0x7f685c146680 2020-06-12T17:49:03.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.478+0000 7f6861a3e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685c146f50 con 0x7f685c0b2eb0 2020-06-12T17:49:03.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.478+0000 7f685a7fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f685c0b2eb0 0x7f685c09d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:03.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.478+0000 7f685affd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f685c146680 0x7f685c0ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:03.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.478+0000 7f685a7fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f685c0b2eb0 0x7f685c09d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:56632/0 (socket says 172.21.15.38:56632) 2020-06-12T17:49:03.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.478+0000 7f685b7fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f685c09d620 0x7f685c09b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:59718/0 (socket says 172.21.15.38:59718) 2020-06-12T17:49:03.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.478+0000 7f685a7fc700 1 -- 172.21.15.38:0/2456720275 learned_addr learned my addr 172.21.15.38:0/2456720275 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:03.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.479+0000 7f685a7fc700 1 -- 172.21.15.38:0/2456720275 >> v2:172.21.15.150:3300/0 conn(0x7f685c146680 msgr2=0x7f685c0ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:03.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.479+0000 7f685a7fc700 1 --2- 172.21.15.38:0/2456720275 >> v2:172.21.15.150:3300/0 conn(0x7f685c146680 0x7f685c0ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:03.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.479+0000 7f685a7fc700 1 -- 172.21.15.38:0/2456720275 >> v1:172.21.15.150:6789/0 conn(0x7f685c09d620 legacy=0x7f685c09b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:03.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.479+0000 7f685a7fc700 1 -- 172.21.15.38:0/2456720275 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c146a60 con 0x7f685c0b2eb0 2020-06-12T17:49:03.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.479+0000 7f6859ffb700 1 -- 172.21.15.38:0/2456720275 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1486555770 0 0) 0x7f685c146d20 con 0x7f685c09d620 2020-06-12T17:49:03.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.479+0000 7f685affd700 1 --2- 172.21.15.38:0/2456720275 >> v2:172.21.15.150:3300/0 conn(0x7f685c146680 0x7f685c0ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:49:03.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.479+0000 7f685a7fc700 1 --2- 172.21.15.38:0/2456720275 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f685c0b2eb0 0x7f685c09d1c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6844002f30 tx=0x7f6844007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.479+0000 7f685a7fc700 1 --2- 172.21.15.38:0/2456720275 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f685c0b2eb0 0x7f685c09d1c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6844002f30 tx=0x7f6844007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.479+0000 7f685a7fc700 1 --2- 172.21.15.38:0/2456720275 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f685c0b2eb0 0x7f685c09d1c0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f6844002f30 tx=0x7f6844007e60).ready entity=mon.2 client_cookie=f40238daabc00b16 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:03.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.479+0000 7f685a7fc700 1 --2- 172.21.15.38:0/2456720275 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f685c0b2eb0 0x7f685c09d1c0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f6844002f30 tx=0x7f6844007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.479+0000 7f6859ffb700 1 -- 172.21.15.38:0/2456720275 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6844011630 con 0x7f685c0b2eb0 2020-06-12T17:49:03.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.479+0000 7f685a7fc700 1 --2- 172.21.15.38:0/2456720275 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f685c0b2eb0 0x7f685c09d1c0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f6844002f30 tx=0x7f6844007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.479+0000 7f6859ffb700 1 -- 172.21.15.38:0/2456720275 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6844011790 con 0x7f685c0b2eb0 2020-06-12T17:49:03.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.479+0000 7f685a7fc700 1 --2- 172.21.15.38:0/2456720275 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f685c0b2eb0 0x7f685c09d1c0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f6844002f30 tx=0x7f6844007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.479+0000 7f6859ffb700 1 -- 172.21.15.38:0/2456720275 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6844011b70 con 0x7f685c0b2eb0 2020-06-12T17:49:03.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.479+0000 7f6861a3e700 1 -- 172.21.15.38:0/2456720275 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f685c0b2eb0 msgr2=0x7f685c09d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:03.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.479+0000 7f6861a3e700 1 --2- 172.21.15.38:0/2456720275 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f685c0b2eb0 0x7f685c09d1c0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f6844002f30 tx=0x7f6844007e60).stop 2020-06-12T17:49:03.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.480+0000 7f6861a3e700 1 -- 172.21.15.38:0/2456720275 shutdown_connections 2020-06-12T17:49:03.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.480+0000 7f6861a3e700 1 --2- 172.21.15.38:0/2456720275 >> v2:172.21.15.150:3300/0 conn(0x7f685c146680 0x7f685c0ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:03.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.480+0000 7f6861a3e700 1 --2- 172.21.15.38:0/2456720275 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f685c0b2eb0 0x7f685c09d1c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:03.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.480+0000 7f6861a3e700 1 -- 172.21.15.38:0/2456720275 >> 172.21.15.38:0/2456720275 conn(0x7f685c0b5a20 msgr2=0x7f685c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:03.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.480+0000 7f6861a3e700 1 -- 172.21.15.38:0/2456720275 shutdown_connections 2020-06-12T17:49:03.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.480+0000 7f6861a3e700 1 -- 172.21.15.38:0/2456720275 wait complete. 2020-06-12T17:49:03.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.481+0000 7f6861a3e700 1 Processor -- start 2020-06-12T17:49:03.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.481+0000 7f6861a3e700 1 -- start start 2020-06-12T17:49:03.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.481+0000 7f6861a3e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f685c0b2eb0 0x7f685c0b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:03.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.481+0000 7f6861a3e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f685c146680 0x7f685c065ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:03.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.481+0000 7f6861a3e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685c0645c0 con 0x7f685c09d620 2020-06-12T17:49:03.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.481+0000 7f6861a3e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f685c0643e0 con 0x7f685c0b2eb0 2020-06-12T17:49:03.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.481+0000 7f6861a3e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685c0b2040 con 0x7f685c146680 2020-06-12T17:49:03.495 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.482+0000 7f685a7fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f685c0b2eb0 0x7f685c0b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:03.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.482+0000 7f685affd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f685c09d620 0x7f685c063730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38992/0 (socket says 172.21.15.38:38992) 2020-06-12T17:49:03.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.482+0000 7f685a7fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f685c0b2eb0 0x7f685c0b24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37178/0 (socket says 172.21.15.38:37178) 2020-06-12T17:49:03.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.482+0000 7f685affd700 1 -- 172.21.15.38:0/908890231 learned_addr learned my addr 172.21.15.38:0/908890231 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:03.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.482+0000 7f685b7fe700 1 --2- 172.21.15.38:0/908890231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f685c146680 0x7f685c065ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:03.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.482+0000 7f685a7fc700 1 -- 172.21.15.38:0/908890231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f685c146680 msgr2=0x7f685c065ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:03.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.482+0000 7f685a7fc700 1 --2- 172.21.15.38:0/908890231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f685c146680 0x7f685c065ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:03.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.482+0000 7f6853fff700 1 -- 172.21.15.38:0/908890231 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910113845 0 0) 0x7f685c0645c0 con 0x7f685c09d620 2020-06-12T17:49:03.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.482+0000 7f685a7fc700 1 -- 172.21.15.38:0/908890231 >> v1:172.21.15.38:6789/0 conn(0x7f685c09d620 legacy=0x7f685c063730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:03.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.482+0000 7f685a7fc700 1 -- 172.21.15.38:0/908890231 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c061a90 con 0x7f685c0b2eb0 2020-06-12T17:49:03.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.482+0000 7f685a7fc700 1 --2- 172.21.15.38:0/908890231 >> v2:172.21.15.38:3300/0 conn(0x7f685c0b2eb0 0x7f685c0b24e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6844002f30 tx=0x7f6844007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.482+0000 7f685a7fc700 1 --2- 172.21.15.38:0/908890231 >> v2:172.21.15.38:3300/0 conn(0x7f685c0b2eb0 0x7f685c0b24e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6844002f30 tx=0x7f6844007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.482+0000 7f685a7fc700 1 --2- 172.21.15.38:0/908890231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f685c0b2eb0 0x7f685c0b24e0 secure :-1 s=READY pgs=384 cs=0 l=1 rx=0x7f6844002f30 tx=0x7f6844007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:03.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.482+0000 7f685a7fc700 1 --2- 172.21.15.38:0/908890231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f685c0b2eb0 0x7f685c0b24e0 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7f6844002f30 tx=0x7f6844007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.482+0000 7f6853fff700 1 -- 172.21.15.38:0/908890231 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6844011a40 con 0x7f685c0b2eb0 2020-06-12T17:49:03.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.482+0000 7f685a7fc700 1 --2- 172.21.15.38:0/908890231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f685c0b2eb0 0x7f685c0b24e0 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7f6844002f30 tx=0x7f6844007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.482+0000 7f6861a3e700 1 -- 172.21.15.38:0/908890231 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f685c061e80 con 0x7f685c0b2eb0 2020-06-12T17:49:03.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.482+0000 7f685a7fc700 1 --2- 172.21.15.38:0/908890231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f685c0b2eb0 0x7f685c0b24e0 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7f6844002f30 tx=0x7f6844007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.482+0000 7f6853fff700 1 -- 172.21.15.38:0/908890231 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6844011ba0 con 0x7f685c0b2eb0 2020-06-12T17:49:03.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.482+0000 7f6853fff700 1 -- 172.21.15.38:0/908890231 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6844007340 con 0x7f685c0b2eb0 2020-06-12T17:49:03.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.482+0000 7f6861a3e700 1 -- 172.21.15.38:0/908890231 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f685c064080 con 0x7f685c0b2eb0 2020-06-12T17:49:03.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.483+0000 7f685a7fc700 1 --2- 172.21.15.38:0/908890231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f685c0b2eb0 0x7f685c0b24e0 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7f6844002f30 tx=0x7f6844007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.483+0000 7f6861a3e700 1 -- 172.21.15.38:0/908890231 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f685c067b20 con 0x7f685c0b2eb0 2020-06-12T17:49:03.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.483+0000 7f6853fff700 1 -- 172.21.15.38:0/908890231 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f68440056c0 con 0x7f685c0b2eb0 2020-06-12T17:49:03.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.483+0000 7f685a7fc700 1 --2- 172.21.15.38:0/908890231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f685c0b2eb0 0x7f685c0b24e0 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7f6844002f30 tx=0x7f6844007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.484+0000 7f6853fff700 1 --2- 172.21.15.38:0/908890231 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f684004d4e0 0x7f684004f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:03.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.484+0000 7f6853fff700 1 -- 172.21.15.38:0/908890231 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f6844061030 con 0x7f685c0b2eb0 2020-06-12T17:49:03.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.484+0000 7f685affd700 1 --2- 172.21.15.38:0/908890231 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f684004d4e0 0x7f684004f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:03.502 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.484+0000 7f685affd700 1 --2- 172.21.15.38:0/908890231 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f684004d4e0 0x7f684004f9a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6854007e00 tx=0x7f68540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.502 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.484+0000 7f685affd700 1 --2- 172.21.15.38:0/908890231 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f684004d4e0 0x7f684004f9a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6854007e00 tx=0x7f68540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.502 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.484+0000 7f685affd700 1 --2- 172.21.15.38:0/908890231 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f684004d4e0 0x7f684004f9a0 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7f6854007e00 tx=0x7f68540081e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:03.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.487+0000 7f685a7fc700 1 --2- 172.21.15.38:0/908890231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f685c0b2eb0 0x7f685c0b24e0 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7f6844002f30 tx=0x7f6844007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.487+0000 7f6853fff700 1 -- 172.21.15.38:0/908890231 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f684403c830 con 0x7f685c0b2eb0 2020-06-12T17:49:03.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.689+0000 7f6861a3e700 1 -- 172.21.15.38:0/908890231 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f685c061c80 con 0x7f685c0b2eb0 2020-06-12T17:49:03.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.765+0000 7f685a7fc700 1 --2- 172.21.15.38:0/908890231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f685c0b2eb0 0x7f685c0b24e0 secure :-1 s=THROTTLE_DONE pgs=384 cs=0 l=1 rx=0x7f6844002f30 tx=0x7f6844007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.765+0000 7f6853fff700 1 -- 172.21.15.38:0/908890231 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7f684403fe50 con 0x7f685c0b2eb0 2020-06-12T17:49:03.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.767+0000 7f6861a3e700 1 -- 172.21.15.38:0/908890231 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f684004d4e0 msgr2=0x7f684004f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:03.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.767+0000 7f6861a3e700 1 --2- 172.21.15.38:0/908890231 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f684004d4e0 0x7f684004f9a0 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7f6854007e00 tx=0x7f68540081e0).stop 2020-06-12T17:49:03.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.767+0000 7f6861a3e700 1 -- 172.21.15.38:0/908890231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f685c0b2eb0 msgr2=0x7f685c0b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:03.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.767+0000 7f6861a3e700 1 --2- 172.21.15.38:0/908890231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f685c0b2eb0 0x7f685c0b24e0 secure :-1 s=READY pgs=384 cs=0 l=1 rx=0x7f6844002f30 tx=0x7f6844007e60).stop 2020-06-12T17:49:03.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.767+0000 7f6861a3e700 1 -- 172.21.15.38:0/908890231 shutdown_connections 2020-06-12T17:49:03.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.767+0000 7f6861a3e700 1 --2- 172.21.15.38:0/908890231 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f684004d4e0 0x7f684004f9a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:03.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.767+0000 7f6861a3e700 1 --2- 172.21.15.38:0/908890231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f685c146680 0x7f685c065ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:03.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.767+0000 7f6861a3e700 1 --2- 172.21.15.38:0/908890231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f685c0b2eb0 0x7f685c0b24e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:03.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.767+0000 7f6861a3e700 1 -- 172.21.15.38:0/908890231 >> 172.21.15.38:0/908890231 conn(0x7f685c0b5a20 msgr2=0x7f685c0b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:03.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.767+0000 7f6861a3e700 1 -- 172.21.15.38:0/908890231 shutdown_connections 2020-06-12T17:49:03.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.767+0000 7f6861a3e700 1 -- 172.21.15.38:0/908890231 wait complete. 2020-06-12T17:49:03.782 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-06-12T17:49:03.896 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.892+0000 7f670cecc700 1 Processor -- start 2020-06-12T17:49:03.897 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.892+0000 7f670cecc700 1 -- start start 2020-06-12T17:49:03.903 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f670cecc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f67080b3550 0x7f670805bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:03.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f670cecc700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670805c380 con 0x7f6708143480 2020-06-12T17:49:03.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f670cecc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67080b3b80 con 0x7f670809dd30 2020-06-12T17:49:03.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f670cecc700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6708061880 con 0x7f67080b3550 2020-06-12T17:49:03.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f6705d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f67080b3550 0x7f670805bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:03.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f6706d9d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6708143480 0x7f67081438a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39004/0 (socket says 172.21.15.38:39004) 2020-06-12T17:49:03.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f6706d9d700 1 -- 172.21.15.38:0/2505687996 learned_addr learned my addr 172.21.15.38:0/2505687996 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:03.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f6705d9b700 1 -- 172.21.15.38:0/2505687996 >> v1:172.21.15.150:6789/0 conn(0x7f670809dd30 legacy=0x7f6708061d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:03.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f6705d9b700 1 -- 172.21.15.38:0/2505687996 >> v1:172.21.15.38:6789/0 conn(0x7f6708143480 legacy=0x7f67081438a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:03.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f670559a700 1 -- 172.21.15.38:0/2505687996 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2104795094 0 0) 0x7f6700001450 con 0x7f6708143480 2020-06-12T17:49:03.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f6705d9b700 1 -- 172.21.15.38:0/2505687996 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670809e110 con 0x7f67080b3550 2020-06-12T17:49:03.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f6705d9b700 1 --2- 172.21.15.38:0/2505687996 >> v2:172.21.15.38:3300/0 conn(0x7f67080b3550 0x7f670805bf20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f66f8002f30 tx=0x7f66f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f6705d9b700 1 --2- 172.21.15.38:0/2505687996 >> v2:172.21.15.38:3300/0 conn(0x7f67080b3550 0x7f670805bf20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f66f8002f30 tx=0x7f66f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f6705d9b700 1 --2- 172.21.15.38:0/2505687996 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f67080b3550 0x7f670805bf20 secure :-1 s=READY pgs=386 cs=0 l=1 rx=0x7f66f8002f30 tx=0x7f66f8007e60).ready entity=mon.0 client_cookie=c1bf1d4a4d3eac9d server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:03.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f6705d9b700 1 --2- 172.21.15.38:0/2505687996 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f67080b3550 0x7f670805bf20 secure :-1 s=THROTTLE_DONE pgs=386 cs=0 l=1 rx=0x7f66f8002f30 tx=0x7f66f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f670559a700 1 -- 172.21.15.38:0/2505687996 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66f8011430 con 0x7f67080b3550 2020-06-12T17:49:03.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f6705d9b700 1 --2- 172.21.15.38:0/2505687996 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f67080b3550 0x7f670805bf20 secure :-1 s=THROTTLE_DONE pgs=386 cs=0 l=1 rx=0x7f66f8002f30 tx=0x7f66f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f6705d9b700 1 --2- 172.21.15.38:0/2505687996 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f67080b3550 0x7f670805bf20 secure :-1 s=THROTTLE_DONE pgs=386 cs=0 l=1 rx=0x7f66f8002f30 tx=0x7f66f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f670559a700 1 -- 172.21.15.38:0/2505687996 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f8011590 con 0x7f67080b3550 2020-06-12T17:49:03.909 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f670559a700 1 -- 172.21.15.38:0/2505687996 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66f80118f0 con 0x7f67080b3550 2020-06-12T17:49:03.909 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f670cecc700 1 -- 172.21.15.38:0/2505687996 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f67080b3550 msgr2=0x7f670805bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:03.909 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f670cecc700 1 --2- 172.21.15.38:0/2505687996 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f67080b3550 0x7f670805bf20 secure :-1 s=READY pgs=386 cs=0 l=1 rx=0x7f66f8002f30 tx=0x7f66f8007e60).stop 2020-06-12T17:49:03.909 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f670cecc700 1 -- 172.21.15.38:0/2505687996 shutdown_connections 2020-06-12T17:49:03.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f670cecc700 1 --2- 172.21.15.38:0/2505687996 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f67080b3550 0x7f670805bf20 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:03.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f670cecc700 1 -- 172.21.15.38:0/2505687996 >> 172.21.15.38:0/2505687996 conn(0x7f67080b8420 msgr2=0x7f67080b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:03.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f670cecc700 1 -- 172.21.15.38:0/2505687996 shutdown_connections 2020-06-12T17:49:03.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.894+0000 7f670cecc700 1 -- 172.21.15.38:0/2505687996 wait complete. 2020-06-12T17:49:03.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.895+0000 7f670cecc700 1 Processor -- start 2020-06-12T17:49:03.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.895+0000 7f670cecc700 1 -- start start 2020-06-12T17:49:03.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.896+0000 7f670cecc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f670809dd30 0x7f67081475c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:03.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.896+0000 7f670cecc700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670809d240 con 0x7f67080b3550 2020-06-12T17:49:03.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.896+0000 7f670cecc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670809c450 con 0x7f6708143480 2020-06-12T17:49:03.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.896+0000 7f670cecc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670813fda0 con 0x7f670809dd30 2020-06-12T17:49:03.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.896+0000 7f6705d9b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f67080b3550 0x7f670813baf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39008/0 (socket says 172.21.15.38:39008) 2020-06-12T17:49:03.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.896+0000 7f6705d9b700 1 -- 172.21.15.38:0/2060151115 learned_addr learned my addr 172.21.15.38:0/2060151115 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:03.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.896+0000 7f66f77fe700 1 -- 172.21.15.38:0/2060151115 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166541171 0 0) 0x7f670809e110 con 0x7f67080b3550 2020-06-12T17:49:03.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.896+0000 7f66f77fe700 1 -- 172.21.15.38:0/2060151115 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66e4002fe0 con 0x7f67080b3550 2020-06-12T17:49:03.913 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.896+0000 7f670659c700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f670809dd30 0x7f67081475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:03.913 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.896+0000 7f66f77fe700 1 -- 172.21.15.38:0/2060151115 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3658400291 0 0) 0x7f66e4002fe0 con 0x7f67080b3550 2020-06-12T17:49:03.913 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.896+0000 7f66f77fe700 1 -- 172.21.15.38:0/2060151115 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f670809e110 con 0x7f67080b3550 2020-06-12T17:49:03.913 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.896+0000 7f66f77fe700 1 -- 172.21.15.38:0/2060151115 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f66f8008e10 con 0x7f67080b3550 2020-06-12T17:49:03.914 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.896+0000 7f66f77fe700 1 -- 172.21.15.38:0/2060151115 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f670809dd30 msgr2=0x7f67081475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:03.914 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.896+0000 7f66f77fe700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f670809dd30 0x7f67081475c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:03.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.896+0000 7f66f77fe700 1 -- 172.21.15.38:0/2060151115 >> v1:172.21.15.150:6789/0 conn(0x7f6708143480 legacy=0x7f67081404e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:03.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.896+0000 7f66f77fe700 1 -- 172.21.15.38:0/2060151115 >> v1:172.21.15.38:6789/0 conn(0x7f67080b3550 legacy=0x7f670813baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:03.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.896+0000 7f66f77fe700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f670809dd30 0x7f66e40049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:03.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.896+0000 7f66f77fe700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66e4004e10 0x7f66e4003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:03.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.896+0000 7f66f77fe700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66e4003d80 0x7f66e4004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:03.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.896+0000 7f66f77fe700 1 -- 172.21.15.38:0/2060151115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670813fda0 con 0x7f66e4004e10 2020-06-12T17:49:03.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.896+0000 7f66f77fe700 1 -- 172.21.15.38:0/2060151115 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e40052c0 con 0x7f66e4003d80 2020-06-12T17:49:03.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.896+0000 7f66f77fe700 1 -- 172.21.15.38:0/2060151115 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e4005480 con 0x7f670809dd30 2020-06-12T17:49:03.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.897+0000 7f6705d9b700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66e4004e10 0x7f66e4003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:03.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.897+0000 7f670659c700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f670809dd30 0x7f66e40049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:03.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.897+0000 7f6706d9d700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66e4003d80 0x7f66e4004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:03.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.897+0000 7f6705d9b700 1 -- 172.21.15.38:0/2060151115 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f670809dd30 msgr2=0x7f66e40049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:03.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.897+0000 7f6705d9b700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f670809dd30 0x7f66e40049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:03.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.897+0000 7f6705d9b700 1 -- 172.21.15.38:0/2060151115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66e4003d80 msgr2=0x7f66e4004200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:03.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.897+0000 7f6705d9b700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66e4003d80 0x7f66e4004200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:03.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.897+0000 7f6705d9b700 1 -- 172.21.15.38:0/2060151115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6708140040 con 0x7f66e4004e10 2020-06-12T17:49:03.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.897+0000 7f6706d9d700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66e4003d80 0x7f66e4004200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:49:03.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.897+0000 7f670cecc700 1 -- 172.21.15.38:0/2060151115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f670809c180 con 0x7f66e4004e10 2020-06-12T17:49:03.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.897+0000 7f6705d9b700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66e4004e10 0x7f66e4003920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f66f80084c0 tx=0x7f66f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.897+0000 7f670cecc700 1 -- 172.21.15.38:0/2060151115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6708147190 con 0x7f66e4004e10 2020-06-12T17:49:03.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.897+0000 7f6705d9b700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66e4004e10 0x7f66e4003920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f66f80084c0 tx=0x7f66f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.897+0000 7f6705d9b700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66e4004e10 0x7f66e4003920 secure :-1 s=READY pgs=388 cs=0 l=1 rx=0x7f66f80084c0 tx=0x7f66f8007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:03.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.897+0000 7f6705d9b700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66e4004e10 0x7f66e4003920 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7f66f80084c0 tx=0x7f66f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.897+0000 7f66f77fe700 1 -- 172.21.15.38:0/2060151115 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66f8008660 con 0x7f66e4004e10 2020-06-12T17:49:03.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.897+0000 7f6705d9b700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66e4004e10 0x7f66e4003920 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7f66f80084c0 tx=0x7f66f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.897+0000 7f6705d9b700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66e4004e10 0x7f66e4003920 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7f66f80084c0 tx=0x7f66f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.897+0000 7f66f77fe700 1 -- 172.21.15.38:0/2060151115 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f8007530 con 0x7f66e4004e10 2020-06-12T17:49:03.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.897+0000 7f66f77fe700 1 -- 172.21.15.38:0/2060151115 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66f800ab80 con 0x7f66e4004e10 2020-06-12T17:49:03.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.898+0000 7f6705d9b700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66e4004e10 0x7f66e4003920 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7f66f80084c0 tx=0x7f66f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.898+0000 7f670cecc700 1 -- 172.21.15.38:0/2060151115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e0003340 con 0x7f66e4004e10 2020-06-12T17:49:03.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.898+0000 7f66f77fe700 1 -- 172.21.15.38:0/2060151115 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f66f800ace0 con 0x7f66e4004e10 2020-06-12T17:49:03.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.898+0000 7f6705d9b700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66e4004e10 0x7f66e4003920 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7f66f80084c0 tx=0x7f66f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.898+0000 7f66f77fe700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f66e4055820 0x7f66e4057ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:03.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.898+0000 7f66f77fe700 1 -- 172.21.15.38:0/2060151115 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f66f8061d20 con 0x7f66e4004e10 2020-06-12T17:49:03.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.899+0000 7f670659c700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f66e4055820 0x7f66e4057ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:03.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.899+0000 7f670659c700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f66e4055820 0x7f66e4057ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6708060250 tx=0x7f66fc001740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.899+0000 7f670659c700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f66e4055820 0x7f66e4057ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6708060250 tx=0x7f66fc001740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.899+0000 7f670659c700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f66e4055820 0x7f66e4057ce0 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7f6708060250 tx=0x7f66fc001740).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:03.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.902+0000 7f6705d9b700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66e4004e10 0x7f66e4003920 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7f66f80084c0 tx=0x7f66f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:03.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:03.902+0000 7f66f77fe700 1 -- 172.21.15.38:0/2060151115 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f66f803d540 con 0x7f66e4004e10 2020-06-12T17:49:04.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.105+0000 7f670cecc700 1 -- 172.21.15.38:0/2060151115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66e00036e0 con 0x7f66e4004e10 2020-06-12T17:49:04.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.105+0000 7f6705d9b700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66e4004e10 0x7f66e4003920 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7f66f80084c0 tx=0x7f66f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.105+0000 7f66f77fe700 1 -- 172.21.15.38:0/2060151115 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f66f8040b60 con 0x7f66e4004e10 2020-06-12T17:49:04.112 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:49:04.112 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.38:6833/1552225333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1552225333},{"type":"v1","addr":"172.21.15.38:6833","nonce":1552225333}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-06-12T17:49:02.759507+0000","modified":"2020-06-12T17:49:03.760890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5008},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5008":{"gid":5008,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2576246531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2576246531},{"type":"v1","addr":"172.21.15.150:6835","nonce":2576246531}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-06-12T17:49:04.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.107+0000 7f670cecc700 1 -- 172.21.15.38:0/2060151115 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f66e4055820 msgr2=0x7f66e4057ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:04.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.107+0000 7f670cecc700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f66e4055820 0x7f66e4057ce0 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7f6708060250 tx=0x7f66fc001740).stop 2020-06-12T17:49:04.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.107+0000 7f670cecc700 1 -- 172.21.15.38:0/2060151115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66e4004e10 msgr2=0x7f66e4003920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:04.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.107+0000 7f670cecc700 1 --2- 172.21.15.38:0/2060151115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66e4004e10 0x7f66e4003920 secure :-1 s=READY pgs=388 cs=0 l=1 rx=0x7f66f80084c0 tx=0x7f66f8007e60).stop 2020-06-12T17:49:04.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.107+0000 7f6706d9d700 1 -- 172.21.15.38:0/2060151115 reap_dead start 2020-06-12T17:49:04.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.107+0000 7f670cecc700 1 -- 172.21.15.38:0/2060151115 shutdown_connections 2020-06-12T17:49:04.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.107+0000 7f670cecc700 1 -- 172.21.15.38:0/2060151115 >> 172.21.15.38:0/2060151115 conn(0x7f67080b8420 msgr2=0x7f67080b4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:04.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.107+0000 7f670cecc700 1 -- 172.21.15.38:0/2060151115 shutdown_connections 2020-06-12T17:49:04.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.107+0000 7f670cecc700 1 -- 172.21.15.38:0/2060151115 wait complete. 2020-06-12T17:49:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 12 2020-06-12T17:49:04.129 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-12T17:49:04.252 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.239+0000 7f53e3520700 1 Processor -- start 2020-06-12T17:49:04.252 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.239+0000 7f53e3520700 1 -- start start 2020-06-12T17:49:04.253 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.240+0000 7f53e3520700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f53dc09bee0 0x7f53dc0b3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:04.253 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.240+0000 7f53e3520700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53dc0b2dc0 con 0x7f53dc061a80 2020-06-12T17:49:04.253 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.240+0000 7f53e3520700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53dc09e560 con 0x7f53dc0b38f0 2020-06-12T17:49:04.253 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.240+0000 7f53e3520700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53dc0b29d0 con 0x7f53dc09bee0 2020-06-12T17:49:04.254 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.240+0000 7f53e0abb700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f53dc09bee0 0x7f53dc0b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:04.254 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.240+0000 7f53e12bc700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f53dc061a80 0x7f53dc142350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39020/0 (socket says 172.21.15.38:39020) 2020-06-12T17:49:04.254 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.240+0000 7f53e12bc700 1 -- 172.21.15.38:0/966123846 learned_addr learned my addr 172.21.15.38:0/966123846 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:04.254 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.240+0000 7f53e0abb700 1 -- 172.21.15.38:0/966123846 >> v1:172.21.15.150:6789/0 conn(0x7f53dc0b38f0 legacy=0x7f53dc0b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:04.254 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.240+0000 7f53e0abb700 1 -- 172.21.15.38:0/966123846 >> v1:172.21.15.38:6789/0 conn(0x7f53dc061a80 legacy=0x7f53dc142350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:04.255 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.240+0000 7f53e0abb700 1 -- 172.21.15.38:0/966123846 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53dc0b2ff0 con 0x7f53dc09bee0 2020-06-12T17:49:04.255 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.240+0000 7f53cbfff700 1 -- 172.21.15.38:0/966123846 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2949440209 0 0) 0x7f53dc0b2dc0 con 0x7f53dc061a80 2020-06-12T17:49:04.255 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.241+0000 7f53e0abb700 1 --2- 172.21.15.38:0/966123846 >> v2:172.21.15.38:3300/0 conn(0x7f53dc09bee0 0x7f53dc0b3490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f53d8002f30 tx=0x7f53d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.255 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.241+0000 7f53e0abb700 1 --2- 172.21.15.38:0/966123846 >> v2:172.21.15.38:3300/0 conn(0x7f53dc09bee0 0x7f53dc0b3490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f53d8002f30 tx=0x7f53d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.256 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.241+0000 7f53e0abb700 1 --2- 172.21.15.38:0/966123846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53dc09bee0 0x7f53dc0b3490 secure :-1 s=READY pgs=390 cs=0 l=1 rx=0x7f53d8002f30 tx=0x7f53d8007e60).ready entity=mon.0 client_cookie=5c72ee7a0942c2b1 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:04.256 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.241+0000 7f53e0abb700 1 --2- 172.21.15.38:0/966123846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53dc09bee0 0x7f53dc0b3490 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7f53d8002f30 tx=0x7f53d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.256 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.241+0000 7f53cbfff700 1 -- 172.21.15.38:0/966123846 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53d8011430 con 0x7f53dc09bee0 2020-06-12T17:49:04.256 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.241+0000 7f53e0abb700 1 --2- 172.21.15.38:0/966123846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53dc09bee0 0x7f53dc0b3490 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7f53d8002f30 tx=0x7f53d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.256 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.241+0000 7f53e0abb700 1 --2- 172.21.15.38:0/966123846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53dc09bee0 0x7f53dc0b3490 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7f53d8002f30 tx=0x7f53d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.257 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.241+0000 7f53cbfff700 1 -- 172.21.15.38:0/966123846 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d8011590 con 0x7f53dc09bee0 2020-06-12T17:49:04.257 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.241+0000 7f53cbfff700 1 -- 172.21.15.38:0/966123846 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53d80118f0 con 0x7f53dc09bee0 2020-06-12T17:49:04.257 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.241+0000 7f53e3520700 1 -- 172.21.15.38:0/966123846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53dc09bee0 msgr2=0x7f53dc0b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:04.257 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.241+0000 7f53e3520700 1 --2- 172.21.15.38:0/966123846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53dc09bee0 0x7f53dc0b3490 secure :-1 s=READY pgs=390 cs=0 l=1 rx=0x7f53d8002f30 tx=0x7f53d8007e60).stop 2020-06-12T17:49:04.257 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.241+0000 7f53e3520700 1 -- 172.21.15.38:0/966123846 shutdown_connections 2020-06-12T17:49:04.258 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.241+0000 7f53e3520700 1 --2- 172.21.15.38:0/966123846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53dc09bee0 0x7f53dc0b3490 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:04.258 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.241+0000 7f53e3520700 1 -- 172.21.15.38:0/966123846 >> 172.21.15.38:0/966123846 conn(0x7f53dc0b8420 msgr2=0x7f53dc0b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:04.258 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.241+0000 7f53e3520700 1 -- 172.21.15.38:0/966123846 shutdown_connections 2020-06-12T17:49:04.258 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.241+0000 7f53e3520700 1 -- 172.21.15.38:0/966123846 wait complete. 2020-06-12T17:49:04.259 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.242+0000 7f53e3520700 1 Processor -- start 2020-06-12T17:49:04.259 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.242+0000 7f53e3520700 1 -- start start 2020-06-12T17:49:04.259 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.243+0000 7f53e3520700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f53dc061a80 0x7f53dc144fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:04.259 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.243+0000 7f53e3520700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53dc0b38f0 0x7f53dc0ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:04.260 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.243+0000 7f53e3520700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53dc142120 con 0x7f53dc09bee0 2020-06-12T17:49:04.260 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.243+0000 7f53e3520700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53dc0aed90 con 0x7f53dc061a80 2020-06-12T17:49:04.260 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.243+0000 7f53e3520700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc142350 con 0x7f53dc0b38f0 2020-06-12T17:49:04.260 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.243+0000 7f53e12bc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f53dc061a80 0x7f53dc144fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:04.260 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.243+0000 7f53e12bc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f53dc061a80 0x7f53dc144fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37210/0 (socket says 172.21.15.38:37210) 2020-06-12T17:49:04.261 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.243+0000 7f53e12bc700 1 -- 172.21.15.38:0/1343199748 learned_addr learned my addr 172.21.15.38:0/1343199748 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:04.261 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.243+0000 7f53e1abd700 1 --2- 172.21.15.38:0/1343199748 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53dc0b38f0 0x7f53dc0ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:04.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.243+0000 7f53e12bc700 1 -- 172.21.15.38:0/1343199748 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53dc0b38f0 msgr2=0x7f53dc0ae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:04.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.243+0000 7f53e12bc700 1 --2- 172.21.15.38:0/1343199748 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53dc0b38f0 0x7f53dc0ae7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:04.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.243+0000 7f53e12bc700 1 -- 172.21.15.38:0/1343199748 >> v1:172.21.15.150:6789/0 conn(0x7f53dc09bee0 legacy=0x7f53dc065970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:04.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.243+0000 7f53e12bc700 1 -- 172.21.15.38:0/1343199748 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53dc066080 con 0x7f53dc061a80 2020-06-12T17:49:04.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.243+0000 7f53e1abd700 1 --2- 172.21.15.38:0/1343199748 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53dc0b38f0 0x7f53dc0ae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:49:04.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.243+0000 7f53e12bc700 1 --2- 172.21.15.38:0/1343199748 >> v2:172.21.15.38:3300/0 conn(0x7f53dc061a80 0x7f53dc144fb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f53cc000b80 tx=0x7f53cc0016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.244+0000 7f53e12bc700 1 --2- 172.21.15.38:0/1343199748 >> v2:172.21.15.38:3300/0 conn(0x7f53dc061a80 0x7f53dc144fb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f53cc000b80 tx=0x7f53cc0016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.264 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.244+0000 7f53e12bc700 1 --2- 172.21.15.38:0/1343199748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53dc061a80 0x7f53dc144fb0 secure :-1 s=READY pgs=391 cs=0 l=1 rx=0x7f53cc000b80 tx=0x7f53cc0016e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:04.264 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.244+0000 7f53e12bc700 1 --2- 172.21.15.38:0/1343199748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53dc061a80 0x7f53dc144fb0 secure :-1 s=THROTTLE_DONE pgs=391 cs=0 l=1 rx=0x7f53cc000b80 tx=0x7f53cc0016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.265 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.244+0000 7f53e12bc700 1 --2- 172.21.15.38:0/1343199748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53dc061a80 0x7f53dc144fb0 secure :-1 s=THROTTLE_DONE pgs=391 cs=0 l=1 rx=0x7f53cc000b80 tx=0x7f53cc0016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.265 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.244+0000 7f53ca7fc700 1 -- 172.21.15.38:0/1343199748 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53cc005ca0 con 0x7f53dc061a80 2020-06-12T17:49:04.265 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.244+0000 7f53e12bc700 1 --2- 172.21.15.38:0/1343199748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53dc061a80 0x7f53dc144fb0 secure :-1 s=THROTTLE_DONE pgs=391 cs=0 l=1 rx=0x7f53cc000b80 tx=0x7f53cc0016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.266 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.244+0000 7f53ca7fc700 1 -- 172.21.15.38:0/1343199748 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53cc005e00 con 0x7f53dc061a80 2020-06-12T17:49:04.267 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.244+0000 7f53e3520700 1 -- 172.21.15.38:0/1343199748 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53dc1389a0 con 0x7f53dc061a80 2020-06-12T17:49:04.267 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.244+0000 7f53ca7fc700 1 -- 172.21.15.38:0/1343199748 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53cc0062b0 con 0x7f53dc061a80 2020-06-12T17:49:04.267 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.244+0000 7f53e3520700 1 -- 172.21.15.38:0/1343199748 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53dc138e10 con 0x7f53dc061a80 2020-06-12T17:49:04.268 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.244+0000 7f53e12bc700 1 --2- 172.21.15.38:0/1343199748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53dc061a80 0x7f53dc144fb0 secure :-1 s=THROTTLE_DONE pgs=391 cs=0 l=1 rx=0x7f53cc000b80 tx=0x7f53cc0016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.268 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.245+0000 7f53ca7fc700 1 -- 172.21.15.38:0/1343199748 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f53cc006520 con 0x7f53dc061a80 2020-06-12T17:49:04.268 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.245+0000 7f53e3520700 1 -- 172.21.15.38:0/1343199748 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53dc056c30 con 0x7f53dc061a80 2020-06-12T17:49:04.269 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.245+0000 7f53e12bc700 1 --2- 172.21.15.38:0/1343199748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53dc061a80 0x7f53dc144fb0 secure :-1 s=THROTTLE_DONE pgs=391 cs=0 l=1 rx=0x7f53cc000b80 tx=0x7f53cc0016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.269 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.245+0000 7f53ca7fc700 1 --2- 172.21.15.38:0/1343199748 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f53bc04d580 0x7f53bc04fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:04.269 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.245+0000 7f53ca7fc700 1 -- 172.21.15.38:0/1343199748 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f53cc060f60 con 0x7f53dc061a80 2020-06-12T17:49:04.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.245+0000 7f53e0abb700 1 --2- 172.21.15.38:0/1343199748 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f53bc04d580 0x7f53bc04fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:04.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.245+0000 7f53e0abb700 1 --2- 172.21.15.38:0/1343199748 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f53bc04d580 0x7f53bc04fa40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f53dc067320 tx=0x7f53d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.246+0000 7f53e0abb700 1 --2- 172.21.15.38:0/1343199748 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f53bc04d580 0x7f53bc04fa40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f53dc067320 tx=0x7f53d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.246+0000 7f53e0abb700 1 --2- 172.21.15.38:0/1343199748 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f53bc04d580 0x7f53bc04fa40 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7f53dc067320 tx=0x7f53d8007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:04.272 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.250+0000 7f53e12bc700 1 --2- 172.21.15.38:0/1343199748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53dc061a80 0x7f53dc144fb0 secure :-1 s=THROTTLE_DONE pgs=391 cs=0 l=1 rx=0x7f53cc000b80 tx=0x7f53cc0016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.272 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.250+0000 7f53ca7fc700 1 -- 172.21.15.38:0/1343199748 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f53cc03c6c0 con 0x7f53dc061a80 2020-06-12T17:49:04.405 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.401+0000 7f53e3520700 1 -- 172.21.15.38:0/1343199748 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53dc0aeed0 con 0x7f53dc061a80 2020-06-12T17:49:04.406 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.402+0000 7f53e12bc700 1 --2- 172.21.15.38:0/1343199748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53dc061a80 0x7f53dc144fb0 secure :-1 s=THROTTLE_DONE pgs=391 cs=0 l=1 rx=0x7f53cc000b80 tx=0x7f53cc0016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.407 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.402+0000 7f53ca7fc700 1 -- 172.21.15.38:0/1343199748 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16319 (secure 0 0 0) 0x7f53dc0aeed0 con 0x7f53dc061a80 2020-06-12T17:49:04.407 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:49:04.407 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"fsid":"8e42a2e7-b187-42c4-a73f-8f812ee62352","created":"2020-06-12T17:47:54.434340+0000","modified":"2020-06-12T17:49:03.761154+0000","last_up_change":"2020-06-12T17:48:03.388718+0000","last_in_change":"2020-06-12T17:48:03.388718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-06-12T17:47:57.558119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-06-12T17:48:07.419264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2020-06-12T17:49:00.516131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2020-06-12T17:49:01.711699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"44ac3dea-67b4-4b9a-bc18-ac511710afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":31038},{"type":"v1","addr":"172.21.15.38:6816","nonce":31038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":31038},{"type":"v1","addr":"172.21.15.38:6819","nonce":31038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":31038},{"type":"v1","addr":"172.21.15.38:6823","nonce":31038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":31038},{"type":"v1","addr":"172.21.15.38:6821","nonce":31038}]},"public_addr":"172.21.15.38:6816/31038","cluster_addr":"172.21.15.38:6819/31038","heartbeat_back_addr":"172.21.15.38:6823/31038","heartbeat_front_addr":"172.21.15.38:6821/31038","state":["exists","up"]},{"osd":1,"uuid":"561f7ced-3fff-4364-8619-6e4ecbc9d256","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":31036},{"type":"v1","addr":"172.21.15.38:6801","nonce":31036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":31036},{"type":"v1","addr":"172.21.15.38:6803","nonce":31036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":31036},{"type":"v1","addr":"172.21.15.38:6807","nonce":31036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":31036},{"type":"v1","addr":"172.21.15.38:6805","nonce":31036}]},"public_addr":"172.21.15.38:6801/31036","cluster_addr":"172.21.15.38:6803/31036","heartbeat_back_addr":"172.21.15.38:6807/31036","heartbeat_front_addr":"172.21.15.38:6805/31036","state":["exists","up"]},{"osd":2,"uuid":"0bb3c806-07af-49f5-b492-d0e33f2de37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":31053},{"type":"v1","addr":"172.21.15.38:6825","nonce":31053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":31053},{"type":"v1","addr":"172.21.15.38:6827","nonce":31053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":31053},{"type":"v1","addr":"172.21.15.38:6831","nonce":31053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":31053},{"type":"v1","addr":"172.21.15.38:6829","nonce":31053}]},"public_addr":"172.21.15.38:6825/31053","cluster_addr":"172.21.15.38:6827/31053","heartbeat_back_addr":"172.21.15.38:6831/31053","heartbeat_front_addr":"172.21.15.38:6829/31053","state":["exists","up"]},{"osd":3,"uuid":"7f6a1e75-7b11-456e-8a4b-510b16226800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":31037},{"type":"v1","addr":"172.21.15.38:6809","nonce":31037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":31037},{"type":"v1","addr":"172.21.15.38:6811","nonce":31037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6815","nonce":31037},{"type":"v1","addr":"172.21.15.38:6817","nonce":31037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":31037},{"type":"v1","addr":"172.21.15.38:6813","nonce":31037}]},"public_addr":"172.21.15.38:6809/31037","cluster_addr":"172.21.15.38:6811/31037","heartbeat_back_addr":"172.21.15.38:6817/31037","heartbeat_front_addr":"172.21.15.38:6813/31037","state":["exists","up"]},{"osd":4,"uuid":"0eca0272-8cfd-469c-a32d-e29730dc0e1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":31294},{"type":"v1","addr":"172.21.15.150:6803","nonce":31294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":31294},{"type":"v1","addr":"172.21.15.150:6805","nonce":31294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":31294},{"type":"v1","addr":"172.21.15.150:6809","nonce":31294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":31294},{"type":"v1","addr":"172.21.15.150:6807","nonce":31294}]},"public_addr":"172.21.15.150:6803/31294","cluster_addr":"172.21.15.150:6805/31294","heartbeat_back_addr":"172.21.15.150:6809/31294","heartbeat_front_addr":"172.21.15.150:6807/31294","state":["exists","up"]},{"osd":5,"uuid":"69d6a7dc-a55a-4ebc-8479-8bb921ddfb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":31295},{"type":"v1","addr":"172.21.15.150:6813","nonce":31295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":31295},{"type":"v1","addr":"172.21.15.150:6816","nonce":31295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":31295},{"type":"v1","addr":"172.21.15.150:6828","nonce":31295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6819","nonce":31295},{"type":"v1","addr":"172.21.15.150:6822","nonce":31295}]},"public_addr":"172.21.15.150:6813/31295","cluster_addr":"172.21.15.150:6816/31295","heartbeat_back_addr":"172.21.15.150:6828/31295","heartbeat_front_addr":"172.21.15.150:6822/31295","state":["exists","up"]},{"osd":6,"uuid":"f0d320f8-c2f0-40bb-b713-526246cf97b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":31297},{"type":"v1","addr":"172.21.15.150:6820","nonce":31297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6823","nonce":31297},{"type":"v1","addr":"172.21.15.150:6827","nonce":31297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":31297},{"type":"v1","addr":"172.21.15.150:6833","nonce":31297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":31297},{"type":"v1","addr":"172.21.15.150:6831","nonce":31297}]},"public_addr":"172.21.15.150:6820/31297","cluster_addr":"172.21.15.150:6827/31297","heartbeat_back_addr":"172.21.15.150:6833/31297","heartbeat_front_addr":"172.21.15.150:6831/31297","state":["exists","up"]},{"osd":7,"uuid":"970b7d02-a189-41b2-96e5-a5a5a57c6476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":31296},{"type":"v1","addr":"172.21.15.150:6812","nonce":31296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":31296},{"type":"v1","addr":"172.21.15.150:6818","nonce":31296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":31296},{"type":"v1","addr":"172.21.15.150:6829","nonce":31296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":31296},{"type":"v1","addr":"172.21.15.150:6824","nonce":31296}]},"public_addr":"172.21.15.150:6812/31296","cluster_addr":"172.21.15.150:6818/31296","heartbeat_back_addr":"172.21.15.150:6829/31296","heartbeat_front_addr":"172.21.15.150:6824/31296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.664300+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.644253+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.651120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.584978+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.561149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.661778+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T17:49:04.409 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.404+0000 7f53e3520700 1 -- 172.21.15.38:0/1343199748 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f53bc04d580 msgr2=0x7f53bc04fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:04.409 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.404+0000 7f53e3520700 1 --2- 172.21.15.38:0/1343199748 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f53bc04d580 0x7f53bc04fa40 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7f53dc067320 tx=0x7f53d8007e60).stop 2020-06-12T17:49:04.410 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.404+0000 7f53e3520700 1 -- 172.21.15.38:0/1343199748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53dc061a80 msgr2=0x7f53dc144fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:04.410 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.404+0000 7f53e3520700 1 --2- 172.21.15.38:0/1343199748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53dc061a80 0x7f53dc144fb0 secure :-1 s=READY pgs=391 cs=0 l=1 rx=0x7f53cc000b80 tx=0x7f53cc0016e0).stop 2020-06-12T17:49:04.410 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.404+0000 7f53e3520700 1 -- 172.21.15.38:0/1343199748 shutdown_connections 2020-06-12T17:49:04.410 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.404+0000 7f53e3520700 1 --2- 172.21.15.38:0/1343199748 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f53bc04d580 0x7f53bc04fa40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:04.411 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.404+0000 7f53e3520700 1 --2- 172.21.15.38:0/1343199748 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53dc0b38f0 0x7f53dc0ae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:04.411 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.404+0000 7f53e3520700 1 --2- 172.21.15.38:0/1343199748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53dc061a80 0x7f53dc144fb0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:04.411 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.404+0000 7f53e3520700 1 -- 172.21.15.38:0/1343199748 >> 172.21.15.38:0/1343199748 conn(0x7f53dc0b8420 msgr2=0x7f53dc1392b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:04.411 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.404+0000 7f53e3520700 1 -- 172.21.15.38:0/1343199748 shutdown_connections 2020-06-12T17:49:04.412 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.404+0000 7f53e3520700 1 -- 172.21.15.38:0/1343199748 wait complete. 2020-06-12T17:49:04.420 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-06-12T17:49:04.544 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.538+0000 7f7471483700 1 Processor -- start 2020-06-12T17:49:04.545 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.538+0000 7f7471483700 1 -- start start 2020-06-12T17:49:04.545 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.539+0000 7f7471483700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f746c1523e0 0x7f746c1527c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:04.545 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.539+0000 7f7471483700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f746c05ac00 0x7f746c05b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:04.545 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.539+0000 7f7471483700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f746c0ace40 con 0x7f746c0b3ca0 2020-06-12T17:49:04.546 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.539+0000 7f7471483700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f746c0ad0e0 con 0x7f746c1523e0 2020-06-12T17:49:04.546 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.539+0000 7f7471483700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f746c0af0c0 con 0x7f746c05ac00 2020-06-12T17:49:04.546 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.539+0000 7f746b7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f746c1523e0 0x7f746c1527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:04.546 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.539+0000 7f746affd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f746c0b3ca0 0x7f746c0ae9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39034/0 (socket says 172.21.15.38:39034) 2020-06-12T17:49:04.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.539+0000 7f746affd700 1 -- 172.21.15.38:0/653544743 learned_addr learned my addr 172.21.15.38:0/653544743 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:04.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.539+0000 7f746bfff700 1 --2- 172.21.15.38:0/653544743 >> v2:172.21.15.150:3300/0 conn(0x7f746c05ac00 0x7f746c05b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:04.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.539+0000 7f746b7fe700 1 -- 172.21.15.38:0/653544743 >> v2:172.21.15.150:3300/0 conn(0x7f746c05ac00 msgr2=0x7f746c05b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:04.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.539+0000 7f746b7fe700 1 --2- 172.21.15.38:0/653544743 >> v2:172.21.15.150:3300/0 conn(0x7f746c05ac00 0x7f746c05b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:04.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.539+0000 7f746b7fe700 1 -- 172.21.15.38:0/653544743 >> v1:172.21.15.38:6789/0 conn(0x7f746c0b3ca0 legacy=0x7f746c0ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:04.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.539+0000 7f746a7fc700 1 -- 172.21.15.38:0/653544743 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3316240771 0 0) 0x7f746c0ace40 con 0x7f746c0b3ca0 2020-06-12T17:49:04.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.539+0000 7f746b7fe700 1 -- 172.21.15.38:0/653544743 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c0b4130 con 0x7f746c1523e0 2020-06-12T17:49:04.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.539+0000 7f746b7fe700 1 --2- 172.21.15.38:0/653544743 >> v2:172.21.15.38:3300/0 conn(0x7f746c1523e0 0x7f746c1527c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f74640032b0 tx=0x7f74640081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.539+0000 7f746b7fe700 1 --2- 172.21.15.38:0/653544743 >> v2:172.21.15.38:3300/0 conn(0x7f746c1523e0 0x7f746c1527c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f74640032b0 tx=0x7f74640081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.539+0000 7f746b7fe700 1 --2- 172.21.15.38:0/653544743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f746c1523e0 0x7f746c1527c0 secure :-1 s=READY pgs=393 cs=0 l=1 rx=0x7f74640032b0 tx=0x7f74640081e0).ready entity=mon.0 client_cookie=d3d245c2547e1b7d server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:04.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.539+0000 7f746b7fe700 1 --2- 172.21.15.38:0/653544743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f746c1523e0 0x7f746c1527c0 secure :-1 s=THROTTLE_DONE pgs=393 cs=0 l=1 rx=0x7f74640032b0 tx=0x7f74640081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.539+0000 7f746a7fc700 1 -- 172.21.15.38:0/653544743 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7464011e90 con 0x7f746c1523e0 2020-06-12T17:49:04.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.539+0000 7f746b7fe700 1 --2- 172.21.15.38:0/653544743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f746c1523e0 0x7f746c1527c0 secure :-1 s=THROTTLE_DONE pgs=393 cs=0 l=1 rx=0x7f74640032b0 tx=0x7f74640081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.540+0000 7f746a7fc700 1 -- 172.21.15.38:0/653544743 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746400a160 con 0x7f746c1523e0 2020-06-12T17:49:04.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.540+0000 7f746b7fe700 1 --2- 172.21.15.38:0/653544743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f746c1523e0 0x7f746c1527c0 secure :-1 s=THROTTLE_DONE pgs=393 cs=0 l=1 rx=0x7f74640032b0 tx=0x7f74640081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.540+0000 7f746a7fc700 1 -- 172.21.15.38:0/653544743 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f746400a500 con 0x7f746c1523e0 2020-06-12T17:49:04.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.540+0000 7f7471483700 1 -- 172.21.15.38:0/653544743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f746c1523e0 msgr2=0x7f746c1527c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:04.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.540+0000 7f7471483700 1 --2- 172.21.15.38:0/653544743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f746c1523e0 0x7f746c1527c0 secure :-1 s=READY pgs=393 cs=0 l=1 rx=0x7f74640032b0 tx=0x7f74640081e0).stop 2020-06-12T17:49:04.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.540+0000 7f7471483700 1 -- 172.21.15.38:0/653544743 shutdown_connections 2020-06-12T17:49:04.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.540+0000 7f7471483700 1 --2- 172.21.15.38:0/653544743 >> v2:172.21.15.150:3300/0 conn(0x7f746c05ac00 0x7f746c05b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:04.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.540+0000 7f7471483700 1 --2- 172.21.15.38:0/653544743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f746c1523e0 0x7f746c1527c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:04.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.540+0000 7f7471483700 1 -- 172.21.15.38:0/653544743 >> 172.21.15.38:0/653544743 conn(0x7f746c0b8200 msgr2=0x7f746c0b8610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:04.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.540+0000 7f7471483700 1 -- 172.21.15.38:0/653544743 shutdown_connections 2020-06-12T17:49:04.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.540+0000 7f7471483700 1 -- 172.21.15.38:0/653544743 wait complete. 2020-06-12T17:49:04.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.541+0000 7f7471483700 1 Processor -- start 2020-06-12T17:49:04.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.541+0000 7f7471483700 1 -- start start 2020-06-12T17:49:04.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.542+0000 7f7471483700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f746c05ac00 0x7f746c133e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:04.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.542+0000 7f7471483700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f746c0b3ca0 0x7f746c137a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:04.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.542+0000 7f7471483700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f746c1342d0 con 0x7f746c1523e0 2020-06-12T17:49:04.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.542+0000 7f7471483700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f746c065a00 con 0x7f746c0b3ca0 2020-06-12T17:49:04.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.542+0000 7f7471483700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f746c063220 con 0x7f746c05ac00 2020-06-12T17:49:04.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.542+0000 7f746affd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f746c0b3ca0 0x7f746c137a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:04.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.542+0000 7f746affd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f746c0b3ca0 0x7f746c137a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37224/0 (socket says 172.21.15.38:37224) 2020-06-12T17:49:04.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.542+0000 7f746affd700 1 -- 172.21.15.38:0/2050428858 learned_addr learned my addr 172.21.15.38:0/2050428858 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:04.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.542+0000 7f746b7fe700 1 --2- 172.21.15.38:0/2050428858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f746c05ac00 0x7f746c133e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:04.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.543+0000 7f746affd700 1 -- 172.21.15.38:0/2050428858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f746c05ac00 msgr2=0x7f746c133e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:04.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.543+0000 7f746affd700 1 --2- 172.21.15.38:0/2050428858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f746c05ac00 0x7f746c133e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:04.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.543+0000 7f746affd700 1 -- 172.21.15.38:0/2050428858 >> v1:172.21.15.150:6789/0 conn(0x7f746c1523e0 legacy=0x7f746c137e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:04.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.543+0000 7f746affd700 1 -- 172.21.15.38:0/2050428858 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c0634c0 con 0x7f746c0b3ca0 2020-06-12T17:49:04.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.543+0000 7f746affd700 1 --2- 172.21.15.38:0/2050428858 >> v2:172.21.15.38:3300/0 conn(0x7f746c0b3ca0 0x7f746c137a30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7454000b80 tx=0x7f7454001920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.543+0000 7f746affd700 1 --2- 172.21.15.38:0/2050428858 >> v2:172.21.15.38:3300/0 conn(0x7f746c0b3ca0 0x7f746c137a30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7454000b80 tx=0x7f7454001920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.543+0000 7f746affd700 1 --2- 172.21.15.38:0/2050428858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f746c0b3ca0 0x7f746c137a30 secure :-1 s=READY pgs=394 cs=0 l=1 rx=0x7f7454000b80 tx=0x7f7454001920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:04.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.543+0000 7f746affd700 1 --2- 172.21.15.38:0/2050428858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f746c0b3ca0 0x7f746c137a30 secure :-1 s=THROTTLE_DONE pgs=394 cs=0 l=1 rx=0x7f7454000b80 tx=0x7f7454001920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.543+0000 7f7463fff700 1 -- 172.21.15.38:0/2050428858 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7454001a60 con 0x7f746c0b3ca0 2020-06-12T17:49:04.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.543+0000 7f746affd700 1 --2- 172.21.15.38:0/2050428858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f746c0b3ca0 0x7f746c137a30 secure :-1 s=THROTTLE_DONE pgs=394 cs=0 l=1 rx=0x7f7454000b80 tx=0x7f7454001920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.543+0000 7f746affd700 1 --2- 172.21.15.38:0/2050428858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f746c0b3ca0 0x7f746c137a30 secure :-1 s=THROTTLE_DONE pgs=394 cs=0 l=1 rx=0x7f7454000b80 tx=0x7f7454001920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.543+0000 7f7463fff700 1 -- 172.21.15.38:0/2050428858 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745400c6e0 con 0x7f746c0b3ca0 2020-06-12T17:49:04.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.543+0000 7f7463fff700 1 -- 172.21.15.38:0/2050428858 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f745400cb00 con 0x7f746c0b3ca0 2020-06-12T17:49:04.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.543+0000 7f7471483700 1 -- 172.21.15.38:0/2050428858 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f746c063760 con 0x7f746c0b3ca0 2020-06-12T17:49:04.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.543+0000 7f7471483700 1 -- 172.21.15.38:0/2050428858 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f746c062ea0 con 0x7f746c0b3ca0 2020-06-12T17:49:04.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.544+0000 7f746affd700 1 --2- 172.21.15.38:0/2050428858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f746c0b3ca0 0x7f746c137a30 secure :-1 s=THROTTLE_DONE pgs=394 cs=0 l=1 rx=0x7f7454000b80 tx=0x7f7454001920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.544+0000 7f7471483700 1 -- 172.21.15.38:0/2050428858 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f746c056c30 con 0x7f746c0b3ca0 2020-06-12T17:49:04.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.544+0000 7f7463fff700 1 -- 172.21.15.38:0/2050428858 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f74540054b0 con 0x7f746c0b3ca0 2020-06-12T17:49:04.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.544+0000 7f746affd700 1 --2- 172.21.15.38:0/2050428858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f746c0b3ca0 0x7f746c137a30 secure :-1 s=THROTTLE_DONE pgs=394 cs=0 l=1 rx=0x7f7454000b80 tx=0x7f7454001920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.544+0000 7f7463fff700 1 --2- 172.21.15.38:0/2050428858 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f745004d550 0x7f745004fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:04.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.544+0000 7f7463fff700 1 -- 172.21.15.38:0/2050428858 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7454060c50 con 0x7f746c0b3ca0 2020-06-12T17:49:04.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.544+0000 7f746b7fe700 1 --2- 172.21.15.38:0/2050428858 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f745004d550 0x7f745004fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:04.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.545+0000 7f746b7fe700 1 --2- 172.21.15.38:0/2050428858 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f745004d550 0x7f745004fa10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f74640032b0 tx=0x7f74640081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.545+0000 7f746b7fe700 1 --2- 172.21.15.38:0/2050428858 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f745004d550 0x7f745004fa10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f74640032b0 tx=0x7f74640081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.545+0000 7f746b7fe700 1 --2- 172.21.15.38:0/2050428858 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f745004d550 0x7f745004fa10 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7f74640032b0 tx=0x7f74640081e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:04.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.548+0000 7f746affd700 1 --2- 172.21.15.38:0/2050428858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f746c0b3ca0 0x7f746c137a30 secure :-1 s=THROTTLE_DONE pgs=394 cs=0 l=1 rx=0x7f7454000b80 tx=0x7f7454001920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.548+0000 7f7463fff700 1 -- 172.21.15.38:0/2050428858 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f745403c2d0 con 0x7f746c0b3ca0 2020-06-12T17:49:04.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.756+0000 7f7471483700 1 -- 172.21.15.38:0/2050428858 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f746c1295e0 con 0x7f746c0b3ca0 2020-06-12T17:49:04.762 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.759+0000 7f746affd700 1 --2- 172.21.15.38:0/2050428858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f746c0b3ca0 0x7f746c137a30 secure :-1 s=THROTTLE_DONE pgs=394 cs=0 l=1 rx=0x7f7454000b80 tx=0x7f7454001920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.763 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.759+0000 7f7463fff700 1 -- 172.21.15.38:0/2050428858 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v12) v1 ==== 184+0+0 (secure 0 0 0) 0x7f745403f8f0 con 0x7f746c0b3ca0 2020-06-12T17:49:04.764 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.760+0000 7f7471483700 1 -- 172.21.15.38:0/2050428858 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f745004d550 msgr2=0x7f745004fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:04.764 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.760+0000 7f7471483700 1 --2- 172.21.15.38:0/2050428858 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f745004d550 0x7f745004fa10 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7f74640032b0 tx=0x7f74640081e0).stop 2020-06-12T17:49:04.765 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.760+0000 7f7471483700 1 -- 172.21.15.38:0/2050428858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f746c0b3ca0 msgr2=0x7f746c137a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:04.765 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.761+0000 7f7471483700 1 --2- 172.21.15.38:0/2050428858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f746c0b3ca0 0x7f746c137a30 secure :-1 s=READY pgs=394 cs=0 l=1 rx=0x7f7454000b80 tx=0x7f7454001920).stop 2020-06-12T17:49:04.765 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.761+0000 7f7471483700 1 -- 172.21.15.38:0/2050428858 shutdown_connections 2020-06-12T17:49:04.765 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.761+0000 7f7471483700 1 --2- 172.21.15.38:0/2050428858 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f745004d550 0x7f745004fa10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:04.766 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.761+0000 7f7471483700 1 --2- 172.21.15.38:0/2050428858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f746c05ac00 0x7f746c133e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:04.766 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.761+0000 7f7471483700 1 --2- 172.21.15.38:0/2050428858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f746c0b3ca0 0x7f746c137a30 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:04.766 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.761+0000 7f7471483700 1 -- 172.21.15.38:0/2050428858 >> 172.21.15.38:0/2050428858 conn(0x7f746c0b8200 msgr2=0x7f746c1299c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:04.767 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.761+0000 7f7471483700 1 -- 172.21.15.38:0/2050428858 shutdown_connections 2020-06-12T17:49:04.768 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.761+0000 7f7471483700 1 -- 172.21.15.38:0/2050428858 wait complete. 2020-06-12T17:49:04.768 INFO:teuthology.orchestra.run.smithi038.stderr:updated caps for client.0 2020-06-12T17:49:04.774 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-06-12T17:49:04.903 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.896+0000 7f921ba37700 1 Processor -- start 2020-06-12T17:49:04.903 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.897+0000 7f921ba37700 1 -- start start 2020-06-12T17:49:04.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.897+0000 7f921ba37700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f92141527c0 0x7f92140ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:04.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.897+0000 7f921ba37700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f92140aee10 0x7f921405ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:04.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.897+0000 7f921ba37700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92140ace40 con 0x7f92141523e0 2020-06-12T17:49:04.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.897+0000 7f921ba37700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92140ad0e0 con 0x7f92140aee10 2020-06-12T17:49:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.897+0000 7f921ba37700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9214066990 con 0x7f92141527c0 2020-06-12T17:49:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.898+0000 7f921a7d5700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f92140aee10 0x7f921405ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.898+0000 7f9219fd4700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f92141523e0 0x7f92140b3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39046/0 (socket says 172.21.15.38:39046) 2020-06-12T17:49:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.898+0000 7f9219fd4700 1 -- 172.21.15.38:0/2031753442 learned_addr learned my addr 172.21.15.38:0/2031753442 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.898+0000 7f92197d3700 1 --2- 172.21.15.38:0/2031753442 >> v2:172.21.15.150:3300/0 conn(0x7f92141527c0 0x7f92140ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.898+0000 7f921a7d5700 1 -- 172.21.15.38:0/2031753442 >> v2:172.21.15.150:3300/0 conn(0x7f92141527c0 msgr2=0x7f92140ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.898+0000 7f921a7d5700 1 --2- 172.21.15.38:0/2031753442 >> v2:172.21.15.150:3300/0 conn(0x7f92141527c0 0x7f92140ae9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.898+0000 7f921a7d5700 1 -- 172.21.15.38:0/2031753442 >> v1:172.21.15.38:6789/0 conn(0x7f92141523e0 legacy=0x7f92140b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.898+0000 7f9218fd2700 1 -- 172.21.15.38:0/2031753442 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2488778891 0 0) 0x7f92140ace40 con 0x7f92141523e0 2020-06-12T17:49:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.898+0000 7f921a7d5700 1 -- 172.21.15.38:0/2031753442 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9214066b00 con 0x7f92140aee10 2020-06-12T17:49:04.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.898+0000 7f92197d3700 1 --2- 172.21.15.38:0/2031753442 >> v2:172.21.15.150:3300/0 conn(0x7f92141527c0 0x7f92140ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:49:04.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.898+0000 7f921a7d5700 1 --2- 172.21.15.38:0/2031753442 >> v2:172.21.15.38:3300/0 conn(0x7f92140aee10 0x7f921405ac00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f920c0032b0 tx=0x7f920c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.898+0000 7f921a7d5700 1 --2- 172.21.15.38:0/2031753442 >> v2:172.21.15.38:3300/0 conn(0x7f92140aee10 0x7f921405ac00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f920c0032b0 tx=0x7f920c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.898+0000 7f921a7d5700 1 --2- 172.21.15.38:0/2031753442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92140aee10 0x7f921405ac00 secure :-1 s=READY pgs=396 cs=0 l=1 rx=0x7f920c0032b0 tx=0x7f920c0081e0).ready entity=mon.0 client_cookie=910c8dbf5a2c582f server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:04.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.898+0000 7f921a7d5700 1 --2- 172.21.15.38:0/2031753442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92140aee10 0x7f921405ac00 secure :-1 s=THROTTLE_DONE pgs=396 cs=0 l=1 rx=0x7f920c0032b0 tx=0x7f920c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.898+0000 7f9218fd2700 1 -- 172.21.15.38:0/2031753442 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f920c011e90 con 0x7f92140aee10 2020-06-12T17:49:04.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.898+0000 7f921a7d5700 1 --2- 172.21.15.38:0/2031753442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92140aee10 0x7f921405ac00 secure :-1 s=THROTTLE_DONE pgs=396 cs=0 l=1 rx=0x7f920c0032b0 tx=0x7f920c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.898+0000 7f921a7d5700 1 --2- 172.21.15.38:0/2031753442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92140aee10 0x7f921405ac00 secure :-1 s=THROTTLE_DONE pgs=396 cs=0 l=1 rx=0x7f920c0032b0 tx=0x7f920c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.909 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.898+0000 7f9218fd2700 1 -- 172.21.15.38:0/2031753442 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920c00a160 con 0x7f92140aee10 2020-06-12T17:49:04.909 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.898+0000 7f9218fd2700 1 -- 172.21.15.38:0/2031753442 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f920c00a500 con 0x7f92140aee10 2020-06-12T17:49:04.909 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.898+0000 7f921ba37700 1 -- 172.21.15.38:0/2031753442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92140aee10 msgr2=0x7f921405ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:04.909 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.898+0000 7f921ba37700 1 --2- 172.21.15.38:0/2031753442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92140aee10 0x7f921405ac00 secure :-1 s=READY pgs=396 cs=0 l=1 rx=0x7f920c0032b0 tx=0x7f920c0081e0).stop 2020-06-12T17:49:04.909 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.899+0000 7f921ba37700 1 -- 172.21.15.38:0/2031753442 shutdown_connections 2020-06-12T17:49:04.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.899+0000 7f921ba37700 1 --2- 172.21.15.38:0/2031753442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92140aee10 0x7f921405ac00 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:04.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.899+0000 7f921ba37700 1 --2- 172.21.15.38:0/2031753442 >> v2:172.21.15.150:3300/0 conn(0x7f92141527c0 0x7f92140ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:04.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.899+0000 7f921ba37700 1 -- 172.21.15.38:0/2031753442 >> 172.21.15.38:0/2031753442 conn(0x7f92140b8200 msgr2=0x7f92140b8610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:04.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.899+0000 7f921ba37700 1 -- 172.21.15.38:0/2031753442 shutdown_connections 2020-06-12T17:49:04.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.899+0000 7f921ba37700 1 -- 172.21.15.38:0/2031753442 wait complete. 2020-06-12T17:49:04.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.900+0000 7f921ba37700 1 Processor -- start 2020-06-12T17:49:04.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.900+0000 7f921ba37700 1 -- start start 2020-06-12T17:49:04.914 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.900+0000 7f921ba37700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f92140aee10 0x7f9214128d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:04.914 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.900+0000 7f921ba37700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92141523e0 0x7f92140b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:04.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.900+0000 7f921ba37700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9214064e10 con 0x7f92141527c0 2020-06-12T17:49:04.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.900+0000 7f921ba37700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9214064c20 con 0x7f92140aee10 2020-06-12T17:49:04.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.900+0000 7f921ba37700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92140650b0 con 0x7f92141523e0 2020-06-12T17:49:04.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.901+0000 7f9219fd4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f92140aee10 0x7f9214128d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:04.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.901+0000 7f921a7d5700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f92141527c0 0x7f92140657f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39054/0 (socket says 172.21.15.38:39054) 2020-06-12T17:49:04.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.901+0000 7f921a7d5700 1 -- 172.21.15.38:0/4072620681 learned_addr learned my addr 172.21.15.38:0/4072620681 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:04.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.901+0000 7f92197d3700 1 --2- 172.21.15.38:0/4072620681 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92141523e0 0x7f92140b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:04.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.901+0000 7f9219fd4700 1 -- 172.21.15.38:0/4072620681 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92141523e0 msgr2=0x7f92140b62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:04.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.901+0000 7f9219fd4700 1 --2- 172.21.15.38:0/4072620681 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92141523e0 0x7f92140b62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:04.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.901+0000 7f9219fd4700 1 -- 172.21.15.38:0/4072620681 >> v1:172.21.15.38:6789/0 conn(0x7f92141527c0 legacy=0x7f92140657f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:04.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.901+0000 7f920a7fc700 1 -- 172.21.15.38:0/4072620681 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 664861236 0 0) 0x7f9214064e10 con 0x7f92141527c0 2020-06-12T17:49:04.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.901+0000 7f9219fd4700 1 -- 172.21.15.38:0/4072620681 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9214065350 con 0x7f92140aee10 2020-06-12T17:49:04.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.901+0000 7f92197d3700 1 --2- 172.21.15.38:0/4072620681 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92141523e0 0x7f92140b62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:49:04.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.901+0000 7f9219fd4700 1 --2- 172.21.15.38:0/4072620681 >> v2:172.21.15.38:3300/0 conn(0x7f92140aee10 0x7f9214128d30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9210000b80 tx=0x7f9210001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.901+0000 7f9219fd4700 1 --2- 172.21.15.38:0/4072620681 >> v2:172.21.15.38:3300/0 conn(0x7f92140aee10 0x7f9214128d30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9210000b80 tx=0x7f9210001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.901+0000 7f9219fd4700 1 --2- 172.21.15.38:0/4072620681 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92140aee10 0x7f9214128d30 secure :-1 s=READY pgs=398 cs=0 l=1 rx=0x7f9210000b80 tx=0x7f9210001680).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:04.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.901+0000 7f9219fd4700 1 --2- 172.21.15.38:0/4072620681 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92140aee10 0x7f9214128d30 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f9210000b80 tx=0x7f9210001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.901+0000 7f920a7fc700 1 -- 172.21.15.38:0/4072620681 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9210005ca0 con 0x7f92140aee10 2020-06-12T17:49:04.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.901+0000 7f9219fd4700 1 --2- 172.21.15.38:0/4072620681 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92140aee10 0x7f9214128d30 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f9210000b80 tx=0x7f9210001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.901+0000 7f9219fd4700 1 --2- 172.21.15.38:0/4072620681 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92140aee10 0x7f9214128d30 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f9210000b80 tx=0x7f9210001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.901+0000 7f920a7fc700 1 -- 172.21.15.38:0/4072620681 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9210005e00 con 0x7f92140aee10 2020-06-12T17:49:04.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.901+0000 7f921ba37700 1 -- 172.21.15.38:0/4072620681 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92140b6720 con 0x7f92140aee10 2020-06-12T17:49:04.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.901+0000 7f920a7fc700 1 -- 172.21.15.38:0/4072620681 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92100062b0 con 0x7f92140aee10 2020-06-12T17:49:04.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.901+0000 7f921ba37700 1 -- 172.21.15.38:0/4072620681 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92140660c0 con 0x7f92140aee10 2020-06-12T17:49:04.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.902+0000 7f9219fd4700 1 --2- 172.21.15.38:0/4072620681 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92140aee10 0x7f9214128d30 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f9210000b80 tx=0x7f9210001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.903+0000 7f920a7fc700 1 -- 172.21.15.38:0/4072620681 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f9210006520 con 0x7f92140aee10 2020-06-12T17:49:04.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.903+0000 7f921ba37700 1 -- 172.21.15.38:0/4072620681 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9214056c30 con 0x7f92140aee10 2020-06-12T17:49:04.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.903+0000 7f9219fd4700 1 --2- 172.21.15.38:0/4072620681 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92140aee10 0x7f9214128d30 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f9210000b80 tx=0x7f9210001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.903+0000 7f920a7fc700 1 --2- 172.21.15.38:0/4072620681 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f91fc04d550 0x7f91fc04fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:04.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.903+0000 7f920a7fc700 1 -- 172.21.15.38:0/4072620681 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9210060e90 con 0x7f92140aee10 2020-06-12T17:49:04.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.903+0000 7f92197d3700 1 --2- 172.21.15.38:0/4072620681 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f91fc04d550 0x7f91fc04fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:04.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.903+0000 7f92197d3700 1 --2- 172.21.15.38:0/4072620681 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f91fc04d550 0x7f91fc04fa10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9204002f30 tx=0x7f9204007ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.903+0000 7f92197d3700 1 --2- 172.21.15.38:0/4072620681 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f91fc04d550 0x7f91fc04fa10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9204002f30 tx=0x7f9204007ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.903+0000 7f92197d3700 1 --2- 172.21.15.38:0/4072620681 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f91fc04d550 0x7f91fc04fa10 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7f9204002f30 tx=0x7f9204007ed0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:04.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.906+0000 7f9219fd4700 1 --2- 172.21.15.38:0/4072620681 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92140aee10 0x7f9214128d30 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f9210000b80 tx=0x7f9210001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:04.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:04.906+0000 7f920a7fc700 1 -- 172.21.15.38:0/4072620681 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f921003c530 con 0x7f92140aee10 2020-06-12T17:49:05.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.111+0000 7f921ba37700 1 -- 172.21.15.38:0/4072620681 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f92140aebf0 con 0x7f92140aee10 2020-06-12T17:49:05.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.118+0000 7f9219fd4700 1 --2- 172.21.15.38:0/4072620681 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92140aee10 0x7f9214128d30 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f9210000b80 tx=0x7f9210001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.118+0000 7f920a7fc700 1 -- 172.21.15.38:0/4072620681 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7f921003fb50 con 0x7f92140aee10 2020-06-12T17:49:05.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.120+0000 7f921ba37700 1 -- 172.21.15.38:0/4072620681 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f91fc04d550 msgr2=0x7f91fc04fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:05.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.120+0000 7f921ba37700 1 --2- 172.21.15.38:0/4072620681 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f91fc04d550 0x7f91fc04fa10 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7f9204002f30 tx=0x7f9204007ed0).stop 2020-06-12T17:49:05.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.120+0000 7f921ba37700 1 -- 172.21.15.38:0/4072620681 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92140aee10 msgr2=0x7f9214128d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:05.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.120+0000 7f921ba37700 1 --2- 172.21.15.38:0/4072620681 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92140aee10 0x7f9214128d30 secure :-1 s=READY pgs=398 cs=0 l=1 rx=0x7f9210000b80 tx=0x7f9210001680).stop 2020-06-12T17:49:05.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.120+0000 7f921ba37700 1 -- 172.21.15.38:0/4072620681 shutdown_connections 2020-06-12T17:49:05.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.120+0000 7f921ba37700 1 --2- 172.21.15.38:0/4072620681 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f91fc04d550 0x7f91fc04fa10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:05.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.120+0000 7f921ba37700 1 --2- 172.21.15.38:0/4072620681 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92140aee10 0x7f9214128d30 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:05.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.120+0000 7f921ba37700 1 --2- 172.21.15.38:0/4072620681 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92141523e0 0x7f92140b62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:05.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.120+0000 7f921ba37700 1 -- 172.21.15.38:0/4072620681 >> 172.21.15.38:0/4072620681 conn(0x7f92140b8200 msgr2=0x7f92140b7720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:05.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.120+0000 7f921ba37700 1 -- 172.21.15.38:0/4072620681 shutdown_connections 2020-06-12T17:49:05.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.120+0000 7f921ba37700 1 -- 172.21.15.38:0/4072620681 wait complete. 2020-06-12T17:49:05.126 INFO:teuthology.orchestra.run.smithi038.stderr:updated caps for client.1 2020-06-12T17:49:05.134 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-06-12T17:49:05.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.251+0000 7efc2c649700 1 Processor -- start 2020-06-12T17:49:05.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.251+0000 7efc2c649700 1 -- start start 2020-06-12T17:49:05.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.252+0000 7efc2c649700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efc241527c0 0x7efc240ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:05.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.252+0000 7efc2c649700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc240ace40 con 0x7efc241523e0 2020-06-12T17:49:05.264 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.252+0000 7efc2c649700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc240ad0e0 con 0x7efc240aee10 2020-06-12T17:49:05.264 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.252+0000 7efc2c649700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc24066990 con 0x7efc241527c0 2020-06-12T17:49:05.264 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.252+0000 7efc2abe6700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7efc241523e0 0x7efc240b3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39058/0 (socket says 172.21.15.38:39058) 2020-06-12T17:49:05.264 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.252+0000 7efc2abe6700 1 -- 172.21.15.38:0/3686960090 learned_addr learned my addr 172.21.15.38:0/3686960090 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:05.265 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.253+0000 7efc2a3e5700 1 --2- 172.21.15.38:0/3686960090 >> v2:172.21.15.150:3300/0 conn(0x7efc241527c0 0x7efc240ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:05.265 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.253+0000 7efc29be4700 1 -- 172.21.15.38:0/3686960090 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4178177191 0 0) 0x7efc240ace40 con 0x7efc241523e0 2020-06-12T17:49:05.265 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.253+0000 7efc29be4700 1 -- 172.21.15.38:0/3686960090 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc10003230 con 0x7efc241523e0 2020-06-12T17:49:05.266 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.253+0000 7efc29be4700 1 -- 172.21.15.38:0/3686960090 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3910583599 0 0) 0x7efc10003230 con 0x7efc241523e0 2020-06-12T17:49:05.266 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.253+0000 7efc29be4700 1 -- 172.21.15.38:0/3686960090 >> v2:172.21.15.150:3300/0 conn(0x7efc241527c0 msgr2=0x7efc240ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:05.266 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.253+0000 7efc29be4700 1 --2- 172.21.15.38:0/3686960090 >> v2:172.21.15.150:3300/0 conn(0x7efc241527c0 0x7efc240ae9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:05.266 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.253+0000 7efc29be4700 1 -- 172.21.15.38:0/3686960090 >> v1:172.21.15.150:6789/0 conn(0x7efc240aee10 legacy=0x7efc2405ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:05.267 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.253+0000 7efc29be4700 1 -- 172.21.15.38:0/3686960090 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc24066ad0 con 0x7efc241523e0 2020-06-12T17:49:05.267 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.253+0000 7efc29be4700 1 -- 172.21.15.38:0/3686960090 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7efc200016d0 con 0x7efc241523e0 2020-06-12T17:49:05.267 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.253+0000 7efc29be4700 1 -- 172.21.15.38:0/3686960090 >> v1:172.21.15.38:6789/0 conn(0x7efc241523e0 legacy=0x7efc240b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:05.267 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.253+0000 7efc29be4700 1 --2- 172.21.15.38:0/3686960090 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc10003720 0x7efc10003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:05.268 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.253+0000 7efc29be4700 1 --2- 172.21.15.38:0/3686960090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc100044d0 0x7efc10004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:05.268 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.253+0000 7efc29be4700 1 --2- 172.21.15.38:0/3686960090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc10004db0 0x7efc1000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:05.268 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.253+0000 7efc29be4700 1 -- 172.21.15.38:0/3686960090 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc24066990 con 0x7efc100044d0 2020-06-12T17:49:05.269 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.253+0000 7efc29be4700 1 -- 172.21.15.38:0/3686960090 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc100041c0 con 0x7efc10004db0 2020-06-12T17:49:05.269 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.253+0000 7efc29be4700 1 -- 172.21.15.38:0/3686960090 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1004fb90 con 0x7efc10003720 2020-06-12T17:49:05.269 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.253+0000 7efc2a3e5700 1 --2- 172.21.15.38:0/3686960090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc100044d0 0x7efc10004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:05.269 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.253+0000 7efc2abe6700 1 --2- 172.21.15.38:0/3686960090 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc10003720 0x7efc10003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:05.269 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.253+0000 7efc2b3e7700 1 --2- 172.21.15.38:0/3686960090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc10004db0 0x7efc1000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:05.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.253+0000 7efc2a3e5700 1 -- 172.21.15.38:0/3686960090 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc10003720 msgr2=0x7efc10003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:05.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.253+0000 7efc2a3e5700 1 --2- 172.21.15.38:0/3686960090 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc10003720 0x7efc10003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:05.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.253+0000 7efc2a3e5700 1 -- 172.21.15.38:0/3686960090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc10004db0 msgr2=0x7efc1000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:05.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.253+0000 7efc2a3e5700 1 --2- 172.21.15.38:0/3686960090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc10004db0 0x7efc1000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:05.271 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.253+0000 7efc2b3e7700 1 -- 172.21.15.38:0/3686960090 reap_dead start 2020-06-12T17:49:05.271 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.253+0000 7efc2a3e5700 1 -- 172.21.15.38:0/3686960090 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc10003230 con 0x7efc100044d0 2020-06-12T17:49:05.271 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.253+0000 7efc2a3e5700 1 --2- 172.21.15.38:0/3686960090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc100044d0 0x7efc10004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efc14002f30 tx=0x7efc14007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.271 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.254+0000 7efc2a3e5700 1 --2- 172.21.15.38:0/3686960090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc100044d0 0x7efc10004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efc14002f30 tx=0x7efc14007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.271 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.254+0000 7efc2a3e5700 1 --2- 172.21.15.38:0/3686960090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc100044d0 0x7efc10004950 secure :-1 s=READY pgs=400 cs=0 l=1 rx=0x7efc14002f30 tx=0x7efc14007e60).ready entity=mon.0 client_cookie=427ed6f720abd334 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:05.272 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.254+0000 7efc2a3e5700 1 --2- 172.21.15.38:0/3686960090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc100044d0 0x7efc10004950 secure :-1 s=THROTTLE_DONE pgs=400 cs=0 l=1 rx=0x7efc14002f30 tx=0x7efc14007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.272 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.254+0000 7efc29be4700 1 -- 172.21.15.38:0/3686960090 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc14008d30 con 0x7efc100044d0 2020-06-12T17:49:05.272 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.254+0000 7efc2a3e5700 1 --2- 172.21.15.38:0/3686960090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc100044d0 0x7efc10004950 secure :-1 s=THROTTLE_DONE pgs=400 cs=0 l=1 rx=0x7efc14002f30 tx=0x7efc14007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.272 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.254+0000 7efc2a3e5700 1 --2- 172.21.15.38:0/3686960090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc100044d0 0x7efc10004950 secure :-1 s=THROTTLE_DONE pgs=400 cs=0 l=1 rx=0x7efc14002f30 tx=0x7efc14007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.272 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.254+0000 7efc29be4700 1 -- 172.21.15.38:0/3686960090 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc14008e90 con 0x7efc100044d0 2020-06-12T17:49:05.273 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.254+0000 7efc29be4700 1 -- 172.21.15.38:0/3686960090 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc14010a80 con 0x7efc100044d0 2020-06-12T17:49:05.273 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.254+0000 7efc2c649700 1 -- 172.21.15.38:0/3686960090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc100044d0 msgr2=0x7efc10004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:05.273 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.254+0000 7efc2c649700 1 --2- 172.21.15.38:0/3686960090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc100044d0 0x7efc10004950 secure :-1 s=READY pgs=400 cs=0 l=1 rx=0x7efc14002f30 tx=0x7efc14007e60).stop 2020-06-12T17:49:05.274 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.254+0000 7efc2c649700 1 -- 172.21.15.38:0/3686960090 shutdown_connections 2020-06-12T17:49:05.274 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.254+0000 7efc2c649700 1 --2- 172.21.15.38:0/3686960090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc100044d0 0x7efc10004950 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:05.275 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.254+0000 7efc2c649700 1 -- 172.21.15.38:0/3686960090 >> 172.21.15.38:0/3686960090 conn(0x7efc240b8200 msgr2=0x7efc240b8610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:05.275 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.254+0000 7efc2c649700 1 -- 172.21.15.38:0/3686960090 shutdown_connections 2020-06-12T17:49:05.275 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.254+0000 7efc2c649700 1 -- 172.21.15.38:0/3686960090 wait complete. 2020-06-12T17:49:05.276 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.256+0000 7efc2c649700 1 Processor -- start 2020-06-12T17:49:05.276 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.256+0000 7efc2c649700 1 -- start start 2020-06-12T17:49:05.276 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.256+0000 7efc2c649700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc240657b0 0x7efc24114df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:05.277 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.256+0000 7efc2c649700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc24064060 con 0x7efc100044d0 2020-06-12T17:49:05.277 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.256+0000 7efc2c649700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc24064300 con 0x7efc24121210 2020-06-12T17:49:05.277 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.256+0000 7efc2c649700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc24063e70 con 0x7efc240657b0 2020-06-12T17:49:05.278 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.256+0000 7efc2abe6700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7efc100044d0 0x7efc24120b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39068/0 (socket says 172.21.15.38:39068) 2020-06-12T17:49:05.278 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.256+0000 7efc2abe6700 1 -- 172.21.15.38:0/1411787618 learned_addr learned my addr 172.21.15.38:0/1411787618 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:05.278 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.257+0000 7efc2b3e7700 1 --2- 172.21.15.38:0/1411787618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc240657b0 0x7efc24114df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:05.279 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.257+0000 7efc1b7fe700 1 -- 172.21.15.38:0/1411787618 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539261959 0 0) 0x7efc24064060 con 0x7efc100044d0 2020-06-12T17:49:05.279 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.257+0000 7efc1b7fe700 1 -- 172.21.15.38:0/1411787618 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc0c003230 con 0x7efc100044d0 2020-06-12T17:49:05.280 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.257+0000 7efc1b7fe700 1 -- 172.21.15.38:0/1411787618 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2058224291 0 0) 0x7efc24064300 con 0x7efc24121210 2020-06-12T17:49:05.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.257+0000 7efc1b7fe700 1 -- 172.21.15.38:0/1411787618 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc24064060 con 0x7efc24121210 2020-06-12T17:49:05.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.257+0000 7efc2b3e7700 1 -- 172.21.15.38:0/1411787618 >> v1:172.21.15.150:6789/0 conn(0x7efc24121210 legacy=0x7efc24133dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:05.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.257+0000 7efc2b3e7700 1 -- 172.21.15.38:0/1411787618 >> v1:172.21.15.38:6789/0 conn(0x7efc100044d0 legacy=0x7efc24120b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:05.282 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.257+0000 7efc2b3e7700 1 -- 172.21.15.38:0/1411787618 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc241119e0 con 0x7efc240657b0 2020-06-12T17:49:05.282 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.257+0000 7efc2b3e7700 1 --2- 172.21.15.38:0/1411787618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc240657b0 0x7efc24114df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efc24060300 tx=0x7efc1c001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.282 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.257+0000 7efc2b3e7700 1 --2- 172.21.15.38:0/1411787618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc240657b0 0x7efc24114df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efc24060300 tx=0x7efc1c001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.257+0000 7efc2b3e7700 1 --2- 172.21.15.38:0/1411787618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc240657b0 0x7efc24114df0 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7efc24060300 tx=0x7efc1c001bc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:05.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.257+0000 7efc2b3e7700 1 --2- 172.21.15.38:0/1411787618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc240657b0 0x7efc24114df0 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7efc24060300 tx=0x7efc1c001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.257+0000 7efc1b7fe700 1 -- 172.21.15.38:0/1411787618 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc1c006e40 con 0x7efc240657b0 2020-06-12T17:49:05.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.257+0000 7efc2b3e7700 1 --2- 172.21.15.38:0/1411787618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc240657b0 0x7efc24114df0 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7efc24060300 tx=0x7efc1c001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.257+0000 7efc2b3e7700 1 --2- 172.21.15.38:0/1411787618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc240657b0 0x7efc24114df0 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7efc24060300 tx=0x7efc1c001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.257+0000 7efc1b7fe700 1 -- 172.21.15.38:0/1411787618 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c011030 con 0x7efc240657b0 2020-06-12T17:49:05.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.257+0000 7efc2c649700 1 -- 172.21.15.38:0/1411787618 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc24111c30 con 0x7efc240657b0 2020-06-12T17:49:05.285 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.257+0000 7efc1b7fe700 1 -- 172.21.15.38:0/1411787618 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc1c011390 con 0x7efc240657b0 2020-06-12T17:49:05.285 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.257+0000 7efc2c649700 1 -- 172.21.15.38:0/1411787618 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc241256a0 con 0x7efc240657b0 2020-06-12T17:49:05.285 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.258+0000 7efc2b3e7700 1 --2- 172.21.15.38:0/1411787618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc240657b0 0x7efc24114df0 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7efc24060300 tx=0x7efc1c001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.286 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.258+0000 7efc1b7fe700 1 -- 172.21.15.38:0/1411787618 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7efc1c0114f0 con 0x7efc240657b0 2020-06-12T17:49:05.286 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.258+0000 7efc2b3e7700 1 --2- 172.21.15.38:0/1411787618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc240657b0 0x7efc24114df0 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7efc24060300 tx=0x7efc1c001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.286 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.258+0000 7efc2c649700 1 -- 172.21.15.38:0/1411787618 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc24064490 con 0x7efc240657b0 2020-06-12T17:49:05.287 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.259+0000 7efc1b7fe700 1 --2- 172.21.15.38:0/1411787618 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efc0c04da30 0x7efc0c04fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:05.287 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.259+0000 7efc1b7fe700 1 -- 172.21.15.38:0/1411787618 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7efc1c060c30 con 0x7efc240657b0 2020-06-12T17:49:05.287 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.259+0000 7efc2abe6700 1 --2- 172.21.15.38:0/1411787618 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efc0c04da30 0x7efc0c04fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:05.288 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.259+0000 7efc2abe6700 1 --2- 172.21.15.38:0/1411787618 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efc0c04da30 0x7efc0c04fef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efc20001420 tx=0x7efc2000e8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.288 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.259+0000 7efc2abe6700 1 --2- 172.21.15.38:0/1411787618 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efc0c04da30 0x7efc0c04fef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efc20001420 tx=0x7efc2000e8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.288 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.259+0000 7efc2abe6700 1 --2- 172.21.15.38:0/1411787618 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efc0c04da30 0x7efc0c04fef0 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7efc20001420 tx=0x7efc2000e8b0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:05.289 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.262+0000 7efc2b3e7700 1 --2- 172.21.15.38:0/1411787618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc240657b0 0x7efc24114df0 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7efc24060300 tx=0x7efc1c001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.290 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.262+0000 7efc1b7fe700 1 -- 172.21.15.38:0/1411787618 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7efc1c03c430 con 0x7efc240657b0 2020-06-12T17:49:05.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.466+0000 7efc2c649700 1 -- 172.21.15.38:0/1411787618 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7efc24056c30 con 0x7efc240657b0 2020-06-12T17:49:05.473 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.470+0000 7efc2b3e7700 1 --2- 172.21.15.38:0/1411787618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc240657b0 0x7efc24114df0 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7efc24060300 tx=0x7efc1c001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.474 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.470+0000 7efc1b7fe700 1 -- 172.21.15.38:0/1411787618 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v14) v1 ==== 184+0+0 (secure 0 0 0) 0x7efc1c03fa50 con 0x7efc240657b0 2020-06-12T17:49:05.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.471+0000 7efc2c649700 1 -- 172.21.15.38:0/1411787618 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efc0c04da30 msgr2=0x7efc0c04fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:05.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.471+0000 7efc2c649700 1 --2- 172.21.15.38:0/1411787618 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efc0c04da30 0x7efc0c04fef0 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7efc20001420 tx=0x7efc2000e8b0).stop 2020-06-12T17:49:05.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.471+0000 7efc2c649700 1 -- 172.21.15.38:0/1411787618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc240657b0 msgr2=0x7efc24114df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:05.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.471+0000 7efc2c649700 1 --2- 172.21.15.38:0/1411787618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc240657b0 0x7efc24114df0 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7efc24060300 tx=0x7efc1c001bc0).stop 2020-06-12T17:49:05.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.471+0000 7efc2c649700 1 -- 172.21.15.38:0/1411787618 shutdown_connections 2020-06-12T17:49:05.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.471+0000 7efc2c649700 1 --2- 172.21.15.38:0/1411787618 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efc0c04da30 0x7efc0c04fef0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:05.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.471+0000 7efc2c649700 1 --2- 172.21.15.38:0/1411787618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc240657b0 0x7efc24114df0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:05.478 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.471+0000 7efc2c649700 1 -- 172.21.15.38:0/1411787618 >> 172.21.15.38:0/1411787618 conn(0x7efc240b8200 msgr2=0x7efc240b7950 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:05.478 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.471+0000 7efc2c649700 1 -- 172.21.15.38:0/1411787618 shutdown_connections 2020-06-12T17:49:05.478 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.472+0000 7efc2c649700 1 -- 172.21.15.38:0/1411787618 wait complete. 2020-06-12T17:49:05.481 INFO:teuthology.orchestra.run.smithi038.stderr:updated caps for client.2 2020-06-12T17:49:05.486 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-06-12T17:49:05.616 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.604+0000 7fc955991700 1 Processor -- start 2020-06-12T17:49:05.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.604+0000 7fc955991700 1 -- start start 2020-06-12T17:49:05.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.605+0000 7fc955991700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc9501527c0 0x7fc9500ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:05.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.605+0000 7fc955991700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9500aee10 0x7fc95005ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:05.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.605+0000 7fc955991700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9500ace40 con 0x7fc9501523e0 2020-06-12T17:49:05.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.605+0000 7fc955991700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9500ad0e0 con 0x7fc9501527c0 2020-06-12T17:49:05.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.605+0000 7fc955991700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc950066990 con 0x7fc9500aee10 2020-06-12T17:49:05.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.605+0000 7fc94ffff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9500aee10 0x7fc95005ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:05.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.605+0000 7fc94effd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc9501527c0 0x7fc9500ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:05.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.605+0000 7fc94ffff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9500aee10 0x7fc95005ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:56720/0 (socket says 172.21.15.38:56720) 2020-06-12T17:49:05.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.605+0000 7fc94f7fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fc9501523e0 0x7fc9500b3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:59808/0 (socket says 172.21.15.38:59808) 2020-06-12T17:49:05.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.605+0000 7fc94ffff700 1 -- 172.21.15.38:0/3575958185 learned_addr learned my addr 172.21.15.38:0/3575958185 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:05.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.606+0000 7fc94ffff700 1 -- 172.21.15.38:0/3575958185 >> v2:172.21.15.150:3300/0 conn(0x7fc9501527c0 msgr2=0x7fc9500ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:05.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.606+0000 7fc94ffff700 1 --2- 172.21.15.38:0/3575958185 >> v2:172.21.15.150:3300/0 conn(0x7fc9501527c0 0x7fc9500ae9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:05.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.606+0000 7fc94ffff700 1 -- 172.21.15.38:0/3575958185 >> v1:172.21.15.150:6789/0 conn(0x7fc9501523e0 legacy=0x7fc9500b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:05.624 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.606+0000 7fc94ffff700 1 -- 172.21.15.38:0/3575958185 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc950066b00 con 0x7fc9500aee10 2020-06-12T17:49:05.625 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.606+0000 7fc94effd700 1 --2- 172.21.15.38:0/3575958185 >> v2:172.21.15.150:3300/0 conn(0x7fc9501527c0 0x7fc9500ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:49:05.625 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.606+0000 7fc94ffff700 1 --2- 172.21.15.38:0/3575958185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9500aee10 0x7fc95005ac00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc9480032b0 tx=0x7fc9480081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.626 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.606+0000 7fc94ffff700 1 --2- 172.21.15.38:0/3575958185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9500aee10 0x7fc95005ac00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc9480032b0 tx=0x7fc9480081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.626 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.606+0000 7fc94ffff700 1 --2- 172.21.15.38:0/3575958185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9500aee10 0x7fc95005ac00 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fc9480032b0 tx=0x7fc9480081e0).ready entity=mon.2 client_cookie=b68ed734dd6d1cc5 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:05.627 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.606+0000 7fc94ffff700 1 --2- 172.21.15.38:0/3575958185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9500aee10 0x7fc95005ac00 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fc9480032b0 tx=0x7fc9480081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.629 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.606+0000 7fc94e7fc700 1 -- 172.21.15.38:0/3575958185 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc948011ea0 con 0x7fc9500aee10 2020-06-12T17:49:05.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.606+0000 7fc94ffff700 1 --2- 172.21.15.38:0/3575958185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9500aee10 0x7fc95005ac00 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fc9480032b0 tx=0x7fc9480081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.606+0000 7fc94ffff700 1 --2- 172.21.15.38:0/3575958185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9500aee10 0x7fc95005ac00 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fc9480032b0 tx=0x7fc9480081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.606+0000 7fc94e7fc700 1 -- 172.21.15.38:0/3575958185 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94800a160 con 0x7fc9500aee10 2020-06-12T17:49:05.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.606+0000 7fc94e7fc700 1 -- 172.21.15.38:0/3575958185 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc94800a580 con 0x7fc9500aee10 2020-06-12T17:49:05.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.606+0000 7fc955991700 1 -- 172.21.15.38:0/3575958185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9500aee10 msgr2=0x7fc95005ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:05.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.606+0000 7fc955991700 1 --2- 172.21.15.38:0/3575958185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9500aee10 0x7fc95005ac00 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fc9480032b0 tx=0x7fc9480081e0).stop 2020-06-12T17:49:05.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.607+0000 7fc955991700 1 -- 172.21.15.38:0/3575958185 shutdown_connections 2020-06-12T17:49:05.634 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.607+0000 7fc955991700 1 --2- 172.21.15.38:0/3575958185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9500aee10 0x7fc95005ac00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:05.635 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.607+0000 7fc955991700 1 --2- 172.21.15.38:0/3575958185 >> v2:172.21.15.150:3300/0 conn(0x7fc9501527c0 0x7fc9500ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:05.635 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.607+0000 7fc955991700 1 -- 172.21.15.38:0/3575958185 >> 172.21.15.38:0/3575958185 conn(0x7fc9500b8200 msgr2=0x7fc9500b8610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:05.635 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.607+0000 7fc955991700 1 -- 172.21.15.38:0/3575958185 shutdown_connections 2020-06-12T17:49:05.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.607+0000 7fc955991700 1 -- 172.21.15.38:0/3575958185 wait complete. 2020-06-12T17:49:05.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.608+0000 7fc955991700 1 Processor -- start 2020-06-12T17:49:05.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.608+0000 7fc955991700 1 -- start start 2020-06-12T17:49:05.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.609+0000 7fc955991700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9501523e0 0x7fc950063250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:05.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.609+0000 7fc955991700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc9501527c0 0x7fc9501150c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:05.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.609+0000 7fc955991700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc950126310 con 0x7fc9500aee10 2020-06-12T17:49:05.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.609+0000 7fc955991700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc950126540 con 0x7fc9501527c0 2020-06-12T17:49:05.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.609+0000 7fc955991700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9501267e0 con 0x7fc9501523e0 2020-06-12T17:49:05.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.609+0000 7fc94ffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc9501527c0 0x7fc9501150c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:05.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.609+0000 7fc94effd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9501523e0 0x7fc950063250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:05.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.609+0000 7fc94ffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc9501527c0 0x7fc9501150c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:46744/0 (socket says 172.21.15.38:46744) 2020-06-12T17:49:05.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.609+0000 7fc94f7fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fc9500aee10 0x7fc950115a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:59812/0 (socket says 172.21.15.38:59812) 2020-06-12T17:49:05.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.609+0000 7fc94ffff700 1 -- 172.21.15.38:0/1096225867 learned_addr learned my addr 172.21.15.38:0/1096225867 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:05.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.609+0000 7fc937fff700 1 -- 172.21.15.38:0/1096225867 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3552259703 0 0) 0x7fc950126310 con 0x7fc9500aee10 2020-06-12T17:49:05.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.609+0000 7fc937fff700 1 -- 172.21.15.38:0/1096225867 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc930003230 con 0x7fc9500aee10 2020-06-12T17:49:05.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.609+0000 7fc94effd700 1 -- 172.21.15.38:0/1096225867 >> v2:172.21.15.150:3300/0 conn(0x7fc9501527c0 msgr2=0x7fc9501150c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:05.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.609+0000 7fc94effd700 1 --2- 172.21.15.38:0/1096225867 >> v2:172.21.15.150:3300/0 conn(0x7fc9501527c0 0x7fc9501150c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:05.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.609+0000 7fc94effd700 1 -- 172.21.15.38:0/1096225867 >> v1:172.21.15.150:6789/0 conn(0x7fc9500aee10 legacy=0x7fc950115a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:05.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.610+0000 7fc94effd700 1 -- 172.21.15.38:0/1096225867 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc950062ed0 con 0x7fc9501523e0 2020-06-12T17:49:05.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.610+0000 7fc94effd700 1 --2- 172.21.15.38:0/1096225867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9501523e0 0x7fc950063250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc944002f30 tx=0x7fc944007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.610+0000 7fc94effd700 1 --2- 172.21.15.38:0/1096225867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9501523e0 0x7fc950063250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc944002f30 tx=0x7fc944007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.610+0000 7fc94effd700 1 --2- 172.21.15.38:0/1096225867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9501523e0 0x7fc950063250 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7fc944002f30 tx=0x7fc944007e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:05.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.610+0000 7fc94effd700 1 --2- 172.21.15.38:0/1096225867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9501523e0 0x7fc950063250 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fc944002f30 tx=0x7fc944007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.610+0000 7fc937fff700 1 -- 172.21.15.38:0/1096225867 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc944012af0 con 0x7fc9501523e0 2020-06-12T17:49:05.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.610+0000 7fc94effd700 1 --2- 172.21.15.38:0/1096225867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9501523e0 0x7fc950063250 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fc944002f30 tx=0x7fc944007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.610+0000 7fc94effd700 1 --2- 172.21.15.38:0/1096225867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9501523e0 0x7fc950063250 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fc944002f30 tx=0x7fc944007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.610+0000 7fc937fff700 1 -- 172.21.15.38:0/1096225867 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc944012c50 con 0x7fc9501523e0 2020-06-12T17:49:05.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.610+0000 7fc937fff700 1 -- 172.21.15.38:0/1096225867 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc944012dc0 con 0x7fc9501523e0 2020-06-12T17:49:05.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.610+0000 7fc955991700 1 -- 172.21.15.38:0/1096225867 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc950116170 con 0x7fc9501523e0 2020-06-12T17:49:05.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.610+0000 7fc955991700 1 -- 172.21.15.38:0/1096225867 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc950061740 con 0x7fc9501523e0 2020-06-12T17:49:05.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.611+0000 7fc94effd700 1 --2- 172.21.15.38:0/1096225867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9501523e0 0x7fc950063250 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fc944002f30 tx=0x7fc944007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.611+0000 7fc955991700 1 -- 172.21.15.38:0/1096225867 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc950056c30 con 0x7fc9501523e0 2020-06-12T17:49:05.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.611+0000 7fc937fff700 1 -- 172.21.15.38:0/1096225867 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fc944007180 con 0x7fc9501523e0 2020-06-12T17:49:05.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.611+0000 7fc94effd700 1 --2- 172.21.15.38:0/1096225867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9501523e0 0x7fc950063250 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fc944002f30 tx=0x7fc944007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.611+0000 7fc937fff700 1 --2- 172.21.15.38:0/1096225867 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc93004d8a0 0x7fc93004fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:05.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.611+0000 7fc937fff700 1 -- 172.21.15.38:0/1096225867 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc944061190 con 0x7fc9501523e0 2020-06-12T17:49:05.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.612+0000 7fc94f7fe700 1 --2- 172.21.15.38:0/1096225867 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc93004d8a0 0x7fc93004fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:05.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.612+0000 7fc94f7fe700 1 --2- 172.21.15.38:0/1096225867 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc93004d8a0 0x7fc93004fd60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc940000fe0 tx=0x7fc940001540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.612+0000 7fc94f7fe700 1 --2- 172.21.15.38:0/1096225867 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc93004d8a0 0x7fc93004fd60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc940000fe0 tx=0x7fc940001540).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.612+0000 7fc94f7fe700 1 --2- 172.21.15.38:0/1096225867 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc93004d8a0 0x7fc93004fd60 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7fc940000fe0 tx=0x7fc940001540).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:05.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.615+0000 7fc94effd700 1 --2- 172.21.15.38:0/1096225867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9501523e0 0x7fc950063250 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fc944002f30 tx=0x7fc944007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.615+0000 7fc937fff700 1 -- 172.21.15.38:0/1096225867 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fc94403c990 con 0x7fc9501523e0 2020-06-12T17:49:05.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.820+0000 7fc955991700 1 -- 172.21.15.38:0/1096225867 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fc9500b6a80 con 0x7fc9501523e0 2020-06-12T17:49:05.830 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.827+0000 7fc94effd700 1 --2- 172.21.15.38:0/1096225867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9501523e0 0x7fc950063250 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fc944002f30 tx=0x7fc944007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.830 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.827+0000 7fc937fff700 1 -- 172.21.15.38:0/1096225867 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v15) v1 ==== 184+0+0 (secure 0 0 0) 0x7fc94403ffb0 con 0x7fc9501523e0 2020-06-12T17:49:05.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.828+0000 7fc955991700 1 -- 172.21.15.38:0/1096225867 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc93004d8a0 msgr2=0x7fc93004fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:05.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.828+0000 7fc955991700 1 --2- 172.21.15.38:0/1096225867 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc93004d8a0 0x7fc93004fd60 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7fc940000fe0 tx=0x7fc940001540).stop 2020-06-12T17:49:05.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.828+0000 7fc955991700 1 -- 172.21.15.38:0/1096225867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9501523e0 msgr2=0x7fc950063250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:05.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.828+0000 7fc955991700 1 --2- 172.21.15.38:0/1096225867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9501523e0 0x7fc950063250 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7fc944002f30 tx=0x7fc944007e60).stop 2020-06-12T17:49:05.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.828+0000 7fc955991700 1 -- 172.21.15.38:0/1096225867 shutdown_connections 2020-06-12T17:49:05.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.828+0000 7fc955991700 1 --2- 172.21.15.38:0/1096225867 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc93004d8a0 0x7fc93004fd60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:05.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.828+0000 7fc955991700 1 --2- 172.21.15.38:0/1096225867 >> v2:172.21.15.150:3300/0 conn(0x7fc9501527c0 0x7fc9501150c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:05.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.828+0000 7fc955991700 1 --2- 172.21.15.38:0/1096225867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9501523e0 0x7fc950063250 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.828+0000 7fc955991700 1 -- 172.21.15.38:0/1096225867 >> 172.21.15.38:0/1096225867 conn(0x7fc9500b8200 msgr2=0x7fc9500b7950 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.828+0000 7fc955991700 1 -- 172.21.15.38:0/1096225867 shutdown_connections 2020-06-12T17:49:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.828+0000 7fc955991700 1 -- 172.21.15.38:0/1096225867 wait complete. 2020-06-12T17:49:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:updated caps for client.3 2020-06-12T17:49:05.842 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-06-12T17:49:05.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.953+0000 7f0e09c96700 1 Processor -- start 2020-06-12T17:49:05.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.953+0000 7f0e09c96700 1 -- start start 2020-06-12T17:49:05.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.954+0000 7f0e09c96700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0e040623f0 0x7f0e040b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:05.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.954+0000 7f0e09c96700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e04145b00 0x7f0e04145f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:05.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.954+0000 7f0e09c96700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e0409b920 con 0x7f0e0405b410 2020-06-12T17:49:05.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.954+0000 7f0e09c96700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e04067250 con 0x7f0e040623f0 2020-06-12T17:49:05.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.954+0000 7f0e09c96700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0405bb20 con 0x7f0e04145b00 2020-06-12T17:49:05.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.954+0000 7f0e03fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e04145b00 0x7f0e04145f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:05.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.954+0000 7f0e037fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0e040623f0 0x7f0e040b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:05.962 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.954+0000 7f0e03fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e04145b00 0x7f0e04145f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:56734/0 (socket says 172.21.15.38:56734) 2020-06-12T17:49:05.962 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.954+0000 7f0e037fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0e040623f0 0x7f0e040b49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:46748/0 (socket says 172.21.15.38:46748) 2020-06-12T17:49:05.962 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.954+0000 7f0e03fff700 1 -- 172.21.15.38:0/3738249489 learned_addr learned my addr 172.21.15.38:0/3738249489 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:05.966 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.954+0000 7f0e02ffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f0e0405b410 0x7f0e0413c250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:59822/0 (socket says 172.21.15.38:59822) 2020-06-12T17:49:05.966 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.954+0000 7f0e027fc700 1 -- 172.21.15.38:0/3738249489 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 268158798 0 0) 0x7f0e0409b920 con 0x7f0e0405b410 2020-06-12T17:49:05.967 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.955+0000 7f0e027fc700 1 -- 172.21.15.38:0/3738249489 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0df0003230 con 0x7f0e0405b410 2020-06-12T17:49:05.967 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.955+0000 7f0e03fff700 1 -- 172.21.15.38:0/3738249489 >> v2:172.21.15.150:3300/0 conn(0x7f0e040623f0 msgr2=0x7f0e040b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:05.967 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.955+0000 7f0e03fff700 1 --2- 172.21.15.38:0/3738249489 >> v2:172.21.15.150:3300/0 conn(0x7f0e040623f0 0x7f0e040b49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:05.967 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.955+0000 7f0e03fff700 1 -- 172.21.15.38:0/3738249489 >> v1:172.21.15.150:6789/0 conn(0x7f0e0405b410 legacy=0x7f0e0413c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:05.967 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.955+0000 7f0e03fff700 1 -- 172.21.15.38:0/3738249489 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0405b890 con 0x7f0e04145b00 2020-06-12T17:49:05.968 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.955+0000 7f0e03fff700 1 --2- 172.21.15.38:0/3738249489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e04145b00 0x7f0e04145f90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0dfc0032b0 tx=0x7f0dfc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.968 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.955+0000 7f0e03fff700 1 --2- 172.21.15.38:0/3738249489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e04145b00 0x7f0e04145f90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0dfc0032b0 tx=0x7f0dfc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.968 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.955+0000 7f0e03fff700 1 --2- 172.21.15.38:0/3738249489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e04145b00 0x7f0e04145f90 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f0dfc0032b0 tx=0x7f0dfc0081e0).ready entity=mon.2 client_cookie=f30f9ad83ec3578a server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:05.968 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.955+0000 7f0e03fff700 1 --2- 172.21.15.38:0/3738249489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e04145b00 0x7f0e04145f90 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f0dfc0032b0 tx=0x7f0dfc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.968 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.955+0000 7f0e027fc700 1 -- 172.21.15.38:0/3738249489 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dfc011df0 con 0x7f0e04145b00 2020-06-12T17:49:05.969 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.955+0000 7f0e03fff700 1 --2- 172.21.15.38:0/3738249489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e04145b00 0x7f0e04145f90 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f0dfc0032b0 tx=0x7f0dfc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.969 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.955+0000 7f0e027fc700 1 -- 172.21.15.38:0/3738249489 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dfc00a160 con 0x7f0e04145b00 2020-06-12T17:49:05.969 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.955+0000 7f0e03fff700 1 --2- 172.21.15.38:0/3738249489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e04145b00 0x7f0e04145f90 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f0dfc0032b0 tx=0x7f0dfc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.970 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.955+0000 7f0e027fc700 1 -- 172.21.15.38:0/3738249489 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dfc00a540 con 0x7f0e04145b00 2020-06-12T17:49:05.970 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.955+0000 7f0e09c96700 1 -- 172.21.15.38:0/3738249489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e04145b00 msgr2=0x7f0e04145f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:05.970 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.955+0000 7f0e09c96700 1 --2- 172.21.15.38:0/3738249489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e04145b00 0x7f0e04145f90 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f0dfc0032b0 tx=0x7f0dfc0081e0).stop 2020-06-12T17:49:05.970 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.955+0000 7f0e09c96700 1 -- 172.21.15.38:0/3738249489 shutdown_connections 2020-06-12T17:49:05.971 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.955+0000 7f0e09c96700 1 --2- 172.21.15.38:0/3738249489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e04145b00 0x7f0e04145f90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:05.971 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.955+0000 7f0e09c96700 1 --2- 172.21.15.38:0/3738249489 >> v2:172.21.15.150:3300/0 conn(0x7f0e040623f0 0x7f0e040b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:05.971 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.955+0000 7f0e09c96700 1 -- 172.21.15.38:0/3738249489 >> 172.21.15.38:0/3738249489 conn(0x7f0e040b8420 msgr2=0x7f0e040b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:05.971 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.955+0000 7f0e09c96700 1 -- 172.21.15.38:0/3738249489 shutdown_connections 2020-06-12T17:49:05.971 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.956+0000 7f0e09c96700 1 -- 172.21.15.38:0/3738249489 wait complete. 2020-06-12T17:49:05.972 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.956+0000 7f0e09c96700 1 Processor -- start 2020-06-12T17:49:05.972 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.957+0000 7f0e09c96700 1 -- start start 2020-06-12T17:49:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.957+0000 7f0e09c96700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0e0405b410 0x7f0e04090210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.957+0000 7f0e09c96700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0e040623f0 0x7f0e041539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.957+0000 7f0e09c96700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e0408f830 con 0x7f0e04145b00 2020-06-12T17:49:05.976 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.957+0000 7f0e09c96700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e0408fad0 con 0x7f0e0405b410 2020-06-12T17:49:05.976 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.957+0000 7f0e09c96700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e0408fd70 con 0x7f0e040623f0 2020-06-12T17:49:05.976 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.958+0000 7f0e037fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0e0405b410 0x7f0e04090210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:05.976 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.958+0000 7f0e03fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f0e04145b00 0x7f0e040b0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39098/0 (socket says 172.21.15.38:39098) 2020-06-12T17:49:05.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.958+0000 7f0e03fff700 1 -- 172.21.15.38:0/1055656072 learned_addr learned my addr 172.21.15.38:0/1055656072 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:05.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.958+0000 7f0e02ffd700 1 --2- 172.21.15.38:0/1055656072 >> v2:172.21.15.150:3300/0 conn(0x7f0e040623f0 0x7f0e041539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:05.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.958+0000 7f0e037fe700 1 -- 172.21.15.38:0/1055656072 >> v2:172.21.15.150:3300/0 conn(0x7f0e040623f0 msgr2=0x7f0e041539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:05.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.958+0000 7f0e037fe700 1 --2- 172.21.15.38:0/1055656072 >> v2:172.21.15.150:3300/0 conn(0x7f0e040623f0 0x7f0e041539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:05.978 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.958+0000 7f0e037fe700 1 -- 172.21.15.38:0/1055656072 >> v1:172.21.15.38:6789/0 conn(0x7f0e04145b00 legacy=0x7f0e040b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:05.978 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.958+0000 7f0e00ff9700 1 -- 172.21.15.38:0/1055656072 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031618864 0 0) 0x7f0e0408f830 con 0x7f0e04145b00 2020-06-12T17:49:05.978 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.958+0000 7f0e037fe700 1 -- 172.21.15.38:0/1055656072 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0408f440 con 0x7f0e0405b410 2020-06-12T17:49:05.978 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.958+0000 7f0e037fe700 1 --2- 172.21.15.38:0/1055656072 >> v2:172.21.15.38:3300/0 conn(0x7f0e0405b410 0x7f0e04090210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0df4002f30 tx=0x7f0df4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.978 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.958+0000 7f0e037fe700 1 --2- 172.21.15.38:0/1055656072 >> v2:172.21.15.38:3300/0 conn(0x7f0e0405b410 0x7f0e04090210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0df4002f30 tx=0x7f0df4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.979 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.958+0000 7f0e037fe700 1 --2- 172.21.15.38:0/1055656072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e0405b410 0x7f0e04090210 secure :-1 s=READY pgs=403 cs=0 l=1 rx=0x7f0df4002f30 tx=0x7f0df4007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:05.979 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.958+0000 7f0e037fe700 1 --2- 172.21.15.38:0/1055656072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e0405b410 0x7f0e04090210 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7f0df4002f30 tx=0x7f0df4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.979 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.958+0000 7f0e00ff9700 1 -- 172.21.15.38:0/1055656072 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0df4007530 con 0x7f0e0405b410 2020-06-12T17:49:05.979 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.958+0000 7f0e09c96700 1 -- 172.21.15.38:0/1055656072 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e040aeff0 con 0x7f0e0405b410 2020-06-12T17:49:05.979 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.958+0000 7f0e037fe700 1 --2- 172.21.15.38:0/1055656072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e0405b410 0x7f0e04090210 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7f0df4002f30 tx=0x7f0df4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.980 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.958+0000 7f0e00ff9700 1 -- 172.21.15.38:0/1055656072 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df40056c0 con 0x7f0e0405b410 2020-06-12T17:49:05.980 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.958+0000 7f0e037fe700 1 --2- 172.21.15.38:0/1055656072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e0405b410 0x7f0e04090210 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7f0df4002f30 tx=0x7f0df4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.980 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.958+0000 7f0e00ff9700 1 -- 172.21.15.38:0/1055656072 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0df4005aa0 con 0x7f0e0405b410 2020-06-12T17:49:05.980 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.958+0000 7f0e09c96700 1 -- 172.21.15.38:0/1055656072 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e04154390 con 0x7f0e0405b410 2020-06-12T17:49:05.981 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.959+0000 7f0e037fe700 1 --2- 172.21.15.38:0/1055656072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e0405b410 0x7f0e04090210 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7f0df4002f30 tx=0x7f0df4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.981 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.959+0000 7f0e09c96700 1 -- 172.21.15.38:0/1055656072 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e0408f630 con 0x7f0e0405b410 2020-06-12T17:49:05.981 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.959+0000 7f0e00ff9700 1 -- 172.21.15.38:0/1055656072 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f0df4005d20 con 0x7f0e0405b410 2020-06-12T17:49:05.981 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.959+0000 7f0e037fe700 1 --2- 172.21.15.38:0/1055656072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e0405b410 0x7f0e04090210 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7f0df4002f30 tx=0x7f0df4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.981 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.960+0000 7f0e00ff9700 1 --2- 172.21.15.38:0/1055656072 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0de404d350 0x7f0de404f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:05.982 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.960+0000 7f0e00ff9700 1 -- 172.21.15.38:0/1055656072 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0df400d0c0 con 0x7f0e0405b410 2020-06-12T17:49:05.982 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.960+0000 7f0e02ffd700 1 --2- 172.21.15.38:0/1055656072 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0de404d350 0x7f0de404f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:05.982 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.960+0000 7f0e02ffd700 1 --2- 172.21.15.38:0/1055656072 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0de404d350 0x7f0de404f810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0df80010d0 tx=0x7f0df8001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.982 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.960+0000 7f0e02ffd700 1 --2- 172.21.15.38:0/1055656072 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0de404d350 0x7f0de404f810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0df80010d0 tx=0x7f0df8001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.982 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.960+0000 7f0e02ffd700 1 --2- 172.21.15.38:0/1055656072 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0de404d350 0x7f0de404f810 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7f0df80010d0 tx=0x7f0df8001780).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:05.983 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.963+0000 7f0e037fe700 1 --2- 172.21.15.38:0/1055656072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e0405b410 0x7f0e04090210 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7f0df4002f30 tx=0x7f0df4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:05.983 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:05.963+0000 7f0e00ff9700 1 -- 172.21.15.38:0/1055656072 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f0df403c8d0 con 0x7f0e0405b410 2020-06-12T17:49:06.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.161+0000 7f0e09c96700 1 -- 172.21.15.38:0/1055656072 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e04056c30 con 0x7f0e0405b410 2020-06-12T17:49:06.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.161+0000 7f0e037fe700 1 --2- 172.21.15.38:0/1055656072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e0405b410 0x7f0e04090210 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7f0df4002f30 tx=0x7f0df4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.161+0000 7f0e00ff9700 1 -- 172.21.15.38:0/1055656072 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f0df403fef0 con 0x7f0e0405b410 2020-06-12T17:49:06.166 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:49:06.166 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.38:6833/1552225333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1552225333},{"type":"v1","addr":"172.21.15.38:6833","nonce":1552225333}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-06-12T17:49:02.759507+0000","modified":"2020-06-12T17:49:03.760890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5008},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5008":{"gid":5008,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2576246531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2576246531},{"type":"v1","addr":"172.21.15.150:6835","nonce":2576246531}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-06-12T17:49:06.167 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.162+0000 7f0e09c96700 1 -- 172.21.15.38:0/1055656072 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0de404d350 msgr2=0x7f0de404f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:06.167 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.162+0000 7f0e09c96700 1 --2- 172.21.15.38:0/1055656072 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0de404d350 0x7f0de404f810 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7f0df80010d0 tx=0x7f0df8001780).stop 2020-06-12T17:49:06.168 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.162+0000 7f0e09c96700 1 -- 172.21.15.38:0/1055656072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e0405b410 msgr2=0x7f0e04090210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:06.168 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.162+0000 7f0e09c96700 1 --2- 172.21.15.38:0/1055656072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e0405b410 0x7f0e04090210 secure :-1 s=READY pgs=403 cs=0 l=1 rx=0x7f0df4002f30 tx=0x7f0df4007e60).stop 2020-06-12T17:49:06.168 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.163+0000 7f0e09c96700 1 -- 172.21.15.38:0/1055656072 shutdown_connections 2020-06-12T17:49:06.169 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.163+0000 7f0e09c96700 1 --2- 172.21.15.38:0/1055656072 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0de404d350 0x7f0de404f810 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:06.169 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.163+0000 7f0e09c96700 1 --2- 172.21.15.38:0/1055656072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e0405b410 0x7f0e04090210 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:06.169 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.163+0000 7f0e09c96700 1 --2- 172.21.15.38:0/1055656072 >> v2:172.21.15.150:3300/0 conn(0x7f0e040623f0 0x7f0e041539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:06.170 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.163+0000 7f0e09c96700 1 -- 172.21.15.38:0/1055656072 >> 172.21.15.38:0/1055656072 conn(0x7f0e040b8420 msgr2=0x7f0e0409d740 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:06.170 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.163+0000 7f0e09c96700 1 -- 172.21.15.38:0/1055656072 shutdown_connections 2020-06-12T17:49:06.170 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.163+0000 7f0e09c96700 1 -- 172.21.15.38:0/1055656072 wait complete. 2020-06-12T17:49:06.170 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 12 2020-06-12T17:49:06.378 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-06-12T17:49:02.759507+0000', 'modified': '2020-06-12T17:49:03.760890+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5008}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5008': {'gid': 5008, 'name': 'b', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6835/2576246531', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6834', 'nonce': 2576246531}, {'type': 'v1', 'addr': '172.21.15.150:6835', 'nonce': 2576246531}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292836696063, 'flags': 0}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-06-12T17:49:06.379 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-06-12T17:49:06.380 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-06-12T17:49:06.512 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2020-06-12T17:49:06.513 INFO:teuthology.orchestra.run.smithi150.stdout: "cluster_fsid": "8e42a2e7-b187-42c4-a73f-8f812ee62352", 2020-06-12T17:49:06.513 INFO:teuthology.orchestra.run.smithi150.stdout: "whoami": 0, 2020-06-12T17:49:06.513 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 5008, 2020-06-12T17:49:06.514 INFO:teuthology.orchestra.run.smithi150.stdout: "want_state": "up:active", 2020-06-12T17:49:06.514 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "up:active", 2020-06-12T17:49:06.514 INFO:teuthology.orchestra.run.smithi150.stdout: "rank_uptime": 3.748413196, 2020-06-12T17:49:06.514 INFO:teuthology.orchestra.run.smithi150.stdout: "mdsmap_epoch": 12, 2020-06-12T17:49:06.514 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch": 34, 2020-06-12T17:49:06.514 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch_barrier": 33, 2020-06-12T17:49:06.515 INFO:teuthology.orchestra.run.smithi150.stdout: "uptime": 10.996460214000001 2020-06-12T17:49:06.515 INFO:teuthology.orchestra.run.smithi150.stdout:} 2020-06-12T17:49:06.521 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "8e42a2e7-b187-42c4-a73f-8f812ee62352", "whoami": 0, "id": 5008, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.748413196, "mdsmap_epoch": 12, "osdmap_epoch": 34, "osdmap_epoch_barrier": 33, "uptime": 10.996460214000001 } 2020-06-12T17:49:06.522 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-12T17:49:06.641 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.637+0000 7f2b82c89700 1 Processor -- start 2020-06-12T17:49:06.641 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.637+0000 7f2b82c89700 1 -- start start 2020-06-12T17:49:06.644 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.638+0000 7f2b82c89700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b7c061a80 0x7f2b7c09bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:06.644 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.638+0000 7f2b82c89700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2b7c0b44a0 0x7f2b7c1427b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:06.644 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.638+0000 7f2b82c89700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7c0b2dc0 con 0x7f2b7c142350 2020-06-12T17:49:06.644 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.638+0000 7f2b82c89700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b7c09e560 con 0x7f2b7c0b44a0 2020-06-12T17:49:06.645 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.638+0000 7f2b82c89700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0b29d0 con 0x7f2b7c061a80 2020-06-12T17:49:06.645 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.638+0000 7f2b81226700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2b7c0b44a0 0x7f2b7c1427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:06.645 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.638+0000 7f2b81226700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2b7c0b44a0 0x7f2b7c1427b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37290/0 (socket says 172.21.15.38:37290) 2020-06-12T17:49:06.645 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.638+0000 7f2b81226700 1 -- 172.21.15.38:0/1746612898 learned_addr learned my addr 172.21.15.38:0/1746612898 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:06.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.638+0000 7f2b80a25700 1 --2- 172.21.15.38:0/1746612898 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b7c061a80 0x7f2b7c09bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:06.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.638+0000 7f2b81226700 1 -- 172.21.15.38:0/1746612898 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b7c061a80 msgr2=0x7f2b7c09bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:06.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.638+0000 7f2b81226700 1 --2- 172.21.15.38:0/1746612898 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b7c061a80 0x7f2b7c09bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:06.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.638+0000 7f2b81226700 1 -- 172.21.15.38:0/1746612898 >> v1:172.21.15.150:6789/0 conn(0x7f2b7c142350 legacy=0x7f2b7c146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:06.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.638+0000 7f2b81226700 1 -- 172.21.15.38:0/1746612898 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c0b2ff0 con 0x7f2b7c0b44a0 2020-06-12T17:49:06.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.638+0000 7f2b80a25700 1 --2- 172.21.15.38:0/1746612898 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b7c061a80 0x7f2b7c09bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:49:06.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.638+0000 7f2b81226700 1 --2- 172.21.15.38:0/1746612898 >> v2:172.21.15.38:3300/0 conn(0x7f2b7c0b44a0 0x7f2b7c1427b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2b740032b0 tx=0x7f2b740081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.638+0000 7f2b81226700 1 --2- 172.21.15.38:0/1746612898 >> v2:172.21.15.38:3300/0 conn(0x7f2b7c0b44a0 0x7f2b7c1427b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2b740032b0 tx=0x7f2b740081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.638+0000 7f2b81226700 1 --2- 172.21.15.38:0/1746612898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7c0b44a0 0x7f2b7c1427b0 secure :-1 s=READY pgs=404 cs=0 l=1 rx=0x7f2b740032b0 tx=0x7f2b740081e0).ready entity=mon.0 client_cookie=4ecce8e422695555 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:06.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.639+0000 7f2b81226700 1 --2- 172.21.15.38:0/1746612898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7c0b44a0 0x7f2b7c1427b0 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7f2b740032b0 tx=0x7f2b740081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.639+0000 7f2b7b7fe700 1 -- 172.21.15.38:0/1746612898 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b7400a160 con 0x7f2b7c0b44a0 2020-06-12T17:49:06.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.639+0000 7f2b81226700 1 --2- 172.21.15.38:0/1746612898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7c0b44a0 0x7f2b7c1427b0 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7f2b740032b0 tx=0x7f2b740081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.639+0000 7f2b81226700 1 --2- 172.21.15.38:0/1746612898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7c0b44a0 0x7f2b7c1427b0 secure :-1 s=THROTTLE_DONE pgs=404 cs=0 l=1 rx=0x7f2b740032b0 tx=0x7f2b740081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.639+0000 7f2b7b7fe700 1 -- 172.21.15.38:0/1746612898 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7400a2c0 con 0x7f2b7c0b44a0 2020-06-12T17:49:06.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.639+0000 7f2b7b7fe700 1 -- 172.21.15.38:0/1746612898 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b7400a6e0 con 0x7f2b7c0b44a0 2020-06-12T17:49:06.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.639+0000 7f2b82c89700 1 -- 172.21.15.38:0/1746612898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7c0b44a0 msgr2=0x7f2b7c1427b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:06.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.639+0000 7f2b82c89700 1 --2- 172.21.15.38:0/1746612898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7c0b44a0 0x7f2b7c1427b0 secure :-1 s=READY pgs=404 cs=0 l=1 rx=0x7f2b740032b0 tx=0x7f2b740081e0).stop 2020-06-12T17:49:06.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.639+0000 7f2b82c89700 1 -- 172.21.15.38:0/1746612898 shutdown_connections 2020-06-12T17:49:06.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.639+0000 7f2b82c89700 1 --2- 172.21.15.38:0/1746612898 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b7c061a80 0x7f2b7c09bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:06.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.639+0000 7f2b82c89700 1 --2- 172.21.15.38:0/1746612898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7c0b44a0 0x7f2b7c1427b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:06.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.639+0000 7f2b82c89700 1 -- 172.21.15.38:0/1746612898 >> 172.21.15.38:0/1746612898 conn(0x7f2b7c0b8420 msgr2=0x7f2b7c0b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:06.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.639+0000 7f2b82c89700 1 -- 172.21.15.38:0/1746612898 shutdown_connections 2020-06-12T17:49:06.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.639+0000 7f2b82c89700 1 -- 172.21.15.38:0/1746612898 wait complete. 2020-06-12T17:49:06.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.640+0000 7f2b82c89700 1 Processor -- start 2020-06-12T17:49:06.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.640+0000 7f2b82c89700 1 -- start start 2020-06-12T17:49:06.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.641+0000 7f2b82c89700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b7c0b44a0 0x7f2b7c065ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:06.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.641+0000 7f2b82c89700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7c066410 con 0x7f2b7c061a80 2020-06-12T17:49:06.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.641+0000 7f2b82c89700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7c062e00 con 0x7f2b7c142350 2020-06-12T17:49:06.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.641+0000 7f2b82c89700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c1459b0 con 0x7f2b7c0b44a0 2020-06-12T17:49:06.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.641+0000 7f2b80a25700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f2b7c061a80 0x7f2b7c13e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39108/0 (socket says 172.21.15.38:39108) 2020-06-12T17:49:06.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.641+0000 7f2b80a25700 1 -- 172.21.15.38:0/2693059281 learned_addr learned my addr 172.21.15.38:0/2693059281 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:06.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.641+0000 7f2b7bfff700 1 --2- 172.21.15.38:0/2693059281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b7c0b44a0 0x7f2b7c065ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:06.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.641+0000 7f2b79ffb700 1 -- 172.21.15.38:0/2693059281 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1647981660 0 0) 0x7f2b7c066410 con 0x7f2b7c061a80 2020-06-12T17:49:06.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.641+0000 7f2b79ffb700 1 -- 172.21.15.38:0/2693059281 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b5c002fe0 con 0x7f2b7c061a80 2020-06-12T17:49:06.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.641+0000 7f2b79ffb700 1 -- 172.21.15.38:0/2693059281 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171686227 0 0) 0x7f2b7c062e00 con 0x7f2b7c142350 2020-06-12T17:49:06.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.641+0000 7f2b79ffb700 1 -- 172.21.15.38:0/2693059281 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b7c066410 con 0x7f2b7c142350 2020-06-12T17:49:06.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.642+0000 7f2b7bfff700 1 -- 172.21.15.38:0/2693059281 >> v1:172.21.15.150:6789/0 conn(0x7f2b7c142350 legacy=0x7f2b7c0632a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:06.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.642+0000 7f2b7bfff700 1 -- 172.21.15.38:0/2693059281 >> v1:172.21.15.38:6789/0 conn(0x7f2b7c061a80 legacy=0x7f2b7c13e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:06.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.642+0000 7f2b79ffb700 1 -- 172.21.15.38:0/2693059281 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3215220815 0 0) 0x7f2b5c002fe0 con 0x7f2b7c061a80 2020-06-12T17:49:06.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.642+0000 7f2b7bfff700 1 -- 172.21.15.38:0/2693059281 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c13eab0 con 0x7f2b7c0b44a0 2020-06-12T17:49:06.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.642+0000 7f2b7bfff700 1 --2- 172.21.15.38:0/2693059281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b7c0b44a0 0x7f2b7c065ec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2b6c002f30 tx=0x7f2b70001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.642+0000 7f2b7bfff700 1 --2- 172.21.15.38:0/2693059281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b7c0b44a0 0x7f2b7c065ec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2b6c002f30 tx=0x7f2b70001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.642+0000 7f2b7bfff700 1 --2- 172.21.15.38:0/2693059281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b7c0b44a0 0x7f2b7c065ec0 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f2b6c002f30 tx=0x7f2b70001810).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:06.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.642+0000 7f2b7bfff700 1 --2- 172.21.15.38:0/2693059281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b7c0b44a0 0x7f2b7c065ec0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f2b6c002f30 tx=0x7f2b70001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.642+0000 7f2b79ffb700 1 -- 172.21.15.38:0/2693059281 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b70001ea0 con 0x7f2b7c0b44a0 2020-06-12T17:49:06.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.642+0000 7f2b7bfff700 1 --2- 172.21.15.38:0/2693059281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b7c0b44a0 0x7f2b7c065ec0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f2b6c002f30 tx=0x7f2b70001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.642+0000 7f2b7bfff700 1 --2- 172.21.15.38:0/2693059281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b7c0b44a0 0x7f2b7c065ec0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f2b6c002f30 tx=0x7f2b70001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.642+0000 7f2b79ffb700 1 -- 172.21.15.38:0/2693059281 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7000c940 con 0x7f2b7c0b44a0 2020-06-12T17:49:06.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.642+0000 7f2b82c89700 1 -- 172.21.15.38:0/2693059281 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7c1536c0 con 0x7f2b7c0b44a0 2020-06-12T17:49:06.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.642+0000 7f2b79ffb700 1 -- 172.21.15.38:0/2693059281 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b6c002500 con 0x7f2b7c0b44a0 2020-06-12T17:49:06.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.642+0000 7f2b82c89700 1 -- 172.21.15.38:0/2693059281 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7c066810 con 0x7f2b7c0b44a0 2020-06-12T17:49:06.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.643+0000 7f2b7bfff700 1 --2- 172.21.15.38:0/2693059281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b7c0b44a0 0x7f2b7c065ec0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f2b6c002f30 tx=0x7f2b70001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.643+0000 7f2b82c89700 1 -- 172.21.15.38:0/2693059281 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b7c13ed00 con 0x7f2b7c0b44a0 2020-06-12T17:49:06.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.643+0000 7f2b79ffb700 1 -- 172.21.15.38:0/2693059281 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f2b7000cce0 con 0x7f2b7c0b44a0 2020-06-12T17:49:06.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.643+0000 7f2b7bfff700 1 --2- 172.21.15.38:0/2693059281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b7c0b44a0 0x7f2b7c065ec0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f2b6c002f30 tx=0x7f2b70001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.643+0000 7f2b79ffb700 1 --2- 172.21.15.38:0/2693059281 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2b5c04da30 0x7f2b5c04fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:06.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.643+0000 7f2b79ffb700 1 -- 172.21.15.38:0/2693059281 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2b700604e0 con 0x7f2b7c0b44a0 2020-06-12T17:49:06.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.644+0000 7f2b80a25700 1 --2- 172.21.15.38:0/2693059281 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2b5c04da30 0x7f2b5c04fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:06.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.644+0000 7f2b80a25700 1 --2- 172.21.15.38:0/2693059281 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2b5c04da30 0x7f2b5c04fef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2b6c002660 tx=0x7f2b6c002890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.644+0000 7f2b80a25700 1 --2- 172.21.15.38:0/2693059281 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2b5c04da30 0x7f2b5c04fef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2b6c002660 tx=0x7f2b6c002890).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.644+0000 7f2b80a25700 1 --2- 172.21.15.38:0/2693059281 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2b5c04da30 0x7f2b5c04fef0 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f2b6c002660 tx=0x7f2b6c002890).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:06.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.647+0000 7f2b7bfff700 1 --2- 172.21.15.38:0/2693059281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b7c0b44a0 0x7f2b7c065ec0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f2b6c002f30 tx=0x7f2b70001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.647+0000 7f2b79ffb700 1 -- 172.21.15.38:0/2693059281 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f2b7003bc80 con 0x7f2b7c0b44a0 2020-06-12T17:49:06.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.799+0000 7f2b82c89700 1 -- 172.21.15.38:0/2693059281 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b7c056c30 con 0x7f2b7c0b44a0 2020-06-12T17:49:06.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.800+0000 7f2b7bfff700 1 --2- 172.21.15.38:0/2693059281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b7c0b44a0 0x7f2b7c065ec0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f2b6c002f30 tx=0x7f2b70001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.800+0000 7f2b79ffb700 1 -- 172.21.15.38:0/2693059281 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16319 (secure 0 0 0) 0x7f2b7003f2a0 con 0x7f2b7c0b44a0 2020-06-12T17:49:06.804 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:49:06.805 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"fsid":"8e42a2e7-b187-42c4-a73f-8f812ee62352","created":"2020-06-12T17:47:54.434340+0000","modified":"2020-06-12T17:49:03.761154+0000","last_up_change":"2020-06-12T17:48:03.388718+0000","last_in_change":"2020-06-12T17:48:03.388718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-06-12T17:47:57.558119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-06-12T17:48:07.419264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2020-06-12T17:49:00.516131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2020-06-12T17:49:01.711699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"44ac3dea-67b4-4b9a-bc18-ac511710afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":31038},{"type":"v1","addr":"172.21.15.38:6816","nonce":31038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":31038},{"type":"v1","addr":"172.21.15.38:6819","nonce":31038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":31038},{"type":"v1","addr":"172.21.15.38:6823","nonce":31038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":31038},{"type":"v1","addr":"172.21.15.38:6821","nonce":31038}]},"public_addr":"172.21.15.38:6816/31038","cluster_addr":"172.21.15.38:6819/31038","heartbeat_back_addr":"172.21.15.38:6823/31038","heartbeat_front_addr":"172.21.15.38:6821/31038","state":["exists","up"]},{"osd":1,"uuid":"561f7ced-3fff-4364-8619-6e4ecbc9d256","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":31036},{"type":"v1","addr":"172.21.15.38:6801","nonce":31036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":31036},{"type":"v1","addr":"172.21.15.38:6803","nonce":31036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":31036},{"type":"v1","addr":"172.21.15.38:6807","nonce":31036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":31036},{"type":"v1","addr":"172.21.15.38:6805","nonce":31036}]},"public_addr":"172.21.15.38:6801/31036","cluster_addr":"172.21.15.38:6803/31036","heartbeat_back_addr":"172.21.15.38:6807/31036","heartbeat_front_addr":"172.21.15.38:6805/31036","state":["exists","up"]},{"osd":2,"uuid":"0bb3c806-07af-49f5-b492-d0e33f2de37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":31053},{"type":"v1","addr":"172.21.15.38:6825","nonce":31053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":31053},{"type":"v1","addr":"172.21.15.38:6827","nonce":31053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":31053},{"type":"v1","addr":"172.21.15.38:6831","nonce":31053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":31053},{"type":"v1","addr":"172.21.15.38:6829","nonce":31053}]},"public_addr":"172.21.15.38:6825/31053","cluster_addr":"172.21.15.38:6827/31053","heartbeat_back_addr":"172.21.15.38:6831/31053","heartbeat_front_addr":"172.21.15.38:6829/31053","state":["exists","up"]},{"osd":3,"uuid":"7f6a1e75-7b11-456e-8a4b-510b16226800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":31037},{"type":"v1","addr":"172.21.15.38:6809","nonce":31037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":31037},{"type":"v1","addr":"172.21.15.38:6811","nonce":31037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6815","nonce":31037},{"type":"v1","addr":"172.21.15.38:6817","nonce":31037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":31037},{"type":"v1","addr":"172.21.15.38:6813","nonce":31037}]},"public_addr":"172.21.15.38:6809/31037","cluster_addr":"172.21.15.38:6811/31037","heartbeat_back_addr":"172.21.15.38:6817/31037","heartbeat_front_addr":"172.21.15.38:6813/31037","state":["exists","up"]},{"osd":4,"uuid":"0eca0272-8cfd-469c-a32d-e29730dc0e1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":31294},{"type":"v1","addr":"172.21.15.150:6803","nonce":31294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":31294},{"type":"v1","addr":"172.21.15.150:6805","nonce":31294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":31294},{"type":"v1","addr":"172.21.15.150:6809","nonce":31294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":31294},{"type":"v1","addr":"172.21.15.150:6807","nonce":31294}]},"public_addr":"172.21.15.150:6803/31294","cluster_addr":"172.21.15.150:6805/31294","heartbeat_back_addr":"172.21.15.150:6809/31294","heartbeat_front_addr":"172.21.15.150:6807/31294","state":["exists","up"]},{"osd":5,"uuid":"69d6a7dc-a55a-4ebc-8479-8bb921ddfb65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6811","nonce":31295},{"type":"v1","addr":"172.21.15.150:6813","nonce":31295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":31295},{"type":"v1","addr":"172.21.15.150:6816","nonce":31295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":31295},{"type":"v1","addr":"172.21.15.150:6828","nonce":31295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6819","nonce":31295},{"type":"v1","addr":"172.21.15.150:6822","nonce":31295}]},"public_addr":"172.21.15.150:6813/31295","cluster_addr":"172.21.15.150:6816/31295","heartbeat_back_addr":"172.21.15.150:6828/31295","heartbeat_front_addr":"172.21.15.150:6822/31295","state":["exists","up"]},{"osd":6,"uuid":"f0d320f8-c2f0-40bb-b713-526246cf97b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":31297},{"type":"v1","addr":"172.21.15.150:6820","nonce":31297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6823","nonce":31297},{"type":"v1","addr":"172.21.15.150:6827","nonce":31297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":31297},{"type":"v1","addr":"172.21.15.150:6833","nonce":31297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":31297},{"type":"v1","addr":"172.21.15.150:6831","nonce":31297}]},"public_addr":"172.21.15.150:6820/31297","cluster_addr":"172.21.15.150:6827/31297","heartbeat_back_addr":"172.21.15.150:6833/31297","heartbeat_front_addr":"172.21.15.150:6831/31297","state":["exists","up"]},{"osd":7,"uuid":"970b7d02-a189-41b2-96e5-a5a5a57c6476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":31296},{"type":"v1","addr":"172.21.15.150:6812","nonce":31296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6815","nonce":31296},{"type":"v1","addr":"172.21.15.150:6818","nonce":31296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":31296},{"type":"v1","addr":"172.21.15.150:6829","nonce":31296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6821","nonce":31296},{"type":"v1","addr":"172.21.15.150:6824","nonce":31296}]},"public_addr":"172.21.15.150:6812/31296","cluster_addr":"172.21.15.150:6818/31296","heartbeat_back_addr":"172.21.15.150:6829/31296","heartbeat_front_addr":"172.21.15.150:6824/31296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.664300+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.644253+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.651120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.584978+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.561149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.661778+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T17:48:01.628606+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T17:49:06.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.802+0000 7f2b82c89700 1 -- 172.21.15.38:0/2693059281 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2b5c04da30 msgr2=0x7f2b5c04fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:06.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.802+0000 7f2b82c89700 1 --2- 172.21.15.38:0/2693059281 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2b5c04da30 0x7f2b5c04fef0 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f2b6c002660 tx=0x7f2b6c002890).stop 2020-06-12T17:49:06.807 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.802+0000 7f2b82c89700 1 -- 172.21.15.38:0/2693059281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b7c0b44a0 msgr2=0x7f2b7c065ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:06.807 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.802+0000 7f2b82c89700 1 --2- 172.21.15.38:0/2693059281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b7c0b44a0 0x7f2b7c065ec0 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f2b6c002f30 tx=0x7f2b70001810).stop 2020-06-12T17:49:06.807 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.802+0000 7f2b82c89700 1 -- 172.21.15.38:0/2693059281 shutdown_connections 2020-06-12T17:49:06.807 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.802+0000 7f2b82c89700 1 --2- 172.21.15.38:0/2693059281 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2b5c04da30 0x7f2b5c04fef0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:06.808 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.802+0000 7f2b82c89700 1 --2- 172.21.15.38:0/2693059281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b7c0b44a0 0x7f2b7c065ec0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:06.808 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.802+0000 7f2b82c89700 1 -- 172.21.15.38:0/2693059281 >> 172.21.15.38:0/2693059281 conn(0x7f2b7c0b8420 msgr2=0x7f2b7c1419b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:06.808 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.802+0000 7f2b82c89700 1 -- 172.21.15.38:0/2693059281 shutdown_connections 2020-06-12T17:49:06.808 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.802+0000 7f2b82c89700 1 -- 172.21.15.38:0/2693059281 wait complete. 2020-06-12T17:49:06.816 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-06-12T17:47:57.558119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-06-12T17:48:07.419264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2020-06-12T17:49:00.516131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2020-06-12T17:49:01.711699+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-06-12T17:49:06.817 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-06-12T17:49:06.933 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.930+0000 7fa3f918e700 1 Processor -- start 2020-06-12T17:49:06.934 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.930+0000 7fa3f918e700 1 -- start start 2020-06-12T17:49:06.936 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.931+0000 7fa3f918e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3f40b5ab0 0x7fa3f4146810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:06.937 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.931+0000 7fa3f918e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa3f40b5e90 0x7fa3f40b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:06.937 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.931+0000 7fa3f918e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f40b5380 con 0x7fa3f40b3cc0 2020-06-12T17:49:06.937 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.931+0000 7fa3f918e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f4146c70 con 0x7fa3f40b5e90 2020-06-12T17:49:06.937 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.931+0000 7fa3f918e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f40b5620 con 0x7fa3f40b5ab0 2020-06-12T17:49:06.938 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.931+0000 7fa3ebfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa3f40b5e90 0x7fa3f40b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:06.938 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.931+0000 7fa3ebfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa3f40b5e90 0x7fa3f40b3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37302/0 (socket says 172.21.15.38:37302) 2020-06-12T17:49:06.938 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.931+0000 7fa3ebfff700 1 -- 172.21.15.38:0/3753845234 learned_addr learned my addr 172.21.15.38:0/3753845234 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:06.938 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.931+0000 7fa3f2d9d700 1 --2- 172.21.15.38:0/3753845234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3f40b5ab0 0x7fa3f4146810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:06.938 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.931+0000 7fa3ebfff700 1 -- 172.21.15.38:0/3753845234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3f40b5ab0 msgr2=0x7fa3f4146810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:06.939 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.931+0000 7fa3ebfff700 1 --2- 172.21.15.38:0/3753845234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3f40b5ab0 0x7fa3f4146810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:06.939 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.931+0000 7fa3ebfff700 1 -- 172.21.15.38:0/3753845234 >> v1:172.21.15.150:6789/0 conn(0x7fa3f40b3cc0 legacy=0x7fa3f4142c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:06.939 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.931+0000 7fa3ebfff700 1 -- 172.21.15.38:0/3753845234 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f40b5000 con 0x7fa3f40b5e90 2020-06-12T17:49:06.939 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.931+0000 7fa3ebfff700 1 --2- 172.21.15.38:0/3753845234 >> v2:172.21.15.38:3300/0 conn(0x7fa3f40b5e90 0x7fa3f40b3860 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa3dc002f30 tx=0x7fa3dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.939 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.931+0000 7fa3ebfff700 1 --2- 172.21.15.38:0/3753845234 >> v2:172.21.15.38:3300/0 conn(0x7fa3f40b5e90 0x7fa3f40b3860 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa3dc002f30 tx=0x7fa3dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.940 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.931+0000 7fa3ebfff700 1 --2- 172.21.15.38:0/3753845234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3f40b5e90 0x7fa3f40b3860 secure :-1 s=READY pgs=406 cs=0 l=1 rx=0x7fa3dc002f30 tx=0x7fa3dc007e60).ready entity=mon.0 client_cookie=a17169a133d89e54 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:06.940 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.931+0000 7fa3ebfff700 1 --2- 172.21.15.38:0/3753845234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3f40b5e90 0x7fa3f40b3860 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7fa3dc002f30 tx=0x7fa3dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.940 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.931+0000 7fa3f259c700 1 -- 172.21.15.38:0/3753845234 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3dc0116e0 con 0x7fa3f40b5e90 2020-06-12T17:49:06.940 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.931+0000 7fa3ebfff700 1 --2- 172.21.15.38:0/3753845234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3f40b5e90 0x7fa3f40b3860 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7fa3dc002f30 tx=0x7fa3dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.940 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.931+0000 7fa3f259c700 1 -- 172.21.15.38:0/3753845234 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc011840 con 0x7fa3f40b5e90 2020-06-12T17:49:06.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.931+0000 7fa3ebfff700 1 --2- 172.21.15.38:0/3753845234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3f40b5e90 0x7fa3f40b3860 secure :-1 s=THROTTLE_DONE pgs=406 cs=0 l=1 rx=0x7fa3dc002f30 tx=0x7fa3dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.931+0000 7fa3f259c700 1 -- 172.21.15.38:0/3753845234 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3dc011c20 con 0x7fa3f40b5e90 2020-06-12T17:49:06.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.931+0000 7fa3f918e700 1 -- 172.21.15.38:0/3753845234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3f40b5e90 msgr2=0x7fa3f40b3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:06.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.931+0000 7fa3f918e700 1 --2- 172.21.15.38:0/3753845234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3f40b5e90 0x7fa3f40b3860 secure :-1 s=READY pgs=406 cs=0 l=1 rx=0x7fa3dc002f30 tx=0x7fa3dc007e60).stop 2020-06-12T17:49:06.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.932+0000 7fa3f918e700 1 -- 172.21.15.38:0/3753845234 shutdown_connections 2020-06-12T17:49:06.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.932+0000 7fa3f918e700 1 --2- 172.21.15.38:0/3753845234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3f40b5ab0 0x7fa3f4146810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:06.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.932+0000 7fa3f918e700 1 --2- 172.21.15.38:0/3753845234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3f40b5e90 0x7fa3f40b3860 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:06.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.932+0000 7fa3f918e700 1 -- 172.21.15.38:0/3753845234 >> 172.21.15.38:0/3753845234 conn(0x7fa3f40b8ec0 msgr2=0x7fa3f40b92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:06.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.932+0000 7fa3f918e700 1 -- 172.21.15.38:0/3753845234 shutdown_connections 2020-06-12T17:49:06.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.932+0000 7fa3f918e700 1 -- 172.21.15.38:0/3753845234 wait complete. 2020-06-12T17:49:06.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.933+0000 7fa3f918e700 1 Processor -- start 2020-06-12T17:49:06.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.933+0000 7fa3f918e700 1 -- start start 2020-06-12T17:49:06.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.934+0000 7fa3f918e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3f40b5e90 0x7fa3f4142500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:06.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.934+0000 7fa3f918e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f4142960 con 0x7fa3f41558f0 2020-06-12T17:49:06.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.934+0000 7fa3f918e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f40644d0 con 0x7fa3f40b5ab0 2020-06-12T17:49:06.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.934+0000 7fa3f918e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f4136180 con 0x7fa3f40b5e90 2020-06-12T17:49:06.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.934+0000 7fa3f359e700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa3f41558f0 0x7fa3f41375f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39126/0 (socket says 172.21.15.38:39126) 2020-06-12T17:49:06.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.934+0000 7fa3f359e700 1 -- 172.21.15.38:0/419191721 learned_addr learned my addr 172.21.15.38:0/419191721 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:06.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.934+0000 7fa3ebfff700 1 --2- 172.21.15.38:0/419191721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3f40b5e90 0x7fa3f4142500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:06.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.934+0000 7fa3f0d99700 1 -- 172.21.15.38:0/419191721 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830426255 0 0) 0x7fa3f40b5380 con 0x7fa3f41558f0 2020-06-12T17:49:06.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.934+0000 7fa3f0d99700 1 -- 172.21.15.38:0/419191721 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3d8002fe0 con 0x7fa3f41558f0 2020-06-12T17:49:06.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.934+0000 7fa3f0d99700 1 -- 172.21.15.38:0/419191721 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 228711199 0 0) 0x7fa3f40644d0 con 0x7fa3f40b5ab0 2020-06-12T17:49:06.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.934+0000 7fa3f0d99700 1 -- 172.21.15.38:0/419191721 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3f40b5380 con 0x7fa3f40b5ab0 2020-06-12T17:49:06.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.934+0000 7fa3ebfff700 1 -- 172.21.15.38:0/419191721 >> v1:172.21.15.150:6789/0 conn(0x7fa3f40b5ab0 legacy=0x7fa3f41551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:06.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.934+0000 7fa3ebfff700 1 -- 172.21.15.38:0/419191721 >> v1:172.21.15.38:6789/0 conn(0x7fa3f41558f0 legacy=0x7fa3f41375f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:06.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.934+0000 7fa3ebfff700 1 -- 172.21.15.38:0/419191721 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f40636d0 con 0x7fa3f40b5e90 2020-06-12T17:49:06.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.934+0000 7fa3ebfff700 1 --2- 172.21.15.38:0/419191721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3f40b5e90 0x7fa3f4142500 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa3dc002f30 tx=0x7fa3dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.934+0000 7fa3ebfff700 1 --2- 172.21.15.38:0/419191721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3f40b5e90 0x7fa3f4142500 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa3dc002f30 tx=0x7fa3dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.934+0000 7fa3ebfff700 1 --2- 172.21.15.38:0/419191721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3f40b5e90 0x7fa3f4142500 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7fa3dc002f30 tx=0x7fa3dc007e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:06.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.935+0000 7fa3ebfff700 1 --2- 172.21.15.38:0/419191721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3f40b5e90 0x7fa3f4142500 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7fa3dc002f30 tx=0x7fa3dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.935+0000 7fa3f0d99700 1 -- 172.21.15.38:0/419191721 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3dc011ea0 con 0x7fa3f40b5e90 2020-06-12T17:49:06.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.935+0000 7fa3ebfff700 1 --2- 172.21.15.38:0/419191721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3f40b5e90 0x7fa3f4142500 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7fa3dc002f30 tx=0x7fa3dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.935+0000 7fa3ebfff700 1 --2- 172.21.15.38:0/419191721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3f40b5e90 0x7fa3f4142500 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7fa3dc002f30 tx=0x7fa3dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.935+0000 7fa3f0d99700 1 -- 172.21.15.38:0/419191721 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc007150 con 0x7fa3f40b5e90 2020-06-12T17:49:06.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.935+0000 7fa3f918e700 1 -- 172.21.15.38:0/419191721 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f4135e10 con 0x7fa3f40b5e90 2020-06-12T17:49:06.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.935+0000 7fa3f0d99700 1 -- 172.21.15.38:0/419191721 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3dc0074b0 con 0x7fa3f40b5e90 2020-06-12T17:49:06.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.935+0000 7fa3f918e700 1 -- 172.21.15.38:0/419191721 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f4098020 con 0x7fa3f40b5e90 2020-06-12T17:49:06.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.935+0000 7fa3ebfff700 1 --2- 172.21.15.38:0/419191721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3f40b5e90 0x7fa3f4142500 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7fa3dc002f30 tx=0x7fa3dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.935+0000 7fa3f918e700 1 -- 172.21.15.38:0/419191721 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f405d3e0 con 0x7fa3f40b5e90 2020-06-12T17:49:06.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.936+0000 7fa3f0d99700 1 -- 172.21.15.38:0/419191721 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fa3dc0056c0 con 0x7fa3f40b5e90 2020-06-12T17:49:06.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.936+0000 7fa3ebfff700 1 --2- 172.21.15.38:0/419191721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3f40b5e90 0x7fa3f4142500 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7fa3dc002f30 tx=0x7fa3dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.936+0000 7fa3f0d99700 1 --2- 172.21.15.38:0/419191721 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa3d804dae0 0x7fa3d804ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:06.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.936+0000 7fa3f0d99700 1 -- 172.21.15.38:0/419191721 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa3dc0612c0 con 0x7fa3f40b5e90 2020-06-12T17:49:06.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.936+0000 7fa3f2d9d700 1 --2- 172.21.15.38:0/419191721 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa3d804dae0 0x7fa3d804ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:06.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.936+0000 7fa3f2d9d700 1 --2- 172.21.15.38:0/419191721 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa3d804dae0 0x7fa3d804ffa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa3e4002ef0 tx=0x7fa3e4007ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.936+0000 7fa3f2d9d700 1 --2- 172.21.15.38:0/419191721 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa3d804dae0 0x7fa3d804ffa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa3e4002ef0 tx=0x7fa3e4007ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.936+0000 7fa3f2d9d700 1 --2- 172.21.15.38:0/419191721 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa3d804dae0 0x7fa3d804ffa0 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7fa3e4002ef0 tx=0x7fa3e4007ec0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:06.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.939+0000 7fa3ebfff700 1 --2- 172.21.15.38:0/419191721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3f40b5e90 0x7fa3f4142500 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7fa3dc002f30 tx=0x7fa3dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:06.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:06.939+0000 7fa3f0d99700 1 -- 172.21.15.38:0/419191721 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fa3dc03cae0 con 0x7fa3f40b5e90 2020-06-12T17:49:07.097 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.093+0000 7fa3f918e700 1 -- 172.21.15.38:0/419191721 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa3f4064320 con 0x7fa3f40b5e90 2020-06-12T17:49:07.098 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.094+0000 7fa3ebfff700 1 --2- 172.21.15.38:0/419191721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3f40b5e90 0x7fa3f4142500 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7fa3dc002f30 tx=0x7fa3dc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.098 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.094+0000 7fa3f0d99700 1 -- 172.21.15.38:0/419191721 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v34) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa3dc040100 con 0x7fa3f40b5e90 2020-06-12T17:49:07.098 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2020-06-12T17:49:07.099 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.095+0000 7fa3f918e700 1 -- 172.21.15.38:0/419191721 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa3d804dae0 msgr2=0x7fa3d804ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:07.100 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.095+0000 7fa3f918e700 1 --2- 172.21.15.38:0/419191721 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa3d804dae0 0x7fa3d804ffa0 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7fa3e4002ef0 tx=0x7fa3e4007ec0).stop 2020-06-12T17:49:07.100 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.095+0000 7fa3f918e700 1 -- 172.21.15.38:0/419191721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3f40b5e90 msgr2=0x7fa3f4142500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:07.100 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.095+0000 7fa3f918e700 1 --2- 172.21.15.38:0/419191721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3f40b5e90 0x7fa3f4142500 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7fa3dc002f30 tx=0x7fa3dc007e60).stop 2020-06-12T17:49:07.100 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.095+0000 7fa3f918e700 1 -- 172.21.15.38:0/419191721 shutdown_connections 2020-06-12T17:49:07.100 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.095+0000 7fa3f918e700 1 --2- 172.21.15.38:0/419191721 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa3d804dae0 0x7fa3d804ffa0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:07.101 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.095+0000 7fa3f918e700 1 --2- 172.21.15.38:0/419191721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3f40b5e90 0x7fa3f4142500 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:07.101 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.095+0000 7fa3f918e700 1 -- 172.21.15.38:0/419191721 >> 172.21.15.38:0/419191721 conn(0x7fa3f40b8ec0 msgr2=0x7fa3f409a030 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:07.101 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.095+0000 7fa3f918e700 1 -- 172.21.15.38:0/419191721 shutdown_connections 2020-06-12T17:49:07.101 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.095+0000 7fa3f918e700 1 -- 172.21.15.38:0/419191721 wait complete. 2020-06-12T17:49:07.109 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-06-12T17:49:07.226 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.223+0000 7fe8b425d700 1 Processor -- start 2020-06-12T17:49:07.227 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.223+0000 7fe8b425d700 1 -- start start 2020-06-12T17:49:07.232 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.223+0000 7fe8b425d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8ac09df00 0x7fe8ac13c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:07.232 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.224+0000 7fe8b425d700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8ac09b960 con 0x7fe8ac142e90 2020-06-12T17:49:07.233 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.224+0000 7fe8b425d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8ac09bc00 con 0x7fe8ac0b3ac0 2020-06-12T17:49:07.233 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.224+0000 7fe8b425d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac0b48f0 con 0x7fe8ac09df00 2020-06-12T17:49:07.233 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.224+0000 7fe8b27fa700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe8ac142e90 0x7fe8ac066790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39134/0 (socket says 172.21.15.38:39134) 2020-06-12T17:49:07.233 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.224+0000 7fe8b27fa700 1 -- 172.21.15.38:0/452894490 learned_addr learned my addr 172.21.15.38:0/452894490 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:07.233 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.224+0000 7fe8b17f8700 1 --2- 172.21.15.38:0/452894490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8ac09df00 0x7fe8ac13c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:07.234 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.224+0000 7fe8b0ff7700 1 -- 172.21.15.38:0/452894490 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477490944 0 0) 0x7fe8ac09b960 con 0x7fe8ac142e90 2020-06-12T17:49:07.234 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.224+0000 7fe8b0ff7700 1 -- 172.21.15.38:0/452894490 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe894003230 con 0x7fe8ac142e90 2020-06-12T17:49:07.234 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.224+0000 7fe8b0ff7700 1 -- 172.21.15.38:0/452894490 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1558112369 0 0) 0x7fe8ac09bc00 con 0x7fe8ac0b3ac0 2020-06-12T17:49:07.234 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.224+0000 7fe8b0ff7700 1 -- 172.21.15.38:0/452894490 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8ac09b960 con 0x7fe8ac0b3ac0 2020-06-12T17:49:07.234 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.224+0000 7fe8b0ff7700 1 -- 172.21.15.38:0/452894490 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1173475421 0 0) 0x7fe894003230 con 0x7fe8ac142e90 2020-06-12T17:49:07.235 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.224+0000 7fe8b0ff7700 1 -- 172.21.15.38:0/452894490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8ac09df00 msgr2=0x7fe8ac13c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:07.235 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.224+0000 7fe8b0ff7700 1 --2- 172.21.15.38:0/452894490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8ac09df00 0x7fe8ac13c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:07.235 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.224+0000 7fe8b0ff7700 1 -- 172.21.15.38:0/452894490 >> v1:172.21.15.150:6789/0 conn(0x7fe8ac0b3ac0 legacy=0x7fe8ac13bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:07.235 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.224+0000 7fe8b0ff7700 1 -- 172.21.15.38:0/452894490 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ac0b3ea0 con 0x7fe8ac142e90 2020-06-12T17:49:07.235 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.224+0000 7fe8b0ff7700 1 -- 172.21.15.38:0/452894490 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fe8a4001a50 con 0x7fe8ac142e90 2020-06-12T17:49:07.236 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.224+0000 7fe8b0ff7700 1 -- 172.21.15.38:0/452894490 >> v1:172.21.15.38:6789/0 conn(0x7fe8ac142e90 legacy=0x7fe8ac066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:07.236 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.224+0000 7fe8b0ff7700 1 --2- 172.21.15.38:0/452894490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8940038e0 0x7fe894003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:07.236 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.224+0000 7fe8b0ff7700 1 --2- 172.21.15.38:0/452894490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8940044d0 0x7fe894004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:07.236 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.224+0000 7fe8b0ff7700 1 --2- 172.21.15.38:0/452894490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8ac09df00 0x7fe894004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:07.236 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.224+0000 7fe8b0ff7700 1 -- 172.21.15.38:0/452894490 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac0b48f0 con 0x7fe8940038e0 2020-06-12T17:49:07.237 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.224+0000 7fe8b0ff7700 1 -- 172.21.15.38:0/452894490 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe894005210 con 0x7fe8940044d0 2020-06-12T17:49:07.237 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.224+0000 7fe8b0ff7700 1 -- 172.21.15.38:0/452894490 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89400c830 con 0x7fe8ac09df00 2020-06-12T17:49:07.237 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.224+0000 7fe8b1ff9700 1 --2- 172.21.15.38:0/452894490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8940038e0 0x7fe894003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:07.237 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.224+0000 7fe8b17f8700 1 --2- 172.21.15.38:0/452894490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8940044d0 0x7fe894004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:07.237 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.224+0000 7fe8b27fa700 1 --2- 172.21.15.38:0/452894490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8ac09df00 0x7fe894004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:07.238 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.225+0000 7fe8b1ff9700 1 -- 172.21.15.38:0/452894490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8ac09df00 msgr2=0x7fe894004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:07.238 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.225+0000 7fe8b1ff9700 1 --2- 172.21.15.38:0/452894490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8ac09df00 0x7fe894004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:07.238 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.225+0000 7fe8b1ff9700 1 -- 172.21.15.38:0/452894490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8940044d0 msgr2=0x7fe894004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:07.238 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.225+0000 7fe8b1ff9700 1 --2- 172.21.15.38:0/452894490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8940044d0 0x7fe894004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:07.238 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.225+0000 7fe8b1ff9700 1 -- 172.21.15.38:0/452894490 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe894003230 con 0x7fe8940038e0 2020-06-12T17:49:07.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.225+0000 7fe8b27fa700 1 --2- 172.21.15.38:0/452894490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8ac09df00 0x7fe894004db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:49:07.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.225+0000 7fe8b1ff9700 1 --2- 172.21.15.38:0/452894490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8940038e0 0x7fe894003ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe89c0010d0 tx=0x7fe89c0019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.225+0000 7fe8b1ff9700 1 --2- 172.21.15.38:0/452894490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8940038e0 0x7fe894003ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe89c0010d0 tx=0x7fe89c0019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.225+0000 7fe8b1ff9700 1 --2- 172.21.15.38:0/452894490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8940038e0 0x7fe894003ce0 secure :-1 s=READY pgs=409 cs=0 l=1 rx=0x7fe89c0010d0 tx=0x7fe89c0019a0).ready entity=mon.0 client_cookie=c16e2e014b672630 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:07.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.225+0000 7fe8b1ff9700 1 --2- 172.21.15.38:0/452894490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8940038e0 0x7fe894003ce0 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fe89c0010d0 tx=0x7fe89c0019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.225+0000 7fe8b1ff9700 1 --2- 172.21.15.38:0/452894490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8940038e0 0x7fe894003ce0 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fe89c0010d0 tx=0x7fe89c0019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.225+0000 7fe8b0ff7700 1 -- 172.21.15.38:0/452894490 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe89c012d10 con 0x7fe8940038e0 2020-06-12T17:49:07.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.225+0000 7fe8b1ff9700 1 --2- 172.21.15.38:0/452894490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8940038e0 0x7fe894003ce0 secure :-1 s=THROTTLE_DONE pgs=409 cs=0 l=1 rx=0x7fe89c0010d0 tx=0x7fe89c0019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.225+0000 7fe8b0ff7700 1 -- 172.21.15.38:0/452894490 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89c0064e0 con 0x7fe8940038e0 2020-06-12T17:49:07.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.225+0000 7fe8b0ff7700 1 -- 172.21.15.38:0/452894490 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe89c006900 con 0x7fe8940038e0 2020-06-12T17:49:07.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.225+0000 7fe8b425d700 1 -- 172.21.15.38:0/452894490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8940038e0 msgr2=0x7fe894003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:07.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.225+0000 7fe8b425d700 1 --2- 172.21.15.38:0/452894490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8940038e0 0x7fe894003ce0 secure :-1 s=READY pgs=409 cs=0 l=1 rx=0x7fe89c0010d0 tx=0x7fe89c0019a0).stop 2020-06-12T17:49:07.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.225+0000 7fe8b27fa700 1 -- 172.21.15.38:0/452894490 reap_dead start 2020-06-12T17:49:07.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.225+0000 7fe8b425d700 1 -- 172.21.15.38:0/452894490 shutdown_connections 2020-06-12T17:49:07.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.225+0000 7fe8b425d700 1 -- 172.21.15.38:0/452894490 >> 172.21.15.38:0/452894490 conn(0x7fe8ac0b5a20 msgr2=0x7fe8ac05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:07.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.226+0000 7fe8b425d700 1 -- 172.21.15.38:0/452894490 shutdown_connections 2020-06-12T17:49:07.242 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.226+0000 7fe8b425d700 1 -- 172.21.15.38:0/452894490 wait complete. 2020-06-12T17:49:07.242 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.226+0000 7fe8b425d700 1 Processor -- start 2020-06-12T17:49:07.242 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.227+0000 7fe8b425d700 1 -- start start 2020-06-12T17:49:07.242 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.227+0000 7fe8b425d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe8ac061720 0x7fe8ac143dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:07.242 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.227+0000 7fe8b425d700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8ac141970 con 0x7fe8ac144d90 2020-06-12T17:49:07.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.227+0000 7fe8b425d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8ac063530 con 0x7fe8ac141590 2020-06-12T17:49:07.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.227+0000 7fe8b425d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8ac144230 con 0x7fe8ac061720 2020-06-12T17:49:07.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.227+0000 7fe8b27fa700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe8ac144d90 0x7fe8ac13b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39146/0 (socket says 172.21.15.38:39146) 2020-06-12T17:49:07.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.227+0000 7fe8b27fa700 1 -- 172.21.15.38:0/555722910 learned_addr learned my addr 172.21.15.38:0/555722910 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:07.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.227+0000 7fe8b17f8700 1 --2- 172.21.15.38:0/555722910 >> v2:172.21.15.150:3300/0 conn(0x7fe8ac061720 0x7fe8ac143dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:07.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.227+0000 7fe89affd700 1 -- 172.21.15.38:0/555722910 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1069625955 0 0) 0x7fe8ac141970 con 0x7fe8ac144d90 2020-06-12T17:49:07.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.228+0000 7fe89affd700 1 -- 172.21.15.38:0/555722910 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe88c002fe0 con 0x7fe8ac144d90 2020-06-12T17:49:07.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.228+0000 7fe8b17f8700 1 -- 172.21.15.38:0/555722910 >> v1:172.21.15.150:6789/0 conn(0x7fe8ac141590 legacy=0x7fe8ac063ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:07.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.228+0000 7fe8b17f8700 1 -- 172.21.15.38:0/555722910 >> v1:172.21.15.38:6789/0 conn(0x7fe8ac144d90 legacy=0x7fe8ac13b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:07.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.228+0000 7fe89affd700 1 -- 172.21.15.38:0/555722910 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196148165 0 0) 0x7fe8ac063530 con 0x7fe8ac141590 2020-06-12T17:49:07.245 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.228+0000 7fe8b17f8700 1 -- 172.21.15.38:0/555722910 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ac063790 con 0x7fe8ac061720 2020-06-12T17:49:07.245 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.228+0000 7fe8b17f8700 1 --2- 172.21.15.38:0/555722910 >> v2:172.21.15.150:3300/0 conn(0x7fe8ac061720 0x7fe8ac143dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe8a40021c0 tx=0x7fe8a8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.245 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.228+0000 7fe8b17f8700 1 --2- 172.21.15.38:0/555722910 >> v2:172.21.15.150:3300/0 conn(0x7fe8ac061720 0x7fe8ac143dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe8a40021c0 tx=0x7fe8a8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.245 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.228+0000 7fe8b17f8700 1 --2- 172.21.15.38:0/555722910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8ac061720 0x7fe8ac143dd0 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7fe8a40021c0 tx=0x7fe8a8007e60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:07.245 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.228+0000 7fe8b17f8700 1 --2- 172.21.15.38:0/555722910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8ac061720 0x7fe8ac143dd0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fe8a40021c0 tx=0x7fe8a8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.245 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.228+0000 7fe89affd700 1 -- 172.21.15.38:0/555722910 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8a4001a50 con 0x7fe8ac061720 2020-06-12T17:49:07.246 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.228+0000 7fe8b17f8700 1 --2- 172.21.15.38:0/555722910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8ac061720 0x7fe8ac143dd0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fe8a40021c0 tx=0x7fe8a8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.246 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.228+0000 7fe8b425d700 1 -- 172.21.15.38:0/555722910 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ac063a30 con 0x7fe8ac061720 2020-06-12T17:49:07.246 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.228+0000 7fe89affd700 1 -- 172.21.15.38:0/555722910 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a8005ca0 con 0x7fe8ac061720 2020-06-12T17:49:07.246 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.228+0000 7fe8b17f8700 1 --2- 172.21.15.38:0/555722910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8ac061720 0x7fe8ac143dd0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fe8a40021c0 tx=0x7fe8a8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.247 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.228+0000 7fe89affd700 1 -- 172.21.15.38:0/555722910 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8a8007160 con 0x7fe8ac061720 2020-06-12T17:49:07.247 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.228+0000 7fe8b425d700 1 -- 172.21.15.38:0/555722910 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ac13bbd0 con 0x7fe8ac061720 2020-06-12T17:49:07.247 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.229+0000 7fe8b17f8700 1 --2- 172.21.15.38:0/555722910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8ac061720 0x7fe8ac143dd0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fe8a40021c0 tx=0x7fe8a8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.248 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.229+0000 7fe8b425d700 1 -- 172.21.15.38:0/555722910 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ac056c30 con 0x7fe8ac061720 2020-06-12T17:49:07.249 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.230+0000 7fe89affd700 1 -- 172.21.15.38:0/555722910 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe8a80073e0 con 0x7fe8ac061720 2020-06-12T17:49:07.249 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.230+0000 7fe8b17f8700 1 --2- 172.21.15.38:0/555722910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8ac061720 0x7fe8ac143dd0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fe8a40021c0 tx=0x7fe8a8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.249 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.230+0000 7fe89affd700 1 --2- 172.21.15.38:0/555722910 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe88c04d830 0x7fe88c04fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:07.249 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.230+0000 7fe89affd700 1 -- 172.21.15.38:0/555722910 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe8a8060700 con 0x7fe8ac061720 2020-06-12T17:49:07.250 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.230+0000 7fe8b1ff9700 1 --2- 172.21.15.38:0/555722910 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe88c04d830 0x7fe88c04fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:07.250 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.230+0000 7fe8b1ff9700 1 --2- 172.21.15.38:0/555722910 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe88c04d830 0x7fe88c04fcf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe89c000b80 tx=0x7fe89c0019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.250 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.230+0000 7fe8b1ff9700 1 --2- 172.21.15.38:0/555722910 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe88c04d830 0x7fe88c04fcf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe89c000b80 tx=0x7fe89c0019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.250 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.230+0000 7fe8b1ff9700 1 --2- 172.21.15.38:0/555722910 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe88c04d830 0x7fe88c04fcf0 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7fe89c000b80 tx=0x7fe89c0019a0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:07.251 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.234+0000 7fe8b17f8700 1 --2- 172.21.15.38:0/555722910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8ac061720 0x7fe8ac143dd0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fe8a40021c0 tx=0x7fe8a8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.251 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.234+0000 7fe89affd700 1 -- 172.21.15.38:0/555722910 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fe8a803bde0 con 0x7fe8ac061720 2020-06-12T17:49:07.388 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.384+0000 7fe8b425d700 1 -- 172.21.15.38:0/555722910 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe8ac05a5e0 con 0x7fe8ac061720 2020-06-12T17:49:07.389 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.385+0000 7fe8b17f8700 1 --2- 172.21.15.38:0/555722910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8ac061720 0x7fe8ac143dd0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fe8a40021c0 tx=0x7fe8a8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.389 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.385+0000 7fe89affd700 1 -- 172.21.15.38:0/555722910 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v34) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe8a803f400 con 0x7fe8ac061720 2020-06-12T17:49:07.389 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:49:07.391 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.387+0000 7fe8b425d700 1 -- 172.21.15.38:0/555722910 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe88c04d830 msgr2=0x7fe88c04fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:07.391 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.387+0000 7fe8b425d700 1 --2- 172.21.15.38:0/555722910 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe88c04d830 0x7fe88c04fcf0 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7fe89c000b80 tx=0x7fe89c0019a0).stop 2020-06-12T17:49:07.391 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.387+0000 7fe8b425d700 1 -- 172.21.15.38:0/555722910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8ac061720 msgr2=0x7fe8ac143dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:07.391 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.387+0000 7fe8b425d700 1 --2- 172.21.15.38:0/555722910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8ac061720 0x7fe8ac143dd0 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7fe8a40021c0 tx=0x7fe8a8007e60).stop 2020-06-12T17:49:07.392 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.387+0000 7fe8b425d700 1 -- 172.21.15.38:0/555722910 shutdown_connections 2020-06-12T17:49:07.392 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.387+0000 7fe8b425d700 1 --2- 172.21.15.38:0/555722910 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe88c04d830 0x7fe88c04fcf0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:07.392 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.387+0000 7fe8b425d700 1 --2- 172.21.15.38:0/555722910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8ac061720 0x7fe8ac143dd0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:07.392 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.387+0000 7fe8b425d700 1 -- 172.21.15.38:0/555722910 >> 172.21.15.38:0/555722910 conn(0x7fe8ac0b5a20 msgr2=0x7fe8ac09cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:07.392 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.387+0000 7fe8b425d700 1 -- 172.21.15.38:0/555722910 shutdown_connections 2020-06-12T17:49:07.392 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.387+0000 7fe8b425d700 1 -- 172.21.15.38:0/555722910 wait complete. 2020-06-12T17:49:07.401 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-06-12T17:49:07.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.515+0000 7ff062d38700 1 Processor -- start 2020-06-12T17:49:07.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.515+0000 7ff062d38700 1 -- start start 2020-06-12T17:49:07.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.516+0000 7ff062d38700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff05c05b0a0 0x7ff05c0b7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:07.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.516+0000 7ff062d38700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05c05c8e0 con 0x7ff05c0b74d0 2020-06-12T17:49:07.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.516+0000 7ff062d38700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05c149700 con 0x7ff05c065420 2020-06-12T17:49:07.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.516+0000 7ff062d38700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05c0b78d0 con 0x7ff05c05b0a0 2020-06-12T17:49:07.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.516+0000 7ff05bfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff05c05b0a0 0x7ff05c0b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:07.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.516+0000 7ff0612d5700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff05c0b74d0 0x7ff05c149ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39150/0 (socket says 172.21.15.38:39150) 2020-06-12T17:49:07.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.516+0000 7ff0612d5700 1 -- 172.21.15.38:0/3581869585 learned_addr learned my addr 172.21.15.38:0/3581869585 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:07.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.517+0000 7ff05bfff700 1 -- 172.21.15.38:0/3581869585 >> v1:172.21.15.150:6789/0 conn(0x7ff05c065420 legacy=0x7ff05c146090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:07.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.517+0000 7ff05bfff700 1 -- 172.21.15.38:0/3581869585 >> v1:172.21.15.38:6789/0 conn(0x7ff05c0b74d0 legacy=0x7ff05c149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:07.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.517+0000 7ff05b7fe700 1 -- 172.21.15.38:0/3581869585 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1095707511 0 0) 0x7ff05c05c8e0 con 0x7ff05c0b74d0 2020-06-12T17:49:07.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.517+0000 7ff05bfff700 1 -- 172.21.15.38:0/3581869585 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05c1467a0 con 0x7ff05c05b0a0 2020-06-12T17:49:07.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.517+0000 7ff05bfff700 1 --2- 172.21.15.38:0/3581869585 >> v2:172.21.15.38:3300/0 conn(0x7ff05c05b0a0 0x7ff05c0b7070 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff050002f30 tx=0x7ff050007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.517+0000 7ff05bfff700 1 --2- 172.21.15.38:0/3581869585 >> v2:172.21.15.38:3300/0 conn(0x7ff05c05b0a0 0x7ff05c0b7070 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff050002f30 tx=0x7ff050007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.517+0000 7ff05bfff700 1 --2- 172.21.15.38:0/3581869585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff05c05b0a0 0x7ff05c0b7070 secure :-1 s=READY pgs=412 cs=0 l=1 rx=0x7ff050002f30 tx=0x7ff050007e60).ready entity=mon.0 client_cookie=c21a732f2499b02d server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:07.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.517+0000 7ff05bfff700 1 --2- 172.21.15.38:0/3581869585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff05c05b0a0 0x7ff05c0b7070 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7ff050002f30 tx=0x7ff050007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.517+0000 7ff05b7fe700 1 -- 172.21.15.38:0/3581869585 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff050011430 con 0x7ff05c05b0a0 2020-06-12T17:49:07.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.517+0000 7ff05bfff700 1 --2- 172.21.15.38:0/3581869585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff05c05b0a0 0x7ff05c0b7070 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7ff050002f30 tx=0x7ff050007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.517+0000 7ff05b7fe700 1 -- 172.21.15.38:0/3581869585 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff050011590 con 0x7ff05c05b0a0 2020-06-12T17:49:07.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.517+0000 7ff05bfff700 1 --2- 172.21.15.38:0/3581869585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff05c05b0a0 0x7ff05c0b7070 secure :-1 s=THROTTLE_DONE pgs=412 cs=0 l=1 rx=0x7ff050002f30 tx=0x7ff050007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.517+0000 7ff05b7fe700 1 -- 172.21.15.38:0/3581869585 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0500118f0 con 0x7ff05c05b0a0 2020-06-12T17:49:07.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.517+0000 7ff062d38700 1 -- 172.21.15.38:0/3581869585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff05c05b0a0 msgr2=0x7ff05c0b7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:07.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.517+0000 7ff062d38700 1 --2- 172.21.15.38:0/3581869585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff05c05b0a0 0x7ff05c0b7070 secure :-1 s=READY pgs=412 cs=0 l=1 rx=0x7ff050002f30 tx=0x7ff050007e60).stop 2020-06-12T17:49:07.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.517+0000 7ff062d38700 1 -- 172.21.15.38:0/3581869585 shutdown_connections 2020-06-12T17:49:07.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.517+0000 7ff062d38700 1 --2- 172.21.15.38:0/3581869585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff05c05b0a0 0x7ff05c0b7070 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:07.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.517+0000 7ff062d38700 1 -- 172.21.15.38:0/3581869585 >> 172.21.15.38:0/3581869585 conn(0x7ff05c0ba610 msgr2=0x7ff05c0baa20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:07.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.517+0000 7ff062d38700 1 -- 172.21.15.38:0/3581869585 shutdown_connections 2020-06-12T17:49:07.528 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.518+0000 7ff062d38700 1 -- 172.21.15.38:0/3581869585 wait complete. 2020-06-12T17:49:07.528 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.518+0000 7ff062d38700 1 Processor -- start 2020-06-12T17:49:07.528 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.519+0000 7ff062d38700 1 -- start start 2020-06-12T17:49:07.533 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.519+0000 7ff062d38700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff05c05b0a0 0x7ff05c09dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:07.533 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.519+0000 7ff062d38700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff05c065420 0x7ff05c064280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:07.533 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.519+0000 7ff062d38700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05c1356b0 con 0x7ff05c0b74d0 2020-06-12T17:49:07.533 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.519+0000 7ff062d38700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05c135950 con 0x7ff05c05b0a0 2020-06-12T17:49:07.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.519+0000 7ff062d38700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05c135bf0 con 0x7ff05c065420 2020-06-12T17:49:07.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.519+0000 7ff060ad4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff05c05b0a0 0x7ff05c09dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:07.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.519+0000 7ff060ad4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff05c05b0a0 0x7ff05c09dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37338/0 (socket says 172.21.15.38:37338) 2020-06-12T17:49:07.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.519+0000 7ff060ad4700 1 -- 172.21.15.38:0/1074676241 learned_addr learned my addr 172.21.15.38:0/1074676241 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:07.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.520+0000 7ff05bfff700 1 --2- 172.21.15.38:0/1074676241 >> v2:172.21.15.150:3300/0 conn(0x7ff05c065420 0x7ff05c064280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:07.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.520+0000 7ff060ad4700 1 -- 172.21.15.38:0/1074676241 >> v2:172.21.15.150:3300/0 conn(0x7ff05c065420 msgr2=0x7ff05c064280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:07.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.520+0000 7ff060ad4700 1 --2- 172.21.15.38:0/1074676241 >> v2:172.21.15.150:3300/0 conn(0x7ff05c065420 0x7ff05c064280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:07.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.520+0000 7ff060ad4700 1 -- 172.21.15.38:0/1074676241 >> v1:172.21.15.150:6789/0 conn(0x7ff05c0b74d0 legacy=0x7ff05c156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:07.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.520+0000 7ff060ad4700 1 -- 172.21.15.38:0/1074676241 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05c0a04b0 con 0x7ff05c05b0a0 2020-06-12T17:49:07.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.520+0000 7ff060ad4700 1 --2- 172.21.15.38:0/1074676241 >> v2:172.21.15.38:3300/0 conn(0x7ff05c05b0a0 0x7ff05c09dcd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff05c0b7fb0 tx=0x7ff04c0017d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.520+0000 7ff060ad4700 1 --2- 172.21.15.38:0/1074676241 >> v2:172.21.15.38:3300/0 conn(0x7ff05c05b0a0 0x7ff05c09dcd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff05c0b7fb0 tx=0x7ff04c0017d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.520+0000 7ff060ad4700 1 --2- 172.21.15.38:0/1074676241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff05c05b0a0 0x7ff05c09dcd0 secure :-1 s=READY pgs=413 cs=0 l=1 rx=0x7ff05c0b7fb0 tx=0x7ff04c0017d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:07.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.520+0000 7ff060ad4700 1 --2- 172.21.15.38:0/1074676241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff05c05b0a0 0x7ff05c09dcd0 secure :-1 s=THROTTLE_DONE pgs=413 cs=0 l=1 rx=0x7ff05c0b7fb0 tx=0x7ff04c0017d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.520+0000 7ff060ad4700 1 --2- 172.21.15.38:0/1074676241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff05c05b0a0 0x7ff05c09dcd0 secure :-1 s=THROTTLE_DONE pgs=413 cs=0 l=1 rx=0x7ff05c0b7fb0 tx=0x7ff04c0017d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.520+0000 7ff060ad4700 1 --2- 172.21.15.38:0/1074676241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff05c05b0a0 0x7ff05c09dcd0 secure :-1 s=THROTTLE_DONE pgs=413 cs=0 l=1 rx=0x7ff05c0b7fb0 tx=0x7ff04c0017d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.520+0000 7ff059ffb700 1 -- 172.21.15.38:0/1074676241 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff04c00cc20 con 0x7ff05c05b0a0 2020-06-12T17:49:07.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.520+0000 7ff059ffb700 1 -- 172.21.15.38:0/1074676241 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c00cd80 con 0x7ff05c05b0a0 2020-06-12T17:49:07.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.520+0000 7ff062d38700 1 -- 172.21.15.38:0/1074676241 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff05c136090 con 0x7ff05c05b0a0 2020-06-12T17:49:07.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.520+0000 7ff059ffb700 1 -- 172.21.15.38:0/1074676241 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff04c0110e0 con 0x7ff05c05b0a0 2020-06-12T17:49:07.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.520+0000 7ff062d38700 1 -- 172.21.15.38:0/1074676241 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05c1353d0 con 0x7ff05c05b0a0 2020-06-12T17:49:07.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.521+0000 7ff060ad4700 1 --2- 172.21.15.38:0/1074676241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff05c05b0a0 0x7ff05c09dcd0 secure :-1 s=THROTTLE_DONE pgs=413 cs=0 l=1 rx=0x7ff05c0b7fb0 tx=0x7ff04c0017d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.521+0000 7ff062d38700 1 -- 172.21.15.38:0/1074676241 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff05c056c30 con 0x7ff05c05b0a0 2020-06-12T17:49:07.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.521+0000 7ff059ffb700 1 -- 172.21.15.38:0/1074676241 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7ff04c0064e0 con 0x7ff05c05b0a0 2020-06-12T17:49:07.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.521+0000 7ff060ad4700 1 --2- 172.21.15.38:0/1074676241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff05c05b0a0 0x7ff05c09dcd0 secure :-1 s=THROTTLE_DONE pgs=413 cs=0 l=1 rx=0x7ff05c0b7fb0 tx=0x7ff04c0017d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.521+0000 7ff059ffb700 1 --2- 172.21.15.38:0/1074676241 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff03c04d5c0 0x7ff03c04fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:07.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.522+0000 7ff059ffb700 1 -- 172.21.15.38:0/1074676241 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff04c060a40 con 0x7ff05c05b0a0 2020-06-12T17:49:07.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.522+0000 7ff05bfff700 1 --2- 172.21.15.38:0/1074676241 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff03c04d5c0 0x7ff03c04fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:07.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.522+0000 7ff05bfff700 1 --2- 172.21.15.38:0/1074676241 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff03c04d5c0 0x7ff03c04fa80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff050002f30 tx=0x7ff050007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.522+0000 7ff05bfff700 1 --2- 172.21.15.38:0/1074676241 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff03c04d5c0 0x7ff03c04fa80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff050002f30 tx=0x7ff050007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.522+0000 7ff05bfff700 1 --2- 172.21.15.38:0/1074676241 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff03c04d5c0 0x7ff03c04fa80 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7ff050002f30 tx=0x7ff050007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:07.540 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.525+0000 7ff060ad4700 1 --2- 172.21.15.38:0/1074676241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff05c05b0a0 0x7ff05c09dcd0 secure :-1 s=THROTTLE_DONE pgs=413 cs=0 l=1 rx=0x7ff05c0b7fb0 tx=0x7ff04c0017d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.540 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.525+0000 7ff059ffb700 1 -- 172.21.15.38:0/1074676241 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7ff04c03c1a0 con 0x7ff05c05b0a0 2020-06-12T17:49:07.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.678+0000 7ff062d38700 1 -- 172.21.15.38:0/1074676241 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff05c157a80 con 0x7ff05c05b0a0 2020-06-12T17:49:07.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.678+0000 7ff060ad4700 1 --2- 172.21.15.38:0/1074676241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff05c05b0a0 0x7ff05c09dcd0 secure :-1 s=THROTTLE_DONE pgs=413 cs=0 l=1 rx=0x7ff05c0b7fb0 tx=0x7ff04c0017d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.678+0000 7ff059ffb700 1 -- 172.21.15.38:0/1074676241 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+10 (secure 0 0 0) 0x7ff04c03f7c0 con 0x7ff05c05b0a0 2020-06-12T17:49:07.683 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:49:07.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.679+0000 7ff062d38700 1 -- 172.21.15.38:0/1074676241 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff03c04d5c0 msgr2=0x7ff03c04fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:07.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.679+0000 7ff062d38700 1 --2- 172.21.15.38:0/1074676241 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff03c04d5c0 0x7ff03c04fa80 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7ff050002f30 tx=0x7ff050007e60).stop 2020-06-12T17:49:07.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.679+0000 7ff062d38700 1 -- 172.21.15.38:0/1074676241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff05c05b0a0 msgr2=0x7ff05c09dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:07.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.679+0000 7ff062d38700 1 --2- 172.21.15.38:0/1074676241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff05c05b0a0 0x7ff05c09dcd0 secure :-1 s=READY pgs=413 cs=0 l=1 rx=0x7ff05c0b7fb0 tx=0x7ff04c0017d0).stop 2020-06-12T17:49:07.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.679+0000 7ff062d38700 1 -- 172.21.15.38:0/1074676241 shutdown_connections 2020-06-12T17:49:07.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.679+0000 7ff062d38700 1 --2- 172.21.15.38:0/1074676241 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff03c04d5c0 0x7ff03c04fa80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:07.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.679+0000 7ff062d38700 1 --2- 172.21.15.38:0/1074676241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff05c05b0a0 0x7ff05c09dcd0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:07.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.679+0000 7ff062d38700 1 --2- 172.21.15.38:0/1074676241 >> v2:172.21.15.150:3300/0 conn(0x7ff05c065420 0x7ff05c064280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:07.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.679+0000 7ff062d38700 1 -- 172.21.15.38:0/1074676241 >> 172.21.15.38:0/1074676241 conn(0x7ff05c0ba610 msgr2=0x7ff05c149ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:07.686 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.680+0000 7ff062d38700 1 -- 172.21.15.38:0/1074676241 shutdown_connections 2020-06-12T17:49:07.686 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.680+0000 7ff062d38700 1 -- 172.21.15.38:0/1074676241 wait complete. 2020-06-12T17:49:07.693 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-06-12T17:49:07.814 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.808+0000 7fd3f06cc700 1 Processor -- start 2020-06-12T17:49:07.818 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.808+0000 7fd3f06cc700 1 -- start start 2020-06-12T17:49:07.819 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.809+0000 7fd3f06cc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd3e8066b20 0x7fd3e81438f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:07.819 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.809+0000 7fd3f06cc700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e8147550 con 0x7fd3e809b190 2020-06-12T17:49:07.819 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.809+0000 7fd3f06cc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e809e110 con 0x7fd3e809dd30 2020-06-12T17:49:07.819 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.809+0000 7fd3f06cc700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e8067380 con 0x7fd3e8066b20 2020-06-12T17:49:07.819 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.809+0000 7fd3eec69700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd3e8066b20 0x7fd3e81438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:07.820 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.809+0000 7fd3edc67700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd3e809b190 0x7fd3e80b3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39164/0 (socket says 172.21.15.38:39164) 2020-06-12T17:49:07.820 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.809+0000 7fd3edc67700 1 -- 172.21.15.38:0/3481126980 learned_addr learned my addr 172.21.15.38:0/3481126980 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:07.820 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.809+0000 7fd3ed466700 1 -- 172.21.15.38:0/3481126980 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 722224327 0 0) 0x7fd3e8147550 con 0x7fd3e809b190 2020-06-12T17:49:07.820 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.809+0000 7fd3ed466700 1 -- 172.21.15.38:0/3481126980 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3d4003230 con 0x7fd3e809b190 2020-06-12T17:49:07.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.809+0000 7fd3eec69700 1 -- 172.21.15.38:0/3481126980 >> v1:172.21.15.150:6789/0 conn(0x7fd3e809dd30 legacy=0x7fd3e81431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:07.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.809+0000 7fd3eec69700 1 -- 172.21.15.38:0/3481126980 >> v1:172.21.15.38:6789/0 conn(0x7fd3e809b190 legacy=0x7fd3e80b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:07.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.809+0000 7fd3eec69700 1 -- 172.21.15.38:0/3481126980 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e8067000 con 0x7fd3e8066b20 2020-06-12T17:49:07.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.809+0000 7fd3eec69700 1 --2- 172.21.15.38:0/3481126980 >> v2:172.21.15.38:3300/0 conn(0x7fd3e8066b20 0x7fd3e81438f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd3d8002f30 tx=0x7fd3d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.809+0000 7fd3eec69700 1 --2- 172.21.15.38:0/3481126980 >> v2:172.21.15.38:3300/0 conn(0x7fd3e8066b20 0x7fd3e81438f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd3d8002f30 tx=0x7fd3d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.809+0000 7fd3eec69700 1 --2- 172.21.15.38:0/3481126980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3e8066b20 0x7fd3e81438f0 secure :-1 s=READY pgs=415 cs=0 l=1 rx=0x7fd3d8002f30 tx=0x7fd3d8007e60).ready entity=mon.0 client_cookie=abaa9930ebb71871 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:07.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.809+0000 7fd3eec69700 1 --2- 172.21.15.38:0/3481126980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3e8066b20 0x7fd3e81438f0 secure :-1 s=THROTTLE_DONE pgs=415 cs=0 l=1 rx=0x7fd3d8002f30 tx=0x7fd3d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.809+0000 7fd3ed466700 1 -- 172.21.15.38:0/3481126980 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3d8011380 con 0x7fd3e8066b20 2020-06-12T17:49:07.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.809+0000 7fd3eec69700 1 --2- 172.21.15.38:0/3481126980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3e8066b20 0x7fd3e81438f0 secure :-1 s=THROTTLE_DONE pgs=415 cs=0 l=1 rx=0x7fd3d8002f30 tx=0x7fd3d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.809+0000 7fd3eec69700 1 --2- 172.21.15.38:0/3481126980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3e8066b20 0x7fd3e81438f0 secure :-1 s=THROTTLE_DONE pgs=415 cs=0 l=1 rx=0x7fd3d8002f30 tx=0x7fd3d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.809+0000 7fd3ed466700 1 -- 172.21.15.38:0/3481126980 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d80114e0 con 0x7fd3e8066b20 2020-06-12T17:49:07.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.809+0000 7fd3ed466700 1 -- 172.21.15.38:0/3481126980 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3d8011880 con 0x7fd3e8066b20 2020-06-12T17:49:07.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.809+0000 7fd3f06cc700 1 -- 172.21.15.38:0/3481126980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3e8066b20 msgr2=0x7fd3e81438f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:07.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.809+0000 7fd3f06cc700 1 --2- 172.21.15.38:0/3481126980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3e8066b20 0x7fd3e81438f0 secure :-1 s=READY pgs=415 cs=0 l=1 rx=0x7fd3d8002f30 tx=0x7fd3d8007e60).stop 2020-06-12T17:49:07.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.810+0000 7fd3f06cc700 1 -- 172.21.15.38:0/3481126980 shutdown_connections 2020-06-12T17:49:07.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.810+0000 7fd3f06cc700 1 --2- 172.21.15.38:0/3481126980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3e8066b20 0x7fd3e81438f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:07.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.810+0000 7fd3f06cc700 1 -- 172.21.15.38:0/3481126980 >> 172.21.15.38:0/3481126980 conn(0x7fd3e80b5a20 msgr2=0x7fd3e805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:07.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.810+0000 7fd3f06cc700 1 -- 172.21.15.38:0/3481126980 shutdown_connections 2020-06-12T17:49:07.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.810+0000 7fd3f06cc700 1 -- 172.21.15.38:0/3481126980 wait complete. 2020-06-12T17:49:07.830 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.811+0000 7fd3f06cc700 1 Processor -- start 2020-06-12T17:49:07.830 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.811+0000 7fd3f06cc700 1 -- start start 2020-06-12T17:49:07.830 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.811+0000 7fd3f06cc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd3e809dd30 0x7fd3e8142c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:07.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.811+0000 7fd3f06cc700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e8145ff0 con 0x7fd3e809b190 2020-06-12T17:49:07.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.811+0000 7fd3f06cc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e809ac00 con 0x7fd3e8066b20 2020-06-12T17:49:07.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.812+0000 7fd3f06cc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e8145b50 con 0x7fd3e809dd30 2020-06-12T17:49:07.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.812+0000 7fd3edc67700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd3e809b190 0x7fd3e809bec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39170/0 (socket says 172.21.15.38:39170) 2020-06-12T17:49:07.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.812+0000 7fd3edc67700 1 -- 172.21.15.38:0/124354390 learned_addr learned my addr 172.21.15.38:0/124354390 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:07.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.812+0000 7fd3eec69700 1 --2- 172.21.15.38:0/124354390 >> v2:172.21.15.150:3300/0 conn(0x7fd3e809dd30 0x7fd3e8142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:07.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.812+0000 7fd3e77fe700 1 -- 172.21.15.38:0/124354390 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 279868372 0 0) 0x7fd3e8145ff0 con 0x7fd3e809b190 2020-06-12T17:49:07.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.812+0000 7fd3e77fe700 1 -- 172.21.15.38:0/124354390 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3c8002fe0 con 0x7fd3e809b190 2020-06-12T17:49:07.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.812+0000 7fd3e77fe700 1 -- 172.21.15.38:0/124354390 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413527202 0 0) 0x7fd3e809ac00 con 0x7fd3e8066b20 2020-06-12T17:49:07.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.812+0000 7fd3e77fe700 1 -- 172.21.15.38:0/124354390 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3e8145ff0 con 0x7fd3e8066b20 2020-06-12T17:49:07.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.812+0000 7fd3e77fe700 1 -- 172.21.15.38:0/124354390 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4121579204 0 0) 0x7fd3c8002fe0 con 0x7fd3e809b190 2020-06-12T17:49:07.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.812+0000 7fd3eec69700 1 -- 172.21.15.38:0/124354390 >> v1:172.21.15.150:6789/0 conn(0x7fd3e8066b20 legacy=0x7fd3e8065900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:07.835 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.812+0000 7fd3eec69700 1 -- 172.21.15.38:0/124354390 >> v1:172.21.15.38:6789/0 conn(0x7fd3e809b190 legacy=0x7fd3e809bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:07.835 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.812+0000 7fd3eec69700 1 -- 172.21.15.38:0/124354390 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e8145860 con 0x7fd3e809dd30 2020-06-12T17:49:07.835 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.812+0000 7fd3eec69700 1 --2- 172.21.15.38:0/124354390 >> v2:172.21.15.150:3300/0 conn(0x7fd3e809dd30 0x7fd3e8142c90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd3dc001ae0 tx=0x7fd3d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.836 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.812+0000 7fd3eec69700 1 --2- 172.21.15.38:0/124354390 >> v2:172.21.15.150:3300/0 conn(0x7fd3e809dd30 0x7fd3e8142c90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd3dc001ae0 tx=0x7fd3d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.836 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.812+0000 7fd3eec69700 1 --2- 172.21.15.38:0/124354390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3e809dd30 0x7fd3e8142c90 secure :-1 s=READY pgs=262 cs=0 l=1 rx=0x7fd3dc001ae0 tx=0x7fd3d8007e60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:07.836 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.812+0000 7fd3eec69700 1 --2- 172.21.15.38:0/124354390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3e809dd30 0x7fd3e8142c90 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7fd3dc001ae0 tx=0x7fd3d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.836 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.812+0000 7fd3e77fe700 1 -- 172.21.15.38:0/124354390 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3dc001940 con 0x7fd3e809dd30 2020-06-12T17:49:07.836 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.812+0000 7fd3eec69700 1 --2- 172.21.15.38:0/124354390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3e809dd30 0x7fd3e8142c90 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7fd3dc001ae0 tx=0x7fd3d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.812+0000 7fd3e77fe700 1 -- 172.21.15.38:0/124354390 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d8008e90 con 0x7fd3e809dd30 2020-06-12T17:49:07.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.812+0000 7fd3f06cc700 1 -- 172.21.15.38:0/124354390 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e8066010 con 0x7fd3e809dd30 2020-06-12T17:49:07.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.812+0000 7fd3eec69700 1 --2- 172.21.15.38:0/124354390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3e809dd30 0x7fd3e8142c90 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7fd3dc001ae0 tx=0x7fd3d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.812+0000 7fd3e77fe700 1 -- 172.21.15.38:0/124354390 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3d800f760 con 0x7fd3e809dd30 2020-06-12T17:49:07.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.812+0000 7fd3f06cc700 1 -- 172.21.15.38:0/124354390 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e8140260 con 0x7fd3e809dd30 2020-06-12T17:49:07.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.813+0000 7fd3eec69700 1 --2- 172.21.15.38:0/124354390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3e809dd30 0x7fd3e8142c90 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7fd3dc001ae0 tx=0x7fd3d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.814+0000 7fd3e77fe700 1 -- 172.21.15.38:0/124354390 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fd3d8007150 con 0x7fd3e809dd30 2020-06-12T17:49:07.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.814+0000 7fd3eec69700 1 --2- 172.21.15.38:0/124354390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3e809dd30 0x7fd3e8142c90 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7fd3dc001ae0 tx=0x7fd3d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.814+0000 7fd3f06cc700 1 -- 172.21.15.38:0/124354390 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e8067b20 con 0x7fd3e809dd30 2020-06-12T17:49:07.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.814+0000 7fd3e77fe700 1 --2- 172.21.15.38:0/124354390 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd3c804da30 0x7fd3c804fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:07.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.814+0000 7fd3e77fe700 1 -- 172.21.15.38:0/124354390 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd3d8060d60 con 0x7fd3e809dd30 2020-06-12T17:49:07.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.814+0000 7fd3ee468700 1 --2- 172.21.15.38:0/124354390 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd3c804da30 0x7fd3c804fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:07.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.814+0000 7fd3ee468700 1 --2- 172.21.15.38:0/124354390 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd3c804da30 0x7fd3c804fef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd3e0001360 tx=0x7fd3e0002920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.814+0000 7fd3ee468700 1 --2- 172.21.15.38:0/124354390 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd3c804da30 0x7fd3c804fef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd3e0001360 tx=0x7fd3e0002920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.814+0000 7fd3ee468700 1 --2- 172.21.15.38:0/124354390 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd3c804da30 0x7fd3c804fef0 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7fd3e0001360 tx=0x7fd3e0002920).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:07.840 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.818+0000 7fd3eec69700 1 --2- 172.21.15.38:0/124354390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3e809dd30 0x7fd3e8142c90 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7fd3dc001ae0 tx=0x7fd3d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.840 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.818+0000 7fd3e77fe700 1 -- 172.21.15.38:0/124354390 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fd3d803c560 con 0x7fd3e809dd30 2020-06-12T17:49:07.973 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.970+0000 7fd3f06cc700 1 -- 172.21.15.38:0/124354390 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd3e8056c30 con 0x7fd3e809dd30 2020-06-12T17:49:07.974 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.971+0000 7fd3eec69700 1 --2- 172.21.15.38:0/124354390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3e809dd30 0x7fd3e8142c90 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7fd3dc001ae0 tx=0x7fd3d8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:07.974 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.971+0000 7fd3e77fe700 1 -- 172.21.15.38:0/124354390 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd3d80150e0 con 0x7fd3e809dd30 2020-06-12T17:49:07.975 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2020-06-12T17:49:07.976 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.972+0000 7fd3f06cc700 1 -- 172.21.15.38:0/124354390 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd3c804da30 msgr2=0x7fd3c804fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:07.976 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.972+0000 7fd3f06cc700 1 --2- 172.21.15.38:0/124354390 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd3c804da30 0x7fd3c804fef0 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7fd3e0001360 tx=0x7fd3e0002920).stop 2020-06-12T17:49:07.976 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.972+0000 7fd3f06cc700 1 -- 172.21.15.38:0/124354390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3e809dd30 msgr2=0x7fd3e8142c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:07.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.972+0000 7fd3f06cc700 1 --2- 172.21.15.38:0/124354390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3e809dd30 0x7fd3e8142c90 secure :-1 s=READY pgs=262 cs=0 l=1 rx=0x7fd3dc001ae0 tx=0x7fd3d8007e60).stop 2020-06-12T17:49:07.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.972+0000 7fd3f06cc700 1 -- 172.21.15.38:0/124354390 shutdown_connections 2020-06-12T17:49:07.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.972+0000 7fd3f06cc700 1 --2- 172.21.15.38:0/124354390 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd3c804da30 0x7fd3c804fef0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:07.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.972+0000 7fd3f06cc700 1 --2- 172.21.15.38:0/124354390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3e809dd30 0x7fd3e8142c90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:07.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.972+0000 7fd3f06cc700 1 -- 172.21.15.38:0/124354390 >> 172.21.15.38:0/124354390 conn(0x7fd3e80b5a20 msgr2=0x7fd3e80b7750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:07.978 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.972+0000 7fd3f06cc700 1 -- 172.21.15.38:0/124354390 shutdown_connections 2020-06-12T17:49:07.978 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:07.972+0000 7fd3f06cc700 1 -- 172.21.15.38:0/124354390 wait complete. 2020-06-12T17:49:07.986 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-06-12T17:49:07.987 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-06-12T17:49:08.101 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.097+0000 7f9a19101700 1 Processor -- start 2020-06-12T17:49:08.101 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.097+0000 7f9a19101700 1 -- start start 2020-06-12T17:49:08.104 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.098+0000 7f9a19101700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9a14061a80 0x7f9a1409bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:08.104 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.098+0000 7f9a19101700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a140b44a0 0x7f9a141427e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:08.105 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.098+0000 7f9a19101700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a140b2dc0 con 0x7f9a14142350 2020-06-12T17:49:08.105 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.098+0000 7f9a19101700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a14142c40 con 0x7f9a14061a80 2020-06-12T17:49:08.105 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.098+0000 7f9a19101700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1409e560 con 0x7f9a140b44a0 2020-06-12T17:49:08.105 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.099+0000 7f9a12d9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9a14061a80 0x7f9a1409bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:08.105 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.099+0000 7f9a1359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a140b44a0 0x7f9a141427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:08.106 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.099+0000 7f9a12d9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9a14061a80 0x7f9a1409bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:46840/0 (socket says 172.21.15.38:46840) 2020-06-12T17:49:08.106 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.099+0000 7f9a12d9d700 1 -- 172.21.15.38:0/2075784201 learned_addr learned my addr 172.21.15.38:0/2075784201 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:08.106 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.099+0000 7f9a1259c700 1 --1- 172.21.15.38:0/2075784201 >> v1:172.21.15.150:6789/0 conn(0x7f9a14142350 0x7f9a14146380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:59908/0 (socket says 172.21.15.38:59908) 2020-06-12T17:49:08.106 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.099+0000 7f9a1359e700 1 -- 172.21.15.38:0/2075784201 >> v2:172.21.15.150:3300/0 conn(0x7f9a14061a80 msgr2=0x7f9a1409bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:08.106 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.099+0000 7f9a1359e700 1 --2- 172.21.15.38:0/2075784201 >> v2:172.21.15.150:3300/0 conn(0x7f9a14061a80 0x7f9a1409bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:08.107 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.099+0000 7f9a1359e700 1 -- 172.21.15.38:0/2075784201 >> v1:172.21.15.150:6789/0 conn(0x7f9a14142350 legacy=0x7f9a14146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:08.107 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.099+0000 7f9a1359e700 1 -- 172.21.15.38:0/2075784201 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a140b29d0 con 0x7f9a140b44a0 2020-06-12T17:49:08.107 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.099+0000 7f9a12d9d700 1 --2- 172.21.15.38:0/2075784201 >> v2:172.21.15.150:3300/0 conn(0x7f9a14061a80 0x7f9a1409bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:49:08.107 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.099+0000 7f9a1359e700 1 --2- 172.21.15.38:0/2075784201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a140b44a0 0x7f9a141427e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9a0c0032b0 tx=0x7f9a0c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:08.107 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.099+0000 7f9a1359e700 1 --2- 172.21.15.38:0/2075784201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a140b44a0 0x7f9a141427e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9a0c0032b0 tx=0x7f9a0c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:08.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.099+0000 7f9a1359e700 1 --2- 172.21.15.38:0/2075784201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a140b44a0 0x7f9a141427e0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f9a0c0032b0 tx=0x7f9a0c0081e0).ready entity=mon.2 client_cookie=460a4a69030e8bcb server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:08.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.099+0000 7f9a1359e700 1 --2- 172.21.15.38:0/2075784201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a140b44a0 0x7f9a141427e0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f9a0c0032b0 tx=0x7f9a0c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:08.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.099+0000 7f9a11d9b700 1 -- 172.21.15.38:0/2075784201 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a0c011de0 con 0x7f9a140b44a0 2020-06-12T17:49:08.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.099+0000 7f9a1359e700 1 --2- 172.21.15.38:0/2075784201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a140b44a0 0x7f9a141427e0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f9a0c0032b0 tx=0x7f9a0c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:08.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.099+0000 7f9a1359e700 1 --2- 172.21.15.38:0/2075784201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a140b44a0 0x7f9a141427e0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f9a0c0032b0 tx=0x7f9a0c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:08.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.099+0000 7f9a11d9b700 1 -- 172.21.15.38:0/2075784201 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0c00a160 con 0x7f9a140b44a0 2020-06-12T17:49:08.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.099+0000 7f9a11d9b700 1 -- 172.21.15.38:0/2075784201 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a0c00a540 con 0x7f9a140b44a0 2020-06-12T17:49:08.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.099+0000 7f9a19101700 1 -- 172.21.15.38:0/2075784201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a140b44a0 msgr2=0x7f9a141427e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:08.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.099+0000 7f9a19101700 1 --2- 172.21.15.38:0/2075784201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a140b44a0 0x7f9a141427e0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f9a0c0032b0 tx=0x7f9a0c0081e0).stop 2020-06-12T17:49:08.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.100+0000 7f9a19101700 1 -- 172.21.15.38:0/2075784201 shutdown_connections 2020-06-12T17:49:08.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.100+0000 7f9a19101700 1 --2- 172.21.15.38:0/2075784201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a140b44a0 0x7f9a141427e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:08.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.100+0000 7f9a19101700 1 --2- 172.21.15.38:0/2075784201 >> v2:172.21.15.150:3300/0 conn(0x7f9a14061a80 0x7f9a1409bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:08.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.100+0000 7f9a19101700 1 -- 172.21.15.38:0/2075784201 >> 172.21.15.38:0/2075784201 conn(0x7f9a140b8420 msgr2=0x7f9a140b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:08.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.100+0000 7f9a19101700 1 -- 172.21.15.38:0/2075784201 shutdown_connections 2020-06-12T17:49:08.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.100+0000 7f9a19101700 1 -- 172.21.15.38:0/2075784201 wait complete. 2020-06-12T17:49:08.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.101+0000 7f9a19101700 1 Processor -- start 2020-06-12T17:49:08.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.101+0000 7f9a19101700 1 -- start start 2020-06-12T17:49:08.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.102+0000 7f9a19101700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a140b44a0 0x7f9a140ada50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:08.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.102+0000 7f9a19101700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a140af6a0 con 0x7f9a14142350 2020-06-12T17:49:08.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.102+0000 7f9a19101700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a140af940 con 0x7f9a14061a80 2020-06-12T17:49:08.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.102+0000 7f9a19101700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a140ae400 con 0x7f9a140b44a0 2020-06-12T17:49:08.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.102+0000 7f9a1359e700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f9a14142350 0x7f9a141402a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39186/0 (socket says 172.21.15.38:39186) 2020-06-12T17:49:08.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.102+0000 7f9a1359e700 1 -- 172.21.15.38:0/3061216701 learned_addr learned my addr 172.21.15.38:0/3061216701 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:08.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.102+0000 7f9a1259c700 1 --2- 172.21.15.38:0/3061216701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a140b44a0 0x7f9a140ada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:08.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.102+0000 7f9a0bfff700 1 -- 172.21.15.38:0/3061216701 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 655398175 0 0) 0x7f9a140af6a0 con 0x7f9a14142350 2020-06-12T17:49:08.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.102+0000 7f9a0bfff700 1 -- 172.21.15.38:0/3061216701 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99f8002fe0 con 0x7f9a14142350 2020-06-12T17:49:08.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.102+0000 7f9a0bfff700 1 -- 172.21.15.38:0/3061216701 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229054615 0 0) 0x7f9a140af940 con 0x7f9a14061a80 2020-06-12T17:49:08.118 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.102+0000 7f9a0bfff700 1 -- 172.21.15.38:0/3061216701 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a140af6a0 con 0x7f9a14061a80 2020-06-12T17:49:08.118 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.102+0000 7f9a1259c700 1 -- 172.21.15.38:0/3061216701 >> v1:172.21.15.150:6789/0 conn(0x7f9a14061a80 legacy=0x7f9a140b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:08.118 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.102+0000 7f9a1259c700 1 -- 172.21.15.38:0/3061216701 >> v1:172.21.15.38:6789/0 conn(0x7f9a14142350 legacy=0x7f9a141402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:08.118 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.102+0000 7f9a1259c700 1 -- 172.21.15.38:0/3061216701 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a140afbe0 con 0x7f9a140b44a0 2020-06-12T17:49:08.118 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.102+0000 7f9a1259c700 1 --2- 172.21.15.38:0/3061216701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a140b44a0 0x7f9a140ada50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9a14060540 tx=0x7f9a04001790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:08.119 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.102+0000 7f9a1259c700 1 --2- 172.21.15.38:0/3061216701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a140b44a0 0x7f9a140ada50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9a14060540 tx=0x7f9a04001790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:08.119 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.102+0000 7f9a1259c700 1 --2- 172.21.15.38:0/3061216701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a140b44a0 0x7f9a140ada50 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f9a14060540 tx=0x7f9a04001790).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:08.119 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.102+0000 7f9a1259c700 1 --2- 172.21.15.38:0/3061216701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a140b44a0 0x7f9a140ada50 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f9a14060540 tx=0x7f9a04001790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:08.119 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.102+0000 7f9a0bfff700 1 -- 172.21.15.38:0/3061216701 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a040114f0 con 0x7f9a140b44a0 2020-06-12T17:49:08.119 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.102+0000 7f9a1259c700 1 --2- 172.21.15.38:0/3061216701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a140b44a0 0x7f9a140ada50 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f9a14060540 tx=0x7f9a04001790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:08.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.102+0000 7f9a0bfff700 1 -- 172.21.15.38:0/3061216701 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a04011650 con 0x7f9a140b44a0 2020-06-12T17:49:08.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.102+0000 7f9a1259c700 1 --2- 172.21.15.38:0/3061216701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a140b44a0 0x7f9a140ada50 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f9a14060540 tx=0x7f9a04001790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:08.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.102+0000 7f9a19101700 1 -- 172.21.15.38:0/3061216701 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a140b0790 con 0x7f9a140b44a0 2020-06-12T17:49:08.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.102+0000 7f9a0bfff700 1 -- 172.21.15.38:0/3061216701 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a04011a30 con 0x7f9a140b44a0 2020-06-12T17:49:08.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.103+0000 7f9a19101700 1 -- 172.21.15.38:0/3061216701 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a141557a0 con 0x7f9a140b44a0 2020-06-12T17:49:08.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.103+0000 7f9a1259c700 1 --2- 172.21.15.38:0/3061216701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a140b44a0 0x7f9a140ada50 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f9a14060540 tx=0x7f9a04001790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:08.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.103+0000 7f9a19101700 1 -- 172.21.15.38:0/3061216701 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a14155c40 con 0x7f9a140b44a0 2020-06-12T17:49:08.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.104+0000 7f9a0bfff700 1 -- 172.21.15.38:0/3061216701 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f9a04007180 con 0x7f9a140b44a0 2020-06-12T17:49:08.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.104+0000 7f9a1259c700 1 --2- 172.21.15.38:0/3061216701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a140b44a0 0x7f9a140ada50 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f9a14060540 tx=0x7f9a04001790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:08.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.104+0000 7f9a0bfff700 1 --2- 172.21.15.38:0/3061216701 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f99f804da90 0x7f99f804ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:08.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.104+0000 7f9a0bfff700 1 -- 172.21.15.38:0/3061216701 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9a04060b00 con 0x7f9a140b44a0 2020-06-12T17:49:08.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.104+0000 7f9a12d9d700 1 --2- 172.21.15.38:0/3061216701 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f99f804da90 0x7f99f804ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:08.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.104+0000 7f9a12d9d700 1 --2- 172.21.15.38:0/3061216701 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f99f804da90 0x7f99f804ff50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f99fc007720 tx=0x7f99fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:08.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.104+0000 7f9a12d9d700 1 --2- 172.21.15.38:0/3061216701 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f99f804da90 0x7f99f804ff50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f99fc007720 tx=0x7f99fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:08.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.104+0000 7f9a12d9d700 1 --2- 172.21.15.38:0/3061216701 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f99f804da90 0x7f99f804ff50 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7f99fc007720 tx=0x7f99fc007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:08.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.108+0000 7f9a1259c700 1 --2- 172.21.15.38:0/3061216701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a140b44a0 0x7f9a140ada50 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f9a14060540 tx=0x7f9a04001790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:08.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.108+0000 7f9a0bfff700 1 -- 172.21.15.38:0/3061216701 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f9a0403c180 con 0x7f9a140b44a0 2020-06-12T17:49:08.313 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.310+0000 7f9a19101700 1 -- 172.21.15.38:0/3061216701 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a14056c30 con 0x7f9a140b44a0 2020-06-12T17:49:08.314 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.310+0000 7f9a1259c700 1 --2- 172.21.15.38:0/3061216701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a140b44a0 0x7f9a140ada50 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f9a14060540 tx=0x7f9a04001790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:08.314 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.310+0000 7f9a0bfff700 1 -- 172.21.15.38:0/3061216701 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2141 (secure 0 0 0) 0x7f9a0403f7a0 con 0x7f9a140b44a0 2020-06-12T17:49:08.315 INFO:teuthology.orchestra.run.smithi038.stdout: 2020-06-12T17:49:08.315 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.38:6833/1552225333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1552225333},{"type":"v1","addr":"172.21.15.38:6833","nonce":1552225333}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":10}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-06-12T17:49:02.759507+0000","modified":"2020-06-12T17:49:03.760890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5008},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5008":{"gid":5008,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/2576246531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2576246531},{"type":"v1","addr":"172.21.15.150:6835","nonce":2576246531}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-06-12T17:49:08.316 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.312+0000 7f9a19101700 1 -- 172.21.15.38:0/3061216701 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f99f804da90 msgr2=0x7f99f804ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:08.316 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.312+0000 7f9a19101700 1 --2- 172.21.15.38:0/3061216701 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f99f804da90 0x7f99f804ff50 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7f99fc007720 tx=0x7f99fc007e60).stop 2020-06-12T17:49:08.316 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.312+0000 7f9a19101700 1 -- 172.21.15.38:0/3061216701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a140b44a0 msgr2=0x7f9a140ada50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:08.317 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.312+0000 7f9a19101700 1 --2- 172.21.15.38:0/3061216701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a140b44a0 0x7f9a140ada50 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f9a14060540 tx=0x7f9a04001790).stop 2020-06-12T17:49:08.317 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.312+0000 7f9a19101700 1 -- 172.21.15.38:0/3061216701 shutdown_connections 2020-06-12T17:49:08.317 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.312+0000 7f9a19101700 1 --2- 172.21.15.38:0/3061216701 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f99f804da90 0x7f99f804ff50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:08.317 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.312+0000 7f9a19101700 1 --2- 172.21.15.38:0/3061216701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a140b44a0 0x7f9a140ada50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:08.317 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.312+0000 7f9a19101700 1 -- 172.21.15.38:0/3061216701 >> 172.21.15.38:0/3061216701 conn(0x7f9a140b8420 msgr2=0x7f9a141415d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:08.318 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.312+0000 7f9a19101700 1 -- 172.21.15.38:0/3061216701 shutdown_connections 2020-06-12T17:49:08.318 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:08.312+0000 7f9a19101700 1 -- 172.21.15.38:0/3061216701 wait complete. 2020-06-12T17:49:08.318 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 12 2020-06-12T17:49:08.527 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-06-12T17:49:02.759507+0000', 'modified': '2020-06-12T17:49:03.760890+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5008}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5008': {'gid': 5008, 'name': 'b', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6835/2576246531', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6834', 'nonce': 2576246531}, {'type': 'v1', 'addr': '172.21.15.150:6835', 'nonce': 2576246531}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292836696063, 'flags': 0}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-06-12T17:49:08.528 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-06-12T17:49:08.528 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-06-12T17:49:08.658 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2020-06-12T17:49:08.658 INFO:teuthology.orchestra.run.smithi150.stdout: "cluster_fsid": "8e42a2e7-b187-42c4-a73f-8f812ee62352", 2020-06-12T17:49:08.658 INFO:teuthology.orchestra.run.smithi150.stdout: "whoami": 0, 2020-06-12T17:49:08.658 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 5008, 2020-06-12T17:49:08.659 INFO:teuthology.orchestra.run.smithi150.stdout: "want_state": "up:active", 2020-06-12T17:49:08.659 INFO:teuthology.orchestra.run.smithi150.stdout: "state": "up:active", 2020-06-12T17:49:08.659 INFO:teuthology.orchestra.run.smithi150.stdout: "rank_uptime": 5.8935249570000003, 2020-06-12T17:49:08.659 INFO:teuthology.orchestra.run.smithi150.stdout: "mdsmap_epoch": 12, 2020-06-12T17:49:08.659 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch": 34, 2020-06-12T17:49:08.660 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_epoch_barrier": 33, 2020-06-12T17:49:08.660 INFO:teuthology.orchestra.run.smithi150.stdout: "uptime": 13.141572376999999 2020-06-12T17:49:08.660 INFO:teuthology.orchestra.run.smithi150.stdout:} 2020-06-12T17:49:08.666 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "8e42a2e7-b187-42c4-a73f-8f812ee62352", "whoami": 0, "id": 5008, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.8935249570000003, "mdsmap_epoch": 12, "osdmap_epoch": 34, "osdmap_epoch_barrier": 33, "uptime": 13.141572376999999 } 2020-06-12T17:49:08.667 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-06-12T17:49:08.667 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-06-12T17:49:08.667 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-06-12T17:49:08.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:08.668 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:08.685 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:08.686 INFO:teuthology.orchestra.run.smithi038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-06-12T17:49:08.756 INFO:teuthology.orchestra.run.smithi038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-06-12T17:49:08.757 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-06-12T17:49:08.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:08.759 INFO:teuthology.orchestra.run.smithi038:> ls /sys/fs/fuse/connections 2020-06-12T17:49:08.813 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-06-12T17:49:08.814 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:08.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:08.856 INFO:teuthology.orchestra.run.smithi038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-06-12T17:49:08.888 INFO:teuthology.orchestra.run.smithi038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted on /sys/fs/fuse/connections. 2020-06-12T17:49:08.889 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-06-12T17:49:08.890 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:08.890 INFO:teuthology.orchestra.run.smithi038:> ls /sys/fs/fuse/connections 2020-06-12T17:49:08.938 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi038.stderr:2020-06-12T17:49:08.935+0000 7fadd7c541c0 -1 init, newargv = 0x564cc34f0f20 newargc=9 2020-06-12T17:49:08.939 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi038.stderr:ceph-fuse[38489]: starting ceph client 2020-06-12T17:49:08.943 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi038.stderr:ceph-fuse[38489]: starting fuse 2020-06-12T17:49:08.945 INFO:teuthology.orchestra.run.smithi038.stdout:46 2020-06-12T17:49:08.946 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2020-06-12T17:49:08.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:08.947 INFO:teuthology.orchestra.run.smithi038:> sudo python3 -c ' 2020-06-12T17:49:08.947 INFO:teuthology.orchestra.run.smithi038:> import glob 2020-06-12T17:49:08.948 INFO:teuthology.orchestra.run.smithi038:> import re 2020-06-12T17:49:08.948 INFO:teuthology.orchestra.run.smithi038:> import os 2020-06-12T17:49:08.949 INFO:teuthology.orchestra.run.smithi038:> import subprocess 2020-06-12T17:49:08.949 INFO:teuthology.orchestra.run.smithi038:> 2020-06-12T17:49:08.950 INFO:teuthology.orchestra.run.smithi038:> def find_socket(client_name): 2020-06-12T17:49:08.950 INFO:teuthology.orchestra.run.smithi038:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-06-12T17:49:08.950 INFO:teuthology.orchestra.run.smithi038:> files = glob.glob(asok_path) 2020-06-12T17:49:08.951 INFO:teuthology.orchestra.run.smithi038:> 2020-06-12T17:49:08.951 INFO:teuthology.orchestra.run.smithi038:> # Given a non-glob path, it better be there 2020-06-12T17:49:08.952 INFO:teuthology.orchestra.run.smithi038:> if "*" not in asok_path: 2020-06-12T17:49:08.952 INFO:teuthology.orchestra.run.smithi038:> assert(len(files) == 1) 2020-06-12T17:49:08.953 INFO:teuthology.orchestra.run.smithi038:> return files[0] 2020-06-12T17:49:08.953 INFO:teuthology.orchestra.run.smithi038:> 2020-06-12T17:49:08.953 INFO:teuthology.orchestra.run.smithi038:> for f in files: 2020-06-12T17:49:08.954 INFO:teuthology.orchestra.run.smithi038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-06-12T17:49:08.954 INFO:teuthology.orchestra.run.smithi038:> if os.path.exists("/proc/{0}".format(pid)): 2020-06-12T17:49:08.955 INFO:teuthology.orchestra.run.smithi038:> return f 2020-06-12T17:49:08.955 INFO:teuthology.orchestra.run.smithi038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-06-12T17:49:08.956 INFO:teuthology.orchestra.run.smithi038:> 2020-06-12T17:49:08.956 INFO:teuthology.orchestra.run.smithi038:> print(find_socket("client.0")) 2020-06-12T17:49:08.956 INFO:teuthology.orchestra.run.smithi038:> ' 2020-06-12T17:49:09.041 INFO:teuthology.orchestra.run.smithi038.stdout:/var/run/ceph/ceph-client.0.38489.asok 2020-06-12T17:49:09.045 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.38489.asok 2020-06-12T17:49:09.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:09.046 INFO:teuthology.orchestra.run.smithi038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.38489.asok status 2020-06-12T17:49:09.162 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2020-06-12T17:49:09.162 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": { 2020-06-12T17:49:09.162 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_sha1": "91d24f498556f86f6d1318d2efd5210c35b36762", 2020-06-12T17:49:09.162 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_version": "ceph version 15.2.3-196-g91d24f4 (91d24f498556f86f6d1318d2efd5210c35b36762) octopus (stable)", 2020-06-12T17:49:09.163 INFO:teuthology.orchestra.run.smithi038.stdout: "entity_id": "0", 2020-06-12T17:49:09.163 INFO:teuthology.orchestra.run.smithi038.stdout: "hostname": "smithi038", 2020-06-12T17:49:09.163 INFO:teuthology.orchestra.run.smithi038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-06-12T17:49:09.163 INFO:teuthology.orchestra.run.smithi038.stdout: "pid": "38489", 2020-06-12T17:49:09.163 INFO:teuthology.orchestra.run.smithi038.stdout: "root": "/" 2020-06-12T17:49:09.164 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:49:09.164 INFO:teuthology.orchestra.run.smithi038.stdout: "dentry_count": 0, 2020-06-12T17:49:09.164 INFO:teuthology.orchestra.run.smithi038.stdout: "dentry_pinned_count": 0, 2020-06-12T17:49:09.164 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 5319, 2020-06-12T17:49:09.164 INFO:teuthology.orchestra.run.smithi038.stdout: "inst": { 2020-06-12T17:49:09.165 INFO:teuthology.orchestra.run.smithi038.stdout: "name": { 2020-06-12T17:49:09.165 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "client", 2020-06-12T17:49:09.165 INFO:teuthology.orchestra.run.smithi038.stdout: "num": 5319 2020-06-12T17:49:09.165 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:49:09.166 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": { 2020-06-12T17:49:09.166 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:49:09.166 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:0", 2020-06-12T17:49:09.166 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 879027391 2020-06-12T17:49:09.166 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:49:09.167 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:49:09.167 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": { 2020-06-12T17:49:09.167 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2020-06-12T17:49:09.167 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:0", 2020-06-12T17:49:09.167 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 879027391 2020-06-12T17:49:09.167 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2020-06-12T17:49:09.168 INFO:teuthology.orchestra.run.smithi038.stdout: "inst_str": "client.5319 172.21.15.38:0/879027391", 2020-06-12T17:49:09.168 INFO:teuthology.orchestra.run.smithi038.stdout: "addr_str": "172.21.15.38:0/879027391", 2020-06-12T17:49:09.168 INFO:teuthology.orchestra.run.smithi038.stdout: "inode_count": 1, 2020-06-12T17:49:09.168 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_epoch": 12, 2020-06-12T17:49:09.168 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_epoch": 34, 2020-06-12T17:49:09.169 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_epoch_barrier": 0, 2020-06-12T17:49:09.169 INFO:teuthology.orchestra.run.smithi038.stdout: "blacklisted": false 2020-06-12T17:49:09.169 INFO:teuthology.orchestra.run.smithi038.stdout:} 2020-06-12T17:49:09.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:09.171 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:09.171 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:09.186 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:09.187 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:09.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:09.188 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:09.258 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs flag set enable_multiple true --yes-i-really-mean-it 2020-06-12T17:49:09.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.412+0000 7f1dd72df700 1 Processor -- start 2020-06-12T17:49:09.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.413+0000 7f1dd72df700 1 -- start start 2020-06-12T17:49:09.419 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.413+0000 7f1dd72df700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1dd0146680 0x7f1dd00ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:09.419 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.413+0000 7f1dd72df700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1dd00b2eb0 0x7f1dd009d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:09.420 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.413+0000 7f1dd72df700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1dd009d620 0x7f1dd009da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:09.420 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.413+0000 7f1dd72df700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd0146d20 con 0x7f1dd009d620 2020-06-12T17:49:09.420 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.413+0000 7f1dd72df700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd0066a80 con 0x7f1dd00b2eb0 2020-06-12T17:49:09.420 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.413+0000 7f1dd72df700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd0146f50 con 0x7f1dd0146680 2020-06-12T17:49:09.420 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.414+0000 7f1dd587c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1dd009d620 0x7f1dd009da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:09.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.414+0000 7f1dd587c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1dd009d620 0x7f1dd009da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37392/0 (socket says 172.21.15.38:37392) 2020-06-12T17:49:09.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.414+0000 7f1dd587c700 1 -- 172.21.15.38:0/437303738 learned_addr learned my addr 172.21.15.38:0/437303738 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:09.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.414+0000 7f1dd507b700 1 --2- 172.21.15.38:0/437303738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1dd0146680 0x7f1dd00ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:09.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.414+0000 7f1dd487a700 1 --2- 172.21.15.38:0/437303738 >> v2:172.21.15.150:3300/0 conn(0x7f1dd00b2eb0 0x7f1dd009d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:09.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.414+0000 7f1dd587c700 1 -- 172.21.15.38:0/437303738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1dd0146680 msgr2=0x7f1dd00ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:09.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.414+0000 7f1dd587c700 1 --2- 172.21.15.38:0/437303738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1dd0146680 0x7f1dd00ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:09.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.414+0000 7f1dd587c700 1 -- 172.21.15.38:0/437303738 >> v2:172.21.15.150:3300/0 conn(0x7f1dd00b2eb0 msgr2=0x7f1dd009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:09.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.414+0000 7f1dd587c700 1 --2- 172.21.15.38:0/437303738 >> v2:172.21.15.150:3300/0 conn(0x7f1dd00b2eb0 0x7f1dd009d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:09.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.414+0000 7f1dd587c700 1 -- 172.21.15.38:0/437303738 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd0146a60 con 0x7f1dd009d620 2020-06-12T17:49:09.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.414+0000 7f1dd587c700 1 --2- 172.21.15.38:0/437303738 >> v2:172.21.15.38:3300/0 conn(0x7f1dd009d620 0x7f1dd009da90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1dc80032b0 tx=0x7f1dc80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:09.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.414+0000 7f1dd587c700 1 --2- 172.21.15.38:0/437303738 >> v2:172.21.15.38:3300/0 conn(0x7f1dd009d620 0x7f1dd009da90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1dc80032b0 tx=0x7f1dc80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:09.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.414+0000 7f1dd587c700 1 --2- 172.21.15.38:0/437303738 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1dd009d620 0x7f1dd009da90 secure :-1 s=READY pgs=420 cs=0 l=1 rx=0x7f1dc80032b0 tx=0x7f1dc80081e0).ready entity=mon.0 client_cookie=d15d1eb3aba421a1 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:09.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.414+0000 7f1dd587c700 1 --2- 172.21.15.38:0/437303738 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1dd009d620 0x7f1dd009da90 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7f1dc80032b0 tx=0x7f1dc80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:09.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.414+0000 7f1dd587c700 1 --2- 172.21.15.38:0/437303738 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1dd009d620 0x7f1dd009da90 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7f1dc80032b0 tx=0x7f1dc80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:09.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.414+0000 7f1dbffff700 1 -- 172.21.15.38:0/437303738 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dc800a160 con 0x7f1dd009d620 2020-06-12T17:49:09.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.414+0000 7f1dd587c700 1 --2- 172.21.15.38:0/437303738 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1dd009d620 0x7f1dd009da90 secure :-1 s=THROTTLE_DONE pgs=420 cs=0 l=1 rx=0x7f1dc80032b0 tx=0x7f1dc80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:09.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.414+0000 7f1dbffff700 1 -- 172.21.15.38:0/437303738 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc800a2c0 con 0x7f1dd009d620 2020-06-12T17:49:09.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.414+0000 7f1dbffff700 1 -- 172.21.15.38:0/437303738 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dc800a6a0 con 0x7f1dd009d620 2020-06-12T17:49:09.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.414+0000 7f1dd72df700 1 -- 172.21.15.38:0/437303738 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1dd009d620 msgr2=0x7f1dd009da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:09.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.414+0000 7f1dd72df700 1 --2- 172.21.15.38:0/437303738 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1dd009d620 0x7f1dd009da90 secure :-1 s=READY pgs=420 cs=0 l=1 rx=0x7f1dc80032b0 tx=0x7f1dc80081e0).stop 2020-06-12T17:49:09.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.415+0000 7f1dd72df700 1 -- 172.21.15.38:0/437303738 shutdown_connections 2020-06-12T17:49:09.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.415+0000 7f1dd72df700 1 --2- 172.21.15.38:0/437303738 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1dd009d620 0x7f1dd009da90 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:09.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.415+0000 7f1dd72df700 1 --2- 172.21.15.38:0/437303738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1dd0146680 0x7f1dd00ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:09.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.415+0000 7f1dd72df700 1 --2- 172.21.15.38:0/437303738 >> v2:172.21.15.150:3300/0 conn(0x7f1dd00b2eb0 0x7f1dd009d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:09.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.415+0000 7f1dd72df700 1 -- 172.21.15.38:0/437303738 >> 172.21.15.38:0/437303738 conn(0x7f1dd00b5a20 msgr2=0x7f1dd005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:09.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.415+0000 7f1dd72df700 1 -- 172.21.15.38:0/437303738 shutdown_connections 2020-06-12T17:49:09.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.415+0000 7f1dd72df700 1 -- 172.21.15.38:0/437303738 wait complete. 2020-06-12T17:49:09.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.416+0000 7f1dd72df700 1 Processor -- start 2020-06-12T17:49:09.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.416+0000 7f1dd72df700 1 -- start start 2020-06-12T17:49:09.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.416+0000 7f1dd72df700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1dd009d620 0x7f1dd0151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:09.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.416+0000 7f1dd72df700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1dd0146680 0x7f1dd0144110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:09.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.416+0000 7f1dd72df700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd0151220 con 0x7f1dd00b2eb0 2020-06-12T17:49:09.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.416+0000 7f1dd72df700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd01514c0 con 0x7f1dd009d620 2020-06-12T17:49:09.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.416+0000 7f1dd72df700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd0151760 con 0x7f1dd0146680 2020-06-12T17:49:09.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.416+0000 7f1dd507b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1dd009d620 0x7f1dd0151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:09.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.416+0000 7f1dd507b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1dd009d620 0x7f1dd0151c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37394/0 (socket says 172.21.15.38:37394) 2020-06-12T17:49:09.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.417+0000 7f1dd507b700 1 -- 172.21.15.38:0/4019032423 learned_addr learned my addr 172.21.15.38:0/4019032423 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:09.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.417+0000 7f1dd587c700 1 --2- 172.21.15.38:0/4019032423 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1dd0146680 0x7f1dd0144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:09.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.417+0000 7f1dd507b700 1 -- 172.21.15.38:0/4019032423 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1dd0146680 msgr2=0x7f1dd0144110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:09.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.417+0000 7f1dd507b700 1 --2- 172.21.15.38:0/4019032423 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1dd0146680 0x7f1dd0144110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:09.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.417+0000 7f1dd507b700 1 -- 172.21.15.38:0/4019032423 >> v1:172.21.15.150:6789/0 conn(0x7f1dd00b2eb0 legacy=0x7f1dd00b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:09.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.417+0000 7f1dd507b700 1 -- 172.21.15.38:0/4019032423 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd00b3e50 con 0x7f1dd009d620 2020-06-12T17:49:09.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.417+0000 7f1dbe7fc700 1 -- 172.21.15.38:0/4019032423 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1113919493 0 0) 0x7f1dd0151220 con 0x7f1dd00b2eb0 2020-06-12T17:49:09.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.417+0000 7f1dd507b700 1 --2- 172.21.15.38:0/4019032423 >> v2:172.21.15.38:3300/0 conn(0x7f1dd009d620 0x7f1dd0151c00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1dc0007b00 tx=0x7f1dc000e140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:09.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.417+0000 7f1dd507b700 1 --2- 172.21.15.38:0/4019032423 >> v2:172.21.15.38:3300/0 conn(0x7f1dd009d620 0x7f1dd0151c00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1dc0007b00 tx=0x7f1dc000e140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:09.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.417+0000 7f1dd507b700 1 --2- 172.21.15.38:0/4019032423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1dd009d620 0x7f1dd0151c00 secure :-1 s=READY pgs=421 cs=0 l=1 rx=0x7f1dc0007b00 tx=0x7f1dc000e140).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:09.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.417+0000 7f1dd507b700 1 --2- 172.21.15.38:0/4019032423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1dd009d620 0x7f1dd0151c00 secure :-1 s=THROTTLE_DONE pgs=421 cs=0 l=1 rx=0x7f1dc0007b00 tx=0x7f1dc000e140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:09.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.417+0000 7f1dbe7fc700 1 -- 172.21.15.38:0/4019032423 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dc0005e90 con 0x7f1dd009d620 2020-06-12T17:49:09.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.417+0000 7f1dd507b700 1 --2- 172.21.15.38:0/4019032423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1dd009d620 0x7f1dd0151c00 secure :-1 s=THROTTLE_DONE pgs=421 cs=0 l=1 rx=0x7f1dc0007b00 tx=0x7f1dc000e140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:09.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.417+0000 7f1dd507b700 1 --2- 172.21.15.38:0/4019032423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1dd009d620 0x7f1dd0151c00 secure :-1 s=THROTTLE_DONE pgs=421 cs=0 l=1 rx=0x7f1dc0007b00 tx=0x7f1dc000e140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:09.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.417+0000 7f1dbe7fc700 1 -- 172.21.15.38:0/4019032423 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc0007160 con 0x7f1dd009d620 2020-06-12T17:49:09.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.417+0000 7f1dd72df700 1 -- 172.21.15.38:0/4019032423 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd0150e80 con 0x7f1dd009d620 2020-06-12T17:49:09.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.417+0000 7f1dbe7fc700 1 -- 172.21.15.38:0/4019032423 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dc0007540 con 0x7f1dd009d620 2020-06-12T17:49:09.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.417+0000 7f1dd72df700 1 -- 172.21.15.38:0/4019032423 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd00b2970 con 0x7f1dd009d620 2020-06-12T17:49:09.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.418+0000 7f1dd507b700 1 --2- 172.21.15.38:0/4019032423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1dd009d620 0x7f1dd0151c00 secure :-1 s=THROTTLE_DONE pgs=421 cs=0 l=1 rx=0x7f1dc0007b00 tx=0x7f1dc000e140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:09.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.418+0000 7f1dd72df700 1 -- 172.21.15.38:0/4019032423 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd0056c30 con 0x7f1dd009d620 2020-06-12T17:49:09.435 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.419+0000 7f1dbe7fc700 1 -- 172.21.15.38:0/4019032423 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f1dc000e2d0 con 0x7f1dd009d620 2020-06-12T17:49:09.435 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.419+0000 7f1dd507b700 1 --2- 172.21.15.38:0/4019032423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1dd009d620 0x7f1dd0151c00 secure :-1 s=THROTTLE_DONE pgs=421 cs=0 l=1 rx=0x7f1dc0007b00 tx=0x7f1dc000e140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:09.435 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.419+0000 7f1dbe7fc700 1 --2- 172.21.15.38:0/4019032423 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1db004d4a0 0x7f1db004f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:09.435 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.419+0000 7f1dbe7fc700 1 -- 172.21.15.38:0/4019032423 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1dc0061230 con 0x7f1dd009d620 2020-06-12T17:49:09.435 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.419+0000 7f1dd487a700 1 --2- 172.21.15.38:0/4019032423 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1db004d4a0 0x7f1db004f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:09.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.419+0000 7f1dd487a700 1 --2- 172.21.15.38:0/4019032423 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1db004d4a0 0x7f1db004f960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1dcc007920 tx=0x7f1dcc0021c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:09.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.419+0000 7f1dd487a700 1 --2- 172.21.15.38:0/4019032423 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1db004d4a0 0x7f1db004f960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1dcc007920 tx=0x7f1dcc0021c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:09.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.419+0000 7f1dd487a700 1 --2- 172.21.15.38:0/4019032423 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1db004d4a0 0x7f1db004f960 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7f1dcc007920 tx=0x7f1dcc0021c0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:09.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.422+0000 7f1dd507b700 1 --2- 172.21.15.38:0/4019032423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1dd009d620 0x7f1dd0151c00 secure :-1 s=THROTTLE_DONE pgs=421 cs=0 l=1 rx=0x7f1dc0007b00 tx=0x7f1dc000e140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:09.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.422+0000 7f1dbe7fc700 1 -- 172.21.15.38:0/4019032423 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f1dc003c990 con 0x7f1dd009d620 2020-06-12T17:49:09.628 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:09.624+0000 7f1dd72df700 1 -- 172.21.15.38:0/4019032423 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1dd01518d0 con 0x7f1dd009d620 2020-06-12T17:49:10.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.236+0000 7f1dd507b700 1 --2- 172.21.15.38:0/4019032423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1dd009d620 0x7f1dd0151c00 secure :-1 s=THROTTLE_DONE pgs=421 cs=0 l=1 rx=0x7f1dc0007b00 tx=0x7f1dc000e140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.236+0000 7f1dbe7fc700 1 -- 172.21.15.38:0/4019032423 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v13) v1 ==== 136+0+0 (secure 0 0 0) 0x7f1dc000a100 con 0x7f1dd009d620 2020-06-12T17:49:10.242 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.238+0000 7f1dd72df700 1 -- 172.21.15.38:0/4019032423 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1db004d4a0 msgr2=0x7f1db004f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:10.242 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.238+0000 7f1dd72df700 1 --2- 172.21.15.38:0/4019032423 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1db004d4a0 0x7f1db004f960 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7f1dcc007920 tx=0x7f1dcc0021c0).stop 2020-06-12T17:49:10.242 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.238+0000 7f1dd72df700 1 -- 172.21.15.38:0/4019032423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1dd009d620 msgr2=0x7f1dd0151c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:10.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.238+0000 7f1dd72df700 1 --2- 172.21.15.38:0/4019032423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1dd009d620 0x7f1dd0151c00 secure :-1 s=READY pgs=421 cs=0 l=1 rx=0x7f1dc0007b00 tx=0x7f1dc000e140).stop 2020-06-12T17:49:10.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.238+0000 7f1dd72df700 1 -- 172.21.15.38:0/4019032423 shutdown_connections 2020-06-12T17:49:10.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.238+0000 7f1dd72df700 1 --2- 172.21.15.38:0/4019032423 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1db004d4a0 0x7f1db004f960 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:10.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.238+0000 7f1dd72df700 1 --2- 172.21.15.38:0/4019032423 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1dd0146680 0x7f1dd0144110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:10.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.238+0000 7f1dd72df700 1 --2- 172.21.15.38:0/4019032423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1dd009d620 0x7f1dd0151c00 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:10.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.238+0000 7f1dd72df700 1 -- 172.21.15.38:0/4019032423 >> 172.21.15.38:0/4019032423 conn(0x7f1dd00b5a20 msgr2=0x7f1dd009b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:10.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.238+0000 7f1dd72df700 1 -- 172.21.15.38:0/4019032423 shutdown_connections 2020-06-12T17:49:10.245 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.238+0000 7f1dd72df700 1 -- 172.21.15.38:0/4019032423 wait complete. 2020-06-12T17:49:10.255 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs volume ls 2020-06-12T17:49:10.378 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.375+0000 7f0dfab9a700 1 Processor -- start 2020-06-12T17:49:10.379 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.375+0000 7f0dfab9a700 1 -- start start 2020-06-12T17:49:10.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.376+0000 7f0dfab9a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0df409df50 0x7f0df409b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:10.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.376+0000 7f0dfab9a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0df4066a80 0x7f0df40aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:10.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.376+0000 7f0dfab9a700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df40ad7b0 con 0x7f0df409db70 2020-06-12T17:49:10.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.376+0000 7f0dfab9a700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df4144ee0 con 0x7f0df4066a80 2020-06-12T17:49:10.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.376+0000 7f0dfab9a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df41449a0 con 0x7f0df409df50 2020-06-12T17:49:10.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.376+0000 7f0df9137700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0df4066a80 0x7f0df40aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:10.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.376+0000 7f0df8936700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f0df409db70 0x7f0df4141040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39218/0 (socket says 172.21.15.38:39218) 2020-06-12T17:49:10.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.376+0000 7f0df8936700 1 -- 172.21.15.38:0/2900655516 learned_addr learned my addr 172.21.15.38:0/2900655516 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:10.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.376+0000 7f0df3fff700 1 --2- 172.21.15.38:0/2900655516 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0df409df50 0x7f0df409b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:10.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.376+0000 7f0df9137700 1 -- 172.21.15.38:0/2900655516 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0df409df50 msgr2=0x7f0df409b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:10.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.376+0000 7f0df9137700 1 --2- 172.21.15.38:0/2900655516 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0df409df50 0x7f0df409b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:10.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.376+0000 7f0df9137700 1 -- 172.21.15.38:0/2900655516 >> v1:172.21.15.38:6789/0 conn(0x7f0df409db70 legacy=0x7f0df4141040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:10.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.376+0000 7f0df9137700 1 -- 172.21.15.38:0/2900655516 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df4144c40 con 0x7f0df4066a80 2020-06-12T17:49:10.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.376+0000 7f0df37fe700 1 -- 172.21.15.38:0/2900655516 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231262759 0 0) 0x7f0df40ad7b0 con 0x7f0df409db70 2020-06-12T17:49:10.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.376+0000 7f0df3fff700 1 --2- 172.21.15.38:0/2900655516 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0df409df50 0x7f0df409b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:49:10.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.376+0000 7f0df9137700 1 --2- 172.21.15.38:0/2900655516 >> v2:172.21.15.38:3300/0 conn(0x7f0df4066a80 0x7f0df40aebc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0de4002f30 tx=0x7f0de4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.376+0000 7f0df9137700 1 --2- 172.21.15.38:0/2900655516 >> v2:172.21.15.38:3300/0 conn(0x7f0df4066a80 0x7f0df40aebc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0de4002f30 tx=0x7f0de4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.376+0000 7f0df9137700 1 --2- 172.21.15.38:0/2900655516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0df4066a80 0x7f0df40aebc0 secure :-1 s=READY pgs=423 cs=0 l=1 rx=0x7f0de4002f30 tx=0x7f0de4007e60).ready entity=mon.0 client_cookie=d7bb3bfb2bd476fa server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:10.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.376+0000 7f0df9137700 1 --2- 172.21.15.38:0/2900655516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0df4066a80 0x7f0df40aebc0 secure :-1 s=THROTTLE_DONE pgs=423 cs=0 l=1 rx=0x7f0de4002f30 tx=0x7f0de4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.376+0000 7f0df9137700 1 --2- 172.21.15.38:0/2900655516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0df4066a80 0x7f0df40aebc0 secure :-1 s=THROTTLE_DONE pgs=423 cs=0 l=1 rx=0x7f0de4002f30 tx=0x7f0de4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.376+0000 7f0df37fe700 1 -- 172.21.15.38:0/2900655516 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0de4011430 con 0x7f0df4066a80 2020-06-12T17:49:10.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.376+0000 7f0df9137700 1 --2- 172.21.15.38:0/2900655516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0df4066a80 0x7f0df40aebc0 secure :-1 s=THROTTLE_DONE pgs=423 cs=0 l=1 rx=0x7f0de4002f30 tx=0x7f0de4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.376+0000 7f0df37fe700 1 -- 172.21.15.38:0/2900655516 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de4011590 con 0x7f0df4066a80 2020-06-12T17:49:10.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.376+0000 7f0df37fe700 1 -- 172.21.15.38:0/2900655516 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0de4011970 con 0x7f0df4066a80 2020-06-12T17:49:10.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.376+0000 7f0dfab9a700 1 -- 172.21.15.38:0/2900655516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0df4066a80 msgr2=0x7f0df40aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:10.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.376+0000 7f0dfab9a700 1 --2- 172.21.15.38:0/2900655516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0df4066a80 0x7f0df40aebc0 secure :-1 s=READY pgs=423 cs=0 l=1 rx=0x7f0de4002f30 tx=0x7f0de4007e60).stop 2020-06-12T17:49:10.387 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.377+0000 7f0dfab9a700 1 -- 172.21.15.38:0/2900655516 shutdown_connections 2020-06-12T17:49:10.387 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.377+0000 7f0dfab9a700 1 --2- 172.21.15.38:0/2900655516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0df4066a80 0x7f0df40aebc0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:10.387 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.377+0000 7f0dfab9a700 1 --2- 172.21.15.38:0/2900655516 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0df409df50 0x7f0df409b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:10.387 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.377+0000 7f0dfab9a700 1 -- 172.21.15.38:0/2900655516 >> 172.21.15.38:0/2900655516 conn(0x7f0df40b8410 msgr2=0x7f0df40b8820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:10.387 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.377+0000 7f0dfab9a700 1 -- 172.21.15.38:0/2900655516 shutdown_connections 2020-06-12T17:49:10.387 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.377+0000 7f0dfab9a700 1 -- 172.21.15.38:0/2900655516 wait complete. 2020-06-12T17:49:10.388 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.378+0000 7f0dfab9a700 1 Processor -- start 2020-06-12T17:49:10.388 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.378+0000 7f0dfab9a700 1 -- start start 2020-06-12T17:49:10.392 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0dfab9a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0df4066a80 0x7f0df409a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:10.392 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0dfab9a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0df409df50 0x7f0df4091c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:10.392 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0dfab9a700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df409d100 con 0x7f0df409db70 2020-06-12T17:49:10.392 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0dfab9a700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df40920e0 con 0x7f0df409df50 2020-06-12T17:49:10.393 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0dfab9a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df409d3a0 con 0x7f0df4066a80 2020-06-12T17:49:10.393 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0df9137700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0df409df50 0x7f0df4091c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:10.393 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0df9137700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0df409df50 0x7f0df4091c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37412/0 (socket says 172.21.15.38:37412) 2020-06-12T17:49:10.393 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0df3fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f0df409db70 0x7f0df4142050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39226/0 (socket says 172.21.15.38:39226) 2020-06-12T17:49:10.393 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0df9137700 1 -- 172.21.15.38:0/1024702735 learned_addr learned my addr 172.21.15.38:0/1024702735 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:10.394 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0df8936700 1 --2- 172.21.15.38:0/1024702735 >> v2:172.21.15.150:3300/0 conn(0x7f0df4066a80 0x7f0df409a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:10.394 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0df9137700 1 -- 172.21.15.38:0/1024702735 >> v2:172.21.15.150:3300/0 conn(0x7f0df4066a80 msgr2=0x7f0df409a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:10.394 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0df9137700 1 --2- 172.21.15.38:0/1024702735 >> v2:172.21.15.150:3300/0 conn(0x7f0df4066a80 0x7f0df409a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:10.395 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0df9137700 1 -- 172.21.15.38:0/1024702735 >> v1:172.21.15.38:6789/0 conn(0x7f0df409db70 legacy=0x7f0df4142050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:10.395 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0df1ffb700 1 -- 172.21.15.38:0/1024702735 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2289787805 0 0) 0x7f0df409d100 con 0x7f0df409db70 2020-06-12T17:49:10.395 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0df9137700 1 -- 172.21.15.38:0/1024702735 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df409d640 con 0x7f0df409df50 2020-06-12T17:49:10.395 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0df8936700 1 --2- 172.21.15.38:0/1024702735 >> v2:172.21.15.150:3300/0 conn(0x7f0df4066a80 0x7f0df409a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:49:10.396 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0df9137700 1 --2- 172.21.15.38:0/1024702735 >> v2:172.21.15.38:3300/0 conn(0x7f0df409df50 0x7f0df4091c80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0df408fb70 tx=0x7f0de4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.396 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0df9137700 1 --2- 172.21.15.38:0/1024702735 >> v2:172.21.15.38:3300/0 conn(0x7f0df409df50 0x7f0df4091c80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0df408fb70 tx=0x7f0de4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.396 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0df9137700 1 --2- 172.21.15.38:0/1024702735 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0df409df50 0x7f0df4091c80 secure :-1 s=READY pgs=425 cs=0 l=1 rx=0x7f0df408fb70 tx=0x7f0de4007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:10.396 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0df9137700 1 --2- 172.21.15.38:0/1024702735 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0df409df50 0x7f0df4091c80 secure :-1 s=THROTTLE_DONE pgs=425 cs=0 l=1 rx=0x7f0df408fb70 tx=0x7f0de4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.396 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0df1ffb700 1 -- 172.21.15.38:0/1024702735 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0de4007150 con 0x7f0df409df50 2020-06-12T17:49:10.397 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0df9137700 1 --2- 172.21.15.38:0/1024702735 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0df409df50 0x7f0df4091c80 secure :-1 s=THROTTLE_DONE pgs=425 cs=0 l=1 rx=0x7f0df408fb70 tx=0x7f0de4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.397 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0df9137700 1 --2- 172.21.15.38:0/1024702735 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0df409df50 0x7f0df4091c80 secure :-1 s=THROTTLE_DONE pgs=425 cs=0 l=1 rx=0x7f0df408fb70 tx=0x7f0de4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.397 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0df1ffb700 1 -- 172.21.15.38:0/1024702735 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de40072b0 con 0x7f0df409df50 2020-06-12T17:49:10.397 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0df1ffb700 1 -- 172.21.15.38:0/1024702735 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0de40056c0 con 0x7f0df409df50 2020-06-12T17:49:10.397 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0dfab9a700 1 -- 172.21.15.38:0/1024702735 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df40907c0 con 0x7f0df409df50 2020-06-12T17:49:10.398 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.379+0000 7f0dfab9a700 1 -- 172.21.15.38:0/1024702735 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df409ce30 con 0x7f0df409df50 2020-06-12T17:49:10.398 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.380+0000 7f0df9137700 1 --2- 172.21.15.38:0/1024702735 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0df409df50 0x7f0df4091c80 secure :-1 s=THROTTLE_DONE pgs=425 cs=0 l=1 rx=0x7f0df408fb70 tx=0x7f0de4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.398 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.380+0000 7f0dfab9a700 1 -- 172.21.15.38:0/1024702735 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df4056c30 con 0x7f0df409df50 2020-06-12T17:49:10.398 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.381+0000 7f0df1ffb700 1 -- 172.21.15.38:0/1024702735 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f0de40058b0 con 0x7f0df409df50 2020-06-12T17:49:10.398 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.381+0000 7f0df9137700 1 --2- 172.21.15.38:0/1024702735 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0df409df50 0x7f0df4091c80 secure :-1 s=THROTTLE_DONE pgs=425 cs=0 l=1 rx=0x7f0df408fb70 tx=0x7f0de4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.381+0000 7f0df1ffb700 1 --2- 172.21.15.38:0/1024702735 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0dd404d5c0 0x7f0dd404fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:10.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.381+0000 7f0df1ffb700 1 -- 172.21.15.38:0/1024702735 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0de40616a0 con 0x7f0df409df50 2020-06-12T17:49:10.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.381+0000 7f0df8936700 1 --2- 172.21.15.38:0/1024702735 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0dd404d5c0 0x7f0dd404fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:10.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.381+0000 7f0df8936700 1 --2- 172.21.15.38:0/1024702735 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0dd404d5c0 0x7f0dd404fa80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0dec000f00 tx=0x7f0dec001750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.381+0000 7f0df8936700 1 --2- 172.21.15.38:0/1024702735 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0dd404d5c0 0x7f0dd404fa80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0dec000f00 tx=0x7f0dec001750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.400 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.381+0000 7f0df8936700 1 --2- 172.21.15.38:0/1024702735 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0dd404d5c0 0x7f0dd404fa80 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7f0dec000f00 tx=0x7f0dec001750).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:10.400 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.384+0000 7f0df9137700 1 --2- 172.21.15.38:0/1024702735 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0df409df50 0x7f0df4091c80 secure :-1 s=THROTTLE_DONE pgs=425 cs=0 l=1 rx=0x7f0df408fb70 tx=0x7f0de4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.400 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.384+0000 7f0df1ffb700 1 -- 172.21.15.38:0/1024702735 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f0de403cec0 con 0x7f0df409df50 2020-06-12T17:49:10.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.574+0000 7f0dfab9a700 1 -- 172.21.15.38:0/1024702735 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f0df409d7d0 con 0x7f0dd404d5c0 2020-06-12T17:49:10.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.576+0000 7f0df8936700 1 --2- 172.21.15.38:0/1024702735 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0dd404d5c0 0x7f0dd404fa80 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f0dec000f00 tx=0x7f0dec001750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.576+0000 7f0df1ffb700 1 -- 172.21.15.38:0/1024702735 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f0dec009bd0 con 0x7f0dd404d5c0 2020-06-12T17:49:10.580 INFO:teuthology.orchestra.run.smithi038.stdout:[ 2020-06-12T17:49:10.580 INFO:teuthology.orchestra.run.smithi038.stdout: { 2020-06-12T17:49:10.580 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cephfs" 2020-06-12T17:49:10.580 INFO:teuthology.orchestra.run.smithi038.stdout: } 2020-06-12T17:49:10.580 INFO:teuthology.orchestra.run.smithi038.stdout:] 2020-06-12T17:49:10.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.577+0000 7f0dfab9a700 1 -- 172.21.15.38:0/1024702735 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0dd404d5c0 msgr2=0x7f0dd404fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:10.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.577+0000 7f0dfab9a700 1 --2- 172.21.15.38:0/1024702735 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0dd404d5c0 0x7f0dd404fa80 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7f0dec000f00 tx=0x7f0dec001750).stop 2020-06-12T17:49:10.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.577+0000 7f0dfab9a700 1 -- 172.21.15.38:0/1024702735 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0df409df50 msgr2=0x7f0df4091c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:10.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.577+0000 7f0dfab9a700 1 --2- 172.21.15.38:0/1024702735 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0df409df50 0x7f0df4091c80 secure :-1 s=READY pgs=425 cs=0 l=1 rx=0x7f0df408fb70 tx=0x7f0de4007e60).stop 2020-06-12T17:49:10.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.577+0000 7f0dfab9a700 1 -- 172.21.15.38:0/1024702735 shutdown_connections 2020-06-12T17:49:10.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.577+0000 7f0dfab9a700 1 --2- 172.21.15.38:0/1024702735 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0dd404d5c0 0x7f0dd404fa80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:10.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.577+0000 7f0dfab9a700 1 --2- 172.21.15.38:0/1024702735 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0df409df50 0x7f0df4091c80 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:10.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.577+0000 7f0dfab9a700 1 --2- 172.21.15.38:0/1024702735 >> v2:172.21.15.150:3300/0 conn(0x7f0df4066a80 0x7f0df409a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:10.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.577+0000 7f0dfab9a700 1 -- 172.21.15.38:0/1024702735 >> 172.21.15.38:0/1024702735 conn(0x7f0df40b8410 msgr2=0x7f0df4143450 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:10.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.577+0000 7f0dfab9a700 1 -- 172.21.15.38:0/1024702735 shutdown_connections 2020-06-12T17:49:10.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.577+0000 7f0dfab9a700 1 -- 172.21.15.38:0/1024702735 wait complete. 2020-06-12T17:49:10.591 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_9470 2020-06-12T17:49:10.709 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.706+0000 7fb7a542a700 1 Processor -- start 2020-06-12T17:49:10.710 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.706+0000 7fb7a542a700 1 -- start start 2020-06-12T17:49:10.712 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.707+0000 7fb7a542a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7a0146680 0x7fb7a00ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:10.712 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.707+0000 7fb7a542a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb7a009d8d0 0x7fb7a01421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:10.713 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.707+0000 7fb7a542a700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a0146d20 con 0x7fb7a00b2eb0 2020-06-12T17:49:10.713 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.707+0000 7fb7a542a700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a0066a80 con 0x7fb7a009d8d0 2020-06-12T17:49:10.713 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.707+0000 7fb7a542a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a0146f50 con 0x7fb7a0146680 2020-06-12T17:49:10.713 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.707+0000 7fb79f7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb7a009d8d0 0x7fb7a01421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:10.713 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.707+0000 7fb79e7fc700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb7a00b2eb0 0x7fb7a009d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39232/0 (socket says 172.21.15.38:39232) 2020-06-12T17:49:10.714 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.707+0000 7fb79f7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb7a009d8d0 0x7fb7a01421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37416/0 (socket says 172.21.15.38:37416) 2020-06-12T17:49:10.714 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.707+0000 7fb79e7fc700 1 -- 172.21.15.38:0/4232396518 learned_addr learned my addr 172.21.15.38:0/4232396518 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:10.714 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.707+0000 7fb79effd700 1 --2- 172.21.15.38:0/4232396518 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7a0146680 0x7fb7a00ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:10.714 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.707+0000 7fb79f7fe700 1 -- 172.21.15.38:0/4232396518 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7a0146680 msgr2=0x7fb7a00ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:10.715 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.707+0000 7fb79f7fe700 1 --2- 172.21.15.38:0/4232396518 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7a0146680 0x7fb7a00ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:10.715 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.707+0000 7fb79f7fe700 1 -- 172.21.15.38:0/4232396518 >> v1:172.21.15.38:6789/0 conn(0x7fb7a00b2eb0 legacy=0x7fb7a009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:10.715 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.707+0000 7fb79f7fe700 1 -- 172.21.15.38:0/4232396518 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a0146a60 con 0x7fb7a009d8d0 2020-06-12T17:49:10.715 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.707+0000 7fb79dffb700 1 -- 172.21.15.38:0/4232396518 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160303619 0 0) 0x7fb7a0146d20 con 0x7fb7a00b2eb0 2020-06-12T17:49:10.715 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.707+0000 7fb79f7fe700 1 --2- 172.21.15.38:0/4232396518 >> v2:172.21.15.38:3300/0 conn(0x7fb7a009d8d0 0x7fb7a01421d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb7980032b0 tx=0x7fb7980081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.716 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.707+0000 7fb79f7fe700 1 --2- 172.21.15.38:0/4232396518 >> v2:172.21.15.38:3300/0 conn(0x7fb7a009d8d0 0x7fb7a01421d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb7980032b0 tx=0x7fb7980081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.716 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.707+0000 7fb79f7fe700 1 --2- 172.21.15.38:0/4232396518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb7a009d8d0 0x7fb7a01421d0 secure :-1 s=READY pgs=427 cs=0 l=1 rx=0x7fb7980032b0 tx=0x7fb7980081e0).ready entity=mon.0 client_cookie=f8db2b6516930b98 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:10.716 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.707+0000 7fb79f7fe700 1 --2- 172.21.15.38:0/4232396518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb7a009d8d0 0x7fb7a01421d0 secure :-1 s=THROTTLE_DONE pgs=427 cs=0 l=1 rx=0x7fb7980032b0 tx=0x7fb7980081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.716 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.707+0000 7fb79dffb700 1 -- 172.21.15.38:0/4232396518 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb798011de0 con 0x7fb7a009d8d0 2020-06-12T17:49:10.716 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.707+0000 7fb79f7fe700 1 --2- 172.21.15.38:0/4232396518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb7a009d8d0 0x7fb7a01421d0 secure :-1 s=THROTTLE_DONE pgs=427 cs=0 l=1 rx=0x7fb7980032b0 tx=0x7fb7980081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.717 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.707+0000 7fb79f7fe700 1 --2- 172.21.15.38:0/4232396518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb7a009d8d0 0x7fb7a01421d0 secure :-1 s=THROTTLE_DONE pgs=427 cs=0 l=1 rx=0x7fb7980032b0 tx=0x7fb7980081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.717 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.707+0000 7fb79dffb700 1 -- 172.21.15.38:0/4232396518 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79800a160 con 0x7fb7a009d8d0 2020-06-12T17:49:10.717 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.707+0000 7fb79dffb700 1 -- 172.21.15.38:0/4232396518 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb79800a540 con 0x7fb7a009d8d0 2020-06-12T17:49:10.717 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.707+0000 7fb7a542a700 1 -- 172.21.15.38:0/4232396518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb7a009d8d0 msgr2=0x7fb7a01421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:10.717 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.707+0000 7fb7a542a700 1 --2- 172.21.15.38:0/4232396518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb7a009d8d0 0x7fb7a01421d0 secure :-1 s=READY pgs=427 cs=0 l=1 rx=0x7fb7980032b0 tx=0x7fb7980081e0).stop 2020-06-12T17:49:10.718 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.708+0000 7fb7a542a700 1 -- 172.21.15.38:0/4232396518 shutdown_connections 2020-06-12T17:49:10.718 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.708+0000 7fb7a542a700 1 --2- 172.21.15.38:0/4232396518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb7a009d8d0 0x7fb7a01421d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:10.718 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.708+0000 7fb7a542a700 1 --2- 172.21.15.38:0/4232396518 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7a0146680 0x7fb7a00ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:10.718 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.708+0000 7fb7a542a700 1 -- 172.21.15.38:0/4232396518 >> 172.21.15.38:0/4232396518 conn(0x7fb7a00b5a20 msgr2=0x7fb7a005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:10.718 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.708+0000 7fb7a542a700 1 -- 172.21.15.38:0/4232396518 shutdown_connections 2020-06-12T17:49:10.719 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.708+0000 7fb7a542a700 1 -- 172.21.15.38:0/4232396518 wait complete. 2020-06-12T17:49:10.719 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.709+0000 7fb7a542a700 1 Processor -- start 2020-06-12T17:49:10.719 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.709+0000 7fb7a542a700 1 -- start start 2020-06-12T17:49:10.723 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.710+0000 7fb7a542a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb7a00b2eb0 0x7fb7a00af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:10.723 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.710+0000 7fb7a542a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb7a0146680 0x7fb7a01536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:10.723 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.710+0000 7fb7a542a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a0153c30 con 0x7fb7a009d8d0 2020-06-12T17:49:10.723 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.710+0000 7fb7a542a700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a0153ed0 con 0x7fb7a00b2eb0 2020-06-12T17:49:10.723 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.710+0000 7fb7a542a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a0154170 con 0x7fb7a0146680 2020-06-12T17:49:10.724 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.710+0000 7fb79e7fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb7a00b2eb0 0x7fb7a00af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:10.724 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.710+0000 7fb79e7fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb7a00b2eb0 0x7fb7a00af2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37422/0 (socket says 172.21.15.38:37422) 2020-06-12T17:49:10.724 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.710+0000 7fb79e7fc700 1 -- 172.21.15.38:0/1279222024 learned_addr learned my addr 172.21.15.38:0/1279222024 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:10.724 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.710+0000 7fb79f7fe700 1 --2- 172.21.15.38:0/1279222024 >> v2:172.21.15.150:3300/0 conn(0x7fb7a0146680 0x7fb7a01536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:10.724 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.710+0000 7fb79e7fc700 1 -- 172.21.15.38:0/1279222024 >> v2:172.21.15.150:3300/0 conn(0x7fb7a0146680 msgr2=0x7fb7a01536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:10.725 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.710+0000 7fb79e7fc700 1 --2- 172.21.15.38:0/1279222024 >> v2:172.21.15.150:3300/0 conn(0x7fb7a0146680 0x7fb7a01536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:10.725 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.710+0000 7fb79e7fc700 1 -- 172.21.15.38:0/1279222024 >> v1:172.21.15.150:6789/0 conn(0x7fb7a009d8d0 legacy=0x7fb7a01427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:10.725 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.710+0000 7fb79e7fc700 1 -- 172.21.15.38:0/1279222024 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a0142f00 con 0x7fb7a00b2eb0 2020-06-12T17:49:10.725 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.710+0000 7fb79f7fe700 1 --2- 172.21.15.38:0/1279222024 >> v2:172.21.15.150:3300/0 conn(0x7fb7a0146680 0x7fb7a01536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:49:10.725 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.710+0000 7fb79e7fc700 1 --2- 172.21.15.38:0/1279222024 >> v2:172.21.15.38:3300/0 conn(0x7fb7a00b2eb0 0x7fb7a00af2b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb7a0061650 tx=0x7fb7900017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.726 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.710+0000 7fb79e7fc700 1 --2- 172.21.15.38:0/1279222024 >> v2:172.21.15.38:3300/0 conn(0x7fb7a00b2eb0 0x7fb7a00af2b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb7a0061650 tx=0x7fb7900017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.726 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.710+0000 7fb79e7fc700 1 --2- 172.21.15.38:0/1279222024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb7a00b2eb0 0x7fb7a00af2b0 secure :-1 s=READY pgs=428 cs=0 l=1 rx=0x7fb7a0061650 tx=0x7fb7900017a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:10.726 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.710+0000 7fb79e7fc700 1 --2- 172.21.15.38:0/1279222024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb7a00b2eb0 0x7fb7a00af2b0 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7fb7a0061650 tx=0x7fb7900017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.726 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.710+0000 7fb78ffff700 1 -- 172.21.15.38:0/1279222024 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb79000c650 con 0x7fb7a00b2eb0 2020-06-12T17:49:10.726 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.710+0000 7fb79e7fc700 1 --2- 172.21.15.38:0/1279222024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb7a00b2eb0 0x7fb7a00af2b0 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7fb7a0061650 tx=0x7fb7900017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.727 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.710+0000 7fb79e7fc700 1 --2- 172.21.15.38:0/1279222024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb7a00b2eb0 0x7fb7a00af2b0 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7fb7a0061650 tx=0x7fb7900017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.727 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.710+0000 7fb78ffff700 1 -- 172.21.15.38:0/1279222024 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79000c7b0 con 0x7fb7a00b2eb0 2020-06-12T17:49:10.727 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.710+0000 7fb7a542a700 1 -- 172.21.15.38:0/1279222024 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a00b19a0 con 0x7fb7a00b2eb0 2020-06-12T17:49:10.727 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.710+0000 7fb78ffff700 1 -- 172.21.15.38:0/1279222024 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb79000cb90 con 0x7fb7a00b2eb0 2020-06-12T17:49:10.727 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.710+0000 7fb7a542a700 1 -- 172.21.15.38:0/1279222024 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a013e360 con 0x7fb7a00b2eb0 2020-06-12T17:49:10.728 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.711+0000 7fb79e7fc700 1 --2- 172.21.15.38:0/1279222024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb7a00b2eb0 0x7fb7a00af2b0 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7fb7a0061650 tx=0x7fb7900017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.728 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.712+0000 7fb7a542a700 1 -- 172.21.15.38:0/1279222024 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a013e670 con 0x7fb7a00b2eb0 2020-06-12T17:49:10.728 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.712+0000 7fb78ffff700 1 -- 172.21.15.38:0/1279222024 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fb7900055c0 con 0x7fb7a00b2eb0 2020-06-12T17:49:10.728 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.712+0000 7fb79e7fc700 1 --2- 172.21.15.38:0/1279222024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb7a00b2eb0 0x7fb7a00af2b0 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7fb7a0061650 tx=0x7fb7900017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.728 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.712+0000 7fb78ffff700 1 --2- 172.21.15.38:0/1279222024 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb77c04d560 0x7fb77c04fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:10.729 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.712+0000 7fb78ffff700 1 -- 172.21.15.38:0/1279222024 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb790060a20 con 0x7fb7a00b2eb0 2020-06-12T17:49:10.729 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.712+0000 7fb79effd700 1 --2- 172.21.15.38:0/1279222024 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb77c04d560 0x7fb77c04fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:10.729 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.712+0000 7fb79effd700 1 --2- 172.21.15.38:0/1279222024 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb77c04d560 0x7fb77c04fa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb7a0143ae0 tx=0x7fb794007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.729 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.713+0000 7fb79effd700 1 --2- 172.21.15.38:0/1279222024 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb77c04d560 0x7fb77c04fa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb7a0143ae0 tx=0x7fb794007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.729 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.713+0000 7fb79effd700 1 --2- 172.21.15.38:0/1279222024 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb77c04d560 0x7fb77c04fa20 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7fb7a0143ae0 tx=0x7fb794007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:10.730 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.715+0000 7fb79e7fc700 1 --2- 172.21.15.38:0/1279222024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb7a00b2eb0 0x7fb7a00af2b0 secure :-1 s=THROTTLE_DONE pgs=428 cs=0 l=1 rx=0x7fb7a0061650 tx=0x7fb7900017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.730 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.715+0000 7fb78ffff700 1 -- 172.21.15.38:0/1279222024 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fb79003c1e0 con 0x7fb7a00b2eb0 2020-06-12T17:49:10.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.914+0000 7fb7a542a700 1 -- 172.21.15.38:0/1279222024 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_9470", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7a0056c30 con 0x7fb77c04d560 2020-06-12T17:49:10.922 INFO:tasks.ceph.mgr.x.smithi150.stderr:2020-06-12T17:49:10.919+0000 7fa81a848700 -1 client.0 error registering admin socket command: (17) File exists 2020-06-12T17:49:10.922 INFO:tasks.ceph.mgr.x.smithi150.stderr:2020-06-12T17:49:10.919+0000 7fa81a848700 -1 client.0 error registering admin socket command: (17) File exists 2020-06-12T17:49:10.922 INFO:tasks.ceph.mgr.x.smithi150.stderr:2020-06-12T17:49:10.919+0000 7fa81a848700 -1 client.0 error registering admin socket command: (17) File exists 2020-06-12T17:49:10.923 INFO:tasks.ceph.mgr.x.smithi150.stderr:2020-06-12T17:49:10.919+0000 7fa81a848700 -1 client.0 error registering admin socket command: (17) File exists 2020-06-12T17:49:10.923 INFO:tasks.ceph.mgr.x.smithi150.stderr:2020-06-12T17:49:10.919+0000 7fa81a848700 -1 client.0 error registering admin socket command: (17) File exists 2020-06-12T17:49:10.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.954+0000 7fb79effd700 1 --2- 172.21.15.38:0/1279222024 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb77c04d560 0x7fb77c04fa20 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7fb7a0143ae0 tx=0x7fb794007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:10.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.954+0000 7fb78ffff700 1 -- 172.21.15.38:0/1279222024 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb7a0056c30 con 0x7fb77c04d560 2020-06-12T17:49:10.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.956+0000 7fb7a542a700 1 -- 172.21.15.38:0/1279222024 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb77c04d560 msgr2=0x7fb77c04fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:10.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.956+0000 7fb7a542a700 1 --2- 172.21.15.38:0/1279222024 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb77c04d560 0x7fb77c04fa20 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7fb7a0143ae0 tx=0x7fb794007e60).stop 2020-06-12T17:49:10.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.956+0000 7fb7a542a700 1 -- 172.21.15.38:0/1279222024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb7a00b2eb0 msgr2=0x7fb7a00af2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:10.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.956+0000 7fb7a542a700 1 --2- 172.21.15.38:0/1279222024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb7a00b2eb0 0x7fb7a00af2b0 secure :-1 s=READY pgs=428 cs=0 l=1 rx=0x7fb7a0061650 tx=0x7fb7900017a0).stop 2020-06-12T17:49:10.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.956+0000 7fb7a542a700 1 -- 172.21.15.38:0/1279222024 shutdown_connections 2020-06-12T17:49:10.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.956+0000 7fb7a542a700 1 --2- 172.21.15.38:0/1279222024 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb77c04d560 0x7fb77c04fa20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:10.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.956+0000 7fb7a542a700 1 --2- 172.21.15.38:0/1279222024 >> v2:172.21.15.150:3300/0 conn(0x7fb7a0146680 0x7fb7a01536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:10.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.956+0000 7fb7a542a700 1 --2- 172.21.15.38:0/1279222024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb7a00b2eb0 0x7fb7a00af2b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:10.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.956+0000 7fb7a542a700 1 -- 172.21.15.38:0/1279222024 >> 172.21.15.38:0/1279222024 conn(0x7fb7a00b5a20 msgr2=0x7fb7a0144ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:10.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.956+0000 7fb7a542a700 1 -- 172.21.15.38:0/1279222024 shutdown_connections 2020-06-12T17:49:10.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:10.956+0000 7fb7a542a700 1 -- 172.21.15.38:0/1279222024 wait complete. 2020-06-12T17:49:10.969 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_9470 2020-06-12T17:49:11.086 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.083+0000 7fe882650700 1 Processor -- start 2020-06-12T17:49:11.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.083+0000 7fe882650700 1 -- start start 2020-06-12T17:49:11.089 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.083+0000 7fe882650700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe87c146680 0x7fe87c0ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:11.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.084+0000 7fe882650700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe87c0b2eb0 0x7fe87c09d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:11.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.084+0000 7fe882650700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe87c09d620 0x7fe87c09da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:11.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.084+0000 7fe882650700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe87c146d20 con 0x7fe87c146680 2020-06-12T17:49:11.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.084+0000 7fe882650700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe87c066a80 con 0x7fe87c09d620 2020-06-12T17:49:11.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.084+0000 7fe882650700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87c146f50 con 0x7fe87c0b2eb0 2020-06-12T17:49:11.091 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.084+0000 7fe87bfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe87c146680 0x7fe87c0ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:11.091 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.084+0000 7fe87bfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe87c146680 0x7fe87c0ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37428/0 (socket says 172.21.15.38:37428) 2020-06-12T17:49:11.091 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.084+0000 7fe87bfff700 1 -- 172.21.15.38:0/1012979601 learned_addr learned my addr 172.21.15.38:0/1012979601 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:11.094 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.084+0000 7fe880bed700 1 --2- 172.21.15.38:0/1012979601 >> v2:172.21.15.150:3300/0 conn(0x7fe87c09d620 0x7fe87c09da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:11.094 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.084+0000 7fe87b7fe700 1 --2- 172.21.15.38:0/1012979601 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe87c0b2eb0 0x7fe87c09d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:11.095 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.084+0000 7fe87bfff700 1 -- 172.21.15.38:0/1012979601 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe87c0b2eb0 msgr2=0x7fe87c09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:11.095 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.084+0000 7fe87bfff700 1 --2- 172.21.15.38:0/1012979601 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe87c0b2eb0 0x7fe87c09d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:11.096 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.084+0000 7fe87bfff700 1 -- 172.21.15.38:0/1012979601 >> v2:172.21.15.150:3300/0 conn(0x7fe87c09d620 msgr2=0x7fe87c09da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:11.096 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.084+0000 7fe87bfff700 1 --2- 172.21.15.38:0/1012979601 >> v2:172.21.15.150:3300/0 conn(0x7fe87c09d620 0x7fe87c09da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:11.096 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.084+0000 7fe87bfff700 1 -- 172.21.15.38:0/1012979601 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87c146a60 con 0x7fe87c146680 2020-06-12T17:49:11.096 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.084+0000 7fe87bfff700 1 --2- 172.21.15.38:0/1012979601 >> v2:172.21.15.38:3300/0 conn(0x7fe87c146680 0x7fe87c0ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe86c002f30 tx=0x7fe86c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:11.096 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.084+0000 7fe87bfff700 1 --2- 172.21.15.38:0/1012979601 >> v2:172.21.15.38:3300/0 conn(0x7fe87c146680 0x7fe87c0ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe86c002f30 tx=0x7fe86c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:11.097 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.084+0000 7fe87bfff700 1 --2- 172.21.15.38:0/1012979601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe87c146680 0x7fe87c0ad5b0 secure :-1 s=READY pgs=431 cs=0 l=1 rx=0x7fe86c002f30 tx=0x7fe86c007e60).ready entity=mon.0 client_cookie=7ed833c6ccff96e1 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:11.097 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.084+0000 7fe87bfff700 1 --2- 172.21.15.38:0/1012979601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe87c146680 0x7fe87c0ad5b0 secure :-1 s=THROTTLE_DONE pgs=431 cs=0 l=1 rx=0x7fe86c002f30 tx=0x7fe86c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:11.097 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.084+0000 7fe87bfff700 1 --2- 172.21.15.38:0/1012979601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe87c146680 0x7fe87c0ad5b0 secure :-1 s=THROTTLE_DONE pgs=431 cs=0 l=1 rx=0x7fe86c002f30 tx=0x7fe86c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:11.097 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.084+0000 7fe87bfff700 1 --2- 172.21.15.38:0/1012979601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe87c146680 0x7fe87c0ad5b0 secure :-1 s=THROTTLE_DONE pgs=431 cs=0 l=1 rx=0x7fe86c002f30 tx=0x7fe86c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:11.098 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.084+0000 7fe87affd700 1 -- 172.21.15.38:0/1012979601 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe86c0116e0 con 0x7fe87c146680 2020-06-12T17:49:11.098 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.084+0000 7fe87affd700 1 -- 172.21.15.38:0/1012979601 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86c011840 con 0x7fe87c146680 2020-06-12T17:49:11.098 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.084+0000 7fe87affd700 1 -- 172.21.15.38:0/1012979601 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe86c011c20 con 0x7fe87c146680 2020-06-12T17:49:11.098 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.084+0000 7fe882650700 1 -- 172.21.15.38:0/1012979601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe87c146680 msgr2=0x7fe87c0ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:11.098 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.084+0000 7fe882650700 1 --2- 172.21.15.38:0/1012979601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe87c146680 0x7fe87c0ad5b0 secure :-1 s=READY pgs=431 cs=0 l=1 rx=0x7fe86c002f30 tx=0x7fe86c007e60).stop 2020-06-12T17:49:11.099 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.085+0000 7fe882650700 1 -- 172.21.15.38:0/1012979601 shutdown_connections 2020-06-12T17:49:11.099 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.085+0000 7fe882650700 1 --2- 172.21.15.38:0/1012979601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe87c146680 0x7fe87c0ad5b0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:11.099 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.085+0000 7fe882650700 1 --2- 172.21.15.38:0/1012979601 >> v2:172.21.15.150:3300/0 conn(0x7fe87c09d620 0x7fe87c09da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:11.099 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.085+0000 7fe882650700 1 --2- 172.21.15.38:0/1012979601 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe87c0b2eb0 0x7fe87c09d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:11.099 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.085+0000 7fe882650700 1 -- 172.21.15.38:0/1012979601 >> 172.21.15.38:0/1012979601 conn(0x7fe87c0b5a20 msgr2=0x7fe87c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:11.100 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.085+0000 7fe882650700 1 -- 172.21.15.38:0/1012979601 shutdown_connections 2020-06-12T17:49:11.100 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.085+0000 7fe882650700 1 -- 172.21.15.38:0/1012979601 wait complete. 2020-06-12T17:49:11.100 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.086+0000 7fe882650700 1 Processor -- start 2020-06-12T17:49:11.101 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.086+0000 7fe882650700 1 -- start start 2020-06-12T17:49:11.104 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.087+0000 7fe882650700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe87c09d620 0x7fe87c1397a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:11.105 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.087+0000 7fe882650700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe87c146680 0x7fe87c065080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:11.105 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.087+0000 7fe882650700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe87c0b15a0 con 0x7fe87c0b2eb0 2020-06-12T17:49:11.105 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.087+0000 7fe882650700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe87c064700 con 0x7fe87c09d620 2020-06-12T17:49:11.105 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.087+0000 7fe882650700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87c0649a0 con 0x7fe87c146680 2020-06-12T17:49:11.106 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.087+0000 7fe87b7fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe87c0b2eb0 0x7fe87c139c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39254/0 (socket says 172.21.15.38:39254) 2020-06-12T17:49:11.106 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.087+0000 7fe87b7fe700 1 -- 172.21.15.38:0/551837306 learned_addr learned my addr 172.21.15.38:0/551837306 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:11.106 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.087+0000 7fe87bfff700 1 --2- 172.21.15.38:0/551837306 >> v2:172.21.15.150:3300/0 conn(0x7fe87c09d620 0x7fe87c1397a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:11.106 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.087+0000 7fe880bed700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe87c146680 0x7fe87c065080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:11.106 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.087+0000 7fe8797fa700 1 -- 172.21.15.38:0/551837306 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1202574205 0 0) 0x7fe87c0b15a0 con 0x7fe87c0b2eb0 2020-06-12T17:49:11.107 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.087+0000 7fe8797fa700 1 -- 172.21.15.38:0/551837306 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe85c002fe0 con 0x7fe87c0b2eb0 2020-06-12T17:49:11.107 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.087+0000 7fe8797fa700 1 -- 172.21.15.38:0/551837306 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 942552000 0 0) 0x7fe85c002fe0 con 0x7fe87c0b2eb0 2020-06-12T17:49:11.107 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.087+0000 7fe8797fa700 1 -- 172.21.15.38:0/551837306 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe87c0b15a0 con 0x7fe87c0b2eb0 2020-06-12T17:49:11.107 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.087+0000 7fe8797fa700 1 -- 172.21.15.38:0/551837306 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fe870002540 con 0x7fe87c0b2eb0 2020-06-12T17:49:11.107 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.087+0000 7fe8797fa700 1 -- 172.21.15.38:0/551837306 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe87c146680 msgr2=0x7fe87c065080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:11.107 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.087+0000 7fe8797fa700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe87c146680 0x7fe87c065080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:11.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.087+0000 7fe8797fa700 1 -- 172.21.15.38:0/551837306 >> v2:172.21.15.150:3300/0 conn(0x7fe87c09d620 msgr2=0x7fe87c1397a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:11.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.087+0000 7fe8797fa700 1 --2- 172.21.15.38:0/551837306 >> v2:172.21.15.150:3300/0 conn(0x7fe87c09d620 0x7fe87c1397a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:11.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.087+0000 7fe8797fa700 1 -- 172.21.15.38:0/551837306 >> v1:172.21.15.38:6789/0 conn(0x7fe87c0b2eb0 legacy=0x7fe87c139c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:11.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.087+0000 7fe8797fa700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe85c0049b0 0x7fe85c004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:11.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.087+0000 7fe8797fa700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe85c0052a0 0x7fe85c003980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:11.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.087+0000 7fe8797fa700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe85c003f80 0x7fe85c004400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:11.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.087+0000 7fe8797fa700 1 -- 172.21.15.38:0/551837306 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87c064700 con 0x7fe85c003f80 2020-06-12T17:49:11.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.087+0000 7fe8797fa700 1 -- 172.21.15.38:0/551837306 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87c0649a0 con 0x7fe85c0052a0 2020-06-12T17:49:11.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.087+0000 7fe8797fa700 1 -- 172.21.15.38:0/551837306 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c00b990 con 0x7fe85c0049b0 2020-06-12T17:49:11.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.088+0000 7fe880bed700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe87c146680 0x7fe87c065080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:49:11.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.088+0000 7fe87bfff700 1 --2- 172.21.15.38:0/551837306 >> v2:172.21.15.150:3300/0 conn(0x7fe87c09d620 0x7fe87c1397a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:49:11.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.088+0000 7fe880bed700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe85c003f80 0x7fe85c004400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:11.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.088+0000 7fe87b7fe700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe85c0052a0 0x7fe85c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:11.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.088+0000 7fe87bfff700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe85c0049b0 0x7fe85c004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:11.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.088+0000 7fe880bed700 1 -- 172.21.15.38:0/551837306 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe85c0049b0 msgr2=0x7fe85c004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:11.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.088+0000 7fe880bed700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe85c0049b0 0x7fe85c004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:11.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.088+0000 7fe880bed700 1 -- 172.21.15.38:0/551837306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe85c0052a0 msgr2=0x7fe85c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:11.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.088+0000 7fe880bed700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe85c0052a0 0x7fe85c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:11.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.088+0000 7fe880bed700 1 -- 172.21.15.38:0/551837306 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87c0643b0 con 0x7fe85c003f80 2020-06-12T17:49:11.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.088+0000 7fe882650700 1 -- 172.21.15.38:0/551837306 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe87c065080 con 0x7fe85c003f80 2020-06-12T17:49:11.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.088+0000 7fe880bed700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe85c003f80 0x7fe85c004400 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe8740032b0 tx=0x7fe87400e290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:11.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.088+0000 7fe882650700 1 -- 172.21.15.38:0/551837306 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe87c065450 con 0x7fe85c003f80 2020-06-12T17:49:11.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.088+0000 7fe880bed700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe85c003f80 0x7fe85c004400 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe8740032b0 tx=0x7fe87400e290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:11.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.088+0000 7fe880bed700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe85c003f80 0x7fe85c004400 secure :-1 s=READY pgs=433 cs=0 l=1 rx=0x7fe8740032b0 tx=0x7fe87400e290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:11.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.088+0000 7fe880bed700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe85c003f80 0x7fe85c004400 secure :-1 s=THROTTLE_DONE pgs=433 cs=0 l=1 rx=0x7fe8740032b0 tx=0x7fe87400e290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:11.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.088+0000 7fe8797fa700 1 -- 172.21.15.38:0/551837306 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe874005c30 con 0x7fe85c003f80 2020-06-12T17:49:11.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.088+0000 7fe880bed700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe85c003f80 0x7fe85c004400 secure :-1 s=THROTTLE_DONE pgs=433 cs=0 l=1 rx=0x7fe8740032b0 tx=0x7fe87400e290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:11.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.088+0000 7fe880bed700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe85c003f80 0x7fe85c004400 secure :-1 s=THROTTLE_DONE pgs=433 cs=0 l=1 rx=0x7fe8740032b0 tx=0x7fe87400e290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:11.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.088+0000 7fe8797fa700 1 -- 172.21.15.38:0/551837306 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe874005d90 con 0x7fe85c003f80 2020-06-12T17:49:11.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.088+0000 7fe8797fa700 1 -- 172.21.15.38:0/551837306 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe874012940 con 0x7fe85c003f80 2020-06-12T17:49:11.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.089+0000 7fe880bed700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe85c003f80 0x7fe85c004400 secure :-1 s=THROTTLE_DONE pgs=433 cs=0 l=1 rx=0x7fe8740032b0 tx=0x7fe87400e290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:11.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.089+0000 7fe882650700 1 -- 172.21.15.38:0/551837306 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe858003340 con 0x7fe85c003f80 2020-06-12T17:49:11.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.089+0000 7fe8797fa700 1 -- 172.21.15.38:0/551837306 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe874012aa0 con 0x7fe85c003f80 2020-06-12T17:49:11.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.089+0000 7fe880bed700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe85c003f80 0x7fe85c004400 secure :-1 s=THROTTLE_DONE pgs=433 cs=0 l=1 rx=0x7fe8740032b0 tx=0x7fe87400e290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:11.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.089+0000 7fe8797fa700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe85c055cd0 0x7fe85c058190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:11.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.090+0000 7fe8797fa700 1 -- 172.21.15.38:0/551837306 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe874061230 con 0x7fe85c003f80 2020-06-12T17:49:11.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.090+0000 7fe87bfff700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe85c055cd0 0x7fe85c058190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:11.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.090+0000 7fe87bfff700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe85c055cd0 0x7fe85c058190 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe86c002f30 tx=0x7fe86c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:11.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.090+0000 7fe87bfff700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe85c055cd0 0x7fe85c058190 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe86c002f30 tx=0x7fe86c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:11.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.090+0000 7fe87bfff700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe85c055cd0 0x7fe85c058190 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7fe86c002f30 tx=0x7fe86c007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:11.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.093+0000 7fe880bed700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe85c003f80 0x7fe85c004400 secure :-1 s=THROTTLE_DONE pgs=433 cs=0 l=1 rx=0x7fe8740032b0 tx=0x7fe87400e290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:11.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.093+0000 7fe8797fa700 1 -- 172.21.15.38:0/551837306 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fe87403c990 con 0x7fe85c003f80 2020-06-12T17:49:11.297 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.294+0000 7fe882650700 1 -- 172.21.15.38:0/551837306 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_9470", "target": ["mon-mgr", ""]}) v1 -- 0x7fe858002200 con 0x7fe85c055cd0 2020-06-12T17:49:11.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.296+0000 7fe87bfff700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe85c055cd0 0x7fe85c058190 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7fe86c002f30 tx=0x7fe86c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:11.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.296+0000 7fe8797fa700 1 -- 172.21.15.38:0/551837306 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7fe858002200 con 0x7fe85c055cd0 2020-06-12T17:49:11.300 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_9470/79457905-2c07-463f-9db1-9eb590313052 2020-06-12T17:49:11.301 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.298+0000 7fe882650700 1 -- 172.21.15.38:0/551837306 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe85c055cd0 msgr2=0x7fe85c058190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:11.302 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.298+0000 7fe882650700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe85c055cd0 0x7fe85c058190 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7fe86c002f30 tx=0x7fe86c007e60).stop 2020-06-12T17:49:11.302 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.298+0000 7fe882650700 1 -- 172.21.15.38:0/551837306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe85c003f80 msgr2=0x7fe85c004400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:11.302 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.298+0000 7fe882650700 1 --2- 172.21.15.38:0/551837306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe85c003f80 0x7fe85c004400 secure :-1 s=READY pgs=433 cs=0 l=1 rx=0x7fe8740032b0 tx=0x7fe87400e290).stop 2020-06-12T17:49:11.302 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.298+0000 7fe880bed700 1 -- 172.21.15.38:0/551837306 reap_dead start 2020-06-12T17:49:11.303 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.298+0000 7fe880bed700 1 -- 172.21.15.38:0/551837306 reap_dead start 2020-06-12T17:49:11.303 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.298+0000 7fe882650700 1 -- 172.21.15.38:0/551837306 shutdown_connections 2020-06-12T17:49:11.303 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.298+0000 7fe882650700 1 -- 172.21.15.38:0/551837306 >> 172.21.15.38:0/551837306 conn(0x7fe87c0b5a20 msgr2=0x7fe87c09c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:11.303 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.298+0000 7fe882650700 1 -- 172.21.15.38:0/551837306 shutdown_connections 2020-06-12T17:49:11.303 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:11.298+0000 7fe882650700 1 -- 172.21.15.38:0/551837306 wait complete. 2020-06-12T17:49:11.311 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_9470 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_9470/79457905-2c07-463f-9db1-9eb590313052 2020-06-12T17:49:11.312 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:11.312 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:11.313 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:11.328 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:11.328 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:11.329 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9470/79457905-2c07-463f-9db1-9eb590313052/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:11.425 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:11.426 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:11.426 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01576 s, 66.5 MB/s 2020-06-12T17:49:11.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:11.428 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:11.428 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:11.443 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:11.444 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:11.444 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9470/79457905-2c07-463f-9db1-9eb590313052/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:11.529 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:11.530 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:11.530 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115234 s, 91.0 MB/s 2020-06-12T17:49:11.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:11.532 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:11.532 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:11.547 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:11.548 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:11.548 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9470/79457905-2c07-463f-9db1-9eb590313052/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:11.637 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:11.638 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:11.638 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134333 s, 78.1 MB/s 2020-06-12T17:49:11.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:11.640 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:11.640 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:11.655 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:11.656 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:11.656 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9470/79457905-2c07-463f-9db1-9eb590313052/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:11.746 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:11.747 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:11.747 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150979 s, 69.5 MB/s 2020-06-12T17:49:11.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:11.749 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:11.749 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:11.764 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:11.764 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:11.765 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9470/79457905-2c07-463f-9db1-9eb590313052/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:11.858 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:11.859 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:11.859 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121244 s, 86.5 MB/s 2020-06-12T17:49:11.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:11.860 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:11.860 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:11.875 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:11.876 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:11.876 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9470/79457905-2c07-463f-9db1-9eb590313052/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:11.964 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:11.965 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:11.965 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104571 s, 100 MB/s 2020-06-12T17:49:11.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:11.967 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:11.967 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:11.982 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:11.983 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:11.983 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9470/79457905-2c07-463f-9db1-9eb590313052/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:12.070 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:12.070 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:12.070 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112931 s, 92.9 MB/s 2020-06-12T17:49:12.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:12.072 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:12.072 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:12.087 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:12.088 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:12.088 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9470/79457905-2c07-463f-9db1-9eb590313052/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:12.177 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:12.178 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:12.178 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115407 s, 90.9 MB/s 2020-06-12T17:49:12.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:12.180 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:12.180 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:12.195 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:12.196 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:12.196 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9470/79457905-2c07-463f-9db1-9eb590313052/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:12.284 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:12.284 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:12.284 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111427 s, 94.1 MB/s 2020-06-12T17:49:12.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:12.286 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:12.286 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:12.301 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:12.302 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:12.302 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9470/79457905-2c07-463f-9db1-9eb590313052/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:12.388 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:12.389 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:12.389 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117735 s, 89.1 MB/s 2020-06-12T17:49:12.390 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_6546 2020-06-12T17:49:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.504+0000 7fe584857700 1 Processor -- start 2020-06-12T17:49:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.504+0000 7fe584857700 1 -- start start 2020-06-12T17:49:12.511 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.505+0000 7fe584857700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe580065420 0x7fe58005b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:12.511 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.505+0000 7fe584857700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe580146090 0x7fe580146520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:12.511 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.505+0000 7fe584857700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe58005c8e0 con 0x7fe5800b7070 2020-06-12T17:49:12.511 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.505+0000 7fe584857700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe580149700 con 0x7fe580065420 2020-06-12T17:49:12.512 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.505+0000 7fe584857700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe58005cb80 con 0x7fe580146090 2020-06-12T17:49:12.512 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.505+0000 7fe57e59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe580065420 0x7fe58005b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:12.512 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.505+0000 7fe57e59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe580065420 0x7fe58005b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37454/0 (socket says 172.21.15.38:37454) 2020-06-12T17:49:12.512 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.505+0000 7fe57ed9d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe5800b7070 0x7fe580149ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39270/0 (socket says 172.21.15.38:39270) 2020-06-12T17:49:12.512 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.505+0000 7fe57e59c700 1 -- 172.21.15.38:0/3240388266 learned_addr learned my addr 172.21.15.38:0/3240388266 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:12.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.505+0000 7fe57dd9b700 1 --2- 172.21.15.38:0/3240388266 >> v2:172.21.15.150:3300/0 conn(0x7fe580146090 0x7fe580146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:12.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.506+0000 7fe57e59c700 1 -- 172.21.15.38:0/3240388266 >> v2:172.21.15.150:3300/0 conn(0x7fe580146090 msgr2=0x7fe580146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:12.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.506+0000 7fe57e59c700 1 --2- 172.21.15.38:0/3240388266 >> v2:172.21.15.150:3300/0 conn(0x7fe580146090 0x7fe580146520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:12.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.506+0000 7fe57e59c700 1 -- 172.21.15.38:0/3240388266 >> v1:172.21.15.38:6789/0 conn(0x7fe5800b7070 legacy=0x7fe580149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:12.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.506+0000 7fe57e59c700 1 -- 172.21.15.38:0/3240388266 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58005c560 con 0x7fe580065420 2020-06-12T17:49:12.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.506+0000 7fe57d59a700 1 -- 172.21.15.38:0/3240388266 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748552592 0 0) 0x7fe58005c8e0 con 0x7fe5800b7070 2020-06-12T17:49:12.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.506+0000 7fe57e59c700 1 --2- 172.21.15.38:0/3240388266 >> v2:172.21.15.38:3300/0 conn(0x7fe580065420 0x7fe58005b0a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe574002f30 tx=0x7fe574007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.506+0000 7fe57e59c700 1 --2- 172.21.15.38:0/3240388266 >> v2:172.21.15.38:3300/0 conn(0x7fe580065420 0x7fe58005b0a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe574002f30 tx=0x7fe574007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.506+0000 7fe57e59c700 1 --2- 172.21.15.38:0/3240388266 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe580065420 0x7fe58005b0a0 secure :-1 s=READY pgs=435 cs=0 l=1 rx=0x7fe574002f30 tx=0x7fe574007e60).ready entity=mon.0 client_cookie=5ece602d02e03bda server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:12.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.506+0000 7fe57e59c700 1 --2- 172.21.15.38:0/3240388266 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe580065420 0x7fe58005b0a0 secure :-1 s=THROTTLE_DONE pgs=435 cs=0 l=1 rx=0x7fe574002f30 tx=0x7fe574007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.506+0000 7fe57e59c700 1 --2- 172.21.15.38:0/3240388266 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe580065420 0x7fe58005b0a0 secure :-1 s=THROTTLE_DONE pgs=435 cs=0 l=1 rx=0x7fe574002f30 tx=0x7fe574007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.506+0000 7fe57e59c700 1 --2- 172.21.15.38:0/3240388266 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe580065420 0x7fe58005b0a0 secure :-1 s=THROTTLE_DONE pgs=435 cs=0 l=1 rx=0x7fe574002f30 tx=0x7fe574007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.506+0000 7fe57d59a700 1 -- 172.21.15.38:0/3240388266 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5740116e0 con 0x7fe580065420 2020-06-12T17:49:12.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.506+0000 7fe57d59a700 1 -- 172.21.15.38:0/3240388266 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe574011840 con 0x7fe580065420 2020-06-12T17:49:12.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.506+0000 7fe57d59a700 1 -- 172.21.15.38:0/3240388266 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe574011c20 con 0x7fe580065420 2020-06-12T17:49:12.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.506+0000 7fe584857700 1 -- 172.21.15.38:0/3240388266 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe580065420 msgr2=0x7fe58005b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:12.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.506+0000 7fe584857700 1 --2- 172.21.15.38:0/3240388266 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe580065420 0x7fe58005b0a0 secure :-1 s=READY pgs=435 cs=0 l=1 rx=0x7fe574002f30 tx=0x7fe574007e60).stop 2020-06-12T17:49:12.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.507+0000 7fe584857700 1 -- 172.21.15.38:0/3240388266 shutdown_connections 2020-06-12T17:49:12.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.507+0000 7fe584857700 1 --2- 172.21.15.38:0/3240388266 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe580065420 0x7fe58005b0a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:12.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.507+0000 7fe584857700 1 --2- 172.21.15.38:0/3240388266 >> v2:172.21.15.150:3300/0 conn(0x7fe580146090 0x7fe580146520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:12.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.507+0000 7fe584857700 1 -- 172.21.15.38:0/3240388266 >> 172.21.15.38:0/3240388266 conn(0x7fe5800ba610 msgr2=0x7fe5800baa20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:12.517 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.507+0000 7fe584857700 1 -- 172.21.15.38:0/3240388266 shutdown_connections 2020-06-12T17:49:12.517 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.507+0000 7fe584857700 1 -- 172.21.15.38:0/3240388266 wait complete. 2020-06-12T17:49:12.517 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.508+0000 7fe584857700 1 Processor -- start 2020-06-12T17:49:12.517 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.508+0000 7fe584857700 1 -- start start 2020-06-12T17:49:12.520 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.508+0000 7fe584857700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe580065420 0x7fe5800b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:12.520 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.508+0000 7fe584857700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe580146090 0x7fe5800b8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:12.520 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.508+0000 7fe584857700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe580153990 con 0x7fe5800b7070 2020-06-12T17:49:12.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.508+0000 7fe584857700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe580153780 con 0x7fe580146090 2020-06-12T17:49:12.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.508+0000 7fe584857700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe580153c30 con 0x7fe580065420 2020-06-12T17:49:12.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.508+0000 7fe57ed9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe580146090 0x7fe5800b8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:12.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.508+0000 7fe57ed9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe580146090 0x7fe5800b8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37462/0 (socket says 172.21.15.38:37462) 2020-06-12T17:49:12.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.508+0000 7fe57ed9d700 1 -- 172.21.15.38:0/1076145006 learned_addr learned my addr 172.21.15.38:0/1076145006 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:12.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.508+0000 7fe57e59c700 1 --2- 172.21.15.38:0/1076145006 >> v2:172.21.15.150:3300/0 conn(0x7fe580065420 0x7fe5800b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:12.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.509+0000 7fe57ed9d700 1 -- 172.21.15.38:0/1076145006 >> v2:172.21.15.150:3300/0 conn(0x7fe580065420 msgr2=0x7fe5800b8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:12.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.509+0000 7fe57ed9d700 1 --2- 172.21.15.38:0/1076145006 >> v2:172.21.15.150:3300/0 conn(0x7fe580065420 0x7fe5800b8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:12.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.509+0000 7fe57ed9d700 1 -- 172.21.15.38:0/1076145006 >> v1:172.21.15.150:6789/0 conn(0x7fe5800b7070 legacy=0x7fe580157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:12.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.509+0000 7fe57ed9d700 1 -- 172.21.15.38:0/1076145006 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe580157740 con 0x7fe580146090 2020-06-12T17:49:12.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.509+0000 7fe57ed9d700 1 --2- 172.21.15.38:0/1076145006 >> v2:172.21.15.38:3300/0 conn(0x7fe580146090 0x7fe5800b8e80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe578000f00 tx=0x7fe578001b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.509+0000 7fe57ed9d700 1 --2- 172.21.15.38:0/1076145006 >> v2:172.21.15.38:3300/0 conn(0x7fe580146090 0x7fe5800b8e80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe578000f00 tx=0x7fe578001b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.509+0000 7fe57ed9d700 1 --2- 172.21.15.38:0/1076145006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe580146090 0x7fe5800b8e80 secure :-1 s=READY pgs=436 cs=0 l=1 rx=0x7fe578000f00 tx=0x7fe578001b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:12.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.509+0000 7fe57ed9d700 1 --2- 172.21.15.38:0/1076145006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe580146090 0x7fe5800b8e80 secure :-1 s=THROTTLE_DONE pgs=436 cs=0 l=1 rx=0x7fe578000f00 tx=0x7fe578001b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.509+0000 7fe57ed9d700 1 --2- 172.21.15.38:0/1076145006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe580146090 0x7fe5800b8e80 secure :-1 s=THROTTLE_DONE pgs=436 cs=0 l=1 rx=0x7fe578000f00 tx=0x7fe578001b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.509+0000 7fe56f7fe700 1 -- 172.21.15.38:0/1076145006 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe57800ccd0 con 0x7fe580146090 2020-06-12T17:49:12.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.509+0000 7fe57ed9d700 1 --2- 172.21.15.38:0/1076145006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe580146090 0x7fe5800b8e80 secure :-1 s=THROTTLE_DONE pgs=436 cs=0 l=1 rx=0x7fe578000f00 tx=0x7fe578001b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.509+0000 7fe56f7fe700 1 -- 172.21.15.38:0/1076145006 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57800ce30 con 0x7fe580146090 2020-06-12T17:49:12.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.509+0000 7fe56f7fe700 1 -- 172.21.15.38:0/1076145006 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe578004a60 con 0x7fe580146090 2020-06-12T17:49:12.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.509+0000 7fe584857700 1 -- 172.21.15.38:0/1076145006 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe580153320 con 0x7fe580146090 2020-06-12T17:49:12.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.509+0000 7fe584857700 1 -- 172.21.15.38:0/1076145006 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5801540d0 con 0x7fe580146090 2020-06-12T17:49:12.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.510+0000 7fe57ed9d700 1 --2- 172.21.15.38:0/1076145006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe580146090 0x7fe5800b8e80 secure :-1 s=THROTTLE_DONE pgs=436 cs=0 l=1 rx=0x7fe578000f00 tx=0x7fe578001b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.510+0000 7fe56f7fe700 1 -- 172.21.15.38:0/1076145006 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fe578004cd0 con 0x7fe580146090 2020-06-12T17:49:12.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.510+0000 7fe57ed9d700 1 --2- 172.21.15.38:0/1076145006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe580146090 0x7fe5800b8e80 secure :-1 s=THROTTLE_DONE pgs=436 cs=0 l=1 rx=0x7fe578000f00 tx=0x7fe578001b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.510+0000 7fe584857700 1 -- 172.21.15.38:0/1076145006 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe580056c30 con 0x7fe580146090 2020-06-12T17:49:12.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.510+0000 7fe56f7fe700 1 --2- 172.21.15.38:0/1076145006 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe55c04d5e0 0x7fe55c04faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:12.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.510+0000 7fe56f7fe700 1 -- 172.21.15.38:0/1076145006 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe578060fe0 con 0x7fe580146090 2020-06-12T17:49:12.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.510+0000 7fe57e59c700 1 --2- 172.21.15.38:0/1076145006 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe55c04d5e0 0x7fe55c04faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:12.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.511+0000 7fe57e59c700 1 --2- 172.21.15.38:0/1076145006 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe55c04d5e0 0x7fe55c04faa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe574002f30 tx=0x7fe574007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.511+0000 7fe57e59c700 1 --2- 172.21.15.38:0/1076145006 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe55c04d5e0 0x7fe55c04faa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe574002f30 tx=0x7fe574007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.511+0000 7fe57e59c700 1 --2- 172.21.15.38:0/1076145006 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe55c04d5e0 0x7fe55c04faa0 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7fe574002f30 tx=0x7fe574007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:12.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.514+0000 7fe57ed9d700 1 --2- 172.21.15.38:0/1076145006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe580146090 0x7fe5800b8e80 secure :-1 s=THROTTLE_DONE pgs=436 cs=0 l=1 rx=0x7fe578000f00 tx=0x7fe578001b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.514+0000 7fe56f7fe700 1 -- 172.21.15.38:0/1076145006 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fe57803c760 con 0x7fe580146090 2020-06-12T17:49:12.715 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.711+0000 7fe584857700 1 -- 172.21.15.38:0/1076145006 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_6546", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5801439e0 con 0x7fe55c04d5e0 2020-06-12T17:49:12.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.731+0000 7fe57e59c700 1 --2- 172.21.15.38:0/1076145006 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe55c04d5e0 0x7fe55c04faa0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fe574002f30 tx=0x7fe574007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.731+0000 7fe56f7fe700 1 -- 172.21.15.38:0/1076145006 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe5801439e0 con 0x7fe55c04d5e0 2020-06-12T17:49:12.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.733+0000 7fe584857700 1 -- 172.21.15.38:0/1076145006 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe55c04d5e0 msgr2=0x7fe55c04faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:12.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.733+0000 7fe584857700 1 --2- 172.21.15.38:0/1076145006 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe55c04d5e0 0x7fe55c04faa0 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7fe574002f30 tx=0x7fe574007e60).stop 2020-06-12T17:49:12.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.733+0000 7fe584857700 1 -- 172.21.15.38:0/1076145006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe580146090 msgr2=0x7fe5800b8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:12.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.733+0000 7fe584857700 1 --2- 172.21.15.38:0/1076145006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe580146090 0x7fe5800b8e80 secure :-1 s=READY pgs=436 cs=0 l=1 rx=0x7fe578000f00 tx=0x7fe578001b30).stop 2020-06-12T17:49:12.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.733+0000 7fe584857700 1 -- 172.21.15.38:0/1076145006 shutdown_connections 2020-06-12T17:49:12.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.733+0000 7fe584857700 1 --2- 172.21.15.38:0/1076145006 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe55c04d5e0 0x7fe55c04faa0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:12.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.733+0000 7fe584857700 1 --2- 172.21.15.38:0/1076145006 >> v2:172.21.15.150:3300/0 conn(0x7fe580065420 0x7fe5800b8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:12.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.733+0000 7fe584857700 1 --2- 172.21.15.38:0/1076145006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe580146090 0x7fe5800b8e80 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:12.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.733+0000 7fe584857700 1 -- 172.21.15.38:0/1076145006 >> 172.21.15.38:0/1076145006 conn(0x7fe5800ba610 msgr2=0x7fe580149ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:12.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.733+0000 7fe584857700 1 -- 172.21.15.38:0/1076145006 shutdown_connections 2020-06-12T17:49:12.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.733+0000 7fe584857700 1 -- 172.21.15.38:0/1076145006 wait complete. 2020-06-12T17:49:12.746 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_6546 2020-06-12T17:49:12.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.860+0000 7f3b4ebdd700 1 Processor -- start 2020-06-12T17:49:12.914 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.860+0000 7f3b4ebdd700 1 -- start start 2020-06-12T17:49:12.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.861+0000 7f3b4ebdd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3b480b11e0 0x7f3b480b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:12.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.861+0000 7f3b4ebdd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3b480b2380 0x7f3b480ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:12.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.861+0000 7f3b4ebdd700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b480b2900 con 0x7f3b480ae520 2020-06-12T17:49:12.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.861+0000 7f3b4ebdd700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b480b1ad0 con 0x7f3b480b2380 2020-06-12T17:49:12.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.861+0000 7f3b4ebdd700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b480b1d70 con 0x7f3b480b11e0 2020-06-12T17:49:12.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.861+0000 7f3b4d3da700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3b480b2380 0x7f3b480ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:12.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.861+0000 7f3b4e3dc700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f3b480ae520 0x7f3b480afc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39282/0 (socket says 172.21.15.38:39282) 2020-06-12T17:49:12.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.861+0000 7f3b4e3dc700 1 -- 172.21.15.38:0/1342210757 learned_addr learned my addr 172.21.15.38:0/1342210757 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:12.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.862+0000 7f3b4dbdb700 1 --2- 172.21.15.38:0/1342210757 >> v2:172.21.15.150:3300/0 conn(0x7f3b480b11e0 0x7f3b480b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:12.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.862+0000 7f3b4d3da700 1 -- 172.21.15.38:0/1342210757 >> v2:172.21.15.150:3300/0 conn(0x7f3b480b11e0 msgr2=0x7f3b480b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:12.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.862+0000 7f3b4d3da700 1 --2- 172.21.15.38:0/1342210757 >> v2:172.21.15.150:3300/0 conn(0x7f3b480b11e0 0x7f3b480b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:12.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.862+0000 7f3b4cbd9700 1 -- 172.21.15.38:0/1342210757 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496772231 0 0) 0x7f3b480b2900 con 0x7f3b480ae520 2020-06-12T17:49:12.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.862+0000 7f3b4d3da700 1 -- 172.21.15.38:0/1342210757 >> v1:172.21.15.38:6789/0 conn(0x7f3b480ae520 legacy=0x7f3b480afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:12.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.862+0000 7f3b4d3da700 1 -- 172.21.15.38:0/1342210757 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b480b0330 con 0x7f3b480b2380 2020-06-12T17:49:12.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.862+0000 7f3b4d3da700 1 --2- 172.21.15.38:0/1342210757 >> v2:172.21.15.38:3300/0 conn(0x7f3b480b2380 0x7f3b480ae0c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3b440032b0 tx=0x7f3b440081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.862+0000 7f3b4d3da700 1 --2- 172.21.15.38:0/1342210757 >> v2:172.21.15.38:3300/0 conn(0x7f3b480b2380 0x7f3b480ae0c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3b440032b0 tx=0x7f3b440081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.862+0000 7f3b4d3da700 1 --2- 172.21.15.38:0/1342210757 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b480b2380 0x7f3b480ae0c0 secure :-1 s=READY pgs=438 cs=0 l=1 rx=0x7f3b440032b0 tx=0x7f3b440081e0).ready entity=mon.0 client_cookie=cdb7d19d076951e3 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:12.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.862+0000 7f3b4d3da700 1 --2- 172.21.15.38:0/1342210757 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b480b2380 0x7f3b480ae0c0 secure :-1 s=THROTTLE_DONE pgs=438 cs=0 l=1 rx=0x7f3b440032b0 tx=0x7f3b440081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.862+0000 7f3b4cbd9700 1 -- 172.21.15.38:0/1342210757 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b44011e90 con 0x7f3b480b2380 2020-06-12T17:49:12.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.862+0000 7f3b4d3da700 1 --2- 172.21.15.38:0/1342210757 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b480b2380 0x7f3b480ae0c0 secure :-1 s=THROTTLE_DONE pgs=438 cs=0 l=1 rx=0x7f3b440032b0 tx=0x7f3b440081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.862+0000 7f3b4d3da700 1 --2- 172.21.15.38:0/1342210757 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b480b2380 0x7f3b480ae0c0 secure :-1 s=THROTTLE_DONE pgs=438 cs=0 l=1 rx=0x7f3b440032b0 tx=0x7f3b440081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.862+0000 7f3b4cbd9700 1 -- 172.21.15.38:0/1342210757 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4400a160 con 0x7f3b480b2380 2020-06-12T17:49:12.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.862+0000 7f3b4cbd9700 1 -- 172.21.15.38:0/1342210757 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b4400a500 con 0x7f3b480b2380 2020-06-12T17:49:12.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.862+0000 7f3b4ebdd700 1 -- 172.21.15.38:0/1342210757 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b480b2380 msgr2=0x7f3b480ae0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:12.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.862+0000 7f3b4ebdd700 1 --2- 172.21.15.38:0/1342210757 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b480b2380 0x7f3b480ae0c0 secure :-1 s=READY pgs=438 cs=0 l=1 rx=0x7f3b440032b0 tx=0x7f3b440081e0).stop 2020-06-12T17:49:12.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.863+0000 7f3b4ebdd700 1 -- 172.21.15.38:0/1342210757 shutdown_connections 2020-06-12T17:49:12.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.863+0000 7f3b4ebdd700 1 --2- 172.21.15.38:0/1342210757 >> v2:172.21.15.150:3300/0 conn(0x7f3b480b11e0 0x7f3b480b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:12.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.863+0000 7f3b4ebdd700 1 --2- 172.21.15.38:0/1342210757 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b480b2380 0x7f3b480ae0c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:12.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.863+0000 7f3b4ebdd700 1 -- 172.21.15.38:0/1342210757 >> 172.21.15.38:0/1342210757 conn(0x7f3b480b4cc0 msgr2=0x7f3b480b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:12.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.863+0000 7f3b4ebdd700 1 -- 172.21.15.38:0/1342210757 shutdown_connections 2020-06-12T17:49:12.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.863+0000 7f3b4ebdd700 1 -- 172.21.15.38:0/1342210757 wait complete. 2020-06-12T17:49:12.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.864+0000 7f3b4ebdd700 1 Processor -- start 2020-06-12T17:49:12.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.864+0000 7f3b4ebdd700 1 -- start start 2020-06-12T17:49:12.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.864+0000 7f3b4ebdd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3b480ae520 0x7f3b481390f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:12.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.864+0000 7f3b4ebdd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b480b2380 0x7f3b4813b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:12.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.864+0000 7f3b4ebdd700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b4813ba60 con 0x7f3b480b11e0 2020-06-12T17:49:12.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.864+0000 7f3b4ebdd700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b480ac8e0 con 0x7f3b480ae520 2020-06-12T17:49:12.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.864+0000 7f3b4ebdd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b480acb80 con 0x7f3b480b2380 2020-06-12T17:49:12.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.864+0000 7f3b4dbdb700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3b480ae520 0x7f3b481390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:12.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.864+0000 7f3b4dbdb700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3b480ae520 0x7f3b481390f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37472/0 (socket says 172.21.15.38:37472) 2020-06-12T17:49:12.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.864+0000 7f3b4d3da700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f3b480b11e0 0x7f3b480b66b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39290/0 (socket says 172.21.15.38:39290) 2020-06-12T17:49:12.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.864+0000 7f3b4dbdb700 1 -- 172.21.15.38:0/2116160039 learned_addr learned my addr 172.21.15.38:0/2116160039 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:12.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.865+0000 7f3b4e3dc700 1 --2- 172.21.15.38:0/2116160039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b480b2380 0x7f3b4813b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:12.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.865+0000 7f3b4dbdb700 1 -- 172.21.15.38:0/2116160039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b480b2380 msgr2=0x7f3b4813b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:12.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.865+0000 7f3b4dbdb700 1 --2- 172.21.15.38:0/2116160039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b480b2380 0x7f3b4813b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:12.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.865+0000 7f3b4dbdb700 1 -- 172.21.15.38:0/2116160039 >> v1:172.21.15.38:6789/0 conn(0x7f3b480b11e0 legacy=0x7f3b480b66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:12.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.865+0000 7f3b36ffd700 1 -- 172.21.15.38:0/2116160039 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2336285705 0 0) 0x7f3b480b0330 con 0x7f3b480b11e0 2020-06-12T17:49:12.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.865+0000 7f3b4dbdb700 1 -- 172.21.15.38:0/2116160039 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b480b6dc0 con 0x7f3b480ae520 2020-06-12T17:49:12.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.865+0000 7f3b4dbdb700 1 --2- 172.21.15.38:0/2116160039 >> v2:172.21.15.38:3300/0 conn(0x7f3b480ae520 0x7f3b481390f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b38003070 tx=0x7f3b3800e1a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.865+0000 7f3b4dbdb700 1 --2- 172.21.15.38:0/2116160039 >> v2:172.21.15.38:3300/0 conn(0x7f3b480ae520 0x7f3b481390f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b38003070 tx=0x7f3b3800e1a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.865+0000 7f3b4dbdb700 1 --2- 172.21.15.38:0/2116160039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b480ae520 0x7f3b481390f0 secure :-1 s=READY pgs=440 cs=0 l=1 rx=0x7f3b38003070 tx=0x7f3b3800e1a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:12.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.865+0000 7f3b4dbdb700 1 --2- 172.21.15.38:0/2116160039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b480ae520 0x7f3b481390f0 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7f3b38003070 tx=0x7f3b3800e1a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.865+0000 7f3b36ffd700 1 -- 172.21.15.38:0/2116160039 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b38012a20 con 0x7f3b480ae520 2020-06-12T17:49:12.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.865+0000 7f3b4dbdb700 1 --2- 172.21.15.38:0/2116160039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b480ae520 0x7f3b481390f0 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7f3b38003070 tx=0x7f3b3800e1a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.865+0000 7f3b4dbdb700 1 --2- 172.21.15.38:0/2116160039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b480ae520 0x7f3b481390f0 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7f3b38003070 tx=0x7f3b3800e1a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.865+0000 7f3b36ffd700 1 -- 172.21.15.38:0/2116160039 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b38012b80 con 0x7f3b480ae520 2020-06-12T17:49:12.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.865+0000 7f3b36ffd700 1 -- 172.21.15.38:0/2116160039 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b380091a0 con 0x7f3b480ae520 2020-06-12T17:49:12.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.865+0000 7f3b4ebdd700 1 -- 172.21.15.38:0/2116160039 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b480ac520 con 0x7f3b480ae520 2020-06-12T17:49:12.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.865+0000 7f3b4ebdd700 1 -- 172.21.15.38:0/2116160039 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b481398d0 con 0x7f3b480ae520 2020-06-12T17:49:12.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.866+0000 7f3b4dbdb700 1 --2- 172.21.15.38:0/2116160039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b480ae520 0x7f3b481390f0 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7f3b38003070 tx=0x7f3b3800e1a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.932 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.866+0000 7f3b36ffd700 1 -- 172.21.15.38:0/2116160039 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f3b38007170 con 0x7f3b480ae520 2020-06-12T17:49:12.932 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.866+0000 7f3b4dbdb700 1 --2- 172.21.15.38:0/2116160039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b480ae520 0x7f3b481390f0 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7f3b38003070 tx=0x7f3b3800e1a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.932 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.866+0000 7f3b4ebdd700 1 -- 172.21.15.38:0/2116160039 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b48056c30 con 0x7f3b480ae520 2020-06-12T17:49:12.932 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.866+0000 7f3b36ffd700 1 --2- 172.21.15.38:0/2116160039 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3b2804d4f0 0x7f3b2804f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:12.932 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.866+0000 7f3b36ffd700 1 -- 172.21.15.38:0/2116160039 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3b38061110 con 0x7f3b480ae520 2020-06-12T17:49:12.933 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.867+0000 7f3b4d3da700 1 --2- 172.21.15.38:0/2116160039 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3b2804d4f0 0x7f3b2804f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:12.933 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.867+0000 7f3b4d3da700 1 --2- 172.21.15.38:0/2116160039 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3b2804d4f0 0x7f3b2804f9b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b44010580 tx=0x7f3b440081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.933 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.867+0000 7f3b4d3da700 1 --2- 172.21.15.38:0/2116160039 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3b2804d4f0 0x7f3b2804f9b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b44010580 tx=0x7f3b440081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.933 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.867+0000 7f3b4d3da700 1 --2- 172.21.15.38:0/2116160039 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3b2804d4f0 0x7f3b2804f9b0 secure :-1 s=READY pgs=181 cs=0 l=1 rx=0x7f3b44010580 tx=0x7f3b440081e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:12.933 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.870+0000 7f3b4dbdb700 1 --2- 172.21.15.38:0/2116160039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b480ae520 0x7f3b481390f0 secure :-1 s=THROTTLE_DONE pgs=440 cs=0 l=1 rx=0x7f3b38003070 tx=0x7f3b3800e1a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:12.934 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:12.870+0000 7f3b36ffd700 1 -- 172.21.15.38:0/2116160039 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f3b3803c8f0 con 0x7f3b480ae520 2020-06-12T17:49:13.067 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:13.064+0000 7f3b4ebdd700 1 -- 172.21.15.38:0/2116160039 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_6546", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b481398d0 con 0x7f3b2804d4f0 2020-06-12T17:49:13.071 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:13.068+0000 7f3b4d3da700 1 --2- 172.21.15.38:0/2116160039 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3b2804d4f0 0x7f3b2804f9b0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f3b44010580 tx=0x7f3b440081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:13.071 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:13.068+0000 7f3b36ffd700 1 -- 172.21.15.38:0/2116160039 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f3b481398d0 con 0x7f3b2804d4f0 2020-06-12T17:49:13.072 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_6546/6e539393-9445-45f2-91f2-90147af2f812 2020-06-12T17:49:13.073 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:13.069+0000 7f3b4ebdd700 1 -- 172.21.15.38:0/2116160039 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3b2804d4f0 msgr2=0x7f3b2804f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:13.073 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:13.069+0000 7f3b4ebdd700 1 --2- 172.21.15.38:0/2116160039 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3b2804d4f0 0x7f3b2804f9b0 secure :-1 s=READY pgs=181 cs=0 l=1 rx=0x7f3b44010580 tx=0x7f3b440081e0).stop 2020-06-12T17:49:13.073 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:13.069+0000 7f3b4ebdd700 1 -- 172.21.15.38:0/2116160039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b480ae520 msgr2=0x7f3b481390f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:13.074 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:13.069+0000 7f3b4ebdd700 1 --2- 172.21.15.38:0/2116160039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b480ae520 0x7f3b481390f0 secure :-1 s=READY pgs=440 cs=0 l=1 rx=0x7f3b38003070 tx=0x7f3b3800e1a0).stop 2020-06-12T17:49:13.074 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:13.069+0000 7f3b4ebdd700 1 -- 172.21.15.38:0/2116160039 shutdown_connections 2020-06-12T17:49:13.074 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:13.069+0000 7f3b4ebdd700 1 --2- 172.21.15.38:0/2116160039 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3b2804d4f0 0x7f3b2804f9b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:13.074 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:13.069+0000 7f3b4ebdd700 1 --2- 172.21.15.38:0/2116160039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b480b2380 0x7f3b4813b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:13.074 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:13.069+0000 7f3b4ebdd700 1 --2- 172.21.15.38:0/2116160039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b480ae520 0x7f3b481390f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:13.075 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:13.069+0000 7f3b4ebdd700 1 -- 172.21.15.38:0/2116160039 >> 172.21.15.38:0/2116160039 conn(0x7f3b480b4cc0 msgr2=0x7f3b480b7500 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:13.075 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:13.069+0000 7f3b4ebdd700 1 -- 172.21.15.38:0/2116160039 shutdown_connections 2020-06-12T17:49:13.075 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:13.069+0000 7f3b4ebdd700 1 -- 172.21.15.38:0/2116160039 wait complete. 2020-06-12T17:49:13.082 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_6546 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_6546/6e539393-9445-45f2-91f2-90147af2f812 2020-06-12T17:49:13.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:13.083 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:13.084 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:13.098 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:13.099 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:13.099 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6546/6e539393-9445-45f2-91f2-90147af2f812/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:13.192 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:13.192 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:13.192 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144897 s, 72.4 MB/s 2020-06-12T17:49:13.193 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:13.194 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:13.194 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:13.209 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:13.210 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:13.210 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6546/6e539393-9445-45f2-91f2-90147af2f812/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:13.300 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:13.300 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:13.300 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139297 s, 75.3 MB/s 2020-06-12T17:49:13.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:13.302 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:13.302 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:13.317 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:13.318 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:13.318 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6546/6e539393-9445-45f2-91f2-90147af2f812/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:13.404 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:13.404 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:13.405 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957699 s, 109 MB/s 2020-06-12T17:49:13.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:13.406 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:13.407 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:13.421 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:13.422 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:13.423 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6546/6e539393-9445-45f2-91f2-90147af2f812/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:13.510 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:13.510 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:13.511 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116238 s, 90.2 MB/s 2020-06-12T17:49:13.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:13.512 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:13.512 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:13.527 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:13.528 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:13.529 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6546/6e539393-9445-45f2-91f2-90147af2f812/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:13.618 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:13.618 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:13.618 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134578 s, 77.9 MB/s 2020-06-12T17:49:13.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:13.620 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:13.620 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:13.636 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:13.637 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:13.637 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6546/6e539393-9445-45f2-91f2-90147af2f812/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:13.726 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:13.727 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:13.727 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137041 s, 76.5 MB/s 2020-06-12T17:49:13.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:13.729 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:13.729 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:13.744 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:13.745 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:13.745 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6546/6e539393-9445-45f2-91f2-90147af2f812/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:13.834 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:13.835 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:13.835 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139755 s, 75.0 MB/s 2020-06-12T17:49:13.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:13.837 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:13.837 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:13.852 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:13.854 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:13.855 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6546/6e539393-9445-45f2-91f2-90147af2f812/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:13.943 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:13.944 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:13.944 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107547 s, 97.5 MB/s 2020-06-12T17:49:13.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:13.945 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:13.945 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:13.960 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:13.961 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:13.961 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6546/6e539393-9445-45f2-91f2-90147af2f812/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:14.052 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:14.053 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:14.053 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117263 s, 89.4 MB/s 2020-06-12T17:49:14.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:14.056 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:14.056 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:14.071 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:14.072 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:14.072 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6546/6e539393-9445-45f2-91f2-90147af2f812/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:14.164 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:14.165 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:14.165 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138044 s, 76.0 MB/s 2020-06-12T17:49:14.166 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_3261 2020-06-12T17:49:14.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.280+0000 7f8adcc54700 1 Processor -- start 2020-06-12T17:49:14.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.280+0000 7f8adcc54700 1 -- start start 2020-06-12T17:49:14.286 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.281+0000 7f8adcc54700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8ad80b3ac0 0x7f8ad809df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:14.287 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.281+0000 7f8adcc54700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8ad8142e90 0x7f8ad813bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:14.287 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.281+0000 7f8adcc54700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad809b960 con 0x7f8ad813c3a0 2020-06-12T17:49:14.287 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.281+0000 7f8adcc54700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad80b35c0 con 0x7f8ad80b3ac0 2020-06-12T17:49:14.287 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.281+0000 7f8adcc54700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad809bc00 con 0x7f8ad8142e90 2020-06-12T17:49:14.287 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.281+0000 7f8ad659c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8ad80b3ac0 0x7f8ad809df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:14.288 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.281+0000 7f8ad659c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8ad80b3ac0 0x7f8ad809df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37484/0 (socket says 172.21.15.38:37484) 2020-06-12T17:49:14.288 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.281+0000 7f8ad659c700 1 -- 172.21.15.38:0/3968574957 learned_addr learned my addr 172.21.15.38:0/3968574957 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:14.288 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.281+0000 7f8ad5d9b700 1 --2- 172.21.15.38:0/3968574957 >> v2:172.21.15.150:3300/0 conn(0x7f8ad8142e90 0x7f8ad813bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:14.288 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.281+0000 7f8ad659c700 1 -- 172.21.15.38:0/3968574957 >> v2:172.21.15.150:3300/0 conn(0x7f8ad8142e90 msgr2=0x7f8ad813bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:14.288 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.281+0000 7f8ad659c700 1 --2- 172.21.15.38:0/3968574957 >> v2:172.21.15.150:3300/0 conn(0x7f8ad8142e90 0x7f8ad813bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:14.289 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.281+0000 7f8ad659c700 1 -- 172.21.15.38:0/3968574957 >> v1:172.21.15.150:6789/0 conn(0x7f8ad813c3a0 legacy=0x7f8ad80b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:14.289 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.281+0000 7f8ad659c700 1 -- 172.21.15.38:0/3968574957 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad80b48f0 con 0x7f8ad80b3ac0 2020-06-12T17:49:14.289 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.281+0000 7f8ad5d9b700 1 --2- 172.21.15.38:0/3968574957 >> v2:172.21.15.150:3300/0 conn(0x7f8ad8142e90 0x7f8ad813bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:49:14.289 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.281+0000 7f8ad659c700 1 --2- 172.21.15.38:0/3968574957 >> v2:172.21.15.38:3300/0 conn(0x7f8ad80b3ac0 0x7f8ad809df00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8ad8061380 tx=0x7f8acc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.289 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.281+0000 7f8ad659c700 1 --2- 172.21.15.38:0/3968574957 >> v2:172.21.15.38:3300/0 conn(0x7f8ad80b3ac0 0x7f8ad809df00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8ad8061380 tx=0x7f8acc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.290 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.281+0000 7f8ad659c700 1 --2- 172.21.15.38:0/3968574957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ad80b3ac0 0x7f8ad809df00 secure :-1 s=READY pgs=441 cs=0 l=1 rx=0x7f8ad8061380 tx=0x7f8acc007e60).ready entity=mon.0 client_cookie=af653a33800dee7d server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:14.290 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.282+0000 7f8ad659c700 1 --2- 172.21.15.38:0/3968574957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ad80b3ac0 0x7f8ad809df00 secure :-1 s=THROTTLE_DONE pgs=441 cs=0 l=1 rx=0x7f8ad8061380 tx=0x7f8acc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.290 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.282+0000 7f8ad559a700 1 -- 172.21.15.38:0/3968574957 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8acc008e20 con 0x7f8ad80b3ac0 2020-06-12T17:49:14.290 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.282+0000 7f8ad659c700 1 --2- 172.21.15.38:0/3968574957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ad80b3ac0 0x7f8ad809df00 secure :-1 s=THROTTLE_DONE pgs=441 cs=0 l=1 rx=0x7f8ad8061380 tx=0x7f8acc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.290 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.282+0000 7f8ad659c700 1 --2- 172.21.15.38:0/3968574957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ad80b3ac0 0x7f8ad809df00 secure :-1 s=THROTTLE_DONE pgs=441 cs=0 l=1 rx=0x7f8ad8061380 tx=0x7f8acc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.291 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.282+0000 7f8ad559a700 1 -- 172.21.15.38:0/3968574957 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8acc011890 con 0x7f8ad80b3ac0 2020-06-12T17:49:14.291 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.282+0000 7f8ad559a700 1 -- 172.21.15.38:0/3968574957 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8acc011c70 con 0x7f8ad80b3ac0 2020-06-12T17:49:14.291 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.282+0000 7f8adcc54700 1 -- 172.21.15.38:0/3968574957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ad80b3ac0 msgr2=0x7f8ad809df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:14.291 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.282+0000 7f8adcc54700 1 --2- 172.21.15.38:0/3968574957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ad80b3ac0 0x7f8ad809df00 secure :-1 s=READY pgs=441 cs=0 l=1 rx=0x7f8ad8061380 tx=0x7f8acc007e60).stop 2020-06-12T17:49:14.291 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.282+0000 7f8adcc54700 1 -- 172.21.15.38:0/3968574957 shutdown_connections 2020-06-12T17:49:14.291 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.282+0000 7f8adcc54700 1 --2- 172.21.15.38:0/3968574957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ad80b3ac0 0x7f8ad809df00 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:14.292 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.282+0000 7f8adcc54700 1 --2- 172.21.15.38:0/3968574957 >> v2:172.21.15.150:3300/0 conn(0x7f8ad8142e90 0x7f8ad813bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:14.292 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.282+0000 7f8adcc54700 1 -- 172.21.15.38:0/3968574957 >> 172.21.15.38:0/3968574957 conn(0x7f8ad80b5a20 msgr2=0x7f8ad805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:14.292 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.282+0000 7f8adcc54700 1 -- 172.21.15.38:0/3968574957 shutdown_connections 2020-06-12T17:49:14.292 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.282+0000 7f8adcc54700 1 -- 172.21.15.38:0/3968574957 wait complete. 2020-06-12T17:49:14.292 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.283+0000 7f8adcc54700 1 Processor -- start 2020-06-12T17:49:14.293 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.283+0000 7f8adcc54700 1 -- start start 2020-06-12T17:49:14.296 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.284+0000 7f8adcc54700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8ad80b3ac0 0x7f8ad8064d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:14.296 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.284+0000 7f8adcc54700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8ad813c3a0 0x7f8ad8150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:14.296 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.284+0000 7f8adcc54700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad8065210 con 0x7f8ad8142e90 2020-06-12T17:49:14.296 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.284+0000 7f8adcc54700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad80654b0 con 0x7f8ad813c3a0 2020-06-12T17:49:14.297 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.284+0000 7f8adcc54700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad8065750 con 0x7f8ad80b3ac0 2020-06-12T17:49:14.297 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.284+0000 7f8ad5d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8ad813c3a0 0x7f8ad8150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:14.297 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.284+0000 7f8ad5d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8ad813c3a0 0x7f8ad8150340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37490/0 (socket says 172.21.15.38:37490) 2020-06-12T17:49:14.297 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.284+0000 7f8ad6d9d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8ad8142e90 0x7f8ad8150a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39308/0 (socket says 172.21.15.38:39308) 2020-06-12T17:49:14.297 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.284+0000 7f8ad5d9b700 1 -- 172.21.15.38:0/2135205535 learned_addr learned my addr 172.21.15.38:0/2135205535 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:14.298 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.284+0000 7f8ad659c700 1 --2- 172.21.15.38:0/2135205535 >> v2:172.21.15.150:3300/0 conn(0x7f8ad80b3ac0 0x7f8ad8064d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:14.298 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.284+0000 7f8ad5d9b700 1 -- 172.21.15.38:0/2135205535 >> v2:172.21.15.150:3300/0 conn(0x7f8ad80b3ac0 msgr2=0x7f8ad8064d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:14.298 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.284+0000 7f8ad5d9b700 1 --2- 172.21.15.38:0/2135205535 >> v2:172.21.15.150:3300/0 conn(0x7f8ad80b3ac0 0x7f8ad8064d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:14.298 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.284+0000 7f8ac77fe700 1 -- 172.21.15.38:0/2135205535 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 525101819 0 0) 0x7f8ad8065210 con 0x7f8ad8142e90 2020-06-12T17:49:14.298 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.284+0000 7f8ad5d9b700 1 -- 172.21.15.38:0/2135205535 >> v1:172.21.15.38:6789/0 conn(0x7f8ad8142e90 legacy=0x7f8ad8150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:14.299 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.284+0000 7f8ad5d9b700 1 -- 172.21.15.38:0/2135205535 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad8066290 con 0x7f8ad813c3a0 2020-06-12T17:49:14.299 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.284+0000 7f8ad5d9b700 1 --2- 172.21.15.38:0/2135205535 >> v2:172.21.15.38:3300/0 conn(0x7f8ad813c3a0 0x7f8ad8150340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8ac80032b0 tx=0x7f8ac8008300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.299 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.284+0000 7f8ad5d9b700 1 --2- 172.21.15.38:0/2135205535 >> v2:172.21.15.38:3300/0 conn(0x7f8ad813c3a0 0x7f8ad8150340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8ac80032b0 tx=0x7f8ac8008300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.299 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.284+0000 7f8ad5d9b700 1 --2- 172.21.15.38:0/2135205535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ad813c3a0 0x7f8ad8150340 secure :-1 s=READY pgs=443 cs=0 l=1 rx=0x7f8ac80032b0 tx=0x7f8ac8008300).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:14.299 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.284+0000 7f8ad5d9b700 1 --2- 172.21.15.38:0/2135205535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ad813c3a0 0x7f8ad8150340 secure :-1 s=THROTTLE_DONE pgs=443 cs=0 l=1 rx=0x7f8ac80032b0 tx=0x7f8ac8008300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.285+0000 7f8ac77fe700 1 -- 172.21.15.38:0/2135205535 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ac8007350 con 0x7f8ad813c3a0 2020-06-12T17:49:14.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.285+0000 7f8ad5d9b700 1 --2- 172.21.15.38:0/2135205535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ad813c3a0 0x7f8ad8150340 secure :-1 s=THROTTLE_DONE pgs=443 cs=0 l=1 rx=0x7f8ac80032b0 tx=0x7f8ac8008300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.285+0000 7f8ad5d9b700 1 --2- 172.21.15.38:0/2135205535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ad813c3a0 0x7f8ad8150340 secure :-1 s=THROTTLE_DONE pgs=443 cs=0 l=1 rx=0x7f8ac80032b0 tx=0x7f8ac8008300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.285+0000 7f8ac77fe700 1 -- 172.21.15.38:0/2135205535 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac80074b0 con 0x7f8ad813c3a0 2020-06-12T17:49:14.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.285+0000 7f8adcc54700 1 -- 172.21.15.38:0/2135205535 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad8151120 con 0x7f8ad813c3a0 2020-06-12T17:49:14.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.285+0000 7f8ac77fe700 1 -- 172.21.15.38:0/2135205535 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ac8007850 con 0x7f8ad813c3a0 2020-06-12T17:49:14.301 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.285+0000 7f8adcc54700 1 -- 172.21.15.38:0/2135205535 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad8065e30 con 0x7f8ad813c3a0 2020-06-12T17:49:14.301 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.285+0000 7f8ad5d9b700 1 --2- 172.21.15.38:0/2135205535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ad813c3a0 0x7f8ad8150340 secure :-1 s=THROTTLE_DONE pgs=443 cs=0 l=1 rx=0x7f8ac80032b0 tx=0x7f8ac8008300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.301 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.286+0000 7f8ac77fe700 1 -- 172.21.15.38:0/2135205535 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f8ac8012480 con 0x7f8ad813c3a0 2020-06-12T17:49:14.301 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.286+0000 7f8ad5d9b700 1 --2- 172.21.15.38:0/2135205535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ad813c3a0 0x7f8ad8150340 secure :-1 s=THROTTLE_DONE pgs=443 cs=0 l=1 rx=0x7f8ac80032b0 tx=0x7f8ac8008300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.301 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.286+0000 7f8adcc54700 1 -- 172.21.15.38:0/2135205535 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad8056c30 con 0x7f8ad813c3a0 2020-06-12T17:49:14.302 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.286+0000 7f8ac77fe700 1 --2- 172.21.15.38:0/2135205535 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8ab404d470 0x7f8ab404f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:14.302 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.286+0000 7f8ac77fe700 1 -- 172.21.15.38:0/2135205535 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8ac80610a0 con 0x7f8ad813c3a0 2020-06-12T17:49:14.302 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.286+0000 7f8ad659c700 1 --2- 172.21.15.38:0/2135205535 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8ab404d470 0x7f8ab404f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:14.302 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.286+0000 7f8ad659c700 1 --2- 172.21.15.38:0/2135205535 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8ab404d470 0x7f8ab404f930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8ad8061380 tx=0x7f8acc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.302 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.286+0000 7f8ad659c700 1 --2- 172.21.15.38:0/2135205535 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8ab404d470 0x7f8ab404f930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8ad8061380 tx=0x7f8acc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.303 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.286+0000 7f8ad659c700 1 --2- 172.21.15.38:0/2135205535 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8ab404d470 0x7f8ab404f930 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f8ad8061380 tx=0x7f8acc007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:14.303 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.289+0000 7f8ad5d9b700 1 --2- 172.21.15.38:0/2135205535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ad813c3a0 0x7f8ad8150340 secure :-1 s=THROTTLE_DONE pgs=443 cs=0 l=1 rx=0x7f8ac80032b0 tx=0x7f8ac8008300).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.303 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.289+0000 7f8ac77fe700 1 -- 172.21.15.38:0/2135205535 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f8ac803c820 con 0x7f8ad813c3a0 2020-06-12T17:49:14.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.485+0000 7f8adcc54700 1 -- 172.21.15.38:0/2135205535 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_3261", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ad8065950 con 0x7f8ab404d470 2020-06-12T17:49:14.506 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.502+0000 7f8ad659c700 1 --2- 172.21.15.38:0/2135205535 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8ab404d470 0x7f8ab404f930 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7f8ad8061380 tx=0x7f8acc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.506 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.502+0000 7f8ac77fe700 1 -- 172.21.15.38:0/2135205535 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8acc008e20 con 0x7f8ab404d470 2020-06-12T17:49:14.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.504+0000 7f8adcc54700 1 -- 172.21.15.38:0/2135205535 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8ab404d470 msgr2=0x7f8ab404f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:14.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.504+0000 7f8adcc54700 1 --2- 172.21.15.38:0/2135205535 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8ab404d470 0x7f8ab404f930 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7f8ad8061380 tx=0x7f8acc007e60).stop 2020-06-12T17:49:14.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.504+0000 7f8adcc54700 1 -- 172.21.15.38:0/2135205535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ad813c3a0 msgr2=0x7f8ad8150340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:14.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.504+0000 7f8adcc54700 1 --2- 172.21.15.38:0/2135205535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ad813c3a0 0x7f8ad8150340 secure :-1 s=READY pgs=443 cs=0 l=1 rx=0x7f8ac80032b0 tx=0x7f8ac8008300).stop 2020-06-12T17:49:14.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.504+0000 7f8adcc54700 1 -- 172.21.15.38:0/2135205535 shutdown_connections 2020-06-12T17:49:14.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.504+0000 7f8adcc54700 1 --2- 172.21.15.38:0/2135205535 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8ab404d470 0x7f8ab404f930 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:14.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.504+0000 7f8adcc54700 1 --2- 172.21.15.38:0/2135205535 >> v2:172.21.15.150:3300/0 conn(0x7f8ad80b3ac0 0x7f8ad8064d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:14.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.504+0000 7f8adcc54700 1 --2- 172.21.15.38:0/2135205535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ad813c3a0 0x7f8ad8150340 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:14.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.504+0000 7f8adcc54700 1 -- 172.21.15.38:0/2135205535 >> 172.21.15.38:0/2135205535 conn(0x7f8ad80b5a20 msgr2=0x7f8ad8066b40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:14.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.504+0000 7f8adcc54700 1 -- 172.21.15.38:0/2135205535 shutdown_connections 2020-06-12T17:49:14.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.504+0000 7f8adcc54700 1 -- 172.21.15.38:0/2135205535 wait complete. 2020-06-12T17:49:14.518 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_3261 2020-06-12T17:49:14.635 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.632+0000 7fdebd843700 1 Processor -- start 2020-06-12T17:49:14.635 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.632+0000 7fdebd843700 1 -- start start 2020-06-12T17:49:14.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.632+0000 7fdebd843700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeb8140100 0x7fdeb81468d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:14.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.632+0000 7fdebd843700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb8146df0 con 0x7fdeb8060320 2020-06-12T17:49:14.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.632+0000 7fdebd843700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb80a2030 con 0x7fdeb80b7920 2020-06-12T17:49:14.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.632+0000 7fdebd843700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb80a0b10 con 0x7fdeb8140100 2020-06-12T17:49:14.640 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.633+0000 7fdeb6ffd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fdeb8060320 0x7fdeb813f9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39312/0 (socket says 172.21.15.38:39312) 2020-06-12T17:49:14.640 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.633+0000 7fdeb6ffd700 1 -- 172.21.15.38:0/1364360843 learned_addr learned my addr 172.21.15.38:0/1364360843 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:14.640 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.633+0000 7fdeb67fc700 1 --2- 172.21.15.38:0/1364360843 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeb8140100 0x7fdeb81468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:14.640 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.633+0000 7fdeb5ffb700 1 -- 172.21.15.38:0/1364360843 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4245335308 0 0) 0x7fdeb8146df0 con 0x7fdeb8060320 2020-06-12T17:49:14.640 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.633+0000 7fdeb5ffb700 1 -- 172.21.15.38:0/1364360843 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde98003230 con 0x7fdeb8060320 2020-06-12T17:49:14.641 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.633+0000 7fdeb5ffb700 1 -- 172.21.15.38:0/1364360843 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1877406574 0 0) 0x7fde98003230 con 0x7fdeb8060320 2020-06-12T17:49:14.641 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.633+0000 7fdeb5ffb700 1 -- 172.21.15.38:0/1364360843 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeb8140100 msgr2=0x7fdeb81468d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:14.641 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.633+0000 7fdeb5ffb700 1 --2- 172.21.15.38:0/1364360843 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeb8140100 0x7fdeb81468d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:14.641 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.633+0000 7fdeb5ffb700 1 -- 172.21.15.38:0/1364360843 >> v1:172.21.15.150:6789/0 conn(0x7fdeb80b7920 legacy=0x7fdeb805b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:14.641 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.633+0000 7fdeb5ffb700 1 -- 172.21.15.38:0/1364360843 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb80a22d0 con 0x7fdeb8060320 2020-06-12T17:49:14.642 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.633+0000 7fdeb5ffb700 1 -- 172.21.15.38:0/1364360843 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fdea00016d0 con 0x7fdeb8060320 2020-06-12T17:49:14.642 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.633+0000 7fdeb5ffb700 1 -- 172.21.15.38:0/1364360843 >> v1:172.21.15.38:6789/0 conn(0x7fdeb8060320 legacy=0x7fdeb813f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:14.642 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.633+0000 7fdeb5ffb700 1 --2- 172.21.15.38:0/1364360843 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde98003750 0x7fde98003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:14.642 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.633+0000 7fdeb5ffb700 1 --2- 172.21.15.38:0/1364360843 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde98004090 0x7fde98004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:14.642 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.633+0000 7fdeb5ffb700 1 --2- 172.21.15.38:0/1364360843 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeb8140100 0x7fde98004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:14.643 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.633+0000 7fdeb5ffb700 1 -- 172.21.15.38:0/1364360843 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb80a0b10 con 0x7fde98003750 2020-06-12T17:49:14.643 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.633+0000 7fdeb5ffb700 1 -- 172.21.15.38:0/1364360843 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde98004fb0 con 0x7fde98004090 2020-06-12T17:49:14.643 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.633+0000 7fdeb5ffb700 1 -- 172.21.15.38:0/1364360843 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde98005170 con 0x7fdeb8140100 2020-06-12T17:49:14.643 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.633+0000 7fdeb6ffd700 1 --2- 172.21.15.38:0/1364360843 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde98003750 0x7fde98003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:14.643 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.633+0000 7fdeb67fc700 1 --2- 172.21.15.38:0/1364360843 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde98004090 0x7fde98004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:14.644 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.633+0000 7fdeb77fe700 1 --2- 172.21.15.38:0/1364360843 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeb8140100 0x7fde98004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:14.644 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.634+0000 7fdeb6ffd700 1 -- 172.21.15.38:0/1364360843 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeb8140100 msgr2=0x7fde98004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:14.644 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.634+0000 7fdeb6ffd700 1 --2- 172.21.15.38:0/1364360843 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeb8140100 0x7fde98004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:14.644 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.634+0000 7fdeb6ffd700 1 -- 172.21.15.38:0/1364360843 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde98004090 msgr2=0x7fde98004570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:14.644 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.634+0000 7fdeb6ffd700 1 --2- 172.21.15.38:0/1364360843 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde98004090 0x7fde98004570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:14.644 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.634+0000 7fdeb6ffd700 1 -- 172.21.15.38:0/1364360843 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde98003230 con 0x7fde98003750 2020-06-12T17:49:14.645 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.634+0000 7fdeb6ffd700 1 --2- 172.21.15.38:0/1364360843 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde98003750 0x7fde98003b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdea00013e0 tx=0x7fdeb80b8ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.645 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.634+0000 7fdeb6ffd700 1 --2- 172.21.15.38:0/1364360843 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde98003750 0x7fde98003b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdea00013e0 tx=0x7fdeb80b8ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.645 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.634+0000 7fdeb6ffd700 1 --2- 172.21.15.38:0/1364360843 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde98003750 0x7fde98003b70 secure :-1 s=READY pgs=445 cs=0 l=1 rx=0x7fdea00013e0 tx=0x7fdeb80b8ed0).ready entity=mon.0 client_cookie=19a13798e80db92b server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:14.645 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.634+0000 7fdeb6ffd700 1 --2- 172.21.15.38:0/1364360843 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde98003750 0x7fde98003b70 secure :-1 s=THROTTLE_DONE pgs=445 cs=0 l=1 rx=0x7fdea00013e0 tx=0x7fdeb80b8ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.645 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.634+0000 7fdeb6ffd700 1 --2- 172.21.15.38:0/1364360843 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde98003750 0x7fde98003b70 secure :-1 s=THROTTLE_DONE pgs=445 cs=0 l=1 rx=0x7fdea00013e0 tx=0x7fdeb80b8ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.634+0000 7fdeb5ffb700 1 -- 172.21.15.38:0/1364360843 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdea000e160 con 0x7fde98003750 2020-06-12T17:49:14.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.634+0000 7fdeb6ffd700 1 --2- 172.21.15.38:0/1364360843 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde98003750 0x7fde98003b70 secure :-1 s=THROTTLE_DONE pgs=445 cs=0 l=1 rx=0x7fdea00013e0 tx=0x7fdeb80b8ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.634+0000 7fdeb5ffb700 1 -- 172.21.15.38:0/1364360843 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea000e2c0 con 0x7fde98003750 2020-06-12T17:49:14.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.634+0000 7fdeb5ffb700 1 -- 172.21.15.38:0/1364360843 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdea00100b0 con 0x7fde98003750 2020-06-12T17:49:14.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.634+0000 7fdebd843700 1 -- 172.21.15.38:0/1364360843 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde98003750 msgr2=0x7fde98003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:14.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.634+0000 7fdebd843700 1 --2- 172.21.15.38:0/1364360843 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde98003750 0x7fde98003b70 secure :-1 s=READY pgs=445 cs=0 l=1 rx=0x7fdea00013e0 tx=0x7fdeb80b8ed0).stop 2020-06-12T17:49:14.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.634+0000 7fdeb77fe700 1 -- 172.21.15.38:0/1364360843 reap_dead start 2020-06-12T17:49:14.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.634+0000 7fdebd843700 1 -- 172.21.15.38:0/1364360843 shutdown_connections 2020-06-12T17:49:14.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.634+0000 7fdebd843700 1 -- 172.21.15.38:0/1364360843 >> 172.21.15.38:0/1364360843 conn(0x7fdeb80b91b0 msgr2=0x7fdeb80b95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:14.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.634+0000 7fdebd843700 1 -- 172.21.15.38:0/1364360843 shutdown_connections 2020-06-12T17:49:14.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.634+0000 7fdebd843700 1 -- 172.21.15.38:0/1364360843 wait complete. 2020-06-12T17:49:14.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.635+0000 7fdebd843700 1 Processor -- start 2020-06-12T17:49:14.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.635+0000 7fdebd843700 1 -- start start 2020-06-12T17:49:14.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.636+0000 7fdebd843700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeb80b6ab0 0x7fdeb8143050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:14.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.636+0000 7fdebd843700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb8139320 con 0x7fdeb81450f0 2020-06-12T17:49:14.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.636+0000 7fdebd843700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb813f080 con 0x7fdeb8141270 2020-06-12T17:49:14.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.636+0000 7fdebd843700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb813f320 con 0x7fdeb80b6ab0 2020-06-12T17:49:14.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.636+0000 7fdeb6ffd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fdeb81450f0 0x7fdeb8138c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39322/0 (socket says 172.21.15.38:39322) 2020-06-12T17:49:14.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.636+0000 7fdeb6ffd700 1 -- 172.21.15.38:0/358500447 learned_addr learned my addr 172.21.15.38:0/358500447 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:14.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.636+0000 7fdeb67fc700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeb80b6ab0 0x7fdeb8143050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:14.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.636+0000 7fdeaffff700 1 -- 172.21.15.38:0/358500447 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3315735872 0 0) 0x7fdeb8139320 con 0x7fdeb81450f0 2020-06-12T17:49:14.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.636+0000 7fdeaffff700 1 -- 172.21.15.38:0/358500447 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde9c002fe0 con 0x7fdeb81450f0 2020-06-12T17:49:14.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeaffff700 1 -- 172.21.15.38:0/358500447 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1394620052 0 0) 0x7fde9c002fe0 con 0x7fdeb81450f0 2020-06-12T17:49:14.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeaffff700 1 -- 172.21.15.38:0/358500447 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdeb8139320 con 0x7fdeb81450f0 2020-06-12T17:49:14.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeaffff700 1 -- 172.21.15.38:0/358500447 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fdea0001a50 con 0x7fdeb81450f0 2020-06-12T17:49:14.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeaffff700 1 -- 172.21.15.38:0/358500447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeb80b6ab0 msgr2=0x7fdeb8143050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:14.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeaffff700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeb80b6ab0 0x7fdeb8143050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:14.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeaffff700 1 -- 172.21.15.38:0/358500447 >> v1:172.21.15.150:6789/0 conn(0x7fdeb8141270 legacy=0x7fdeb81416d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:14.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeaffff700 1 -- 172.21.15.38:0/358500447 >> v1:172.21.15.38:6789/0 conn(0x7fdeb81450f0 legacy=0x7fdeb8138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:14.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeaffff700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde9c0049b0 0x7fde9c004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:14.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeaffff700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde9c005210 0x7fde9c003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:14.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeaffff700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde9c003e00 0x7fde9c0042b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:14.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeaffff700 1 -- 172.21.15.38:0/358500447 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb813f320 con 0x7fde9c0049b0 2020-06-12T17:49:14.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeaffff700 1 -- 172.21.15.38:0/358500447 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c00b750 con 0x7fde9c003e00 2020-06-12T17:49:14.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeaffff700 1 -- 172.21.15.38:0/358500447 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c00b8e0 con 0x7fde9c005210 2020-06-12T17:49:14.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeb67fc700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeb80b6ab0 0x7fdeb8143050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:49:14.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeb6ffd700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde9c0049b0 0x7fde9c004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:14.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeb77fe700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde9c003e00 0x7fde9c0042b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:14.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeb67fc700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde9c005210 0x7fde9c003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:14.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeb6ffd700 1 -- 172.21.15.38:0/358500447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde9c005210 msgr2=0x7fde9c003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:14.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeb6ffd700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde9c005210 0x7fde9c003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:14.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeb6ffd700 1 -- 172.21.15.38:0/358500447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde9c003e00 msgr2=0x7fde9c0042b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:14.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeb6ffd700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde9c003e00 0x7fde9c0042b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:14.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeb6ffd700 1 -- 172.21.15.38:0/358500447 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb813f5c0 con 0x7fde9c0049b0 2020-06-12T17:49:14.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdebd843700 1 -- 172.21.15.38:0/358500447 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb81454d0 con 0x7fde9c0049b0 2020-06-12T17:49:14.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeb6ffd700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde9c0049b0 0x7fde9c004d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fde9c0048f0 tx=0x7fdeb80b8ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdebd843700 1 -- 172.21.15.38:0/358500447 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb8143290 con 0x7fde9c0049b0 2020-06-12T17:49:14.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeb6ffd700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde9c0049b0 0x7fde9c004d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fde9c0048f0 tx=0x7fdeb80b8ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeb6ffd700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde9c0049b0 0x7fde9c004d90 secure :-1 s=READY pgs=447 cs=0 l=1 rx=0x7fde9c0048f0 tx=0x7fdeb80b8ed0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:14.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeb6ffd700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde9c0049b0 0x7fde9c004d90 secure :-1 s=THROTTLE_DONE pgs=447 cs=0 l=1 rx=0x7fde9c0048f0 tx=0x7fdeb80b8ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeaffff700 1 -- 172.21.15.38:0/358500447 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdea00045b0 con 0x7fde9c0049b0 2020-06-12T17:49:14.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeb6ffd700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde9c0049b0 0x7fde9c004d90 secure :-1 s=THROTTLE_DONE pgs=447 cs=0 l=1 rx=0x7fde9c0048f0 tx=0x7fdeb80b8ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeb6ffd700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde9c0049b0 0x7fde9c004d90 secure :-1 s=THROTTLE_DONE pgs=447 cs=0 l=1 rx=0x7fde9c0048f0 tx=0x7fdeb80b8ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeaffff700 1 -- 172.21.15.38:0/358500447 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea0004750 con 0x7fde9c0049b0 2020-06-12T17:49:14.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.637+0000 7fdeaffff700 1 -- 172.21.15.38:0/358500447 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdea0004af0 con 0x7fde9c0049b0 2020-06-12T17:49:14.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.638+0000 7fdeb6ffd700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde9c0049b0 0x7fde9c004d90 secure :-1 s=THROTTLE_DONE pgs=447 cs=0 l=1 rx=0x7fde9c0048f0 tx=0x7fdeb80b8ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.638+0000 7fdebd843700 1 -- 172.21.15.38:0/358500447 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde90003340 con 0x7fde9c0049b0 2020-06-12T17:49:14.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.638+0000 7fdeaffff700 1 -- 172.21.15.38:0/358500447 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fdea0011d70 con 0x7fde9c0049b0 2020-06-12T17:49:14.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.638+0000 7fdeb6ffd700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde9c0049b0 0x7fde9c004d90 secure :-1 s=THROTTLE_DONE pgs=447 cs=0 l=1 rx=0x7fde9c0048f0 tx=0x7fdeb80b8ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.639+0000 7fdeaffff700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fde9c055c60 0x7fde9c058120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:14.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.639+0000 7fdeaffff700 1 -- 172.21.15.38:0/358500447 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fdea0061d50 con 0x7fde9c0049b0 2020-06-12T17:49:14.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.639+0000 7fdeb67fc700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fde9c055c60 0x7fde9c058120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:14.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.639+0000 7fdeb67fc700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fde9c055c60 0x7fde9c058120 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdea8000b20 tx=0x7fdea8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.639+0000 7fdeb67fc700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fde9c055c60 0x7fde9c058120 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdea8000b20 tx=0x7fdea8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.639+0000 7fdeb67fc700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fde9c055c60 0x7fde9c058120 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7fdea8000b20 tx=0x7fdea8007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:14.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.642+0000 7fdeb6ffd700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde9c0049b0 0x7fde9c004d90 secure :-1 s=THROTTLE_DONE pgs=447 cs=0 l=1 rx=0x7fde9c0048f0 tx=0x7fdeb80b8ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.642+0000 7fdeaffff700 1 -- 172.21.15.38:0/358500447 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fdea003d590 con 0x7fde9c0049b0 2020-06-12T17:49:14.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.836+0000 7fdebd843700 1 -- 172.21.15.38:0/358500447 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_3261", "target": ["mon-mgr", ""]}) v1 -- 0x7fde90002200 con 0x7fde9c055c60 2020-06-12T17:49:14.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.840+0000 7fdeb67fc700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fde9c055c60 0x7fde9c058120 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7fdea8000b20 tx=0x7fdea8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:14.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.840+0000 7fdeaffff700 1 -- 172.21.15.38:0/358500447 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7fde90002200 con 0x7fde9c055c60 2020-06-12T17:49:14.843 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_3261/0913fb23-4ddd-4837-9eb4-f54131f87dfb 2020-06-12T17:49:14.844 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.841+0000 7fdebd843700 1 -- 172.21.15.38:0/358500447 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fde9c055c60 msgr2=0x7fde9c058120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:14.845 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.841+0000 7fdebd843700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fde9c055c60 0x7fde9c058120 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7fdea8000b20 tx=0x7fdea8007e60).stop 2020-06-12T17:49:14.845 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.841+0000 7fdebd843700 1 -- 172.21.15.38:0/358500447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde9c0049b0 msgr2=0x7fde9c004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:14.845 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.841+0000 7fdebd843700 1 --2- 172.21.15.38:0/358500447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde9c0049b0 0x7fde9c004d90 secure :-1 s=READY pgs=447 cs=0 l=1 rx=0x7fde9c0048f0 tx=0x7fdeb80b8ed0).stop 2020-06-12T17:49:14.845 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.841+0000 7fdeb77fe700 1 -- 172.21.15.38:0/358500447 reap_dead start 2020-06-12T17:49:14.846 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.841+0000 7fdebd843700 1 -- 172.21.15.38:0/358500447 shutdown_connections 2020-06-12T17:49:14.846 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.841+0000 7fdebd843700 1 -- 172.21.15.38:0/358500447 >> 172.21.15.38:0/358500447 conn(0x7fdeb80b91b0 msgr2=0x7fdeb806a440 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:14.846 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.841+0000 7fdebd843700 1 -- 172.21.15.38:0/358500447 shutdown_connections 2020-06-12T17:49:14.846 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:14.841+0000 7fdebd843700 1 -- 172.21.15.38:0/358500447 wait complete. 2020-06-12T17:49:14.854 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_3261 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_3261/0913fb23-4ddd-4837-9eb4-f54131f87dfb 2020-06-12T17:49:14.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:14.855 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:14.856 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:14.871 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:14.871 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:14.872 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3261/0913fb23-4ddd-4837-9eb4-f54131f87dfb/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:14.964 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:14.965 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:14.965 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122116 s, 85.9 MB/s 2020-06-12T17:49:14.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:14.966 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:14.967 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:14.981 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:14.987 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:14.987 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3261/0913fb23-4ddd-4837-9eb4-f54131f87dfb/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:15.077 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:15.077 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:15.077 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124761 s, 84.0 MB/s 2020-06-12T17:49:15.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:15.079 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:15.079 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:15.094 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:15.095 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:15.095 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3261/0913fb23-4ddd-4837-9eb4-f54131f87dfb/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:15.185 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:15.185 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:15.186 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133749 s, 78.4 MB/s 2020-06-12T17:49:15.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:15.188 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:15.188 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:15.203 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:15.204 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:15.204 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3261/0913fb23-4ddd-4837-9eb4-f54131f87dfb/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:15.293 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:15.294 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:15.294 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109774 s, 95.5 MB/s 2020-06-12T17:49:15.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:15.296 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:15.296 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:15.311 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:15.311 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:15.312 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3261/0913fb23-4ddd-4837-9eb4-f54131f87dfb/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:15.400 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:15.400 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:15.400 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119888 s, 87.5 MB/s 2020-06-12T17:49:15.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:15.402 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:15.402 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:15.417 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:15.417 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:15.418 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3261/0913fb23-4ddd-4837-9eb4-f54131f87dfb/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:15.504 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:15.505 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:15.505 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104764 s, 100 MB/s 2020-06-12T17:49:15.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:15.507 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:15.516 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:15.532 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:15.532 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:15.533 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3261/0913fb23-4ddd-4837-9eb4-f54131f87dfb/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:15.618 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:15.619 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:15.619 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127135 s, 82.5 MB/s 2020-06-12T17:49:15.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:15.621 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:15.621 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:15.636 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:15.637 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:15.637 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3261/0913fb23-4ddd-4837-9eb4-f54131f87dfb/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:15.724 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:15.725 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:15.725 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118543 s, 88.5 MB/s 2020-06-12T17:49:15.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:15.726 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:15.727 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:15.742 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:15.742 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:15.743 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3261/0913fb23-4ddd-4837-9eb4-f54131f87dfb/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:15.830 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:15.831 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:15.831 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111471 s, 94.1 MB/s 2020-06-12T17:49:15.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:15.832 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:15.833 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:15.849 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:15.849 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:15.850 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3261/0913fb23-4ddd-4837-9eb4-f54131f87dfb/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:15.938 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:15.939 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:15.939 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125567 s, 83.5 MB/s 2020-06-12T17:49:15.940 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_6045 2020-06-12T17:49:16.058 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.054+0000 7fe3a85c9700 1 Processor -- start 2020-06-12T17:49:16.058 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.054+0000 7fe3a85c9700 1 -- start start 2020-06-12T17:49:16.076 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.055+0000 7fe3a85c9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3a0146680 0x7fe3a00ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:16.076 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.055+0000 7fe3a85c9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe3a00b2eb0 0x7fe3a009d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:16.077 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.055+0000 7fe3a85c9700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a0146d20 con 0x7fe3a009d620 2020-06-12T17:49:16.077 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.055+0000 7fe3a85c9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a0066a80 con 0x7fe3a00b2eb0 2020-06-12T17:49:16.077 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.055+0000 7fe3a85c9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a0146f50 con 0x7fe3a0146680 2020-06-12T17:49:16.077 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.055+0000 7fe3a6b66700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe3a009d620 0x7fe3a009b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39336/0 (socket says 172.21.15.38:39336) 2020-06-12T17:49:16.078 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.055+0000 7fe3a6b66700 1 -- 172.21.15.38:0/114461260 learned_addr learned my addr 172.21.15.38:0/114461260 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:16.078 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.055+0000 7fe3a5363700 1 -- 172.21.15.38:0/114461260 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3906250428 0 0) 0x7fe3a0146d20 con 0x7fe3a009d620 2020-06-12T17:49:16.078 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.055+0000 7fe3a5363700 1 -- 172.21.15.38:0/114461260 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe388003230 con 0x7fe3a009d620 2020-06-12T17:49:16.079 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.055+0000 7fe3a5b64700 1 --2- 172.21.15.38:0/114461260 >> v2:172.21.15.150:3300/0 conn(0x7fe3a00b2eb0 0x7fe3a009d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:16.079 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a6365700 1 --2- 172.21.15.38:0/114461260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3a0146680 0x7fe3a00ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:16.079 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a5363700 1 -- 172.21.15.38:0/114461260 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1997343096 0 0) 0x7fe388003230 con 0x7fe3a009d620 2020-06-12T17:49:16.079 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a5363700 1 -- 172.21.15.38:0/114461260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3a0146680 msgr2=0x7fe3a00ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:16.080 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a5363700 1 --2- 172.21.15.38:0/114461260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3a0146680 0x7fe3a00ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:16.080 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a5363700 1 -- 172.21.15.38:0/114461260 >> v2:172.21.15.150:3300/0 conn(0x7fe3a00b2eb0 msgr2=0x7fe3a009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:16.081 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a5363700 1 --2- 172.21.15.38:0/114461260 >> v2:172.21.15.150:3300/0 conn(0x7fe3a00b2eb0 0x7fe3a009d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:16.081 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a5363700 1 -- 172.21.15.38:0/114461260 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a0146a60 con 0x7fe3a009d620 2020-06-12T17:49:16.081 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a5363700 1 -- 172.21.15.38:0/114461260 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fe3980016d0 con 0x7fe3a009d620 2020-06-12T17:49:16.082 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a5363700 1 -- 172.21.15.38:0/114461260 >> v1:172.21.15.38:6789/0 conn(0x7fe3a009d620 legacy=0x7fe3a009b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:16.082 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a5363700 1 --2- 172.21.15.38:0/114461260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3a0146680 0x7fe388003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:16.082 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a5363700 1 --2- 172.21.15.38:0/114461260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe388003ba0 0x7fe388004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:16.082 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a5363700 1 --2- 172.21.15.38:0/114461260 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3880045e0 0x7fe388004a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:16.083 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a5363700 1 -- 172.21.15.38:0/114461260 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a0066a80 con 0x7fe3880045e0 2020-06-12T17:49:16.083 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a5363700 1 -- 172.21.15.38:0/114461260 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a0146f50 con 0x7fe388003ba0 2020-06-12T17:49:16.083 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a5363700 1 -- 172.21.15.38:0/114461260 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe388005090 con 0x7fe3a0146680 2020-06-12T17:49:16.083 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a6b66700 1 --2- 172.21.15.38:0/114461260 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3880045e0 0x7fe388004a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:16.083 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a6365700 1 --2- 172.21.15.38:0/114461260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3a0146680 0x7fe388003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:16.083 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a5b64700 1 --2- 172.21.15.38:0/114461260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe388003ba0 0x7fe388004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:16.084 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a6b66700 1 -- 172.21.15.38:0/114461260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3a0146680 msgr2=0x7fe388003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:16.084 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a6b66700 1 --2- 172.21.15.38:0/114461260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3a0146680 0x7fe388003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:16.084 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a6b66700 1 -- 172.21.15.38:0/114461260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe388003ba0 msgr2=0x7fe388004020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:16.084 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a6b66700 1 --2- 172.21.15.38:0/114461260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe388003ba0 0x7fe388004020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:16.084 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a6b66700 1 -- 172.21.15.38:0/114461260 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe388003230 con 0x7fe3880045e0 2020-06-12T17:49:16.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a6b66700 1 --2- 172.21.15.38:0/114461260 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3880045e0 0x7fe388004a60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe3980013e0 tx=0x7fe3a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a6b66700 1 --2- 172.21.15.38:0/114461260 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3880045e0 0x7fe388004a60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe3980013e0 tx=0x7fe3a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a6b66700 1 --2- 172.21.15.38:0/114461260 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3880045e0 0x7fe388004a60 secure :-1 s=READY pgs=449 cs=0 l=1 rx=0x7fe3980013e0 tx=0x7fe3a0146220).ready entity=mon.0 client_cookie=8c38300cc8d6a47c server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:16.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a6b66700 1 --2- 172.21.15.38:0/114461260 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3880045e0 0x7fe388004a60 secure :-1 s=THROTTLE_DONE pgs=449 cs=0 l=1 rx=0x7fe3980013e0 tx=0x7fe3a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a6b66700 1 --2- 172.21.15.38:0/114461260 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3880045e0 0x7fe388004a60 secure :-1 s=THROTTLE_DONE pgs=449 cs=0 l=1 rx=0x7fe3980013e0 tx=0x7fe3a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.086 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a5363700 1 -- 172.21.15.38:0/114461260 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe39800e160 con 0x7fe3880045e0 2020-06-12T17:49:16.086 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a6b66700 1 --2- 172.21.15.38:0/114461260 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3880045e0 0x7fe388004a60 secure :-1 s=THROTTLE_DONE pgs=449 cs=0 l=1 rx=0x7fe3980013e0 tx=0x7fe3a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.086 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a5363700 1 -- 172.21.15.38:0/114461260 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39800e2c0 con 0x7fe3880045e0 2020-06-12T17:49:16.086 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a5363700 1 -- 172.21.15.38:0/114461260 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe39800e6e0 con 0x7fe3880045e0 2020-06-12T17:49:16.086 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a85c9700 1 -- 172.21.15.38:0/114461260 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3880045e0 msgr2=0x7fe388004a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:16.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a85c9700 1 --2- 172.21.15.38:0/114461260 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3880045e0 0x7fe388004a60 secure :-1 s=READY pgs=449 cs=0 l=1 rx=0x7fe3980013e0 tx=0x7fe3a0146220).stop 2020-06-12T17:49:16.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.056+0000 7fe3a6b66700 1 -- 172.21.15.38:0/114461260 reap_dead start 2020-06-12T17:49:16.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.057+0000 7fe3a85c9700 1 -- 172.21.15.38:0/114461260 shutdown_connections 2020-06-12T17:49:16.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.057+0000 7fe3a85c9700 1 -- 172.21.15.38:0/114461260 >> 172.21.15.38:0/114461260 conn(0x7fe3a00b5a20 msgr2=0x7fe3a005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:16.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.057+0000 7fe3a85c9700 1 -- 172.21.15.38:0/114461260 shutdown_connections 2020-06-12T17:49:16.088 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.057+0000 7fe3a85c9700 1 -- 172.21.15.38:0/114461260 wait complete. 2020-06-12T17:49:16.088 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.058+0000 7fe3a85c9700 1 Processor -- start 2020-06-12T17:49:16.088 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.058+0000 7fe3a85c9700 1 -- start start 2020-06-12T17:49:16.088 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.059+0000 7fe3a85c9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3a012d540 0x7fe3a012d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:16.088 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.059+0000 7fe3a85c9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe3a01395b0 0x7fe3a0139a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:16.089 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.059+0000 7fe3a85c9700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a00aec00 con 0x7fe3a00b7a60 2020-06-12T17:49:16.089 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.059+0000 7fe3a85c9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a00aee30 con 0x7fe3a01395b0 2020-06-12T17:49:16.089 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.059+0000 7fe3a85c9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a00af0d0 con 0x7fe3a012d540 2020-06-12T17:49:16.089 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.059+0000 7fe3a6365700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe3a00b7a60 0x7fe3a00b0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39346/0 (socket says 172.21.15.38:39346) 2020-06-12T17:49:16.089 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.059+0000 7fe3a6365700 1 -- 172.21.15.38:0/1240559107 learned_addr learned my addr 172.21.15.38:0/1240559107 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:16.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.059+0000 7fe3a6b66700 1 --2- 172.21.15.38:0/1240559107 >> v2:172.21.15.150:3300/0 conn(0x7fe3a01395b0 0x7fe3a0139a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:16.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.059+0000 7fe3a5b64700 1 --2- 172.21.15.38:0/1240559107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3a012d540 0x7fe3a012d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:16.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.059+0000 7fe38f7fe700 1 -- 172.21.15.38:0/1240559107 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602460691 0 0) 0x7fe3a00aec00 con 0x7fe3a00b7a60 2020-06-12T17:49:16.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.059+0000 7fe38f7fe700 1 -- 172.21.15.38:0/1240559107 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe380002fe0 con 0x7fe3a00b7a60 2020-06-12T17:49:16.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.059+0000 7fe3a6b66700 1 -- 172.21.15.38:0/1240559107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3a012d540 msgr2=0x7fe3a012d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:16.091 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.059+0000 7fe3a6b66700 1 --2- 172.21.15.38:0/1240559107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3a012d540 0x7fe3a012d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:16.091 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.059+0000 7fe3a6b66700 1 -- 172.21.15.38:0/1240559107 >> v1:172.21.15.38:6789/0 conn(0x7fe3a00b7a60 legacy=0x7fe3a00b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:16.091 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.059+0000 7fe3a6b66700 1 -- 172.21.15.38:0/1240559107 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a00b1490 con 0x7fe3a01395b0 2020-06-12T17:49:16.091 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.059+0000 7fe3a5b64700 1 --2- 172.21.15.38:0/1240559107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3a012d540 0x7fe3a012d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:49:16.092 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.059+0000 7fe3a6b66700 1 --2- 172.21.15.38:0/1240559107 >> v2:172.21.15.150:3300/0 conn(0x7fe3a01395b0 0x7fe3a0139a40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe3a01472d0 tx=0x7fe3a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.092 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.059+0000 7fe3a6b66700 1 --2- 172.21.15.38:0/1240559107 >> v2:172.21.15.150:3300/0 conn(0x7fe3a01395b0 0x7fe3a0139a40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe3a01472d0 tx=0x7fe3a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.092 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.059+0000 7fe3a6b66700 1 --2- 172.21.15.38:0/1240559107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3a01395b0 0x7fe3a0139a40 secure :-1 s=READY pgs=275 cs=0 l=1 rx=0x7fe3a01472d0 tx=0x7fe3a0146220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:16.092 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.059+0000 7fe3a6b66700 1 --2- 172.21.15.38:0/1240559107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3a01395b0 0x7fe3a0139a40 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7fe3a01472d0 tx=0x7fe3a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.093 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.059+0000 7fe38f7fe700 1 -- 172.21.15.38:0/1240559107 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe398010d30 con 0x7fe3a01395b0 2020-06-12T17:49:16.093 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.060+0000 7fe3a6b66700 1 --2- 172.21.15.38:0/1240559107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3a01395b0 0x7fe3a0139a40 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7fe3a01472d0 tx=0x7fe3a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.093 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.060+0000 7fe3a85c9700 1 -- 172.21.15.38:0/1240559107 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a00af370 con 0x7fe3a01395b0 2020-06-12T17:49:16.093 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.060+0000 7fe38f7fe700 1 -- 172.21.15.38:0/1240559107 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe398010e90 con 0x7fe3a01395b0 2020-06-12T17:49:16.093 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.060+0000 7fe3a6b66700 1 --2- 172.21.15.38:0/1240559107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3a01395b0 0x7fe3a0139a40 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7fe3a01472d0 tx=0x7fe3a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.094 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.060+0000 7fe38f7fe700 1 -- 172.21.15.38:0/1240559107 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3980102a0 con 0x7fe3a01395b0 2020-06-12T17:49:16.094 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.060+0000 7fe3a85c9700 1 -- 172.21.15.38:0/1240559107 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a012de00 con 0x7fe3a01395b0 2020-06-12T17:49:16.094 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.060+0000 7fe3a6b66700 1 --2- 172.21.15.38:0/1240559107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3a01395b0 0x7fe3a0139a40 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7fe3a01472d0 tx=0x7fe3a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.095 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.061+0000 7fe3a85c9700 1 -- 172.21.15.38:0/1240559107 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a0056c30 con 0x7fe3a01395b0 2020-06-12T17:49:16.095 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.061+0000 7fe38f7fe700 1 -- 172.21.15.38:0/1240559107 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fe398010400 con 0x7fe3a01395b0 2020-06-12T17:49:16.095 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.061+0000 7fe3a6b66700 1 --2- 172.21.15.38:0/1240559107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3a01395b0 0x7fe3a0139a40 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7fe3a01472d0 tx=0x7fe3a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.096 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.061+0000 7fe38f7fe700 1 --2- 172.21.15.38:0/1240559107 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe38004d930 0x7fe38004fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:16.096 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.061+0000 7fe38f7fe700 1 -- 172.21.15.38:0/1240559107 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe398060d70 con 0x7fe3a01395b0 2020-06-12T17:49:16.096 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.061+0000 7fe3a6365700 1 --2- 172.21.15.38:0/1240559107 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe38004d930 0x7fe38004fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:16.096 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.061+0000 7fe3a6365700 1 --2- 172.21.15.38:0/1240559107 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe38004d930 0x7fe38004fdf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe390002f30 tx=0x7fe390007e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.097 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.061+0000 7fe3a6365700 1 --2- 172.21.15.38:0/1240559107 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe38004d930 0x7fe38004fdf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe390002f30 tx=0x7fe390007e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.097 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.061+0000 7fe3a6365700 1 --2- 172.21.15.38:0/1240559107 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe38004d930 0x7fe38004fdf0 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7fe390002f30 tx=0x7fe390007e90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:16.097 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.065+0000 7fe3a6b66700 1 --2- 172.21.15.38:0/1240559107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3a01395b0 0x7fe3a0139a40 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7fe3a01472d0 tx=0x7fe3a0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.097 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.065+0000 7fe38f7fe700 1 -- 172.21.15.38:0/1240559107 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fe39803c590 con 0x7fe3a01395b0 2020-06-12T17:49:16.261 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.257+0000 7fe3a85c9700 1 -- 172.21.15.38:0/1240559107 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_6045", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3a00af500 con 0x7fe38004d930 2020-06-12T17:49:16.279 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.276+0000 7fe3a6365700 1 --2- 172.21.15.38:0/1240559107 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe38004d930 0x7fe38004fdf0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7fe390002f30 tx=0x7fe390007e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.280 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.276+0000 7fe38f7fe700 1 -- 172.21.15.38:0/1240559107 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe390007330 con 0x7fe38004d930 2020-06-12T17:49:16.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.277+0000 7fe3a85c9700 1 -- 172.21.15.38:0/1240559107 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe38004d930 msgr2=0x7fe38004fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:16.282 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.277+0000 7fe3a85c9700 1 --2- 172.21.15.38:0/1240559107 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe38004d930 0x7fe38004fdf0 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7fe390002f30 tx=0x7fe390007e90).stop 2020-06-12T17:49:16.282 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.277+0000 7fe3a85c9700 1 -- 172.21.15.38:0/1240559107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3a01395b0 msgr2=0x7fe3a0139a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:16.282 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.277+0000 7fe3a85c9700 1 --2- 172.21.15.38:0/1240559107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3a01395b0 0x7fe3a0139a40 secure :-1 s=READY pgs=275 cs=0 l=1 rx=0x7fe3a01472d0 tx=0x7fe3a0146220).stop 2020-06-12T17:49:16.282 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.277+0000 7fe3a85c9700 1 -- 172.21.15.38:0/1240559107 shutdown_connections 2020-06-12T17:49:16.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.277+0000 7fe3a85c9700 1 --2- 172.21.15.38:0/1240559107 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe38004d930 0x7fe38004fdf0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:16.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.277+0000 7fe3a85c9700 1 --2- 172.21.15.38:0/1240559107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3a01395b0 0x7fe3a0139a40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:16.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.277+0000 7fe3a85c9700 1 --2- 172.21.15.38:0/1240559107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3a012d540 0x7fe3a012d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:16.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.277+0000 7fe3a85c9700 1 -- 172.21.15.38:0/1240559107 >> 172.21.15.38:0/1240559107 conn(0x7fe3a00b5a20 msgr2=0x7fe3a00b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:16.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.277+0000 7fe3a85c9700 1 -- 172.21.15.38:0/1240559107 shutdown_connections 2020-06-12T17:49:16.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.277+0000 7fe3a85c9700 1 -- 172.21.15.38:0/1240559107 wait complete. 2020-06-12T17:49:16.291 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_6045 2020-06-12T17:49:16.408 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.404+0000 7fead8c8d700 1 Processor -- start 2020-06-12T17:49:16.408 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.404+0000 7fead8c8d700 1 -- start start 2020-06-12T17:49:16.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.405+0000 7fead8c8d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fead405b5e0 0x7fead40b9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:16.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.405+0000 7fead8c8d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fead405b9c0 0x7fead40b73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:16.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.405+0000 7fead8c8d700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead414a100 con 0x7fead40b7cf0 2020-06-12T17:49:16.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.405+0000 7fead8c8d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead414a3a0 con 0x7fead405b9c0 2020-06-12T17:49:16.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.405+0000 7fead8c8d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead409db70 con 0x7fead405b5e0 2020-06-12T17:49:16.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.405+0000 7fead2d9d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fead40b7cf0 0x7fead41461a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39354/0 (socket says 172.21.15.38:39354) 2020-06-12T17:49:16.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.405+0000 7fead2d9d700 1 -- 172.21.15.38:0/3847075054 learned_addr learned my addr 172.21.15.38:0/3847075054 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:16.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.406+0000 7fead259c700 1 --2- 172.21.15.38:0/3847075054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fead405b5e0 0x7fead40b9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:16.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.406+0000 7fead1d9b700 1 --2- 172.21.15.38:0/3847075054 >> v2:172.21.15.150:3300/0 conn(0x7fead405b9c0 0x7fead40b73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:16.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.406+0000 7fead159a700 1 -- 172.21.15.38:0/3847075054 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 859200355 0 0) 0x7fead414a100 con 0x7fead40b7cf0 2020-06-12T17:49:16.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.406+0000 7fead159a700 1 -- 172.21.15.38:0/3847075054 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feab4003230 con 0x7fead40b7cf0 2020-06-12T17:49:16.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.406+0000 7fead159a700 1 -- 172.21.15.38:0/3847075054 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 203602774 0 0) 0x7feab4003230 con 0x7fead40b7cf0 2020-06-12T17:49:16.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.406+0000 7fead159a700 1 -- 172.21.15.38:0/3847075054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fead405b5e0 msgr2=0x7fead40b9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:16.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.406+0000 7fead159a700 1 --2- 172.21.15.38:0/3847075054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fead405b5e0 0x7fead40b9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:16.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.406+0000 7fead159a700 1 -- 172.21.15.38:0/3847075054 >> v2:172.21.15.150:3300/0 conn(0x7fead405b9c0 msgr2=0x7fead40b73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:16.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.406+0000 7fead159a700 1 --2- 172.21.15.38:0/3847075054 >> v2:172.21.15.150:3300/0 conn(0x7fead405b9c0 0x7fead40b73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:16.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.406+0000 7fead159a700 1 -- 172.21.15.38:0/3847075054 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead409dce0 con 0x7fead40b7cf0 2020-06-12T17:49:16.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.406+0000 7fead159a700 1 -- 172.21.15.38:0/3847075054 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7feacc0016d0 con 0x7fead40b7cf0 2020-06-12T17:49:16.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.406+0000 7fead159a700 1 -- 172.21.15.38:0/3847075054 >> v1:172.21.15.38:6789/0 conn(0x7fead40b7cf0 legacy=0x7fead41461a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:16.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.406+0000 7fead159a700 1 --2- 172.21.15.38:0/3847075054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab4003720 0x7feab4003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:16.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.406+0000 7fead159a700 1 --2- 172.21.15.38:0/3847075054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fead405b5e0 0x7feab40044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:16.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.406+0000 7fead159a700 1 --2- 172.21.15.38:0/3847075054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feab4004930 0x7feab4004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:16.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.406+0000 7fead159a700 1 -- 172.21.15.38:0/3847075054 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead414a3a0 con 0x7feab4004930 2020-06-12T17:49:16.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.406+0000 7fead159a700 1 -- 172.21.15.38:0/3847075054 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead409db70 con 0x7feab4003720 2020-06-12T17:49:16.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.406+0000 7fead159a700 1 -- 172.21.15.38:0/3847075054 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab4005380 con 0x7fead405b5e0 2020-06-12T17:49:16.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.406+0000 7fead2d9d700 1 --2- 172.21.15.38:0/3847075054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feab4004930 0x7feab4004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:16.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.406+0000 7fead259c700 1 --2- 172.21.15.38:0/3847075054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab4003720 0x7feab4003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:16.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.406+0000 7fead1d9b700 1 --2- 172.21.15.38:0/3847075054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fead405b5e0 0x7feab40044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:16.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.406+0000 7fead2d9d700 1 -- 172.21.15.38:0/3847075054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fead405b5e0 msgr2=0x7feab40044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:16.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.406+0000 7fead2d9d700 1 --2- 172.21.15.38:0/3847075054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fead405b5e0 0x7feab40044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:16.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.406+0000 7fead2d9d700 1 -- 172.21.15.38:0/3847075054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab4003720 msgr2=0x7feab4003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:16.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.406+0000 7fead2d9d700 1 --2- 172.21.15.38:0/3847075054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab4003720 0x7feab4003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:16.435 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.406+0000 7fead2d9d700 1 -- 172.21.15.38:0/3847075054 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab4003230 con 0x7feab4004930 2020-06-12T17:49:16.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.407+0000 7fead2d9d700 1 --2- 172.21.15.38:0/3847075054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feab4004930 0x7feab4004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7feacc0013e0 tx=0x7fead40b8db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.407+0000 7fead2d9d700 1 --2- 172.21.15.38:0/3847075054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feab4004930 0x7feab4004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7feacc0013e0 tx=0x7fead40b8db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.407+0000 7fead2d9d700 1 --2- 172.21.15.38:0/3847075054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feab4004930 0x7feab4004db0 secure :-1 s=READY pgs=452 cs=0 l=1 rx=0x7feacc0013e0 tx=0x7fead40b8db0).ready entity=mon.0 client_cookie=a6aba617039e7fcd server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:16.437 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.407+0000 7fead2d9d700 1 --2- 172.21.15.38:0/3847075054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feab4004930 0x7feab4004db0 secure :-1 s=THROTTLE_DONE pgs=452 cs=0 l=1 rx=0x7feacc0013e0 tx=0x7fead40b8db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.437 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.407+0000 7fead159a700 1 -- 172.21.15.38:0/3847075054 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feacc010dc0 con 0x7feab4004930 2020-06-12T17:49:16.437 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.407+0000 7fead2d9d700 1 --2- 172.21.15.38:0/3847075054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feab4004930 0x7feab4004db0 secure :-1 s=THROTTLE_DONE pgs=452 cs=0 l=1 rx=0x7feacc0013e0 tx=0x7fead40b8db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.407+0000 7fead2d9d700 1 --2- 172.21.15.38:0/3847075054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feab4004930 0x7feab4004db0 secure :-1 s=THROTTLE_DONE pgs=452 cs=0 l=1 rx=0x7feacc0013e0 tx=0x7fead40b8db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.407+0000 7fead159a700 1 -- 172.21.15.38:0/3847075054 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feacc0055e0 con 0x7feab4004930 2020-06-12T17:49:16.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.407+0000 7fead159a700 1 -- 172.21.15.38:0/3847075054 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feacc005a00 con 0x7feab4004930 2020-06-12T17:49:16.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.407+0000 7fead8c8d700 1 -- 172.21.15.38:0/3847075054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feab4004930 msgr2=0x7feab4004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:16.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.407+0000 7fead8c8d700 1 --2- 172.21.15.38:0/3847075054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feab4004930 0x7feab4004db0 secure :-1 s=READY pgs=452 cs=0 l=1 rx=0x7feacc0013e0 tx=0x7fead40b8db0).stop 2020-06-12T17:49:16.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.407+0000 7fead2d9d700 1 -- 172.21.15.38:0/3847075054 reap_dead start 2020-06-12T17:49:16.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.407+0000 7fead8c8d700 1 -- 172.21.15.38:0/3847075054 shutdown_connections 2020-06-12T17:49:16.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.407+0000 7fead8c8d700 1 -- 172.21.15.38:0/3847075054 >> 172.21.15.38:0/3847075054 conn(0x7fead40b94a0 msgr2=0x7fead40b98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:16.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.407+0000 7fead8c8d700 1 -- 172.21.15.38:0/3847075054 shutdown_connections 2020-06-12T17:49:16.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.407+0000 7fead8c8d700 1 -- 172.21.15.38:0/3847075054 wait complete. 2020-06-12T17:49:16.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.408+0000 7fead8c8d700 1 Processor -- start 2020-06-12T17:49:16.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.408+0000 7fead8c8d700 1 -- start start 2020-06-12T17:49:16.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.409+0000 7fead8c8d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fead40b29e0 0x7fead40b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:16.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.409+0000 7fead8c8d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fead4153630 0x7fead413f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:16.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.409+0000 7fead8c8d700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead40b11e0 con 0x7fead413f9e0 2020-06-12T17:49:16.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.409+0000 7fead8c8d700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead40b3210 con 0x7fead40b29e0 2020-06-12T17:49:16.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.409+0000 7fead8c8d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead40b34b0 con 0x7fead4153630 2020-06-12T17:49:16.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.409+0000 7fead259c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fead40b29e0 0x7fead40b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:16.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.409+0000 7fead259c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fead40b29e0 0x7fead40b0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37550/0 (socket says 172.21.15.38:37550) 2020-06-12T17:49:16.444 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.409+0000 7fead259c700 1 -- 172.21.15.38:0/2903537531 learned_addr learned my addr 172.21.15.38:0/2903537531 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:16.444 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.409+0000 7fead2d9d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fead413f9e0 0x7fead4144660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39370/0 (socket says 172.21.15.38:39370) 2020-06-12T17:49:16.444 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.409+0000 7fead1d9b700 1 --2- 172.21.15.38:0/2903537531 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fead4153630 0x7fead413f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:16.445 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.409+0000 7fead259c700 1 -- 172.21.15.38:0/2903537531 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fead4153630 msgr2=0x7fead413f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:16.445 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.409+0000 7fead259c700 1 --2- 172.21.15.38:0/2903537531 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fead4153630 0x7fead413f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:16.445 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.409+0000 7fead259c700 1 -- 172.21.15.38:0/2903537531 >> v1:172.21.15.38:6789/0 conn(0x7fead413f9e0 legacy=0x7fead4144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:16.446 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.409+0000 7feacb7fe700 1 -- 172.21.15.38:0/2903537531 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477513885 0 0) 0x7feab4003230 con 0x7fead413f9e0 2020-06-12T17:49:16.446 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.409+0000 7fead259c700 1 -- 172.21.15.38:0/2903537531 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead413fe40 con 0x7fead40b29e0 2020-06-12T17:49:16.446 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.409+0000 7fead259c700 1 --2- 172.21.15.38:0/2903537531 >> v2:172.21.15.38:3300/0 conn(0x7fead40b29e0 0x7fead40b0d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feabc003070 tx=0x7feabc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.446 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.409+0000 7fead259c700 1 --2- 172.21.15.38:0/2903537531 >> v2:172.21.15.38:3300/0 conn(0x7fead40b29e0 0x7fead40b0d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feabc003070 tx=0x7feabc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.446 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.410+0000 7fead259c700 1 --2- 172.21.15.38:0/2903537531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead40b29e0 0x7fead40b0d80 secure :-1 s=READY pgs=454 cs=0 l=1 rx=0x7feabc003070 tx=0x7feabc007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:16.447 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.410+0000 7fead259c700 1 --2- 172.21.15.38:0/2903537531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead40b29e0 0x7fead40b0d80 secure :-1 s=THROTTLE_DONE pgs=454 cs=0 l=1 rx=0x7feabc003070 tx=0x7feabc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.447 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.410+0000 7feacb7fe700 1 -- 172.21.15.38:0/2903537531 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feabc005e90 con 0x7fead40b29e0 2020-06-12T17:49:16.447 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.410+0000 7fead259c700 1 --2- 172.21.15.38:0/2903537531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead40b29e0 0x7fead40b0d80 secure :-1 s=THROTTLE_DONE pgs=454 cs=0 l=1 rx=0x7feabc003070 tx=0x7feabc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.447 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.410+0000 7fead259c700 1 --2- 172.21.15.38:0/2903537531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead40b29e0 0x7fead40b0d80 secure :-1 s=THROTTLE_DONE pgs=454 cs=0 l=1 rx=0x7feabc003070 tx=0x7feabc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.447 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.410+0000 7feacb7fe700 1 -- 172.21.15.38:0/2903537531 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feabc007fa0 con 0x7fead40b29e0 2020-06-12T17:49:16.448 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.410+0000 7fead8c8d700 1 -- 172.21.15.38:0/2903537531 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead40b2dc0 con 0x7fead40b29e0 2020-06-12T17:49:16.448 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.410+0000 7feacb7fe700 1 -- 172.21.15.38:0/2903537531 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feabc007390 con 0x7fead40b29e0 2020-06-12T17:49:16.448 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.410+0000 7fead8c8d700 1 -- 172.21.15.38:0/2903537531 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead40b0170 con 0x7fead40b29e0 2020-06-12T17:49:16.448 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.410+0000 7fead259c700 1 --2- 172.21.15.38:0/2903537531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead40b29e0 0x7fead40b0d80 secure :-1 s=THROTTLE_DONE pgs=454 cs=0 l=1 rx=0x7feabc003070 tx=0x7feabc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.448 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.411+0000 7feacb7fe700 1 -- 172.21.15.38:0/2903537531 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7feabc009480 con 0x7fead40b29e0 2020-06-12T17:49:16.449 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.411+0000 7fead8c8d700 1 -- 172.21.15.38:0/2903537531 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead4056c30 con 0x7fead40b29e0 2020-06-12T17:49:16.449 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.411+0000 7fead259c700 1 --2- 172.21.15.38:0/2903537531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead40b29e0 0x7fead40b0d80 secure :-1 s=THROTTLE_DONE pgs=454 cs=0 l=1 rx=0x7feabc003070 tx=0x7feabc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.449 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.411+0000 7feacb7fe700 1 --2- 172.21.15.38:0/2903537531 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7feab804d580 0x7feab804fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:16.449 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.411+0000 7feacb7fe700 1 -- 172.21.15.38:0/2903537531 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7feabc061140 con 0x7fead40b29e0 2020-06-12T17:49:16.450 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.411+0000 7fead1d9b700 1 --2- 172.21.15.38:0/2903537531 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7feab804d580 0x7feab804fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:16.450 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.412+0000 7fead1d9b700 1 --2- 172.21.15.38:0/2903537531 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7feab804d580 0x7feab804fa40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feac40032b0 tx=0x7feac40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.450 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.412+0000 7fead1d9b700 1 --2- 172.21.15.38:0/2903537531 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7feab804d580 0x7feab804fa40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feac40032b0 tx=0x7feac40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.450 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.412+0000 7fead1d9b700 1 --2- 172.21.15.38:0/2903537531 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7feab804d580 0x7feab804fa40 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7feac40032b0 tx=0x7feac40081e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:16.450 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.414+0000 7fead259c700 1 --2- 172.21.15.38:0/2903537531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead40b29e0 0x7fead40b0d80 secure :-1 s=THROTTLE_DONE pgs=454 cs=0 l=1 rx=0x7feabc003070 tx=0x7feabc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.451 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.414+0000 7feacb7fe700 1 -- 172.21.15.38:0/2903537531 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7feabc03c8c0 con 0x7fead40b29e0 2020-06-12T17:49:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.608+0000 7fead8c8d700 1 -- 172.21.15.38:0/2903537531 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_6045", "target": ["mon-mgr", ""]}) v1 -- 0x7fead41443c0 con 0x7feab804d580 2020-06-12T17:49:16.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.612+0000 7fead1d9b700 1 --2- 172.21.15.38:0/2903537531 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7feab804d580 0x7feab804fa40 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7feac40032b0 tx=0x7feac40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:16.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.612+0000 7feacb7fe700 1 -- 172.21.15.38:0/2903537531 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7feac4005a40 con 0x7feab804d580 2020-06-12T17:49:16.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.613+0000 7fead8c8d700 1 -- 172.21.15.38:0/2903537531 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7feab804d580 msgr2=0x7feab804fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:16.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.613+0000 7fead8c8d700 1 --2- 172.21.15.38:0/2903537531 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7feab804d580 0x7feab804fa40 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7feac40032b0 tx=0x7feac40081e0).stop 2020-06-12T17:49:16.623 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.613+0000 7fead8c8d700 1 -- 172.21.15.38:0/2903537531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead40b29e0 msgr2=0x7fead40b0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:16.623 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.613+0000 7fead8c8d700 1 --2- 172.21.15.38:0/2903537531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead40b29e0 0x7fead40b0d80 secure :-1 s=READY pgs=454 cs=0 l=1 rx=0x7feabc003070 tx=0x7feabc007e60).stop 2020-06-12T17:49:16.624 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.613+0000 7fead8c8d700 1 -- 172.21.15.38:0/2903537531 shutdown_connections 2020-06-12T17:49:16.624 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.613+0000 7fead8c8d700 1 --2- 172.21.15.38:0/2903537531 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7feab804d580 0x7feab804fa40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:16.624 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.613+0000 7fead8c8d700 1 --2- 172.21.15.38:0/2903537531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead40b29e0 0x7fead40b0d80 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:16.625 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.613+0000 7fead8c8d700 1 --2- 172.21.15.38:0/2903537531 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fead4153630 0x7fead413f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:16.625 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.613+0000 7fead8c8d700 1 -- 172.21.15.38:0/2903537531 >> 172.21.15.38:0/2903537531 conn(0x7fead40b94a0 msgr2=0x7fead40b74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:16.625 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.613+0000 7fead8c8d700 1 -- 172.21.15.38:0/2903537531 shutdown_connections 2020-06-12T17:49:16.626 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:16.613+0000 7fead8c8d700 1 -- 172.21.15.38:0/2903537531 wait complete. 2020-06-12T17:49:16.626 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_6045/86ca183f-1556-474f-8a95-c0a14b264eba 2020-06-12T17:49:16.628 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_6045 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_6045/86ca183f-1556-474f-8a95-c0a14b264eba 2020-06-12T17:49:16.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:16.629 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:16.633 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:16.649 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:16.650 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:16.651 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6045/86ca183f-1556-474f-8a95-c0a14b264eba/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:16.738 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:16.738 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:16.738 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965061 s, 109 MB/s 2020-06-12T17:49:16.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:16.740 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:16.740 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:16.756 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:16.757 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:16.757 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6045/86ca183f-1556-474f-8a95-c0a14b264eba/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:16.845 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:16.845 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:16.846 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116527 s, 90.0 MB/s 2020-06-12T17:49:16.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:16.847 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:16.848 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:16.862 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:16.863 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:16.864 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6045/86ca183f-1556-474f-8a95-c0a14b264eba/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:16.953 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:16.953 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:16.953 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013309 s, 78.8 MB/s 2020-06-12T17:49:16.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:16.955 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:16.955 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:16.970 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:16.970 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:16.971 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6045/86ca183f-1556-474f-8a95-c0a14b264eba/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:17.058 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:17.059 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:17.059 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117091 s, 89.6 MB/s 2020-06-12T17:49:17.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:17.060 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:17.061 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:17.075 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:17.076 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:17.077 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6045/86ca183f-1556-474f-8a95-c0a14b264eba/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:17.164 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:17.164 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:17.165 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120754 s, 86.8 MB/s 2020-06-12T17:49:17.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:17.166 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:17.167 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:17.181 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:17.182 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:17.183 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6045/86ca183f-1556-474f-8a95-c0a14b264eba/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:17.271 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:17.271 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:17.271 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116859 s, 89.7 MB/s 2020-06-12T17:49:17.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:17.273 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:17.273 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:17.288 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:17.289 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:17.289 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6045/86ca183f-1556-474f-8a95-c0a14b264eba/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:17.376 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:17.377 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:17.377 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107776 s, 97.3 MB/s 2020-06-12T17:49:17.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:17.379 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:17.379 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:17.393 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:17.394 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:17.395 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6045/86ca183f-1556-474f-8a95-c0a14b264eba/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:17.487 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:17.487 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:17.487 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125886 s, 83.3 MB/s 2020-06-12T17:49:17.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:17.490 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:17.491 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:17.506 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:17.506 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:17.507 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6045/86ca183f-1556-474f-8a95-c0a14b264eba/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:17.530 INFO:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-06-12T17:49:17.549 INFO:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-06-12T17:49:17.595 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:17.595 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:17.595 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108734 s, 96.4 MB/s 2020-06-12T17:49:17.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:17.597 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:17.597 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:17.651 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:17.651 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:17.652 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6045/86ca183f-1556-474f-8a95-c0a14b264eba/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:17.740 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:17.741 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:17.741 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116899 s, 89.7 MB/s 2020-06-12T17:49:17.742 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_520 2020-06-12T17:49:17.859 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.855+0000 7fc2bea98700 1 Processor -- start 2020-06-12T17:49:17.859 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.855+0000 7fc2bea98700 1 -- start start 2020-06-12T17:49:17.866 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.856+0000 7fc2bea98700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2b80b2eb0 0x7fc2b814d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:17.866 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.856+0000 7fc2bea98700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b8146d20 con 0x7fc2b80ad5b0 2020-06-12T17:49:17.867 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.856+0000 7fc2bea98700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b8066a80 con 0x7fc2b8146680 2020-06-12T17:49:17.867 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.856+0000 7fc2bea98700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b8146f50 con 0x7fc2b80b2eb0 2020-06-12T17:49:17.867 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.856+0000 7fc2b7fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc2b80ad5b0 0x7fc2b809d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39374/0 (socket says 172.21.15.38:39374) 2020-06-12T17:49:17.867 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.856+0000 7fc2b7fff700 1 -- 172.21.15.38:0/1625572328 learned_addr learned my addr 172.21.15.38:0/1625572328 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:17.868 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.856+0000 7fc2bd035700 1 --2- 172.21.15.38:0/1625572328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2b80b2eb0 0x7fc2b814d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:17.868 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.856+0000 7fc2b77fe700 1 -- 172.21.15.38:0/1625572328 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1040457437 0 0) 0x7fc2b8146d20 con 0x7fc2b80ad5b0 2020-06-12T17:49:17.868 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.856+0000 7fc2b77fe700 1 -- 172.21.15.38:0/1625572328 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2a4003230 con 0x7fc2b80ad5b0 2020-06-12T17:49:17.868 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.857+0000 7fc2b77fe700 1 -- 172.21.15.38:0/1625572328 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2964971379 0 0) 0x7fc2a4003230 con 0x7fc2b80ad5b0 2020-06-12T17:49:17.868 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.857+0000 7fc2b77fe700 1 -- 172.21.15.38:0/1625572328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2b80b2eb0 msgr2=0x7fc2b814d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:17.868 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.857+0000 7fc2b77fe700 1 --2- 172.21.15.38:0/1625572328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2b80b2eb0 0x7fc2b814d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:17.869 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.857+0000 7fc2b77fe700 1 -- 172.21.15.38:0/1625572328 >> v1:172.21.15.150:6789/0 conn(0x7fc2b8146680 legacy=0x7fc2b809d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:17.869 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.857+0000 7fc2b77fe700 1 -- 172.21.15.38:0/1625572328 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b8146a60 con 0x7fc2b80ad5b0 2020-06-12T17:49:17.869 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.857+0000 7fc2b77fe700 1 -- 172.21.15.38:0/1625572328 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fc2ac0016d0 con 0x7fc2b80ad5b0 2020-06-12T17:49:17.869 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.857+0000 7fc2b77fe700 1 -- 172.21.15.38:0/1625572328 >> v1:172.21.15.38:6789/0 conn(0x7fc2b80ad5b0 legacy=0x7fc2b809d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:17.869 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.857+0000 7fc2b77fe700 1 --2- 172.21.15.38:0/1625572328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2b80b2eb0 0x7fc2a4003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:17.870 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.857+0000 7fc2b77fe700 1 --2- 172.21.15.38:0/1625572328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2a4003bb0 0x7fc2a4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:17.870 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.857+0000 7fc2b77fe700 1 --2- 172.21.15.38:0/1625572328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2a4004590 0x7fc2a4004a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:17.870 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.857+0000 7fc2b77fe700 1 -- 172.21.15.38:0/1625572328 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b8146f50 con 0x7fc2a4003bb0 2020-06-12T17:49:17.870 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.857+0000 7fc2b77fe700 1 -- 172.21.15.38:0/1625572328 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a4004fc0 con 0x7fc2a4004590 2020-06-12T17:49:17.870 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.857+0000 7fc2b77fe700 1 -- 172.21.15.38:0/1625572328 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a4005180 con 0x7fc2b80b2eb0 2020-06-12T17:49:17.871 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.857+0000 7fc2b7fff700 1 --2- 172.21.15.38:0/1625572328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2a4003bb0 0x7fc2a4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:17.871 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.857+0000 7fc2bc834700 1 --2- 172.21.15.38:0/1625572328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2b80b2eb0 0x7fc2a4003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:17.871 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.857+0000 7fc2bd035700 1 --2- 172.21.15.38:0/1625572328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2a4004590 0x7fc2a4004a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:17.871 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.857+0000 7fc2b7fff700 1 -- 172.21.15.38:0/1625572328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2b80b2eb0 msgr2=0x7fc2a4003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:17.871 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.857+0000 7fc2b7fff700 1 --2- 172.21.15.38:0/1625572328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2b80b2eb0 0x7fc2a4003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:17.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.857+0000 7fc2b7fff700 1 -- 172.21.15.38:0/1625572328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2a4004590 msgr2=0x7fc2a4004a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:17.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.857+0000 7fc2b7fff700 1 --2- 172.21.15.38:0/1625572328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2a4004590 0x7fc2a4004a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:17.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.857+0000 7fc2b7fff700 1 -- 172.21.15.38:0/1625572328 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a4003230 con 0x7fc2a4003bb0 2020-06-12T17:49:17.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.857+0000 7fc2b7fff700 1 --2- 172.21.15.38:0/1625572328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2a4003bb0 0x7fc2a4004010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc2ac0013e0 tx=0x7fc2b8146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:17.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.857+0000 7fc2b7fff700 1 --2- 172.21.15.38:0/1625572328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2a4003bb0 0x7fc2a4004010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc2ac0013e0 tx=0x7fc2b8146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:17.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.857+0000 7fc2b7fff700 1 --2- 172.21.15.38:0/1625572328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2a4003bb0 0x7fc2a4004010 secure :-1 s=READY pgs=456 cs=0 l=1 rx=0x7fc2ac0013e0 tx=0x7fc2b8146220).ready entity=mon.0 client_cookie=2ddb05abd5375a0e server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:17.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.857+0000 7fc2b7fff700 1 --2- 172.21.15.38:0/1625572328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2a4003bb0 0x7fc2a4004010 secure :-1 s=THROTTLE_DONE pgs=456 cs=0 l=1 rx=0x7fc2ac0013e0 tx=0x7fc2b8146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:17.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.858+0000 7fc2b77fe700 1 -- 172.21.15.38:0/1625572328 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2ac00ca80 con 0x7fc2a4003bb0 2020-06-12T17:49:17.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.858+0000 7fc2b7fff700 1 --2- 172.21.15.38:0/1625572328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2a4003bb0 0x7fc2a4004010 secure :-1 s=THROTTLE_DONE pgs=456 cs=0 l=1 rx=0x7fc2ac0013e0 tx=0x7fc2b8146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:17.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.858+0000 7fc2b7fff700 1 --2- 172.21.15.38:0/1625572328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2a4003bb0 0x7fc2a4004010 secure :-1 s=THROTTLE_DONE pgs=456 cs=0 l=1 rx=0x7fc2ac0013e0 tx=0x7fc2b8146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:17.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.858+0000 7fc2b77fe700 1 -- 172.21.15.38:0/1625572328 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ac00cbe0 con 0x7fc2a4003bb0 2020-06-12T17:49:17.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.858+0000 7fc2b77fe700 1 -- 172.21.15.38:0/1625572328 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2ac0111b0 con 0x7fc2a4003bb0 2020-06-12T17:49:17.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.858+0000 7fc2bea98700 1 -- 172.21.15.38:0/1625572328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2a4003bb0 msgr2=0x7fc2a4004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:17.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.858+0000 7fc2bea98700 1 --2- 172.21.15.38:0/1625572328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2a4003bb0 0x7fc2a4004010 secure :-1 s=READY pgs=456 cs=0 l=1 rx=0x7fc2ac0013e0 tx=0x7fc2b8146220).stop 2020-06-12T17:49:17.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.858+0000 7fc2bd035700 1 -- 172.21.15.38:0/1625572328 reap_dead start 2020-06-12T17:49:17.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.858+0000 7fc2bea98700 1 -- 172.21.15.38:0/1625572328 shutdown_connections 2020-06-12T17:49:17.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.858+0000 7fc2bea98700 1 -- 172.21.15.38:0/1625572328 >> 172.21.15.38:0/1625572328 conn(0x7fc2b80b5a20 msgr2=0x7fc2b805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:17.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.858+0000 7fc2bea98700 1 -- 172.21.15.38:0/1625572328 shutdown_connections 2020-06-12T17:49:17.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.858+0000 7fc2bea98700 1 -- 172.21.15.38:0/1625572328 wait complete. 2020-06-12T17:49:17.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.859+0000 7fc2bea98700 1 Processor -- start 2020-06-12T17:49:17.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.859+0000 7fc2bea98700 1 -- start start 2020-06-12T17:49:17.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.860+0000 7fc2bea98700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc2b80b3610 0x7fc2b8137b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:17.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.860+0000 7fc2bea98700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b8136240 con 0x7fc2b8065ba0 2020-06-12T17:49:17.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.860+0000 7fc2bea98700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b8066390 con 0x7fc2b8136910 2020-06-12T17:49:17.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.860+0000 7fc2bea98700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b8136470 con 0x7fc2b80b3610 2020-06-12T17:49:17.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.860+0000 7fc2b7fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc2b8065ba0 0x7fc2b814eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39388/0 (socket says 172.21.15.38:39388) 2020-06-12T17:49:17.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.860+0000 7fc2b7fff700 1 -- 172.21.15.38:0/297554457 learned_addr learned my addr 172.21.15.38:0/297554457 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:17.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.860+0000 7fc2b5ffb700 1 -- 172.21.15.38:0/297554457 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1384350119 0 0) 0x7fc2b8136240 con 0x7fc2b8065ba0 2020-06-12T17:49:17.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.860+0000 7fc2bc834700 1 --2- 172.21.15.38:0/297554457 >> v2:172.21.15.150:3300/0 conn(0x7fc2b80b3610 0x7fc2b8137b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:17.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.860+0000 7fc2b5ffb700 1 -- 172.21.15.38:0/297554457 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc298002fe0 con 0x7fc2b8065ba0 2020-06-12T17:49:17.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.860+0000 7fc2b5ffb700 1 -- 172.21.15.38:0/297554457 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2741774024 0 0) 0x7fc298002fe0 con 0x7fc2b8065ba0 2020-06-12T17:49:17.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.860+0000 7fc2b5ffb700 1 -- 172.21.15.38:0/297554457 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc2b8136240 con 0x7fc2b8065ba0 2020-06-12T17:49:17.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.860+0000 7fc2b5ffb700 1 -- 172.21.15.38:0/297554457 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fc2ac000e90 con 0x7fc2b8065ba0 2020-06-12T17:49:17.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.860+0000 7fc2b5ffb700 1 -- 172.21.15.38:0/297554457 >> v2:172.21.15.150:3300/0 conn(0x7fc2b80b3610 msgr2=0x7fc2b8137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:17.882 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.860+0000 7fc2b5ffb700 1 --2- 172.21.15.38:0/297554457 >> v2:172.21.15.150:3300/0 conn(0x7fc2b80b3610 0x7fc2b8137b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:17.882 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.860+0000 7fc2b5ffb700 1 -- 172.21.15.38:0/297554457 >> v1:172.21.15.150:6789/0 conn(0x7fc2b8136910 legacy=0x7fc2b8136d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:17.882 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.860+0000 7fc2b5ffb700 1 -- 172.21.15.38:0/297554457 >> v1:172.21.15.38:6789/0 conn(0x7fc2b8065ba0 legacy=0x7fc2b814eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:17.882 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.860+0000 7fc2b5ffb700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc298004a40 0x7fc298004e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:17.882 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.860+0000 7fc2b5ffb700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc298003920 0x7fc298003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:17.883 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.860+0000 7fc2b5ffb700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2980041c0 0x7fc29800b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:17.883 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.860+0000 7fc2b5ffb700 1 -- 172.21.15.38:0/297554457 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b8136470 con 0x7fc298003920 2020-06-12T17:49:17.883 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.860+0000 7fc2b5ffb700 1 -- 172.21.15.38:0/297554457 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29800bbb0 con 0x7fc298004a40 2020-06-12T17:49:17.883 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.861+0000 7fc2b5ffb700 1 -- 172.21.15.38:0/297554457 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29800bcf0 con 0x7fc2980041c0 2020-06-12T17:49:17.883 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.861+0000 7fc2b7fff700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc298003920 0x7fc298003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:17.883 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.861+0000 7fc2bc834700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc298004a40 0x7fc298004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:17.884 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.861+0000 7fc2bd035700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2980041c0 0x7fc29800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:17.884 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.861+0000 7fc2b7fff700 1 -- 172.21.15.38:0/297554457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2980041c0 msgr2=0x7fc29800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:17.884 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.861+0000 7fc2b7fff700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2980041c0 0x7fc29800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:17.884 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.861+0000 7fc2b7fff700 1 -- 172.21.15.38:0/297554457 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc298004a40 msgr2=0x7fc298004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:17.884 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.861+0000 7fc2b7fff700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc298004a40 0x7fc298004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:17.885 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.861+0000 7fc2bd035700 1 -- 172.21.15.38:0/297554457 reap_dead start 2020-06-12T17:49:17.885 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.861+0000 7fc2b7fff700 1 -- 172.21.15.38:0/297554457 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b80b39f0 con 0x7fc298003920 2020-06-12T17:49:17.885 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.861+0000 7fc2bea98700 1 -- 172.21.15.38:0/297554457 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b80afb90 con 0x7fc298003920 2020-06-12T17:49:17.885 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.861+0000 7fc2bea98700 1 -- 172.21.15.38:0/297554457 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b8137b10 con 0x7fc298003920 2020-06-12T17:49:17.885 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.861+0000 7fc2b7fff700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc298003920 0x7fc298003d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc2ac0018f0 tx=0x7fc2b8146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:17.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.861+0000 7fc2b7fff700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc298003920 0x7fc298003d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc2ac0018f0 tx=0x7fc2b8146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:17.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.861+0000 7fc2b7fff700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc298003920 0x7fc298003d60 secure :-1 s=READY pgs=458 cs=0 l=1 rx=0x7fc2ac0018f0 tx=0x7fc2b8146220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:17.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.861+0000 7fc2b7fff700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc298003920 0x7fc298003d60 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7fc2ac0018f0 tx=0x7fc2b8146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:17.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.861+0000 7fc2b7fff700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc298003920 0x7fc298003d60 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7fc2ac0018f0 tx=0x7fc2b8146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:17.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.861+0000 7fc2b5ffb700 1 -- 172.21.15.38:0/297554457 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2ac001970 con 0x7fc298003920 2020-06-12T17:49:17.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.861+0000 7fc2b7fff700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc298003920 0x7fc298003d60 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7fc2ac0018f0 tx=0x7fc2b8146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:17.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.861+0000 7fc2b5ffb700 1 -- 172.21.15.38:0/297554457 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ac004990 con 0x7fc298003920 2020-06-12T17:49:17.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.861+0000 7fc2b5ffb700 1 -- 172.21.15.38:0/297554457 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2ac004db0 con 0x7fc298003920 2020-06-12T17:49:17.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.862+0000 7fc2b7fff700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc298003920 0x7fc298003d60 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7fc2ac0018f0 tx=0x7fc2b8146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:17.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.862+0000 7fc2bea98700 1 -- 172.21.15.38:0/297554457 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc294003340 con 0x7fc298003920 2020-06-12T17:49:17.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.862+0000 7fc2b5ffb700 1 -- 172.21.15.38:0/297554457 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fc2ac0101b0 con 0x7fc298003920 2020-06-12T17:49:17.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.862+0000 7fc2b7fff700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc298003920 0x7fc298003d60 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7fc2ac0018f0 tx=0x7fc2b8146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:17.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.863+0000 7fc2b5ffb700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc298050d30 0x7fc2980531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:17.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.863+0000 7fc2b5ffb700 1 -- 172.21.15.38:0/297554457 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc2ac061620 con 0x7fc298003920 2020-06-12T17:49:17.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.863+0000 7fc2bc834700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc298050d30 0x7fc2980531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:17.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.863+0000 7fc2bc834700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc298050d30 0x7fc2980531f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc2a8000fe0 tx=0x7fc2a80018e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:17.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.863+0000 7fc2bc834700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc298050d30 0x7fc2980531f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc2a8000fe0 tx=0x7fc2a80018e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:17.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.863+0000 7fc2bc834700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc298050d30 0x7fc2980531f0 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7fc2a8000fe0 tx=0x7fc2a80018e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:17.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.866+0000 7fc2b7fff700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc298003920 0x7fc298003d60 secure :-1 s=THROTTLE_DONE pgs=458 cs=0 l=1 rx=0x7fc2ac0018f0 tx=0x7fc2b8146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:17.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:17.866+0000 7fc2b5ffb700 1 -- 172.21.15.38:0/297554457 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fc2ac03ce00 con 0x7fc298003920 2020-06-12T17:49:18.064 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.060+0000 7fc2bea98700 1 -- 172.21.15.38:0/297554457 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_520", "target": ["mon-mgr", ""]}) v1 -- 0x7fc294002200 con 0x7fc298050d30 2020-06-12T17:49:18.083 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.080+0000 7fc2bc834700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc298050d30 0x7fc2980531f0 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7fc2a8000fe0 tx=0x7fc2a80018e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:18.084 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.080+0000 7fc2b5ffb700 1 -- 172.21.15.38:0/297554457 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc294002200 con 0x7fc298050d30 2020-06-12T17:49:18.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.081+0000 7fc2bea98700 1 -- 172.21.15.38:0/297554457 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc298050d30 msgr2=0x7fc2980531f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:18.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.081+0000 7fc2bea98700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc298050d30 0x7fc2980531f0 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7fc2a8000fe0 tx=0x7fc2a80018e0).stop 2020-06-12T17:49:18.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.081+0000 7fc2bea98700 1 -- 172.21.15.38:0/297554457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc298003920 msgr2=0x7fc298003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:18.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.081+0000 7fc2bea98700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc298003920 0x7fc298003d60 secure :-1 s=READY pgs=458 cs=0 l=1 rx=0x7fc2ac0018f0 tx=0x7fc2b8146220).stop 2020-06-12T17:49:18.086 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.081+0000 7fc2bea98700 1 -- 172.21.15.38:0/297554457 shutdown_connections 2020-06-12T17:49:18.086 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.081+0000 7fc2bea98700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc298050d30 0x7fc2980531f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:18.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.081+0000 7fc2bea98700 1 --2- 172.21.15.38:0/297554457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc298003920 0x7fc298003d60 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:18.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.081+0000 7fc2bea98700 1 -- 172.21.15.38:0/297554457 >> 172.21.15.38:0/297554457 conn(0x7fc2b80b5a20 msgr2=0x7fc2b809dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:18.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.081+0000 7fc2bea98700 1 -- 172.21.15.38:0/297554457 shutdown_connections 2020-06-12T17:49:18.087 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.081+0000 7fc2bea98700 1 -- 172.21.15.38:0/297554457 wait complete. 2020-06-12T17:49:18.095 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_520 2020-06-12T17:49:18.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.219+0000 7f4a21514700 1 Processor -- start 2020-06-12T17:49:18.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.219+0000 7f4a21514700 1 -- start start 2020-06-12T17:49:18.226 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.220+0000 7f4a21514700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a1c146680 0x7f4a1c0ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:18.226 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.220+0000 7f4a21514700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4a1c0b2eb0 0x7f4a1c09d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:18.226 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.220+0000 7f4a21514700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1c146d20 con 0x7f4a1c09d620 2020-06-12T17:49:18.226 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.220+0000 7f4a21514700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1c066a80 con 0x7f4a1c0b2eb0 2020-06-12T17:49:18.227 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.220+0000 7f4a21514700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c146f50 con 0x7f4a1c146680 2020-06-12T17:49:18.227 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.220+0000 7f4a1affd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a1c146680 0x7f4a1c0ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:18.227 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.220+0000 7f4a1a7fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4a1c0b2eb0 0x7f4a1c09d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:18.227 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.220+0000 7f4a1affd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a1c146680 0x7f4a1c0ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:57042/0 (socket says 172.21.15.38:57042) 2020-06-12T17:49:18.227 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.220+0000 7f4a1affd700 1 -- 172.21.15.38:0/3907743585 learned_addr learned my addr 172.21.15.38:0/3907743585 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:18.228 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.220+0000 7f4a1b7fe700 1 --1- 172.21.15.38:0/3907743585 >> v1:172.21.15.150:6789/0 conn(0x7f4a1c09d620 0x7f4a1c09b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:60132/0 (socket says 172.21.15.38:60132) 2020-06-12T17:49:18.228 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.221+0000 7f4a1affd700 1 -- 172.21.15.38:0/3907743585 >> v2:172.21.15.150:3300/0 conn(0x7f4a1c0b2eb0 msgr2=0x7f4a1c09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:18.228 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.221+0000 7f4a1affd700 1 --2- 172.21.15.38:0/3907743585 >> v2:172.21.15.150:3300/0 conn(0x7f4a1c0b2eb0 0x7f4a1c09d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:18.228 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.221+0000 7f4a1affd700 1 -- 172.21.15.38:0/3907743585 >> v1:172.21.15.150:6789/0 conn(0x7f4a1c09d620 legacy=0x7f4a1c09b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:18.228 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.221+0000 7f4a1affd700 1 -- 172.21.15.38:0/3907743585 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c146a60 con 0x7f4a1c146680 2020-06-12T17:49:18.229 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.221+0000 7f4a1a7fc700 1 --2- 172.21.15.38:0/3907743585 >> v2:172.21.15.150:3300/0 conn(0x7f4a1c0b2eb0 0x7f4a1c09d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:49:18.229 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.221+0000 7f4a1affd700 1 --2- 172.21.15.38:0/3907743585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a1c146680 0x7f4a1c0ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4a10002f30 tx=0x7f4a10007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:18.229 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.221+0000 7f4a1affd700 1 --2- 172.21.15.38:0/3907743585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a1c146680 0x7f4a1c0ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4a10002f30 tx=0x7f4a10007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:18.229 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.221+0000 7f4a1affd700 1 --2- 172.21.15.38:0/3907743585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a1c146680 0x7f4a1c0ad5b0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f4a10002f30 tx=0x7f4a10007e60).ready entity=mon.2 client_cookie=e2912a9146c23b73 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:18.229 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.221+0000 7f4a1affd700 1 --2- 172.21.15.38:0/3907743585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a1c146680 0x7f4a1c0ad5b0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f4a10002f30 tx=0x7f4a10007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:18.230 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.221+0000 7f4a19ffb700 1 -- 172.21.15.38:0/3907743585 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a10011630 con 0x7f4a1c146680 2020-06-12T17:49:18.230 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.221+0000 7f4a1affd700 1 --2- 172.21.15.38:0/3907743585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a1c146680 0x7f4a1c0ad5b0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f4a10002f30 tx=0x7f4a10007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:18.230 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.221+0000 7f4a19ffb700 1 -- 172.21.15.38:0/3907743585 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a10011790 con 0x7f4a1c146680 2020-06-12T17:49:18.230 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.221+0000 7f4a1affd700 1 --2- 172.21.15.38:0/3907743585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a1c146680 0x7f4a1c0ad5b0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f4a10002f30 tx=0x7f4a10007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:18.230 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.221+0000 7f4a19ffb700 1 -- 172.21.15.38:0/3907743585 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a10011bb0 con 0x7f4a1c146680 2020-06-12T17:49:18.230 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.221+0000 7f4a21514700 1 -- 172.21.15.38:0/3907743585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a1c146680 msgr2=0x7f4a1c0ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:18.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.221+0000 7f4a21514700 1 --2- 172.21.15.38:0/3907743585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a1c146680 0x7f4a1c0ad5b0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f4a10002f30 tx=0x7f4a10007e60).stop 2020-06-12T17:49:18.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.222+0000 7f4a21514700 1 -- 172.21.15.38:0/3907743585 shutdown_connections 2020-06-12T17:49:18.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.222+0000 7f4a21514700 1 --2- 172.21.15.38:0/3907743585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a1c146680 0x7f4a1c0ad5b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:18.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.222+0000 7f4a21514700 1 --2- 172.21.15.38:0/3907743585 >> v2:172.21.15.150:3300/0 conn(0x7f4a1c0b2eb0 0x7f4a1c09d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:18.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.222+0000 7f4a21514700 1 -- 172.21.15.38:0/3907743585 >> 172.21.15.38:0/3907743585 conn(0x7f4a1c0b5a20 msgr2=0x7f4a1c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:18.232 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.222+0000 7f4a21514700 1 -- 172.21.15.38:0/3907743585 shutdown_connections 2020-06-12T17:49:18.232 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.222+0000 7f4a21514700 1 -- 172.21.15.38:0/3907743585 wait complete. 2020-06-12T17:49:18.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.223+0000 7f4a21514700 1 Processor -- start 2020-06-12T17:49:18.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.223+0000 7f4a21514700 1 -- start start 2020-06-12T17:49:18.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.223+0000 7f4a21514700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4a1c09d620 0x7f4a1c13a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:18.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.223+0000 7f4a21514700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1c13ad70 con 0x7f4a1c146680 2020-06-12T17:49:18.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.223+0000 7f4a21514700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1c0b2b90 con 0x7f4a1c0b2eb0 2020-06-12T17:49:18.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.223+0000 7f4a21514700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1c065410 con 0x7f4a1c09d620 2020-06-12T17:49:18.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.223+0000 7f4a1b7fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4a1c146680 0x7f4a1c064d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39410/0 (socket says 172.21.15.38:39410) 2020-06-12T17:49:18.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.223+0000 7f4a1b7fe700 1 -- 172.21.15.38:0/1094817356 learned_addr learned my addr 172.21.15.38:0/1094817356 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:18.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.224+0000 7f4a1affd700 1 --2- 172.21.15.38:0/1094817356 >> v2:172.21.15.150:3300/0 conn(0x7f4a1c09d620 0x7f4a1c13a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:18.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.224+0000 7f4a0bfff700 1 -- 172.21.15.38:0/1094817356 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2589477582 0 0) 0x7f4a1c13ad70 con 0x7f4a1c146680 2020-06-12T17:49:18.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.224+0000 7f4a0bfff700 1 -- 172.21.15.38:0/1094817356 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49f8002fe0 con 0x7f4a1c146680 2020-06-12T17:49:18.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.224+0000 7f4a1affd700 1 -- 172.21.15.38:0/1094817356 >> v1:172.21.15.150:6789/0 conn(0x7f4a1c0b2eb0 legacy=0x7f4a1c0b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:18.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.224+0000 7f4a0bfff700 1 -- 172.21.15.38:0/1094817356 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3175522526 0 0) 0x7f4a0c002240 con 0x7f4a1c0b2eb0 2020-06-12T17:49:18.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.224+0000 7f4a1affd700 1 -- 172.21.15.38:0/1094817356 >> v1:172.21.15.38:6789/0 conn(0x7f4a1c146680 legacy=0x7f4a1c064d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:18.242 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.224+0000 7f4a1affd700 1 -- 172.21.15.38:0/1094817356 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c13afa0 con 0x7f4a1c09d620 2020-06-12T17:49:18.242 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.224+0000 7f4a1affd700 1 --2- 172.21.15.38:0/1094817356 >> v2:172.21.15.150:3300/0 conn(0x7f4a1c09d620 0x7f4a1c13a630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4a10002f30 tx=0x7f4a10007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:18.242 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.224+0000 7f4a1affd700 1 --2- 172.21.15.38:0/1094817356 >> v2:172.21.15.150:3300/0 conn(0x7f4a1c09d620 0x7f4a1c13a630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4a10002f30 tx=0x7f4a10007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:18.242 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.224+0000 7f4a1affd700 1 --2- 172.21.15.38:0/1094817356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a1c09d620 0x7f4a1c13a630 secure :-1 s=READY pgs=280 cs=0 l=1 rx=0x7f4a10002f30 tx=0x7f4a10007e60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:18.242 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.224+0000 7f4a1affd700 1 --2- 172.21.15.38:0/1094817356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a1c09d620 0x7f4a1c13a630 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7f4a10002f30 tx=0x7f4a10007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:18.242 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.224+0000 7f4a0bfff700 1 -- 172.21.15.38:0/1094817356 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a10011c70 con 0x7f4a1c09d620 2020-06-12T17:49:18.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.224+0000 7f4a1affd700 1 --2- 172.21.15.38:0/1094817356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a1c09d620 0x7f4a1c13a630 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7f4a10002f30 tx=0x7f4a10007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:18.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.224+0000 7f4a0bfff700 1 -- 172.21.15.38:0/1094817356 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a10011e30 con 0x7f4a1c09d620 2020-06-12T17:49:18.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.224+0000 7f4a1affd700 1 --2- 172.21.15.38:0/1094817356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a1c09d620 0x7f4a1c13a630 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7f4a10002f30 tx=0x7f4a10007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:18.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.224+0000 7f4a21514700 1 -- 172.21.15.38:0/1094817356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1c063cc0 con 0x7f4a1c09d620 2020-06-12T17:49:18.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.224+0000 7f4a0bfff700 1 -- 172.21.15.38:0/1094817356 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a10007530 con 0x7f4a1c09d620 2020-06-12T17:49:18.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.224+0000 7f4a21514700 1 -- 172.21.15.38:0/1094817356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1c0b09f0 con 0x7f4a1c09d620 2020-06-12T17:49:18.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.225+0000 7f4a1affd700 1 --2- 172.21.15.38:0/1094817356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a1c09d620 0x7f4a1c13a630 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7f4a10002f30 tx=0x7f4a10007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:18.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.225+0000 7f4a21514700 1 -- 172.21.15.38:0/1094817356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1c056c30 con 0x7f4a1c09d620 2020-06-12T17:49:18.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.225+0000 7f4a0bfff700 1 -- 172.21.15.38:0/1094817356 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f4a100056c0 con 0x7f4a1c09d620 2020-06-12T17:49:18.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.225+0000 7f4a1affd700 1 --2- 172.21.15.38:0/1094817356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a1c09d620 0x7f4a1c13a630 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7f4a10002f30 tx=0x7f4a10007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:18.245 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.226+0000 7f4a0bfff700 1 --2- 172.21.15.38:0/1094817356 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f49f804d830 0x7f49f804fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:18.245 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.226+0000 7f4a0bfff700 1 -- 172.21.15.38:0/1094817356 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f4a10060ea0 con 0x7f4a1c09d620 2020-06-12T17:49:18.245 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.226+0000 7f4a1a7fc700 1 --2- 172.21.15.38:0/1094817356 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f49f804d830 0x7f49f804fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:18.245 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.226+0000 7f4a1a7fc700 1 --2- 172.21.15.38:0/1094817356 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f49f804d830 0x7f49f804fcf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4a0c003270 tx=0x7f4a0c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:18.245 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.226+0000 7f4a1a7fc700 1 --2- 172.21.15.38:0/1094817356 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f49f804d830 0x7f49f804fcf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4a0c003270 tx=0x7f4a0c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:18.246 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.226+0000 7f4a1a7fc700 1 --2- 172.21.15.38:0/1094817356 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f49f804d830 0x7f49f804fcf0 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7f4a0c003270 tx=0x7f4a0c0081e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:18.246 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.230+0000 7f4a1affd700 1 --2- 172.21.15.38:0/1094817356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a1c09d620 0x7f4a1c13a630 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7f4a10002f30 tx=0x7f4a10007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:18.246 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.230+0000 7f4a0bfff700 1 -- 172.21.15.38:0/1094817356 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f4a1003c6c0 con 0x7f4a1c09d620 2020-06-12T17:49:18.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.423+0000 7f4a21514700 1 -- 172.21.15.38:0/1094817356 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_520", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a1c069be0 con 0x7f49f804d830 2020-06-12T17:49:18.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.427+0000 7f4a1a7fc700 1 --2- 172.21.15.38:0/1094817356 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f49f804d830 0x7f49f804fcf0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f4a0c003270 tx=0x7f4a0c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:18.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.427+0000 7f4a0bfff700 1 -- 172.21.15.38:0/1094817356 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+69 (secure 0 0 0) 0x7f4a1c069be0 con 0x7f49f804d830 2020-06-12T17:49:18.431 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_520/3fe3698c-c0de-44d0-a3d4-8e86eef43b74 2020-06-12T17:49:18.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.428+0000 7f4a21514700 1 -- 172.21.15.38:0/1094817356 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f49f804d830 msgr2=0x7f49f804fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:18.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.428+0000 7f4a21514700 1 --2- 172.21.15.38:0/1094817356 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f49f804d830 0x7f49f804fcf0 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7f4a0c003270 tx=0x7f4a0c0081e0).stop 2020-06-12T17:49:18.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.428+0000 7f4a21514700 1 -- 172.21.15.38:0/1094817356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a1c09d620 msgr2=0x7f4a1c13a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:18.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.428+0000 7f4a21514700 1 --2- 172.21.15.38:0/1094817356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a1c09d620 0x7f4a1c13a630 secure :-1 s=READY pgs=280 cs=0 l=1 rx=0x7f4a10002f30 tx=0x7f4a10007e60).stop 2020-06-12T17:49:18.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.428+0000 7f4a21514700 1 -- 172.21.15.38:0/1094817356 shutdown_connections 2020-06-12T17:49:18.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.428+0000 7f4a21514700 1 --2- 172.21.15.38:0/1094817356 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f49f804d830 0x7f49f804fcf0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:18.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.428+0000 7f4a21514700 1 --2- 172.21.15.38:0/1094817356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a1c09d620 0x7f4a1c13a630 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:18.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.428+0000 7f4a21514700 1 -- 172.21.15.38:0/1094817356 >> 172.21.15.38:0/1094817356 conn(0x7f4a1c0b5a20 msgr2=0x7f4a1c0b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:18.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.428+0000 7f4a21514700 1 -- 172.21.15.38:0/1094817356 shutdown_connections 2020-06-12T17:49:18.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:18.428+0000 7f4a21514700 1 -- 172.21.15.38:0/1094817356 wait complete. 2020-06-12T17:49:18.442 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_520 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_520/3fe3698c-c0de-44d0-a3d4-8e86eef43b74 2020-06-12T17:49:18.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:18.443 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:18.444 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:18.459 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:18.460 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:18.460 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_520/3fe3698c-c0de-44d0-a3d4-8e86eef43b74/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:18.552 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:18.553 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:18.553 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133909 s, 78.3 MB/s 2020-06-12T17:49:18.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:18.555 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:18.555 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:18.571 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:18.572 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:18.572 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_520/3fe3698c-c0de-44d0-a3d4-8e86eef43b74/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:18.661 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:18.661 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:18.662 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126218 s, 83.1 MB/s 2020-06-12T17:49:18.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:18.663 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:18.664 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:18.679 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:18.680 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:18.680 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_520/3fe3698c-c0de-44d0-a3d4-8e86eef43b74/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:18.765 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:18.766 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:18.766 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954502 s, 110 MB/s 2020-06-12T17:49:18.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:18.768 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:18.768 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:18.784 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:18.785 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:18.786 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_520/3fe3698c-c0de-44d0-a3d4-8e86eef43b74/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:18.875 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:18.875 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:18.875 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117197 s, 89.5 MB/s 2020-06-12T17:49:18.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:18.877 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:18.877 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:18.892 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:18.893 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:18.893 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_520/3fe3698c-c0de-44d0-a3d4-8e86eef43b74/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:18.987 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:18.987 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:18.987 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014609 s, 71.8 MB/s 2020-06-12T17:49:18.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:18.989 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:18.989 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:19.005 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:19.006 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:19.006 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_520/3fe3698c-c0de-44d0-a3d4-8e86eef43b74/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:19.096 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:19.096 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:19.096 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130519 s, 80.3 MB/s 2020-06-12T17:49:19.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:19.098 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:19.098 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:19.113 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:19.113 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:19.114 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_520/3fe3698c-c0de-44d0-a3d4-8e86eef43b74/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:19.203 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:19.203 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:19.203 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115712 s, 90.6 MB/s 2020-06-12T17:49:19.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:19.204 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:19.205 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:19.228 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:19.228 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:19.229 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_520/3fe3698c-c0de-44d0-a3d4-8e86eef43b74/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:19.318 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:19.318 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:19.318 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013297 s, 78.9 MB/s 2020-06-12T17:49:19.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:19.320 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:19.320 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:19.335 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:19.336 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:19.336 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_520/3fe3698c-c0de-44d0-a3d4-8e86eef43b74/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:19.425 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:19.425 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:19.425 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119598 s, 87.7 MB/s 2020-06-12T17:49:19.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:19.427 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:19.427 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:19.442 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:19.443 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:19.444 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_520/3fe3698c-c0de-44d0-a3d4-8e86eef43b74/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:19.533 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:19.533 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:19.534 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139667 s, 75.1 MB/s 2020-06-12T17:49:19.535 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_6485 2020-06-12T17:49:19.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.649+0000 7febd6587700 1 Processor -- start 2020-06-12T17:49:19.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.649+0000 7febd6587700 1 -- start start 2020-06-12T17:49:19.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.650+0000 7febd6587700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7febd0146060 0x7febd00a2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:19.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.650+0000 7febd6587700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febd013fc90 0x7febd0140100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:19.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.650+0000 7febd6587700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd005f7a0 con 0x7febd00a2460 2020-06-12T17:49:19.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.650+0000 7febd6587700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd005f2b0 con 0x7febd0146060 2020-06-12T17:49:19.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.650+0000 7febd6587700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd005fa40 con 0x7febd013fc90 2020-06-12T17:49:19.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.650+0000 7febc7fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7febd0146060 0x7febd00a2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:19.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.650+0000 7febc7fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7febd0146060 0x7febd00a2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37602/0 (socket says 172.21.15.38:37602) 2020-06-12T17:49:19.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.650+0000 7febc7fff700 1 -- 172.21.15.38:0/1127696104 learned_addr learned my addr 172.21.15.38:0/1127696104 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:19.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.650+0000 7febd4b24700 1 --2- 172.21.15.38:0/1127696104 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febd013fc90 0x7febd0140100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:19.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.651+0000 7febc7fff700 1 -- 172.21.15.38:0/1127696104 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febd013fc90 msgr2=0x7febd0140100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:19.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.651+0000 7febc7fff700 1 --2- 172.21.15.38:0/1127696104 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febd013fc90 0x7febd0140100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:19.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.651+0000 7febc7fff700 1 -- 172.21.15.38:0/1127696104 >> v1:172.21.15.150:6789/0 conn(0x7febd00a2460 legacy=0x7febd009d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:19.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.651+0000 7febc7fff700 1 -- 172.21.15.38:0/1127696104 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd009dfc0 con 0x7febd0146060 2020-06-12T17:49:19.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.651+0000 7febc7fff700 1 --2- 172.21.15.38:0/1127696104 >> v2:172.21.15.38:3300/0 conn(0x7febd0146060 0x7febd00a2840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7febd009f310 tx=0x7febb8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:19.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.651+0000 7febc7fff700 1 --2- 172.21.15.38:0/1127696104 >> v2:172.21.15.38:3300/0 conn(0x7febd0146060 0x7febd00a2840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7febd009f310 tx=0x7febb8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:19.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.651+0000 7febc7fff700 1 --2- 172.21.15.38:0/1127696104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7febd0146060 0x7febd00a2840 secure :-1 s=READY pgs=460 cs=0 l=1 rx=0x7febd009f310 tx=0x7febb8007e60).ready entity=mon.0 client_cookie=29745cec07304e0a server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:19.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.651+0000 7febc7fff700 1 --2- 172.21.15.38:0/1127696104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7febd0146060 0x7febd00a2840 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7febd009f310 tx=0x7febb8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:19.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.651+0000 7febc7fff700 1 --2- 172.21.15.38:0/1127696104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7febd0146060 0x7febd00a2840 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7febd009f310 tx=0x7febb8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:19.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.651+0000 7febcf7fe700 1 -- 172.21.15.38:0/1127696104 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febb80116a0 con 0x7febd0146060 2020-06-12T17:49:19.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.651+0000 7febc7fff700 1 --2- 172.21.15.38:0/1127696104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7febd0146060 0x7febd00a2840 secure :-1 s=THROTTLE_DONE pgs=460 cs=0 l=1 rx=0x7febd009f310 tx=0x7febb8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:19.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.651+0000 7febcf7fe700 1 -- 172.21.15.38:0/1127696104 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb8011800 con 0x7febd0146060 2020-06-12T17:49:19.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.651+0000 7febcf7fe700 1 -- 172.21.15.38:0/1127696104 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febb8011c20 con 0x7febd0146060 2020-06-12T17:49:19.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.651+0000 7febd6587700 1 -- 172.21.15.38:0/1127696104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7febd0146060 msgr2=0x7febd00a2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:19.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.651+0000 7febd6587700 1 --2- 172.21.15.38:0/1127696104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7febd0146060 0x7febd00a2840 secure :-1 s=READY pgs=460 cs=0 l=1 rx=0x7febd009f310 tx=0x7febb8007e60).stop 2020-06-12T17:49:19.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.651+0000 7febd6587700 1 -- 172.21.15.38:0/1127696104 shutdown_connections 2020-06-12T17:49:19.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.651+0000 7febd6587700 1 --2- 172.21.15.38:0/1127696104 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7febd013fc90 0x7febd0140100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:19.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.651+0000 7febd6587700 1 --2- 172.21.15.38:0/1127696104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7febd0146060 0x7febd00a2840 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:19.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.651+0000 7febd6587700 1 -- 172.21.15.38:0/1127696104 >> 172.21.15.38:0/1127696104 conn(0x7febd005b450 msgr2=0x7febd005b860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:19.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.651+0000 7febd6587700 1 -- 172.21.15.38:0/1127696104 shutdown_connections 2020-06-12T17:49:19.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.651+0000 7febd6587700 1 -- 172.21.15.38:0/1127696104 wait complete. 2020-06-12T17:49:19.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.652+0000 7febd6587700 1 Processor -- start 2020-06-12T17:49:19.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.652+0000 7febd6587700 1 -- start start 2020-06-12T17:49:19.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.653+0000 7febd6587700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7febd00a2460 0x7febd0142540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:19.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.653+0000 7febd6587700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7febd0146060 0x7febd013f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:19.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.653+0000 7febd6587700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd00b7000 con 0x7febd013fc90 2020-06-12T17:49:19.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.653+0000 7febd6587700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd0145c90 con 0x7febd0146060 2020-06-12T17:49:19.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.653+0000 7febd6587700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd00b6d60 con 0x7febd00a2460 2020-06-12T17:49:19.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.653+0000 7febd4b24700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7febd0146060 0x7febd013f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:19.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.653+0000 7febd4b24700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7febd0146060 0x7febd013f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37608/0 (socket says 172.21.15.38:37608) 2020-06-12T17:49:19.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.653+0000 7febc7fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7febd013fc90 0x7febd0145580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39422/0 (socket says 172.21.15.38:39422) 2020-06-12T17:49:19.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.653+0000 7febd4b24700 1 -- 172.21.15.38:0/2626323302 learned_addr learned my addr 172.21.15.38:0/2626323302 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:19.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.653+0000 7febcffff700 1 --2- 172.21.15.38:0/2626323302 >> v2:172.21.15.150:3300/0 conn(0x7febd00a2460 0x7febd0142540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:19.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.653+0000 7febd4b24700 1 -- 172.21.15.38:0/2626323302 >> v2:172.21.15.150:3300/0 conn(0x7febd00a2460 msgr2=0x7febd0142540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:19.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.653+0000 7febd4b24700 1 --2- 172.21.15.38:0/2626323302 >> v2:172.21.15.150:3300/0 conn(0x7febd00a2460 0x7febd0142540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:19.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.653+0000 7febd4b24700 1 -- 172.21.15.38:0/2626323302 >> v1:172.21.15.38:6789/0 conn(0x7febd013fc90 legacy=0x7febd0145580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:19.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.653+0000 7febd4b24700 1 -- 172.21.15.38:0/2626323302 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd01450e0 con 0x7febd0146060 2020-06-12T17:49:19.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.653+0000 7febcdffb700 1 -- 172.21.15.38:0/2626323302 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296639976 0 0) 0x7febd00b7000 con 0x7febd013fc90 2020-06-12T17:49:19.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.654+0000 7febd4b24700 1 --2- 172.21.15.38:0/2626323302 >> v2:172.21.15.38:3300/0 conn(0x7febd0146060 0x7febd013f530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7febc80032b0 tx=0x7febc800e4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:19.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.654+0000 7febd4b24700 1 --2- 172.21.15.38:0/2626323302 >> v2:172.21.15.38:3300/0 conn(0x7febd0146060 0x7febd013f530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7febc80032b0 tx=0x7febc800e4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:19.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.654+0000 7febd4b24700 1 --2- 172.21.15.38:0/2626323302 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7febd0146060 0x7febd013f530 secure :-1 s=READY pgs=462 cs=0 l=1 rx=0x7febc80032b0 tx=0x7febc800e4d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:19.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.654+0000 7febd4b24700 1 --2- 172.21.15.38:0/2626323302 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7febd0146060 0x7febd013f530 secure :-1 s=THROTTLE_DONE pgs=462 cs=0 l=1 rx=0x7febc80032b0 tx=0x7febc800e4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:19.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.654+0000 7febcdffb700 1 -- 172.21.15.38:0/2626323302 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febc8005e30 con 0x7febd0146060 2020-06-12T17:49:19.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.654+0000 7febd4b24700 1 --2- 172.21.15.38:0/2626323302 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7febd0146060 0x7febd013f530 secure :-1 s=THROTTLE_DONE pgs=462 cs=0 l=1 rx=0x7febc80032b0 tx=0x7febc800e4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:19.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.654+0000 7febd4b24700 1 --2- 172.21.15.38:0/2626323302 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7febd0146060 0x7febd013f530 secure :-1 s=THROTTLE_DONE pgs=462 cs=0 l=1 rx=0x7febc80032b0 tx=0x7febc800e4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:19.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.654+0000 7febcdffb700 1 -- 172.21.15.38:0/2626323302 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc8007540 con 0x7febd0146060 2020-06-12T17:49:19.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.654+0000 7febd6587700 1 -- 172.21.15.38:0/2626323302 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd00b69e0 con 0x7febd0146060 2020-06-12T17:49:19.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.654+0000 7febcdffb700 1 -- 172.21.15.38:0/2626323302 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febc800e610 con 0x7febd0146060 2020-06-12T17:49:19.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.654+0000 7febd6587700 1 -- 172.21.15.38:0/2626323302 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd0140ac0 con 0x7febd0146060 2020-06-12T17:49:19.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.655+0000 7febd4b24700 1 --2- 172.21.15.38:0/2626323302 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7febd0146060 0x7febd013f530 secure :-1 s=THROTTLE_DONE pgs=462 cs=0 l=1 rx=0x7febc80032b0 tx=0x7febc800e4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:19.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.655+0000 7febd6587700 1 -- 172.21.15.38:0/2626323302 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd0067b20 con 0x7febd0146060 2020-06-12T17:49:19.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.655+0000 7febcdffb700 1 -- 172.21.15.38:0/2626323302 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7febc8010180 con 0x7febd0146060 2020-06-12T17:49:19.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.655+0000 7febd4b24700 1 --2- 172.21.15.38:0/2626323302 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7febd0146060 0x7febd013f530 secure :-1 s=THROTTLE_DONE pgs=462 cs=0 l=1 rx=0x7febc80032b0 tx=0x7febc800e4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:19.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.655+0000 7febcdffb700 1 --2- 172.21.15.38:0/2626323302 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7febb404d4c0 0x7febb404f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:19.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.655+0000 7febcdffb700 1 -- 172.21.15.38:0/2626323302 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7febc8061060 con 0x7febd0146060 2020-06-12T17:49:19.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.655+0000 7febcffff700 1 --2- 172.21.15.38:0/2626323302 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7febb404d4c0 0x7febb404f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:19.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.656+0000 7febcffff700 1 --2- 172.21.15.38:0/2626323302 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7febb404d4c0 0x7febb404f980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7febc0001f50 tx=0x7febc0002710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:19.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.656+0000 7febcffff700 1 --2- 172.21.15.38:0/2626323302 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7febb404d4c0 0x7febb404f980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7febc0001f50 tx=0x7febc0002710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:19.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.656+0000 7febcffff700 1 --2- 172.21.15.38:0/2626323302 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7febb404d4c0 0x7febb404f980 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7febc0001f50 tx=0x7febc0002710).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:19.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.659+0000 7febd4b24700 1 --2- 172.21.15.38:0/2626323302 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7febd0146060 0x7febd013f530 secure :-1 s=THROTTLE_DONE pgs=462 cs=0 l=1 rx=0x7febc80032b0 tx=0x7febc800e4d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:19.673 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.659+0000 7febcdffb700 1 -- 172.21.15.38:0/2626323302 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7febc803c720 con 0x7febd0146060 2020-06-12T17:49:19.858 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.854+0000 7febd6587700 1 -- 172.21.15.38:0/2626323302 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_6485", "target": ["mon-mgr", ""]}) v1 -- 0x7febd01452e0 con 0x7febb404d4c0 2020-06-12T17:49:19.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.872+0000 7febcffff700 1 --2- 172.21.15.38:0/2626323302 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7febb404d4c0 0x7febb404f980 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7febc0001f50 tx=0x7febc0002710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:19.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.872+0000 7febcdffb700 1 -- 172.21.15.38:0/2626323302 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7febc0008330 con 0x7febb404d4c0 2020-06-12T17:49:19.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.874+0000 7febd6587700 1 -- 172.21.15.38:0/2626323302 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7febb404d4c0 msgr2=0x7febb404f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:19.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.874+0000 7febd6587700 1 --2- 172.21.15.38:0/2626323302 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7febb404d4c0 0x7febb404f980 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7febc0001f50 tx=0x7febc0002710).stop 2020-06-12T17:49:19.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.874+0000 7febd6587700 1 -- 172.21.15.38:0/2626323302 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7febd0146060 msgr2=0x7febd013f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:19.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.874+0000 7febd6587700 1 --2- 172.21.15.38:0/2626323302 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7febd0146060 0x7febd013f530 secure :-1 s=READY pgs=462 cs=0 l=1 rx=0x7febc80032b0 tx=0x7febc800e4d0).stop 2020-06-12T17:49:19.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.874+0000 7febd6587700 1 -- 172.21.15.38:0/2626323302 shutdown_connections 2020-06-12T17:49:19.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.874+0000 7febd6587700 1 --2- 172.21.15.38:0/2626323302 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7febb404d4c0 0x7febb404f980 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:19.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.874+0000 7febd6587700 1 --2- 172.21.15.38:0/2626323302 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7febd0146060 0x7febd013f530 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:19.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.874+0000 7febd6587700 1 --2- 172.21.15.38:0/2626323302 >> v2:172.21.15.150:3300/0 conn(0x7febd00a2460 0x7febd0142540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:19.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.874+0000 7febd6587700 1 -- 172.21.15.38:0/2626323302 >> 172.21.15.38:0/2626323302 conn(0x7febd005b450 msgr2=0x7febd0146490 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:19.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.874+0000 7febd6587700 1 -- 172.21.15.38:0/2626323302 shutdown_connections 2020-06-12T17:49:19.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:19.874+0000 7febd6587700 1 -- 172.21.15.38:0/2626323302 wait complete. 2020-06-12T17:49:19.887 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_6485 2020-06-12T17:49:20.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.001+0000 7f211ba22700 1 Processor -- start 2020-06-12T17:49:20.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.001+0000 7f211ba22700 1 -- start start 2020-06-12T17:49:20.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.002+0000 7f211ba22700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21140ad5b0 0x7f21140b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:20.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.002+0000 7f211ba22700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2114146d20 con 0x7f211409d8d0 2020-06-12T17:49:20.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.002+0000 7f211ba22700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2114066a80 con 0x7f2114146680 2020-06-12T17:49:20.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.002+0000 7f211ba22700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2114146f50 con 0x7f21140ad5b0 2020-06-12T17:49:20.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.002+0000 7f2119fbf700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f211409d8d0 0x7f21141421d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39428/0 (socket says 172.21.15.38:39428) 2020-06-12T17:49:20.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.002+0000 7f2119fbf700 1 -- 172.21.15.38:0/1677332427 learned_addr learned my addr 172.21.15.38:0/1677332427 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:20.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.002+0000 7f2118fbd700 1 --2- 172.21.15.38:0/1677332427 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21140ad5b0 0x7f21140b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:20.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.002+0000 7f2107fff700 1 -- 172.21.15.38:0/1677332427 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330843651 0 0) 0x7f2114146d20 con 0x7f211409d8d0 2020-06-12T17:49:20.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.002+0000 7f2107fff700 1 -- 172.21.15.38:0/1677332427 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20fc003230 con 0x7f211409d8d0 2020-06-12T17:49:20.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2107fff700 1 -- 172.21.15.38:0/1677332427 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170865098 0 0) 0x7f2114066a80 con 0x7f2114146680 2020-06-12T17:49:20.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2107fff700 1 -- 172.21.15.38:0/1677332427 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2114146d20 con 0x7f2114146680 2020-06-12T17:49:20.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2107fff700 1 -- 172.21.15.38:0/1677332427 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1132002542 0 0) 0x7f20fc003230 con 0x7f211409d8d0 2020-06-12T17:49:20.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2107fff700 1 -- 172.21.15.38:0/1677332427 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21140ad5b0 msgr2=0x7f21140b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:20.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2107fff700 1 --2- 172.21.15.38:0/1677332427 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21140ad5b0 0x7f21140b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:20.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2107fff700 1 -- 172.21.15.38:0/1677332427 >> v1:172.21.15.150:6789/0 conn(0x7f2114146680 legacy=0x7f211409d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:20.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2107fff700 1 -- 172.21.15.38:0/1677332427 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2114146a60 con 0x7f211409d8d0 2020-06-12T17:49:20.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2107fff700 1 -- 172.21.15.38:0/1677332427 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f210c001a50 con 0x7f211409d8d0 2020-06-12T17:49:20.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2107fff700 1 -- 172.21.15.38:0/1677332427 >> v1:172.21.15.38:6789/0 conn(0x7f211409d8d0 legacy=0x7f21141421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:20.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2107fff700 1 --2- 172.21.15.38:0/1677332427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20fc0038e0 0x7f20fc003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:20.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2107fff700 1 --2- 172.21.15.38:0/1677332427 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20fc0044d0 0x7f20fc004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:20.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2107fff700 1 --2- 172.21.15.38:0/1677332427 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21140ad5b0 0x7f20fc004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:20.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2107fff700 1 -- 172.21.15.38:0/1677332427 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2114146f50 con 0x7f20fc0044d0 2020-06-12T17:49:20.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2107fff700 1 -- 172.21.15.38:0/1677332427 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc005210 con 0x7f20fc0038e0 2020-06-12T17:49:20.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2107fff700 1 -- 172.21.15.38:0/1677332427 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc00b720 con 0x7f21140ad5b0 2020-06-12T17:49:20.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2118fbd700 1 --2- 172.21.15.38:0/1677332427 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20fc0044d0 0x7f20fc004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:20.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f21197be700 1 --2- 172.21.15.38:0/1677332427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20fc0038e0 0x7f20fc003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:20.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2119fbf700 1 --2- 172.21.15.38:0/1677332427 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21140ad5b0 0x7f20fc004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:20.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2118fbd700 1 -- 172.21.15.38:0/1677332427 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21140ad5b0 msgr2=0x7f20fc004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:20.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2118fbd700 1 --2- 172.21.15.38:0/1677332427 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21140ad5b0 0x7f20fc004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:20.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2118fbd700 1 -- 172.21.15.38:0/1677332427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20fc0038e0 msgr2=0x7f20fc003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:20.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2118fbd700 1 --2- 172.21.15.38:0/1677332427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20fc0038e0 0x7f20fc003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:20.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2118fbd700 1 -- 172.21.15.38:0/1677332427 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20fc003230 con 0x7f20fc0044d0 2020-06-12T17:49:20.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2118fbd700 1 --2- 172.21.15.38:0/1677332427 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20fc0044d0 0x7f20fc004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2110008910 tx=0x7f2110007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:20.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2118fbd700 1 --2- 172.21.15.38:0/1677332427 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20fc0044d0 0x7f20fc004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2110008910 tx=0x7f2110007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:20.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2118fbd700 1 --2- 172.21.15.38:0/1677332427 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20fc0044d0 0x7f20fc004950 secure :-1 s=READY pgs=464 cs=0 l=1 rx=0x7f2110008910 tx=0x7f2110007e60).ready entity=mon.0 client_cookie=9e439addd7cccc0e server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:20.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2118fbd700 1 --2- 172.21.15.38:0/1677332427 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20fc0044d0 0x7f20fc004950 secure :-1 s=THROTTLE_DONE pgs=464 cs=0 l=1 rx=0x7f2110008910 tx=0x7f2110007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:20.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2118fbd700 1 --2- 172.21.15.38:0/1677332427 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20fc0044d0 0x7f20fc004950 secure :-1 s=THROTTLE_DONE pgs=464 cs=0 l=1 rx=0x7f2110008910 tx=0x7f2110007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:20.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2107fff700 1 -- 172.21.15.38:0/1677332427 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2110008d30 con 0x7f20fc0044d0 2020-06-12T17:49:20.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2118fbd700 1 --2- 172.21.15.38:0/1677332427 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20fc0044d0 0x7f20fc004950 secure :-1 s=THROTTLE_DONE pgs=464 cs=0 l=1 rx=0x7f2110008910 tx=0x7f2110007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:20.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.003+0000 7f2107fff700 1 -- 172.21.15.38:0/1677332427 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2110008e90 con 0x7f20fc0044d0 2020-06-12T17:49:20.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.004+0000 7f2107fff700 1 -- 172.21.15.38:0/1677332427 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2110010a20 con 0x7f20fc0044d0 2020-06-12T17:49:20.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.004+0000 7f211ba22700 1 -- 172.21.15.38:0/1677332427 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20fc0044d0 msgr2=0x7f20fc004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:20.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.004+0000 7f211ba22700 1 --2- 172.21.15.38:0/1677332427 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20fc0044d0 0x7f20fc004950 secure :-1 s=READY pgs=464 cs=0 l=1 rx=0x7f2110008910 tx=0x7f2110007e60).stop 2020-06-12T17:49:20.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.004+0000 7f2119fbf700 1 -- 172.21.15.38:0/1677332427 reap_dead start 2020-06-12T17:49:20.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.004+0000 7f211ba22700 1 -- 172.21.15.38:0/1677332427 shutdown_connections 2020-06-12T17:49:20.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.004+0000 7f211ba22700 1 -- 172.21.15.38:0/1677332427 >> 172.21.15.38:0/1677332427 conn(0x7f21140b5a20 msgr2=0x7f211405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:20.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.004+0000 7f211ba22700 1 -- 172.21.15.38:0/1677332427 shutdown_connections 2020-06-12T17:49:20.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.004+0000 7f211ba22700 1 -- 172.21.15.38:0/1677332427 wait complete. 2020-06-12T17:49:20.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.005+0000 7f211ba22700 1 Processor -- start 2020-06-12T17:49:20.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.005+0000 7f211ba22700 1 -- start start 2020-06-12T17:49:20.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.006+0000 7f211ba22700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21140b3b60 0x7f2114063e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:20.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.006+0000 7f211ba22700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f21140b1370 0x7f21140b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:20.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.006+0000 7f211ba22700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21140b0760 con 0x7f21140af750 2020-06-12T17:49:20.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.006+0000 7f211ba22700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21140b0990 con 0x7f21140b1370 2020-06-12T17:49:20.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.006+0000 7f211ba22700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21140b0c30 con 0x7f21140b3b60 2020-06-12T17:49:20.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.006+0000 7f21197be700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21140b3b60 0x7f2114063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:20.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.006+0000 7f2118fbd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f21140af750 0x7f211413df60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:60172/0 (socket says 172.21.15.38:60172) 2020-06-12T17:49:20.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.006+0000 7f2118fbd700 1 -- 172.21.15.38:0/2768330885 learned_addr learned my addr 172.21.15.38:0/2768330885 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:20.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.006+0000 7f2119fbf700 1 --2- 172.21.15.38:0/2768330885 >> v2:172.21.15.150:3300/0 conn(0x7f21140b1370 0x7f21140b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:20.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.006+0000 7f21197be700 1 -- 172.21.15.38:0/2768330885 >> v2:172.21.15.150:3300/0 conn(0x7f21140b1370 msgr2=0x7f21140b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:20.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.006+0000 7f21197be700 1 --2- 172.21.15.38:0/2768330885 >> v2:172.21.15.150:3300/0 conn(0x7f21140b1370 0x7f21140b1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:20.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.006+0000 7f21197be700 1 -- 172.21.15.38:0/2768330885 >> v1:172.21.15.150:6789/0 conn(0x7f21140af750 legacy=0x7f211413df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:20.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.007+0000 7f21197be700 1 -- 172.21.15.38:0/2768330885 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21140b0ed0 con 0x7f21140b3b60 2020-06-12T17:49:20.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.007+0000 7f21197be700 1 --2- 172.21.15.38:0/2768330885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21140b3b60 0x7f2114063e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2114062a30 tx=0x7f21080019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:20.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.007+0000 7f21197be700 1 --2- 172.21.15.38:0/2768330885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21140b3b60 0x7f2114063e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2114062a30 tx=0x7f21080019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:20.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.007+0000 7f21197be700 1 --2- 172.21.15.38:0/2768330885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21140b3b60 0x7f2114063e60 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f2114062a30 tx=0x7f21080019a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:20.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.007+0000 7f21197be700 1 --2- 172.21.15.38:0/2768330885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21140b3b60 0x7f2114063e60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2114062a30 tx=0x7f21080019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:20.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.007+0000 7f21067fc700 1 -- 172.21.15.38:0/2768330885 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21080124b0 con 0x7f21140b3b60 2020-06-12T17:49:20.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.007+0000 7f21197be700 1 --2- 172.21.15.38:0/2768330885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21140b3b60 0x7f2114063e60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2114062a30 tx=0x7f21080019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:20.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.007+0000 7f21197be700 1 --2- 172.21.15.38:0/2768330885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21140b3b60 0x7f2114063e60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2114062a30 tx=0x7f21080019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:20.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.007+0000 7f21067fc700 1 -- 172.21.15.38:0/2768330885 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2108012610 con 0x7f21140b3b60 2020-06-12T17:49:20.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.007+0000 7f211ba22700 1 -- 172.21.15.38:0/2768330885 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21140642c0 con 0x7f21140b3b60 2020-06-12T17:49:20.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.007+0000 7f21067fc700 1 -- 172.21.15.38:0/2768330885 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2108012a30 con 0x7f21140b3b60 2020-06-12T17:49:20.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.007+0000 7f211ba22700 1 -- 172.21.15.38:0/2768330885 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211413e6f0 con 0x7f21140b3b60 2020-06-12T17:49:20.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.008+0000 7f21197be700 1 --2- 172.21.15.38:0/2768330885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21140b3b60 0x7f2114063e60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2114062a30 tx=0x7f21080019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:20.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.008+0000 7f211ba22700 1 -- 172.21.15.38:0/2768330885 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21140b1060 con 0x7f21140b3b60 2020-06-12T17:49:20.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.008+0000 7f21067fc700 1 -- 172.21.15.38:0/2768330885 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f2108012cf0 con 0x7f21140b3b60 2020-06-12T17:49:20.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.008+0000 7f21197be700 1 --2- 172.21.15.38:0/2768330885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21140b3b60 0x7f2114063e60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2114062a30 tx=0x7f21080019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:20.028 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.008+0000 7f21067fc700 1 --2- 172.21.15.38:0/2768330885 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f20f404d680 0x7f20f404fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:20.028 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.008+0000 7f21067fc700 1 -- 172.21.15.38:0/2768330885 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2108060910 con 0x7f21140b3b60 2020-06-12T17:49:20.028 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.009+0000 7f2118fbd700 1 --2- 172.21.15.38:0/2768330885 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f20f404d680 0x7f20f404fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:20.028 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.009+0000 7f2118fbd700 1 --2- 172.21.15.38:0/2768330885 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f20f404d680 0x7f20f404fb40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2114062170 tx=0x7f2110007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:20.028 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.009+0000 7f2118fbd700 1 --2- 172.21.15.38:0/2768330885 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f20f404d680 0x7f20f404fb40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2114062170 tx=0x7f2110007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:20.029 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.009+0000 7f2118fbd700 1 --2- 172.21.15.38:0/2768330885 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f20f404d680 0x7f20f404fb40 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7f2114062170 tx=0x7f2110007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:20.029 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.012+0000 7f21197be700 1 --2- 172.21.15.38:0/2768330885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21140b3b60 0x7f2114063e60 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2114062a30 tx=0x7f21080019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:20.029 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.012+0000 7f21067fc700 1 -- 172.21.15.38:0/2768330885 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f210803c010 con 0x7f21140b3b60 2020-06-12T17:49:20.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.208+0000 7f211ba22700 1 -- 172.21.15.38:0/2768330885 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_6485", "target": ["mon-mgr", ""]}) v1 -- 0x7f2114056c30 con 0x7f20f404d680 2020-06-12T17:49:20.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.212+0000 7f2118fbd700 1 --2- 172.21.15.38:0/2768330885 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f20f404d680 0x7f20f404fb40 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f2114062170 tx=0x7f2110007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:20.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.212+0000 7f21067fc700 1 -- 172.21.15.38:0/2768330885 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f2114056c30 con 0x7f20f404d680 2020-06-12T17:49:20.216 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_6485/7750a23c-04f5-4742-82bf-501530c43ab9 2020-06-12T17:49:20.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.213+0000 7f211ba22700 1 -- 172.21.15.38:0/2768330885 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f20f404d680 msgr2=0x7f20f404fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:20.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.213+0000 7f211ba22700 1 --2- 172.21.15.38:0/2768330885 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f20f404d680 0x7f20f404fb40 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7f2114062170 tx=0x7f2110007e60).stop 2020-06-12T17:49:20.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.213+0000 7f211ba22700 1 -- 172.21.15.38:0/2768330885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21140b3b60 msgr2=0x7f2114063e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:20.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.213+0000 7f211ba22700 1 --2- 172.21.15.38:0/2768330885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21140b3b60 0x7f2114063e60 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f2114062a30 tx=0x7f21080019a0).stop 2020-06-12T17:49:20.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.213+0000 7f211ba22700 1 -- 172.21.15.38:0/2768330885 shutdown_connections 2020-06-12T17:49:20.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.213+0000 7f211ba22700 1 --2- 172.21.15.38:0/2768330885 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f20f404d680 0x7f20f404fb40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:20.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.213+0000 7f211ba22700 1 --2- 172.21.15.38:0/2768330885 >> v2:172.21.15.150:3300/0 conn(0x7f21140b1370 0x7f21140b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:20.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.213+0000 7f211ba22700 1 --2- 172.21.15.38:0/2768330885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21140b3b60 0x7f2114063e60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:20.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.213+0000 7f211ba22700 1 -- 172.21.15.38:0/2768330885 >> 172.21.15.38:0/2768330885 conn(0x7f21140b5a20 msgr2=0x7f211405b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:20.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.213+0000 7f211ba22700 1 -- 172.21.15.38:0/2768330885 shutdown_connections 2020-06-12T17:49:20.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:20.213+0000 7f211ba22700 1 -- 172.21.15.38:0/2768330885 wait complete. 2020-06-12T17:49:20.227 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_6485 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_6485/7750a23c-04f5-4742-82bf-501530c43ab9 2020-06-12T17:49:20.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:20.228 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:20.228 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:20.243 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:20.244 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:20.244 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6485/7750a23c-04f5-4742-82bf-501530c43ab9/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:20.336 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:20.336 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:20.337 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127106 s, 82.5 MB/s 2020-06-12T17:49:20.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:20.338 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:20.339 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:20.353 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:20.354 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:20.355 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6485/7750a23c-04f5-4742-82bf-501530c43ab9/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:20.441 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:20.441 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:20.442 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110279 s, 95.1 MB/s 2020-06-12T17:49:20.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:20.443 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:20.444 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:20.458 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:20.459 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:20.459 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6485/7750a23c-04f5-4742-82bf-501530c43ab9/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:20.546 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:20.547 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:20.547 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128703 s, 81.5 MB/s 2020-06-12T17:49:20.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:20.549 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:20.549 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:20.564 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:20.565 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:20.565 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6485/7750a23c-04f5-4742-82bf-501530c43ab9/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:20.655 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:20.656 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:20.656 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149217 s, 70.3 MB/s 2020-06-12T17:49:20.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:20.658 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:20.658 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:20.673 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:20.673 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:20.674 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6485/7750a23c-04f5-4742-82bf-501530c43ab9/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:20.762 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:20.763 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:20.763 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124799 s, 84.0 MB/s 2020-06-12T17:49:20.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:20.765 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:20.765 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:20.780 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:20.781 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:20.782 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6485/7750a23c-04f5-4742-82bf-501530c43ab9/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:20.869 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:20.869 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:20.870 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011093 s, 94.5 MB/s 2020-06-12T17:49:20.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:20.871 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:20.872 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:20.887 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:20.887 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:20.888 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6485/7750a23c-04f5-4742-82bf-501530c43ab9/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:20.980 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:20.980 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:20.981 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127388 s, 82.3 MB/s 2020-06-12T17:49:20.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:20.982 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:20.983 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:20.998 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:20.998 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:20.999 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6485/7750a23c-04f5-4742-82bf-501530c43ab9/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:21.087 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:21.087 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:21.088 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127074 s, 82.5 MB/s 2020-06-12T17:49:21.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:21.089 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:21.089 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:21.104 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:21.105 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:21.106 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6485/7750a23c-04f5-4742-82bf-501530c43ab9/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:21.197 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:21.198 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:21.198 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107687 s, 97.4 MB/s 2020-06-12T17:49:21.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:21.199 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:21.199 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:21.215 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:21.215 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:21.215 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6485/7750a23c-04f5-4742-82bf-501530c43ab9/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:21.303 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:21.304 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:21.304 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113573 s, 92.3 MB/s 2020-06-12T17:49:21.305 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_9271 2020-06-12T17:49:21.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.419+0000 7fcb9fad3700 1 Processor -- start 2020-06-12T17:49:21.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.419+0000 7fcb9fad3700 1 -- start start 2020-06-12T17:49:21.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.419+0000 7fcb9fad3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcb980ad5b0 0x7fcb980b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:21.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.420+0000 7fcb9fad3700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb98146d20 con 0x7fcb9809d8d0 2020-06-12T17:49:21.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.420+0000 7fcb9fad3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb98066a80 con 0x7fcb98146680 2020-06-12T17:49:21.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.420+0000 7fcb9fad3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb98146f50 con 0x7fcb980ad5b0 2020-06-12T17:49:21.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.420+0000 7fcb9e070700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fcb9809d8d0 0x7fcb981421d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39446/0 (socket says 172.21.15.38:39446) 2020-06-12T17:49:21.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.420+0000 7fcb9e070700 1 -- 172.21.15.38:0/941092079 learned_addr learned my addr 172.21.15.38:0/941092079 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:21.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.420+0000 7fcb9c86d700 1 -- 172.21.15.38:0/941092079 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590862017 0 0) 0x7fcb98146d20 con 0x7fcb9809d8d0 2020-06-12T17:49:21.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.420+0000 7fcb9c86d700 1 -- 172.21.15.38:0/941092079 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb80003230 con 0x7fcb9809d8d0 2020-06-12T17:49:21.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.420+0000 7fcb9d06e700 1 --2- 172.21.15.38:0/941092079 >> v2:172.21.15.150:3300/0 conn(0x7fcb980ad5b0 0x7fcb980b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:21.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.420+0000 7fcb9c86d700 1 -- 172.21.15.38:0/941092079 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2927772599 0 0) 0x7fcb80003230 con 0x7fcb9809d8d0 2020-06-12T17:49:21.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.420+0000 7fcb9c86d700 1 -- 172.21.15.38:0/941092079 >> v2:172.21.15.150:3300/0 conn(0x7fcb980ad5b0 msgr2=0x7fcb980b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:21.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.420+0000 7fcb9c86d700 1 --2- 172.21.15.38:0/941092079 >> v2:172.21.15.150:3300/0 conn(0x7fcb980ad5b0 0x7fcb980b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:21.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.420+0000 7fcb9c86d700 1 -- 172.21.15.38:0/941092079 >> v1:172.21.15.150:6789/0 conn(0x7fcb98146680 legacy=0x7fcb9809d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:21.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.420+0000 7fcb9c86d700 1 -- 172.21.15.38:0/941092079 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb98146a60 con 0x7fcb9809d8d0 2020-06-12T17:49:21.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.420+0000 7fcb9c86d700 1 -- 172.21.15.38:0/941092079 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fcb90001a50 con 0x7fcb9809d8d0 2020-06-12T17:49:21.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.420+0000 7fcb9c86d700 1 -- 172.21.15.38:0/941092079 >> v1:172.21.15.38:6789/0 conn(0x7fcb9809d8d0 legacy=0x7fcb981421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:21.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.420+0000 7fcb9c86d700 1 --2- 172.21.15.38:0/941092079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb80003720 0x7fcb80003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:21.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.420+0000 7fcb9c86d700 1 --2- 172.21.15.38:0/941092079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb800044d0 0x7fcb80004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:21.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.420+0000 7fcb9c86d700 1 --2- 172.21.15.38:0/941092079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb80004db0 0x7fcb8000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:21.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.420+0000 7fcb9c86d700 1 -- 172.21.15.38:0/941092079 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb98146f50 con 0x7fcb80004db0 2020-06-12T17:49:21.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.420+0000 7fcb9c86d700 1 -- 172.21.15.38:0/941092079 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb800041c0 con 0x7fcb800044d0 2020-06-12T17:49:21.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.420+0000 7fcb9c86d700 1 -- 172.21.15.38:0/941092079 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8000bb80 con 0x7fcb80003720 2020-06-12T17:49:21.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.420+0000 7fcb9e070700 1 --2- 172.21.15.38:0/941092079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb80004db0 0x7fcb8000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:21.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.421+0000 7fcb9d86f700 1 --2- 172.21.15.38:0/941092079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb80003720 0x7fcb80003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:21.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.421+0000 7fcb9d06e700 1 --2- 172.21.15.38:0/941092079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb800044d0 0x7fcb80004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:21.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.421+0000 7fcb9e070700 1 -- 172.21.15.38:0/941092079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb80003720 msgr2=0x7fcb80003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:21.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.421+0000 7fcb9e070700 1 --2- 172.21.15.38:0/941092079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb80003720 0x7fcb80003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:21.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.421+0000 7fcb9e070700 1 -- 172.21.15.38:0/941092079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb800044d0 msgr2=0x7fcb80004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:21.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.421+0000 7fcb9e070700 1 --2- 172.21.15.38:0/941092079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb800044d0 0x7fcb80004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:21.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.421+0000 7fcb9e070700 1 -- 172.21.15.38:0/941092079 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb80003230 con 0x7fcb80004db0 2020-06-12T17:49:21.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.421+0000 7fcb9e070700 1 --2- 172.21.15.38:0/941092079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb80004db0 0x7fcb8000b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcb90001760 tx=0x7fcb980aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.421+0000 7fcb9e070700 1 -- 172.21.15.38:0/941092079 reap_dead start 2020-06-12T17:49:21.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.421+0000 7fcb9e070700 1 --2- 172.21.15.38:0/941092079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb80004db0 0x7fcb8000b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcb90001760 tx=0x7fcb980aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.421+0000 7fcb9e070700 1 --2- 172.21.15.38:0/941092079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb80004db0 0x7fcb8000b720 secure :-1 s=READY pgs=466 cs=0 l=1 rx=0x7fcb90001760 tx=0x7fcb980aec70).ready entity=mon.0 client_cookie=641997de881e70bd server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:21.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.421+0000 7fcb9e070700 1 --2- 172.21.15.38:0/941092079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb80004db0 0x7fcb8000b720 secure :-1 s=THROTTLE_DONE pgs=466 cs=0 l=1 rx=0x7fcb90001760 tx=0x7fcb980aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.421+0000 7fcb9e070700 1 --2- 172.21.15.38:0/941092079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb80004db0 0x7fcb8000b720 secure :-1 s=THROTTLE_DONE pgs=466 cs=0 l=1 rx=0x7fcb90001760 tx=0x7fcb980aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.421+0000 7fcb9c86d700 1 -- 172.21.15.38:0/941092079 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb9000ce30 con 0x7fcb80004db0 2020-06-12T17:49:21.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.421+0000 7fcb9e070700 1 --2- 172.21.15.38:0/941092079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb80004db0 0x7fcb8000b720 secure :-1 s=THROTTLE_DONE pgs=466 cs=0 l=1 rx=0x7fcb90001760 tx=0x7fcb980aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.421+0000 7fcb9c86d700 1 -- 172.21.15.38:0/941092079 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9000e540 con 0x7fcb80004db0 2020-06-12T17:49:21.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.421+0000 7fcb9c86d700 1 -- 172.21.15.38:0/941092079 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb9000e8a0 con 0x7fcb80004db0 2020-06-12T17:49:21.435 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.421+0000 7fcb9fad3700 1 -- 172.21.15.38:0/941092079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb80004db0 msgr2=0x7fcb8000b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:21.435 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.421+0000 7fcb9fad3700 1 --2- 172.21.15.38:0/941092079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb80004db0 0x7fcb8000b720 secure :-1 s=READY pgs=466 cs=0 l=1 rx=0x7fcb90001760 tx=0x7fcb980aec70).stop 2020-06-12T17:49:21.435 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.422+0000 7fcb9fad3700 1 -- 172.21.15.38:0/941092079 shutdown_connections 2020-06-12T17:49:21.435 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.422+0000 7fcb9fad3700 1 --2- 172.21.15.38:0/941092079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb80004db0 0x7fcb8000b720 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:21.435 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.422+0000 7fcb9fad3700 1 -- 172.21.15.38:0/941092079 >> 172.21.15.38:0/941092079 conn(0x7fcb980b5a20 msgr2=0x7fcb9805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:21.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.422+0000 7fcb9fad3700 1 -- 172.21.15.38:0/941092079 shutdown_connections 2020-06-12T17:49:21.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.422+0000 7fcb9fad3700 1 -- 172.21.15.38:0/941092079 wait complete. 2020-06-12T17:49:21.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.423+0000 7fcb9fad3700 1 Processor -- start 2020-06-12T17:49:21.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.423+0000 7fcb9fad3700 1 -- start start 2020-06-12T17:49:21.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.423+0000 7fcb9fad3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb980b16b0 0x7fcb980b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:21.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.423+0000 7fcb9fad3700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcb98153210 0x7fcb981536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:21.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.423+0000 7fcb9fad3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb98144660 con 0x7fcb80004db0 2020-06-12T17:49:21.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.423+0000 7fcb9fad3700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb98144900 con 0x7fcb98153210 2020-06-12T17:49:21.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.423+0000 7fcb9fad3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb981567e0 con 0x7fcb980b16b0 2020-06-12T17:49:21.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.423+0000 7fcb9e070700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcb98153210 0x7fcb981536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:21.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.423+0000 7fcb9e070700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcb98153210 0x7fcb981536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37644/0 (socket says 172.21.15.38:37644) 2020-06-12T17:49:21.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.423+0000 7fcb9e070700 1 -- 172.21.15.38:0/73780521 learned_addr learned my addr 172.21.15.38:0/73780521 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:21.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.423+0000 7fcb9d06e700 1 --2- 172.21.15.38:0/73780521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb980b16b0 0x7fcb980b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:21.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.424+0000 7fcb9e070700 1 -- 172.21.15.38:0/73780521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb980b16b0 msgr2=0x7fcb980b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:21.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.424+0000 7fcb9e070700 1 --2- 172.21.15.38:0/73780521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb980b16b0 0x7fcb980b3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:21.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.424+0000 7fcb9e070700 1 -- 172.21.15.38:0/73780521 >> v1:172.21.15.150:6789/0 conn(0x7fcb80004db0 legacy=0x7fcb98143e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:21.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.424+0000 7fcb9e070700 1 -- 172.21.15.38:0/73780521 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9813b730 con 0x7fcb98153210 2020-06-12T17:49:21.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.424+0000 7fcb9e070700 1 --2- 172.21.15.38:0/73780521 >> v2:172.21.15.38:3300/0 conn(0x7fcb98153210 0x7fcb981536a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcb90001760 tx=0x7fcb980aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.424+0000 7fcb9e070700 1 --2- 172.21.15.38:0/73780521 >> v2:172.21.15.38:3300/0 conn(0x7fcb98153210 0x7fcb981536a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcb90001760 tx=0x7fcb980aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.424+0000 7fcb9e070700 1 --2- 172.21.15.38:0/73780521 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb98153210 0x7fcb981536a0 secure :-1 s=READY pgs=467 cs=0 l=1 rx=0x7fcb90001760 tx=0x7fcb980aec70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:21.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.424+0000 7fcb9e070700 1 --2- 172.21.15.38:0/73780521 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb98153210 0x7fcb981536a0 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7fcb90001760 tx=0x7fcb980aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.424+0000 7fcb9e070700 1 --2- 172.21.15.38:0/73780521 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb98153210 0x7fcb981536a0 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7fcb90001760 tx=0x7fcb980aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.424+0000 7fcb86ffd700 1 -- 172.21.15.38:0/73780521 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb9000ce30 con 0x7fcb98153210 2020-06-12T17:49:21.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.424+0000 7fcb9e070700 1 --2- 172.21.15.38:0/73780521 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb98153210 0x7fcb981536a0 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7fcb90001760 tx=0x7fcb980aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.444 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.424+0000 7fcb86ffd700 1 -- 172.21.15.38:0/73780521 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb900108a0 con 0x7fcb98153210 2020-06-12T17:49:21.444 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.424+0000 7fcb9fad3700 1 -- 172.21.15.38:0/73780521 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb9813b980 con 0x7fcb98153210 2020-06-12T17:49:21.444 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.424+0000 7fcb86ffd700 1 -- 172.21.15.38:0/73780521 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb90010c00 con 0x7fcb98153210 2020-06-12T17:49:21.444 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.424+0000 7fcb9fad3700 1 -- 172.21.15.38:0/73780521 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb9813bed0 con 0x7fcb98153210 2020-06-12T17:49:21.444 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.425+0000 7fcb9e070700 1 --2- 172.21.15.38:0/73780521 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb98153210 0x7fcb981536a0 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7fcb90001760 tx=0x7fcb980aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.445 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.425+0000 7fcb9fad3700 1 -- 172.21.15.38:0/73780521 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb98056c30 con 0x7fcb98153210 2020-06-12T17:49:21.445 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.425+0000 7fcb86ffd700 1 -- 172.21.15.38:0/73780521 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fcb90004870 con 0x7fcb98153210 2020-06-12T17:49:21.445 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.425+0000 7fcb9e070700 1 --2- 172.21.15.38:0/73780521 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb98153210 0x7fcb981536a0 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7fcb90001760 tx=0x7fcb980aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.445 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.426+0000 7fcb86ffd700 1 --2- 172.21.15.38:0/73780521 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcb7804d6a0 0x7fcb7804fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:21.446 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.426+0000 7fcb86ffd700 1 -- 172.21.15.38:0/73780521 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcb90061410 con 0x7fcb98153210 2020-06-12T17:49:21.446 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.426+0000 7fcb9d86f700 1 --2- 172.21.15.38:0/73780521 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcb7804d6a0 0x7fcb7804fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:21.446 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.426+0000 7fcb9d86f700 1 --2- 172.21.15.38:0/73780521 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcb7804d6a0 0x7fcb7804fb60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcb980b2a40 tx=0x7fcb88001870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.446 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.426+0000 7fcb9d86f700 1 --2- 172.21.15.38:0/73780521 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcb7804d6a0 0x7fcb7804fb60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcb980b2a40 tx=0x7fcb88001870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.447 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.426+0000 7fcb9d86f700 1 --2- 172.21.15.38:0/73780521 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcb7804d6a0 0x7fcb7804fb60 secure :-1 s=READY pgs=190 cs=0 l=1 rx=0x7fcb980b2a40 tx=0x7fcb88001870).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:21.447 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.429+0000 7fcb9e070700 1 --2- 172.21.15.38:0/73780521 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb98153210 0x7fcb981536a0 secure :-1 s=THROTTLE_DONE pgs=467 cs=0 l=1 rx=0x7fcb90001760 tx=0x7fcb980aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.447 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.429+0000 7fcb86ffd700 1 -- 172.21.15.38:0/73780521 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fcb9003cc50 con 0x7fcb98153210 2020-06-12T17:49:21.625 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.621+0000 7fcb9fad3700 1 -- 172.21.15.38:0/73780521 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_9271", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb98156950 con 0x7fcb7804d6a0 2020-06-12T17:49:21.644 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.641+0000 7fcb9d86f700 1 --2- 172.21.15.38:0/73780521 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcb7804d6a0 0x7fcb7804fb60 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7fcb980b2a40 tx=0x7fcb88001870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.644 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.641+0000 7fcb86ffd700 1 -- 172.21.15.38:0/73780521 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcb98156950 con 0x7fcb7804d6a0 2020-06-12T17:49:21.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.642+0000 7fcb9fad3700 1 -- 172.21.15.38:0/73780521 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcb7804d6a0 msgr2=0x7fcb7804fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:21.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.642+0000 7fcb9fad3700 1 --2- 172.21.15.38:0/73780521 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcb7804d6a0 0x7fcb7804fb60 secure :-1 s=READY pgs=190 cs=0 l=1 rx=0x7fcb980b2a40 tx=0x7fcb88001870).stop 2020-06-12T17:49:21.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.642+0000 7fcb9fad3700 1 -- 172.21.15.38:0/73780521 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb98153210 msgr2=0x7fcb981536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:21.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.642+0000 7fcb9fad3700 1 --2- 172.21.15.38:0/73780521 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb98153210 0x7fcb981536a0 secure :-1 s=READY pgs=467 cs=0 l=1 rx=0x7fcb90001760 tx=0x7fcb980aec70).stop 2020-06-12T17:49:21.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.642+0000 7fcb9fad3700 1 -- 172.21.15.38:0/73780521 shutdown_connections 2020-06-12T17:49:21.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.642+0000 7fcb9fad3700 1 --2- 172.21.15.38:0/73780521 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcb7804d6a0 0x7fcb7804fb60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:21.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.642+0000 7fcb9fad3700 1 --2- 172.21.15.38:0/73780521 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb98153210 0x7fcb981536a0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:21.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.642+0000 7fcb9fad3700 1 --2- 172.21.15.38:0/73780521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb980b16b0 0x7fcb980b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:21.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.642+0000 7fcb9fad3700 1 -- 172.21.15.38:0/73780521 >> 172.21.15.38:0/73780521 conn(0x7fcb980b5a20 msgr2=0x7fcb9813e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:21.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.642+0000 7fcb9fad3700 1 -- 172.21.15.38:0/73780521 shutdown_connections 2020-06-12T17:49:21.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.642+0000 7fcb9fad3700 1 -- 172.21.15.38:0/73780521 wait complete. 2020-06-12T17:49:21.656 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_9271 2020-06-12T17:49:21.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.769+0000 7ff6ba2cd700 1 Processor -- start 2020-06-12T17:49:21.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.769+0000 7ff6ba2cd700 1 -- start start 2020-06-12T17:49:21.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.770+0000 7ff6ba2cd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6b40b2eb0 0x7ff6b414d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:21.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.770+0000 7ff6ba2cd700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b4146d20 con 0x7ff6b40ad5b0 2020-06-12T17:49:21.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.770+0000 7ff6ba2cd700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b4066a80 con 0x7ff6b4146680 2020-06-12T17:49:21.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.770+0000 7ff6ba2cd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b4146f50 con 0x7ff6b40b2eb0 2020-06-12T17:49:21.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.770+0000 7ff6b37fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff6b40ad5b0 0x7ff6b409d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39466/0 (socket says 172.21.15.38:39466) 2020-06-12T17:49:21.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.770+0000 7ff6b37fe700 1 -- 172.21.15.38:0/326251907 learned_addr learned my addr 172.21.15.38:0/326251907 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:21.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.770+0000 7ff6b886a700 1 --2- 172.21.15.38:0/326251907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6b40b2eb0 0x7ff6b414d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:21.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.770+0000 7ff6b2ffd700 1 -- 172.21.15.38:0/326251907 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3057568457 0 0) 0x7ff6b4146d20 con 0x7ff6b40ad5b0 2020-06-12T17:49:21.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.770+0000 7ff6b2ffd700 1 -- 172.21.15.38:0/326251907 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6a0003230 con 0x7ff6b40ad5b0 2020-06-12T17:49:21.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.770+0000 7ff6b2ffd700 1 -- 172.21.15.38:0/326251907 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362190731 0 0) 0x7ff6b4066a80 con 0x7ff6b4146680 2020-06-12T17:49:21.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.770+0000 7ff6b2ffd700 1 -- 172.21.15.38:0/326251907 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6b4146d20 con 0x7ff6b4146680 2020-06-12T17:49:21.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.770+0000 7ff6b2ffd700 1 -- 172.21.15.38:0/326251907 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 959798795 0 0) 0x7ff6a0003230 con 0x7ff6b40ad5b0 2020-06-12T17:49:21.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.770+0000 7ff6b2ffd700 1 -- 172.21.15.38:0/326251907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6b40b2eb0 msgr2=0x7ff6b414d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:21.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.770+0000 7ff6b2ffd700 1 --2- 172.21.15.38:0/326251907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6b40b2eb0 0x7ff6b414d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:21.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.770+0000 7ff6b2ffd700 1 -- 172.21.15.38:0/326251907 >> v1:172.21.15.150:6789/0 conn(0x7ff6b4146680 legacy=0x7ff6b409d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:21.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b2ffd700 1 -- 172.21.15.38:0/326251907 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b4146a60 con 0x7ff6b40ad5b0 2020-06-12T17:49:21.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b2ffd700 1 -- 172.21.15.38:0/326251907 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7ff6a80016d0 con 0x7ff6b40ad5b0 2020-06-12T17:49:21.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b886a700 1 --2- 172.21.15.38:0/326251907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6b40b2eb0 0x7ff6b414d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:49:21.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b2ffd700 1 -- 172.21.15.38:0/326251907 >> v1:172.21.15.38:6789/0 conn(0x7ff6b40ad5b0 legacy=0x7ff6b409d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:21.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b2ffd700 1 --2- 172.21.15.38:0/326251907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6b40b2eb0 0x7ff6a00038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:21.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b2ffd700 1 --2- 172.21.15.38:0/326251907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6a0003d40 0x7ff6a00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:21.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b2ffd700 1 --2- 172.21.15.38:0/326251907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a0004930 0x7ff6a0004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:21.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b2ffd700 1 -- 172.21.15.38:0/326251907 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b4146f50 con 0x7ff6a0004930 2020-06-12T17:49:21.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b2ffd700 1 -- 172.21.15.38:0/326251907 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a0005240 con 0x7ff6a0003d40 2020-06-12T17:49:21.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b2ffd700 1 -- 172.21.15.38:0/326251907 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a000b720 con 0x7ff6b40b2eb0 2020-06-12T17:49:21.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b886a700 1 --2- 172.21.15.38:0/326251907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a0004930 0x7ff6a0004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:21.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b37fe700 1 --2- 172.21.15.38:0/326251907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6a0003d40 0x7ff6a00044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:21.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b3fff700 1 --2- 172.21.15.38:0/326251907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6b40b2eb0 0x7ff6a00038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:21.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b886a700 1 -- 172.21.15.38:0/326251907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6b40b2eb0 msgr2=0x7ff6a00038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:21.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b886a700 1 --2- 172.21.15.38:0/326251907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6b40b2eb0 0x7ff6a00038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:21.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b886a700 1 -- 172.21.15.38:0/326251907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6a0003d40 msgr2=0x7ff6a00044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:21.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b886a700 1 --2- 172.21.15.38:0/326251907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6a0003d40 0x7ff6a00044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:21.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b886a700 1 -- 172.21.15.38:0/326251907 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a0003230 con 0x7ff6a0004930 2020-06-12T17:49:21.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b886a700 1 --2- 172.21.15.38:0/326251907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a0004930 0x7ff6a0004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff6ac0032b0 tx=0x7ff6ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b886a700 1 --2- 172.21.15.38:0/326251907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a0004930 0x7ff6a0004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff6ac0032b0 tx=0x7ff6ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b886a700 1 --2- 172.21.15.38:0/326251907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a0004930 0x7ff6a0004db0 secure :-1 s=READY pgs=469 cs=0 l=1 rx=0x7ff6ac0032b0 tx=0x7ff6ac0081e0).ready entity=mon.0 client_cookie=90745514492c7525 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:21.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b886a700 1 --2- 172.21.15.38:0/326251907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a0004930 0x7ff6a0004db0 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7ff6ac0032b0 tx=0x7ff6ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b2ffd700 1 -- 172.21.15.38:0/326251907 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6ac005c30 con 0x7ff6a0004930 2020-06-12T17:49:21.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b886a700 1 --2- 172.21.15.38:0/326251907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a0004930 0x7ff6a0004db0 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7ff6ac0032b0 tx=0x7ff6ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b2ffd700 1 -- 172.21.15.38:0/326251907 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ac005d90 con 0x7ff6a0004930 2020-06-12T17:49:21.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b886a700 1 --2- 172.21.15.38:0/326251907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a0004930 0x7ff6a0004db0 secure :-1 s=THROTTLE_DONE pgs=469 cs=0 l=1 rx=0x7ff6ac0032b0 tx=0x7ff6ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6ba2cd700 1 -- 172.21.15.38:0/326251907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a0004930 msgr2=0x7ff6a0004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:21.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b2ffd700 1 -- 172.21.15.38:0/326251907 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6ac00e350 con 0x7ff6a0004930 2020-06-12T17:49:21.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6ba2cd700 1 --2- 172.21.15.38:0/326251907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a0004930 0x7ff6a0004db0 secure :-1 s=READY pgs=469 cs=0 l=1 rx=0x7ff6ac0032b0 tx=0x7ff6ac0081e0).stop 2020-06-12T17:49:21.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.771+0000 7ff6b886a700 1 -- 172.21.15.38:0/326251907 reap_dead start 2020-06-12T17:49:21.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.772+0000 7ff6ba2cd700 1 -- 172.21.15.38:0/326251907 shutdown_connections 2020-06-12T17:49:21.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.772+0000 7ff6ba2cd700 1 -- 172.21.15.38:0/326251907 >> 172.21.15.38:0/326251907 conn(0x7ff6b40b5a20 msgr2=0x7ff6b405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:21.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.772+0000 7ff6ba2cd700 1 -- 172.21.15.38:0/326251907 shutdown_connections 2020-06-12T17:49:21.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.772+0000 7ff6ba2cd700 1 -- 172.21.15.38:0/326251907 wait complete. 2020-06-12T17:49:21.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.773+0000 7ff6ba2cd700 1 Processor -- start 2020-06-12T17:49:21.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.773+0000 7ff6ba2cd700 1 -- start start 2020-06-12T17:49:21.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.774+0000 7ff6ba2cd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff6b412ebe0 0x7ff6b40b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:21.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.774+0000 7ff6ba2cd700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b40b0c90 con 0x7ff6b412e800 2020-06-12T17:49:21.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.774+0000 7ff6ba2cd700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b4063310 con 0x7ff6b40b05e0 2020-06-12T17:49:21.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.774+0000 7ff6ba2cd700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b4063070 con 0x7ff6b412ebe0 2020-06-12T17:49:21.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.774+0000 7ff6b3fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff6b412e800 0x7ff6b40625e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39476/0 (socket says 172.21.15.38:39476) 2020-06-12T17:49:21.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.774+0000 7ff6b3fff700 1 -- 172.21.15.38:0/3708713950 learned_addr learned my addr 172.21.15.38:0/3708713950 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:21.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.774+0000 7ff6b886a700 1 --2- 172.21.15.38:0/3708713950 >> v2:172.21.15.38:3300/0 conn(0x7ff6b412ebe0 0x7ff6b40b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:21.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.774+0000 7ff6b17fa700 1 -- 172.21.15.38:0/3708713950 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545412109 0 0) 0x7ff6b40b0c90 con 0x7ff6b412e800 2020-06-12T17:49:21.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.774+0000 7ff6b17fa700 1 -- 172.21.15.38:0/3708713950 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff694002fe0 con 0x7ff6b412e800 2020-06-12T17:49:21.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.774+0000 7ff6b886a700 1 -- 172.21.15.38:0/3708713950 >> v1:172.21.15.150:6789/0 conn(0x7ff6b40b05e0 legacy=0x7ff6b40b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:21.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.774+0000 7ff6b886a700 1 -- 172.21.15.38:0/3708713950 >> v1:172.21.15.38:6789/0 conn(0x7ff6b412e800 legacy=0x7ff6b40625e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:21.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.774+0000 7ff6b886a700 1 -- 172.21.15.38:0/3708713950 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b4063710 con 0x7ff6b412ebe0 2020-06-12T17:49:21.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.774+0000 7ff6b886a700 1 --2- 172.21.15.38:0/3708713950 >> v2:172.21.15.38:3300/0 conn(0x7ff6b412ebe0 0x7ff6b40b1800 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff6a80018b0 tx=0x7ff6ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.774+0000 7ff6b886a700 1 --2- 172.21.15.38:0/3708713950 >> v2:172.21.15.38:3300/0 conn(0x7ff6b412ebe0 0x7ff6b40b1800 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff6a80018b0 tx=0x7ff6ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.774+0000 7ff6b886a700 1 --2- 172.21.15.38:0/3708713950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6b412ebe0 0x7ff6b40b1800 secure :-1 s=READY pgs=471 cs=0 l=1 rx=0x7ff6a80018b0 tx=0x7ff6ac0081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:21.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.774+0000 7ff6b886a700 1 --2- 172.21.15.38:0/3708713950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6b412ebe0 0x7ff6b40b1800 secure :-1 s=THROTTLE_DONE pgs=471 cs=0 l=1 rx=0x7ff6a80018b0 tx=0x7ff6ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.800 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.774+0000 7ff6b17fa700 1 -- 172.21.15.38:0/3708713950 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6ac011460 con 0x7ff6b412ebe0 2020-06-12T17:49:21.800 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.774+0000 7ff6b886a700 1 --2- 172.21.15.38:0/3708713950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6b412ebe0 0x7ff6b40b1800 secure :-1 s=THROTTLE_DONE pgs=471 cs=0 l=1 rx=0x7ff6a80018b0 tx=0x7ff6ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.800 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.774+0000 7ff6b886a700 1 --2- 172.21.15.38:0/3708713950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6b412ebe0 0x7ff6b40b1800 secure :-1 s=THROTTLE_DONE pgs=471 cs=0 l=1 rx=0x7ff6a80018b0 tx=0x7ff6ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.800 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.774+0000 7ff6b17fa700 1 -- 172.21.15.38:0/3708713950 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ac0115c0 con 0x7ff6b412ebe0 2020-06-12T17:49:21.800 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.774+0000 7ff6ba2cd700 1 -- 172.21.15.38:0/3708713950 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b4062cf0 con 0x7ff6b412ebe0 2020-06-12T17:49:21.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.774+0000 7ff6b17fa700 1 -- 172.21.15.38:0/3708713950 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6ac007150 con 0x7ff6b412ebe0 2020-06-12T17:49:21.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.774+0000 7ff6ba2cd700 1 -- 172.21.15.38:0/3708713950 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b40b1e20 con 0x7ff6b412ebe0 2020-06-12T17:49:21.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.775+0000 7ff6b886a700 1 --2- 172.21.15.38:0/3708713950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6b412ebe0 0x7ff6b40b1800 secure :-1 s=THROTTLE_DONE pgs=471 cs=0 l=1 rx=0x7ff6a80018b0 tx=0x7ff6ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.775+0000 7ff6ba2cd700 1 -- 172.21.15.38:0/3708713950 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b40b23f0 con 0x7ff6b412ebe0 2020-06-12T17:49:21.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.776+0000 7ff6b17fa700 1 -- 172.21.15.38:0/3708713950 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7ff6ac0072b0 con 0x7ff6b412ebe0 2020-06-12T17:49:21.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.776+0000 7ff6b886a700 1 --2- 172.21.15.38:0/3708713950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6b412ebe0 0x7ff6b40b1800 secure :-1 s=THROTTLE_DONE pgs=471 cs=0 l=1 rx=0x7ff6a80018b0 tx=0x7ff6ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.776+0000 7ff6b17fa700 1 --2- 172.21.15.38:0/3708713950 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff69404d9c0 0x7ff69404fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:21.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.776+0000 7ff6b17fa700 1 -- 172.21.15.38:0/3708713950 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff6ac060d60 con 0x7ff6b412ebe0 2020-06-12T17:49:21.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.776+0000 7ff6b3fff700 1 --2- 172.21.15.38:0/3708713950 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff69404d9c0 0x7ff69404fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:21.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.776+0000 7ff6b3fff700 1 --2- 172.21.15.38:0/3708713950 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff69404d9c0 0x7ff69404fe80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff6a40010d0 tx=0x7ff6a40019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.776+0000 7ff6b3fff700 1 --2- 172.21.15.38:0/3708713950 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff69404d9c0 0x7ff69404fe80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff6a40010d0 tx=0x7ff6a40019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.776+0000 7ff6b3fff700 1 --2- 172.21.15.38:0/3708713950 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff69404d9c0 0x7ff69404fe80 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7ff6a40010d0 tx=0x7ff6a40019a0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:21.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.779+0000 7ff6b886a700 1 --2- 172.21.15.38:0/3708713950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6b412ebe0 0x7ff6b40b1800 secure :-1 s=THROTTLE_DONE pgs=471 cs=0 l=1 rx=0x7ff6a80018b0 tx=0x7ff6ac0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.779+0000 7ff6b17fa700 1 -- 172.21.15.38:0/3708713950 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7ff6ac03c5a0 con 0x7ff6b412ebe0 2020-06-12T17:49:21.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.974+0000 7ff6ba2cd700 1 -- 172.21.15.38:0/3708713950 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_9271", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6b40b0e50 con 0x7ff69404d9c0 2020-06-12T17:49:21.980 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.977+0000 7ff6b3fff700 1 --2- 172.21.15.38:0/3708713950 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff69404d9c0 0x7ff69404fe80 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7ff6a40010d0 tx=0x7ff6a40019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:21.981 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.977+0000 7ff6b17fa700 1 -- 172.21.15.38:0/3708713950 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7ff6a4009580 con 0x7ff69404d9c0 2020-06-12T17:49:21.981 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_9271/08bf1df2-9eb6-46a3-8a68-17e3b26f1fdc 2020-06-12T17:49:21.982 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.978+0000 7ff6ba2cd700 1 -- 172.21.15.38:0/3708713950 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff69404d9c0 msgr2=0x7ff69404fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:21.982 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.978+0000 7ff6ba2cd700 1 --2- 172.21.15.38:0/3708713950 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff69404d9c0 0x7ff69404fe80 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7ff6a40010d0 tx=0x7ff6a40019a0).stop 2020-06-12T17:49:21.983 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.978+0000 7ff6ba2cd700 1 -- 172.21.15.38:0/3708713950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6b412ebe0 msgr2=0x7ff6b40b1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:21.983 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.978+0000 7ff6ba2cd700 1 --2- 172.21.15.38:0/3708713950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6b412ebe0 0x7ff6b40b1800 secure :-1 s=READY pgs=471 cs=0 l=1 rx=0x7ff6a80018b0 tx=0x7ff6ac0081e0).stop 2020-06-12T17:49:21.983 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.978+0000 7ff6ba2cd700 1 -- 172.21.15.38:0/3708713950 shutdown_connections 2020-06-12T17:49:21.983 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.978+0000 7ff6ba2cd700 1 --2- 172.21.15.38:0/3708713950 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff69404d9c0 0x7ff69404fe80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:21.983 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.978+0000 7ff6ba2cd700 1 --2- 172.21.15.38:0/3708713950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6b412ebe0 0x7ff6b40b1800 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:21.984 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.978+0000 7ff6ba2cd700 1 -- 172.21.15.38:0/3708713950 >> 172.21.15.38:0/3708713950 conn(0x7ff6b40b5a20 msgr2=0x7ff6b41376b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:21.984 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.978+0000 7ff6ba2cd700 1 -- 172.21.15.38:0/3708713950 shutdown_connections 2020-06-12T17:49:21.984 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:21.978+0000 7ff6ba2cd700 1 -- 172.21.15.38:0/3708713950 wait complete. 2020-06-12T17:49:21.992 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_9271 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_9271/08bf1df2-9eb6-46a3-8a68-17e3b26f1fdc 2020-06-12T17:49:21.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:21.993 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:21.993 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:22.009 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:22.009 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:22.010 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9271/08bf1df2-9eb6-46a3-8a68-17e3b26f1fdc/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:22.102 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:22.102 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:22.102 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120604 s, 86.9 MB/s 2020-06-12T17:49:22.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:22.104 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:22.105 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:22.120 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:22.120 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:22.121 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9271/08bf1df2-9eb6-46a3-8a68-17e3b26f1fdc/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:22.209 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:22.210 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:22.210 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130506 s, 80.3 MB/s 2020-06-12T17:49:22.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:22.212 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:22.212 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:22.227 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:22.227 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:22.228 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9271/08bf1df2-9eb6-46a3-8a68-17e3b26f1fdc/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:22.314 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:22.315 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:22.315 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104903 s, 100 MB/s 2020-06-12T17:49:22.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:22.317 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:22.317 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:22.332 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:22.333 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:22.334 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9271/08bf1df2-9eb6-46a3-8a68-17e3b26f1fdc/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:22.419 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:22.419 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:22.419 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972111 s, 108 MB/s 2020-06-12T17:49:22.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:22.421 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:22.421 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:22.436 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:22.437 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:22.438 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9271/08bf1df2-9eb6-46a3-8a68-17e3b26f1fdc/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:22.524 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:22.525 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:22.525 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114268 s, 91.8 MB/s 2020-06-12T17:49:22.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:22.532 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:22.533 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:22.548 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:22.549 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:22.550 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9271/08bf1df2-9eb6-46a3-8a68-17e3b26f1fdc/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:22.640 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:22.640 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:22.640 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139644 s, 75.1 MB/s 2020-06-12T17:49:22.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:22.642 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:22.642 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:22.657 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:22.658 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:22.658 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9271/08bf1df2-9eb6-46a3-8a68-17e3b26f1fdc/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:22.744 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:22.745 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:22.745 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107648 s, 97.4 MB/s 2020-06-12T17:49:22.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:22.746 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:22.747 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:22.763 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:22.765 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:22.765 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9271/08bf1df2-9eb6-46a3-8a68-17e3b26f1fdc/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:22.857 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:22.858 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:22.858 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113492 s, 92.4 MB/s 2020-06-12T17:49:22.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:22.859 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:22.860 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:22.875 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:22.875 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:22.876 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9271/08bf1df2-9eb6-46a3-8a68-17e3b26f1fdc/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:22.968 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:22.969 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:22.969 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010509 s, 99.8 MB/s 2020-06-12T17:49:22.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:22.970 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:22.970 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:22.986 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:22.987 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:22.987 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9271/08bf1df2-9eb6-46a3-8a68-17e3b26f1fdc/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:23.074 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:23.075 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:23.075 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119332 s, 87.9 MB/s 2020-06-12T17:49:23.076 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_6511 2020-06-12T17:49:23.192 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.189+0000 7fcd9a49a700 1 Processor -- start 2020-06-12T17:49:23.193 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.189+0000 7fcd9a49a700 1 -- start start 2020-06-12T17:49:23.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.190+0000 7fcd9a49a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd94146680 0x7fcd940ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:23.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.190+0000 7fcd9a49a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcd940b2eb0 0x7fcd9409d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:23.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.190+0000 7fcd9a49a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd94146d20 con 0x7fcd9409d620 2020-06-12T17:49:23.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.190+0000 7fcd9a49a700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd94066a80 con 0x7fcd940b2eb0 2020-06-12T17:49:23.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.190+0000 7fcd9a49a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd94146f50 con 0x7fcd94146680 2020-06-12T17:49:23.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.190+0000 7fcd937fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcd940b2eb0 0x7fcd9409d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:23.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.190+0000 7fcd937fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcd940b2eb0 0x7fcd9409d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37670/0 (socket says 172.21.15.38:37670) 2020-06-12T17:49:23.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.190+0000 7fcd937fe700 1 -- 172.21.15.38:0/1948138833 learned_addr learned my addr 172.21.15.38:0/1948138833 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:23.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.190+0000 7fcd93fff700 1 --2- 172.21.15.38:0/1948138833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd94146680 0x7fcd940ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:23.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.190+0000 7fcd937fe700 1 -- 172.21.15.38:0/1948138833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd94146680 msgr2=0x7fcd940ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:23.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.190+0000 7fcd937fe700 1 --2- 172.21.15.38:0/1948138833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd94146680 0x7fcd940ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:23.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.190+0000 7fcd937fe700 1 -- 172.21.15.38:0/1948138833 >> v1:172.21.15.150:6789/0 conn(0x7fcd9409d620 legacy=0x7fcd9409b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:23.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.190+0000 7fcd937fe700 1 -- 172.21.15.38:0/1948138833 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd94146a60 con 0x7fcd940b2eb0 2020-06-12T17:49:23.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.190+0000 7fcd93fff700 1 --2- 172.21.15.38:0/1948138833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd94146680 0x7fcd940ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:49:23.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.190+0000 7fcd937fe700 1 --2- 172.21.15.38:0/1948138833 >> v2:172.21.15.38:3300/0 conn(0x7fcd940b2eb0 0x7fcd9409d1c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcd88002f30 tx=0x7fcd88007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.190+0000 7fcd937fe700 1 --2- 172.21.15.38:0/1948138833 >> v2:172.21.15.38:3300/0 conn(0x7fcd940b2eb0 0x7fcd9409d1c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcd88002f30 tx=0x7fcd88007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.190+0000 7fcd937fe700 1 --2- 172.21.15.38:0/1948138833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd940b2eb0 0x7fcd9409d1c0 secure :-1 s=READY pgs=472 cs=0 l=1 rx=0x7fcd88002f30 tx=0x7fcd88007e60).ready entity=mon.0 client_cookie=9a7dd61b8cf26076 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:23.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.190+0000 7fcd937fe700 1 --2- 172.21.15.38:0/1948138833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd940b2eb0 0x7fcd9409d1c0 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7fcd88002f30 tx=0x7fcd88007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.190+0000 7fcd92ffd700 1 -- 172.21.15.38:0/1948138833 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd880116e0 con 0x7fcd940b2eb0 2020-06-12T17:49:23.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.190+0000 7fcd937fe700 1 --2- 172.21.15.38:0/1948138833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd940b2eb0 0x7fcd9409d1c0 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7fcd88002f30 tx=0x7fcd88007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.190+0000 7fcd937fe700 1 --2- 172.21.15.38:0/1948138833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd940b2eb0 0x7fcd9409d1c0 secure :-1 s=THROTTLE_DONE pgs=472 cs=0 l=1 rx=0x7fcd88002f30 tx=0x7fcd88007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.203 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.190+0000 7fcd92ffd700 1 -- 172.21.15.38:0/1948138833 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd88011840 con 0x7fcd940b2eb0 2020-06-12T17:49:23.203 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.190+0000 7fcd92ffd700 1 -- 172.21.15.38:0/1948138833 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd88011c60 con 0x7fcd940b2eb0 2020-06-12T17:49:23.203 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.190+0000 7fcd9a49a700 1 -- 172.21.15.38:0/1948138833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd940b2eb0 msgr2=0x7fcd9409d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:23.203 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.190+0000 7fcd9a49a700 1 --2- 172.21.15.38:0/1948138833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd940b2eb0 0x7fcd9409d1c0 secure :-1 s=READY pgs=472 cs=0 l=1 rx=0x7fcd88002f30 tx=0x7fcd88007e60).stop 2020-06-12T17:49:23.203 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.191+0000 7fcd9a49a700 1 -- 172.21.15.38:0/1948138833 shutdown_connections 2020-06-12T17:49:23.204 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.191+0000 7fcd9a49a700 1 --2- 172.21.15.38:0/1948138833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd94146680 0x7fcd940ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:23.204 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.191+0000 7fcd9a49a700 1 --2- 172.21.15.38:0/1948138833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd940b2eb0 0x7fcd9409d1c0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:23.204 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.191+0000 7fcd9a49a700 1 -- 172.21.15.38:0/1948138833 >> 172.21.15.38:0/1948138833 conn(0x7fcd940b5a20 msgr2=0x7fcd9405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:23.204 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.191+0000 7fcd9a49a700 1 -- 172.21.15.38:0/1948138833 shutdown_connections 2020-06-12T17:49:23.204 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.191+0000 7fcd9a49a700 1 -- 172.21.15.38:0/1948138833 wait complete. 2020-06-12T17:49:23.204 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.192+0000 7fcd9a49a700 1 Processor -- start 2020-06-12T17:49:23.205 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.192+0000 7fcd9a49a700 1 -- start start 2020-06-12T17:49:23.205 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.193+0000 7fcd9a49a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcd94146680 0x7fcd940b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:23.205 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.193+0000 7fcd9a49a700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd94153bc0 con 0x7fcd9409d620 2020-06-12T17:49:23.205 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.193+0000 7fcd9a49a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd94153e60 con 0x7fcd940b2eb0 2020-06-12T17:49:23.205 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.193+0000 7fcd9a49a700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd941539b0 con 0x7fcd94146680 2020-06-12T17:49:23.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.193+0000 7fcd93fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fcd9409d620 0x7fcd94157650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39490/0 (socket says 172.21.15.38:39490) 2020-06-12T17:49:23.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.193+0000 7fcd93fff700 1 -- 172.21.15.38:0/23936973 learned_addr learned my addr 172.21.15.38:0/23936973 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:23.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.193+0000 7fcd98a37700 1 --2- 172.21.15.38:0/23936973 >> v2:172.21.15.38:3300/0 conn(0x7fcd94146680 0x7fcd940b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:23.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.193+0000 7fcd917fa700 1 -- 172.21.15.38:0/23936973 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437494619 0 0) 0x7fcd94153bc0 con 0x7fcd9409d620 2020-06-12T17:49:23.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.193+0000 7fcd917fa700 1 -- 172.21.15.38:0/23936973 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd74002fe0 con 0x7fcd9409d620 2020-06-12T17:49:23.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.193+0000 7fcd98a37700 1 -- 172.21.15.38:0/23936973 >> v1:172.21.15.150:6789/0 conn(0x7fcd940b2eb0 legacy=0x7fcd94091c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:23.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.193+0000 7fcd98a37700 1 -- 172.21.15.38:0/23936973 >> v1:172.21.15.38:6789/0 conn(0x7fcd9409d620 legacy=0x7fcd94157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:23.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.193+0000 7fcd98a37700 1 -- 172.21.15.38:0/23936973 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd94092380 con 0x7fcd94146680 2020-06-12T17:49:23.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.193+0000 7fcd98a37700 1 --2- 172.21.15.38:0/23936973 >> v2:172.21.15.38:3300/0 conn(0x7fcd94146680 0x7fcd940b3ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcd94153840 tx=0x7fcd8c001a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.193+0000 7fcd98a37700 1 --2- 172.21.15.38:0/23936973 >> v2:172.21.15.38:3300/0 conn(0x7fcd94146680 0x7fcd940b3ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcd94153840 tx=0x7fcd8c001a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.193+0000 7fcd98a37700 1 --2- 172.21.15.38:0/23936973 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd94146680 0x7fcd940b3ff0 secure :-1 s=READY pgs=474 cs=0 l=1 rx=0x7fcd94153840 tx=0x7fcd8c001a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:23.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.193+0000 7fcd98a37700 1 --2- 172.21.15.38:0/23936973 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd94146680 0x7fcd940b3ff0 secure :-1 s=THROTTLE_DONE pgs=474 cs=0 l=1 rx=0x7fcd94153840 tx=0x7fcd8c001a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.193+0000 7fcd917fa700 1 -- 172.21.15.38:0/23936973 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd8c002220 con 0x7fcd94146680 2020-06-12T17:49:23.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.193+0000 7fcd98a37700 1 --2- 172.21.15.38:0/23936973 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd94146680 0x7fcd940b3ff0 secure :-1 s=THROTTLE_DONE pgs=474 cs=0 l=1 rx=0x7fcd94153840 tx=0x7fcd8c001a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.193+0000 7fcd98a37700 1 --2- 172.21.15.38:0/23936973 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd94146680 0x7fcd940b3ff0 secure :-1 s=THROTTLE_DONE pgs=474 cs=0 l=1 rx=0x7fcd94153840 tx=0x7fcd8c001a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.193+0000 7fcd917fa700 1 -- 172.21.15.38:0/23936973 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8c002380 con 0x7fcd94146680 2020-06-12T17:49:23.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.194+0000 7fcd9a49a700 1 -- 172.21.15.38:0/23936973 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd94154300 con 0x7fcd94146680 2020-06-12T17:49:23.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.194+0000 7fcd917fa700 1 -- 172.21.15.38:0/23936973 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd8c002760 con 0x7fcd94146680 2020-06-12T17:49:23.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.194+0000 7fcd9a49a700 1 -- 172.21.15.38:0/23936973 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd94154770 con 0x7fcd94146680 2020-06-12T17:49:23.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.194+0000 7fcd98a37700 1 --2- 172.21.15.38:0/23936973 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd94146680 0x7fcd940b3ff0 secure :-1 s=THROTTLE_DONE pgs=474 cs=0 l=1 rx=0x7fcd94153840 tx=0x7fcd8c001a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.195+0000 7fcd917fa700 1 -- 172.21.15.38:0/23936973 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fcd8c0029d0 con 0x7fcd94146680 2020-06-12T17:49:23.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.195+0000 7fcd98a37700 1 --2- 172.21.15.38:0/23936973 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd94146680 0x7fcd940b3ff0 secure :-1 s=THROTTLE_DONE pgs=474 cs=0 l=1 rx=0x7fcd94153840 tx=0x7fcd8c001a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.195+0000 7fcd9a49a700 1 -- 172.21.15.38:0/23936973 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd94154020 con 0x7fcd94146680 2020-06-12T17:49:23.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.195+0000 7fcd917fa700 1 --2- 172.21.15.38:0/23936973 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcd7404d910 0x7fcd7404fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:23.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.195+0000 7fcd917fa700 1 -- 172.21.15.38:0/23936973 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcd8c061360 con 0x7fcd94146680 2020-06-12T17:49:23.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.195+0000 7fcd93fff700 1 --2- 172.21.15.38:0/23936973 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcd7404d910 0x7fcd7404fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:23.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.195+0000 7fcd93fff700 1 --2- 172.21.15.38:0/23936973 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcd7404d910 0x7fcd7404fdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcd84002f30 tx=0x7fcd84007ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.195+0000 7fcd93fff700 1 --2- 172.21.15.38:0/23936973 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcd7404d910 0x7fcd7404fdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcd84002f30 tx=0x7fcd84007ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.195+0000 7fcd93fff700 1 --2- 172.21.15.38:0/23936973 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcd7404d910 0x7fcd7404fdd0 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7fcd84002f30 tx=0x7fcd84007ea0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:23.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.198+0000 7fcd98a37700 1 --2- 172.21.15.38:0/23936973 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd94146680 0x7fcd940b3ff0 secure :-1 s=THROTTLE_DONE pgs=474 cs=0 l=1 rx=0x7fcd94153840 tx=0x7fcd8c001a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.198+0000 7fcd917fa700 1 -- 172.21.15.38:0/23936973 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fcd8c03cae0 con 0x7fcd94146680 2020-06-12T17:49:23.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.395+0000 7fcd9a49a700 1 -- 172.21.15.38:0/23936973 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_6511", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd94067b20 con 0x7fcd7404d910 2020-06-12T17:49:23.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.412+0000 7fcd93fff700 1 --2- 172.21.15.38:0/23936973 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcd7404d910 0x7fcd7404fdd0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7fcd84002f30 tx=0x7fcd84007ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.417 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.412+0000 7fcd917fa700 1 -- 172.21.15.38:0/23936973 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcd94067b20 con 0x7fcd7404d910 2020-06-12T17:49:23.418 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.414+0000 7fcd9a49a700 1 -- 172.21.15.38:0/23936973 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcd7404d910 msgr2=0x7fcd7404fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:23.418 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.414+0000 7fcd9a49a700 1 --2- 172.21.15.38:0/23936973 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcd7404d910 0x7fcd7404fdd0 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7fcd84002f30 tx=0x7fcd84007ea0).stop 2020-06-12T17:49:23.418 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.414+0000 7fcd9a49a700 1 -- 172.21.15.38:0/23936973 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd94146680 msgr2=0x7fcd940b3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:23.419 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.414+0000 7fcd9a49a700 1 --2- 172.21.15.38:0/23936973 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd94146680 0x7fcd940b3ff0 secure :-1 s=READY pgs=474 cs=0 l=1 rx=0x7fcd94153840 tx=0x7fcd8c001a80).stop 2020-06-12T17:49:23.419 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.414+0000 7fcd9a49a700 1 -- 172.21.15.38:0/23936973 shutdown_connections 2020-06-12T17:49:23.419 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.414+0000 7fcd9a49a700 1 --2- 172.21.15.38:0/23936973 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcd7404d910 0x7fcd7404fdd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:23.419 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.414+0000 7fcd9a49a700 1 --2- 172.21.15.38:0/23936973 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd94146680 0x7fcd940b3ff0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:23.419 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.414+0000 7fcd9a49a700 1 -- 172.21.15.38:0/23936973 >> 172.21.15.38:0/23936973 conn(0x7fcd940b5a20 msgr2=0x7fcd9405b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:23.420 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.414+0000 7fcd9a49a700 1 -- 172.21.15.38:0/23936973 shutdown_connections 2020-06-12T17:49:23.420 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.414+0000 7fcd9a49a700 1 -- 172.21.15.38:0/23936973 wait complete. 2020-06-12T17:49:23.428 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_6511 2020-06-12T17:49:23.544 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.541+0000 7f189184e700 1 Processor -- start 2020-06-12T17:49:23.545 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.541+0000 7f189184e700 1 -- start start 2020-06-12T17:49:23.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.542+0000 7f189184e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f188c146680 0x7f188c0ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:23.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.542+0000 7f189184e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f188c09d8d0 0x7f188c1421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:23.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.542+0000 7f189184e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f188c146d20 con 0x7f188c0b2eb0 2020-06-12T17:49:23.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.542+0000 7f189184e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f188c066a80 con 0x7f188c146680 2020-06-12T17:49:23.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.542+0000 7f189184e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f188c146f50 con 0x7f188c09d8d0 2020-06-12T17:49:23.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.542+0000 7f188affd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f188c146680 0x7f188c0ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:23.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.542+0000 7f188affd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f188c146680 0x7f188c0ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37684/0 (socket says 172.21.15.38:37684) 2020-06-12T17:49:23.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.542+0000 7f188affd700 1 -- 172.21.15.38:0/1101985196 learned_addr learned my addr 172.21.15.38:0/1101985196 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:23.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.542+0000 7f188b7fe700 1 --2- 172.21.15.38:0/1101985196 >> v2:172.21.15.150:3300/0 conn(0x7f188c09d8d0 0x7f188c1421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:23.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.542+0000 7f188affd700 1 -- 172.21.15.38:0/1101985196 >> v2:172.21.15.150:3300/0 conn(0x7f188c09d8d0 msgr2=0x7f188c1421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:23.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.542+0000 7f188affd700 1 --2- 172.21.15.38:0/1101985196 >> v2:172.21.15.150:3300/0 conn(0x7f188c09d8d0 0x7f188c1421d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:23.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.542+0000 7f188affd700 1 -- 172.21.15.38:0/1101985196 >> v1:172.21.15.150:6789/0 conn(0x7f188c0b2eb0 legacy=0x7f188c09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:23.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.542+0000 7f188affd700 1 -- 172.21.15.38:0/1101985196 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188c146a60 con 0x7f188c146680 2020-06-12T17:49:23.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.542+0000 7f188affd700 1 --2- 172.21.15.38:0/1101985196 >> v2:172.21.15.38:3300/0 conn(0x7f188c146680 0x7f188c0ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1880002f30 tx=0x7f1880007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.542+0000 7f188affd700 1 --2- 172.21.15.38:0/1101985196 >> v2:172.21.15.38:3300/0 conn(0x7f188c146680 0x7f188c0ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1880002f30 tx=0x7f1880007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.542+0000 7f188affd700 1 --2- 172.21.15.38:0/1101985196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f188c146680 0x7f188c0ad5b0 secure :-1 s=READY pgs=475 cs=0 l=1 rx=0x7f1880002f30 tx=0x7f1880007e60).ready entity=mon.0 client_cookie=268b53596fed8f35 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:23.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.543+0000 7f188affd700 1 --2- 172.21.15.38:0/1101985196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f188c146680 0x7f188c0ad5b0 secure :-1 s=THROTTLE_DONE pgs=475 cs=0 l=1 rx=0x7f1880002f30 tx=0x7f1880007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.543+0000 7f188affd700 1 --2- 172.21.15.38:0/1101985196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f188c146680 0x7f188c0ad5b0 secure :-1 s=THROTTLE_DONE pgs=475 cs=0 l=1 rx=0x7f1880002f30 tx=0x7f1880007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.543+0000 7f1889ffb700 1 -- 172.21.15.38:0/1101985196 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1880011630 con 0x7f188c146680 2020-06-12T17:49:23.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.543+0000 7f188affd700 1 --2- 172.21.15.38:0/1101985196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f188c146680 0x7f188c0ad5b0 secure :-1 s=THROTTLE_DONE pgs=475 cs=0 l=1 rx=0x7f1880002f30 tx=0x7f1880007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.543+0000 7f1889ffb700 1 -- 172.21.15.38:0/1101985196 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1880011790 con 0x7f188c146680 2020-06-12T17:49:23.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.543+0000 7f1889ffb700 1 -- 172.21.15.38:0/1101985196 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1880011b70 con 0x7f188c146680 2020-06-12T17:49:23.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.543+0000 7f189184e700 1 -- 172.21.15.38:0/1101985196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f188c146680 msgr2=0x7f188c0ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:23.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.543+0000 7f189184e700 1 --2- 172.21.15.38:0/1101985196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f188c146680 0x7f188c0ad5b0 secure :-1 s=READY pgs=475 cs=0 l=1 rx=0x7f1880002f30 tx=0x7f1880007e60).stop 2020-06-12T17:49:23.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.543+0000 7f189184e700 1 -- 172.21.15.38:0/1101985196 shutdown_connections 2020-06-12T17:49:23.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.543+0000 7f189184e700 1 --2- 172.21.15.38:0/1101985196 >> v2:172.21.15.150:3300/0 conn(0x7f188c09d8d0 0x7f188c1421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:23.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.543+0000 7f189184e700 1 --2- 172.21.15.38:0/1101985196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f188c146680 0x7f188c0ad5b0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:23.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.543+0000 7f189184e700 1 -- 172.21.15.38:0/1101985196 >> 172.21.15.38:0/1101985196 conn(0x7f188c0b5a20 msgr2=0x7f188c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:23.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.543+0000 7f189184e700 1 -- 172.21.15.38:0/1101985196 shutdown_connections 2020-06-12T17:49:23.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.543+0000 7f189184e700 1 -- 172.21.15.38:0/1101985196 wait complete. 2020-06-12T17:49:23.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.544+0000 7f189184e700 1 Processor -- start 2020-06-12T17:49:23.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.544+0000 7f189184e700 1 -- start start 2020-06-12T17:49:23.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.545+0000 7f189184e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f188c09d8d0 0x7f188c065ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:23.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.545+0000 7f189184e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f188c146680 0x7f188c09a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:23.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.545+0000 7f189184e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f188c143210 con 0x7f188c0b2eb0 2020-06-12T17:49:23.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.545+0000 7f189184e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f188c092380 con 0x7f188c146680 2020-06-12T17:49:23.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.545+0000 7f189184e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188c157650 con 0x7f188c09d8d0 2020-06-12T17:49:23.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.545+0000 7f188a7fc700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f188c0b2eb0 0x7f188c141a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39504/0 (socket says 172.21.15.38:39504) 2020-06-12T17:49:23.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.545+0000 7f188a7fc700 1 -- 172.21.15.38:0/595473468 learned_addr learned my addr 172.21.15.38:0/595473468 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:23.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.545+0000 7f187bfff700 1 -- 172.21.15.38:0/595473468 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158788241 0 0) 0x7f188c143210 con 0x7f188c0b2eb0 2020-06-12T17:49:23.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.545+0000 7f188b7fe700 1 --2- 172.21.15.38:0/595473468 >> v2:172.21.15.150:3300/0 conn(0x7f188c146680 0x7f188c09a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:23.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.545+0000 7f187bfff700 1 -- 172.21.15.38:0/595473468 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1868002fe0 con 0x7f188c0b2eb0 2020-06-12T17:49:23.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.545+0000 7f188affd700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f188c09d8d0 0x7f188c065ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:23.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f187bfff700 1 -- 172.21.15.38:0/595473468 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 187668062 0 0) 0x7f1868002fe0 con 0x7f188c0b2eb0 2020-06-12T17:49:23.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f187bfff700 1 -- 172.21.15.38:0/595473468 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f188c143210 con 0x7f188c0b2eb0 2020-06-12T17:49:23.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f187bfff700 1 -- 172.21.15.38:0/595473468 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f187c0019c0 con 0x7f188c0b2eb0 2020-06-12T17:49:23.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f187bfff700 1 -- 172.21.15.38:0/595473468 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f188c09d8d0 msgr2=0x7f188c065ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:23.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f187bfff700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f188c09d8d0 0x7f188c065ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:23.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f187bfff700 1 -- 172.21.15.38:0/595473468 >> v2:172.21.15.150:3300/0 conn(0x7f188c146680 msgr2=0x7f188c09a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:23.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f187bfff700 1 --2- 172.21.15.38:0/595473468 >> v2:172.21.15.150:3300/0 conn(0x7f188c146680 0x7f188c09a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:23.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f187bfff700 1 -- 172.21.15.38:0/595473468 >> v1:172.21.15.38:6789/0 conn(0x7f188c0b2eb0 legacy=0x7f188c141a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:23.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f187bfff700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f188c09d8d0 0x7f18680049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:23.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f187bfff700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1868004e10 0x7f1868003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:23.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f187bfff700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1868003d80 0x7f1868004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:23.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f187bfff700 1 -- 172.21.15.38:0/595473468 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c092380 con 0x7f1868003d80 2020-06-12T17:49:23.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f187bfff700 1 -- 172.21.15.38:0/595473468 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c157650 con 0x7f1868004e10 2020-06-12T17:49:23.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f187bfff700 1 -- 172.21.15.38:0/595473468 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1868005380 con 0x7f188c09d8d0 2020-06-12T17:49:23.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f188b7fe700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1868003d80 0x7f1868004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:23.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f188affd700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f188c09d8d0 0x7f18680049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:23.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f188a7fc700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1868004e10 0x7f1868003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:23.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f188b7fe700 1 -- 172.21.15.38:0/595473468 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f188c09d8d0 msgr2=0x7f18680049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:23.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f188b7fe700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f188c09d8d0 0x7f18680049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:23.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f188b7fe700 1 -- 172.21.15.38:0/595473468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1868004e10 msgr2=0x7f1868003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:23.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f188b7fe700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1868004e10 0x7f1868003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:23.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f188b7fe700 1 -- 172.21.15.38:0/595473468 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188c09b0f0 con 0x7f1868003d80 2020-06-12T17:49:23.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f189184e700 1 -- 172.21.15.38:0/595473468 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f188c1578e0 con 0x7f1868003d80 2020-06-12T17:49:23.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f188b7fe700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1868003d80 0x7f1868004200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f18840032b0 tx=0x7f18840081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f189184e700 1 -- 172.21.15.38:0/595473468 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f188c0b14f0 con 0x7f1868003d80 2020-06-12T17:49:23.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f188b7fe700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1868003d80 0x7f1868004200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f18840032b0 tx=0x7f18840081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f188b7fe700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1868003d80 0x7f1868004200 secure :-1 s=READY pgs=477 cs=0 l=1 rx=0x7f18840032b0 tx=0x7f18840081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:23.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f188b7fe700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1868003d80 0x7f1868004200 secure :-1 s=THROTTLE_DONE pgs=477 cs=0 l=1 rx=0x7f18840032b0 tx=0x7f18840081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f187bfff700 1 -- 172.21.15.38:0/595473468 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1884011e80 con 0x7f1868003d80 2020-06-12T17:49:23.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f188b7fe700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1868003d80 0x7f1868004200 secure :-1 s=THROTTLE_DONE pgs=477 cs=0 l=1 rx=0x7f18840032b0 tx=0x7f18840081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f188b7fe700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1868003d80 0x7f1868004200 secure :-1 s=THROTTLE_DONE pgs=477 cs=0 l=1 rx=0x7f18840032b0 tx=0x7f18840081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f187bfff700 1 -- 172.21.15.38:0/595473468 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1884005a40 con 0x7f1868003d80 2020-06-12T17:49:23.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.546+0000 7f187bfff700 1 -- 172.21.15.38:0/595473468 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1884005e20 con 0x7f1868003d80 2020-06-12T17:49:23.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.547+0000 7f188b7fe700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1868003d80 0x7f1868004200 secure :-1 s=THROTTLE_DONE pgs=477 cs=0 l=1 rx=0x7f18840032b0 tx=0x7f18840081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.547+0000 7f189184e700 1 -- 172.21.15.38:0/595473468 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186c003340 con 0x7f1868003d80 2020-06-12T17:49:23.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.547+0000 7f187bfff700 1 -- 172.21.15.38:0/595473468 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f1884007150 con 0x7f1868003d80 2020-06-12T17:49:23.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.548+0000 7f188b7fe700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1868003d80 0x7f1868004200 secure :-1 s=THROTTLE_DONE pgs=477 cs=0 l=1 rx=0x7f18840032b0 tx=0x7f18840081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.548+0000 7f187bfff700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f18680557f0 0x7f1868057cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:23.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.548+0000 7f187bfff700 1 -- 172.21.15.38:0/595473468 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1884060fc0 con 0x7f1868003d80 2020-06-12T17:49:23.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.548+0000 7f188affd700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f18680557f0 0x7f1868057cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:23.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.548+0000 7f188affd700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f18680557f0 0x7f1868057cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1880002f30 tx=0x7f1880007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.548+0000 7f188affd700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f18680557f0 0x7f1868057cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1880002f30 tx=0x7f1880007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.548+0000 7f188affd700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f18680557f0 0x7f1868057cb0 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7f1880002f30 tx=0x7f1880007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:23.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.551+0000 7f188b7fe700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1868003d80 0x7f1868004200 secure :-1 s=THROTTLE_DONE pgs=477 cs=0 l=1 rx=0x7f18840032b0 tx=0x7f18840081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.551+0000 7f187bfff700 1 -- 172.21.15.38:0/595473468 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f188403c6e0 con 0x7f1868003d80 2020-06-12T17:49:23.751 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.747+0000 7f189184e700 1 -- 172.21.15.38:0/595473468 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_6511", "target": ["mon-mgr", ""]}) v1 -- 0x7f186c002200 con 0x7f18680557f0 2020-06-12T17:49:23.754 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.751+0000 7f188affd700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f18680557f0 0x7f1868057cb0 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f1880002f30 tx=0x7f1880007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:23.755 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.751+0000 7f187bfff700 1 -- 172.21.15.38:0/595473468 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f186c002200 con 0x7f18680557f0 2020-06-12T17:49:23.755 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_6511/f2235ffc-7d2a-488f-9798-1780c966a720 2020-06-12T17:49:23.756 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.752+0000 7f189184e700 1 -- 172.21.15.38:0/595473468 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f18680557f0 msgr2=0x7f1868057cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:23.756 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.752+0000 7f189184e700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f18680557f0 0x7f1868057cb0 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7f1880002f30 tx=0x7f1880007e60).stop 2020-06-12T17:49:23.756 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.752+0000 7f189184e700 1 -- 172.21.15.38:0/595473468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1868003d80 msgr2=0x7f1868004200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:23.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.752+0000 7f189184e700 1 --2- 172.21.15.38:0/595473468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1868003d80 0x7f1868004200 secure :-1 s=READY pgs=477 cs=0 l=1 rx=0x7f18840032b0 tx=0x7f18840081e0).stop 2020-06-12T17:49:23.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.752+0000 7f188b7fe700 1 -- 172.21.15.38:0/595473468 reap_dead start 2020-06-12T17:49:23.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.752+0000 7f188b7fe700 1 -- 172.21.15.38:0/595473468 reap_dead start 2020-06-12T17:49:23.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.752+0000 7f189184e700 1 -- 172.21.15.38:0/595473468 shutdown_connections 2020-06-12T17:49:23.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.752+0000 7f189184e700 1 -- 172.21.15.38:0/595473468 >> 172.21.15.38:0/595473468 conn(0x7f188c0b5a20 msgr2=0x7f188c0b6390 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:23.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.752+0000 7f189184e700 1 -- 172.21.15.38:0/595473468 shutdown_connections 2020-06-12T17:49:23.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:23.752+0000 7f189184e700 1 -- 172.21.15.38:0/595473468 wait complete. 2020-06-12T17:49:23.766 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_6511 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_6511/f2235ffc-7d2a-488f-9798-1780c966a720 2020-06-12T17:49:23.766 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:23.767 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:23.767 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:23.783 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:23.783 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:23.784 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6511/f2235ffc-7d2a-488f-9798-1780c966a720/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:23.874 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:23.875 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:23.875 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114294 s, 91.7 MB/s 2020-06-12T17:49:23.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:23.876 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:23.877 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:23.892 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:23.892 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:23.893 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6511/f2235ffc-7d2a-488f-9798-1780c966a720/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:23.980 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:23.980 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:23.981 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996427 s, 105 MB/s 2020-06-12T17:49:23.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:23.982 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:23.983 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:23.999 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:24.000 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:24.000 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6511/f2235ffc-7d2a-488f-9798-1780c966a720/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:24.087 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:24.087 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:24.088 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116479 s, 90.0 MB/s 2020-06-12T17:49:24.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:24.090 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:24.091 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:24.107 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:24.107 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:24.108 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6511/f2235ffc-7d2a-488f-9798-1780c966a720/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:24.194 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:24.195 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:24.195 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113586 s, 92.3 MB/s 2020-06-12T17:49:24.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:24.196 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:24.197 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:24.212 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:24.212 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:24.213 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6511/f2235ffc-7d2a-488f-9798-1780c966a720/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:24.300 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:24.300 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:24.300 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111171 s, 94.3 MB/s 2020-06-12T17:49:24.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:24.302 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:24.302 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:24.318 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:24.318 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:24.319 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6511/f2235ffc-7d2a-488f-9798-1780c966a720/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:24.409 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:24.409 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:24.409 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124173 s, 84.4 MB/s 2020-06-12T17:49:24.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:24.411 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:24.411 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:24.427 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:24.427 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:24.428 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6511/f2235ffc-7d2a-488f-9798-1780c966a720/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:24.514 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:24.514 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:24.514 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106279 s, 98.7 MB/s 2020-06-12T17:49:24.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:24.516 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:24.516 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:24.532 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:24.532 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:24.533 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6511/f2235ffc-7d2a-488f-9798-1780c966a720/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:24.621 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:24.622 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:24.622 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011289 s, 92.9 MB/s 2020-06-12T17:49:24.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:24.623 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:24.624 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:24.639 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:24.639 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:24.640 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6511/f2235ffc-7d2a-488f-9798-1780c966a720/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:24.727 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:24.727 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:24.727 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108801 s, 96.4 MB/s 2020-06-12T17:49:24.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:24.729 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:24.729 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:24.744 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:24.745 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:24.746 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6511/f2235ffc-7d2a-488f-9798-1780c966a720/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:24.833 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:24.834 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:24.834 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111607 s, 94.0 MB/s 2020-06-12T17:49:24.835 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_5241 2020-06-12T17:49:24.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.948+0000 7fdf2caa2700 1 Processor -- start 2020-06-12T17:49:24.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.948+0000 7fdf2caa2700 1 -- start start 2020-06-12T17:49:24.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.949+0000 7fdf2caa2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdf280ad5b0 0x7fdf280b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:24.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.949+0000 7fdf2caa2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf2809d8d0 0x7fdf281421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:24.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.949+0000 7fdf2caa2700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf28146d20 con 0x7fdf28146680 2020-06-12T17:49:24.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.949+0000 7fdf2caa2700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf28066a80 con 0x7fdf280ad5b0 2020-06-12T17:49:24.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.949+0000 7fdf2caa2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf28146f50 con 0x7fdf2809d8d0 2020-06-12T17:49:24.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.949+0000 7fdf25d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdf280ad5b0 0x7fdf280b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:24.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.949+0000 7fdf2659c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fdf28146680 0x7fdf2809d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39518/0 (socket says 172.21.15.38:39518) 2020-06-12T17:49:24.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.949+0000 7fdf2659c700 1 -- 172.21.15.38:0/3096966146 learned_addr learned my addr 172.21.15.38:0/3096966146 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:24.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.949+0000 7fdf25d9b700 1 -- 172.21.15.38:0/3096966146 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf2809d8d0 msgr2=0x7fdf281421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:24.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.949+0000 7fdf25d9b700 1 --2- 172.21.15.38:0/3096966146 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf2809d8d0 0x7fdf281421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:24.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.950+0000 7fdf25d9b700 1 -- 172.21.15.38:0/3096966146 >> v1:172.21.15.38:6789/0 conn(0x7fdf28146680 legacy=0x7fdf2809d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:24.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.950+0000 7fdf25d9b700 1 -- 172.21.15.38:0/3096966146 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf28146a60 con 0x7fdf280ad5b0 2020-06-12T17:49:24.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.949+0000 7fdf2559a700 1 -- 172.21.15.38:0/3096966146 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 272213403 0 0) 0x7fdf28146d20 con 0x7fdf28146680 2020-06-12T17:49:24.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.950+0000 7fdf25d9b700 1 --2- 172.21.15.38:0/3096966146 >> v2:172.21.15.38:3300/0 conn(0x7fdf280ad5b0 0x7fdf280b2eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdf18002f30 tx=0x7fdf18007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:24.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.950+0000 7fdf25d9b700 1 --2- 172.21.15.38:0/3096966146 >> v2:172.21.15.38:3300/0 conn(0x7fdf280ad5b0 0x7fdf280b2eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdf18002f30 tx=0x7fdf18007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:24.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.950+0000 7fdf25d9b700 1 --2- 172.21.15.38:0/3096966146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf280ad5b0 0x7fdf280b2eb0 secure :-1 s=READY pgs=479 cs=0 l=1 rx=0x7fdf18002f30 tx=0x7fdf18007e60).ready entity=mon.0 client_cookie=6842a0d63b91b30c server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:24.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.950+0000 7fdf25d9b700 1 --2- 172.21.15.38:0/3096966146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf280ad5b0 0x7fdf280b2eb0 secure :-1 s=THROTTLE_DONE pgs=479 cs=0 l=1 rx=0x7fdf18002f30 tx=0x7fdf18007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:24.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.950+0000 7fdf2559a700 1 -- 172.21.15.38:0/3096966146 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf18011430 con 0x7fdf280ad5b0 2020-06-12T17:49:24.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.950+0000 7fdf25d9b700 1 --2- 172.21.15.38:0/3096966146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf280ad5b0 0x7fdf280b2eb0 secure :-1 s=THROTTLE_DONE pgs=479 cs=0 l=1 rx=0x7fdf18002f30 tx=0x7fdf18007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:24.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.950+0000 7fdf25d9b700 1 --2- 172.21.15.38:0/3096966146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf280ad5b0 0x7fdf280b2eb0 secure :-1 s=THROTTLE_DONE pgs=479 cs=0 l=1 rx=0x7fdf18002f30 tx=0x7fdf18007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:24.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.950+0000 7fdf2559a700 1 -- 172.21.15.38:0/3096966146 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf18011590 con 0x7fdf280ad5b0 2020-06-12T17:49:24.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.950+0000 7fdf2559a700 1 -- 172.21.15.38:0/3096966146 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf18011970 con 0x7fdf280ad5b0 2020-06-12T17:49:24.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.950+0000 7fdf2caa2700 1 -- 172.21.15.38:0/3096966146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf280ad5b0 msgr2=0x7fdf280b2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:24.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.950+0000 7fdf2caa2700 1 --2- 172.21.15.38:0/3096966146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf280ad5b0 0x7fdf280b2eb0 secure :-1 s=READY pgs=479 cs=0 l=1 rx=0x7fdf18002f30 tx=0x7fdf18007e60).stop 2020-06-12T17:49:24.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.950+0000 7fdf2caa2700 1 -- 172.21.15.38:0/3096966146 shutdown_connections 2020-06-12T17:49:24.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.950+0000 7fdf2caa2700 1 --2- 172.21.15.38:0/3096966146 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf2809d8d0 0x7fdf281421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:24.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.950+0000 7fdf2caa2700 1 --2- 172.21.15.38:0/3096966146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf280ad5b0 0x7fdf280b2eb0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:24.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.950+0000 7fdf2caa2700 1 -- 172.21.15.38:0/3096966146 >> 172.21.15.38:0/3096966146 conn(0x7fdf280b5a20 msgr2=0x7fdf2805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:24.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.950+0000 7fdf2caa2700 1 -- 172.21.15.38:0/3096966146 shutdown_connections 2020-06-12T17:49:24.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.950+0000 7fdf2caa2700 1 -- 172.21.15.38:0/3096966146 wait complete. 2020-06-12T17:49:24.963 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.951+0000 7fdf2caa2700 1 Processor -- start 2020-06-12T17:49:24.963 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.951+0000 7fdf2caa2700 1 -- start start 2020-06-12T17:49:24.964 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.952+0000 7fdf2caa2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdf280ad5b0 0x7fdf2813f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:24.964 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.952+0000 7fdf2caa2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf28146680 0x7fdf280b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:24.964 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.952+0000 7fdf2caa2700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf280aff90 con 0x7fdf2809d8d0 2020-06-12T17:49:24.964 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.952+0000 7fdf2caa2700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf280b0770 con 0x7fdf280ad5b0 2020-06-12T17:49:24.964 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.952+0000 7fdf2caa2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf280b0200 con 0x7fdf28146680 2020-06-12T17:49:24.965 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.952+0000 7fdf2659c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fdf2809d8d0 0x7fdf2813ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39524/0 (socket says 172.21.15.38:39524) 2020-06-12T17:49:24.965 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.952+0000 7fdf2659c700 1 -- 172.21.15.38:0/1139449975 learned_addr learned my addr 172.21.15.38:0/1139449975 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:24.965 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.952+0000 7fdf25d9b700 1 --2- 172.21.15.38:0/1139449975 >> v2:172.21.15.38:3300/0 conn(0x7fdf280ad5b0 0x7fdf2813f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:24.965 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.952+0000 7fdf26d9d700 1 --2- 172.21.15.38:0/1139449975 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf28146680 0x7fdf280b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:24.965 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.952+0000 7fdf25d9b700 1 -- 172.21.15.38:0/1139449975 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf28146680 msgr2=0x7fdf280b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:24.966 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.953+0000 7fdf25d9b700 1 --2- 172.21.15.38:0/1139449975 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf28146680 0x7fdf280b15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:24.966 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.953+0000 7fdf25d9b700 1 -- 172.21.15.38:0/1139449975 >> v1:172.21.15.38:6789/0 conn(0x7fdf2809d8d0 legacy=0x7fdf2813ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:24.966 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.953+0000 7fdf177fe700 1 -- 172.21.15.38:0/1139449975 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791203859 0 0) 0x7fdf280aff90 con 0x7fdf2809d8d0 2020-06-12T17:49:24.966 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.953+0000 7fdf25d9b700 1 -- 172.21.15.38:0/1139449975 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf280b04a0 con 0x7fdf280ad5b0 2020-06-12T17:49:24.967 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.953+0000 7fdf26d9d700 1 --2- 172.21.15.38:0/1139449975 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf28146680 0x7fdf280b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:49:24.967 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.953+0000 7fdf25d9b700 1 --2- 172.21.15.38:0/1139449975 >> v2:172.21.15.38:3300/0 conn(0x7fdf280ad5b0 0x7fdf2813f430 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdf280b2b90 tx=0x7fdf18007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:24.967 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.953+0000 7fdf25d9b700 1 --2- 172.21.15.38:0/1139449975 >> v2:172.21.15.38:3300/0 conn(0x7fdf280ad5b0 0x7fdf2813f430 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdf280b2b90 tx=0x7fdf18007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:24.967 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.953+0000 7fdf25d9b700 1 --2- 172.21.15.38:0/1139449975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf280ad5b0 0x7fdf2813f430 secure :-1 s=READY pgs=481 cs=0 l=1 rx=0x7fdf280b2b90 tx=0x7fdf18007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:24.967 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.953+0000 7fdf25d9b700 1 --2- 172.21.15.38:0/1139449975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf280ad5b0 0x7fdf2813f430 secure :-1 s=THROTTLE_DONE pgs=481 cs=0 l=1 rx=0x7fdf280b2b90 tx=0x7fdf18007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:24.968 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.953+0000 7fdf25d9b700 1 --2- 172.21.15.38:0/1139449975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf280ad5b0 0x7fdf2813f430 secure :-1 s=THROTTLE_DONE pgs=481 cs=0 l=1 rx=0x7fdf280b2b90 tx=0x7fdf18007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:24.968 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.953+0000 7fdf177fe700 1 -- 172.21.15.38:0/1139449975 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf18007150 con 0x7fdf280ad5b0 2020-06-12T17:49:24.968 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.953+0000 7fdf25d9b700 1 --2- 172.21.15.38:0/1139449975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf280ad5b0 0x7fdf2813f430 secure :-1 s=THROTTLE_DONE pgs=481 cs=0 l=1 rx=0x7fdf280b2b90 tx=0x7fdf18007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:24.968 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.953+0000 7fdf177fe700 1 -- 172.21.15.38:0/1139449975 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf180072b0 con 0x7fdf280ad5b0 2020-06-12T17:49:24.968 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.953+0000 7fdf2caa2700 1 -- 172.21.15.38:0/1139449975 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf280af060 con 0x7fdf280ad5b0 2020-06-12T17:49:24.969 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.953+0000 7fdf177fe700 1 -- 172.21.15.38:0/1139449975 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf180056c0 con 0x7fdf280ad5b0 2020-06-12T17:49:24.969 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.953+0000 7fdf2caa2700 1 -- 172.21.15.38:0/1139449975 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf280b0f80 con 0x7fdf280ad5b0 2020-06-12T17:49:24.969 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.953+0000 7fdf25d9b700 1 --2- 172.21.15.38:0/1139449975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf280ad5b0 0x7fdf2813f430 secure :-1 s=THROTTLE_DONE pgs=481 cs=0 l=1 rx=0x7fdf280b2b90 tx=0x7fdf18007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:24.969 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.954+0000 7fdf177fe700 1 -- 172.21.15.38:0/1139449975 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fdf180058f0 con 0x7fdf280ad5b0 2020-06-12T17:49:24.969 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.954+0000 7fdf25d9b700 1 --2- 172.21.15.38:0/1139449975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf280ad5b0 0x7fdf2813f430 secure :-1 s=THROTTLE_DONE pgs=481 cs=0 l=1 rx=0x7fdf280b2b90 tx=0x7fdf18007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:24.970 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.954+0000 7fdf2caa2700 1 -- 172.21.15.38:0/1139449975 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf28056c30 con 0x7fdf280ad5b0 2020-06-12T17:49:24.970 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.954+0000 7fdf177fe700 1 --2- 172.21.15.38:0/1139449975 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdf0404d560 0x7fdf0404fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:24.970 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.954+0000 7fdf177fe700 1 -- 172.21.15.38:0/1139449975 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fdf18061520 con 0x7fdf280ad5b0 2020-06-12T17:49:24.970 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.954+0000 7fdf2659c700 1 --2- 172.21.15.38:0/1139449975 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdf0404d560 0x7fdf0404fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:24.970 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.955+0000 7fdf2659c700 1 --2- 172.21.15.38:0/1139449975 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdf0404d560 0x7fdf0404fa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdf1c001260 tx=0x7fdf1c0015c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:24.971 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.955+0000 7fdf2659c700 1 --2- 172.21.15.38:0/1139449975 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdf0404d560 0x7fdf0404fa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdf1c001260 tx=0x7fdf1c0015c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:24.971 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.955+0000 7fdf2659c700 1 --2- 172.21.15.38:0/1139449975 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdf0404d560 0x7fdf0404fa20 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7fdf1c001260 tx=0x7fdf1c0015c0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:24.971 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.958+0000 7fdf25d9b700 1 --2- 172.21.15.38:0/1139449975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf280ad5b0 0x7fdf2813f430 secure :-1 s=THROTTLE_DONE pgs=481 cs=0 l=1 rx=0x7fdf280b2b90 tx=0x7fdf18007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:24.971 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:24.958+0000 7fdf177fe700 1 -- 172.21.15.38:0/1139449975 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fdf1803cd60 con 0x7fdf280ad5b0 2020-06-12T17:49:25.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.150+0000 7fdf2caa2700 1 -- 172.21.15.38:0/1139449975 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_5241", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf28140c00 con 0x7fdf0404d560 2020-06-12T17:49:25.173 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.169+0000 7fdf2659c700 1 --2- 172.21.15.38:0/1139449975 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdf0404d560 0x7fdf0404fa20 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7fdf1c001260 tx=0x7fdf1c0015c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:25.173 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.169+0000 7fdf177fe700 1 -- 172.21.15.38:0/1139449975 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fdf1c00c2a0 con 0x7fdf0404d560 2020-06-12T17:49:25.174 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.171+0000 7fdf2caa2700 1 -- 172.21.15.38:0/1139449975 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdf0404d560 msgr2=0x7fdf0404fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:25.175 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.171+0000 7fdf2caa2700 1 --2- 172.21.15.38:0/1139449975 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdf0404d560 0x7fdf0404fa20 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7fdf1c001260 tx=0x7fdf1c0015c0).stop 2020-06-12T17:49:25.175 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.171+0000 7fdf2caa2700 1 -- 172.21.15.38:0/1139449975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf280ad5b0 msgr2=0x7fdf2813f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:25.175 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.171+0000 7fdf2caa2700 1 --2- 172.21.15.38:0/1139449975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf280ad5b0 0x7fdf2813f430 secure :-1 s=READY pgs=481 cs=0 l=1 rx=0x7fdf280b2b90 tx=0x7fdf18007e60).stop 2020-06-12T17:49:25.175 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.171+0000 7fdf2caa2700 1 -- 172.21.15.38:0/1139449975 shutdown_connections 2020-06-12T17:49:25.176 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.171+0000 7fdf2caa2700 1 --2- 172.21.15.38:0/1139449975 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdf0404d560 0x7fdf0404fa20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:25.176 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.171+0000 7fdf2caa2700 1 --2- 172.21.15.38:0/1139449975 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf28146680 0x7fdf280b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:25.176 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.171+0000 7fdf2caa2700 1 --2- 172.21.15.38:0/1139449975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf280ad5b0 0x7fdf2813f430 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:25.176 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.171+0000 7fdf2caa2700 1 -- 172.21.15.38:0/1139449975 >> 172.21.15.38:0/1139449975 conn(0x7fdf280b5a20 msgr2=0x7fdf28143320 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:25.176 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.171+0000 7fdf2caa2700 1 -- 172.21.15.38:0/1139449975 shutdown_connections 2020-06-12T17:49:25.177 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.171+0000 7fdf2caa2700 1 -- 172.21.15.38:0/1139449975 wait complete. 2020-06-12T17:49:25.184 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_5241 2020-06-12T17:49:25.302 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.298+0000 7f69d6980700 1 Processor -- start 2020-06-12T17:49:25.302 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.298+0000 7f69d6980700 1 -- start start 2020-06-12T17:49:25.313 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.299+0000 7f69d6980700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f69d0140300 0x7f69d00b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:25.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.299+0000 7f69d6980700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69d00b2eb0 0x7f69d00b3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:25.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.299+0000 7f69d6980700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d0146400 con 0x7f69d009e400 2020-06-12T17:49:25.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.299+0000 7f69d6980700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d01466a0 con 0x7f69d0140300 2020-06-12T17:49:25.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.299+0000 7f69d6980700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d0146940 con 0x7f69d00b2eb0 2020-06-12T17:49:25.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.299+0000 7f69cffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f69d0140300 0x7f69d00b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:25.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.299+0000 7f69c7fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f69d009e400 0x7f69d00b19c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39532/0 (socket says 172.21.15.38:39532) 2020-06-12T17:49:25.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.299+0000 7f69cffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f69d0140300 0x7f69d00b2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37716/0 (socket says 172.21.15.38:37716) 2020-06-12T17:49:25.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.299+0000 7f69c7fff700 1 -- 172.21.15.38:0/1576012734 learned_addr learned my addr 172.21.15.38:0/1576012734 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:25.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.300+0000 7f69cffff700 1 -- 172.21.15.38:0/1576012734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69d00b2eb0 msgr2=0x7f69d00b3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:25.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.300+0000 7f69d4f1d700 1 --2- 172.21.15.38:0/1576012734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69d00b2eb0 0x7f69d00b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:25.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.300+0000 7f69cffff700 1 --2- 172.21.15.38:0/1576012734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69d00b2eb0 0x7f69d00b3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:25.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.300+0000 7f69cffff700 1 -- 172.21.15.38:0/1576012734 >> v1:172.21.15.38:6789/0 conn(0x7f69d009e400 legacy=0x7f69d00b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:25.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.300+0000 7f69cf7fe700 1 -- 172.21.15.38:0/1576012734 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 422813342 0 0) 0x7f69d0146400 con 0x7f69d009e400 2020-06-12T17:49:25.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.300+0000 7f69cffff700 1 -- 172.21.15.38:0/1576012734 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d00b20d0 con 0x7f69d0140300 2020-06-12T17:49:25.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.300+0000 7f69d4f1d700 1 --2- 172.21.15.38:0/1576012734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69d00b2eb0 0x7f69d00b3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:49:25.323 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.300+0000 7f69cffff700 1 --2- 172.21.15.38:0/1576012734 >> v2:172.21.15.38:3300/0 conn(0x7f69d0140300 0x7f69d00b2820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f69c0002f30 tx=0x7f69c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:25.323 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.300+0000 7f69cffff700 1 --2- 172.21.15.38:0/1576012734 >> v2:172.21.15.38:3300/0 conn(0x7f69d0140300 0x7f69d00b2820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f69c0002f30 tx=0x7f69c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:25.323 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.300+0000 7f69cffff700 1 --2- 172.21.15.38:0/1576012734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f69d0140300 0x7f69d00b2820 secure :-1 s=READY pgs=483 cs=0 l=1 rx=0x7f69c0002f30 tx=0x7f69c0007e60).ready entity=mon.0 client_cookie=454181478a1842ce server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:25.323 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.300+0000 7f69cffff700 1 --2- 172.21.15.38:0/1576012734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f69d0140300 0x7f69d00b2820 secure :-1 s=THROTTLE_DONE pgs=483 cs=0 l=1 rx=0x7f69c0002f30 tx=0x7f69c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:25.323 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.300+0000 7f69cf7fe700 1 -- 172.21.15.38:0/1576012734 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69c0011430 con 0x7f69d0140300 2020-06-12T17:49:25.324 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.300+0000 7f69cffff700 1 --2- 172.21.15.38:0/1576012734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f69d0140300 0x7f69d00b2820 secure :-1 s=THROTTLE_DONE pgs=483 cs=0 l=1 rx=0x7f69c0002f30 tx=0x7f69c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:25.324 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.300+0000 7f69cffff700 1 --2- 172.21.15.38:0/1576012734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f69d0140300 0x7f69d00b2820 secure :-1 s=THROTTLE_DONE pgs=483 cs=0 l=1 rx=0x7f69c0002f30 tx=0x7f69c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:25.324 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.300+0000 7f69cf7fe700 1 -- 172.21.15.38:0/1576012734 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c0011590 con 0x7f69d0140300 2020-06-12T17:49:25.324 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.300+0000 7f69cf7fe700 1 -- 172.21.15.38:0/1576012734 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69c0011970 con 0x7f69d0140300 2020-06-12T17:49:25.324 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.300+0000 7f69d6980700 1 -- 172.21.15.38:0/1576012734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f69d0140300 msgr2=0x7f69d00b2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:25.325 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.300+0000 7f69d6980700 1 --2- 172.21.15.38:0/1576012734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f69d0140300 0x7f69d00b2820 secure :-1 s=READY pgs=483 cs=0 l=1 rx=0x7f69c0002f30 tx=0x7f69c0007e60).stop 2020-06-12T17:49:25.325 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.300+0000 7f69d6980700 1 -- 172.21.15.38:0/1576012734 shutdown_connections 2020-06-12T17:49:25.325 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.300+0000 7f69d6980700 1 --2- 172.21.15.38:0/1576012734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69d00b2eb0 0x7f69d00b3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:25.325 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.300+0000 7f69d6980700 1 --2- 172.21.15.38:0/1576012734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f69d0140300 0x7f69d00b2820 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:25.325 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.300+0000 7f69d6980700 1 -- 172.21.15.38:0/1576012734 >> 172.21.15.38:0/1576012734 conn(0x7f69d00b5a20 msgr2=0x7f69d005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:25.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.300+0000 7f69d6980700 1 -- 172.21.15.38:0/1576012734 shutdown_connections 2020-06-12T17:49:25.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.300+0000 7f69d6980700 1 -- 172.21.15.38:0/1576012734 wait complete. 2020-06-12T17:49:25.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.301+0000 7f69d6980700 1 Processor -- start 2020-06-12T17:49:25.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.301+0000 7f69d6980700 1 -- start start 2020-06-12T17:49:25.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.302+0000 7f69d6980700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f69d009e400 0x7f69d0063490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:25.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.302+0000 7f69d6980700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69d0140300 0x7f69d013f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:25.327 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.302+0000 7f69d6980700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d0143c50 con 0x7f69d00b2eb0 2020-06-12T17:49:25.327 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.302+0000 7f69d6980700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d0063ac0 con 0x7f69d009e400 2020-06-12T17:49:25.327 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.302+0000 7f69d6980700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d01416b0 con 0x7f69d0140300 2020-06-12T17:49:25.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.302+0000 7f69c7fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f69d00b2eb0 0x7f69d0156e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39540/0 (socket says 172.21.15.38:39540) 2020-06-12T17:49:25.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.302+0000 7f69c7fff700 1 -- 172.21.15.38:0/1763681488 learned_addr learned my addr 172.21.15.38:0/1763681488 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:25.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.302+0000 7f69cffff700 1 --2- 172.21.15.38:0/1763681488 >> v2:172.21.15.150:3300/0 conn(0x7f69d009e400 0x7f69d0063490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:25.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.302+0000 7f69d4f1d700 1 --2- 172.21.15.38:0/1763681488 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69d0140300 0x7f69d013f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:25.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.302+0000 7f69cdffb700 1 -- 172.21.15.38:0/1763681488 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2345844786 0 0) 0x7f69d0143c50 con 0x7f69d00b2eb0 2020-06-12T17:49:25.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.302+0000 7f69cdffb700 1 -- 172.21.15.38:0/1763681488 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69b4002fe0 con 0x7f69d00b2eb0 2020-06-12T17:49:25.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.303+0000 7f69cdffb700 1 -- 172.21.15.38:0/1763681488 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1397272596 0 0) 0x7f69b4002fe0 con 0x7f69d00b2eb0 2020-06-12T17:49:25.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.303+0000 7f69cdffb700 1 -- 172.21.15.38:0/1763681488 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f69d0143c50 con 0x7f69d00b2eb0 2020-06-12T17:49:25.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.303+0000 7f69cdffb700 1 -- 172.21.15.38:0/1763681488 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f69b8001960 con 0x7f69d00b2eb0 2020-06-12T17:49:25.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.303+0000 7f69cffff700 1 -- 172.21.15.38:0/1763681488 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69d0140300 msgr2=0x7f69d013f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:25.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.303+0000 7f69cffff700 1 --2- 172.21.15.38:0/1763681488 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69d0140300 0x7f69d013f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:25.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.303+0000 7f69cffff700 1 -- 172.21.15.38:0/1763681488 >> v1:172.21.15.38:6789/0 conn(0x7f69d00b2eb0 legacy=0x7f69d0156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:25.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.303+0000 7f69cffff700 1 -- 172.21.15.38:0/1763681488 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d0141950 con 0x7f69d009e400 2020-06-12T17:49:25.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.303+0000 7f69cffff700 1 --2- 172.21.15.38:0/1763681488 >> v2:172.21.15.150:3300/0 conn(0x7f69d009e400 0x7f69d0063490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f69c0002f30 tx=0x7f69c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:25.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.303+0000 7f69cffff700 1 --2- 172.21.15.38:0/1763681488 >> v2:172.21.15.150:3300/0 conn(0x7f69d009e400 0x7f69d0063490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f69c0002f30 tx=0x7f69c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:25.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.303+0000 7f69cffff700 1 --2- 172.21.15.38:0/1763681488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69d009e400 0x7f69d0063490 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7f69c0002f30 tx=0x7f69c0007e60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:25.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.303+0000 7f69cffff700 1 --2- 172.21.15.38:0/1763681488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69d009e400 0x7f69d0063490 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f69c0002f30 tx=0x7f69c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:25.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.303+0000 7f69cdffb700 1 -- 172.21.15.38:0/1763681488 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69c0007340 con 0x7f69d009e400 2020-06-12T17:49:25.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.303+0000 7f69cffff700 1 --2- 172.21.15.38:0/1763681488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69d009e400 0x7f69d0063490 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f69c0002f30 tx=0x7f69c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:25.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.303+0000 7f69d6980700 1 -- 172.21.15.38:0/1763681488 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d0157550 con 0x7f69d009e400 2020-06-12T17:49:25.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.303+0000 7f69cdffb700 1 -- 172.21.15.38:0/1763681488 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c00074a0 con 0x7f69d009e400 2020-06-12T17:49:25.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.303+0000 7f69cffff700 1 --2- 172.21.15.38:0/1763681488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69d009e400 0x7f69d0063490 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f69c0002f30 tx=0x7f69c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:25.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.303+0000 7f69cdffb700 1 -- 172.21.15.38:0/1763681488 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69c00116a0 con 0x7f69d009e400 2020-06-12T17:49:25.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.303+0000 7f69d6980700 1 -- 172.21.15.38:0/1763681488 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d013fa50 con 0x7f69d009e400 2020-06-12T17:49:25.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.304+0000 7f69cffff700 1 --2- 172.21.15.38:0/1763681488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69d009e400 0x7f69d0063490 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f69c0002f30 tx=0x7f69c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:25.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.304+0000 7f69d6980700 1 -- 172.21.15.38:0/1763681488 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d00638f0 con 0x7f69d009e400 2020-06-12T17:49:25.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.304+0000 7f69cdffb700 1 -- 172.21.15.38:0/1763681488 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f69c00118a0 con 0x7f69d009e400 2020-06-12T17:49:25.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.304+0000 7f69cffff700 1 --2- 172.21.15.38:0/1763681488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69d009e400 0x7f69d0063490 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f69c0002f30 tx=0x7f69c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:25.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.304+0000 7f69cdffb700 1 --2- 172.21.15.38:0/1763681488 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f69b404dbc0 0x7f69b4050080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:25.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.304+0000 7f69cdffb700 1 -- 172.21.15.38:0/1763681488 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f69c0061120 con 0x7f69d009e400 2020-06-12T17:49:25.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.305+0000 7f69c7fff700 1 --2- 172.21.15.38:0/1763681488 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f69b404dbc0 0x7f69b4050080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:25.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.305+0000 7f69c7fff700 1 --2- 172.21.15.38:0/1763681488 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f69b404dbc0 0x7f69b4050080 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f69b8001670 tx=0x7f69b800a6c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:25.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.305+0000 7f69c7fff700 1 --2- 172.21.15.38:0/1763681488 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f69b404dbc0 0x7f69b4050080 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f69b8001670 tx=0x7f69b800a6c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:25.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.305+0000 7f69c7fff700 1 --2- 172.21.15.38:0/1763681488 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f69b404dbc0 0x7f69b4050080 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7f69b8001670 tx=0x7f69b800a6c0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:25.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.308+0000 7f69cffff700 1 --2- 172.21.15.38:0/1763681488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69d009e400 0x7f69d0063490 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f69c0002f30 tx=0x7f69c0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:25.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.308+0000 7f69cdffb700 1 -- 172.21.15.38:0/1763681488 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f69c003c940 con 0x7f69d009e400 2020-06-12T17:49:25.507 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.504+0000 7f69d6980700 1 -- 172.21.15.38:0/1763681488 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_5241", "target": ["mon-mgr", ""]}) v1 -- 0x7f69d0067b20 con 0x7f69b404dbc0 2020-06-12T17:49:25.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.507+0000 7f69c7fff700 1 --2- 172.21.15.38:0/1763681488 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f69b404dbc0 0x7f69b4050080 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7f69b8001670 tx=0x7f69b800a6c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:25.511 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.507+0000 7f69cdffb700 1 -- 172.21.15.38:0/1763681488 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f69d0067b20 con 0x7f69b404dbc0 2020-06-12T17:49:25.511 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_5241/770b2ee5-7a00-484c-b4d5-70b0df982cde 2020-06-12T17:49:25.512 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.508+0000 7f69d6980700 1 -- 172.21.15.38:0/1763681488 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f69b404dbc0 msgr2=0x7f69b4050080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:25.512 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.508+0000 7f69d6980700 1 --2- 172.21.15.38:0/1763681488 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f69b404dbc0 0x7f69b4050080 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7f69b8001670 tx=0x7f69b800a6c0).stop 2020-06-12T17:49:25.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.509+0000 7f69d6980700 1 -- 172.21.15.38:0/1763681488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69d009e400 msgr2=0x7f69d0063490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:25.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.509+0000 7f69d6980700 1 --2- 172.21.15.38:0/1763681488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69d009e400 0x7f69d0063490 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7f69c0002f30 tx=0x7f69c0007e60).stop 2020-06-12T17:49:25.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.509+0000 7f69d6980700 1 -- 172.21.15.38:0/1763681488 shutdown_connections 2020-06-12T17:49:25.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.509+0000 7f69d6980700 1 --2- 172.21.15.38:0/1763681488 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f69b404dbc0 0x7f69b4050080 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:25.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.509+0000 7f69d6980700 1 --2- 172.21.15.38:0/1763681488 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69d0140300 0x7f69d013f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:25.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.509+0000 7f69d6980700 1 --2- 172.21.15.38:0/1763681488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69d009e400 0x7f69d0063490 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:25.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.509+0000 7f69d6980700 1 -- 172.21.15.38:0/1763681488 >> 172.21.15.38:0/1763681488 conn(0x7f69d00b5a20 msgr2=0x7f69d00b7400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:25.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.509+0000 7f69d6980700 1 -- 172.21.15.38:0/1763681488 shutdown_connections 2020-06-12T17:49:25.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:25.509+0000 7f69d6980700 1 -- 172.21.15.38:0/1763681488 wait complete. 2020-06-12T17:49:25.522 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_5241 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_5241/770b2ee5-7a00-484c-b4d5-70b0df982cde 2020-06-12T17:49:25.523 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:25.523 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:25.524 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:25.539 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:25.539 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:25.540 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5241/770b2ee5-7a00-484c-b4d5-70b0df982cde/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:25.637 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:25.638 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:25.638 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128507 s, 81.6 MB/s 2020-06-12T17:49:25.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:25.639 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:25.640 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:25.655 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:25.656 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:25.657 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5241/770b2ee5-7a00-484c-b4d5-70b0df982cde/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:25.742 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:25.743 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:25.743 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997545 s, 105 MB/s 2020-06-12T17:49:25.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:25.744 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:25.745 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:25.766 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:25.767 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:25.767 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5241/770b2ee5-7a00-484c-b4d5-70b0df982cde/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:25.854 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:25.854 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:25.855 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113086 s, 92.7 MB/s 2020-06-12T17:49:25.856 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:25.856 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:25.857 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:25.871 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:25.872 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:25.872 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5241/770b2ee5-7a00-484c-b4d5-70b0df982cde/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:25.965 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:25.965 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:25.966 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108135 s, 97.0 MB/s 2020-06-12T17:49:25.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:25.967 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:25.967 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:25.983 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:25.984 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:25.985 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5241/770b2ee5-7a00-484c-b4d5-70b0df982cde/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:26.073 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:26.073 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:26.074 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129737 s, 80.8 MB/s 2020-06-12T17:49:26.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:26.075 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:26.076 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:26.091 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:26.091 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:26.092 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5241/770b2ee5-7a00-484c-b4d5-70b0df982cde/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:26.179 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:26.180 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:26.180 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111979 s, 93.6 MB/s 2020-06-12T17:49:26.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:26.181 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:26.182 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:26.198 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:26.199 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:26.199 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5241/770b2ee5-7a00-484c-b4d5-70b0df982cde/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:26.286 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117494 s, 89.2 MB/s 2020-06-12T17:49:26.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:26.288 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:26.289 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:26.304 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:26.304 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:26.304 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5241/770b2ee5-7a00-484c-b4d5-70b0df982cde/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:26.392 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:26.392 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:26.392 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110018 s, 95.3 MB/s 2020-06-12T17:49:26.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:26.394 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:26.394 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:26.409 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:26.410 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:26.411 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5241/770b2ee5-7a00-484c-b4d5-70b0df982cde/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:26.499 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:26.499 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:26.500 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123825 s, 84.7 MB/s 2020-06-12T17:49:26.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:26.501 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:26.502 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:26.516 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:26.517 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:26.518 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5241/770b2ee5-7a00-484c-b4d5-70b0df982cde/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:26.611 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:26.611 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:26.612 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114978 s, 91.2 MB/s 2020-06-12T17:49:26.613 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_8606 2020-06-12T17:49:26.730 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.727+0000 7f20b241f700 1 Processor -- start 2020-06-12T17:49:26.731 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.727+0000 7f20b241f700 1 -- start start 2020-06-12T17:49:26.733 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.727+0000 7f20b241f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20ac0ad5b0 0x7f20ac0b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:26.733 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.727+0000 7f20b241f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f20ac09d8d0 0x7f20ac1421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:26.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.727+0000 7f20b241f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ac146d20 con 0x7f20ac146680 2020-06-12T17:49:26.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.727+0000 7f20b241f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20ac066a80 con 0x7f20ac09d8d0 2020-06-12T17:49:26.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.727+0000 7f20b241f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac146f50 con 0x7f20ac0ad5b0 2020-06-12T17:49:26.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.728+0000 7f20b09bc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f20ac09d8d0 0x7f20ac1421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:26.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.728+0000 7f20ab7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20ac0ad5b0 0x7f20ac0b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:26.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.728+0000 7f20abfff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f20ac146680 0x7f20ac09d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:60278/0 (socket says 172.21.15.38:60278) 2020-06-12T17:49:26.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.728+0000 7f20abfff700 1 -- 172.21.15.38:0/1217072224 learned_addr learned my addr 172.21.15.38:0/1217072224 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:26.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.728+0000 7f20aaffd700 1 -- 172.21.15.38:0/1217072224 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1787190698 0 0) 0x7f20ac146d20 con 0x7f20ac146680 2020-06-12T17:49:26.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.728+0000 7f20aaffd700 1 -- 172.21.15.38:0/1217072224 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2098003230 con 0x7f20ac146680 2020-06-12T17:49:26.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.728+0000 7f20ab7fe700 1 -- 172.21.15.38:0/1217072224 >> v2:172.21.15.150:3300/0 conn(0x7f20ac09d8d0 msgr2=0x7f20ac1421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:26.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.728+0000 7f20ab7fe700 1 --2- 172.21.15.38:0/1217072224 >> v2:172.21.15.150:3300/0 conn(0x7f20ac09d8d0 0x7f20ac1421d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:26.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.728+0000 7f20ab7fe700 1 -- 172.21.15.38:0/1217072224 >> v1:172.21.15.150:6789/0 conn(0x7f20ac146680 legacy=0x7f20ac09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:26.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.728+0000 7f20ab7fe700 1 -- 172.21.15.38:0/1217072224 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ac146a60 con 0x7f20ac0ad5b0 2020-06-12T17:49:26.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.728+0000 7f20b09bc700 1 --2- 172.21.15.38:0/1217072224 >> v2:172.21.15.150:3300/0 conn(0x7f20ac09d8d0 0x7f20ac1421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:49:26.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.728+0000 7f20ab7fe700 1 --2- 172.21.15.38:0/1217072224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20ac0ad5b0 0x7f20ac0b2eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f20a0002f30 tx=0x7f20a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:26.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.728+0000 7f20ab7fe700 1 --2- 172.21.15.38:0/1217072224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20ac0ad5b0 0x7f20ac0b2eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f20a0002f30 tx=0x7f20a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:26.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.728+0000 7f20ab7fe700 1 --2- 172.21.15.38:0/1217072224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20ac0ad5b0 0x7f20ac0b2eb0 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f20a0002f30 tx=0x7f20a0007e60).ready entity=mon.2 client_cookie=a20ed643eff12d6e server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:26.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.729+0000 7f20ab7fe700 1 --2- 172.21.15.38:0/1217072224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20ac0ad5b0 0x7f20ac0b2eb0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f20a0002f30 tx=0x7f20a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:26.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.729+0000 7f20aaffd700 1 -- 172.21.15.38:0/1217072224 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20a00112d0 con 0x7f20ac0ad5b0 2020-06-12T17:49:26.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.729+0000 7f20ab7fe700 1 --2- 172.21.15.38:0/1217072224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20ac0ad5b0 0x7f20ac0b2eb0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f20a0002f30 tx=0x7f20a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:26.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.729+0000 7f20aaffd700 1 -- 172.21.15.38:0/1217072224 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a0011430 con 0x7f20ac0ad5b0 2020-06-12T17:49:26.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.729+0000 7f20ab7fe700 1 --2- 172.21.15.38:0/1217072224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20ac0ad5b0 0x7f20ac0b2eb0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f20a0002f30 tx=0x7f20a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:26.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.729+0000 7f20aaffd700 1 -- 172.21.15.38:0/1217072224 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20a0011850 con 0x7f20ac0ad5b0 2020-06-12T17:49:26.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.729+0000 7f20b241f700 1 -- 172.21.15.38:0/1217072224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20ac0ad5b0 msgr2=0x7f20ac0b2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:26.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.729+0000 7f20b241f700 1 --2- 172.21.15.38:0/1217072224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20ac0ad5b0 0x7f20ac0b2eb0 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f20a0002f30 tx=0x7f20a0007e60).stop 2020-06-12T17:49:26.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.729+0000 7f20b241f700 1 -- 172.21.15.38:0/1217072224 shutdown_connections 2020-06-12T17:49:26.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.729+0000 7f20b241f700 1 --2- 172.21.15.38:0/1217072224 >> v2:172.21.15.150:3300/0 conn(0x7f20ac09d8d0 0x7f20ac1421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:26.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.729+0000 7f20b241f700 1 --2- 172.21.15.38:0/1217072224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20ac0ad5b0 0x7f20ac0b2eb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:26.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.729+0000 7f20b241f700 1 -- 172.21.15.38:0/1217072224 >> 172.21.15.38:0/1217072224 conn(0x7f20ac0b5a20 msgr2=0x7f20ac05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:26.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.729+0000 7f20b241f700 1 -- 172.21.15.38:0/1217072224 shutdown_connections 2020-06-12T17:49:26.740 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.729+0000 7f20b241f700 1 -- 172.21.15.38:0/1217072224 wait complete. 2020-06-12T17:49:26.740 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.730+0000 7f20b241f700 1 Processor -- start 2020-06-12T17:49:26.740 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.730+0000 7f20b241f700 1 -- start start 2020-06-12T17:49:26.744 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.731+0000 7f20b241f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20ac09d8d0 0x7f20ac0b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:26.744 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.731+0000 7f20b241f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f20ac0ad5b0 0x7f20ac0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:26.744 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.731+0000 7f20b241f700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ac065b10 con 0x7f20ac146680 2020-06-12T17:49:26.745 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.731+0000 7f20b241f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20ac0b0e90 con 0x7f20ac0ad5b0 2020-06-12T17:49:26.745 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.731+0000 7f20b241f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac0b1130 con 0x7f20ac09d8d0 2020-06-12T17:49:26.745 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.731+0000 7f20b09bc700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f20ac146680 0x7f20ac151930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39556/0 (socket says 172.21.15.38:39556) 2020-06-12T17:49:26.745 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.731+0000 7f20b09bc700 1 -- 172.21.15.38:0/417772190 learned_addr learned my addr 172.21.15.38:0/417772190 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:26.745 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.731+0000 7f20ab7fe700 1 --2- 172.21.15.38:0/417772190 >> v2:172.21.15.150:3300/0 conn(0x7f20ac0ad5b0 0x7f20ac0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:26.746 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.731+0000 7f20abfff700 1 --2- 172.21.15.38:0/417772190 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20ac09d8d0 0x7f20ac0b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:26.746 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.731+0000 7f20a97fa700 1 -- 172.21.15.38:0/417772190 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5051050 0 0) 0x7f20ac065b10 con 0x7f20ac146680 2020-06-12T17:49:26.746 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.731+0000 7f20a97fa700 1 -- 172.21.15.38:0/417772190 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f208c002fe0 con 0x7f20ac146680 2020-06-12T17:49:26.746 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.732+0000 7f20ab7fe700 1 -- 172.21.15.38:0/417772190 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20ac09d8d0 msgr2=0x7f20ac0b23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:26.747 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.732+0000 7f20ab7fe700 1 --2- 172.21.15.38:0/417772190 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20ac09d8d0 0x7f20ac0b23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:26.747 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.732+0000 7f20ab7fe700 1 -- 172.21.15.38:0/417772190 >> v1:172.21.15.38:6789/0 conn(0x7f20ac146680 legacy=0x7f20ac151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:26.747 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.732+0000 7f20ab7fe700 1 -- 172.21.15.38:0/417772190 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ac0b13d0 con 0x7f20ac0ad5b0 2020-06-12T17:49:26.747 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.732+0000 7f20ab7fe700 1 --2- 172.21.15.38:0/417772190 >> v2:172.21.15.150:3300/0 conn(0x7f20ac0ad5b0 0x7f20ac0b1870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f20a0002f30 tx=0x7f20a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:26.747 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.732+0000 7f20ab7fe700 1 --2- 172.21.15.38:0/417772190 >> v2:172.21.15.150:3300/0 conn(0x7f20ac0ad5b0 0x7f20ac0b1870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f20a0002f30 tx=0x7f20a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:26.748 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.732+0000 7f20ab7fe700 1 --2- 172.21.15.38:0/417772190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20ac0ad5b0 0x7f20ac0b1870 secure :-1 s=READY pgs=293 cs=0 l=1 rx=0x7f20a0002f30 tx=0x7f20a0007e60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:26.748 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.732+0000 7f20ab7fe700 1 --2- 172.21.15.38:0/417772190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20ac0ad5b0 0x7f20ac0b1870 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7f20a0002f30 tx=0x7f20a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:26.748 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.732+0000 7f20a97fa700 1 -- 172.21.15.38:0/417772190 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20a00116d0 con 0x7f20ac0ad5b0 2020-06-12T17:49:26.748 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.732+0000 7f20ab7fe700 1 --2- 172.21.15.38:0/417772190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20ac0ad5b0 0x7f20ac0b1870 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7f20a0002f30 tx=0x7f20a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:26.748 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.732+0000 7f20a97fa700 1 -- 172.21.15.38:0/417772190 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a0011830 con 0x7f20ac0ad5b0 2020-06-12T17:49:26.749 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.732+0000 7f20ab7fe700 1 --2- 172.21.15.38:0/417772190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20ac0ad5b0 0x7f20ac0b1870 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7f20a0002f30 tx=0x7f20a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:26.749 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.732+0000 7f20b241f700 1 -- 172.21.15.38:0/417772190 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ac152040 con 0x7f20ac0ad5b0 2020-06-12T17:49:26.749 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.732+0000 7f20a97fa700 1 -- 172.21.15.38:0/417772190 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20a0007340 con 0x7f20ac0ad5b0 2020-06-12T17:49:26.749 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.732+0000 7f20b241f700 1 -- 172.21.15.38:0/417772190 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ac151520 con 0x7f20ac0ad5b0 2020-06-12T17:49:26.749 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.733+0000 7f20ab7fe700 1 --2- 172.21.15.38:0/417772190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20ac0ad5b0 0x7f20ac0b1870 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7f20a0002f30 tx=0x7f20a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:26.750 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.733+0000 7f20b241f700 1 -- 172.21.15.38:0/417772190 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ac056c30 con 0x7f20ac0ad5b0 2020-06-12T17:49:26.750 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.733+0000 7f20a97fa700 1 -- 172.21.15.38:0/417772190 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f20a00056c0 con 0x7f20ac0ad5b0 2020-06-12T17:49:26.750 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.733+0000 7f20ab7fe700 1 --2- 172.21.15.38:0/417772190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20ac0ad5b0 0x7f20ac0b1870 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7f20a0002f30 tx=0x7f20a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:26.750 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.733+0000 7f20a97fa700 1 --2- 172.21.15.38:0/417772190 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f208c04d8c0 0x7f208c04fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:26.750 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.734+0000 7f20a97fa700 1 -- 172.21.15.38:0/417772190 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f20a00615c0 con 0x7f20ac0ad5b0 2020-06-12T17:49:26.751 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.734+0000 7f20abfff700 1 --2- 172.21.15.38:0/417772190 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f208c04d8c0 0x7f208c04fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:26.751 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.734+0000 7f20abfff700 1 --2- 172.21.15.38:0/417772190 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f208c04d8c0 0x7f208c04fd80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f209c0010d0 tx=0x7f209c0016a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:26.751 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.734+0000 7f20abfff700 1 --2- 172.21.15.38:0/417772190 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f208c04d8c0 0x7f208c04fd80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f209c0010d0 tx=0x7f209c0016a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:26.751 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.734+0000 7f20abfff700 1 --2- 172.21.15.38:0/417772190 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f208c04d8c0 0x7f208c04fd80 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7f209c0010d0 tx=0x7f209c0016a0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:26.751 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.737+0000 7f20ab7fe700 1 --2- 172.21.15.38:0/417772190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20ac0ad5b0 0x7f20ac0b1870 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7f20a0002f30 tx=0x7f20a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:26.752 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.737+0000 7f20a97fa700 1 -- 172.21.15.38:0/417772190 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f20a003cde0 con 0x7f20ac0ad5b0 2020-06-12T17:49:26.936 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.932+0000 7f20b241f700 1 -- 172.21.15.38:0/417772190 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_8606", "target": ["mon-mgr", ""]}) v1 -- 0x7f20ac0b15d0 con 0x7f208c04d8c0 2020-06-12T17:49:26.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.953+0000 7f20abfff700 1 --2- 172.21.15.38:0/417772190 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f208c04d8c0 0x7f208c04fd80 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f209c0010d0 tx=0x7f209c0016a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:26.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.953+0000 7f20a97fa700 1 -- 172.21.15.38:0/417772190 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f209c009880 con 0x7f208c04d8c0 2020-06-12T17:49:26.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.954+0000 7f20b241f700 1 -- 172.21.15.38:0/417772190 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f208c04d8c0 msgr2=0x7f208c04fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:26.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.954+0000 7f20b241f700 1 --2- 172.21.15.38:0/417772190 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f208c04d8c0 0x7f208c04fd80 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7f209c0010d0 tx=0x7f209c0016a0).stop 2020-06-12T17:49:26.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.954+0000 7f20b241f700 1 -- 172.21.15.38:0/417772190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20ac0ad5b0 msgr2=0x7f20ac0b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:26.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.954+0000 7f20b241f700 1 --2- 172.21.15.38:0/417772190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20ac0ad5b0 0x7f20ac0b1870 secure :-1 s=READY pgs=293 cs=0 l=1 rx=0x7f20a0002f30 tx=0x7f20a0007e60).stop 2020-06-12T17:49:26.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.954+0000 7f20b241f700 1 -- 172.21.15.38:0/417772190 shutdown_connections 2020-06-12T17:49:26.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.954+0000 7f20b241f700 1 --2- 172.21.15.38:0/417772190 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f208c04d8c0 0x7f208c04fd80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:26.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.954+0000 7f20b241f700 1 --2- 172.21.15.38:0/417772190 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20ac09d8d0 0x7f20ac0b23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:26.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.954+0000 7f20b241f700 1 --2- 172.21.15.38:0/417772190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20ac0ad5b0 0x7f20ac0b1870 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:26.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.954+0000 7f20b241f700 1 -- 172.21.15.38:0/417772190 >> 172.21.15.38:0/417772190 conn(0x7f20ac0b5a20 msgr2=0x7f20ac09c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:26.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.954+0000 7f20b241f700 1 -- 172.21.15.38:0/417772190 shutdown_connections 2020-06-12T17:49:26.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:26.954+0000 7f20b241f700 1 -- 172.21.15.38:0/417772190 wait complete. 2020-06-12T17:49:26.968 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_8606 2020-06-12T17:49:27.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.082+0000 7fbbaeb34700 1 Processor -- start 2020-06-12T17:49:27.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.082+0000 7fbbaeb34700 1 -- start start 2020-06-12T17:49:27.089 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.082+0000 7fbbaeb34700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbba80b2eb0 0x7fbba814d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:27.089 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.082+0000 7fbbaeb34700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba8146d20 con 0x7fbba80ad5b0 2020-06-12T17:49:27.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.082+0000 7fbbaeb34700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba8066a80 con 0x7fbba8146680 2020-06-12T17:49:27.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.082+0000 7fbbaeb34700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba8146f50 con 0x7fbba80b2eb0 2020-06-12T17:49:27.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.083+0000 7fbba7fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fbba80ad5b0 0x7fbba809d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39560/0 (socket says 172.21.15.38:39560) 2020-06-12T17:49:27.091 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.083+0000 7fbba7fff700 1 -- 172.21.15.38:0/3865374405 learned_addr learned my addr 172.21.15.38:0/3865374405 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:27.091 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.083+0000 7fbbad0d1700 1 --2- 172.21.15.38:0/3865374405 >> v2:172.21.15.150:3300/0 conn(0x7fbba80b2eb0 0x7fbba814d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:27.091 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.083+0000 7fbba77fe700 1 -- 172.21.15.38:0/3865374405 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 975004097 0 0) 0x7fbba8146d20 con 0x7fbba80ad5b0 2020-06-12T17:49:27.091 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.083+0000 7fbba77fe700 1 -- 172.21.15.38:0/3865374405 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb94003230 con 0x7fbba80ad5b0 2020-06-12T17:49:27.091 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.083+0000 7fbba77fe700 1 -- 172.21.15.38:0/3865374405 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 307859234 0 0) 0x7fbb94003230 con 0x7fbba80ad5b0 2020-06-12T17:49:27.092 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.083+0000 7fbba77fe700 1 -- 172.21.15.38:0/3865374405 >> v2:172.21.15.150:3300/0 conn(0x7fbba80b2eb0 msgr2=0x7fbba814d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:27.092 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.083+0000 7fbba77fe700 1 --2- 172.21.15.38:0/3865374405 >> v2:172.21.15.150:3300/0 conn(0x7fbba80b2eb0 0x7fbba814d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:27.092 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.083+0000 7fbba77fe700 1 -- 172.21.15.38:0/3865374405 >> v1:172.21.15.150:6789/0 conn(0x7fbba8146680 legacy=0x7fbba809d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:27.092 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.083+0000 7fbba77fe700 1 -- 172.21.15.38:0/3865374405 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba8146a60 con 0x7fbba80ad5b0 2020-06-12T17:49:27.092 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.083+0000 7fbba77fe700 1 -- 172.21.15.38:0/3865374405 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fbb9c0016d0 con 0x7fbba80ad5b0 2020-06-12T17:49:27.093 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.083+0000 7fbbad0d1700 1 --2- 172.21.15.38:0/3865374405 >> v2:172.21.15.150:3300/0 conn(0x7fbba80b2eb0 0x7fbba814d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:49:27.093 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.083+0000 7fbba77fe700 1 -- 172.21.15.38:0/3865374405 >> v1:172.21.15.38:6789/0 conn(0x7fbba80ad5b0 legacy=0x7fbba809d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:27.093 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.083+0000 7fbba77fe700 1 --2- 172.21.15.38:0/3865374405 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb94003770 0x7fbb94003bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:27.093 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.083+0000 7fbba77fe700 1 --2- 172.21.15.38:0/3865374405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb940044d0 0x7fbb94004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:27.093 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.083+0000 7fbba77fe700 1 --2- 172.21.15.38:0/3865374405 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb94004db0 0x7fbb9400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:27.094 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.083+0000 7fbba77fe700 1 -- 172.21.15.38:0/3865374405 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba8146f50 con 0x7fbb94003770 2020-06-12T17:49:27.094 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.083+0000 7fbba77fe700 1 -- 172.21.15.38:0/3865374405 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb94005290 con 0x7fbb940044d0 2020-06-12T17:49:27.094 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.083+0000 7fbba77fe700 1 -- 172.21.15.38:0/3865374405 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9400dd90 con 0x7fbb94004db0 2020-06-12T17:49:27.094 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.083+0000 7fbbac8d0700 1 --2- 172.21.15.38:0/3865374405 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb94003770 0x7fbb94003bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:27.094 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.083+0000 7fbba7fff700 1 --2- 172.21.15.38:0/3865374405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb940044d0 0x7fbb94004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:27.095 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.083+0000 7fbbad0d1700 1 --2- 172.21.15.38:0/3865374405 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb94004db0 0x7fbb9400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:27.095 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.084+0000 7fbbac8d0700 1 -- 172.21.15.38:0/3865374405 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb94004db0 msgr2=0x7fbb9400b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:27.095 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.084+0000 7fbbac8d0700 1 --2- 172.21.15.38:0/3865374405 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb94004db0 0x7fbb9400b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:27.095 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.084+0000 7fbbac8d0700 1 -- 172.21.15.38:0/3865374405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb940044d0 msgr2=0x7fbb94004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:27.095 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.084+0000 7fbbac8d0700 1 --2- 172.21.15.38:0/3865374405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb940044d0 0x7fbb94004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:27.095 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.084+0000 7fbbad0d1700 1 -- 172.21.15.38:0/3865374405 reap_dead start 2020-06-12T17:49:27.096 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.084+0000 7fbbac8d0700 1 -- 172.21.15.38:0/3865374405 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb94003230 con 0x7fbb94003770 2020-06-12T17:49:27.096 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.084+0000 7fbbac8d0700 1 --2- 172.21.15.38:0/3865374405 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb94003770 0x7fbb94003bb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbb940054a0 tx=0x7fbb98001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:27.096 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.084+0000 7fbbac8d0700 1 --2- 172.21.15.38:0/3865374405 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb94003770 0x7fbb94003bb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbb940054a0 tx=0x7fbb98001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:27.096 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.084+0000 7fbbac8d0700 1 --2- 172.21.15.38:0/3865374405 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb94003770 0x7fbb94003bb0 secure :-1 s=READY pgs=487 cs=0 l=1 rx=0x7fbb940054a0 tx=0x7fbb98001840).ready entity=mon.0 client_cookie=a1504629b51e3727 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:27.096 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.084+0000 7fbbac8d0700 1 --2- 172.21.15.38:0/3865374405 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb94003770 0x7fbb94003bb0 secure :-1 s=THROTTLE_DONE pgs=487 cs=0 l=1 rx=0x7fbb940054a0 tx=0x7fbb98001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:27.097 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.084+0000 7fbbac8d0700 1 --2- 172.21.15.38:0/3865374405 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb94003770 0x7fbb94003bb0 secure :-1 s=THROTTLE_DONE pgs=487 cs=0 l=1 rx=0x7fbb940054a0 tx=0x7fbb98001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:27.097 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.084+0000 7fbba77fe700 1 -- 172.21.15.38:0/3865374405 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb98003540 con 0x7fbb94003770 2020-06-12T17:49:27.097 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.084+0000 7fbbac8d0700 1 --2- 172.21.15.38:0/3865374405 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb94003770 0x7fbb94003bb0 secure :-1 s=THROTTLE_DONE pgs=487 cs=0 l=1 rx=0x7fbb940054a0 tx=0x7fbb98001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:27.097 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.084+0000 7fbba77fe700 1 -- 172.21.15.38:0/3865374405 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb980036a0 con 0x7fbb94003770 2020-06-12T17:49:27.097 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.084+0000 7fbba77fe700 1 -- 172.21.15.38:0/3865374405 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb98003aa0 con 0x7fbb94003770 2020-06-12T17:49:27.098 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.084+0000 7fbbaeb34700 1 -- 172.21.15.38:0/3865374405 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb94003770 msgr2=0x7fbb94003bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:27.099 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.084+0000 7fbbaeb34700 1 --2- 172.21.15.38:0/3865374405 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb94003770 0x7fbb94003bb0 secure :-1 s=READY pgs=487 cs=0 l=1 rx=0x7fbb940054a0 tx=0x7fbb98001840).stop 2020-06-12T17:49:27.099 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.084+0000 7fbbaeb34700 1 -- 172.21.15.38:0/3865374405 shutdown_connections 2020-06-12T17:49:27.099 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.084+0000 7fbbaeb34700 1 --2- 172.21.15.38:0/3865374405 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb94003770 0x7fbb94003bb0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:27.099 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.084+0000 7fbbaeb34700 1 -- 172.21.15.38:0/3865374405 >> 172.21.15.38:0/3865374405 conn(0x7fbba80b5a20 msgr2=0x7fbba805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:27.099 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.084+0000 7fbbaeb34700 1 -- 172.21.15.38:0/3865374405 shutdown_connections 2020-06-12T17:49:27.100 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.084+0000 7fbbaeb34700 1 -- 172.21.15.38:0/3865374405 wait complete. 2020-06-12T17:49:27.100 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.085+0000 7fbbaeb34700 1 Processor -- start 2020-06-12T17:49:27.100 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.085+0000 7fbbaeb34700 1 -- start start 2020-06-12T17:49:27.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.086+0000 7fbbaeb34700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbba81420d0 0x7fbba8140eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:27.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.086+0000 7fbbaeb34700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbba813e590 0x7fbba80afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:27.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.086+0000 7fbbaeb34700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba81425c0 con 0x7fbb94003770 2020-06-12T17:49:27.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.086+0000 7fbbaeb34700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba8142860 con 0x7fbba813e590 2020-06-12T17:49:27.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.086+0000 7fbbaeb34700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba8142b00 con 0x7fbba81420d0 2020-06-12T17:49:27.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.086+0000 7fbbad0d1700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbba813e590 0x7fbba80afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:27.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.086+0000 7fbbad0d1700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbba813e590 0x7fbba80afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37758/0 (socket says 172.21.15.38:37758) 2020-06-12T17:49:27.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.086+0000 7fbbad0d1700 1 -- 172.21.15.38:0/870208910 learned_addr learned my addr 172.21.15.38:0/870208910 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:27.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.086+0000 7fbba7fff700 1 --2- 172.21.15.38:0/870208910 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbba81420d0 0x7fbba8140eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:27.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.087+0000 7fbbad0d1700 1 -- 172.21.15.38:0/870208910 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbba81420d0 msgr2=0x7fbba8140eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:27.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.087+0000 7fbbad0d1700 1 --2- 172.21.15.38:0/870208910 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbba81420d0 0x7fbba8140eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:27.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.087+0000 7fbbad0d1700 1 -- 172.21.15.38:0/870208910 >> v1:172.21.15.150:6789/0 conn(0x7fbb94003770 legacy=0x7fbba8142fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:27.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.087+0000 7fbbad0d1700 1 -- 172.21.15.38:0/870208910 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba80b2ab0 con 0x7fbba813e590 2020-06-12T17:49:27.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.087+0000 7fbba7fff700 1 --2- 172.21.15.38:0/870208910 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbba81420d0 0x7fbba8140eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:49:27.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.087+0000 7fbbad0d1700 1 --2- 172.21.15.38:0/870208910 >> v2:172.21.15.38:3300/0 conn(0x7fbba813e590 0x7fbba80afd80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbb9c0014a0 tx=0x7fbba00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:27.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.087+0000 7fbbad0d1700 1 --2- 172.21.15.38:0/870208910 >> v2:172.21.15.38:3300/0 conn(0x7fbba813e590 0x7fbba80afd80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbb9c0014a0 tx=0x7fbba00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:27.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.087+0000 7fbbad0d1700 1 --2- 172.21.15.38:0/870208910 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba813e590 0x7fbba80afd80 secure :-1 s=READY pgs=488 cs=0 l=1 rx=0x7fbb9c0014a0 tx=0x7fbba00081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:27.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.087+0000 7fbbad0d1700 1 --2- 172.21.15.38:0/870208910 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba813e590 0x7fbba80afd80 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7fbb9c0014a0 tx=0x7fbba00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:27.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.087+0000 7fbba5ffb700 1 -- 172.21.15.38:0/870208910 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbba0005e20 con 0x7fbba813e590 2020-06-12T17:49:27.119 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.087+0000 7fbbad0d1700 1 --2- 172.21.15.38:0/870208910 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba813e590 0x7fbba80afd80 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7fbb9c0014a0 tx=0x7fbba00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:27.119 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.087+0000 7fbbad0d1700 1 --2- 172.21.15.38:0/870208910 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba813e590 0x7fbba80afd80 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7fbb9c0014a0 tx=0x7fbba00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:27.119 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.087+0000 7fbba5ffb700 1 -- 172.21.15.38:0/870208910 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba00118f0 con 0x7fbba813e590 2020-06-12T17:49:27.119 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.087+0000 7fbba5ffb700 1 -- 172.21.15.38:0/870208910 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbba0011c50 con 0x7fbba813e590 2020-06-12T17:49:27.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.087+0000 7fbbaeb34700 1 -- 172.21.15.38:0/870208910 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba81436b0 con 0x7fbba813e590 2020-06-12T17:49:27.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.087+0000 7fbbaeb34700 1 -- 172.21.15.38:0/870208910 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba80b03a0 con 0x7fbba813e590 2020-06-12T17:49:27.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.088+0000 7fbbad0d1700 1 --2- 172.21.15.38:0/870208910 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba813e590 0x7fbba80afd80 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7fbb9c0014a0 tx=0x7fbba00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:27.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.088+0000 7fbbaeb34700 1 -- 172.21.15.38:0/870208910 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba8056c30 con 0x7fbba813e590 2020-06-12T17:49:27.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.088+0000 7fbba5ffb700 1 -- 172.21.15.38:0/870208910 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fbba0007150 con 0x7fbba813e590 2020-06-12T17:49:27.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.088+0000 7fbbad0d1700 1 --2- 172.21.15.38:0/870208910 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba813e590 0x7fbba80afd80 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7fbb9c0014a0 tx=0x7fbba00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:27.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.088+0000 7fbba5ffb700 1 --2- 172.21.15.38:0/870208910 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbb8804d5e0 0x7fbb8804faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:27.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.088+0000 7fbba5ffb700 1 -- 172.21.15.38:0/870208910 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fbba0060c70 con 0x7fbba813e590 2020-06-12T17:49:27.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.089+0000 7fbbac8d0700 1 --2- 172.21.15.38:0/870208910 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbb8804d5e0 0x7fbb8804faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:27.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.089+0000 7fbbac8d0700 1 --2- 172.21.15.38:0/870208910 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbb8804d5e0 0x7fbb8804faa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbba813c570 tx=0x7fbb98001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:27.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.089+0000 7fbbac8d0700 1 --2- 172.21.15.38:0/870208910 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbb8804d5e0 0x7fbb8804faa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbba813c570 tx=0x7fbb98001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:27.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.089+0000 7fbbac8d0700 1 --2- 172.21.15.38:0/870208910 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbb8804d5e0 0x7fbb8804faa0 secure :-1 s=READY pgs=197 cs=0 l=1 rx=0x7fbba813c570 tx=0x7fbb98001840).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:27.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.092+0000 7fbbad0d1700 1 --2- 172.21.15.38:0/870208910 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba813e590 0x7fbba80afd80 secure :-1 s=THROTTLE_DONE pgs=488 cs=0 l=1 rx=0x7fbb9c0014a0 tx=0x7fbba00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:27.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.092+0000 7fbba5ffb700 1 -- 172.21.15.38:0/870208910 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fbba003c3f0 con 0x7fbba813e590 2020-06-12T17:49:27.289 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.285+0000 7fbbaeb34700 1 -- 172.21.15.38:0/870208910 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_8606", "target": ["mon-mgr", ""]}) v1 -- 0x7fbba805a5e0 con 0x7fbb8804d5e0 2020-06-12T17:49:27.292 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.289+0000 7fbbac8d0700 1 --2- 172.21.15.38:0/870208910 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbb8804d5e0 0x7fbb8804faa0 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7fbba813c570 tx=0x7fbb98001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:27.292 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.289+0000 7fbba5ffb700 1 -- 172.21.15.38:0/870208910 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7fbba805a5e0 con 0x7fbb8804d5e0 2020-06-12T17:49:27.293 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_8606/bb2ab861-d996-4cda-941e-996152c38007 2020-06-12T17:49:27.294 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.290+0000 7fbbaeb34700 1 -- 172.21.15.38:0/870208910 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbb8804d5e0 msgr2=0x7fbb8804faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:27.294 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.290+0000 7fbbaeb34700 1 --2- 172.21.15.38:0/870208910 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbb8804d5e0 0x7fbb8804faa0 secure :-1 s=READY pgs=197 cs=0 l=1 rx=0x7fbba813c570 tx=0x7fbb98001840).stop 2020-06-12T17:49:27.295 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.290+0000 7fbbaeb34700 1 -- 172.21.15.38:0/870208910 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba813e590 msgr2=0x7fbba80afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:27.295 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.290+0000 7fbbaeb34700 1 --2- 172.21.15.38:0/870208910 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba813e590 0x7fbba80afd80 secure :-1 s=READY pgs=488 cs=0 l=1 rx=0x7fbb9c0014a0 tx=0x7fbba00081e0).stop 2020-06-12T17:49:27.295 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.291+0000 7fbbaeb34700 1 -- 172.21.15.38:0/870208910 shutdown_connections 2020-06-12T17:49:27.295 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.291+0000 7fbbaeb34700 1 --2- 172.21.15.38:0/870208910 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbb8804d5e0 0x7fbb8804faa0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:27.295 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.291+0000 7fbbaeb34700 1 --2- 172.21.15.38:0/870208910 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba813e590 0x7fbba80afd80 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:27.296 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.291+0000 7fbbaeb34700 1 --2- 172.21.15.38:0/870208910 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbba81420d0 0x7fbba8140eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:27.296 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.291+0000 7fbbaeb34700 1 -- 172.21.15.38:0/870208910 >> 172.21.15.38:0/870208910 conn(0x7fbba80b5a20 msgr2=0x7fbba8143a20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:27.296 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.291+0000 7fbbaeb34700 1 -- 172.21.15.38:0/870208910 shutdown_connections 2020-06-12T17:49:27.296 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:27.291+0000 7fbbaeb34700 1 -- 172.21.15.38:0/870208910 wait complete. 2020-06-12T17:49:27.304 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_8606 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_8606/bb2ab861-d996-4cda-941e-996152c38007 2020-06-12T17:49:27.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:27.305 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:27.305 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:27.321 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:27.321 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:27.322 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8606/bb2ab861-d996-4cda-941e-996152c38007/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:27.416 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:27.416 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:27.417 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140643 s, 74.6 MB/s 2020-06-12T17:49:27.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:27.418 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:27.419 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:27.433 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:27.434 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:27.434 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8606/bb2ab861-d996-4cda-941e-996152c38007/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:27.522 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:27.523 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:27.523 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112097 s, 93.5 MB/s 2020-06-12T17:49:27.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:27.525 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:27.525 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:27.539 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:27.540 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:27.541 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8606/bb2ab861-d996-4cda-941e-996152c38007/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:27.632 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:27.632 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:27.632 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138202 s, 75.9 MB/s 2020-06-12T17:49:27.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:27.634 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:27.635 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:27.649 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:27.650 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:27.650 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8606/bb2ab861-d996-4cda-941e-996152c38007/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:27.738 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:27.739 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:27.739 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118591 s, 88.4 MB/s 2020-06-12T17:49:27.740 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:27.740 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:27.741 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:27.756 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:27.756 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:27.757 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8606/bb2ab861-d996-4cda-941e-996152c38007/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:27.842 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:27.843 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:27.843 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101226 s, 104 MB/s 2020-06-12T17:49:27.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:27.844 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:27.845 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:27.860 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:27.861 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:27.862 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8606/bb2ab861-d996-4cda-941e-996152c38007/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:27.950 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:27.951 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:27.951 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137322 s, 76.4 MB/s 2020-06-12T17:49:27.953 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:27.954 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:27.954 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:27.970 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:27.970 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:27.971 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8606/bb2ab861-d996-4cda-941e-996152c38007/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:28.058 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:28.058 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:28.058 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928641 s, 113 MB/s 2020-06-12T17:49:28.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:28.060 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:28.061 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:28.076 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:28.078 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:28.078 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8606/bb2ab861-d996-4cda-941e-996152c38007/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:28.166 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:28.167 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:28.167 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116133 s, 90.3 MB/s 2020-06-12T17:49:28.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:28.169 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:28.170 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:28.186 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:28.186 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:28.187 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8606/bb2ab861-d996-4cda-941e-996152c38007/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:28.275 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:28.275 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:28.276 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120156 s, 87.3 MB/s 2020-06-12T17:49:28.277 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:28.277 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:28.278 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:28.297 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:28.299 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:28.301 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8606/bb2ab861-d996-4cda-941e-996152c38007/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:28.383 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:28.384 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:28.384 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00970444 s, 108 MB/s 2020-06-12T17:49:28.386 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_8746 2020-06-12T17:49:28.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.499+0000 7fd492a8c700 1 Processor -- start 2020-06-12T17:49:28.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.499+0000 7fd492a8c700 1 -- start start 2020-06-12T17:49:28.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.500+0000 7fd492a8c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd48c0ad5b0 0x7fd48c0b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:28.511 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.500+0000 7fd492a8c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd48c09d8d0 0x7fd48c1421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:28.511 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.500+0000 7fd492a8c700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c146d20 con 0x7fd48c146680 2020-06-12T17:49:28.511 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.500+0000 7fd492a8c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c066a80 con 0x7fd48c09d8d0 2020-06-12T17:49:28.511 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.500+0000 7fd492a8c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c146f50 con 0x7fd48c0ad5b0 2020-06-12T17:49:28.511 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.500+0000 7fd490828700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd48c146680 0x7fd48c09d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39578/0 (socket says 172.21.15.38:39578) 2020-06-12T17:49:28.512 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.500+0000 7fd490828700 1 -- 172.21.15.38:0/1889373729 learned_addr learned my addr 172.21.15.38:0/1889373729 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:28.512 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.500+0000 7fd491029700 1 --2- 172.21.15.38:0/1889373729 >> v2:172.21.15.150:3300/0 conn(0x7fd48c09d8d0 0x7fd48c1421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:28.512 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.500+0000 7fd48bfff700 1 --2- 172.21.15.38:0/1889373729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd48c0ad5b0 0x7fd48c0b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:28.512 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.500+0000 7fd48b7fe700 1 -- 172.21.15.38:0/1889373729 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 956725651 0 0) 0x7fd48c146d20 con 0x7fd48c146680 2020-06-12T17:49:28.512 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.500+0000 7fd48b7fe700 1 -- 172.21.15.38:0/1889373729 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd478003230 con 0x7fd48c146680 2020-06-12T17:49:28.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.501+0000 7fd48bfff700 1 -- 172.21.15.38:0/1889373729 >> v2:172.21.15.150:3300/0 conn(0x7fd48c09d8d0 msgr2=0x7fd48c1421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:28.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.501+0000 7fd48bfff700 1 --2- 172.21.15.38:0/1889373729 >> v2:172.21.15.150:3300/0 conn(0x7fd48c09d8d0 0x7fd48c1421d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:28.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.501+0000 7fd48bfff700 1 -- 172.21.15.38:0/1889373729 >> v1:172.21.15.38:6789/0 conn(0x7fd48c146680 legacy=0x7fd48c09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:28.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.501+0000 7fd48b7fe700 1 -- 172.21.15.38:0/1889373729 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2718932317 0 0) 0x7fd478003230 con 0x7fd48c146680 2020-06-12T17:49:28.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.501+0000 7fd48bfff700 1 -- 172.21.15.38:0/1889373729 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c146a60 con 0x7fd48c0ad5b0 2020-06-12T17:49:28.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.501+0000 7fd491029700 1 --2- 172.21.15.38:0/1889373729 >> v2:172.21.15.150:3300/0 conn(0x7fd48c09d8d0 0x7fd48c1421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:49:28.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.501+0000 7fd48bfff700 1 --2- 172.21.15.38:0/1889373729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd48c0ad5b0 0x7fd48c0b2eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd47c001870 tx=0x7fd480007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.501+0000 7fd48bfff700 1 --2- 172.21.15.38:0/1889373729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd48c0ad5b0 0x7fd48c0b2eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd47c001870 tx=0x7fd480007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.501+0000 7fd48bfff700 1 --2- 172.21.15.38:0/1889373729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd48c0ad5b0 0x7fd48c0b2eb0 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7fd47c001870 tx=0x7fd480007e60).ready entity=mon.2 client_cookie=261966ac82e29dbe server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:28.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.501+0000 7fd48bfff700 1 --2- 172.21.15.38:0/1889373729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd48c0ad5b0 0x7fd48c0b2eb0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7fd47c001870 tx=0x7fd480007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.501+0000 7fd48b7fe700 1 -- 172.21.15.38:0/1889373729 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd47c0016d0 con 0x7fd48c0ad5b0 2020-06-12T17:49:28.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.501+0000 7fd48bfff700 1 --2- 172.21.15.38:0/1889373729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd48c0ad5b0 0x7fd48c0b2eb0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7fd47c001870 tx=0x7fd480007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.501+0000 7fd48b7fe700 1 -- 172.21.15.38:0/1889373729 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd480008cb0 con 0x7fd48c0ad5b0 2020-06-12T17:49:28.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.501+0000 7fd48bfff700 1 --2- 172.21.15.38:0/1889373729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd48c0ad5b0 0x7fd48c0b2eb0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7fd47c001870 tx=0x7fd480007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.501+0000 7fd48b7fe700 1 -- 172.21.15.38:0/1889373729 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd480008e20 con 0x7fd48c0ad5b0 2020-06-12T17:49:28.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.501+0000 7fd492a8c700 1 -- 172.21.15.38:0/1889373729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd48c0ad5b0 msgr2=0x7fd48c0b2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:28.517 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.501+0000 7fd492a8c700 1 --2- 172.21.15.38:0/1889373729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd48c0ad5b0 0x7fd48c0b2eb0 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7fd47c001870 tx=0x7fd480007e60).stop 2020-06-12T17:49:28.518 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.502+0000 7fd492a8c700 1 -- 172.21.15.38:0/1889373729 shutdown_connections 2020-06-12T17:49:28.518 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.502+0000 7fd492a8c700 1 --2- 172.21.15.38:0/1889373729 >> v2:172.21.15.150:3300/0 conn(0x7fd48c09d8d0 0x7fd48c1421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:28.518 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.502+0000 7fd492a8c700 1 --2- 172.21.15.38:0/1889373729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd48c0ad5b0 0x7fd48c0b2eb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:28.518 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.502+0000 7fd492a8c700 1 -- 172.21.15.38:0/1889373729 >> 172.21.15.38:0/1889373729 conn(0x7fd48c0b5a20 msgr2=0x7fd48c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:28.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.502+0000 7fd492a8c700 1 -- 172.21.15.38:0/1889373729 shutdown_connections 2020-06-12T17:49:28.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.502+0000 7fd492a8c700 1 -- 172.21.15.38:0/1889373729 wait complete. 2020-06-12T17:49:28.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.503+0000 7fd492a8c700 1 Processor -- start 2020-06-12T17:49:28.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.503+0000 7fd492a8c700 1 -- start start 2020-06-12T17:49:28.520 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.503+0000 7fd492a8c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd48c09d8d0 0x7fd48c065920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:28.520 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.503+0000 7fd492a8c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd48c0ad5b0 0x7fd48c153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:28.520 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.503+0000 7fd492a8c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c1400f0 con 0x7fd48c146680 2020-06-12T17:49:28.520 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.503+0000 7fd492a8c700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c140390 con 0x7fd48c0ad5b0 2020-06-12T17:49:28.520 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.503+0000 7fd492a8c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c140630 con 0x7fd48c09d8d0 2020-06-12T17:49:28.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.504+0000 7fd48bfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd48c0ad5b0 0x7fd48c153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:28.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.504+0000 7fd48bfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd48c0ad5b0 0x7fd48c153d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37770/0 (socket says 172.21.15.38:37770) 2020-06-12T17:49:28.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.504+0000 7fd48bfff700 1 -- 172.21.15.38:0/4109846821 learned_addr learned my addr 172.21.15.38:0/4109846821 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:28.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.504+0000 7fd490828700 1 --2- 172.21.15.38:0/4109846821 >> v2:172.21.15.150:3300/0 conn(0x7fd48c09d8d0 0x7fd48c065920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:28.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.504+0000 7fd48bfff700 1 -- 172.21.15.38:0/4109846821 >> v2:172.21.15.150:3300/0 conn(0x7fd48c09d8d0 msgr2=0x7fd48c065920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:28.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.504+0000 7fd48bfff700 1 --2- 172.21.15.38:0/4109846821 >> v2:172.21.15.150:3300/0 conn(0x7fd48c09d8d0 0x7fd48c065920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:28.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.504+0000 7fd48bfff700 1 -- 172.21.15.38:0/4109846821 >> v1:172.21.15.150:6789/0 conn(0x7fd48c146680 legacy=0x7fd48c0b1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:28.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.504+0000 7fd48bfff700 1 -- 172.21.15.38:0/4109846821 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c154160 con 0x7fd48c0ad5b0 2020-06-12T17:49:28.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.504+0000 7fd48bfff700 1 --2- 172.21.15.38:0/4109846821 >> v2:172.21.15.38:3300/0 conn(0x7fd48c0ad5b0 0x7fd48c153d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd48c1532f0 tx=0x7fd480007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.504+0000 7fd48bfff700 1 --2- 172.21.15.38:0/4109846821 >> v2:172.21.15.38:3300/0 conn(0x7fd48c0ad5b0 0x7fd48c153d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd48c1532f0 tx=0x7fd480007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.504+0000 7fd48bfff700 1 --2- 172.21.15.38:0/4109846821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd48c0ad5b0 0x7fd48c153d00 secure :-1 s=READY pgs=490 cs=0 l=1 rx=0x7fd48c1532f0 tx=0x7fd480007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:28.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.504+0000 7fd48bfff700 1 --2- 172.21.15.38:0/4109846821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd48c0ad5b0 0x7fd48c153d00 secure :-1 s=THROTTLE_DONE pgs=490 cs=0 l=1 rx=0x7fd48c1532f0 tx=0x7fd480007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.504+0000 7fd48bfff700 1 --2- 172.21.15.38:0/4109846821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd48c0ad5b0 0x7fd48c153d00 secure :-1 s=THROTTLE_DONE pgs=490 cs=0 l=1 rx=0x7fd48c1532f0 tx=0x7fd480007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.504+0000 7fd489ffb700 1 -- 172.21.15.38:0/4109846821 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd480008700 con 0x7fd48c0ad5b0 2020-06-12T17:49:28.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.504+0000 7fd48bfff700 1 --2- 172.21.15.38:0/4109846821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd48c0ad5b0 0x7fd48c153d00 secure :-1 s=THROTTLE_DONE pgs=490 cs=0 l=1 rx=0x7fd48c1532f0 tx=0x7fd480007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.504+0000 7fd489ffb700 1 -- 172.21.15.38:0/4109846821 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd480011cc0 con 0x7fd48c0ad5b0 2020-06-12T17:49:28.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.504+0000 7fd492a8c700 1 -- 172.21.15.38:0/4109846821 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd48c140ad0 con 0x7fd48c0ad5b0 2020-06-12T17:49:28.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.504+0000 7fd489ffb700 1 -- 172.21.15.38:0/4109846821 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd480011e70 con 0x7fd48c0ad5b0 2020-06-12T17:49:28.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.504+0000 7fd492a8c700 1 -- 172.21.15.38:0/4109846821 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd48c141020 con 0x7fd48c0ad5b0 2020-06-12T17:49:28.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.505+0000 7fd48bfff700 1 --2- 172.21.15.38:0/4109846821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd48c0ad5b0 0x7fd48c153d00 secure :-1 s=THROTTLE_DONE pgs=490 cs=0 l=1 rx=0x7fd48c1532f0 tx=0x7fd480007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.505+0000 7fd489ffb700 1 -- 172.21.15.38:0/4109846821 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fd480007350 con 0x7fd48c0ad5b0 2020-06-12T17:49:28.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.505+0000 7fd48bfff700 1 --2- 172.21.15.38:0/4109846821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd48c0ad5b0 0x7fd48c153d00 secure :-1 s=THROTTLE_DONE pgs=490 cs=0 l=1 rx=0x7fd48c1532f0 tx=0x7fd480007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.505+0000 7fd492a8c700 1 -- 172.21.15.38:0/4109846821 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd48c056c30 con 0x7fd48c0ad5b0 2020-06-12T17:49:28.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.505+0000 7fd489ffb700 1 --2- 172.21.15.38:0/4109846821 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd46c04d5e0 0x7fd46c04faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:28.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.505+0000 7fd489ffb700 1 -- 172.21.15.38:0/4109846821 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd4800613b0 con 0x7fd48c0ad5b0 2020-06-12T17:49:28.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.506+0000 7fd490828700 1 --2- 172.21.15.38:0/4109846821 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd46c04d5e0 0x7fd46c04faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:28.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.506+0000 7fd490828700 1 --2- 172.21.15.38:0/4109846821 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd46c04d5e0 0x7fd46c04faa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd47c001930 tx=0x7fd47c001410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.506+0000 7fd490828700 1 --2- 172.21.15.38:0/4109846821 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd46c04d5e0 0x7fd46c04faa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd47c001930 tx=0x7fd47c001410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.506+0000 7fd490828700 1 --2- 172.21.15.38:0/4109846821 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd46c04d5e0 0x7fd46c04faa0 secure :-1 s=READY pgs=198 cs=0 l=1 rx=0x7fd47c001930 tx=0x7fd47c001410).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:28.528 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.509+0000 7fd48bfff700 1 --2- 172.21.15.38:0/4109846821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd48c0ad5b0 0x7fd48c153d00 secure :-1 s=THROTTLE_DONE pgs=490 cs=0 l=1 rx=0x7fd48c1532f0 tx=0x7fd480007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.528 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.509+0000 7fd489ffb700 1 -- 172.21.15.38:0/4109846821 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fd48003cbf0 con 0x7fd48c0ad5b0 2020-06-12T17:49:28.716 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.711+0000 7fd492a8c700 1 -- 172.21.15.38:0/4109846821 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_8746", "target": ["mon-mgr", ""]}) v1 -- 0x7fd48c140770 con 0x7fd46c04d5e0 2020-06-12T17:49:28.732 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.729+0000 7fd490828700 1 --2- 172.21.15.38:0/4109846821 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd46c04d5e0 0x7fd46c04faa0 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7fd47c001930 tx=0x7fd47c001410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.733 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.729+0000 7fd489ffb700 1 -- 172.21.15.38:0/4109846821 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd48c140770 con 0x7fd46c04d5e0 2020-06-12T17:49:28.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.730+0000 7fd492a8c700 1 -- 172.21.15.38:0/4109846821 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd46c04d5e0 msgr2=0x7fd46c04faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:28.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.730+0000 7fd492a8c700 1 --2- 172.21.15.38:0/4109846821 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd46c04d5e0 0x7fd46c04faa0 secure :-1 s=READY pgs=198 cs=0 l=1 rx=0x7fd47c001930 tx=0x7fd47c001410).stop 2020-06-12T17:49:28.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.730+0000 7fd492a8c700 1 -- 172.21.15.38:0/4109846821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd48c0ad5b0 msgr2=0x7fd48c153d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:28.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.730+0000 7fd492a8c700 1 --2- 172.21.15.38:0/4109846821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd48c0ad5b0 0x7fd48c153d00 secure :-1 s=READY pgs=490 cs=0 l=1 rx=0x7fd48c1532f0 tx=0x7fd480007e60).stop 2020-06-12T17:49:28.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.731+0000 7fd492a8c700 1 -- 172.21.15.38:0/4109846821 shutdown_connections 2020-06-12T17:49:28.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.731+0000 7fd492a8c700 1 --2- 172.21.15.38:0/4109846821 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd46c04d5e0 0x7fd46c04faa0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:28.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.731+0000 7fd492a8c700 1 --2- 172.21.15.38:0/4109846821 >> v2:172.21.15.150:3300/0 conn(0x7fd48c09d8d0 0x7fd48c065920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:28.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.731+0000 7fd492a8c700 1 --2- 172.21.15.38:0/4109846821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd48c0ad5b0 0x7fd48c153d00 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:28.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.731+0000 7fd492a8c700 1 -- 172.21.15.38:0/4109846821 >> 172.21.15.38:0/4109846821 conn(0x7fd48c0b5a20 msgr2=0x7fd48c13e300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:28.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.731+0000 7fd492a8c700 1 -- 172.21.15.38:0/4109846821 shutdown_connections 2020-06-12T17:49:28.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.731+0000 7fd492a8c700 1 -- 172.21.15.38:0/4109846821 wait complete. 2020-06-12T17:49:28.744 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_8746 2020-06-12T17:49:28.861 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.857+0000 7fbd53f80700 1 Processor -- start 2020-06-12T17:49:28.861 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.858+0000 7fbd53f80700 1 -- start start 2020-06-12T17:49:28.869 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.858+0000 7fbd53f80700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd4c0ad5b0 0x7fbd4c0b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:28.869 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.858+0000 7fbd53f80700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4c146d20 con 0x7fbd4c146680 2020-06-12T17:49:28.870 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.858+0000 7fbd53f80700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4c066a80 con 0x7fbd4c09d8d0 2020-06-12T17:49:28.870 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.858+0000 7fbd53f80700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c146f50 con 0x7fbd4c0ad5b0 2020-06-12T17:49:28.870 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.859+0000 7fbd51d1c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fbd4c146680 0x7fbd4c09d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39592/0 (socket says 172.21.15.38:39592) 2020-06-12T17:49:28.870 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.859+0000 7fbd51d1c700 1 -- 172.21.15.38:0/2132681585 learned_addr learned my addr 172.21.15.38:0/2132681585 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:28.870 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.859+0000 7fbd5151b700 1 --2- 172.21.15.38:0/2132681585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd4c0ad5b0 0x7fbd4c0b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:28.871 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.859+0000 7fbd50d1a700 1 -- 172.21.15.38:0/2132681585 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134985712 0 0) 0x7fbd4c146d20 con 0x7fbd4c146680 2020-06-12T17:49:28.871 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.859+0000 7fbd50d1a700 1 -- 172.21.15.38:0/2132681585 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd34003230 con 0x7fbd4c146680 2020-06-12T17:49:28.871 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.859+0000 7fbd50d1a700 1 -- 172.21.15.38:0/2132681585 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1787401065 0 0) 0x7fbd34003230 con 0x7fbd4c146680 2020-06-12T17:49:28.871 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.859+0000 7fbd50d1a700 1 -- 172.21.15.38:0/2132681585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd4c0ad5b0 msgr2=0x7fbd4c0b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:28.871 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.859+0000 7fbd50d1a700 1 --2- 172.21.15.38:0/2132681585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd4c0ad5b0 0x7fbd4c0b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:28.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.859+0000 7fbd50d1a700 1 -- 172.21.15.38:0/2132681585 >> v1:172.21.15.150:6789/0 conn(0x7fbd4c09d8d0 legacy=0x7fbd4c1421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:28.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.859+0000 7fbd50d1a700 1 -- 172.21.15.38:0/2132681585 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c146a60 con 0x7fbd4c146680 2020-06-12T17:49:28.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.859+0000 7fbd50d1a700 1 -- 172.21.15.38:0/2132681585 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fbd3c0016d0 con 0x7fbd4c146680 2020-06-12T17:49:28.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.859+0000 7fbd50d1a700 1 -- 172.21.15.38:0/2132681585 >> v1:172.21.15.38:6789/0 conn(0x7fbd4c146680 legacy=0x7fbd4c09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:28.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.859+0000 7fbd50d1a700 1 --2- 172.21.15.38:0/2132681585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd4c0ad5b0 0x7fbd34003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:28.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.859+0000 7fbd50d1a700 1 --2- 172.21.15.38:0/2132681585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd34003bb0 0x7fbd34004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:28.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.859+0000 7fbd50d1a700 1 --2- 172.21.15.38:0/2132681585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd340045e0 0x7fbd34004a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:28.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.859+0000 7fbd50d1a700 1 -- 172.21.15.38:0/2132681585 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c146f50 con 0x7fbd340045e0 2020-06-12T17:49:28.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.859+0000 7fbd50d1a700 1 -- 172.21.15.38:0/2132681585 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd34005010 con 0x7fbd34003bb0 2020-06-12T17:49:28.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.859+0000 7fbd50d1a700 1 -- 172.21.15.38:0/2132681585 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd340051d0 con 0x7fbd4c0ad5b0 2020-06-12T17:49:28.874 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.859+0000 7fbd5251d700 1 --2- 172.21.15.38:0/2132681585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd340045e0 0x7fbd34004a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:28.874 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.859+0000 7fbd5151b700 1 --2- 172.21.15.38:0/2132681585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd34003bb0 0x7fbd34004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:28.874 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.859+0000 7fbd51d1c700 1 --2- 172.21.15.38:0/2132681585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd4c0ad5b0 0x7fbd34003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:28.874 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.860+0000 7fbd5251d700 1 -- 172.21.15.38:0/2132681585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd4c0ad5b0 msgr2=0x7fbd34003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:28.874 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.860+0000 7fbd5251d700 1 --2- 172.21.15.38:0/2132681585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd4c0ad5b0 0x7fbd34003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:28.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.860+0000 7fbd5251d700 1 -- 172.21.15.38:0/2132681585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd34003bb0 msgr2=0x7fbd34004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:28.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.860+0000 7fbd5251d700 1 --2- 172.21.15.38:0/2132681585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd34003bb0 0x7fbd34004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:28.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.860+0000 7fbd5251d700 1 -- 172.21.15.38:0/2132681585 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd34003230 con 0x7fbd340045e0 2020-06-12T17:49:28.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.860+0000 7fbd5251d700 1 --2- 172.21.15.38:0/2132681585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd340045e0 0x7fbd34004a60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbd4c061380 tx=0x7fbd44001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.860+0000 7fbd5251d700 1 --2- 172.21.15.38:0/2132681585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd340045e0 0x7fbd34004a60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbd4c061380 tx=0x7fbd44001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.860+0000 7fbd5251d700 1 --2- 172.21.15.38:0/2132681585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd340045e0 0x7fbd34004a60 secure :-1 s=READY pgs=492 cs=0 l=1 rx=0x7fbd4c061380 tx=0x7fbd44001bc0).ready entity=mon.0 client_cookie=6bb67da9050f8495 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:28.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.860+0000 7fbd5251d700 1 --2- 172.21.15.38:0/2132681585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd340045e0 0x7fbd34004a60 secure :-1 s=THROTTLE_DONE pgs=492 cs=0 l=1 rx=0x7fbd4c061380 tx=0x7fbd44001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.860+0000 7fbd50d1a700 1 -- 172.21.15.38:0/2132681585 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd44006c40 con 0x7fbd340045e0 2020-06-12T17:49:28.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.860+0000 7fbd5251d700 1 --2- 172.21.15.38:0/2132681585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd340045e0 0x7fbd34004a60 secure :-1 s=THROTTLE_DONE pgs=492 cs=0 l=1 rx=0x7fbd4c061380 tx=0x7fbd44001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.860+0000 7fbd5251d700 1 --2- 172.21.15.38:0/2132681585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd340045e0 0x7fbd34004a60 secure :-1 s=THROTTLE_DONE pgs=492 cs=0 l=1 rx=0x7fbd4c061380 tx=0x7fbd44001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.860+0000 7fbd50d1a700 1 -- 172.21.15.38:0/2132681585 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd44006de0 con 0x7fbd340045e0 2020-06-12T17:49:28.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.860+0000 7fbd50d1a700 1 -- 172.21.15.38:0/2132681585 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd44002730 con 0x7fbd340045e0 2020-06-12T17:49:28.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.860+0000 7fbd53f80700 1 -- 172.21.15.38:0/2132681585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd340045e0 msgr2=0x7fbd34004a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:28.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.860+0000 7fbd53f80700 1 --2- 172.21.15.38:0/2132681585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd340045e0 0x7fbd34004a60 secure :-1 s=READY pgs=492 cs=0 l=1 rx=0x7fbd4c061380 tx=0x7fbd44001bc0).stop 2020-06-12T17:49:28.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.860+0000 7fbd5251d700 1 -- 172.21.15.38:0/2132681585 reap_dead start 2020-06-12T17:49:28.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.860+0000 7fbd53f80700 1 -- 172.21.15.38:0/2132681585 shutdown_connections 2020-06-12T17:49:28.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.860+0000 7fbd53f80700 1 -- 172.21.15.38:0/2132681585 >> 172.21.15.38:0/2132681585 conn(0x7fbd4c0b5a20 msgr2=0x7fbd4c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:28.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.861+0000 7fbd53f80700 1 -- 172.21.15.38:0/2132681585 shutdown_connections 2020-06-12T17:49:28.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.861+0000 7fbd53f80700 1 -- 172.21.15.38:0/2132681585 wait complete. 2020-06-12T17:49:28.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.861+0000 7fbd53f80700 1 Processor -- start 2020-06-12T17:49:28.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.861+0000 7fbd53f80700 1 -- start start 2020-06-12T17:49:28.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.862+0000 7fbd53f80700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbd4c0af8d0 0x7fbd4c142170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:28.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.862+0000 7fbd53f80700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4c141790 con 0x7fbd4c0af420 2020-06-12T17:49:28.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.862+0000 7fbd53f80700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4c141a30 con 0x7fbd4c065ca0 2020-06-12T17:49:28.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.862+0000 7fbd53f80700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4c0b0450 con 0x7fbd4c0af8d0 2020-06-12T17:49:28.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.862+0000 7fbd5151b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fbd4c0af420 0x7fbd4c13bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39604/0 (socket says 172.21.15.38:39604) 2020-06-12T17:49:28.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.862+0000 7fbd5151b700 1 -- 172.21.15.38:0/987448940 learned_addr learned my addr 172.21.15.38:0/987448940 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:28.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.862+0000 7fbd5251d700 1 --2- 172.21.15.38:0/987448940 >> v2:172.21.15.150:3300/0 conn(0x7fbd4c0af8d0 0x7fbd4c142170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:28.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.862+0000 7fbd3affd700 1 -- 172.21.15.38:0/987448940 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498583348 0 0) 0x7fbd4c141790 con 0x7fbd4c0af420 2020-06-12T17:49:28.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.862+0000 7fbd3affd700 1 -- 172.21.15.38:0/987448940 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd2c002fe0 con 0x7fbd4c0af420 2020-06-12T17:49:28.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd3affd700 1 -- 172.21.15.38:0/987448940 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1949231431 0 0) 0x7fbd4c141a30 con 0x7fbd4c065ca0 2020-06-12T17:49:28.882 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd3affd700 1 -- 172.21.15.38:0/987448940 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd4c141790 con 0x7fbd4c065ca0 2020-06-12T17:49:28.882 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd3affd700 1 -- 172.21.15.38:0/987448940 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 751957342 0 0) 0x7fbd2c002fe0 con 0x7fbd4c0af420 2020-06-12T17:49:28.882 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd3affd700 1 -- 172.21.15.38:0/987448940 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbd4c141a30 con 0x7fbd4c0af420 2020-06-12T17:49:28.882 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd3affd700 1 -- 172.21.15.38:0/987448940 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fbd48001490 con 0x7fbd4c0af420 2020-06-12T17:49:28.882 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd3affd700 1 -- 172.21.15.38:0/987448940 >> v2:172.21.15.150:3300/0 conn(0x7fbd4c0af8d0 msgr2=0x7fbd4c142170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:28.883 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd3affd700 1 --2- 172.21.15.38:0/987448940 >> v2:172.21.15.150:3300/0 conn(0x7fbd4c0af8d0 0x7fbd4c142170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:28.883 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd3affd700 1 -- 172.21.15.38:0/987448940 >> v1:172.21.15.150:6789/0 conn(0x7fbd4c065ca0 legacy=0x7fbd4c0afd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:28.883 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd3affd700 1 -- 172.21.15.38:0/987448940 >> v1:172.21.15.38:6789/0 conn(0x7fbd4c0af420 legacy=0x7fbd4c13bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:28.883 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd3affd700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd2c004b20 0x7fbd2c004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:28.883 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd3affd700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd2c003ab0 0x7fbd2c003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:28.884 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd3affd700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd2c004350 0x7fbd2c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:28.884 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd3affd700 1 -- 172.21.15.38:0/987448940 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c0b0450 con 0x7fbd2c003ab0 2020-06-12T17:49:28.884 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd3affd700 1 -- 172.21.15.38:0/987448940 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c00bbb0 con 0x7fbd2c004350 2020-06-12T17:49:28.884 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd3affd700 1 -- 172.21.15.38:0/987448940 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c00bcf0 con 0x7fbd2c004b20 2020-06-12T17:49:28.884 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd5251d700 1 --2- 172.21.15.38:0/987448940 >> v2:172.21.15.150:3300/0 conn(0x7fbd4c0af8d0 0x7fbd4c142170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:49:28.885 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd5151b700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd2c003ab0 0x7fbd2c003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:28.885 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd51d1c700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd2c004b20 0x7fbd2c004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:28.885 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd5251d700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd2c004350 0x7fbd2c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:28.885 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd5151b700 1 -- 172.21.15.38:0/987448940 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd2c004b20 msgr2=0x7fbd2c004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:28.885 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd5151b700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbd2c004b20 0x7fbd2c004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:28.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd5151b700 1 -- 172.21.15.38:0/987448940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd2c004350 msgr2=0x7fbd2c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:28.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd5151b700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd2c004350 0x7fbd2c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:28.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd5151b700 1 -- 172.21.15.38:0/987448940 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c141cd0 con 0x7fbd2c003ab0 2020-06-12T17:49:28.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd53f80700 1 -- 172.21.15.38:0/987448940 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4c066080 con 0x7fbd2c003ab0 2020-06-12T17:49:28.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd5151b700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd2c003ab0 0x7fbd2c003ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbd48007fe0 tx=0x7fbd48007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd5251d700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd2c004350 0x7fbd2c00b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:49:28.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd5251d700 1 -- 172.21.15.38:0/987448940 reap_dead start 2020-06-12T17:49:28.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd53f80700 1 -- 172.21.15.38:0/987448940 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4c13e390 con 0x7fbd2c003ab0 2020-06-12T17:49:28.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd5151b700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd2c003ab0 0x7fbd2c003ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbd48007fe0 tx=0x7fbd48007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd5151b700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd2c003ab0 0x7fbd2c003ef0 secure :-1 s=READY pgs=494 cs=0 l=1 rx=0x7fbd48007fe0 tx=0x7fbd48007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:28.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.863+0000 7fbd5151b700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd2c003ab0 0x7fbd2c003ef0 secure :-1 s=THROTTLE_DONE pgs=494 cs=0 l=1 rx=0x7fbd48007fe0 tx=0x7fbd48007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.864+0000 7fbd3affd700 1 -- 172.21.15.38:0/987448940 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd48005da0 con 0x7fbd2c003ab0 2020-06-12T17:49:28.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.864+0000 7fbd5151b700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd2c003ab0 0x7fbd2c003ef0 secure :-1 s=THROTTLE_DONE pgs=494 cs=0 l=1 rx=0x7fbd48007fe0 tx=0x7fbd48007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.864+0000 7fbd5151b700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd2c003ab0 0x7fbd2c003ef0 secure :-1 s=THROTTLE_DONE pgs=494 cs=0 l=1 rx=0x7fbd48007fe0 tx=0x7fbd48007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.864+0000 7fbd3affd700 1 -- 172.21.15.38:0/987448940 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4800a420 con 0x7fbd2c003ab0 2020-06-12T17:49:28.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.864+0000 7fbd3affd700 1 -- 172.21.15.38:0/987448940 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd4800a7c0 con 0x7fbd2c003ab0 2020-06-12T17:49:28.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.864+0000 7fbd5151b700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd2c003ab0 0x7fbd2c003ef0 secure :-1 s=THROTTLE_DONE pgs=494 cs=0 l=1 rx=0x7fbd48007fe0 tx=0x7fbd48007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.864+0000 7fbd53f80700 1 -- 172.21.15.38:0/987448940 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd28003340 con 0x7fbd2c003ab0 2020-06-12T17:49:28.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.864+0000 7fbd3affd700 1 -- 172.21.15.38:0/987448940 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fbd4800a920 con 0x7fbd2c003ab0 2020-06-12T17:49:28.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.864+0000 7fbd5151b700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd2c003ab0 0x7fbd2c003ef0 secure :-1 s=THROTTLE_DONE pgs=494 cs=0 l=1 rx=0x7fbd48007fe0 tx=0x7fbd48007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.865+0000 7fbd3affd700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbd2c0511f0 0x7fbd2c0536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:28.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.865+0000 7fbd3affd700 1 -- 172.21.15.38:0/987448940 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fbd48061b50 con 0x7fbd2c003ab0 2020-06-12T17:49:28.891 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.868+0000 7fbd5151b700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd2c003ab0 0x7fbd2c003ef0 secure :-1 s=THROTTLE_DONE pgs=494 cs=0 l=1 rx=0x7fbd48007fe0 tx=0x7fbd48007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.891 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.868+0000 7fbd3affd700 1 -- 172.21.15.38:0/987448940 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fbd48065e60 con 0x7fbd2c003ab0 2020-06-12T17:49:28.891 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.872+0000 7fbd51d1c700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbd2c0511f0 0x7fbd2c0536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:28.892 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.872+0000 7fbd51d1c700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbd2c0511f0 0x7fbd2c0536b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbd3c001b80 tx=0x7fbd4c146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.892 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.872+0000 7fbd51d1c700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbd2c0511f0 0x7fbd2c0536b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbd3c001b80 tx=0x7fbd4c146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:28.892 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:28.872+0000 7fbd51d1c700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbd2c0511f0 0x7fbd2c0536b0 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7fbd3c001b80 tx=0x7fbd4c146220).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:29.064 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:29.061+0000 7fbd53f80700 1 -- 172.21.15.38:0/987448940 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_8746", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd28002200 con 0x7fbd2c0511f0 2020-06-12T17:49:29.068 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:29.065+0000 7fbd51d1c700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbd2c0511f0 0x7fbd2c0536b0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7fbd3c001b80 tx=0x7fbd4c146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:29.068 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:29.065+0000 7fbd3affd700 1 -- 172.21.15.38:0/987448940 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7fbd28002200 con 0x7fbd2c0511f0 2020-06-12T17:49:29.068 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_8746/230ba910-600d-4def-afdd-ce0206c8b49d 2020-06-12T17:49:29.069 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:29.066+0000 7fbd53f80700 1 -- 172.21.15.38:0/987448940 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbd2c0511f0 msgr2=0x7fbd2c0536b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:29.069 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:29.066+0000 7fbd53f80700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbd2c0511f0 0x7fbd2c0536b0 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7fbd3c001b80 tx=0x7fbd4c146220).stop 2020-06-12T17:49:29.070 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:29.066+0000 7fbd53f80700 1 -- 172.21.15.38:0/987448940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd2c003ab0 msgr2=0x7fbd2c003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:29.070 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:29.066+0000 7fbd53f80700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd2c003ab0 0x7fbd2c003ef0 secure :-1 s=READY pgs=494 cs=0 l=1 rx=0x7fbd48007fe0 tx=0x7fbd48007e60).stop 2020-06-12T17:49:29.070 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:29.066+0000 7fbd53f80700 1 -- 172.21.15.38:0/987448940 shutdown_connections 2020-06-12T17:49:29.070 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:29.066+0000 7fbd53f80700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbd2c0511f0 0x7fbd2c0536b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:29.071 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:29.066+0000 7fbd53f80700 1 --2- 172.21.15.38:0/987448940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd2c003ab0 0x7fbd2c003ef0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:29.071 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:29.066+0000 7fbd53f80700 1 -- 172.21.15.38:0/987448940 >> 172.21.15.38:0/987448940 conn(0x7fbd4c0b5a20 msgr2=0x7fbd4c144da0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:29.071 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:29.066+0000 7fbd53f80700 1 -- 172.21.15.38:0/987448940 shutdown_connections 2020-06-12T17:49:29.071 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:29.066+0000 7fbd53f80700 1 -- 172.21.15.38:0/987448940 wait complete. 2020-06-12T17:49:29.079 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_8746 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_8746/230ba910-600d-4def-afdd-ce0206c8b49d 2020-06-12T17:49:29.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:29.080 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:29.081 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:29.095 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:29.096 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:29.097 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8746/230ba910-600d-4def-afdd-ce0206c8b49d/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:29.189 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:29.190 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:29.190 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124032 s, 84.5 MB/s 2020-06-12T17:49:29.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:29.192 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:29.192 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:29.207 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:29.207 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:29.208 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8746/230ba910-600d-4def-afdd-ce0206c8b49d/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:29.295 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:29.296 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:29.296 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113905 s, 92.1 MB/s 2020-06-12T17:49:29.297 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:29.297 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:29.298 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:29.321 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:29.322 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:29.322 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8746/230ba910-600d-4def-afdd-ce0206c8b49d/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:29.410 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:29.410 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:29.410 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113173 s, 92.7 MB/s 2020-06-12T17:49:29.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:29.412 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:29.412 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:29.427 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:29.427 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:29.428 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8746/230ba910-600d-4def-afdd-ce0206c8b49d/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:29.515 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:29.515 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:29.516 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104561 s, 100 MB/s 2020-06-12T17:49:29.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:29.517 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:29.518 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:29.538 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:29.539 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:29.539 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8746/230ba910-600d-4def-afdd-ce0206c8b49d/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:29.626 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:29.626 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:29.626 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115773 s, 90.6 MB/s 2020-06-12T17:49:29.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:29.628 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:29.628 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:29.643 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:29.643 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:29.644 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8746/230ba910-600d-4def-afdd-ce0206c8b49d/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:29.732 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:29.732 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:29.732 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111832 s, 93.8 MB/s 2020-06-12T17:49:29.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:29.734 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:29.734 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:29.750 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:29.751 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:29.751 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8746/230ba910-600d-4def-afdd-ce0206c8b49d/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:29.838 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:29.839 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:29.839 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115641 s, 90.7 MB/s 2020-06-12T17:49:29.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:29.840 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:29.841 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:29.855 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:29.856 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:29.857 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8746/230ba910-600d-4def-afdd-ce0206c8b49d/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:29.944 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:29.944 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:29.944 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112467 s, 93.2 MB/s 2020-06-12T17:49:29.945 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:29.946 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:29.946 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:29.961 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:29.962 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:29.962 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8746/230ba910-600d-4def-afdd-ce0206c8b49d/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:30.054 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:30.055 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:30.055 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118065 s, 88.8 MB/s 2020-06-12T17:49:30.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:30.057 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:30.057 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:30.072 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:30.073 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:30.073 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8746/230ba910-600d-4def-afdd-ce0206c8b49d/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:30.174 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:30.175 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:30.175 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104957 s, 99.9 MB/s 2020-06-12T17:49:30.175 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_9514 2020-06-12T17:49:30.292 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.288+0000 7f1034fa8700 1 Processor -- start 2020-06-12T17:49:30.292 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.288+0000 7f1034fa8700 1 -- start start 2020-06-12T17:49:30.294 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.289+0000 7f1034fa8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f103009df00 0x7f103013c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:30.294 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.289+0000 7f1034fa8700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1030142e90 0x7f1030066790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:30.294 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.289+0000 7f1034fa8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f103009b960 con 0x7f10300b3ac0 2020-06-12T17:49:30.294 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.290+0000 7f1034fa8700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f103009bc00 con 0x7f1030142e90 2020-06-12T17:49:30.295 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.290+0000 7f1034fa8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10300b48f0 con 0x7f103009df00 2020-06-12T17:49:30.295 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.290+0000 7f102ed9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1030142e90 0x7f1030066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:30.295 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.290+0000 7f102ed9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1030142e90 0x7f1030066790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37804/0 (socket says 172.21.15.38:37804) 2020-06-12T17:49:30.295 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.290+0000 7f102ed9d700 1 -- 172.21.15.38:0/2520401142 learned_addr learned my addr 172.21.15.38:0/2520401142 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:30.295 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.290+0000 7f102dd9b700 1 --2- 172.21.15.38:0/2520401142 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f103009df00 0x7f103013c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:30.296 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.290+0000 7f102ed9d700 1 -- 172.21.15.38:0/2520401142 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f103009df00 msgr2=0x7f103013c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:30.296 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.290+0000 7f102ed9d700 1 --2- 172.21.15.38:0/2520401142 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f103009df00 0x7f103013c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:30.296 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.290+0000 7f102ed9d700 1 -- 172.21.15.38:0/2520401142 >> v1:172.21.15.150:6789/0 conn(0x7f10300b3ac0 legacy=0x7f103013bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:30.296 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.290+0000 7f102ed9d700 1 -- 172.21.15.38:0/2520401142 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10300b3ea0 con 0x7f1030142e90 2020-06-12T17:49:30.296 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.290+0000 7f102ed9d700 1 --2- 172.21.15.38:0/2520401142 >> v2:172.21.15.38:3300/0 conn(0x7f1030142e90 0x7f1030066790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f10200032b0 tx=0x7f10200081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.297 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.290+0000 7f102ed9d700 1 --2- 172.21.15.38:0/2520401142 >> v2:172.21.15.38:3300/0 conn(0x7f1030142e90 0x7f1030066790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f10200032b0 tx=0x7f10200081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.297 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.290+0000 7f102ed9d700 1 --2- 172.21.15.38:0/2520401142 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1030142e90 0x7f1030066790 secure :-1 s=READY pgs=495 cs=0 l=1 rx=0x7f10200032b0 tx=0x7f10200081e0).ready entity=mon.0 client_cookie=8dba5d6655acd00d server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:30.298 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.293+0000 7f102ed9d700 1 --2- 172.21.15.38:0/2520401142 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1030142e90 0x7f1030066790 secure :-1 s=THROTTLE_DONE pgs=495 cs=0 l=1 rx=0x7f10200032b0 tx=0x7f10200081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.298 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.294+0000 7f102d59a700 1 -- 172.21.15.38:0/2520401142 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1020011ea0 con 0x7f1030142e90 2020-06-12T17:49:30.299 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.294+0000 7f102ed9d700 1 --2- 172.21.15.38:0/2520401142 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1030142e90 0x7f1030066790 secure :-1 s=THROTTLE_DONE pgs=495 cs=0 l=1 rx=0x7f10200032b0 tx=0x7f10200081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.299 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.294+0000 7f102ed9d700 1 --2- 172.21.15.38:0/2520401142 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1030142e90 0x7f1030066790 secure :-1 s=THROTTLE_DONE pgs=495 cs=0 l=1 rx=0x7f10200032b0 tx=0x7f10200081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.299 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.294+0000 7f102d59a700 1 -- 172.21.15.38:0/2520401142 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102000a160 con 0x7f1030142e90 2020-06-12T17:49:30.299 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.294+0000 7f102d59a700 1 -- 172.21.15.38:0/2520401142 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f102000a580 con 0x7f1030142e90 2020-06-12T17:49:30.299 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.294+0000 7f1034fa8700 1 -- 172.21.15.38:0/2520401142 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1030142e90 msgr2=0x7f1030066790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:30.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.294+0000 7f1034fa8700 1 --2- 172.21.15.38:0/2520401142 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1030142e90 0x7f1030066790 secure :-1 s=READY pgs=495 cs=0 l=1 rx=0x7f10200032b0 tx=0x7f10200081e0).stop 2020-06-12T17:49:30.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.294+0000 7f1034fa8700 1 -- 172.21.15.38:0/2520401142 shutdown_connections 2020-06-12T17:49:30.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.294+0000 7f1034fa8700 1 --2- 172.21.15.38:0/2520401142 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1030142e90 0x7f1030066790 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:30.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.294+0000 7f1034fa8700 1 --2- 172.21.15.38:0/2520401142 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f103009df00 0x7f103013c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:30.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.294+0000 7f1034fa8700 1 -- 172.21.15.38:0/2520401142 >> 172.21.15.38:0/2520401142 conn(0x7f10300b5a20 msgr2=0x7f103005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:30.301 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.294+0000 7f1034fa8700 1 -- 172.21.15.38:0/2520401142 shutdown_connections 2020-06-12T17:49:30.301 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.294+0000 7f1034fa8700 1 -- 172.21.15.38:0/2520401142 wait complete. 2020-06-12T17:49:30.304 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.295+0000 7f1034fa8700 1 Processor -- start 2020-06-12T17:49:30.304 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.295+0000 7f1034fa8700 1 -- start start 2020-06-12T17:49:30.304 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.296+0000 7f1034fa8700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f103009df00 0x7f1030066400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:30.304 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.296+0000 7f1034fa8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1030142e90 0x7f10301535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:30.305 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.296+0000 7f1034fa8700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10301433f0 con 0x7f10300b3ac0 2020-06-12T17:49:30.305 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.296+0000 7f1034fa8700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1030143690 con 0x7f103009df00 2020-06-12T17:49:30.305 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.296+0000 7f1034fa8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1030143930 con 0x7f1030142e90 2020-06-12T17:49:30.305 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.296+0000 7f102e59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f103009df00 0x7f1030066400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:30.305 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.296+0000 7f102e59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f103009df00 0x7f1030066400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37806/0 (socket says 172.21.15.38:37806) 2020-06-12T17:49:30.306 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.296+0000 7f102dd9b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f10300b3ac0 0x7f103013ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39624/0 (socket says 172.21.15.38:39624) 2020-06-12T17:49:30.306 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.296+0000 7f102e59c700 1 -- 172.21.15.38:0/967289022 learned_addr learned my addr 172.21.15.38:0/967289022 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:30.306 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.296+0000 7f102ed9d700 1 --2- 172.21.15.38:0/967289022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1030142e90 0x7f10301535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:30.306 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.296+0000 7f102e59c700 1 -- 172.21.15.38:0/967289022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1030142e90 msgr2=0x7f10301535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:30.306 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.296+0000 7f102e59c700 1 --2- 172.21.15.38:0/967289022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1030142e90 0x7f10301535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:30.307 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.296+0000 7f102e59c700 1 -- 172.21.15.38:0/967289022 >> v1:172.21.15.38:6789/0 conn(0x7f10300b3ac0 legacy=0x7f103013ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:30.307 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.296+0000 7f101f7fe700 1 -- 172.21.15.38:0/967289022 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188430679 0 0) 0x7f10301433f0 con 0x7f10300b3ac0 2020-06-12T17:49:30.307 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.296+0000 7f102e59c700 1 -- 172.21.15.38:0/967289022 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1030143bd0 con 0x7f103009df00 2020-06-12T17:49:30.307 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.297+0000 7f102e59c700 1 --2- 172.21.15.38:0/967289022 >> v2:172.21.15.38:3300/0 conn(0x7f103009df00 0x7f1030066400 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1030061380 tx=0x7f1028001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.307 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.297+0000 7f102e59c700 1 --2- 172.21.15.38:0/967289022 >> v2:172.21.15.38:3300/0 conn(0x7f103009df00 0x7f1030066400 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1030061380 tx=0x7f1028001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.308 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.297+0000 7f102e59c700 1 --2- 172.21.15.38:0/967289022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f103009df00 0x7f1030066400 secure :-1 s=READY pgs=497 cs=0 l=1 rx=0x7f1030061380 tx=0x7f1028001820).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:30.308 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.297+0000 7f102e59c700 1 --2- 172.21.15.38:0/967289022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f103009df00 0x7f1030066400 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7f1030061380 tx=0x7f1028001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.308 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.297+0000 7f101f7fe700 1 -- 172.21.15.38:0/967289022 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f102800cbf0 con 0x7f103009df00 2020-06-12T17:49:30.308 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.297+0000 7f102e59c700 1 --2- 172.21.15.38:0/967289022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f103009df00 0x7f1030066400 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7f1030061380 tx=0x7f1028001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.308 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.297+0000 7f102e59c700 1 --2- 172.21.15.38:0/967289022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f103009df00 0x7f1030066400 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7f1030061380 tx=0x7f1028001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.309 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.297+0000 7f101f7fe700 1 -- 172.21.15.38:0/967289022 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102800cd50 con 0x7f103009df00 2020-06-12T17:49:30.309 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.297+0000 7f1034fa8700 1 -- 172.21.15.38:0/967289022 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f103013f3a0 con 0x7f103009df00 2020-06-12T17:49:30.309 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.297+0000 7f101f7fe700 1 -- 172.21.15.38:0/967289022 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1028011140 con 0x7f103009df00 2020-06-12T17:49:30.309 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.297+0000 7f1034fa8700 1 -- 172.21.15.38:0/967289022 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f103013c730 con 0x7f103009df00 2020-06-12T17:49:30.309 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.297+0000 7f102e59c700 1 --2- 172.21.15.38:0/967289022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f103009df00 0x7f1030066400 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7f1030061380 tx=0x7f1028001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.310 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.298+0000 7f101f7fe700 1 -- 172.21.15.38:0/967289022 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f10280064e0 con 0x7f103009df00 2020-06-12T17:49:30.310 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.298+0000 7f102e59c700 1 --2- 172.21.15.38:0/967289022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f103009df00 0x7f1030066400 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7f1030061380 tx=0x7f1028001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.310 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.298+0000 7f1034fa8700 1 -- 172.21.15.38:0/967289022 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1030056c30 con 0x7f103009df00 2020-06-12T17:49:30.310 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.298+0000 7f101f7fe700 1 --2- 172.21.15.38:0/967289022 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f100c04d390 0x7f100c04f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:30.310 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.298+0000 7f101f7fe700 1 -- 172.21.15.38:0/967289022 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1028060ae0 con 0x7f103009df00 2020-06-12T17:49:30.311 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.298+0000 7f102dd9b700 1 --2- 172.21.15.38:0/967289022 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f100c04d390 0x7f100c04f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:30.311 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.298+0000 7f102dd9b700 1 --2- 172.21.15.38:0/967289022 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f100c04d390 0x7f100c04f850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1024007920 tx=0x7f1024007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.311 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.299+0000 7f102dd9b700 1 --2- 172.21.15.38:0/967289022 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f100c04d390 0x7f100c04f850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1024007920 tx=0x7f1024007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.311 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.299+0000 7f102dd9b700 1 --2- 172.21.15.38:0/967289022 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f100c04d390 0x7f100c04f850 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7f1024007920 tx=0x7f1024007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:30.312 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.302+0000 7f102e59c700 1 --2- 172.21.15.38:0/967289022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f103009df00 0x7f1030066400 secure :-1 s=THROTTLE_DONE pgs=497 cs=0 l=1 rx=0x7f1030061380 tx=0x7f1028001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.312 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.302+0000 7f101f7fe700 1 -- 172.21.15.38:0/967289022 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f102803c180 con 0x7f103009df00 2020-06-12T17:49:30.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.498+0000 7f1034fa8700 1 -- 172.21.15.38:0/967289022 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_9514", "target": ["mon-mgr", ""]}) v1 -- 0x7f1030143dd0 con 0x7f100c04d390 2020-06-12T17:49:30.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.519+0000 7f102dd9b700 1 --2- 172.21.15.38:0/967289022 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f100c04d390 0x7f100c04f850 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7f1024007920 tx=0x7f1024007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.519+0000 7f101f7fe700 1 -- 172.21.15.38:0/967289022 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f102400e380 con 0x7f100c04d390 2020-06-12T17:49:30.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.521+0000 7f1034fa8700 1 -- 172.21.15.38:0/967289022 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f100c04d390 msgr2=0x7f100c04f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:30.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.521+0000 7f1034fa8700 1 --2- 172.21.15.38:0/967289022 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f100c04d390 0x7f100c04f850 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7f1024007920 tx=0x7f1024007e60).stop 2020-06-12T17:49:30.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.521+0000 7f1034fa8700 1 -- 172.21.15.38:0/967289022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f103009df00 msgr2=0x7f1030066400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:30.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.521+0000 7f1034fa8700 1 --2- 172.21.15.38:0/967289022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f103009df00 0x7f1030066400 secure :-1 s=READY pgs=497 cs=0 l=1 rx=0x7f1030061380 tx=0x7f1028001820).stop 2020-06-12T17:49:30.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.521+0000 7f1034fa8700 1 -- 172.21.15.38:0/967289022 shutdown_connections 2020-06-12T17:49:30.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.521+0000 7f1034fa8700 1 --2- 172.21.15.38:0/967289022 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f100c04d390 0x7f100c04f850 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:30.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.521+0000 7f1034fa8700 1 --2- 172.21.15.38:0/967289022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1030142e90 0x7f10301535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:30.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.521+0000 7f1034fa8700 1 --2- 172.21.15.38:0/967289022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f103009df00 0x7f1030066400 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:30.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.521+0000 7f1034fa8700 1 -- 172.21.15.38:0/967289022 >> 172.21.15.38:0/967289022 conn(0x7f10300b5a20 msgr2=0x7f10300b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:30.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.521+0000 7f1034fa8700 1 -- 172.21.15.38:0/967289022 shutdown_connections 2020-06-12T17:49:30.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.521+0000 7f1034fa8700 1 -- 172.21.15.38:0/967289022 wait complete. 2020-06-12T17:49:30.535 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_9514 2020-06-12T17:49:30.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.649+0000 7f15b92cf700 1 Processor -- start 2020-06-12T17:49:30.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.649+0000 7f15b92cf700 1 -- start start 2020-06-12T17:49:30.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.650+0000 7f15b92cf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15b4146680 0x7f15b40ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:30.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.650+0000 7f15b92cf700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f15b40b2eb0 0x7f15b409d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:30.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.650+0000 7f15b92cf700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b4146d20 con 0x7f15b409d620 2020-06-12T17:49:30.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.650+0000 7f15b92cf700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15b4066a80 con 0x7f15b40b2eb0 2020-06-12T17:49:30.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.650+0000 7f15b92cf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b4146f50 con 0x7f15b4146680 2020-06-12T17:49:30.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.650+0000 7f15b27fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f15b40b2eb0 0x7f15b409d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:30.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.650+0000 7f15b27fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f15b40b2eb0 0x7f15b409d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37814/0 (socket says 172.21.15.38:37814) 2020-06-12T17:49:30.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.650+0000 7f15b27fc700 1 -- 172.21.15.38:0/3834831614 learned_addr learned my addr 172.21.15.38:0/3834831614 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:30.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.650+0000 7f15b2ffd700 1 --2- 172.21.15.38:0/3834831614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15b4146680 0x7f15b40ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:30.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.650+0000 7f15b27fc700 1 -- 172.21.15.38:0/3834831614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15b4146680 msgr2=0x7f15b40ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:30.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.650+0000 7f15b27fc700 1 --2- 172.21.15.38:0/3834831614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15b4146680 0x7f15b40ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:30.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.650+0000 7f15b27fc700 1 -- 172.21.15.38:0/3834831614 >> v1:172.21.15.150:6789/0 conn(0x7f15b409d620 legacy=0x7f15b409b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:30.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.650+0000 7f15b27fc700 1 -- 172.21.15.38:0/3834831614 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b4146a60 con 0x7f15b40b2eb0 2020-06-12T17:49:30.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.650+0000 7f15b27fc700 1 --2- 172.21.15.38:0/3834831614 >> v2:172.21.15.38:3300/0 conn(0x7f15b40b2eb0 0x7f15b409d1c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f159c002f30 tx=0x7f159c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.650+0000 7f15b27fc700 1 --2- 172.21.15.38:0/3834831614 >> v2:172.21.15.38:3300/0 conn(0x7f15b40b2eb0 0x7f15b409d1c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f159c002f30 tx=0x7f159c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.650+0000 7f15b27fc700 1 --2- 172.21.15.38:0/3834831614 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15b40b2eb0 0x7f15b409d1c0 secure :-1 s=READY pgs=498 cs=0 l=1 rx=0x7f159c002f30 tx=0x7f159c007e60).ready entity=mon.0 client_cookie=86473f0745db224d server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:30.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.650+0000 7f15b27fc700 1 --2- 172.21.15.38:0/3834831614 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15b40b2eb0 0x7f15b409d1c0 secure :-1 s=THROTTLE_DONE pgs=498 cs=0 l=1 rx=0x7f159c002f30 tx=0x7f159c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.650+0000 7f15b1ffb700 1 -- 172.21.15.38:0/3834831614 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f159c0116e0 con 0x7f15b40b2eb0 2020-06-12T17:49:30.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.650+0000 7f15b27fc700 1 --2- 172.21.15.38:0/3834831614 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15b40b2eb0 0x7f15b409d1c0 secure :-1 s=THROTTLE_DONE pgs=498 cs=0 l=1 rx=0x7f159c002f30 tx=0x7f159c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.650+0000 7f15b1ffb700 1 -- 172.21.15.38:0/3834831614 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159c011840 con 0x7f15b40b2eb0 2020-06-12T17:49:30.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.650+0000 7f15b27fc700 1 --2- 172.21.15.38:0/3834831614 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15b40b2eb0 0x7f15b409d1c0 secure :-1 s=THROTTLE_DONE pgs=498 cs=0 l=1 rx=0x7f159c002f30 tx=0x7f159c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.650+0000 7f15b92cf700 1 -- 172.21.15.38:0/3834831614 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15b40b2eb0 msgr2=0x7f15b409d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:30.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.650+0000 7f15b1ffb700 1 -- 172.21.15.38:0/3834831614 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f159c011c60 con 0x7f15b40b2eb0 2020-06-12T17:49:30.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.650+0000 7f15b92cf700 1 --2- 172.21.15.38:0/3834831614 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15b40b2eb0 0x7f15b409d1c0 secure :-1 s=READY pgs=498 cs=0 l=1 rx=0x7f159c002f30 tx=0x7f159c007e60).stop 2020-06-12T17:49:30.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.651+0000 7f15b92cf700 1 -- 172.21.15.38:0/3834831614 shutdown_connections 2020-06-12T17:49:30.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.651+0000 7f15b92cf700 1 --2- 172.21.15.38:0/3834831614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15b4146680 0x7f15b40ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:30.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.651+0000 7f15b92cf700 1 --2- 172.21.15.38:0/3834831614 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15b40b2eb0 0x7f15b409d1c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:30.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.651+0000 7f15b92cf700 1 -- 172.21.15.38:0/3834831614 >> 172.21.15.38:0/3834831614 conn(0x7f15b40b5a20 msgr2=0x7f15b405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:30.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.651+0000 7f15b92cf700 1 -- 172.21.15.38:0/3834831614 shutdown_connections 2020-06-12T17:49:30.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.651+0000 7f15b92cf700 1 -- 172.21.15.38:0/3834831614 wait complete. 2020-06-12T17:49:30.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.652+0000 7f15b92cf700 1 Processor -- start 2020-06-12T17:49:30.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.652+0000 7f15b92cf700 1 -- start start 2020-06-12T17:49:30.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.653+0000 7f15b92cf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f15b409d620 0x7f15b4061890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:30.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.653+0000 7f15b92cf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15b4146680 0x7f15b40afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:30.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.653+0000 7f15b92cf700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b4061cf0 con 0x7f15b40b2eb0 2020-06-12T17:49:30.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.653+0000 7f15b92cf700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15b40b1b80 con 0x7f15b409d620 2020-06-12T17:49:30.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.653+0000 7f15b92cf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b40b1de0 con 0x7f15b4146680 2020-06-12T17:49:30.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.653+0000 7f15b2ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f15b409d620 0x7f15b4061890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:30.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.653+0000 7f15b37fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15b4146680 0x7f15b40afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:30.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.653+0000 7f15b37fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15b4146680 0x7f15b40afc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:57282/0 (socket says 172.21.15.38:57282) 2020-06-12T17:49:30.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.653+0000 7f15b37fe700 1 -- 172.21.15.38:0/2133210036 learned_addr learned my addr 172.21.15.38:0/2133210036 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:30.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.653+0000 7f15b2ffd700 1 -- 172.21.15.38:0/2133210036 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15b4146680 msgr2=0x7f15b40afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:30.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.653+0000 7f15b2ffd700 1 --2- 172.21.15.38:0/2133210036 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15b4146680 0x7f15b40afc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:30.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.653+0000 7f15b2ffd700 1 -- 172.21.15.38:0/2133210036 >> v1:172.21.15.150:6789/0 conn(0x7f15b40b2eb0 legacy=0x7f15b40b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:30.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.653+0000 7f15abfff700 1 -- 172.21.15.38:0/2133210036 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2817210699 0 0) 0x7f15b4146a60 con 0x7f15b40b2eb0 2020-06-12T17:49:30.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.653+0000 7f15b2ffd700 1 -- 172.21.15.38:0/2133210036 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b40b2080 con 0x7f15b409d620 2020-06-12T17:49:30.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.653+0000 7f15b37fe700 1 --2- 172.21.15.38:0/2133210036 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15b4146680 0x7f15b40afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:49:30.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.653+0000 7f15b2ffd700 1 --2- 172.21.15.38:0/2133210036 >> v2:172.21.15.150:3300/0 conn(0x7f15b409d620 0x7f15b4061890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f15ac0032b0 tx=0x7f15ac00e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.653+0000 7f15b2ffd700 1 --2- 172.21.15.38:0/2133210036 >> v2:172.21.15.150:3300/0 conn(0x7f15b409d620 0x7f15b4061890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f15ac0032b0 tx=0x7f15ac00e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.653+0000 7f15b2ffd700 1 --2- 172.21.15.38:0/2133210036 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15b409d620 0x7f15b4061890 secure :-1 s=READY pgs=302 cs=0 l=1 rx=0x7f15ac0032b0 tx=0x7f15ac00e440).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:30.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.654+0000 7f15b2ffd700 1 --2- 172.21.15.38:0/2133210036 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15b409d620 0x7f15b4061890 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f15ac0032b0 tx=0x7f15ac00e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.654+0000 7f15abfff700 1 -- 172.21.15.38:0/2133210036 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15ac005e30 con 0x7f15b409d620 2020-06-12T17:49:30.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.654+0000 7f15b2ffd700 1 --2- 172.21.15.38:0/2133210036 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15b409d620 0x7f15b4061890 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f15ac0032b0 tx=0x7f15ac00e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.654+0000 7f15b92cf700 1 -- 172.21.15.38:0/2133210036 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b413acf0 con 0x7f15b409d620 2020-06-12T17:49:30.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.654+0000 7f15abfff700 1 -- 172.21.15.38:0/2133210036 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ac007540 con 0x7f15b409d620 2020-06-12T17:49:30.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.654+0000 7f15b2ffd700 1 --2- 172.21.15.38:0/2133210036 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15b409d620 0x7f15b4061890 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f15ac0032b0 tx=0x7f15ac00e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.654+0000 7f15abfff700 1 -- 172.21.15.38:0/2133210036 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15ac007920 con 0x7f15b409d620 2020-06-12T17:49:30.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.654+0000 7f15b92cf700 1 -- 172.21.15.38:0/2133210036 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b40b0230 con 0x7f15b409d620 2020-06-12T17:49:30.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.654+0000 7f15b2ffd700 1 --2- 172.21.15.38:0/2133210036 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15b409d620 0x7f15b4061890 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f15ac0032b0 tx=0x7f15ac00e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.655+0000 7f15b92cf700 1 -- 172.21.15.38:0/2133210036 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b40b2210 con 0x7f15b409d620 2020-06-12T17:49:30.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.655+0000 7f15abfff700 1 -- 172.21.15.38:0/2133210036 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f15ac010180 con 0x7f15b409d620 2020-06-12T17:49:30.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.655+0000 7f15b2ffd700 1 --2- 172.21.15.38:0/2133210036 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15b409d620 0x7f15b4061890 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f15ac0032b0 tx=0x7f15ac00e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.655+0000 7f15abfff700 1 --2- 172.21.15.38:0/2133210036 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f159804d4b0 0x7f159804f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:30.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.655+0000 7f15abfff700 1 -- 172.21.15.38:0/2133210036 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f15ac060f70 con 0x7f15b409d620 2020-06-12T17:49:30.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.655+0000 7f15b27fc700 1 --2- 172.21.15.38:0/2133210036 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f159804d4b0 0x7f159804f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:30.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.656+0000 7f15b27fc700 1 --2- 172.21.15.38:0/2133210036 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f159804d4b0 0x7f159804f970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f159c0084c0 tx=0x7f159c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.656+0000 7f15b27fc700 1 --2- 172.21.15.38:0/2133210036 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f159804d4b0 0x7f159804f970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f159c0084c0 tx=0x7f159c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.656+0000 7f15b27fc700 1 --2- 172.21.15.38:0/2133210036 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f159804d4b0 0x7f159804f970 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7f159c0084c0 tx=0x7f159c007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:30.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.659+0000 7f15b2ffd700 1 --2- 172.21.15.38:0/2133210036 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15b409d620 0x7f15b4061890 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f15ac0032b0 tx=0x7f15ac00e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.659+0000 7f15abfff700 1 -- 172.21.15.38:0/2133210036 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f15ac03c730 con 0x7f15b409d620 2020-06-12T17:49:30.858 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.855+0000 7f15b92cf700 1 -- 172.21.15.38:0/2133210036 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_9514", "target": ["mon-mgr", ""]}) v1 -- 0x7f15b4056c30 con 0x7f159804d4b0 2020-06-12T17:49:30.861 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.858+0000 7f15b27fc700 1 --2- 172.21.15.38:0/2133210036 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f159804d4b0 0x7f159804f970 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f159c0084c0 tx=0x7f159c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:30.862 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.858+0000 7f15abfff700 1 -- 172.21.15.38:0/2133210036 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f15b4056c30 con 0x7f159804d4b0 2020-06-12T17:49:30.862 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_9514/b54e398f-b211-4108-9644-8500f7c6eb65 2020-06-12T17:49:30.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.859+0000 7f15b92cf700 1 -- 172.21.15.38:0/2133210036 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f159804d4b0 msgr2=0x7f159804f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:30.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.859+0000 7f15b92cf700 1 --2- 172.21.15.38:0/2133210036 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f159804d4b0 0x7f159804f970 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7f159c0084c0 tx=0x7f159c007e60).stop 2020-06-12T17:49:30.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.859+0000 7f15b92cf700 1 -- 172.21.15.38:0/2133210036 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15b409d620 msgr2=0x7f15b4061890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:30.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.859+0000 7f15b92cf700 1 --2- 172.21.15.38:0/2133210036 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15b409d620 0x7f15b4061890 secure :-1 s=READY pgs=302 cs=0 l=1 rx=0x7f15ac0032b0 tx=0x7f15ac00e440).stop 2020-06-12T17:49:30.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.859+0000 7f15b92cf700 1 -- 172.21.15.38:0/2133210036 shutdown_connections 2020-06-12T17:49:30.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.859+0000 7f15b92cf700 1 --2- 172.21.15.38:0/2133210036 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f159804d4b0 0x7f159804f970 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:30.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.859+0000 7f15b92cf700 1 --2- 172.21.15.38:0/2133210036 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15b4146680 0x7f15b40afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:30.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.859+0000 7f15b92cf700 1 --2- 172.21.15.38:0/2133210036 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15b409d620 0x7f15b4061890 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:30.865 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.859+0000 7f15b92cf700 1 -- 172.21.15.38:0/2133210036 >> 172.21.15.38:0/2133210036 conn(0x7f15b40b5a20 msgr2=0x7f15b409b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:30.865 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.859+0000 7f15b92cf700 1 -- 172.21.15.38:0/2133210036 shutdown_connections 2020-06-12T17:49:30.865 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:30.859+0000 7f15b92cf700 1 -- 172.21.15.38:0/2133210036 wait complete. 2020-06-12T17:49:30.873 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_9514 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_9514/b54e398f-b211-4108-9644-8500f7c6eb65 2020-06-12T17:49:30.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:30.874 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:30.874 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:30.889 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:30.890 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:30.890 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9514/b54e398f-b211-4108-9644-8500f7c6eb65/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:30.980 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:30.980 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:30.980 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108689 s, 96.5 MB/s 2020-06-12T17:49:30.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:30.982 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:30.982 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:30.998 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:30.998 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:30.999 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9514/b54e398f-b211-4108-9644-8500f7c6eb65/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:31.088 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:31.088 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:31.089 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135555 s, 77.4 MB/s 2020-06-12T17:49:31.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:31.090 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:31.091 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:31.105 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:31.106 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:31.107 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9514/b54e398f-b211-4108-9644-8500f7c6eb65/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:31.197 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:31.198 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:31.198 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146228 s, 71.7 MB/s 2020-06-12T17:49:31.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:31.200 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:31.200 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:31.215 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:31.215 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:31.216 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9514/b54e398f-b211-4108-9644-8500f7c6eb65/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:31.305 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:31.305 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:31.306 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133818 s, 78.4 MB/s 2020-06-12T17:49:31.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:31.307 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:31.308 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:31.322 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:31.323 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:31.324 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9514/b54e398f-b211-4108-9644-8500f7c6eb65/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:31.410 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:31.411 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:31.411 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110384 s, 95.0 MB/s 2020-06-12T17:49:31.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:31.412 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:31.413 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:31.427 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:31.428 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:31.429 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9514/b54e398f-b211-4108-9644-8500f7c6eb65/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:31.515 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:31.515 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:31.515 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100432 s, 104 MB/s 2020-06-12T17:49:31.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:31.519 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:31.519 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:31.534 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:31.535 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:31.536 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9514/b54e398f-b211-4108-9644-8500f7c6eb65/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:31.622 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:31.622 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:31.622 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101847 s, 103 MB/s 2020-06-12T17:49:31.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:31.624 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:31.624 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:31.639 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:31.639 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:31.640 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9514/b54e398f-b211-4108-9644-8500f7c6eb65/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:31.725 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:31.726 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:31.726 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102644 s, 102 MB/s 2020-06-12T17:49:31.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:31.728 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:31.728 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:31.743 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:31.743 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:31.744 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9514/b54e398f-b211-4108-9644-8500f7c6eb65/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:31.832 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:31.832 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:31.833 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129012 s, 81.3 MB/s 2020-06-12T17:49:31.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:31.834 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:31.835 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:31.849 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:31.850 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:31.850 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9514/b54e398f-b211-4108-9644-8500f7c6eb65/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:31.936 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:31.937 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:31.937 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101321 s, 103 MB/s 2020-06-12T17:49:31.938 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_7100 2020-06-12T17:49:32.055 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.052+0000 7f532624c700 1 Processor -- start 2020-06-12T17:49:32.056 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.052+0000 7f532624c700 1 -- start start 2020-06-12T17:49:32.058 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.053+0000 7f532624c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f532009df00 0x7f532013c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:32.058 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.053+0000 7f532624c700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532009b960 con 0x7f53200b3ac0 2020-06-12T17:49:32.058 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.053+0000 7f532624c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532009bc00 con 0x7f5320142e90 2020-06-12T17:49:32.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.053+0000 7f532624c700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5320143270 con 0x7f532009df00 2020-06-12T17:49:32.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.053+0000 7f5317fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f532009df00 0x7f532013c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:32.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.053+0000 7f5317fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f532009df00 0x7f532013c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37828/0 (socket says 172.21.15.38:37828) 2020-06-12T17:49:32.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.053+0000 7f531f7fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f53200b3ac0 0x7f532013bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39644/0 (socket says 172.21.15.38:39644) 2020-06-12T17:49:32.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.053+0000 7f5317fff700 1 -- 172.21.15.38:0/390516273 learned_addr learned my addr 172.21.15.38:0/390516273 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:32.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.053+0000 7f5317fff700 1 -- 172.21.15.38:0/390516273 >> v1:172.21.15.150:6789/0 conn(0x7f5320142e90 legacy=0x7f5320066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:32.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.053+0000 7f5317fff700 1 -- 172.21.15.38:0/390516273 >> v1:172.21.15.38:6789/0 conn(0x7f53200b3ac0 legacy=0x7f532013bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:32.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.053+0000 7f5317fff700 1 -- 172.21.15.38:0/390516273 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53200b48f0 con 0x7f532009df00 2020-06-12T17:49:32.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.053+0000 7f531effd700 1 -- 172.21.15.38:0/390516273 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072714991 0 0) 0x7f532009b960 con 0x7f53200b3ac0 2020-06-12T17:49:32.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.053+0000 7f5317fff700 1 --2- 172.21.15.38:0/390516273 >> v2:172.21.15.38:3300/0 conn(0x7f532009df00 0x7f532013c650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f532013cb40 tx=0x7f5308007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.061 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.053+0000 7f5317fff700 1 --2- 172.21.15.38:0/390516273 >> v2:172.21.15.38:3300/0 conn(0x7f532009df00 0x7f532013c650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f532013cb40 tx=0x7f5308007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.061 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.053+0000 7f5317fff700 1 --2- 172.21.15.38:0/390516273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f532009df00 0x7f532013c650 secure :-1 s=READY pgs=500 cs=0 l=1 rx=0x7f532013cb40 tx=0x7f5308007e60).ready entity=mon.0 client_cookie=7e6cb2492aa8efac server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:32.061 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.053+0000 7f5317fff700 1 --2- 172.21.15.38:0/390516273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f532009df00 0x7f532013c650 secure :-1 s=THROTTLE_DONE pgs=500 cs=0 l=1 rx=0x7f532013cb40 tx=0x7f5308007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.061 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.053+0000 7f531effd700 1 -- 172.21.15.38:0/390516273 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53080116a0 con 0x7f532009df00 2020-06-12T17:49:32.061 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.053+0000 7f5317fff700 1 --2- 172.21.15.38:0/390516273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f532009df00 0x7f532013c650 secure :-1 s=THROTTLE_DONE pgs=500 cs=0 l=1 rx=0x7f532013cb40 tx=0x7f5308007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.062 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.053+0000 7f5317fff700 1 --2- 172.21.15.38:0/390516273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f532009df00 0x7f532013c650 secure :-1 s=THROTTLE_DONE pgs=500 cs=0 l=1 rx=0x7f532013cb40 tx=0x7f5308007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.062 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.053+0000 7f531effd700 1 -- 172.21.15.38:0/390516273 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5308011800 con 0x7f532009df00 2020-06-12T17:49:32.062 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.053+0000 7f531effd700 1 -- 172.21.15.38:0/390516273 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5308011be0 con 0x7f532009df00 2020-06-12T17:49:32.062 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.053+0000 7f532624c700 1 -- 172.21.15.38:0/390516273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f532009df00 msgr2=0x7f532013c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:32.062 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.053+0000 7f532624c700 1 --2- 172.21.15.38:0/390516273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f532009df00 0x7f532013c650 secure :-1 s=READY pgs=500 cs=0 l=1 rx=0x7f532013cb40 tx=0x7f5308007e60).stop 2020-06-12T17:49:32.063 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.054+0000 7f532624c700 1 -- 172.21.15.38:0/390516273 shutdown_connections 2020-06-12T17:49:32.063 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.054+0000 7f532624c700 1 --2- 172.21.15.38:0/390516273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f532009df00 0x7f532013c650 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:32.063 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.054+0000 7f532624c700 1 -- 172.21.15.38:0/390516273 >> 172.21.15.38:0/390516273 conn(0x7f53200b5a20 msgr2=0x7f532005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:32.063 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.054+0000 7f532624c700 1 -- 172.21.15.38:0/390516273 shutdown_connections 2020-06-12T17:49:32.063 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.054+0000 7f532624c700 1 -- 172.21.15.38:0/390516273 wait complete. 2020-06-12T17:49:32.066 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.055+0000 7f532624c700 1 Processor -- start 2020-06-12T17:49:32.066 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.055+0000 7f532624c700 1 -- start start 2020-06-12T17:49:32.067 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.056+0000 7f532624c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53200b3ac0 0x7f532014f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:32.067 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.056+0000 7f532624c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5320142e90 0x7f53200affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:32.067 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.056+0000 7f532624c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53200b2320 con 0x7f532009df00 2020-06-12T17:49:32.067 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.056+0000 7f532624c700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53201401c0 con 0x7f5320142e90 2020-06-12T17:49:32.067 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.056+0000 7f532624c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53200b25c0 con 0x7f53200b3ac0 2020-06-12T17:49:32.068 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.056+0000 7f531ffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5320142e90 0x7f53200affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:32.068 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.056+0000 7f531ffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5320142e90 0x7f53200affb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37836/0 (socket says 172.21.15.38:37836) 2020-06-12T17:49:32.068 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.056+0000 7f531ffff700 1 -- 172.21.15.38:0/2085013381 learned_addr learned my addr 172.21.15.38:0/2085013381 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:32.068 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.056+0000 7f5317fff700 1 --2- 172.21.15.38:0/2085013381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53200b3ac0 0x7f532014f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:32.068 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.056+0000 7f531ffff700 1 -- 172.21.15.38:0/2085013381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53200b3ac0 msgr2=0x7f532014f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:32.069 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.056+0000 7f531ffff700 1 --2- 172.21.15.38:0/2085013381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53200b3ac0 0x7f532014f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:32.069 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.056+0000 7f531ffff700 1 -- 172.21.15.38:0/2085013381 >> v1:172.21.15.150:6789/0 conn(0x7f532009df00 legacy=0x7f532014ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:32.069 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.056+0000 7f531ffff700 1 -- 172.21.15.38:0/2085013381 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53200b2860 con 0x7f5320142e90 2020-06-12T17:49:32.069 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.056+0000 7f531ffff700 1 --2- 172.21.15.38:0/2085013381 >> v2:172.21.15.38:3300/0 conn(0x7f5320142e90 0x7f53200affb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f53180022d0 tx=0x7f5318002ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.069 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.056+0000 7f531ffff700 1 --2- 172.21.15.38:0/2085013381 >> v2:172.21.15.38:3300/0 conn(0x7f5320142e90 0x7f53200affb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f53180022d0 tx=0x7f5318002ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.070 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.056+0000 7f531ffff700 1 --2- 172.21.15.38:0/2085013381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5320142e90 0x7f53200affb0 secure :-1 s=READY pgs=501 cs=0 l=1 rx=0x7f53180022d0 tx=0x7f5318002ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:32.070 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.056+0000 7f531ffff700 1 --2- 172.21.15.38:0/2085013381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5320142e90 0x7f53200affb0 secure :-1 s=THROTTLE_DONE pgs=501 cs=0 l=1 rx=0x7f53180022d0 tx=0x7f5318002ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.070 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.056+0000 7f531ffff700 1 --2- 172.21.15.38:0/2085013381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5320142e90 0x7f53200affb0 secure :-1 s=THROTTLE_DONE pgs=501 cs=0 l=1 rx=0x7f53180022d0 tx=0x7f5318002ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.071 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.056+0000 7f531d7fa700 1 -- 172.21.15.38:0/2085013381 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5318006c40 con 0x7f5320142e90 2020-06-12T17:49:32.071 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.056+0000 7f531ffff700 1 --2- 172.21.15.38:0/2085013381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5320142e90 0x7f53200affb0 secure :-1 s=THROTTLE_DONE pgs=501 cs=0 l=1 rx=0x7f53180022d0 tx=0x7f5318002ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.071 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.056+0000 7f531d7fa700 1 -- 172.21.15.38:0/2085013381 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5318006de0 con 0x7f5320142e90 2020-06-12T17:49:32.071 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.056+0000 7f532624c700 1 -- 172.21.15.38:0/2085013381 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f532013c1e0 con 0x7f5320142e90 2020-06-12T17:49:32.071 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.056+0000 7f531d7fa700 1 -- 172.21.15.38:0/2085013381 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5318012870 con 0x7f5320142e90 2020-06-12T17:49:32.072 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.056+0000 7f532624c700 1 -- 172.21.15.38:0/2085013381 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5320066d40 con 0x7f5320142e90 2020-06-12T17:49:32.072 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.057+0000 7f531ffff700 1 --2- 172.21.15.38:0/2085013381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5320142e90 0x7f53200affb0 secure :-1 s=THROTTLE_DONE pgs=501 cs=0 l=1 rx=0x7f53180022d0 tx=0x7f5318002ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.072 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.057+0000 7f532624c700 1 -- 172.21.15.38:0/2085013381 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53200b2160 con 0x7f5320142e90 2020-06-12T17:49:32.072 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.057+0000 7f531d7fa700 1 -- 172.21.15.38:0/2085013381 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f5318012ae0 con 0x7f5320142e90 2020-06-12T17:49:32.073 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.057+0000 7f531ffff700 1 --2- 172.21.15.38:0/2085013381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5320142e90 0x7f53200affb0 secure :-1 s=THROTTLE_DONE pgs=501 cs=0 l=1 rx=0x7f53180022d0 tx=0x7f5318002ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.073 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.058+0000 7f531d7fa700 1 --2- 172.21.15.38:0/2085013381 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f530404d5d0 0x7f530404fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:32.073 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.058+0000 7f531d7fa700 1 -- 172.21.15.38:0/2085013381 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5318061520 con 0x7f5320142e90 2020-06-12T17:49:32.073 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.058+0000 7f531f7fe700 1 --2- 172.21.15.38:0/2085013381 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f530404d5d0 0x7f530404fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:32.073 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.058+0000 7f531f7fe700 1 --2- 172.21.15.38:0/2085013381 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f530404d5d0 0x7f530404fa90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f53201404c0 tx=0x7f53100013d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.074 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.058+0000 7f531f7fe700 1 --2- 172.21.15.38:0/2085013381 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f530404d5d0 0x7f530404fa90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f53201404c0 tx=0x7f53100013d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.074 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.058+0000 7f531f7fe700 1 --2- 172.21.15.38:0/2085013381 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f530404d5d0 0x7f530404fa90 secure :-1 s=READY pgs=202 cs=0 l=1 rx=0x7f53201404c0 tx=0x7f53100013d0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:32.074 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.061+0000 7f531ffff700 1 --2- 172.21.15.38:0/2085013381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5320142e90 0x7f53200affb0 secure :-1 s=THROTTLE_DONE pgs=501 cs=0 l=1 rx=0x7f53180022d0 tx=0x7f5318002ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.074 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.061+0000 7f531d7fa700 1 -- 172.21.15.38:0/2085013381 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f531803cdb0 con 0x7f5320142e90 2020-06-12T17:49:32.259 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.256+0000 7f532624c700 1 -- 172.21.15.38:0/2085013381 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_7100", "target": ["mon-mgr", ""]}) v1 -- 0x7f5320056c30 con 0x7f530404d5d0 2020-06-12T17:49:32.280 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.277+0000 7f531f7fe700 1 --2- 172.21.15.38:0/2085013381 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f530404d5d0 0x7f530404fa90 secure :-1 s=THROTTLE_DONE pgs=202 cs=0 l=1 rx=0x7f53201404c0 tx=0x7f53100013d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.280 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.277+0000 7f531d7fa700 1 -- 172.21.15.38:0/2085013381 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f5320056c30 con 0x7f530404d5d0 2020-06-12T17:49:32.282 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.278+0000 7f532624c700 1 -- 172.21.15.38:0/2085013381 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f530404d5d0 msgr2=0x7f530404fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:32.282 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.278+0000 7f532624c700 1 --2- 172.21.15.38:0/2085013381 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f530404d5d0 0x7f530404fa90 secure :-1 s=READY pgs=202 cs=0 l=1 rx=0x7f53201404c0 tx=0x7f53100013d0).stop 2020-06-12T17:49:32.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.278+0000 7f532624c700 1 -- 172.21.15.38:0/2085013381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5320142e90 msgr2=0x7f53200affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:32.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.278+0000 7f532624c700 1 --2- 172.21.15.38:0/2085013381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5320142e90 0x7f53200affb0 secure :-1 s=READY pgs=501 cs=0 l=1 rx=0x7f53180022d0 tx=0x7f5318002ac0).stop 2020-06-12T17:49:32.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.278+0000 7f532624c700 1 -- 172.21.15.38:0/2085013381 shutdown_connections 2020-06-12T17:49:32.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.278+0000 7f532624c700 1 --2- 172.21.15.38:0/2085013381 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f530404d5d0 0x7f530404fa90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:32.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.278+0000 7f532624c700 1 --2- 172.21.15.38:0/2085013381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5320142e90 0x7f53200affb0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:32.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.278+0000 7f532624c700 1 --2- 172.21.15.38:0/2085013381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53200b3ac0 0x7f532014f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:32.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.278+0000 7f532624c700 1 -- 172.21.15.38:0/2085013381 >> 172.21.15.38:0/2085013381 conn(0x7f53200b5a20 msgr2=0x7f53200b68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:32.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.279+0000 7f532624c700 1 -- 172.21.15.38:0/2085013381 shutdown_connections 2020-06-12T17:49:32.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.279+0000 7f532624c700 1 -- 172.21.15.38:0/2085013381 wait complete. 2020-06-12T17:49:32.292 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_7100 2020-06-12T17:49:32.409 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.406+0000 7f14a0be3700 1 Processor -- start 2020-06-12T17:49:32.409 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.406+0000 7f14a0be3700 1 -- start start 2020-06-12T17:49:32.415 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.407+0000 7f14a0be3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f149c0b3ac0 0x7f149c09df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:32.415 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.407+0000 7f14a0be3700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149c09b960 con 0x7f149c13c650 2020-06-12T17:49:32.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.407+0000 7f14a0be3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149c09bc00 con 0x7f149c142e90 2020-06-12T17:49:32.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.407+0000 7f14a0be3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149c0b48f0 con 0x7f149c0b3ac0 2020-06-12T17:49:32.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.407+0000 7f149ad9d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f149c13c650 0x7f149c066790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39656/0 (socket says 172.21.15.38:39656) 2020-06-12T17:49:32.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.407+0000 7f149ad9d700 1 -- 172.21.15.38:0/4126962760 learned_addr learned my addr 172.21.15.38:0/4126962760 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:32.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.407+0000 7f149959a700 1 -- 172.21.15.38:0/4126962760 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 789376562 0 0) 0x7f149c09b960 con 0x7f149c13c650 2020-06-12T17:49:32.417 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.407+0000 7f149a59c700 1 --2- 172.21.15.38:0/4126962760 >> v2:172.21.15.150:3300/0 conn(0x7f149c0b3ac0 0x7f149c09df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:32.417 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.407+0000 7f149959a700 1 -- 172.21.15.38:0/4126962760 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1480003230 con 0x7f149c13c650 2020-06-12T17:49:32.417 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.407+0000 7f149959a700 1 -- 172.21.15.38:0/4126962760 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4019205029 0 0) 0x7f1480003230 con 0x7f149c13c650 2020-06-12T17:49:32.417 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.407+0000 7f149959a700 1 -- 172.21.15.38:0/4126962760 >> v2:172.21.15.150:3300/0 conn(0x7f149c0b3ac0 msgr2=0x7f149c09df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:32.417 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.407+0000 7f149959a700 1 --2- 172.21.15.38:0/4126962760 >> v2:172.21.15.150:3300/0 conn(0x7f149c0b3ac0 0x7f149c09df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:32.418 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.407+0000 7f149959a700 1 -- 172.21.15.38:0/4126962760 >> v1:172.21.15.150:6789/0 conn(0x7f149c142e90 legacy=0x7f149c13bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:32.418 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.407+0000 7f149959a700 1 -- 172.21.15.38:0/4126962760 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149c0b3ea0 con 0x7f149c13c650 2020-06-12T17:49:32.418 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.407+0000 7f149959a700 1 -- 172.21.15.38:0/4126962760 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f1494001a50 con 0x7f149c13c650 2020-06-12T17:49:32.418 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.407+0000 7f149959a700 1 -- 172.21.15.38:0/4126962760 >> v1:172.21.15.38:6789/0 conn(0x7f149c13c650 legacy=0x7f149c066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:32.418 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.407+0000 7f149959a700 1 --2- 172.21.15.38:0/4126962760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1480003720 0x7f1480003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:32.418 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.407+0000 7f149959a700 1 --2- 172.21.15.38:0/4126962760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1480004070 0x7f1480004550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:32.419 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.407+0000 7f149959a700 1 --2- 172.21.15.38:0/4126962760 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1480004ac0 0x7f1480004f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:32.419 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.407+0000 7f149959a700 1 -- 172.21.15.38:0/4126962760 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c0b48f0 con 0x7f1480004070 2020-06-12T17:49:32.419 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.407+0000 7f149959a700 1 -- 172.21.15.38:0/4126962760 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148000b880 con 0x7f1480003720 2020-06-12T17:49:32.419 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.407+0000 7f149959a700 1 -- 172.21.15.38:0/4126962760 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148000ba40 con 0x7f1480004ac0 2020-06-12T17:49:32.419 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.407+0000 7f1499d9b700 1 --2- 172.21.15.38:0/4126962760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1480004070 0x7f1480004550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:32.420 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.408+0000 7f149a59c700 1 --2- 172.21.15.38:0/4126962760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1480003720 0x7f1480003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:32.420 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.408+0000 7f149ad9d700 1 --2- 172.21.15.38:0/4126962760 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1480004ac0 0x7f1480004f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:32.420 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.408+0000 7f1499d9b700 1 -- 172.21.15.38:0/4126962760 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1480004ac0 msgr2=0x7f1480004f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:32.420 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.408+0000 7f1499d9b700 1 --2- 172.21.15.38:0/4126962760 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1480004ac0 0x7f1480004f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:32.420 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.408+0000 7f1499d9b700 1 -- 172.21.15.38:0/4126962760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1480003720 msgr2=0x7f1480003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:32.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.408+0000 7f1499d9b700 1 --2- 172.21.15.38:0/4126962760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1480003720 0x7f1480003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:32.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.408+0000 7f149ad9d700 1 -- 172.21.15.38:0/4126962760 reap_dead start 2020-06-12T17:49:32.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.408+0000 7f1499d9b700 1 -- 172.21.15.38:0/4126962760 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1480003230 con 0x7f1480004070 2020-06-12T17:49:32.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.408+0000 7f149a59c700 1 --2- 172.21.15.38:0/4126962760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1480003720 0x7f1480003b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:49:32.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.408+0000 7f1499d9b700 1 --2- 172.21.15.38:0/4126962760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1480004070 0x7f1480004550 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f148c000fe0 tx=0x7f148c001970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.408+0000 7f1499d9b700 1 --2- 172.21.15.38:0/4126962760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1480004070 0x7f1480004550 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f148c000fe0 tx=0x7f148c001970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.408+0000 7f1499d9b700 1 --2- 172.21.15.38:0/4126962760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1480004070 0x7f1480004550 secure :-1 s=READY pgs=503 cs=0 l=1 rx=0x7f148c000fe0 tx=0x7f148c001970).ready entity=mon.0 client_cookie=473d245d6149698d server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:32.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.408+0000 7f1499d9b700 1 --2- 172.21.15.38:0/4126962760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1480004070 0x7f1480004550 secure :-1 s=THROTTLE_DONE pgs=503 cs=0 l=1 rx=0x7f148c000fe0 tx=0x7f148c001970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.408+0000 7f149959a700 1 -- 172.21.15.38:0/4126962760 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f148c006bc0 con 0x7f1480004070 2020-06-12T17:49:32.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.408+0000 7f1499d9b700 1 --2- 172.21.15.38:0/4126962760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1480004070 0x7f1480004550 secure :-1 s=THROTTLE_DONE pgs=503 cs=0 l=1 rx=0x7f148c000fe0 tx=0x7f148c001970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.408+0000 7f149959a700 1 -- 172.21.15.38:0/4126962760 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c006d20 con 0x7f1480004070 2020-06-12T17:49:32.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.408+0000 7f1499d9b700 1 --2- 172.21.15.38:0/4126962760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1480004070 0x7f1480004550 secure :-1 s=THROTTLE_DONE pgs=503 cs=0 l=1 rx=0x7f148c000fe0 tx=0x7f148c001970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.408+0000 7f149959a700 1 -- 172.21.15.38:0/4126962760 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f148c006e90 con 0x7f1480004070 2020-06-12T17:49:32.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.408+0000 7f14a0be3700 1 -- 172.21.15.38:0/4126962760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1480004070 msgr2=0x7f1480004550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:32.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.408+0000 7f14a0be3700 1 --2- 172.21.15.38:0/4126962760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1480004070 0x7f1480004550 secure :-1 s=READY pgs=503 cs=0 l=1 rx=0x7f148c000fe0 tx=0x7f148c001970).stop 2020-06-12T17:49:32.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.409+0000 7f14a0be3700 1 -- 172.21.15.38:0/4126962760 shutdown_connections 2020-06-12T17:49:32.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.409+0000 7f14a0be3700 1 --2- 172.21.15.38:0/4126962760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1480004070 0x7f1480004550 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:32.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.409+0000 7f14a0be3700 1 -- 172.21.15.38:0/4126962760 >> 172.21.15.38:0/4126962760 conn(0x7f149c0b5a20 msgr2=0x7f149c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:32.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.409+0000 7f14a0be3700 1 -- 172.21.15.38:0/4126962760 shutdown_connections 2020-06-12T17:49:32.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.409+0000 7f14a0be3700 1 -- 172.21.15.38:0/4126962760 wait complete. 2020-06-12T17:49:32.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.410+0000 7f14a0be3700 1 Processor -- start 2020-06-12T17:49:32.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.410+0000 7f14a0be3700 1 -- start start 2020-06-12T17:49:32.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.410+0000 7f14a0be3700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1480004070 0x7f149c1533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:32.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.410+0000 7f14a0be3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f149c13f690 0x7f149c15c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:32.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.410+0000 7f14a0be3700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149c062520 con 0x7f149c065220 2020-06-12T17:49:32.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.410+0000 7f14a0be3700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149c13fb40 con 0x7f1480004070 2020-06-12T17:49:32.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.410+0000 7f14a0be3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149c1538f0 con 0x7f149c13f690 2020-06-12T17:49:32.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.410+0000 7f149a59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1480004070 0x7f149c1533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:32.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.410+0000 7f1499d9b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f149c065220 0x7f149c08ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39670/0 (socket says 172.21.15.38:39670) 2020-06-12T17:49:32.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.410+0000 7f1499d9b700 1 -- 172.21.15.38:0/4153839605 learned_addr learned my addr 172.21.15.38:0/4153839605 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:32.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.411+0000 7f149ad9d700 1 --2- 172.21.15.38:0/4153839605 >> v2:172.21.15.150:3300/0 conn(0x7f149c13f690 0x7f149c15c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:32.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.411+0000 7f149a59c700 1 -- 172.21.15.38:0/4153839605 >> v2:172.21.15.150:3300/0 conn(0x7f149c13f690 msgr2=0x7f149c15c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:32.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.411+0000 7f149a59c700 1 --2- 172.21.15.38:0/4153839605 >> v2:172.21.15.150:3300/0 conn(0x7f149c13f690 0x7f149c15c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:32.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.411+0000 7f149a59c700 1 -- 172.21.15.38:0/4153839605 >> v1:172.21.15.38:6789/0 conn(0x7f149c065220 legacy=0x7f149c08ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:32.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.411+0000 7f148b7fe700 1 -- 172.21.15.38:0/4153839605 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2727519254 0 0) 0x7f149c062520 con 0x7f149c065220 2020-06-12T17:49:32.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.411+0000 7f149a59c700 1 -- 172.21.15.38:0/4153839605 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149c153b90 con 0x7f1480004070 2020-06-12T17:49:32.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.411+0000 7f149a59c700 1 --2- 172.21.15.38:0/4153839605 >> v2:172.21.15.38:3300/0 conn(0x7f1480004070 0x7f149c1533e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1490002f30 tx=0x7f1490007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.411+0000 7f149a59c700 1 --2- 172.21.15.38:0/4153839605 >> v2:172.21.15.38:3300/0 conn(0x7f1480004070 0x7f149c1533e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1490002f30 tx=0x7f1490007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.411+0000 7f149a59c700 1 --2- 172.21.15.38:0/4153839605 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1480004070 0x7f149c1533e0 secure :-1 s=READY pgs=505 cs=0 l=1 rx=0x7f1490002f30 tx=0x7f1490007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:32.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.411+0000 7f149a59c700 1 --2- 172.21.15.38:0/4153839605 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1480004070 0x7f149c1533e0 secure :-1 s=THROTTLE_DONE pgs=505 cs=0 l=1 rx=0x7f1490002f30 tx=0x7f1490007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.411+0000 7f148b7fe700 1 -- 172.21.15.38:0/4153839605 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1490012ab0 con 0x7f1480004070 2020-06-12T17:49:32.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.411+0000 7f149a59c700 1 --2- 172.21.15.38:0/4153839605 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1480004070 0x7f149c1533e0 secure :-1 s=THROTTLE_DONE pgs=505 cs=0 l=1 rx=0x7f1490002f30 tx=0x7f1490007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.411+0000 7f148b7fe700 1 -- 172.21.15.38:0/4153839605 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1490012cb0 con 0x7f1480004070 2020-06-12T17:49:32.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.411+0000 7f149a59c700 1 --2- 172.21.15.38:0/4153839605 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1480004070 0x7f149c1533e0 secure :-1 s=THROTTLE_DONE pgs=505 cs=0 l=1 rx=0x7f1490002f30 tx=0x7f1490007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.411+0000 7f14a0be3700 1 -- 172.21.15.38:0/4153839605 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149c153e30 con 0x7f1480004070 2020-06-12T17:49:32.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.411+0000 7f148b7fe700 1 -- 172.21.15.38:0/4153839605 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1490012e20 con 0x7f1480004070 2020-06-12T17:49:32.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.411+0000 7f14a0be3700 1 -- 172.21.15.38:0/4153839605 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149c1542d0 con 0x7f1480004070 2020-06-12T17:49:32.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.412+0000 7f149a59c700 1 --2- 172.21.15.38:0/4153839605 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1480004070 0x7f149c1533e0 secure :-1 s=THROTTLE_DONE pgs=505 cs=0 l=1 rx=0x7f1490002f30 tx=0x7f1490007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.412+0000 7f148b7fe700 1 -- 172.21.15.38:0/4153839605 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f1490007140 con 0x7f1480004070 2020-06-12T17:49:32.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.412+0000 7f149a59c700 1 --2- 172.21.15.38:0/4153839605 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1480004070 0x7f149c1533e0 secure :-1 s=THROTTLE_DONE pgs=505 cs=0 l=1 rx=0x7f1490002f30 tx=0x7f1490007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.412+0000 7f14a0be3700 1 -- 172.21.15.38:0/4153839605 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f149c153fc0 con 0x7f1480004070 2020-06-12T17:49:32.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.412+0000 7f148b7fe700 1 --2- 172.21.15.38:0/4153839605 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f147804d430 0x7f147804f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:32.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.412+0000 7f148b7fe700 1 -- 172.21.15.38:0/4153839605 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1490061280 con 0x7f1480004070 2020-06-12T17:49:32.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.413+0000 7f1499d9b700 1 --2- 172.21.15.38:0/4153839605 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f147804d430 0x7f147804f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:32.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.413+0000 7f1499d9b700 1 --2- 172.21.15.38:0/4153839605 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f147804d430 0x7f147804f8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f148c003ec0 tx=0x7f148c001970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.413+0000 7f1499d9b700 1 --2- 172.21.15.38:0/4153839605 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f147804d430 0x7f147804f8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f148c003ec0 tx=0x7f148c001970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.413+0000 7f1499d9b700 1 --2- 172.21.15.38:0/4153839605 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f147804d430 0x7f147804f8f0 secure :-1 s=READY pgs=203 cs=0 l=1 rx=0x7f148c003ec0 tx=0x7f148c001970).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:32.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.416+0000 7f149a59c700 1 --2- 172.21.15.38:0/4153839605 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1480004070 0x7f149c1533e0 secure :-1 s=THROTTLE_DONE pgs=505 cs=0 l=1 rx=0x7f1490002f30 tx=0x7f1490007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.416+0000 7f148b7fe700 1 -- 172.21.15.38:0/4153839605 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f149003c9d0 con 0x7f1480004070 2020-06-12T17:49:32.625 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.622+0000 7f14a0be3700 1 -- 172.21.15.38:0/4153839605 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_7100", "target": ["mon-mgr", ""]}) v1 -- 0x7f149c056c30 con 0x7f147804d430 2020-06-12T17:49:32.628 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.625+0000 7f1499d9b700 1 --2- 172.21.15.38:0/4153839605 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f147804d430 0x7f147804f8f0 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7f148c003ec0 tx=0x7f148c001970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:32.629 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.625+0000 7f148b7fe700 1 -- 172.21.15.38:0/4153839605 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f149c056c30 con 0x7f147804d430 2020-06-12T17:49:32.629 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_7100/a8d4e91f-3f39-49eb-b159-26dd0d82b701 2020-06-12T17:49:32.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.626+0000 7f14a0be3700 1 -- 172.21.15.38:0/4153839605 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f147804d430 msgr2=0x7f147804f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:32.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.626+0000 7f14a0be3700 1 --2- 172.21.15.38:0/4153839605 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f147804d430 0x7f147804f8f0 secure :-1 s=READY pgs=203 cs=0 l=1 rx=0x7f148c003ec0 tx=0x7f148c001970).stop 2020-06-12T17:49:32.630 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.626+0000 7f14a0be3700 1 -- 172.21.15.38:0/4153839605 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1480004070 msgr2=0x7f149c1533e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:32.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.626+0000 7f14a0be3700 1 --2- 172.21.15.38:0/4153839605 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1480004070 0x7f149c1533e0 secure :-1 s=READY pgs=505 cs=0 l=1 rx=0x7f1490002f30 tx=0x7f1490007e60).stop 2020-06-12T17:49:32.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.626+0000 7f14a0be3700 1 -- 172.21.15.38:0/4153839605 shutdown_connections 2020-06-12T17:49:32.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.626+0000 7f14a0be3700 1 --2- 172.21.15.38:0/4153839605 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f147804d430 0x7f147804f8f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:32.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.627+0000 7f14a0be3700 1 --2- 172.21.15.38:0/4153839605 >> v2:172.21.15.150:3300/0 conn(0x7f149c13f690 0x7f149c15c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:32.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.627+0000 7f14a0be3700 1 --2- 172.21.15.38:0/4153839605 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1480004070 0x7f149c1533e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:32.632 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.627+0000 7f14a0be3700 1 -- 172.21.15.38:0/4153839605 >> 172.21.15.38:0/4153839605 conn(0x7f149c0b5a20 msgr2=0x7f149c0b7240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:32.632 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.627+0000 7f14a0be3700 1 -- 172.21.15.38:0/4153839605 shutdown_connections 2020-06-12T17:49:32.632 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:32.627+0000 7f14a0be3700 1 -- 172.21.15.38:0/4153839605 wait complete. 2020-06-12T17:49:32.640 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_7100 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_7100/a8d4e91f-3f39-49eb-b159-26dd0d82b701 2020-06-12T17:49:32.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:32.641 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:32.642 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:32.656 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:32.657 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:32.658 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7100/a8d4e91f-3f39-49eb-b159-26dd0d82b701/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:32.747 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:32.747 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:32.748 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103605 s, 101 MB/s 2020-06-12T17:49:32.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:32.749 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:32.750 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:32.764 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:32.765 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:32.766 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7100/a8d4e91f-3f39-49eb-b159-26dd0d82b701/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:32.855 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:32.855 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:32.855 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131724 s, 79.6 MB/s 2020-06-12T17:49:32.856 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:32.857 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:32.857 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:32.872 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:32.872 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:32.873 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7100/a8d4e91f-3f39-49eb-b159-26dd0d82b701/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:32.965 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:32.965 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:32.965 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117235 s, 89.4 MB/s 2020-06-12T17:49:32.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:32.967 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:32.967 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:32.982 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:32.982 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:32.983 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7100/a8d4e91f-3f39-49eb-b159-26dd0d82b701/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:33.069 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:33.070 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:33.070 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115703 s, 90.6 MB/s 2020-06-12T17:49:33.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:33.072 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:33.072 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:33.087 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:33.087 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:33.088 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7100/a8d4e91f-3f39-49eb-b159-26dd0d82b701/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:33.175 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:33.175 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:33.175 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010939 s, 95.9 MB/s 2020-06-12T17:49:33.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:33.177 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:33.177 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:33.192 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:33.193 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:33.193 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7100/a8d4e91f-3f39-49eb-b159-26dd0d82b701/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:33.281 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:33.281 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:33.281 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114606 s, 91.5 MB/s 2020-06-12T17:49:33.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:33.283 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:33.283 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:33.298 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:33.298 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:33.299 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7100/a8d4e91f-3f39-49eb-b159-26dd0d82b701/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:33.389 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:33.389 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:33.390 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012993 s, 80.7 MB/s 2020-06-12T17:49:33.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:33.391 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:33.392 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:33.407 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:33.408 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:33.408 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7100/a8d4e91f-3f39-49eb-b159-26dd0d82b701/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:33.495 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:33.495 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:33.496 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118866 s, 88.2 MB/s 2020-06-12T17:49:33.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:33.497 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:33.498 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:33.513 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:33.513 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:33.513 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7100/a8d4e91f-3f39-49eb-b159-26dd0d82b701/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:33.601 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:33.602 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:33.602 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111054 s, 94.4 MB/s 2020-06-12T17:49:33.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:33.603 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:33.604 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:33.618 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:33.619 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:33.619 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7100/a8d4e91f-3f39-49eb-b159-26dd0d82b701/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:33.706 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:33.706 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:33.706 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106581 s, 98.4 MB/s 2020-06-12T17:49:33.707 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_224 2020-06-12T17:49:33.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.821+0000 7fc098b0a700 1 Processor -- start 2020-06-12T17:49:33.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.821+0000 7fc098b0a700 1 -- start start 2020-06-12T17:49:33.829 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.822+0000 7fc098b0a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc094146680 0x7fc0940ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:33.829 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.822+0000 7fc098b0a700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc094146d20 con 0x7fc0940b2eb0 2020-06-12T17:49:33.829 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.822+0000 7fc098b0a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc094066a80 con 0x7fc09409d8d0 2020-06-12T17:49:33.830 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.822+0000 7fc098b0a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc094146f50 con 0x7fc094146680 2020-06-12T17:49:33.830 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.822+0000 7fc091d9b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc0940b2eb0 0x7fc09409d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39676/0 (socket says 172.21.15.38:39676) 2020-06-12T17:49:33.830 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.823+0000 7fc091d9b700 1 -- 172.21.15.38:0/927642763 learned_addr learned my addr 172.21.15.38:0/927642763 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:33.830 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.823+0000 7fc09259c700 1 --2- 172.21.15.38:0/927642763 >> v2:172.21.15.150:3300/0 conn(0x7fc094146680 0x7fc0940ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:33.830 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.823+0000 7fc09159a700 1 -- 172.21.15.38:0/927642763 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014545170 0 0) 0x7fc094146d20 con 0x7fc0940b2eb0 2020-06-12T17:49:33.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.823+0000 7fc09159a700 1 -- 172.21.15.38:0/927642763 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc074003230 con 0x7fc0940b2eb0 2020-06-12T17:49:33.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.823+0000 7fc09159a700 1 -- 172.21.15.38:0/927642763 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2831299046 0 0) 0x7fc074003230 con 0x7fc0940b2eb0 2020-06-12T17:49:33.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.823+0000 7fc09159a700 1 -- 172.21.15.38:0/927642763 >> v2:172.21.15.150:3300/0 conn(0x7fc094146680 msgr2=0x7fc0940ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:33.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.823+0000 7fc09159a700 1 --2- 172.21.15.38:0/927642763 >> v2:172.21.15.150:3300/0 conn(0x7fc094146680 0x7fc0940ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:33.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.823+0000 7fc09159a700 1 -- 172.21.15.38:0/927642763 >> v1:172.21.15.150:6789/0 conn(0x7fc09409d8d0 legacy=0x7fc0941421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:33.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.823+0000 7fc09159a700 1 -- 172.21.15.38:0/927642763 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc094146a60 con 0x7fc0940b2eb0 2020-06-12T17:49:33.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.823+0000 7fc09159a700 1 -- 172.21.15.38:0/927642763 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fc0840016d0 con 0x7fc0940b2eb0 2020-06-12T17:49:33.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.823+0000 7fc09159a700 1 -- 172.21.15.38:0/927642763 >> v1:172.21.15.38:6789/0 conn(0x7fc0940b2eb0 legacy=0x7fc09409d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:33.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.823+0000 7fc09159a700 1 --2- 172.21.15.38:0/927642763 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc074003720 0x7fc074003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:33.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.823+0000 7fc09159a700 1 --2- 172.21.15.38:0/927642763 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0740044d0 0x7fc074004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:33.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.823+0000 7fc09159a700 1 --2- 172.21.15.38:0/927642763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc074004db0 0x7fc07400d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:33.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.823+0000 7fc09159a700 1 -- 172.21.15.38:0/927642763 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc094146f50 con 0x7fc074003720 2020-06-12T17:49:33.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.823+0000 7fc09159a700 1 -- 172.21.15.38:0/927642763 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0740041c0 con 0x7fc074004db0 2020-06-12T17:49:33.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.823+0000 7fc09159a700 1 -- 172.21.15.38:0/927642763 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07400dd90 con 0x7fc0740044d0 2020-06-12T17:49:33.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.823+0000 7fc09259c700 1 --2- 172.21.15.38:0/927642763 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc074003720 0x7fc074003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:33.834 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.823+0000 7fc091d9b700 1 --2- 172.21.15.38:0/927642763 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0740044d0 0x7fc074004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:33.834 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.823+0000 7fc092d9d700 1 --2- 172.21.15.38:0/927642763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc074004db0 0x7fc07400d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:33.834 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.823+0000 7fc09259c700 1 -- 172.21.15.38:0/927642763 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0740044d0 msgr2=0x7fc074004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:33.834 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.823+0000 7fc09259c700 1 --2- 172.21.15.38:0/927642763 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0740044d0 0x7fc074004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:33.834 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.823+0000 7fc09259c700 1 -- 172.21.15.38:0/927642763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc074004db0 msgr2=0x7fc07400d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:33.835 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.823+0000 7fc09259c700 1 --2- 172.21.15.38:0/927642763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc074004db0 0x7fc07400d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:33.835 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.824+0000 7fc092d9d700 1 -- 172.21.15.38:0/927642763 reap_dead start 2020-06-12T17:49:33.835 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.824+0000 7fc09259c700 1 -- 172.21.15.38:0/927642763 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc074003230 con 0x7fc074003720 2020-06-12T17:49:33.835 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.824+0000 7fc09259c700 1 --2- 172.21.15.38:0/927642763 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc074003720 0x7fc074003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc07c002f30 tx=0x7fc07c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:33.835 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.824+0000 7fc09259c700 1 --2- 172.21.15.38:0/927642763 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc074003720 0x7fc074003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc07c002f30 tx=0x7fc07c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:33.835 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.824+0000 7fc09259c700 1 --2- 172.21.15.38:0/927642763 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc074003720 0x7fc074003b40 secure :-1 s=READY pgs=507 cs=0 l=1 rx=0x7fc07c002f30 tx=0x7fc07c007e60).ready entity=mon.0 client_cookie=6b6757ddedd7b696 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:33.836 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.824+0000 7fc09259c700 1 --2- 172.21.15.38:0/927642763 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc074003720 0x7fc074003b40 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7fc07c002f30 tx=0x7fc07c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:33.836 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.824+0000 7fc09159a700 1 -- 172.21.15.38:0/927642763 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc07c008d30 con 0x7fc074003720 2020-06-12T17:49:33.836 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.824+0000 7fc09259c700 1 --2- 172.21.15.38:0/927642763 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc074003720 0x7fc074003b40 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7fc07c002f30 tx=0x7fc07c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:33.836 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.824+0000 7fc09259c700 1 --2- 172.21.15.38:0/927642763 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc074003720 0x7fc074003b40 secure :-1 s=THROTTLE_DONE pgs=507 cs=0 l=1 rx=0x7fc07c002f30 tx=0x7fc07c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:33.836 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.824+0000 7fc09159a700 1 -- 172.21.15.38:0/927642763 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07c008e90 con 0x7fc074003720 2020-06-12T17:49:33.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.824+0000 7fc09159a700 1 -- 172.21.15.38:0/927642763 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc07c010a30 con 0x7fc074003720 2020-06-12T17:49:33.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.824+0000 7fc098b0a700 1 -- 172.21.15.38:0/927642763 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc074003720 msgr2=0x7fc074003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:33.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.824+0000 7fc098b0a700 1 --2- 172.21.15.38:0/927642763 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc074003720 0x7fc074003b40 secure :-1 s=READY pgs=507 cs=0 l=1 rx=0x7fc07c002f30 tx=0x7fc07c007e60).stop 2020-06-12T17:49:33.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.824+0000 7fc098b0a700 1 -- 172.21.15.38:0/927642763 shutdown_connections 2020-06-12T17:49:33.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.824+0000 7fc098b0a700 1 --2- 172.21.15.38:0/927642763 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc074003720 0x7fc074003b40 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:33.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.824+0000 7fc098b0a700 1 -- 172.21.15.38:0/927642763 >> 172.21.15.38:0/927642763 conn(0x7fc0940b5a20 msgr2=0x7fc09405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:33.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.824+0000 7fc098b0a700 1 -- 172.21.15.38:0/927642763 shutdown_connections 2020-06-12T17:49:33.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.824+0000 7fc098b0a700 1 -- 172.21.15.38:0/927642763 wait complete. 2020-06-12T17:49:33.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.825+0000 7fc098b0a700 1 Processor -- start 2020-06-12T17:49:33.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.825+0000 7fc098b0a700 1 -- start start 2020-06-12T17:49:33.841 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.826+0000 7fc098b0a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc074003720 0x7fc094152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:33.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.826+0000 7fc098b0a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0940b27e0 0x7fc094153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:33.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.826+0000 7fc098b0a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc09413d410 0x7fc09413d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:33.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.826+0000 7fc098b0a700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc094152ff0 con 0x7fc074003720 2020-06-12T17:49:33.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.826+0000 7fc098b0a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc094142d70 con 0x7fc09413d410 2020-06-12T17:49:33.842 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.826+0000 7fc098b0a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc094143010 con 0x7fc0940b27e0 2020-06-12T17:49:33.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.826+0000 7fc09259c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc074003720 0x7fc094152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:33.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.826+0000 7fc09259c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc074003720 0x7fc094152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37872/0 (socket says 172.21.15.38:37872) 2020-06-12T17:49:33.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.826+0000 7fc09259c700 1 -- 172.21.15.38:0/3698902924 learned_addr learned my addr 172.21.15.38:0/3698902924 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:33.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.826+0000 7fc092d9d700 1 --2- 172.21.15.38:0/3698902924 >> v2:172.21.15.150:3300/0 conn(0x7fc09413d410 0x7fc09413d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:33.843 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.826+0000 7fc091d9b700 1 --2- 172.21.15.38:0/3698902924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0940b27e0 0x7fc094153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:33.844 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.826+0000 7fc09259c700 1 -- 172.21.15.38:0/3698902924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0940b27e0 msgr2=0x7fc094153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:33.844 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.826+0000 7fc09259c700 1 --2- 172.21.15.38:0/3698902924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0940b27e0 0x7fc094153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:33.844 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.826+0000 7fc09259c700 1 -- 172.21.15.38:0/3698902924 >> v2:172.21.15.150:3300/0 conn(0x7fc09413d410 msgr2=0x7fc09413d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:33.844 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.826+0000 7fc09259c700 1 --2- 172.21.15.38:0/3698902924 >> v2:172.21.15.150:3300/0 conn(0x7fc09413d410 0x7fc09413d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:33.844 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.826+0000 7fc09259c700 1 -- 172.21.15.38:0/3698902924 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0941432b0 con 0x7fc074003720 2020-06-12T17:49:33.845 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.826+0000 7fc092d9d700 1 --2- 172.21.15.38:0/3698902924 >> v2:172.21.15.150:3300/0 conn(0x7fc09413d410 0x7fc09413d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:49:33.845 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.826+0000 7fc09259c700 1 --2- 172.21.15.38:0/3698902924 >> v2:172.21.15.38:3300/0 conn(0x7fc074003720 0x7fc094152b90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc07c002f30 tx=0x7fc07c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:33.845 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.827+0000 7fc09259c700 1 --2- 172.21.15.38:0/3698902924 >> v2:172.21.15.38:3300/0 conn(0x7fc074003720 0x7fc094152b90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc07c002f30 tx=0x7fc07c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:33.845 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.827+0000 7fc09259c700 1 --2- 172.21.15.38:0/3698902924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc074003720 0x7fc094152b90 secure :-1 s=READY pgs=508 cs=0 l=1 rx=0x7fc07c002f30 tx=0x7fc07c007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:33.845 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.827+0000 7fc09259c700 1 --2- 172.21.15.38:0/3698902924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc074003720 0x7fc094152b90 secure :-1 s=THROTTLE_DONE pgs=508 cs=0 l=1 rx=0x7fc07c002f30 tx=0x7fc07c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:33.846 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.827+0000 7fc09259c700 1 --2- 172.21.15.38:0/3698902924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc074003720 0x7fc094152b90 secure :-1 s=THROTTLE_DONE pgs=508 cs=0 l=1 rx=0x7fc07c002f30 tx=0x7fc07c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:33.846 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.827+0000 7fc08b7fe700 1 -- 172.21.15.38:0/3698902924 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc07c00f5f0 con 0x7fc074003720 2020-06-12T17:49:33.846 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.827+0000 7fc09259c700 1 --2- 172.21.15.38:0/3698902924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc074003720 0x7fc094152b90 secure :-1 s=THROTTLE_DONE pgs=508 cs=0 l=1 rx=0x7fc07c002f30 tx=0x7fc07c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:33.846 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.827+0000 7fc08b7fe700 1 -- 172.21.15.38:0/3698902924 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07c00f750 con 0x7fc074003720 2020-06-12T17:49:33.846 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.827+0000 7fc098b0a700 1 -- 172.21.15.38:0/3698902924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0940b2310 con 0x7fc074003720 2020-06-12T17:49:33.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.827+0000 7fc08b7fe700 1 -- 172.21.15.38:0/3698902924 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc07c0058b0 con 0x7fc074003720 2020-06-12T17:49:33.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.827+0000 7fc098b0a700 1 -- 172.21.15.38:0/3698902924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0940b0250 con 0x7fc074003720 2020-06-12T17:49:33.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.827+0000 7fc09259c700 1 --2- 172.21.15.38:0/3698902924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc074003720 0x7fc094152b90 secure :-1 s=THROTTLE_DONE pgs=508 cs=0 l=1 rx=0x7fc07c002f30 tx=0x7fc07c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:33.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.828+0000 7fc08b7fe700 1 -- 172.21.15.38:0/3698902924 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fc07c005b20 con 0x7fc074003720 2020-06-12T17:49:33.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.828+0000 7fc09259c700 1 --2- 172.21.15.38:0/3698902924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc074003720 0x7fc094152b90 secure :-1 s=THROTTLE_DONE pgs=508 cs=0 l=1 rx=0x7fc07c002f30 tx=0x7fc07c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:33.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.828+0000 7fc098b0a700 1 -- 172.21.15.38:0/3698902924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc094056c30 con 0x7fc074003720 2020-06-12T17:49:33.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.828+0000 7fc08b7fe700 1 --2- 172.21.15.38:0/3698902924 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc07804d6b0 0x7fc07804fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:33.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.828+0000 7fc08b7fe700 1 -- 172.21.15.38:0/3698902924 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc07c061460 con 0x7fc074003720 2020-06-12T17:49:33.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.829+0000 7fc091d9b700 1 --2- 172.21.15.38:0/3698902924 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc07804d6b0 0x7fc07804fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:33.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.829+0000 7fc091d9b700 1 --2- 172.21.15.38:0/3698902924 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc07804d6b0 0x7fc07804fb70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc0840013e0 tx=0x7fc0940b61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:33.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.829+0000 7fc091d9b700 1 --2- 172.21.15.38:0/3698902924 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc07804d6b0 0x7fc07804fb70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc0840013e0 tx=0x7fc0940b61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:33.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.829+0000 7fc091d9b700 1 --2- 172.21.15.38:0/3698902924 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc07804d6b0 0x7fc07804fb70 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7fc0840013e0 tx=0x7fc0940b61c0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:33.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.832+0000 7fc09259c700 1 --2- 172.21.15.38:0/3698902924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc074003720 0x7fc094152b90 secure :-1 s=THROTTLE_DONE pgs=508 cs=0 l=1 rx=0x7fc07c002f30 tx=0x7fc07c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:33.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:33.832+0000 7fc08b7fe700 1 -- 172.21.15.38:0/3698902924 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fc07c03cca0 con 0x7fc074003720 2020-06-12T17:49:34.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.024+0000 7fc098b0a700 1 -- 172.21.15.38:0/3698902924 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_224", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0940b6d10 con 0x7fc07804d6b0 2020-06-12T17:49:34.047 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.043+0000 7fc091d9b700 1 --2- 172.21.15.38:0/3698902924 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc07804d6b0 0x7fc07804fb70 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7fc0840013e0 tx=0x7fc0940b61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:34.047 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.043+0000 7fc08b7fe700 1 -- 172.21.15.38:0/3698902924 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc0940b6d10 con 0x7fc07804d6b0 2020-06-12T17:49:34.049 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.045+0000 7fc098b0a700 1 -- 172.21.15.38:0/3698902924 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc07804d6b0 msgr2=0x7fc07804fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:34.049 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.045+0000 7fc098b0a700 1 --2- 172.21.15.38:0/3698902924 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc07804d6b0 0x7fc07804fb70 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7fc0840013e0 tx=0x7fc0940b61c0).stop 2020-06-12T17:49:34.049 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.045+0000 7fc098b0a700 1 -- 172.21.15.38:0/3698902924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc074003720 msgr2=0x7fc094152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:34.049 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.045+0000 7fc098b0a700 1 --2- 172.21.15.38:0/3698902924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc074003720 0x7fc094152b90 secure :-1 s=READY pgs=508 cs=0 l=1 rx=0x7fc07c002f30 tx=0x7fc07c007e60).stop 2020-06-12T17:49:34.049 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.045+0000 7fc098b0a700 1 -- 172.21.15.38:0/3698902924 shutdown_connections 2020-06-12T17:49:34.050 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.045+0000 7fc098b0a700 1 --2- 172.21.15.38:0/3698902924 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc07804d6b0 0x7fc07804fb70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:34.050 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.045+0000 7fc098b0a700 1 --2- 172.21.15.38:0/3698902924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc074003720 0x7fc094152b90 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:34.050 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.045+0000 7fc098b0a700 1 --2- 172.21.15.38:0/3698902924 >> v2:172.21.15.150:3300/0 conn(0x7fc09413d410 0x7fc09413d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:34.050 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.045+0000 7fc098b0a700 1 --2- 172.21.15.38:0/3698902924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc0940b27e0 0x7fc094153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:34.050 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.045+0000 7fc098b0a700 1 -- 172.21.15.38:0/3698902924 >> 172.21.15.38:0/3698902924 conn(0x7fc0940b5a20 msgr2=0x7fc094143a20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:34.051 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.045+0000 7fc098b0a700 1 -- 172.21.15.38:0/3698902924 shutdown_connections 2020-06-12T17:49:34.051 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.045+0000 7fc098b0a700 1 -- 172.21.15.38:0/3698902924 wait complete. 2020-06-12T17:49:34.059 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_224 2020-06-12T17:49:34.176 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.172+0000 7f99ac5a0700 1 Processor -- start 2020-06-12T17:49:34.176 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.173+0000 7f99ac5a0700 1 -- start start 2020-06-12T17:49:34.180 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.173+0000 7f99ac5a0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99a4146680 0x7f99a40ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:34.180 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.173+0000 7f99ac5a0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f99a40b2eb0 0x7f99a409d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:34.180 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.173+0000 7f99ac5a0700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a4146d20 con 0x7f99a409d620 2020-06-12T17:49:34.181 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.173+0000 7f99ac5a0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a4066a80 con 0x7f99a40b2eb0 2020-06-12T17:49:34.181 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.173+0000 7f99ac5a0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a4146f50 con 0x7f99a4146680 2020-06-12T17:49:34.181 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.174+0000 7f99aab3d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f99a409d620 0x7f99a409b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39700/0 (socket says 172.21.15.38:39700) 2020-06-12T17:49:34.181 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.174+0000 7f99aab3d700 1 -- 172.21.15.38:0/543803387 learned_addr learned my addr 172.21.15.38:0/543803387 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:34.181 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.174+0000 7f99aa33c700 1 --2- 172.21.15.38:0/543803387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99a4146680 0x7f99a40ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:34.182 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.174+0000 7f99a933a700 1 -- 172.21.15.38:0/543803387 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1122935988 0 0) 0x7f99a4146d20 con 0x7f99a409d620 2020-06-12T17:49:34.182 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.174+0000 7f99a9b3b700 1 --2- 172.21.15.38:0/543803387 >> v2:172.21.15.150:3300/0 conn(0x7f99a40b2eb0 0x7f99a409d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:34.182 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.174+0000 7f99a933a700 1 -- 172.21.15.38:0/543803387 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f998c003230 con 0x7f99a409d620 2020-06-12T17:49:34.182 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.174+0000 7f99a933a700 1 -- 172.21.15.38:0/543803387 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1776273287 0 0) 0x7f998c003230 con 0x7f99a409d620 2020-06-12T17:49:34.182 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.174+0000 7f99a933a700 1 -- 172.21.15.38:0/543803387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99a4146680 msgr2=0x7f99a40ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:34.183 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.174+0000 7f99a933a700 1 --2- 172.21.15.38:0/543803387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99a4146680 0x7f99a40ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:34.183 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.174+0000 7f99a933a700 1 -- 172.21.15.38:0/543803387 >> v2:172.21.15.150:3300/0 conn(0x7f99a40b2eb0 msgr2=0x7f99a409d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:34.183 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.174+0000 7f99a933a700 1 --2- 172.21.15.38:0/543803387 >> v2:172.21.15.150:3300/0 conn(0x7f99a40b2eb0 0x7f99a409d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:34.183 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.174+0000 7f99a933a700 1 -- 172.21.15.38:0/543803387 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a4146a60 con 0x7f99a409d620 2020-06-12T17:49:34.183 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.174+0000 7f99a933a700 1 -- 172.21.15.38:0/543803387 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f999c0016d0 con 0x7f99a409d620 2020-06-12T17:49:34.184 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.174+0000 7f99a933a700 1 -- 172.21.15.38:0/543803387 >> v1:172.21.15.38:6789/0 conn(0x7f99a409d620 legacy=0x7f99a409b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:34.184 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.174+0000 7f99a933a700 1 --2- 172.21.15.38:0/543803387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f998c003720 0x7f998c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:34.184 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.174+0000 7f99a933a700 1 --2- 172.21.15.38:0/543803387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f998c004060 0x7f998c004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:34.184 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.174+0000 7f99a933a700 1 --2- 172.21.15.38:0/543803387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99a4146680 0x7f998c004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:34.184 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.174+0000 7f99a933a700 1 -- 172.21.15.38:0/543803387 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a4066a80 con 0x7f998c004060 2020-06-12T17:49:34.185 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.174+0000 7f99a933a700 1 -- 172.21.15.38:0/543803387 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a4146f50 con 0x7f998c003720 2020-06-12T17:49:34.185 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.174+0000 7f99a933a700 1 -- 172.21.15.38:0/543803387 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998c004ff0 con 0x7f99a4146680 2020-06-12T17:49:34.185 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.174+0000 7f99a9b3b700 1 --2- 172.21.15.38:0/543803387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f998c004060 0x7f998c004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:34.185 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.174+0000 7f99aa33c700 1 --2- 172.21.15.38:0/543803387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f998c003720 0x7f998c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:34.185 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.174+0000 7f99aab3d700 1 --2- 172.21.15.38:0/543803387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99a4146680 0x7f998c004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:34.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.174+0000 7f99a9b3b700 1 -- 172.21.15.38:0/543803387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99a4146680 msgr2=0x7f998c004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:34.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.174+0000 7f99a9b3b700 1 --2- 172.21.15.38:0/543803387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99a4146680 0x7f998c004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:34.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.174+0000 7f99a9b3b700 1 -- 172.21.15.38:0/543803387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f998c003720 msgr2=0x7f998c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:34.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.175+0000 7f99a9b3b700 1 --2- 172.21.15.38:0/543803387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f998c003720 0x7f998c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:34.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.175+0000 7f99a9b3b700 1 -- 172.21.15.38:0/543803387 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c003230 con 0x7f998c004060 2020-06-12T17:49:34.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.175+0000 7f99a9b3b700 1 --2- 172.21.15.38:0/543803387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f998c004060 0x7f998c004530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f99a0008c90 tx=0x7f99a00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:34.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.175+0000 7f99a9b3b700 1 --2- 172.21.15.38:0/543803387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f998c004060 0x7f998c004530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f99a0008c90 tx=0x7f99a00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:34.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.175+0000 7f99a9b3b700 1 --2- 172.21.15.38:0/543803387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f998c004060 0x7f998c004530 secure :-1 s=READY pgs=510 cs=0 l=1 rx=0x7f99a0008c90 tx=0x7f99a00081e0).ready entity=mon.0 client_cookie=850984b953ad5c7b server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:34.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.175+0000 7f99a9b3b700 1 --2- 172.21.15.38:0/543803387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f998c004060 0x7f998c004530 secure :-1 s=THROTTLE_DONE pgs=510 cs=0 l=1 rx=0x7f99a0008c90 tx=0x7f99a00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:34.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.175+0000 7f99a933a700 1 -- 172.21.15.38:0/543803387 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99a0010e50 con 0x7f998c004060 2020-06-12T17:49:34.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.175+0000 7f99a9b3b700 1 --2- 172.21.15.38:0/543803387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f998c004060 0x7f998c004530 secure :-1 s=THROTTLE_DONE pgs=510 cs=0 l=1 rx=0x7f99a0008c90 tx=0x7f99a00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:34.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.175+0000 7f99a933a700 1 -- 172.21.15.38:0/543803387 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a00112b0 con 0x7f998c004060 2020-06-12T17:49:34.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.175+0000 7f99a9b3b700 1 --2- 172.21.15.38:0/543803387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f998c004060 0x7f998c004530 secure :-1 s=THROTTLE_DONE pgs=510 cs=0 l=1 rx=0x7f99a0008c90 tx=0x7f99a00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:34.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.175+0000 7f99ac5a0700 1 -- 172.21.15.38:0/543803387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f998c004060 msgr2=0x7f998c004530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:34.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.175+0000 7f99a933a700 1 -- 172.21.15.38:0/543803387 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99a00116d0 con 0x7f998c004060 2020-06-12T17:49:34.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.175+0000 7f99ac5a0700 1 --2- 172.21.15.38:0/543803387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f998c004060 0x7f998c004530 secure :-1 s=READY pgs=510 cs=0 l=1 rx=0x7f99a0008c90 tx=0x7f99a00081e0).stop 2020-06-12T17:49:34.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.175+0000 7f99aab3d700 1 -- 172.21.15.38:0/543803387 reap_dead start 2020-06-12T17:49:34.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.175+0000 7f99ac5a0700 1 -- 172.21.15.38:0/543803387 shutdown_connections 2020-06-12T17:49:34.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.175+0000 7f99ac5a0700 1 -- 172.21.15.38:0/543803387 >> 172.21.15.38:0/543803387 conn(0x7f99a40b5a20 msgr2=0x7f99a405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:34.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.175+0000 7f99ac5a0700 1 -- 172.21.15.38:0/543803387 shutdown_connections 2020-06-12T17:49:34.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.175+0000 7f99ac5a0700 1 -- 172.21.15.38:0/543803387 wait complete. 2020-06-12T17:49:34.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.176+0000 7f99ac5a0700 1 Processor -- start 2020-06-12T17:49:34.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.176+0000 7f99ac5a0700 1 -- start start 2020-06-12T17:49:34.193 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.177+0000 7f99ac5a0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f99a40b7cb0 0x7f99a40b2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:34.193 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.177+0000 7f99ac5a0700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f99a4139490 0x7f99a412d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:34.194 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.177+0000 7f99ac5a0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a413bd50 con 0x7f99a4132240 2020-06-12T17:49:34.194 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.177+0000 7f99ac5a0700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a413bff0 con 0x7f99a4139490 2020-06-12T17:49:34.194 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.177+0000 7f99ac5a0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a40b8090 con 0x7f99a40b7cb0 2020-06-12T17:49:34.194 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.177+0000 7f99aab3d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f99a4139490 0x7f99a412d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:34.194 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.177+0000 7f99aab3d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f99a4139490 0x7f99a412d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37896/0 (socket says 172.21.15.38:37896) 2020-06-12T17:49:34.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.177+0000 7f99aa33c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f99a40b7cb0 0x7f99a40b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:34.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.177+0000 7f99aab3d700 1 -- 172.21.15.38:0/1335769532 learned_addr learned my addr 172.21.15.38:0/1335769532 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:34.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.177+0000 7f99aab3d700 1 -- 172.21.15.38:0/1335769532 >> v2:172.21.15.150:3300/0 conn(0x7f99a40b7cb0 msgr2=0x7f99a40b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:34.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.177+0000 7f99aab3d700 1 --2- 172.21.15.38:0/1335769532 >> v2:172.21.15.150:3300/0 conn(0x7f99a40b7cb0 0x7f99a40b2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:34.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.177+0000 7f99aab3d700 1 -- 172.21.15.38:0/1335769532 >> v1:172.21.15.150:6789/0 conn(0x7f99a4132240 legacy=0x7f99a40b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:34.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.177+0000 7f99aab3d700 1 -- 172.21.15.38:0/1335769532 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a413c560 con 0x7f99a4139490 2020-06-12T17:49:34.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.177+0000 7f99aab3d700 1 --2- 172.21.15.38:0/1335769532 >> v2:172.21.15.38:3300/0 conn(0x7f99a4139490 0x7f99a412d4e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f999c001930 tx=0x7f99a4146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:34.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.178+0000 7f99aab3d700 1 --2- 172.21.15.38:0/1335769532 >> v2:172.21.15.38:3300/0 conn(0x7f99a4139490 0x7f99a412d4e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f999c001930 tx=0x7f99a4146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:34.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.178+0000 7f99aab3d700 1 --2- 172.21.15.38:0/1335769532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99a4139490 0x7f99a412d4e0 secure :-1 s=READY pgs=511 cs=0 l=1 rx=0x7f999c001930 tx=0x7f99a4146220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:34.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.178+0000 7f99aab3d700 1 --2- 172.21.15.38:0/1335769532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99a4139490 0x7f99a412d4e0 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7f999c001930 tx=0x7f99a4146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:34.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.178+0000 7f99aab3d700 1 --2- 172.21.15.38:0/1335769532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99a4139490 0x7f99a412d4e0 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7f999c001930 tx=0x7f99a4146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:34.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.178+0000 7f99937fe700 1 -- 172.21.15.38:0/1335769532 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f999c0116d0 con 0x7f99a4139490 2020-06-12T17:49:34.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.178+0000 7f99aab3d700 1 --2- 172.21.15.38:0/1335769532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99a4139490 0x7f99a412d4e0 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7f999c001930 tx=0x7f99a4146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:34.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.178+0000 7f99937fe700 1 -- 172.21.15.38:0/1335769532 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999c011830 con 0x7f99a4139490 2020-06-12T17:49:34.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.178+0000 7f99ac5a0700 1 -- 172.21.15.38:0/1335769532 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a40b1ee0 con 0x7f99a4139490 2020-06-12T17:49:34.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.178+0000 7f99937fe700 1 -- 172.21.15.38:0/1335769532 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f999c011b90 con 0x7f99a4139490 2020-06-12T17:49:34.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.178+0000 7f99ac5a0700 1 -- 172.21.15.38:0/1335769532 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a412db00 con 0x7f99a4139490 2020-06-12T17:49:34.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.178+0000 7f99aab3d700 1 --2- 172.21.15.38:0/1335769532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99a4139490 0x7f99a412d4e0 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7f999c001930 tx=0x7f99a4146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:34.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.179+0000 7f99937fe700 1 -- 172.21.15.38:0/1335769532 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f999c011cf0 con 0x7f99a4139490 2020-06-12T17:49:34.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.179+0000 7f99aab3d700 1 --2- 172.21.15.38:0/1335769532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99a4139490 0x7f99a412d4e0 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7f999c001930 tx=0x7f99a4146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:34.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.179+0000 7f99ac5a0700 1 -- 172.21.15.38:0/1335769532 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a412e160 con 0x7f99a4139490 2020-06-12T17:49:34.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.179+0000 7f99937fe700 1 --2- 172.21.15.38:0/1335769532 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f998404d520 0x7f998404f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:34.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.179+0000 7f99937fe700 1 -- 172.21.15.38:0/1335769532 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f999c0606d0 con 0x7f99a4139490 2020-06-12T17:49:34.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.179+0000 7f99aa33c700 1 --2- 172.21.15.38:0/1335769532 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f998404d520 0x7f998404f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:34.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.179+0000 7f99aa33c700 1 --2- 172.21.15.38:0/1335769532 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f998404d520 0x7f998404f9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9994002f30 tx=0x7f9994007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:34.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.180+0000 7f99aa33c700 1 --2- 172.21.15.38:0/1335769532 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f998404d520 0x7f998404f9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9994002f30 tx=0x7f9994007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:34.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.180+0000 7f99aa33c700 1 --2- 172.21.15.38:0/1335769532 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f998404d520 0x7f998404f9e0 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x7f9994002f30 tx=0x7f9994007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:34.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.182+0000 7f99aab3d700 1 --2- 172.21.15.38:0/1335769532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99a4139490 0x7f99a412d4e0 secure :-1 s=THROTTLE_DONE pgs=511 cs=0 l=1 rx=0x7f999c001930 tx=0x7f99a4146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:34.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.183+0000 7f99937fe700 1 -- 172.21.15.38:0/1335769532 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f999c03bf10 con 0x7f99a4139490 2020-06-12T17:49:34.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.380+0000 7f99ac5a0700 1 -- 172.21.15.38:0/1335769532 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_224", "target": ["mon-mgr", ""]}) v1 -- 0x7f99a4056c30 con 0x7f998404d520 2020-06-12T17:49:34.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.383+0000 7f99aa33c700 1 --2- 172.21.15.38:0/1335769532 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f998404d520 0x7f998404f9e0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f9994002f30 tx=0x7f9994007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:34.387 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.383+0000 7f99937fe700 1 -- 172.21.15.38:0/1335769532 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+69 (secure 0 0 0) 0x7f99a4056c30 con 0x7f998404d520 2020-06-12T17:49:34.387 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_224/3e9174f3-121b-493f-947a-6fbc5f38fe73 2020-06-12T17:49:34.388 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.384+0000 7f99ac5a0700 1 -- 172.21.15.38:0/1335769532 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f998404d520 msgr2=0x7f998404f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:34.388 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.384+0000 7f99ac5a0700 1 --2- 172.21.15.38:0/1335769532 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f998404d520 0x7f998404f9e0 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x7f9994002f30 tx=0x7f9994007e60).stop 2020-06-12T17:49:34.389 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.384+0000 7f99ac5a0700 1 -- 172.21.15.38:0/1335769532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99a4139490 msgr2=0x7f99a412d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:34.389 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.385+0000 7f99ac5a0700 1 --2- 172.21.15.38:0/1335769532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99a4139490 0x7f99a412d4e0 secure :-1 s=READY pgs=511 cs=0 l=1 rx=0x7f999c001930 tx=0x7f99a4146220).stop 2020-06-12T17:49:34.389 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.385+0000 7f99ac5a0700 1 -- 172.21.15.38:0/1335769532 shutdown_connections 2020-06-12T17:49:34.389 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.385+0000 7f99ac5a0700 1 --2- 172.21.15.38:0/1335769532 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f998404d520 0x7f998404f9e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:34.389 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.385+0000 7f99ac5a0700 1 --2- 172.21.15.38:0/1335769532 >> v2:172.21.15.150:3300/0 conn(0x7f99a40b7cb0 0x7f99a40b2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:34.390 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.385+0000 7f99ac5a0700 1 --2- 172.21.15.38:0/1335769532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99a4139490 0x7f99a412d4e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:34.390 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.385+0000 7f99ac5a0700 1 -- 172.21.15.38:0/1335769532 >> 172.21.15.38:0/1335769532 conn(0x7f99a40b5a20 msgr2=0x7f99a40b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:34.390 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.385+0000 7f99ac5a0700 1 -- 172.21.15.38:0/1335769532 shutdown_connections 2020-06-12T17:49:34.390 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:34.385+0000 7f99ac5a0700 1 -- 172.21.15.38:0/1335769532 wait complete. 2020-06-12T17:49:34.398 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_224 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_224/3e9174f3-121b-493f-947a-6fbc5f38fe73 2020-06-12T17:49:34.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:34.399 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:34.400 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:34.414 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:34.415 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:34.416 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_224/3e9174f3-121b-493f-947a-6fbc5f38fe73/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:34.507 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:34.508 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:34.508 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117432 s, 89.3 MB/s 2020-06-12T17:49:34.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:34.509 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:34.510 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:34.524 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:34.525 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:34.526 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_224/3e9174f3-121b-493f-947a-6fbc5f38fe73/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:34.614 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:34.614 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:34.615 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125098 s, 83.8 MB/s 2020-06-12T17:49:34.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:34.616 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:34.616 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:34.631 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:34.632 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:34.632 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_224/3e9174f3-121b-493f-947a-6fbc5f38fe73/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:34.722 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:34.722 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:34.722 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129116 s, 81.2 MB/s 2020-06-12T17:49:34.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:34.724 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:34.724 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:34.739 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:34.739 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:34.740 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_224/3e9174f3-121b-493f-947a-6fbc5f38fe73/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:34.826 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:34.826 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110603 s, 94.8 MB/s 2020-06-12T17:49:34.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:34.828 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:34.828 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:34.843 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:34.844 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:34.844 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_224/3e9174f3-121b-493f-947a-6fbc5f38fe73/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:34.931 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:34.931 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:34.931 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114179 s, 91.8 MB/s 2020-06-12T17:49:34.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:34.933 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:34.933 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:34.948 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:34.948 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:34.949 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_224/3e9174f3-121b-493f-947a-6fbc5f38fe73/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:35.043 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:35.045 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:35.045 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117548 s, 89.2 MB/s 2020-06-12T17:49:35.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:35.046 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:35.047 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:35.062 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:35.062 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:35.063 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_224/3e9174f3-121b-493f-947a-6fbc5f38fe73/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:35.149 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:35.150 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:35.150 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111063 s, 94.4 MB/s 2020-06-12T17:49:35.151 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:35.151 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:35.152 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:35.166 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:35.167 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:35.168 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_224/3e9174f3-121b-493f-947a-6fbc5f38fe73/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:35.254 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:35.255 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:35.255 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104392 s, 100 MB/s 2020-06-12T17:49:35.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:35.257 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:35.257 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:35.272 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:35.273 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:35.274 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_224/3e9174f3-121b-493f-947a-6fbc5f38fe73/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:35.362 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:35.362 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:35.362 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122178 s, 85.8 MB/s 2020-06-12T17:49:35.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:35.364 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:35.364 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:35.380 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:35.380 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:35.383 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_224/3e9174f3-121b-493f-947a-6fbc5f38fe73/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:35.470 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:35.471 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:35.471 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138475 s, 75.7 MB/s 2020-06-12T17:49:35.472 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_164 2020-06-12T17:49:35.590 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.586+0000 7fa81aa7b700 1 Processor -- start 2020-06-12T17:49:35.590 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.586+0000 7fa81aa7b700 1 -- start start 2020-06-12T17:49:35.598 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.587+0000 7fa81aa7b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8140b2eb0 0x7fa81414d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:35.598 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.587+0000 7fa81aa7b700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa814146d20 con 0x7fa8140ad5b0 2020-06-12T17:49:35.598 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.587+0000 7fa81aa7b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa814066a80 con 0x7fa814146680 2020-06-12T17:49:35.599 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.587+0000 7fa81aa7b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa814146f50 con 0x7fa8140b2eb0 2020-06-12T17:49:35.599 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.587+0000 7fa813fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa8140ad5b0 0x7fa81409d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39716/0 (socket says 172.21.15.38:39716) 2020-06-12T17:49:35.599 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.587+0000 7fa813fff700 1 -- 172.21.15.38:0/1312128571 learned_addr learned my addr 172.21.15.38:0/1312128571 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:35.599 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.587+0000 7fa8137fe700 1 -- 172.21.15.38:0/1312128571 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2052264181 0 0) 0x7fa814146d20 con 0x7fa8140ad5b0 2020-06-12T17:49:35.599 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.588+0000 7fa8137fe700 1 -- 172.21.15.38:0/1312128571 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa800003230 con 0x7fa8140ad5b0 2020-06-12T17:49:35.600 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.588+0000 7fa819018700 1 --2- 172.21.15.38:0/1312128571 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8140b2eb0 0x7fa81414d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:35.600 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.588+0000 7fa8137fe700 1 -- 172.21.15.38:0/1312128571 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1631317209 0 0) 0x7fa800003230 con 0x7fa8140ad5b0 2020-06-12T17:49:35.600 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.588+0000 7fa8137fe700 1 -- 172.21.15.38:0/1312128571 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8140b2eb0 msgr2=0x7fa81414d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:35.600 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.588+0000 7fa8137fe700 1 --2- 172.21.15.38:0/1312128571 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8140b2eb0 0x7fa81414d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:35.600 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.588+0000 7fa8137fe700 1 -- 172.21.15.38:0/1312128571 >> v1:172.21.15.150:6789/0 conn(0x7fa814146680 legacy=0x7fa81409d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:35.601 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.588+0000 7fa8137fe700 1 -- 172.21.15.38:0/1312128571 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa814146a60 con 0x7fa8140ad5b0 2020-06-12T17:49:35.601 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.588+0000 7fa8137fe700 1 -- 172.21.15.38:0/1312128571 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fa8080016d0 con 0x7fa8140ad5b0 2020-06-12T17:49:35.602 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.588+0000 7fa8137fe700 1 -- 172.21.15.38:0/1312128571 >> v1:172.21.15.38:6789/0 conn(0x7fa8140ad5b0 legacy=0x7fa81409d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:35.602 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.588+0000 7fa8137fe700 1 --2- 172.21.15.38:0/1312128571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa800003750 0x7fa800003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:35.603 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.588+0000 7fa8137fe700 1 --2- 172.21.15.38:0/1312128571 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8140b2eb0 0x7fa8000044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:35.603 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.588+0000 7fa8137fe700 1 --2- 172.21.15.38:0/1312128571 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa800004930 0x7fa800004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:35.603 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.588+0000 7fa8137fe700 1 -- 172.21.15.38:0/1312128571 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa814146f50 con 0x7fa800003750 2020-06-12T17:49:35.603 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.588+0000 7fa8137fe700 1 -- 172.21.15.38:0/1312128571 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa800005330 con 0x7fa800004930 2020-06-12T17:49:35.603 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.588+0000 7fa8137fe700 1 -- 172.21.15.38:0/1312128571 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa800004150 con 0x7fa8140b2eb0 2020-06-12T17:49:35.604 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.588+0000 7fa818817700 1 --2- 172.21.15.38:0/1312128571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa800003750 0x7fa800003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:35.604 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.588+0000 7fa813fff700 1 --2- 172.21.15.38:0/1312128571 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8140b2eb0 0x7fa8000044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:35.604 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.588+0000 7fa819018700 1 --2- 172.21.15.38:0/1312128571 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa800004930 0x7fa800004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:35.604 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.588+0000 7fa818817700 1 -- 172.21.15.38:0/1312128571 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8140b2eb0 msgr2=0x7fa8000044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:35.604 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.588+0000 7fa818817700 1 --2- 172.21.15.38:0/1312128571 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8140b2eb0 0x7fa8000044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:35.605 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.588+0000 7fa818817700 1 -- 172.21.15.38:0/1312128571 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa800004930 msgr2=0x7fa800004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:35.605 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.588+0000 7fa818817700 1 --2- 172.21.15.38:0/1312128571 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa800004930 0x7fa800004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:35.605 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.588+0000 7fa818817700 1 -- 172.21.15.38:0/1312128571 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa800003230 con 0x7fa800003750 2020-06-12T17:49:35.605 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.588+0000 7fa818817700 1 --2- 172.21.15.38:0/1312128571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa800003750 0x7fa800003b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa8140aea00 tx=0x7fa804001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.605 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.588+0000 7fa818817700 1 --2- 172.21.15.38:0/1312128571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa800003750 0x7fa800003b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa8140aea00 tx=0x7fa804001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.606 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.588+0000 7fa818817700 1 --2- 172.21.15.38:0/1312128571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa800003750 0x7fa800003b70 secure :-1 s=READY pgs=513 cs=0 l=1 rx=0x7fa8140aea00 tx=0x7fa804001840).ready entity=mon.0 client_cookie=2bb08940f7449fe7 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:35.606 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.589+0000 7fa818817700 1 --2- 172.21.15.38:0/1312128571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa800003750 0x7fa800003b70 secure :-1 s=THROTTLE_DONE pgs=513 cs=0 l=1 rx=0x7fa8140aea00 tx=0x7fa804001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.606 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.589+0000 7fa8137fe700 1 -- 172.21.15.38:0/1312128571 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa804003540 con 0x7fa800003750 2020-06-12T17:49:35.606 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.589+0000 7fa818817700 1 --2- 172.21.15.38:0/1312128571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa800003750 0x7fa800003b70 secure :-1 s=THROTTLE_DONE pgs=513 cs=0 l=1 rx=0x7fa8140aea00 tx=0x7fa804001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.606 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.589+0000 7fa8137fe700 1 -- 172.21.15.38:0/1312128571 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8040036a0 con 0x7fa800003750 2020-06-12T17:49:35.607 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.589+0000 7fa818817700 1 --2- 172.21.15.38:0/1312128571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa800003750 0x7fa800003b70 secure :-1 s=THROTTLE_DONE pgs=513 cs=0 l=1 rx=0x7fa8140aea00 tx=0x7fa804001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.607 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.589+0000 7fa8137fe700 1 -- 172.21.15.38:0/1312128571 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa804003ae0 con 0x7fa800003750 2020-06-12T17:49:35.608 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.589+0000 7fa81aa7b700 1 -- 172.21.15.38:0/1312128571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa800003750 msgr2=0x7fa800003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:35.608 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.589+0000 7fa81aa7b700 1 --2- 172.21.15.38:0/1312128571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa800003750 0x7fa800003b70 secure :-1 s=READY pgs=513 cs=0 l=1 rx=0x7fa8140aea00 tx=0x7fa804001840).stop 2020-06-12T17:49:35.608 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.589+0000 7fa819018700 1 -- 172.21.15.38:0/1312128571 reap_dead start 2020-06-12T17:49:35.608 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.589+0000 7fa81aa7b700 1 -- 172.21.15.38:0/1312128571 shutdown_connections 2020-06-12T17:49:35.608 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.589+0000 7fa81aa7b700 1 -- 172.21.15.38:0/1312128571 >> 172.21.15.38:0/1312128571 conn(0x7fa8140b5a20 msgr2=0x7fa81405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.589+0000 7fa81aa7b700 1 -- 172.21.15.38:0/1312128571 shutdown_connections 2020-06-12T17:49:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.589+0000 7fa81aa7b700 1 -- 172.21.15.38:0/1312128571 wait complete. 2020-06-12T17:49:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.590+0000 7fa81aa7b700 1 Processor -- start 2020-06-12T17:49:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.590+0000 7fa81aa7b700 1 -- start start 2020-06-12T17:49:35.610 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.591+0000 7fa81aa7b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa814142be0 0x7fa81408ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:35.610 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.591+0000 7fa81aa7b700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8140b1c20 con 0x7fa814061d40 2020-06-12T17:49:35.610 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.591+0000 7fa81aa7b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8140b1e50 con 0x7fa814064210 2020-06-12T17:49:35.610 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.591+0000 7fa81aa7b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa814142fc0 con 0x7fa814142be0 2020-06-12T17:49:35.610 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.591+0000 7fa819018700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa814061d40 0x7fa814062180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39732/0 (socket says 172.21.15.38:39732) 2020-06-12T17:49:35.611 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.591+0000 7fa819018700 1 -- 172.21.15.38:0/1828186412 learned_addr learned my addr 172.21.15.38:0/1828186412 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:35.611 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.591+0000 7fa818817700 1 --2- 172.21.15.38:0/1828186412 >> v2:172.21.15.150:3300/0 conn(0x7fa814142be0 0x7fa81408ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:35.611 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.591+0000 7fa811ffb700 1 -- 172.21.15.38:0/1828186412 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2309297263 0 0) 0x7fa8140b1c20 con 0x7fa814061d40 2020-06-12T17:49:35.611 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.591+0000 7fa811ffb700 1 -- 172.21.15.38:0/1828186412 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7f4002fe0 con 0x7fa814061d40 2020-06-12T17:49:35.611 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.592+0000 7fa811ffb700 1 -- 172.21.15.38:0/1828186412 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4114251115 0 0) 0x7fa7f4002fe0 con 0x7fa814061d40 2020-06-12T17:49:35.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.592+0000 7fa818817700 1 -- 172.21.15.38:0/1828186412 >> v1:172.21.15.150:6789/0 conn(0x7fa814064210 legacy=0x7fa8141344c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:35.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.592+0000 7fa818817700 1 -- 172.21.15.38:0/1828186412 >> v1:172.21.15.38:6789/0 conn(0x7fa814061d40 legacy=0x7fa814062180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:35.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.592+0000 7fa818817700 1 -- 172.21.15.38:0/1828186412 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa814134bd0 con 0x7fa814142be0 2020-06-12T17:49:35.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.592+0000 7fa818817700 1 --2- 172.21.15.38:0/1828186412 >> v2:172.21.15.150:3300/0 conn(0x7fa814142be0 0x7fa81408ee50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa80c001970 tx=0x7fa804001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.613 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.592+0000 7fa818817700 1 --2- 172.21.15.38:0/1828186412 >> v2:172.21.15.150:3300/0 conn(0x7fa814142be0 0x7fa81408ee50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa80c001970 tx=0x7fa804001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.613 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.592+0000 7fa818817700 1 --2- 172.21.15.38:0/1828186412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa814142be0 0x7fa81408ee50 secure :-1 s=READY pgs=310 cs=0 l=1 rx=0x7fa80c001970 tx=0x7fa804001840).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:35.614 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.592+0000 7fa818817700 1 --2- 172.21.15.38:0/1828186412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa814142be0 0x7fa81408ee50 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7fa80c001970 tx=0x7fa804001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.614 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.592+0000 7fa811ffb700 1 -- 172.21.15.38:0/1828186412 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa80c001810 con 0x7fa814142be0 2020-06-12T17:49:35.614 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.592+0000 7fa818817700 1 --2- 172.21.15.38:0/1828186412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa814142be0 0x7fa81408ee50 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7fa80c001970 tx=0x7fa804001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.614 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.592+0000 7fa811ffb700 1 -- 172.21.15.38:0/1828186412 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8040066f0 con 0x7fa814142be0 2020-06-12T17:49:35.614 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.592+0000 7fa818817700 1 --2- 172.21.15.38:0/1828186412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa814142be0 0x7fa81408ee50 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7fa80c001970 tx=0x7fa804001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.592+0000 7fa811ffb700 1 -- 172.21.15.38:0/1828186412 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa804006a50 con 0x7fa814142be0 2020-06-12T17:49:35.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.592+0000 7fa81aa7b700 1 -- 172.21.15.38:0/1828186412 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa814066490 con 0x7fa814142be0 2020-06-12T17:49:35.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.592+0000 7fa81aa7b700 1 -- 172.21.15.38:0/1828186412 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa814062a50 con 0x7fa814142be0 2020-06-12T17:49:35.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.593+0000 7fa818817700 1 --2- 172.21.15.38:0/1828186412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa814142be0 0x7fa81408ee50 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7fa80c001970 tx=0x7fa804001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.593+0000 7fa81aa7b700 1 -- 172.21.15.38:0/1828186412 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa814056c30 con 0x7fa814142be0 2020-06-12T17:49:35.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.593+0000 7fa811ffb700 1 -- 172.21.15.38:0/1828186412 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fa804006c90 con 0x7fa814142be0 2020-06-12T17:49:35.616 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.593+0000 7fa818817700 1 --2- 172.21.15.38:0/1828186412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa814142be0 0x7fa81408ee50 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7fa80c001970 tx=0x7fa804001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.616 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.594+0000 7fa811ffb700 1 --2- 172.21.15.38:0/1828186412 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa7f404d830 0x7fa7f404fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:35.616 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.594+0000 7fa811ffb700 1 -- 172.21.15.38:0/1828186412 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa8040612f0 con 0x7fa814142be0 2020-06-12T17:49:35.616 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.594+0000 7fa813fff700 1 --2- 172.21.15.38:0/1828186412 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa7f404d830 0x7fa7f404fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:35.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.594+0000 7fa813fff700 1 --2- 172.21.15.38:0/1828186412 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa7f404d830 0x7fa7f404fcf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa808001e80 tx=0x7fa814146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.594+0000 7fa813fff700 1 --2- 172.21.15.38:0/1828186412 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa7f404d830 0x7fa7f404fcf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa808001e80 tx=0x7fa814146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.594+0000 7fa813fff700 1 --2- 172.21.15.38:0/1828186412 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa7f404d830 0x7fa7f404fcf0 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7fa808001e80 tx=0x7fa814146220).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:35.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.597+0000 7fa818817700 1 --2- 172.21.15.38:0/1828186412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa814142be0 0x7fa81408ee50 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7fa80c001970 tx=0x7fa804001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.597+0000 7fa811ffb700 1 -- 172.21.15.38:0/1828186412 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fa80403cb10 con 0x7fa814142be0 2020-06-12T17:49:35.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.791+0000 7fa81aa7b700 1 -- 172.21.15.38:0/1828186412 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_164", "target": ["mon-mgr", ""]}) v1 -- 0x7fa814134d60 con 0x7fa7f404d830 2020-06-12T17:49:35.812 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.808+0000 7fa813fff700 1 --2- 172.21.15.38:0/1828186412 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa7f404d830 0x7fa7f404fcf0 secure :-1 s=THROTTLE_DONE pgs=206 cs=0 l=1 rx=0x7fa808001e80 tx=0x7fa814146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.812 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.808+0000 7fa811ffb700 1 -- 172.21.15.38:0/1828186412 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa814134d60 con 0x7fa7f404d830 2020-06-12T17:49:35.814 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.810+0000 7fa81aa7b700 1 -- 172.21.15.38:0/1828186412 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa7f404d830 msgr2=0x7fa7f404fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:35.814 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.810+0000 7fa81aa7b700 1 --2- 172.21.15.38:0/1828186412 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa7f404d830 0x7fa7f404fcf0 secure :-1 s=READY pgs=206 cs=0 l=1 rx=0x7fa808001e80 tx=0x7fa814146220).stop 2020-06-12T17:49:35.815 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.810+0000 7fa81aa7b700 1 -- 172.21.15.38:0/1828186412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa814142be0 msgr2=0x7fa81408ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:35.815 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.810+0000 7fa81aa7b700 1 --2- 172.21.15.38:0/1828186412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa814142be0 0x7fa81408ee50 secure :-1 s=READY pgs=310 cs=0 l=1 rx=0x7fa80c001970 tx=0x7fa804001840).stop 2020-06-12T17:49:35.815 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.810+0000 7fa81aa7b700 1 -- 172.21.15.38:0/1828186412 shutdown_connections 2020-06-12T17:49:35.815 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.810+0000 7fa81aa7b700 1 --2- 172.21.15.38:0/1828186412 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa7f404d830 0x7fa7f404fcf0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:35.816 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.810+0000 7fa81aa7b700 1 --2- 172.21.15.38:0/1828186412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa814142be0 0x7fa81408ee50 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:35.816 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.810+0000 7fa81aa7b700 1 -- 172.21.15.38:0/1828186412 >> 172.21.15.38:0/1828186412 conn(0x7fa8140b5a20 msgr2=0x7fa81405bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:35.816 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.810+0000 7fa81aa7b700 1 -- 172.21.15.38:0/1828186412 shutdown_connections 2020-06-12T17:49:35.816 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.810+0000 7fa81aa7b700 1 -- 172.21.15.38:0/1828186412 wait complete. 2020-06-12T17:49:35.824 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_164 2020-06-12T17:49:35.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.938+0000 7f85e25ed700 1 Processor -- start 2020-06-12T17:49:35.942 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.938+0000 7f85e25ed700 1 -- start start 2020-06-12T17:49:35.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.938+0000 7f85e25ed700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f85dc09dd30 0x7f85dc066b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:35.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.938+0000 7f85e25ed700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85dc147550 con 0x7f85dc1438f0 2020-06-12T17:49:35.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.938+0000 7f85e25ed700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85dc09e110 con 0x7f85dc09b190 2020-06-12T17:49:35.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.938+0000 7f85e25ed700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85dc067380 con 0x7f85dc09dd30 2020-06-12T17:49:35.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.939+0000 7f85e0b8a700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f85dc1438f0 0x7f85dc0b3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39740/0 (socket says 172.21.15.38:39740) 2020-06-12T17:49:35.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.939+0000 7f85e0b8a700 1 -- 172.21.15.38:0/1073234181 learned_addr learned my addr 172.21.15.38:0/1073234181 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:35.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.939+0000 7f85dbfff700 1 --2- 172.21.15.38:0/1073234181 >> v2:172.21.15.150:3300/0 conn(0x7f85dc09dd30 0x7f85dc066b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:35.946 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.939+0000 7f85daffd700 1 -- 172.21.15.38:0/1073234181 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 33665836 0 0) 0x7f85dc147550 con 0x7f85dc1438f0 2020-06-12T17:49:35.946 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.939+0000 7f85daffd700 1 -- 172.21.15.38:0/1073234181 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85c8003230 con 0x7f85dc1438f0 2020-06-12T17:49:35.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.939+0000 7f85dbfff700 1 -- 172.21.15.38:0/1073234181 >> v1:172.21.15.150:6789/0 conn(0x7f85dc09b190 legacy=0x7f85dc1431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:35.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.939+0000 7f85dbfff700 1 -- 172.21.15.38:0/1073234181 >> v1:172.21.15.38:6789/0 conn(0x7f85dc1438f0 legacy=0x7f85dc0b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:35.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.939+0000 7f85dbfff700 1 -- 172.21.15.38:0/1073234181 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85dc067000 con 0x7f85dc09dd30 2020-06-12T17:49:35.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.939+0000 7f85dbfff700 1 --2- 172.21.15.38:0/1073234181 >> v2:172.21.15.150:3300/0 conn(0x7f85dc09dd30 0x7f85dc066b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f85dc0afc70 tx=0x7f85cc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.939+0000 7f85dbfff700 1 --2- 172.21.15.38:0/1073234181 >> v2:172.21.15.150:3300/0 conn(0x7f85dc09dd30 0x7f85dc066b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f85dc0afc70 tx=0x7f85cc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.939+0000 7f85dbfff700 1 --2- 172.21.15.38:0/1073234181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85dc09dd30 0x7f85dc066b20 secure :-1 s=READY pgs=312 cs=0 l=1 rx=0x7f85dc0afc70 tx=0x7f85cc007e60).ready entity=mon.1 client_cookie=c8ae4d51b3f66c65 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:35.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.939+0000 7f85dbfff700 1 --2- 172.21.15.38:0/1073234181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85dc09dd30 0x7f85dc066b20 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7f85dc0afc70 tx=0x7f85cc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.939+0000 7f85daffd700 1 -- 172.21.15.38:0/1073234181 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85cc011380 con 0x7f85dc09dd30 2020-06-12T17:49:35.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.939+0000 7f85dbfff700 1 --2- 172.21.15.38:0/1073234181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85dc09dd30 0x7f85dc066b20 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7f85dc0afc70 tx=0x7f85cc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.939+0000 7f85daffd700 1 -- 172.21.15.38:0/1073234181 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85cc0114e0 con 0x7f85dc09dd30 2020-06-12T17:49:35.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.939+0000 7f85dbfff700 1 --2- 172.21.15.38:0/1073234181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85dc09dd30 0x7f85dc066b20 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7f85dc0afc70 tx=0x7f85cc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.939+0000 7f85e25ed700 1 -- 172.21.15.38:0/1073234181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85dc09dd30 msgr2=0x7f85dc066b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:35.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.939+0000 7f85daffd700 1 -- 172.21.15.38:0/1073234181 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85cc011840 con 0x7f85dc09dd30 2020-06-12T17:49:35.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.939+0000 7f85e25ed700 1 --2- 172.21.15.38:0/1073234181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85dc09dd30 0x7f85dc066b20 secure :-1 s=READY pgs=312 cs=0 l=1 rx=0x7f85dc0afc70 tx=0x7f85cc007e60).stop 2020-06-12T17:49:35.950 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.940+0000 7f85e25ed700 1 -- 172.21.15.38:0/1073234181 shutdown_connections 2020-06-12T17:49:35.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.940+0000 7f85e25ed700 1 --2- 172.21.15.38:0/1073234181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85dc09dd30 0x7f85dc066b20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:35.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.940+0000 7f85e25ed700 1 -- 172.21.15.38:0/1073234181 >> 172.21.15.38:0/1073234181 conn(0x7f85dc0b5a20 msgr2=0x7f85dc05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:35.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.940+0000 7f85e25ed700 1 -- 172.21.15.38:0/1073234181 shutdown_connections 2020-06-12T17:49:35.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.940+0000 7f85e25ed700 1 -- 172.21.15.38:0/1073234181 wait complete. 2020-06-12T17:49:35.951 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.941+0000 7f85e25ed700 1 Processor -- start 2020-06-12T17:49:35.952 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.941+0000 7f85e25ed700 1 -- start start 2020-06-12T17:49:35.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.942+0000 7f85e25ed700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f85dc09dd30 0x7f85dc061e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:35.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.942+0000 7f85e25ed700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f85dc1438f0 0x7f85dc145530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:35.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.942+0000 7f85e25ed700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85dc062260 con 0x7f85dc09b190 2020-06-12T17:49:35.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.942+0000 7f85e25ed700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85dc0649e0 con 0x7f85dc09dd30 2020-06-12T17:49:35.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.942+0000 7f85e25ed700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85dc064c30 con 0x7f85dc1438f0 2020-06-12T17:49:35.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.942+0000 7f85dbfff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f85dc09b190 0x7f85dc0640b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39742/0 (socket says 172.21.15.38:39742) 2020-06-12T17:49:35.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.942+0000 7f85dbfff700 1 -- 172.21.15.38:0/1318591395 learned_addr learned my addr 172.21.15.38:0/1318591395 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:35.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.942+0000 7f85db7fe700 1 --2- 172.21.15.38:0/1318591395 >> v2:172.21.15.38:3300/0 conn(0x7f85dc09dd30 0x7f85dc061e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:35.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.942+0000 7f85e0b8a700 1 --2- 172.21.15.38:0/1318591395 >> v2:172.21.15.150:3300/0 conn(0x7f85dc1438f0 0x7f85dc145530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:35.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.942+0000 7f85d97fa700 1 -- 172.21.15.38:0/1318591395 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1287578632 0 0) 0x7f85dc067000 con 0x7f85dc09b190 2020-06-12T17:49:35.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.942+0000 7f85d97fa700 1 -- 172.21.15.38:0/1318591395 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85bc002fe0 con 0x7f85dc09b190 2020-06-12T17:49:35.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.942+0000 7f85db7fe700 1 -- 172.21.15.38:0/1318591395 >> v2:172.21.15.150:3300/0 conn(0x7f85dc1438f0 msgr2=0x7f85dc145530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:35.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.942+0000 7f85db7fe700 1 --2- 172.21.15.38:0/1318591395 >> v2:172.21.15.150:3300/0 conn(0x7f85dc1438f0 0x7f85dc145530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:35.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.942+0000 7f85db7fe700 1 -- 172.21.15.38:0/1318591395 >> v1:172.21.15.38:6789/0 conn(0x7f85dc09b190 legacy=0x7f85dc0640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:35.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.942+0000 7f85db7fe700 1 -- 172.21.15.38:0/1318591395 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85dc064ed0 con 0x7f85dc09dd30 2020-06-12T17:49:35.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.942+0000 7f85db7fe700 1 --2- 172.21.15.38:0/1318591395 >> v2:172.21.15.38:3300/0 conn(0x7f85dc09dd30 0x7f85dc061e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f85dc061380 tx=0x7f85d00017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.942+0000 7f85db7fe700 1 --2- 172.21.15.38:0/1318591395 >> v2:172.21.15.38:3300/0 conn(0x7f85dc09dd30 0x7f85dc061e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f85dc061380 tx=0x7f85d00017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.942+0000 7f85db7fe700 1 --2- 172.21.15.38:0/1318591395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85dc09dd30 0x7f85dc061e00 secure :-1 s=READY pgs=517 cs=0 l=1 rx=0x7f85dc061380 tx=0x7f85d00017f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:35.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.943+0000 7f85db7fe700 1 --2- 172.21.15.38:0/1318591395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85dc09dd30 0x7f85dc061e00 secure :-1 s=THROTTLE_DONE pgs=517 cs=0 l=1 rx=0x7f85dc061380 tx=0x7f85d00017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.943+0000 7f85d97fa700 1 -- 172.21.15.38:0/1318591395 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85d000cc00 con 0x7f85dc09dd30 2020-06-12T17:49:35.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.943+0000 7f85db7fe700 1 --2- 172.21.15.38:0/1318591395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85dc09dd30 0x7f85dc061e00 secure :-1 s=THROTTLE_DONE pgs=517 cs=0 l=1 rx=0x7f85dc061380 tx=0x7f85d00017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.943+0000 7f85d97fa700 1 -- 172.21.15.38:0/1318591395 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d000cda0 con 0x7f85dc09dd30 2020-06-12T17:49:35.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.943+0000 7f85db7fe700 1 --2- 172.21.15.38:0/1318591395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85dc09dd30 0x7f85dc061e00 secure :-1 s=THROTTLE_DONE pgs=517 cs=0 l=1 rx=0x7f85dc061380 tx=0x7f85d00017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.943+0000 7f85e25ed700 1 -- 172.21.15.38:0/1318591395 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85dc145990 con 0x7f85dc09dd30 2020-06-12T17:49:35.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.943+0000 7f85d97fa700 1 -- 172.21.15.38:0/1318591395 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85d0010fb0 con 0x7f85dc09dd30 2020-06-12T17:49:35.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.943+0000 7f85e25ed700 1 -- 172.21.15.38:0/1318591395 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85dc0b1600 con 0x7f85dc09dd30 2020-06-12T17:49:35.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.943+0000 7f85db7fe700 1 --2- 172.21.15.38:0/1318591395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85dc09dd30 0x7f85dc061e00 secure :-1 s=THROTTLE_DONE pgs=517 cs=0 l=1 rx=0x7f85dc061380 tx=0x7f85d00017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.944+0000 7f85e25ed700 1 -- 172.21.15.38:0/1318591395 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85dc056c30 con 0x7f85dc09dd30 2020-06-12T17:49:35.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.944+0000 7f85d97fa700 1 -- 172.21.15.38:0/1318591395 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f85d00064e0 con 0x7f85dc09dd30 2020-06-12T17:49:35.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.944+0000 7f85db7fe700 1 --2- 172.21.15.38:0/1318591395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85dc09dd30 0x7f85dc061e00 secure :-1 s=THROTTLE_DONE pgs=517 cs=0 l=1 rx=0x7f85dc061380 tx=0x7f85d00017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.944+0000 7f85d97fa700 1 --2- 172.21.15.38:0/1318591395 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f85bc04d8c0 0x7f85bc04fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:35.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.944+0000 7f85d97fa700 1 -- 172.21.15.38:0/1318591395 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f85d0060af0 con 0x7f85dc09dd30 2020-06-12T17:49:35.962 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.945+0000 7f85dbfff700 1 --2- 172.21.15.38:0/1318591395 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f85bc04d8c0 0x7f85bc04fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:35.962 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.945+0000 7f85dbfff700 1 --2- 172.21.15.38:0/1318591395 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f85bc04d8c0 0x7f85bc04fd80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f85cc0088e0 tx=0x7f85cc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.962 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.945+0000 7f85dbfff700 1 --2- 172.21.15.38:0/1318591395 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f85bc04d8c0 0x7f85bc04fd80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f85cc0088e0 tx=0x7f85cc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.962 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.945+0000 7f85dbfff700 1 --2- 172.21.15.38:0/1318591395 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f85bc04d8c0 0x7f85bc04fd80 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7f85cc0088e0 tx=0x7f85cc007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:35.963 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.948+0000 7f85db7fe700 1 --2- 172.21.15.38:0/1318591395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85dc09dd30 0x7f85dc061e00 secure :-1 s=THROTTLE_DONE pgs=517 cs=0 l=1 rx=0x7f85dc061380 tx=0x7f85d00017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:35.963 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:35.948+0000 7f85d97fa700 1 -- 172.21.15.38:0/1318591395 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f85d003c1f0 con 0x7f85dc09dd30 2020-06-12T17:49:36.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:36.141+0000 7f85e25ed700 1 -- 172.21.15.38:0/1318591395 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_164", "target": ["mon-mgr", ""]}) v1 -- 0x7f85dc0af3f0 con 0x7f85bc04d8c0 2020-06-12T17:49:36.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:36.145+0000 7f85dbfff700 1 --2- 172.21.15.38:0/1318591395 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f85bc04d8c0 0x7f85bc04fd80 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7f85cc0088e0 tx=0x7f85cc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:36.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:36.145+0000 7f85d97fa700 1 -- 172.21.15.38:0/1318591395 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+69 (secure 0 0 0) 0x7f85dc0af3f0 con 0x7f85bc04d8c0 2020-06-12T17:49:36.148 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_164/79c1059e-9295-415b-bb01-a72eb9bf0e0b 2020-06-12T17:49:36.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:36.146+0000 7f85e25ed700 1 -- 172.21.15.38:0/1318591395 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f85bc04d8c0 msgr2=0x7f85bc04fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:36.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:36.146+0000 7f85e25ed700 1 --2- 172.21.15.38:0/1318591395 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f85bc04d8c0 0x7f85bc04fd80 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7f85cc0088e0 tx=0x7f85cc007e60).stop 2020-06-12T17:49:36.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:36.146+0000 7f85e25ed700 1 -- 172.21.15.38:0/1318591395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85dc09dd30 msgr2=0x7f85dc061e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:36.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:36.146+0000 7f85e25ed700 1 --2- 172.21.15.38:0/1318591395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85dc09dd30 0x7f85dc061e00 secure :-1 s=READY pgs=517 cs=0 l=1 rx=0x7f85dc061380 tx=0x7f85d00017f0).stop 2020-06-12T17:49:36.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:36.146+0000 7f85e25ed700 1 -- 172.21.15.38:0/1318591395 shutdown_connections 2020-06-12T17:49:36.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:36.146+0000 7f85e25ed700 1 --2- 172.21.15.38:0/1318591395 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f85bc04d8c0 0x7f85bc04fd80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:36.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:36.146+0000 7f85e25ed700 1 --2- 172.21.15.38:0/1318591395 >> v2:172.21.15.150:3300/0 conn(0x7f85dc1438f0 0x7f85dc145530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:36.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:36.146+0000 7f85e25ed700 1 --2- 172.21.15.38:0/1318591395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85dc09dd30 0x7f85dc061e00 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:36.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:36.146+0000 7f85e25ed700 1 -- 172.21.15.38:0/1318591395 >> 172.21.15.38:0/1318591395 conn(0x7f85dc0b5a20 msgr2=0x7f85dc0b67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:36.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:36.146+0000 7f85e25ed700 1 -- 172.21.15.38:0/1318591395 shutdown_connections 2020-06-12T17:49:36.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:36.146+0000 7f85e25ed700 1 -- 172.21.15.38:0/1318591395 wait complete. 2020-06-12T17:49:36.160 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_164 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_164/79c1059e-9295-415b-bb01-a72eb9bf0e0b 2020-06-12T17:49:36.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:36.161 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:36.161 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:36.176 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:36.177 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:36.179 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_164/79c1059e-9295-415b-bb01-a72eb9bf0e0b/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:36.269 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:36.270 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:36.270 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109022 s, 96.2 MB/s 2020-06-12T17:49:36.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:36.272 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:36.272 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:36.289 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:36.290 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:36.291 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_164/79c1059e-9295-415b-bb01-a72eb9bf0e0b/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:36.379 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:36.379 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:36.380 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119429 s, 87.8 MB/s 2020-06-12T17:49:36.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:36.381 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:36.382 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:36.396 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:36.397 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:36.397 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_164/79c1059e-9295-415b-bb01-a72eb9bf0e0b/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:36.485 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:36.485 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:36.485 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103998 s, 101 MB/s 2020-06-12T17:49:36.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:36.487 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:36.487 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:36.502 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:36.502 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:36.503 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_164/79c1059e-9295-415b-bb01-a72eb9bf0e0b/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:36.591 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:36.592 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:36.592 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128362 s, 81.7 MB/s 2020-06-12T17:49:36.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:36.593 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:36.594 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:36.609 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:36.609 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:36.610 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_164/79c1059e-9295-415b-bb01-a72eb9bf0e0b/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:36.699 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:36.699 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:36.699 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011809 s, 88.8 MB/s 2020-06-12T17:49:36.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:36.701 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:36.701 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:36.716 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:36.716 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:36.717 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_164/79c1059e-9295-415b-bb01-a72eb9bf0e0b/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:36.802 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:36.802 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:36.803 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0098754 s, 106 MB/s 2020-06-12T17:49:36.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:36.804 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:36.805 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:36.819 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:36.820 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:36.821 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_164/79c1059e-9295-415b-bb01-a72eb9bf0e0b/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:36.908 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:36.909 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:36.909 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011895 s, 88.2 MB/s 2020-06-12T17:49:36.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:36.910 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:36.911 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:36.925 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:36.926 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:36.927 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_164/79c1059e-9295-415b-bb01-a72eb9bf0e0b/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:37.014 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:37.014 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:37.014 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966803 s, 108 MB/s 2020-06-12T17:49:37.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:37.016 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:37.016 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:37.031 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:37.032 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:37.032 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_164/79c1059e-9295-415b-bb01-a72eb9bf0e0b/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:37.121 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:37.121 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:37.122 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130166 s, 80.6 MB/s 2020-06-12T17:49:37.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:37.123 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:37.124 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:37.138 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:37.139 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:37.139 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_164/79c1059e-9295-415b-bb01-a72eb9bf0e0b/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:37.227 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:37.227 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:37.227 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119693 s, 87.6 MB/s 2020-06-12T17:49:37.228 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_8163 2020-06-12T17:49:37.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.342+0000 7fc414388700 1 Processor -- start 2020-06-12T17:49:37.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.342+0000 7fc414388700 1 -- start start 2020-06-12T17:49:37.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.343+0000 7fc414388700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc40c146680 0x7fc40c0ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:37.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.343+0000 7fc414388700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc40c09d8d0 0x7fc40c1421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:37.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.343+0000 7fc414388700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc40c146d20 con 0x7fc40c0b2eb0 2020-06-12T17:49:37.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.343+0000 7fc414388700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40c066a80 con 0x7fc40c146680 2020-06-12T17:49:37.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.343+0000 7fc414388700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c146f50 con 0x7fc40c09d8d0 2020-06-12T17:49:37.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.343+0000 7fc412124700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc40c146680 0x7fc40c0ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:37.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.343+0000 7fc412124700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc40c146680 0x7fc40c0ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37934/0 (socket says 172.21.15.38:37934) 2020-06-12T17:49:37.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.343+0000 7fc412124700 1 -- 172.21.15.38:0/250152178 learned_addr learned my addr 172.21.15.38:0/250152178 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:37.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.344+0000 7fc412925700 1 --2- 172.21.15.38:0/250152178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc40c09d8d0 0x7fc40c1421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:37.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.344+0000 7fc412124700 1 -- 172.21.15.38:0/250152178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc40c09d8d0 msgr2=0x7fc40c1421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:37.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.344+0000 7fc412124700 1 --2- 172.21.15.38:0/250152178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc40c09d8d0 0x7fc40c1421d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:37.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.344+0000 7fc412124700 1 -- 172.21.15.38:0/250152178 >> v1:172.21.15.150:6789/0 conn(0x7fc40c0b2eb0 legacy=0x7fc40c09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:37.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.344+0000 7fc412124700 1 -- 172.21.15.38:0/250152178 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40c146a60 con 0x7fc40c146680 2020-06-12T17:49:37.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.344+0000 7fc412925700 1 --2- 172.21.15.38:0/250152178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc40c09d8d0 0x7fc40c1421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:49:37.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.344+0000 7fc412124700 1 --2- 172.21.15.38:0/250152178 >> v2:172.21.15.38:3300/0 conn(0x7fc40c146680 0x7fc40c0ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc40c061380 tx=0x7fc400007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.344+0000 7fc412124700 1 --2- 172.21.15.38:0/250152178 >> v2:172.21.15.38:3300/0 conn(0x7fc40c146680 0x7fc40c0ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc40c061380 tx=0x7fc400007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.344+0000 7fc412124700 1 --2- 172.21.15.38:0/250152178 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc40c146680 0x7fc40c0ad5b0 secure :-1 s=READY pgs=518 cs=0 l=1 rx=0x7fc40c061380 tx=0x7fc400007e60).ready entity=mon.0 client_cookie=efbaeae6f23fe3d0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:37.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.344+0000 7fc412124700 1 --2- 172.21.15.38:0/250152178 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc40c146680 0x7fc40c0ad5b0 secure :-1 s=THROTTLE_DONE pgs=518 cs=0 l=1 rx=0x7fc40c061380 tx=0x7fc400007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.344+0000 7fc411122700 1 -- 172.21.15.38:0/250152178 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4000116a0 con 0x7fc40c146680 2020-06-12T17:49:37.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.344+0000 7fc412124700 1 --2- 172.21.15.38:0/250152178 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc40c146680 0x7fc40c0ad5b0 secure :-1 s=THROTTLE_DONE pgs=518 cs=0 l=1 rx=0x7fc40c061380 tx=0x7fc400007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.344+0000 7fc412124700 1 --2- 172.21.15.38:0/250152178 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc40c146680 0x7fc40c0ad5b0 secure :-1 s=THROTTLE_DONE pgs=518 cs=0 l=1 rx=0x7fc40c061380 tx=0x7fc400007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.344+0000 7fc411122700 1 -- 172.21.15.38:0/250152178 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc400011800 con 0x7fc40c146680 2020-06-12T17:49:37.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.344+0000 7fc411122700 1 -- 172.21.15.38:0/250152178 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc400011c20 con 0x7fc40c146680 2020-06-12T17:49:37.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.344+0000 7fc414388700 1 -- 172.21.15.38:0/250152178 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc40c146680 msgr2=0x7fc40c0ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:37.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.344+0000 7fc414388700 1 --2- 172.21.15.38:0/250152178 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc40c146680 0x7fc40c0ad5b0 secure :-1 s=READY pgs=518 cs=0 l=1 rx=0x7fc40c061380 tx=0x7fc400007e60).stop 2020-06-12T17:49:37.354 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.345+0000 7fc414388700 1 -- 172.21.15.38:0/250152178 shutdown_connections 2020-06-12T17:49:37.354 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.345+0000 7fc414388700 1 --2- 172.21.15.38:0/250152178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc40c09d8d0 0x7fc40c1421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:37.354 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.345+0000 7fc414388700 1 --2- 172.21.15.38:0/250152178 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc40c146680 0x7fc40c0ad5b0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:37.354 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.345+0000 7fc414388700 1 -- 172.21.15.38:0/250152178 >> 172.21.15.38:0/250152178 conn(0x7fc40c0b5a20 msgr2=0x7fc40c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:37.354 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.345+0000 7fc414388700 1 -- 172.21.15.38:0/250152178 shutdown_connections 2020-06-12T17:49:37.355 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.345+0000 7fc414388700 1 -- 172.21.15.38:0/250152178 wait complete. 2020-06-12T17:49:37.355 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.345+0000 7fc414388700 1 Processor -- start 2020-06-12T17:49:37.355 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.346+0000 7fc414388700 1 -- start start 2020-06-12T17:49:37.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.346+0000 7fc414388700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc40c146680 0x7fc40c0662c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:37.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.346+0000 7fc414388700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc40c09ab80 con 0x7fc40c09d8d0 2020-06-12T17:49:37.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.346+0000 7fc414388700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc40c09ae20 con 0x7fc40c0b2eb0 2020-06-12T17:49:37.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.346+0000 7fc414388700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40c064190 con 0x7fc40c146680 2020-06-12T17:49:37.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.346+0000 7fc412124700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc40c09d8d0 0x7fc40c0b3900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39756/0 (socket says 172.21.15.38:39756) 2020-06-12T17:49:37.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.346+0000 7fc412124700 1 -- 172.21.15.38:0/2695159416 learned_addr learned my addr 172.21.15.38:0/2695159416 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:37.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.346+0000 7fc412925700 1 --2- 172.21.15.38:0/2695159416 >> v2:172.21.15.150:3300/0 conn(0x7fc40c146680 0x7fc40c0662c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:37.361 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.346+0000 7fc3ff7fe700 1 -- 172.21.15.38:0/2695159416 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1037582951 0 0) 0x7fc40c09ab80 con 0x7fc40c09d8d0 2020-06-12T17:49:37.361 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc3ff7fe700 1 -- 172.21.15.38:0/2695159416 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3ec002fe0 con 0x7fc40c09d8d0 2020-06-12T17:49:37.361 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc3ff7fe700 1 -- 172.21.15.38:0/2695159416 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4046279761 0 0) 0x7fc3ec002fe0 con 0x7fc40c09d8d0 2020-06-12T17:49:37.361 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc3ff7fe700 1 -- 172.21.15.38:0/2695159416 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc40c09ab80 con 0x7fc40c09d8d0 2020-06-12T17:49:37.361 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc3ff7fe700 1 -- 172.21.15.38:0/2695159416 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fc400011e90 con 0x7fc40c09d8d0 2020-06-12T17:49:37.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc3ff7fe700 1 -- 172.21.15.38:0/2695159416 >> v2:172.21.15.150:3300/0 conn(0x7fc40c146680 msgr2=0x7fc40c0662c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:37.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc3ff7fe700 1 --2- 172.21.15.38:0/2695159416 >> v2:172.21.15.150:3300/0 conn(0x7fc40c146680 0x7fc40c0662c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:37.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc3ff7fe700 1 -- 172.21.15.38:0/2695159416 >> v1:172.21.15.150:6789/0 conn(0x7fc40c0b2eb0 legacy=0x7fc40c065bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:37.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc3ff7fe700 1 -- 172.21.15.38:0/2695159416 >> v1:172.21.15.38:6789/0 conn(0x7fc40c09d8d0 legacy=0x7fc40c0b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:37.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc3ff7fe700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3ec0049b0 0x7fc3ec004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:37.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc3ff7fe700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3ec003920 0x7fc3ec003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:37.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc3ff7fe700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3ec0041c0 0x7fc3ec00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:37.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc3ff7fe700 1 -- 172.21.15.38:0/2695159416 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c064190 con 0x7fc3ec0049b0 2020-06-12T17:49:37.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc3ff7fe700 1 -- 172.21.15.38:0/2695159416 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec004640 con 0x7fc3ec0041c0 2020-06-12T17:49:37.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc3ff7fe700 1 -- 172.21.15.38:0/2695159416 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec00bbb0 con 0x7fc3ec003920 2020-06-12T17:49:37.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc412925700 1 --2- 172.21.15.38:0/2695159416 >> v2:172.21.15.150:3300/0 conn(0x7fc40c146680 0x7fc40c0662c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:49:37.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc412124700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3ec0049b0 0x7fc3ec004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:37.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc411923700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3ec003920 0x7fc3ec003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:37.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc412925700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3ec0041c0 0x7fc3ec00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:37.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc412124700 1 -- 172.21.15.38:0/2695159416 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3ec003920 msgr2=0x7fc3ec003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:37.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc412124700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3ec003920 0x7fc3ec003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:37.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc412124700 1 -- 172.21.15.38:0/2695159416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3ec0041c0 msgr2=0x7fc3ec00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:37.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc412124700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3ec0041c0 0x7fc3ec00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:37.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc412124700 1 -- 172.21.15.38:0/2695159416 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40c065640 con 0x7fc3ec0049b0 2020-06-12T17:49:37.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc412925700 1 -- 172.21.15.38:0/2695159416 reap_dead start 2020-06-12T17:49:37.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc414388700 1 -- 172.21.15.38:0/2695159416 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40c0658f0 con 0x7fc3ec0049b0 2020-06-12T17:49:37.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc412124700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3ec0049b0 0x7fc3ec004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc400007880 tx=0x7fc400007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc414388700 1 -- 172.21.15.38:0/2695159416 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40c154190 con 0x7fc3ec0049b0 2020-06-12T17:49:37.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc412124700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3ec0049b0 0x7fc3ec004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc400007880 tx=0x7fc400007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.347+0000 7fc412124700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3ec0049b0 0x7fc3ec004dd0 secure :-1 s=READY pgs=520 cs=0 l=1 rx=0x7fc400007880 tx=0x7fc400007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:37.367 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.348+0000 7fc412124700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3ec0049b0 0x7fc3ec004dd0 secure :-1 s=THROTTLE_DONE pgs=520 cs=0 l=1 rx=0x7fc400007880 tx=0x7fc400007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.367 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.348+0000 7fc3ff7fe700 1 -- 172.21.15.38:0/2695159416 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4000086e0 con 0x7fc3ec0049b0 2020-06-12T17:49:37.367 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.348+0000 7fc412124700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3ec0049b0 0x7fc3ec004dd0 secure :-1 s=THROTTLE_DONE pgs=520 cs=0 l=1 rx=0x7fc400007880 tx=0x7fc400007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.367 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.348+0000 7fc3ff7fe700 1 -- 172.21.15.38:0/2695159416 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4000140a0 con 0x7fc3ec0049b0 2020-06-12T17:49:37.367 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.348+0000 7fc412124700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3ec0049b0 0x7fc3ec004dd0 secure :-1 s=THROTTLE_DONE pgs=520 cs=0 l=1 rx=0x7fc400007880 tx=0x7fc400007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.368 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.348+0000 7fc3ff7fe700 1 -- 172.21.15.38:0/2695159416 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc40000ace0 con 0x7fc3ec0049b0 2020-06-12T17:49:37.368 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.348+0000 7fc412124700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3ec0049b0 0x7fc3ec004dd0 secure :-1 s=THROTTLE_DONE pgs=520 cs=0 l=1 rx=0x7fc400007880 tx=0x7fc400007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.368 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.348+0000 7fc414388700 1 -- 172.21.15.38:0/2695159416 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e8003340 con 0x7fc3ec0049b0 2020-06-12T17:49:37.368 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.349+0000 7fc3ff7fe700 1 -- 172.21.15.38:0/2695159416 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fc4000056c0 con 0x7fc3ec0049b0 2020-06-12T17:49:37.368 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.349+0000 7fc412124700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3ec0049b0 0x7fc3ec004dd0 secure :-1 s=THROTTLE_DONE pgs=520 cs=0 l=1 rx=0x7fc400007880 tx=0x7fc400007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.368 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.349+0000 7fc3ff7fe700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc3ec0512e0 0x7fc3ec0537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:37.369 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.349+0000 7fc3ff7fe700 1 -- 172.21.15.38:0/2695159416 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc400061b20 con 0x7fc3ec0049b0 2020-06-12T17:49:37.369 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.349+0000 7fc411923700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc3ec0512e0 0x7fc3ec0537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:37.369 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.349+0000 7fc411923700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc3ec0512e0 0x7fc3ec0537a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc40c062ed0 tx=0x7fc408001a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.369 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.349+0000 7fc411923700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc3ec0512e0 0x7fc3ec0537a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc40c062ed0 tx=0x7fc408001a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.369 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.349+0000 7fc411923700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc3ec0512e0 0x7fc3ec0537a0 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7fc40c062ed0 tx=0x7fc408001a40).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:37.370 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.352+0000 7fc412124700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3ec0049b0 0x7fc3ec004dd0 secure :-1 s=THROTTLE_DONE pgs=520 cs=0 l=1 rx=0x7fc400007880 tx=0x7fc400007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.370 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.352+0000 7fc3ff7fe700 1 -- 172.21.15.38:0/2695159416 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fc40003d340 con 0x7fc3ec0049b0 2020-06-12T17:49:37.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.545+0000 7fc414388700 1 -- 172.21.15.38:0/2695159416 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_8163", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3e8002040 con 0x7fc3ec0512e0 2020-06-12T17:49:37.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.562+0000 7fc411923700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc3ec0512e0 0x7fc3ec0537a0 secure :-1 s=THROTTLE_DONE pgs=208 cs=0 l=1 rx=0x7fc40c062ed0 tx=0x7fc408001a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.562+0000 7fc3ff7fe700 1 -- 172.21.15.38:0/2695159416 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc3e8002040 con 0x7fc3ec0512e0 2020-06-12T17:49:37.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.564+0000 7fc414388700 1 -- 172.21.15.38:0/2695159416 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc3ec0512e0 msgr2=0x7fc3ec0537a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:37.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.564+0000 7fc414388700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc3ec0512e0 0x7fc3ec0537a0 secure :-1 s=READY pgs=208 cs=0 l=1 rx=0x7fc40c062ed0 tx=0x7fc408001a40).stop 2020-06-12T17:49:37.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.564+0000 7fc414388700 1 -- 172.21.15.38:0/2695159416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3ec0049b0 msgr2=0x7fc3ec004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:37.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.564+0000 7fc414388700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3ec0049b0 0x7fc3ec004dd0 secure :-1 s=READY pgs=520 cs=0 l=1 rx=0x7fc400007880 tx=0x7fc400007e60).stop 2020-06-12T17:49:37.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.564+0000 7fc414388700 1 -- 172.21.15.38:0/2695159416 shutdown_connections 2020-06-12T17:49:37.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.564+0000 7fc414388700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc3ec0512e0 0x7fc3ec0537a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:37.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.564+0000 7fc414388700 1 --2- 172.21.15.38:0/2695159416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3ec0049b0 0x7fc3ec004dd0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:37.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.564+0000 7fc414388700 1 -- 172.21.15.38:0/2695159416 >> 172.21.15.38:0/2695159416 conn(0x7fc40c0b5a20 msgr2=0x7fc40c145100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:37.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.564+0000 7fc414388700 1 -- 172.21.15.38:0/2695159416 shutdown_connections 2020-06-12T17:49:37.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.564+0000 7fc414388700 1 -- 172.21.15.38:0/2695159416 wait complete. 2020-06-12T17:49:37.577 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_8163 2020-06-12T17:49:37.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.690+0000 7fe83ee13700 1 Processor -- start 2020-06-12T17:49:37.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.690+0000 7fe83ee13700 1 -- start start 2020-06-12T17:49:37.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.691+0000 7fe83ee13700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe838146680 0x7fe8380ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:37.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.691+0000 7fe83ee13700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8380b2eb0 0x7fe83809d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:37.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.691+0000 7fe83ee13700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe838146d20 con 0x7fe83809d620 2020-06-12T17:49:37.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.691+0000 7fe83ee13700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe838066a80 con 0x7fe838146680 2020-06-12T17:49:37.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.691+0000 7fe83ee13700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe838146f50 con 0x7fe8380b2eb0 2020-06-12T17:49:37.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.691+0000 7fe83cbaf700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe838146680 0x7fe8380ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:37.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.691+0000 7fe83cbaf700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe838146680 0x7fe8380ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37954/0 (socket says 172.21.15.38:37954) 2020-06-12T17:49:37.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.691+0000 7fe83cbaf700 1 -- 172.21.15.38:0/1876639628 learned_addr learned my addr 172.21.15.38:0/1876639628 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:37.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.691+0000 7fe83cbaf700 1 -- 172.21.15.38:0/1876639628 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8380b2eb0 msgr2=0x7fe83809d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:37.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.692+0000 7fe837fff700 1 --2- 172.21.15.38:0/1876639628 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8380b2eb0 0x7fe83809d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:37.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.692+0000 7fe83cbaf700 1 --2- 172.21.15.38:0/1876639628 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8380b2eb0 0x7fe83809d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:37.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.692+0000 7fe83cbaf700 1 -- 172.21.15.38:0/1876639628 >> v1:172.21.15.150:6789/0 conn(0x7fe83809d620 legacy=0x7fe83809b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:37.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.692+0000 7fe83cbaf700 1 -- 172.21.15.38:0/1876639628 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe838146a60 con 0x7fe838146680 2020-06-12T17:49:37.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.692+0000 7fe83cbaf700 1 --2- 172.21.15.38:0/1876639628 >> v2:172.21.15.38:3300/0 conn(0x7fe838146680 0x7fe8380ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe8380ada10 tx=0x7fe828007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.692+0000 7fe83cbaf700 1 --2- 172.21.15.38:0/1876639628 >> v2:172.21.15.38:3300/0 conn(0x7fe838146680 0x7fe8380ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe8380ada10 tx=0x7fe828007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.692+0000 7fe83cbaf700 1 --2- 172.21.15.38:0/1876639628 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe838146680 0x7fe8380ad5b0 secure :-1 s=READY pgs=521 cs=0 l=1 rx=0x7fe8380ada10 tx=0x7fe828007e60).ready entity=mon.0 client_cookie=cd4d607ff0c2c814 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:37.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.692+0000 7fe83cbaf700 1 --2- 172.21.15.38:0/1876639628 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe838146680 0x7fe8380ad5b0 secure :-1 s=THROTTLE_DONE pgs=521 cs=0 l=1 rx=0x7fe8380ada10 tx=0x7fe828007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.692+0000 7fe83cbaf700 1 --2- 172.21.15.38:0/1876639628 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe838146680 0x7fe8380ad5b0 secure :-1 s=THROTTLE_DONE pgs=521 cs=0 l=1 rx=0x7fe8380ada10 tx=0x7fe828007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.692+0000 7fe83cbaf700 1 --2- 172.21.15.38:0/1876639628 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe838146680 0x7fe8380ad5b0 secure :-1 s=THROTTLE_DONE pgs=521 cs=0 l=1 rx=0x7fe8380ada10 tx=0x7fe828007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.692+0000 7fe8377fe700 1 -- 172.21.15.38:0/1876639628 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8280116a0 con 0x7fe838146680 2020-06-12T17:49:37.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.692+0000 7fe8377fe700 1 -- 172.21.15.38:0/1876639628 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe828011800 con 0x7fe838146680 2020-06-12T17:49:37.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.692+0000 7fe8377fe700 1 -- 172.21.15.38:0/1876639628 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe828011c20 con 0x7fe838146680 2020-06-12T17:49:37.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.692+0000 7fe83ee13700 1 -- 172.21.15.38:0/1876639628 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe838146680 msgr2=0x7fe8380ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:37.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.692+0000 7fe83ee13700 1 --2- 172.21.15.38:0/1876639628 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe838146680 0x7fe8380ad5b0 secure :-1 s=READY pgs=521 cs=0 l=1 rx=0x7fe8380ada10 tx=0x7fe828007e60).stop 2020-06-12T17:49:37.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.692+0000 7fe83ee13700 1 -- 172.21.15.38:0/1876639628 shutdown_connections 2020-06-12T17:49:37.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.692+0000 7fe83ee13700 1 --2- 172.21.15.38:0/1876639628 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe838146680 0x7fe8380ad5b0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:37.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.692+0000 7fe83ee13700 1 --2- 172.21.15.38:0/1876639628 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8380b2eb0 0x7fe83809d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:37.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.692+0000 7fe83ee13700 1 -- 172.21.15.38:0/1876639628 >> 172.21.15.38:0/1876639628 conn(0x7fe8380b5a20 msgr2=0x7fe83805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:37.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.692+0000 7fe83ee13700 1 -- 172.21.15.38:0/1876639628 shutdown_connections 2020-06-12T17:49:37.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.692+0000 7fe83ee13700 1 -- 172.21.15.38:0/1876639628 wait complete. 2020-06-12T17:49:37.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.693+0000 7fe83ee13700 1 Processor -- start 2020-06-12T17:49:37.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.693+0000 7fe83ee13700 1 -- start start 2020-06-12T17:49:37.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.694+0000 7fe83ee13700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe83809d620 0x7fe8380629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:37.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.694+0000 7fe83ee13700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe83813fb10 con 0x7fe8380b2eb0 2020-06-12T17:49:37.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.694+0000 7fe83ee13700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe83813fdb0 con 0x7fe838146680 2020-06-12T17:49:37.707 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.694+0000 7fe83ee13700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe83813f900 con 0x7fe83809d620 2020-06-12T17:49:37.707 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.695+0000 7fe837fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe8380b2eb0 0x7fe838140250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39776/0 (socket says 172.21.15.38:39776) 2020-06-12T17:49:37.707 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.695+0000 7fe837fff700 1 -- 172.21.15.38:0/960459397 learned_addr learned my addr 172.21.15.38:0/960459397 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:37.707 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.695+0000 7fe83cbaf700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe83809d620 0x7fe8380629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:37.708 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.695+0000 7fe83cbaf700 1 -- 172.21.15.38:0/960459397 >> v1:172.21.15.150:6789/0 conn(0x7fe838146680 legacy=0x7fe838062ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:37.708 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.695+0000 7fe83cbaf700 1 -- 172.21.15.38:0/960459397 >> v1:172.21.15.38:6789/0 conn(0x7fe8380b2eb0 legacy=0x7fe838140250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:37.708 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.695+0000 7fe835ffb700 1 -- 172.21.15.38:0/960459397 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257135646 0 0) 0x7fe83813fb10 con 0x7fe8380b2eb0 2020-06-12T17:49:37.708 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.695+0000 7fe83cbaf700 1 -- 172.21.15.38:0/960459397 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe838140960 con 0x7fe83809d620 2020-06-12T17:49:37.708 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.695+0000 7fe83cbaf700 1 --2- 172.21.15.38:0/960459397 >> v2:172.21.15.38:3300/0 conn(0x7fe83809d620 0x7fe8380629d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe8380ada10 tx=0x7fe828007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.709 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.695+0000 7fe83cbaf700 1 --2- 172.21.15.38:0/960459397 >> v2:172.21.15.38:3300/0 conn(0x7fe83809d620 0x7fe8380629d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe8380ada10 tx=0x7fe828007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.709 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.695+0000 7fe83cbaf700 1 --2- 172.21.15.38:0/960459397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe83809d620 0x7fe8380629d0 secure :-1 s=READY pgs=523 cs=0 l=1 rx=0x7fe8380ada10 tx=0x7fe828007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:37.709 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.695+0000 7fe83cbaf700 1 --2- 172.21.15.38:0/960459397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe83809d620 0x7fe8380629d0 secure :-1 s=THROTTLE_DONE pgs=523 cs=0 l=1 rx=0x7fe8380ada10 tx=0x7fe828007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.709 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.695+0000 7fe835ffb700 1 -- 172.21.15.38:0/960459397 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe828007150 con 0x7fe83809d620 2020-06-12T17:49:37.709 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.695+0000 7fe83cbaf700 1 --2- 172.21.15.38:0/960459397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe83809d620 0x7fe8380629d0 secure :-1 s=THROTTLE_DONE pgs=523 cs=0 l=1 rx=0x7fe8380ada10 tx=0x7fe828007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.710 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.695+0000 7fe835ffb700 1 -- 172.21.15.38:0/960459397 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8280072b0 con 0x7fe83809d620 2020-06-12T17:49:37.710 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.695+0000 7fe83cbaf700 1 --2- 172.21.15.38:0/960459397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe83809d620 0x7fe8380629d0 secure :-1 s=THROTTLE_DONE pgs=523 cs=0 l=1 rx=0x7fe8380ada10 tx=0x7fe828007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.710 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.695+0000 7fe83ee13700 1 -- 172.21.15.38:0/960459397 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe838065070 con 0x7fe83809d620 2020-06-12T17:49:37.710 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.695+0000 7fe835ffb700 1 -- 172.21.15.38:0/960459397 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8280056c0 con 0x7fe83809d620 2020-06-12T17:49:37.710 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.695+0000 7fe83ee13700 1 -- 172.21.15.38:0/960459397 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe838154ae0 con 0x7fe83809d620 2020-06-12T17:49:37.711 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.696+0000 7fe83cbaf700 1 --2- 172.21.15.38:0/960459397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe83809d620 0x7fe8380629d0 secure :-1 s=THROTTLE_DONE pgs=523 cs=0 l=1 rx=0x7fe8380ada10 tx=0x7fe828007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.711 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.696+0000 7fe83cbaf700 1 --2- 172.21.15.38:0/960459397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe83809d620 0x7fe8380629d0 secure :-1 s=THROTTLE_DONE pgs=523 cs=0 l=1 rx=0x7fe8380ada10 tx=0x7fe828007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.711 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.696+0000 7fe835ffb700 1 -- 172.21.15.38:0/960459397 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fe8280058c0 con 0x7fe83809d620 2020-06-12T17:49:37.711 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.696+0000 7fe83ee13700 1 -- 172.21.15.38:0/960459397 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe838056c30 con 0x7fe83809d620 2020-06-12T17:49:37.711 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.696+0000 7fe835ffb700 1 --2- 172.21.15.38:0/960459397 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe81804d450 0x7fe81804f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:37.711 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.697+0000 7fe835ffb700 1 -- 172.21.15.38:0/960459397 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe828061730 con 0x7fe83809d620 2020-06-12T17:49:37.712 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.697+0000 7fe837fff700 1 --2- 172.21.15.38:0/960459397 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe81804d450 0x7fe81804f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:37.712 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.697+0000 7fe837fff700 1 --2- 172.21.15.38:0/960459397 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe81804d450 0x7fe81804f910 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe82c002170 tx=0x7fe82c002410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.712 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.697+0000 7fe837fff700 1 --2- 172.21.15.38:0/960459397 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe81804d450 0x7fe81804f910 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe82c002170 tx=0x7fe82c002410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.712 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.697+0000 7fe837fff700 1 --2- 172.21.15.38:0/960459397 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe81804d450 0x7fe81804f910 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7fe82c002170 tx=0x7fe82c002410).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:37.712 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.700+0000 7fe83cbaf700 1 --2- 172.21.15.38:0/960459397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe83809d620 0x7fe8380629d0 secure :-1 s=THROTTLE_DONE pgs=523 cs=0 l=1 rx=0x7fe8380ada10 tx=0x7fe828007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.713 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.700+0000 7fe835ffb700 1 -- 172.21.15.38:0/960459397 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fe82803cf30 con 0x7fe83809d620 2020-06-12T17:49:37.897 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.894+0000 7fe83ee13700 1 -- 172.21.15.38:0/960459397 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_8163", "target": ["mon-mgr", ""]}) v1 -- 0x7fe83813ffb0 con 0x7fe81804d450 2020-06-12T17:49:37.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.898+0000 7fe837fff700 1 --2- 172.21.15.38:0/960459397 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe81804d450 0x7fe81804f910 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7fe82c002170 tx=0x7fe82c002410).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:37.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.898+0000 7fe835ffb700 1 -- 172.21.15.38:0/960459397 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7fe82c007300 con 0x7fe81804d450 2020-06-12T17:49:37.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.899+0000 7fe83ee13700 1 -- 172.21.15.38:0/960459397 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe81804d450 msgr2=0x7fe81804f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:37.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.899+0000 7fe83ee13700 1 --2- 172.21.15.38:0/960459397 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe81804d450 0x7fe81804f910 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7fe82c002170 tx=0x7fe82c002410).stop 2020-06-12T17:49:37.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.899+0000 7fe83ee13700 1 -- 172.21.15.38:0/960459397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe83809d620 msgr2=0x7fe8380629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:37.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.899+0000 7fe83ee13700 1 --2- 172.21.15.38:0/960459397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe83809d620 0x7fe8380629d0 secure :-1 s=READY pgs=523 cs=0 l=1 rx=0x7fe8380ada10 tx=0x7fe828007e60).stop 2020-06-12T17:49:37.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.899+0000 7fe83ee13700 1 -- 172.21.15.38:0/960459397 shutdown_connections 2020-06-12T17:49:37.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.899+0000 7fe83ee13700 1 --2- 172.21.15.38:0/960459397 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe81804d450 0x7fe81804f910 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:37.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.899+0000 7fe83ee13700 1 --2- 172.21.15.38:0/960459397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe83809d620 0x7fe8380629d0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:37.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.899+0000 7fe83ee13700 1 -- 172.21.15.38:0/960459397 >> 172.21.15.38:0/960459397 conn(0x7fe8380b5a20 msgr2=0x7fe8380b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:37.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.899+0000 7fe83ee13700 1 -- 172.21.15.38:0/960459397 shutdown_connections 2020-06-12T17:49:37.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:37.899+0000 7fe83ee13700 1 -- 172.21.15.38:0/960459397 wait complete. 2020-06-12T17:49:37.908 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_8163/c0ad091d-421f-401d-b3ca-ac2be35cb9f1 2020-06-12T17:49:37.912 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_8163 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_8163/c0ad091d-421f-401d-b3ca-ac2be35cb9f1 2020-06-12T17:49:37.913 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:37.913 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:37.914 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:37.928 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:37.929 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:37.930 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8163/c0ad091d-421f-401d-b3ca-ac2be35cb9f1/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:38.021 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:38.021 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:38.021 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119367 s, 87.8 MB/s 2020-06-12T17:49:38.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:38.023 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:38.023 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:38.038 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:38.039 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:38.039 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8163/c0ad091d-421f-401d-b3ca-ac2be35cb9f1/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:38.125 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:38.125 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:38.125 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00973144 s, 108 MB/s 2020-06-12T17:49:38.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:38.127 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:38.127 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:38.142 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:38.143 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:38.143 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8163/c0ad091d-421f-401d-b3ca-ac2be35cb9f1/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:38.229 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:38.230 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:38.230 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109423 s, 95.8 MB/s 2020-06-12T17:49:38.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:38.231 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:38.232 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:38.246 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:38.247 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:38.248 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8163/c0ad091d-421f-401d-b3ca-ac2be35cb9f1/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:38.336 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:38.337 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:38.337 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134856 s, 77.8 MB/s 2020-06-12T17:49:38.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:38.338 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:38.339 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:38.354 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:38.354 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:38.355 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8163/c0ad091d-421f-401d-b3ca-ac2be35cb9f1/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:38.442 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:38.442 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:38.443 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112528 s, 93.2 MB/s 2020-06-12T17:49:38.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:38.444 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:38.444 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:38.459 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:38.460 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:38.460 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8163/c0ad091d-421f-401d-b3ca-ac2be35cb9f1/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:38.551 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:38.552 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:38.552 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137531 s, 76.2 MB/s 2020-06-12T17:49:38.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:38.554 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:38.554 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:38.569 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:38.569 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:38.570 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8163/c0ad091d-421f-401d-b3ca-ac2be35cb9f1/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:38.662 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:38.662 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:38.663 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111867 s, 93.7 MB/s 2020-06-12T17:49:38.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:38.664 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:38.664 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:38.680 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:38.681 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:38.681 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8163/c0ad091d-421f-401d-b3ca-ac2be35cb9f1/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:38.767 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:38.767 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:38.768 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112025 s, 93.6 MB/s 2020-06-12T17:49:38.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:38.769 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:38.770 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:38.785 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:38.785 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:38.786 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8163/c0ad091d-421f-401d-b3ca-ac2be35cb9f1/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:38.877 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:38.877 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:38.877 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123001 s, 85.2 MB/s 2020-06-12T17:49:38.878 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:38.879 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:38.879 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:38.894 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:38.895 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:38.896 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8163/c0ad091d-421f-401d-b3ca-ac2be35cb9f1/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:38.986 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:38.987 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:38.987 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121018 s, 86.6 MB/s 2020-06-12T17:49:38.988 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_88 2020-06-12T17:49:39.105 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.102+0000 7fe52c1c8700 1 Processor -- start 2020-06-12T17:49:39.106 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.102+0000 7fe52c1c8700 1 -- start start 2020-06-12T17:49:39.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe52c1c8700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe5240b3ac0 0x7fe52409df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:39.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe52c1c8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe524142e90 0x7fe52413bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:39.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe52c1c8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe52413c3a0 0x7fe5240b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:39.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe52c1c8700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52409b960 con 0x7fe5240b3ac0 2020-06-12T17:49:39.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe52c1c8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52409bc00 con 0x7fe524142e90 2020-06-12T17:49:39.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe52c1c8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5240b48f0 con 0x7fe52413c3a0 2020-06-12T17:49:39.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe529f64700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe5240b3ac0 0x7fe52409df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:39.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe529f64700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe5240b3ac0 0x7fe52409df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37968/0 (socket says 172.21.15.38:37968) 2020-06-12T17:49:39.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe529f64700 1 -- 172.21.15.38:0/3513122766 learned_addr learned my addr 172.21.15.38:0/3513122766 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:39.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe529763700 1 --2- 172.21.15.38:0/3513122766 >> v2:172.21.15.150:3300/0 conn(0x7fe524142e90 0x7fe52413bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:39.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe529f64700 1 -- 172.21.15.38:0/3513122766 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe52413c3a0 msgr2=0x7fe5240b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:39.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe529f64700 1 --2- 172.21.15.38:0/3513122766 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe52413c3a0 0x7fe5240b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:39.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe529f64700 1 -- 172.21.15.38:0/3513122766 >> v2:172.21.15.150:3300/0 conn(0x7fe524142e90 msgr2=0x7fe52413bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:39.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe529f64700 1 --2- 172.21.15.38:0/3513122766 >> v2:172.21.15.150:3300/0 conn(0x7fe524142e90 0x7fe52413bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:39.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe529f64700 1 -- 172.21.15.38:0/3513122766 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5240b3ea0 con 0x7fe5240b3ac0 2020-06-12T17:49:39.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe529763700 1 --2- 172.21.15.38:0/3513122766 >> v2:172.21.15.150:3300/0 conn(0x7fe524142e90 0x7fe52413bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:49:39.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe529f64700 1 --2- 172.21.15.38:0/3513122766 >> v2:172.21.15.38:3300/0 conn(0x7fe5240b3ac0 0x7fe52409df00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe5241433b0 tx=0x7fe51c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe529f64700 1 --2- 172.21.15.38:0/3513122766 >> v2:172.21.15.38:3300/0 conn(0x7fe5240b3ac0 0x7fe52409df00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe5241433b0 tx=0x7fe51c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe529f64700 1 --2- 172.21.15.38:0/3513122766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5240b3ac0 0x7fe52409df00 secure :-1 s=READY pgs=524 cs=0 l=1 rx=0x7fe5241433b0 tx=0x7fe51c0081e0).ready entity=mon.0 client_cookie=cb9b3406467f7d12 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:39.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe529f64700 1 --2- 172.21.15.38:0/3513122766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5240b3ac0 0x7fe52409df00 secure :-1 s=THROTTLE_DONE pgs=524 cs=0 l=1 rx=0x7fe5241433b0 tx=0x7fe51c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe528f62700 1 -- 172.21.15.38:0/3513122766 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe51c00a160 con 0x7fe5240b3ac0 2020-06-12T17:49:39.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe529f64700 1 --2- 172.21.15.38:0/3513122766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5240b3ac0 0x7fe52409df00 secure :-1 s=THROTTLE_DONE pgs=524 cs=0 l=1 rx=0x7fe5241433b0 tx=0x7fe51c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe529f64700 1 --2- 172.21.15.38:0/3513122766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5240b3ac0 0x7fe52409df00 secure :-1 s=THROTTLE_DONE pgs=524 cs=0 l=1 rx=0x7fe5241433b0 tx=0x7fe51c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe528f62700 1 -- 172.21.15.38:0/3513122766 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51c00a2c0 con 0x7fe5240b3ac0 2020-06-12T17:49:39.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe528f62700 1 -- 172.21.15.38:0/3513122766 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe51c00a660 con 0x7fe5240b3ac0 2020-06-12T17:49:39.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe52c1c8700 1 -- 172.21.15.38:0/3513122766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5240b3ac0 msgr2=0x7fe52409df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:39.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.103+0000 7fe52c1c8700 1 --2- 172.21.15.38:0/3513122766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5240b3ac0 0x7fe52409df00 secure :-1 s=READY pgs=524 cs=0 l=1 rx=0x7fe5241433b0 tx=0x7fe51c0081e0).stop 2020-06-12T17:49:39.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.104+0000 7fe52c1c8700 1 -- 172.21.15.38:0/3513122766 shutdown_connections 2020-06-12T17:49:39.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.104+0000 7fe52c1c8700 1 --2- 172.21.15.38:0/3513122766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5240b3ac0 0x7fe52409df00 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:39.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.104+0000 7fe52c1c8700 1 --2- 172.21.15.38:0/3513122766 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe52413c3a0 0x7fe5240b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:39.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.104+0000 7fe52c1c8700 1 --2- 172.21.15.38:0/3513122766 >> v2:172.21.15.150:3300/0 conn(0x7fe524142e90 0x7fe52413bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:39.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.104+0000 7fe52c1c8700 1 -- 172.21.15.38:0/3513122766 >> 172.21.15.38:0/3513122766 conn(0x7fe5240b5a20 msgr2=0x7fe52405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:39.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.104+0000 7fe52c1c8700 1 -- 172.21.15.38:0/3513122766 shutdown_connections 2020-06-12T17:49:39.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.104+0000 7fe52c1c8700 1 -- 172.21.15.38:0/3513122766 wait complete. 2020-06-12T17:49:39.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.105+0000 7fe52c1c8700 1 Processor -- start 2020-06-12T17:49:39.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.105+0000 7fe52c1c8700 1 -- start start 2020-06-12T17:49:39.119 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe52c1c8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5240b3ac0 0x7fe524061c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:39.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe52c1c8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe52413c3a0 0x7fe52413f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:39.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe52c1c8700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe524142e90 0x7fe524156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:39.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe52c1c8700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52413fe50 con 0x7fe524142e90 2020-06-12T17:49:39.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe52c1c8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52413f580 con 0x7fe52413c3a0 2020-06-12T17:49:39.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe52c1c8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe524157590 con 0x7fe5240b3ac0 2020-06-12T17:49:39.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe52a765700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe524142e90 0x7fe524156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:39.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe52a765700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe524142e90 0x7fe524156e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37978/0 (socket says 172.21.15.38:37978) 2020-06-12T17:49:39.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe52a765700 1 -- 172.21.15.38:0/2153766499 learned_addr learned my addr 172.21.15.38:0/2153766499 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:39.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe529f64700 1 --2- 172.21.15.38:0/2153766499 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5240b3ac0 0x7fe524061c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:39.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe529763700 1 --2- 172.21.15.38:0/2153766499 >> v2:172.21.15.150:3300/0 conn(0x7fe52413c3a0 0x7fe52413f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:39.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe52a765700 1 -- 172.21.15.38:0/2153766499 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5240b3ac0 msgr2=0x7fe524061c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:39.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe52a765700 1 --2- 172.21.15.38:0/2153766499 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5240b3ac0 0x7fe524061c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:39.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe52a765700 1 -- 172.21.15.38:0/2153766499 >> v2:172.21.15.150:3300/0 conn(0x7fe52413c3a0 msgr2=0x7fe52413f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:39.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe52a765700 1 --2- 172.21.15.38:0/2153766499 >> v2:172.21.15.150:3300/0 conn(0x7fe52413c3a0 0x7fe52413f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:39.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe52a765700 1 -- 172.21.15.38:0/2153766499 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe524157830 con 0x7fe524142e90 2020-06-12T17:49:39.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe52a765700 1 --2- 172.21.15.38:0/2153766499 >> v2:172.21.15.38:3300/0 conn(0x7fe524142e90 0x7fe524156e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe514002f30 tx=0x7fe514007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe52a765700 1 --2- 172.21.15.38:0/2153766499 >> v2:172.21.15.38:3300/0 conn(0x7fe524142e90 0x7fe524156e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe514002f30 tx=0x7fe514007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe52a765700 1 --2- 172.21.15.38:0/2153766499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe524142e90 0x7fe524156e10 secure :-1 s=READY pgs=525 cs=0 l=1 rx=0x7fe514002f30 tx=0x7fe514007d50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:39.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe52a765700 1 --2- 172.21.15.38:0/2153766499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe524142e90 0x7fe524156e10 secure :-1 s=THROTTLE_DONE pgs=525 cs=0 l=1 rx=0x7fe514002f30 tx=0x7fe514007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe52a765700 1 --2- 172.21.15.38:0/2153766499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe524142e90 0x7fe524156e10 secure :-1 s=THROTTLE_DONE pgs=525 cs=0 l=1 rx=0x7fe514002f30 tx=0x7fe514007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe522ffd700 1 -- 172.21.15.38:0/2153766499 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe514011ea0 con 0x7fe524142e90 2020-06-12T17:49:39.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe52a765700 1 --2- 172.21.15.38:0/2153766499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe524142e90 0x7fe524156e10 secure :-1 s=THROTTLE_DONE pgs=525 cs=0 l=1 rx=0x7fe514002f30 tx=0x7fe514007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe522ffd700 1 -- 172.21.15.38:0/2153766499 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe514007540 con 0x7fe524142e90 2020-06-12T17:49:39.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe522ffd700 1 -- 172.21.15.38:0/2153766499 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe514005b50 con 0x7fe524142e90 2020-06-12T17:49:39.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe52c1c8700 1 -- 172.21.15.38:0/2153766499 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5240623b0 con 0x7fe524142e90 2020-06-12T17:49:39.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.106+0000 7fe52c1c8700 1 -- 172.21.15.38:0/2153766499 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52413e640 con 0x7fe524142e90 2020-06-12T17:49:39.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.107+0000 7fe52a765700 1 --2- 172.21.15.38:0/2153766499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe524142e90 0x7fe524156e10 secure :-1 s=THROTTLE_DONE pgs=525 cs=0 l=1 rx=0x7fe514002f30 tx=0x7fe514007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.107+0000 7fe522ffd700 1 -- 172.21.15.38:0/2153766499 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fe5140088f0 con 0x7fe524142e90 2020-06-12T17:49:39.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.107+0000 7fe52a765700 1 --2- 172.21.15.38:0/2153766499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe524142e90 0x7fe524156e10 secure :-1 s=THROTTLE_DONE pgs=525 cs=0 l=1 rx=0x7fe514002f30 tx=0x7fe514007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.108+0000 7fe52c1c8700 1 -- 172.21.15.38:0/2153766499 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe524056c30 con 0x7fe524142e90 2020-06-12T17:49:39.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.108+0000 7fe522ffd700 1 --2- 172.21.15.38:0/2153766499 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe50404d650 0x7fe50404fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:39.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.108+0000 7fe522ffd700 1 -- 172.21.15.38:0/2153766499 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe5140609a0 con 0x7fe524142e90 2020-06-12T17:49:39.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.108+0000 7fe529f64700 1 --2- 172.21.15.38:0/2153766499 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe50404d650 0x7fe50404fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:39.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.108+0000 7fe529f64700 1 --2- 172.21.15.38:0/2153766499 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe50404d650 0x7fe50404fb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe5241433b0 tx=0x7fe51c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.108+0000 7fe529f64700 1 --2- 172.21.15.38:0/2153766499 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe50404d650 0x7fe50404fb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe5241433b0 tx=0x7fe51c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.108+0000 7fe529f64700 1 --2- 172.21.15.38:0/2153766499 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe50404d650 0x7fe50404fb10 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7fe5241433b0 tx=0x7fe51c0081e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:39.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.111+0000 7fe52a765700 1 --2- 172.21.15.38:0/2153766499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe524142e90 0x7fe524156e10 secure :-1 s=THROTTLE_DONE pgs=525 cs=0 l=1 rx=0x7fe514002f30 tx=0x7fe514007d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.111+0000 7fe522ffd700 1 -- 172.21.15.38:0/2153766499 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fe51403c120 con 0x7fe524142e90 2020-06-12T17:49:39.311 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.308+0000 7fe52c1c8700 1 -- 172.21.15.38:0/2153766499 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_88", "target": ["mon-mgr", ""]}) v1 -- 0x7fe52405a5e0 con 0x7fe50404d650 2020-06-12T17:49:39.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.328+0000 7fe529f64700 1 --2- 172.21.15.38:0/2153766499 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe50404d650 0x7fe50404fb10 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7fe5241433b0 tx=0x7fe51c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.328+0000 7fe522ffd700 1 -- 172.21.15.38:0/2153766499 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe52405a5e0 con 0x7fe50404d650 2020-06-12T17:49:39.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.329+0000 7fe52c1c8700 1 -- 172.21.15.38:0/2153766499 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe50404d650 msgr2=0x7fe50404fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:39.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.329+0000 7fe52c1c8700 1 --2- 172.21.15.38:0/2153766499 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe50404d650 0x7fe50404fb10 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7fe5241433b0 tx=0x7fe51c0081e0).stop 2020-06-12T17:49:39.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.329+0000 7fe52c1c8700 1 -- 172.21.15.38:0/2153766499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe524142e90 msgr2=0x7fe524156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:39.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.329+0000 7fe52c1c8700 1 --2- 172.21.15.38:0/2153766499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe524142e90 0x7fe524156e10 secure :-1 s=READY pgs=525 cs=0 l=1 rx=0x7fe514002f30 tx=0x7fe514007d50).stop 2020-06-12T17:49:39.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.330+0000 7fe52c1c8700 1 -- 172.21.15.38:0/2153766499 shutdown_connections 2020-06-12T17:49:39.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.330+0000 7fe52c1c8700 1 --2- 172.21.15.38:0/2153766499 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe50404d650 0x7fe50404fb10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:39.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.330+0000 7fe52c1c8700 1 --2- 172.21.15.38:0/2153766499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe524142e90 0x7fe524156e10 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:39.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.330+0000 7fe52c1c8700 1 --2- 172.21.15.38:0/2153766499 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5240b3ac0 0x7fe524061c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:39.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.330+0000 7fe52c1c8700 1 --2- 172.21.15.38:0/2153766499 >> v2:172.21.15.150:3300/0 conn(0x7fe52413c3a0 0x7fe52413f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:39.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.330+0000 7fe52c1c8700 1 -- 172.21.15.38:0/2153766499 >> 172.21.15.38:0/2153766499 conn(0x7fe5240b5a20 msgr2=0x7fe5240b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:39.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.330+0000 7fe52c1c8700 1 -- 172.21.15.38:0/2153766499 shutdown_connections 2020-06-12T17:49:39.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.330+0000 7fe52c1c8700 1 -- 172.21.15.38:0/2153766499 wait complete. 2020-06-12T17:49:39.343 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_88 2020-06-12T17:49:39.461 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.457+0000 7fd8b53a1700 1 Processor -- start 2020-06-12T17:49:39.461 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.457+0000 7fd8b53a1700 1 -- start start 2020-06-12T17:49:39.464 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.458+0000 7fd8b53a1700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd8b00b11e0 0x7fd8b00b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:39.464 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.458+0000 7fd8b53a1700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b00b2900 con 0x7fd8b00b2380 2020-06-12T17:49:39.464 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.458+0000 7fd8b53a1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b00ae7d0 con 0x7fd8b00afc20 2020-06-12T17:49:39.464 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.458+0000 7fd8b53a1700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b00add30 con 0x7fd8b00b11e0 2020-06-12T17:49:39.465 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.458+0000 7fd8affff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd8b00b11e0 0x7fd8b00b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:39.465 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.458+0000 7fd8af7fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd8b00b2380 0x7fd8b00ae0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39798/0 (socket says 172.21.15.38:39798) 2020-06-12T17:49:39.465 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.458+0000 7fd8af7fe700 1 -- 172.21.15.38:0/3026481630 learned_addr learned my addr 172.21.15.38:0/3026481630 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:39.465 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.459+0000 7fd8affff700 1 -- 172.21.15.38:0/3026481630 >> v1:172.21.15.150:6789/0 conn(0x7fd8b00afc20 legacy=0x7fd8b00b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:39.465 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.459+0000 7fd8affff700 1 -- 172.21.15.38:0/3026481630 >> v1:172.21.15.38:6789/0 conn(0x7fd8b00b2380 legacy=0x7fd8b00ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:39.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.459+0000 7fd8aeffd700 1 -- 172.21.15.38:0/3026481630 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2184716794 0 0) 0x7fd8b00b2900 con 0x7fd8b00b2380 2020-06-12T17:49:39.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.459+0000 7fd8affff700 1 -- 172.21.15.38:0/3026481630 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b00b1ad0 con 0x7fd8b00b11e0 2020-06-12T17:49:39.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.459+0000 7fd8affff700 1 --2- 172.21.15.38:0/3026481630 >> v2:172.21.15.38:3300/0 conn(0x7fd8b00b11e0 0x7fd8b00b15c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd8a0002f30 tx=0x7fd8a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.459+0000 7fd8affff700 1 --2- 172.21.15.38:0/3026481630 >> v2:172.21.15.38:3300/0 conn(0x7fd8b00b11e0 0x7fd8b00b15c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd8a0002f30 tx=0x7fd8a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.459+0000 7fd8affff700 1 --2- 172.21.15.38:0/3026481630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b00b11e0 0x7fd8b00b15c0 secure :-1 s=READY pgs=527 cs=0 l=1 rx=0x7fd8a0002f30 tx=0x7fd8a0007e60).ready entity=mon.0 client_cookie=8871b0071df2ce86 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:39.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.459+0000 7fd8affff700 1 --2- 172.21.15.38:0/3026481630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b00b11e0 0x7fd8b00b15c0 secure :-1 s=THROTTLE_DONE pgs=527 cs=0 l=1 rx=0x7fd8a0002f30 tx=0x7fd8a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.459+0000 7fd8aeffd700 1 -- 172.21.15.38:0/3026481630 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8a000ae80 con 0x7fd8b00b11e0 2020-06-12T17:49:39.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.459+0000 7fd8affff700 1 --2- 172.21.15.38:0/3026481630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b00b11e0 0x7fd8b00b15c0 secure :-1 s=THROTTLE_DONE pgs=527 cs=0 l=1 rx=0x7fd8a0002f30 tx=0x7fd8a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.459+0000 7fd8aeffd700 1 -- 172.21.15.38:0/3026481630 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a0013a20 con 0x7fd8b00b11e0 2020-06-12T17:49:39.470 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.459+0000 7fd8affff700 1 --2- 172.21.15.38:0/3026481630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b00b11e0 0x7fd8b00b15c0 secure :-1 s=THROTTLE_DONE pgs=527 cs=0 l=1 rx=0x7fd8a0002f30 tx=0x7fd8a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.470 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.459+0000 7fd8aeffd700 1 -- 172.21.15.38:0/3026481630 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8a0013dc0 con 0x7fd8b00b11e0 2020-06-12T17:49:39.470 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.459+0000 7fd8b53a1700 1 -- 172.21.15.38:0/3026481630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b00b11e0 msgr2=0x7fd8b00b15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:39.470 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.459+0000 7fd8b53a1700 1 --2- 172.21.15.38:0/3026481630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b00b11e0 0x7fd8b00b15c0 secure :-1 s=READY pgs=527 cs=0 l=1 rx=0x7fd8a0002f30 tx=0x7fd8a0007e60).stop 2020-06-12T17:49:39.471 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.459+0000 7fd8b53a1700 1 -- 172.21.15.38:0/3026481630 shutdown_connections 2020-06-12T17:49:39.471 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.459+0000 7fd8b53a1700 1 --2- 172.21.15.38:0/3026481630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b00b11e0 0x7fd8b00b15c0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:39.471 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.459+0000 7fd8b53a1700 1 -- 172.21.15.38:0/3026481630 >> 172.21.15.38:0/3026481630 conn(0x7fd8b00b4cc0 msgr2=0x7fd8b00b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:39.471 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.459+0000 7fd8b53a1700 1 -- 172.21.15.38:0/3026481630 shutdown_connections 2020-06-12T17:49:39.471 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.459+0000 7fd8b53a1700 1 -- 172.21.15.38:0/3026481630 wait complete. 2020-06-12T17:49:39.472 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.460+0000 7fd8b53a1700 1 Processor -- start 2020-06-12T17:49:39.472 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.460+0000 7fd8b53a1700 1 -- start start 2020-06-12T17:49:39.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.461+0000 7fd8b53a1700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd8b00b11e0 0x7fd8b0133b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:39.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.461+0000 7fd8b53a1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8b00b2380 0x7fd8b0152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:39.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.461+0000 7fd8b53a1700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b0153910 con 0x7fd8b00afc20 2020-06-12T17:49:39.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.461+0000 7fd8b53a1700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b0152f30 con 0x7fd8b00b11e0 2020-06-12T17:49:39.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.461+0000 7fd8b53a1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b01531d0 con 0x7fd8b00b2380 2020-06-12T17:49:39.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.461+0000 7fd8af7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd8b00b11e0 0x7fd8b0133b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:39.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.461+0000 7fd8affff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd8b00afc20 0x7fd8b0133400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39804/0 (socket says 172.21.15.38:39804) 2020-06-12T17:49:39.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.461+0000 7fd8af7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd8b00b11e0 0x7fd8b0133b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37990/0 (socket says 172.21.15.38:37990) 2020-06-12T17:49:39.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.461+0000 7fd8affff700 1 -- 172.21.15.38:0/3478638779 learned_addr learned my addr 172.21.15.38:0/3478638779 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:39.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.462+0000 7fd8b4ba0700 1 --2- 172.21.15.38:0/3478638779 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8b00b2380 0x7fd8b0152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:39.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.462+0000 7fd8af7fe700 1 -- 172.21.15.38:0/3478638779 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8b00b2380 msgr2=0x7fd8b0152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:39.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.462+0000 7fd8af7fe700 1 --2- 172.21.15.38:0/3478638779 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8b00b2380 0x7fd8b0152a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:39.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.462+0000 7fd8ad7fa700 1 -- 172.21.15.38:0/3478638779 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2966340376 0 0) 0x7fd8b0153910 con 0x7fd8b00afc20 2020-06-12T17:49:39.478 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.462+0000 7fd8af7fe700 1 -- 172.21.15.38:0/3478638779 >> v1:172.21.15.38:6789/0 conn(0x7fd8b00afc20 legacy=0x7fd8b0133400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:39.478 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.462+0000 7fd8af7fe700 1 -- 172.21.15.38:0/3478638779 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b0153470 con 0x7fd8b00b11e0 2020-06-12T17:49:39.478 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.462+0000 7fd8b4ba0700 1 --2- 172.21.15.38:0/3478638779 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8b00b2380 0x7fd8b0152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:49:39.478 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.462+0000 7fd8af7fe700 1 --2- 172.21.15.38:0/3478638779 >> v2:172.21.15.38:3300/0 conn(0x7fd8b00b11e0 0x7fd8b0133b10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd8a4000b80 tx=0x7fd8a4001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.478 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.462+0000 7fd8af7fe700 1 --2- 172.21.15.38:0/3478638779 >> v2:172.21.15.38:3300/0 conn(0x7fd8b00b11e0 0x7fd8b0133b10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd8a4000b80 tx=0x7fd8a4001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.479 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.462+0000 7fd8af7fe700 1 --2- 172.21.15.38:0/3478638779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b00b11e0 0x7fd8b0133b10 secure :-1 s=READY pgs=529 cs=0 l=1 rx=0x7fd8a4000b80 tx=0x7fd8a4001680).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:39.479 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.462+0000 7fd8af7fe700 1 --2- 172.21.15.38:0/3478638779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b00b11e0 0x7fd8b0133b10 secure :-1 s=THROTTLE_DONE pgs=529 cs=0 l=1 rx=0x7fd8a4000b80 tx=0x7fd8a4001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.479 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.462+0000 7fd8ad7fa700 1 -- 172.21.15.38:0/3478638779 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8a4005ca0 con 0x7fd8b00b11e0 2020-06-12T17:49:39.479 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.462+0000 7fd8af7fe700 1 --2- 172.21.15.38:0/3478638779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b00b11e0 0x7fd8b0133b10 secure :-1 s=THROTTLE_DONE pgs=529 cs=0 l=1 rx=0x7fd8a4000b80 tx=0x7fd8a4001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.462+0000 7fd8af7fe700 1 --2- 172.21.15.38:0/3478638779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b00b11e0 0x7fd8b0133b10 secure :-1 s=THROTTLE_DONE pgs=529 cs=0 l=1 rx=0x7fd8a4000b80 tx=0x7fd8a4001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.462+0000 7fd8ad7fa700 1 -- 172.21.15.38:0/3478638779 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a4005e00 con 0x7fd8b00b11e0 2020-06-12T17:49:39.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.462+0000 7fd8ad7fa700 1 -- 172.21.15.38:0/3478638779 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8a40062b0 con 0x7fd8b00b11e0 2020-06-12T17:49:39.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.462+0000 7fd8b53a1700 1 -- 172.21.15.38:0/3478638779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b0111920 con 0x7fd8b00b11e0 2020-06-12T17:49:39.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.462+0000 7fd8b53a1700 1 -- 172.21.15.38:0/3478638779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b0111420 con 0x7fd8b00b11e0 2020-06-12T17:49:39.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.463+0000 7fd8af7fe700 1 --2- 172.21.15.38:0/3478638779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b00b11e0 0x7fd8b0133b10 secure :-1 s=THROTTLE_DONE pgs=529 cs=0 l=1 rx=0x7fd8a4000b80 tx=0x7fd8a4001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.463+0000 7fd8b53a1700 1 -- 172.21.15.38:0/3478638779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b005bbb0 con 0x7fd8b00b11e0 2020-06-12T17:49:39.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.463+0000 7fd8ad7fa700 1 -- 172.21.15.38:0/3478638779 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fd8a4006520 con 0x7fd8b00b11e0 2020-06-12T17:49:39.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.463+0000 7fd8af7fe700 1 --2- 172.21.15.38:0/3478638779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b00b11e0 0x7fd8b0133b10 secure :-1 s=THROTTLE_DONE pgs=529 cs=0 l=1 rx=0x7fd8a4000b80 tx=0x7fd8a4001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.463+0000 7fd8ad7fa700 1 --2- 172.21.15.38:0/3478638779 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd89004d460 0x7fd89004f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:39.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.463+0000 7fd8ad7fa700 1 -- 172.21.15.38:0/3478638779 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd8a4060e30 con 0x7fd8b00b11e0 2020-06-12T17:49:39.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.463+0000 7fd8affff700 1 --2- 172.21.15.38:0/3478638779 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd89004d460 0x7fd89004f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:39.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.464+0000 7fd8affff700 1 --2- 172.21.15.38:0/3478638779 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd89004d460 0x7fd89004f920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd8a00088e0 tx=0x7fd8a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.464+0000 7fd8affff700 1 --2- 172.21.15.38:0/3478638779 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd89004d460 0x7fd89004f920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd8a00088e0 tx=0x7fd8a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.464+0000 7fd8affff700 1 --2- 172.21.15.38:0/3478638779 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd89004d460 0x7fd89004f920 secure :-1 s=READY pgs=211 cs=0 l=1 rx=0x7fd8a00088e0 tx=0x7fd8a0007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:39.483 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.467+0000 7fd8af7fe700 1 --2- 172.21.15.38:0/3478638779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b00b11e0 0x7fd8b0133b10 secure :-1 s=THROTTLE_DONE pgs=529 cs=0 l=1 rx=0x7fd8a4000b80 tx=0x7fd8a4001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.483 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.467+0000 7fd8ad7fa700 1 -- 172.21.15.38:0/3478638779 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fd8a403c4f0 con 0x7fd8b00b11e0 2020-06-12T17:49:39.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.663+0000 7fd8b53a1700 1 -- 172.21.15.38:0/3478638779 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_88", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8b0153670 con 0x7fd89004d460 2020-06-12T17:49:39.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.667+0000 7fd8affff700 1 --2- 172.21.15.38:0/3478638779 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd89004d460 0x7fd89004f920 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7fd8a00088e0 tx=0x7fd8a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:39.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.667+0000 7fd8ad7fa700 1 -- 172.21.15.38:0/3478638779 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+68 (secure 0 0 0) 0x7fd8a0007880 con 0x7fd89004d460 2020-06-12T17:49:39.670 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_88/3cd12689-4bbe-4dd2-ad54-254111d6c26d 2020-06-12T17:49:39.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.667+0000 7fd8b53a1700 1 -- 172.21.15.38:0/3478638779 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd89004d460 msgr2=0x7fd89004f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:39.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.667+0000 7fd8b53a1700 1 --2- 172.21.15.38:0/3478638779 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd89004d460 0x7fd89004f920 secure :-1 s=READY pgs=211 cs=0 l=1 rx=0x7fd8a00088e0 tx=0x7fd8a0007e60).stop 2020-06-12T17:49:39.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.667+0000 7fd8b53a1700 1 -- 172.21.15.38:0/3478638779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b00b11e0 msgr2=0x7fd8b0133b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:39.673 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.667+0000 7fd8b53a1700 1 --2- 172.21.15.38:0/3478638779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b00b11e0 0x7fd8b0133b10 secure :-1 s=READY pgs=529 cs=0 l=1 rx=0x7fd8a4000b80 tx=0x7fd8a4001680).stop 2020-06-12T17:49:39.673 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.667+0000 7fd8b53a1700 1 -- 172.21.15.38:0/3478638779 shutdown_connections 2020-06-12T17:49:39.673 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.667+0000 7fd8b53a1700 1 --2- 172.21.15.38:0/3478638779 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd89004d460 0x7fd89004f920 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:39.673 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.667+0000 7fd8b53a1700 1 --2- 172.21.15.38:0/3478638779 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8b00b2380 0x7fd8b0152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:39.674 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.667+0000 7fd8b53a1700 1 --2- 172.21.15.38:0/3478638779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b00b11e0 0x7fd8b0133b10 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:39.674 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.667+0000 7fd8b53a1700 1 -- 172.21.15.38:0/3478638779 >> 172.21.15.38:0/3478638779 conn(0x7fd8b00b4cc0 msgr2=0x7fd8b00b3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:39.674 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.668+0000 7fd8b53a1700 1 -- 172.21.15.38:0/3478638779 shutdown_connections 2020-06-12T17:49:39.674 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:39.668+0000 7fd8b53a1700 1 -- 172.21.15.38:0/3478638779 wait complete. 2020-06-12T17:49:39.681 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_88 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_88/3cd12689-4bbe-4dd2-ad54-254111d6c26d 2020-06-12T17:49:39.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:39.682 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:39.682 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:39.697 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:39.698 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:39.698 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_88/3cd12689-4bbe-4dd2-ad54-254111d6c26d/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:39.790 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:39.790 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:39.791 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116277 s, 90.2 MB/s 2020-06-12T17:49:39.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:39.792 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:39.793 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:39.807 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:39.808 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:39.808 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_88/3cd12689-4bbe-4dd2-ad54-254111d6c26d/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:39.896 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:39.896 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:39.896 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011998 s, 87.4 MB/s 2020-06-12T17:49:39.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:39.898 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:39.899 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:39.913 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:39.914 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:39.915 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_88/3cd12689-4bbe-4dd2-ad54-254111d6c26d/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:40.004 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:40.005 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:40.005 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120599 s, 86.9 MB/s 2020-06-12T17:49:40.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:40.007 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:40.007 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:40.028 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:40.029 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:40.029 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_88/3cd12689-4bbe-4dd2-ad54-254111d6c26d/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:40.116 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:40.117 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:40.117 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965692 s, 109 MB/s 2020-06-12T17:49:40.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:40.119 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:40.119 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:40.134 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:40.134 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:40.135 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_88/3cd12689-4bbe-4dd2-ad54-254111d6c26d/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:40.222 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:40.223 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:40.223 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118938 s, 88.2 MB/s 2020-06-12T17:49:40.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:40.224 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:40.225 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:40.239 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:40.240 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:40.241 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_88/3cd12689-4bbe-4dd2-ad54-254111d6c26d/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:40.328 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:40.329 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:40.329 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107814 s, 97.3 MB/s 2020-06-12T17:49:40.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:40.331 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:40.331 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:40.346 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:40.347 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:40.348 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_88/3cd12689-4bbe-4dd2-ad54-254111d6c26d/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:40.435 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:40.435 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:40.435 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976423 s, 107 MB/s 2020-06-12T17:49:40.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:40.437 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:40.437 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:40.452 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:40.453 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:40.453 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_88/3cd12689-4bbe-4dd2-ad54-254111d6c26d/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:40.541 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:40.541 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:40.542 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010852 s, 96.6 MB/s 2020-06-12T17:49:40.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:40.543 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:40.544 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:40.561 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:40.562 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:40.563 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_88/3cd12689-4bbe-4dd2-ad54-254111d6c26d/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:40.652 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:40.653 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:40.653 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135381 s, 77.5 MB/s 2020-06-12T17:49:40.654 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:40.655 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:40.655 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:40.670 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:40.677 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:40.677 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_88/3cd12689-4bbe-4dd2-ad54-254111d6c26d/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:40.765 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:40.766 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:40.766 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111092 s, 94.4 MB/s 2020-06-12T17:49:40.767 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_3521 2020-06-12T17:49:40.885 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.882+0000 7f06ffac0700 1 Processor -- start 2020-06-12T17:49:40.885 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.882+0000 7f06ffac0700 1 -- start start 2020-06-12T17:49:40.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.882+0000 7f06ffac0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f06f80b3ac0 0x7f06f809df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:40.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.882+0000 7f06ffac0700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f06f813c650 0x7f06f8066790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:40.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.882+0000 7f06ffac0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f809b960 con 0x7f06f8142e90 2020-06-12T17:49:40.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.882+0000 7f06ffac0700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f809bc00 con 0x7f06f813c650 2020-06-12T17:49:40.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.882+0000 7f06ffac0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f80b48f0 con 0x7f06f80b3ac0 2020-06-12T17:49:40.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.883+0000 7f06fe05d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f06f813c650 0x7f06f8066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:40.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.883+0000 7f06fe05d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f06f813c650 0x7f06f8066790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37996/0 (socket says 172.21.15.38:37996) 2020-06-12T17:49:40.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.883+0000 7f06fe05d700 1 -- 172.21.15.38:0/3692837045 learned_addr learned my addr 172.21.15.38:0/3692837045 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:40.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.883+0000 7f06fd85c700 1 --2- 172.21.15.38:0/3692837045 >> v2:172.21.15.150:3300/0 conn(0x7f06f80b3ac0 0x7f06f809df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:40.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.883+0000 7f06fe05d700 1 -- 172.21.15.38:0/3692837045 >> v2:172.21.15.150:3300/0 conn(0x7f06f80b3ac0 msgr2=0x7f06f809df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:40.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.883+0000 7f06fe05d700 1 --2- 172.21.15.38:0/3692837045 >> v2:172.21.15.150:3300/0 conn(0x7f06f80b3ac0 0x7f06f809df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:40.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.883+0000 7f06fe05d700 1 -- 172.21.15.38:0/3692837045 >> v1:172.21.15.150:6789/0 conn(0x7f06f8142e90 legacy=0x7f06f813bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:40.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.883+0000 7f06fe05d700 1 -- 172.21.15.38:0/3692837045 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f80b3ea0 con 0x7f06f813c650 2020-06-12T17:49:40.891 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.883+0000 7f06fe05d700 1 --2- 172.21.15.38:0/3692837045 >> v2:172.21.15.38:3300/0 conn(0x7f06f813c650 0x7f06f8066790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f06f8061380 tx=0x7f06f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:40.891 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.883+0000 7f06fe05d700 1 --2- 172.21.15.38:0/3692837045 >> v2:172.21.15.38:3300/0 conn(0x7f06f813c650 0x7f06f8066790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f06f8061380 tx=0x7f06f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:40.891 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.883+0000 7f06fe05d700 1 --2- 172.21.15.38:0/3692837045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06f813c650 0x7f06f8066790 secure :-1 s=READY pgs=530 cs=0 l=1 rx=0x7f06f8061380 tx=0x7f06f0007e60).ready entity=mon.0 client_cookie=5e81ecdc4dc4b4c7 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:40.891 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.883+0000 7f06fe05d700 1 --2- 172.21.15.38:0/3692837045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06f813c650 0x7f06f8066790 secure :-1 s=THROTTLE_DONE pgs=530 cs=0 l=1 rx=0x7f06f8061380 tx=0x7f06f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:40.891 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.883+0000 7f06fc85a700 1 -- 172.21.15.38:0/3692837045 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06f00116a0 con 0x7f06f813c650 2020-06-12T17:49:40.892 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.883+0000 7f06fe05d700 1 --2- 172.21.15.38:0/3692837045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06f813c650 0x7f06f8066790 secure :-1 s=THROTTLE_DONE pgs=530 cs=0 l=1 rx=0x7f06f8061380 tx=0x7f06f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:40.892 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.883+0000 7f06fe05d700 1 --2- 172.21.15.38:0/3692837045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06f813c650 0x7f06f8066790 secure :-1 s=THROTTLE_DONE pgs=530 cs=0 l=1 rx=0x7f06f8061380 tx=0x7f06f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:40.892 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.883+0000 7f06fc85a700 1 -- 172.21.15.38:0/3692837045 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f0011800 con 0x7f06f813c650 2020-06-12T17:49:40.892 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.883+0000 7f06fc85a700 1 -- 172.21.15.38:0/3692837045 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06f0011be0 con 0x7f06f813c650 2020-06-12T17:49:40.892 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.883+0000 7f06ffac0700 1 -- 172.21.15.38:0/3692837045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06f813c650 msgr2=0x7f06f8066790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:40.893 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.883+0000 7f06ffac0700 1 --2- 172.21.15.38:0/3692837045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06f813c650 0x7f06f8066790 secure :-1 s=READY pgs=530 cs=0 l=1 rx=0x7f06f8061380 tx=0x7f06f0007e60).stop 2020-06-12T17:49:40.893 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.884+0000 7f06ffac0700 1 -- 172.21.15.38:0/3692837045 shutdown_connections 2020-06-12T17:49:40.893 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.884+0000 7f06ffac0700 1 --2- 172.21.15.38:0/3692837045 >> v2:172.21.15.150:3300/0 conn(0x7f06f80b3ac0 0x7f06f809df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:40.893 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.884+0000 7f06ffac0700 1 --2- 172.21.15.38:0/3692837045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06f813c650 0x7f06f8066790 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:40.893 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.884+0000 7f06ffac0700 1 -- 172.21.15.38:0/3692837045 >> 172.21.15.38:0/3692837045 conn(0x7f06f80b5a20 msgr2=0x7f06f805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:40.894 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.884+0000 7f06ffac0700 1 -- 172.21.15.38:0/3692837045 shutdown_connections 2020-06-12T17:49:40.894 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.884+0000 7f06ffac0700 1 -- 172.21.15.38:0/3692837045 wait complete. 2020-06-12T17:49:40.894 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.885+0000 7f06ffac0700 1 Processor -- start 2020-06-12T17:49:40.894 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.885+0000 7f06ffac0700 1 -- start start 2020-06-12T17:49:40.897 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.885+0000 7f06ffac0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06f80b3ac0 0x7f06f813ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:40.897 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.885+0000 7f06ffac0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f06f813c650 0x7f06f813bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:40.898 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.885+0000 7f06ffac0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f813f550 con 0x7f06f8142e90 2020-06-12T17:49:40.898 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.885+0000 7f06ffac0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f813f7f0 con 0x7f06f813c650 2020-06-12T17:49:40.898 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.885+0000 7f06ffac0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f813f280 con 0x7f06f80b3ac0 2020-06-12T17:49:40.898 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.886+0000 7f06fd05b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f06f813c650 0x7f06f813bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:40.898 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.886+0000 7f06fd85c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06f80b3ac0 0x7f06f813ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:40.899 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.886+0000 7f06fd05b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f06f813c650 0x7f06f813bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:47478/0 (socket says 172.21.15.38:47478) 2020-06-12T17:49:40.899 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.886+0000 7f06fe05d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f06f8142e90 0x7f06f8156e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:60552/0 (socket says 172.21.15.38:60552) 2020-06-12T17:49:40.899 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.886+0000 7f06fd05b700 1 -- 172.21.15.38:0/4009136329 learned_addr learned my addr 172.21.15.38:0/4009136329 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:40.899 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.886+0000 7f06fd05b700 1 -- 172.21.15.38:0/4009136329 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06f80b3ac0 msgr2=0x7f06f813ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:40.899 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.886+0000 7f06fd05b700 1 --2- 172.21.15.38:0/4009136329 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06f80b3ac0 0x7f06f813ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:40.900 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.886+0000 7f06fd05b700 1 -- 172.21.15.38:0/4009136329 >> v1:172.21.15.150:6789/0 conn(0x7f06f8142e90 legacy=0x7f06f8156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:40.900 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.886+0000 7f06fd05b700 1 -- 172.21.15.38:0/4009136329 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f80b2140 con 0x7f06f813c650 2020-06-12T17:49:40.901 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.886+0000 7f06e6ffd700 1 -- 172.21.15.38:0/4009136329 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 286140366 0 0) 0x7f06f813f550 con 0x7f06f8142e90 2020-06-12T17:49:40.901 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.886+0000 7f06fd05b700 1 --2- 172.21.15.38:0/4009136329 >> v2:172.21.15.150:3300/0 conn(0x7f06f813c650 0x7f06f813bcf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f06f40032c0 tx=0x7f06f4008110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:40.902 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.886+0000 7f06fd05b700 1 --2- 172.21.15.38:0/4009136329 >> v2:172.21.15.150:3300/0 conn(0x7f06f813c650 0x7f06f813bcf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f06f40032c0 tx=0x7f06f4008110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:40.902 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.886+0000 7f06fd05b700 1 --2- 172.21.15.38:0/4009136329 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f813c650 0x7f06f813bcf0 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7f06f40032c0 tx=0x7f06f4008110).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:40.902 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.886+0000 7f06fd05b700 1 --2- 172.21.15.38:0/4009136329 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f813c650 0x7f06f813bcf0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f06f40032c0 tx=0x7f06f4008110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:40.902 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.886+0000 7f06e6ffd700 1 -- 172.21.15.38:0/4009136329 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06f4005e80 con 0x7f06f813c650 2020-06-12T17:49:40.902 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.886+0000 7f06fd05b700 1 --2- 172.21.15.38:0/4009136329 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f813c650 0x7f06f813bcf0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f06f40032c0 tx=0x7f06f4008110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:40.903 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.886+0000 7f06e6ffd700 1 -- 172.21.15.38:0/4009136329 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f4007350 con 0x7f06f813c650 2020-06-12T17:49:40.903 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.886+0000 7f06ffac0700 1 -- 172.21.15.38:0/4009136329 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f80b23b0 con 0x7f06f813c650 2020-06-12T17:49:40.903 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.886+0000 7f06fd05b700 1 --2- 172.21.15.38:0/4009136329 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f813c650 0x7f06f813bcf0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f06f40032c0 tx=0x7f06f4008110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:40.903 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.886+0000 7f06e6ffd700 1 -- 172.21.15.38:0/4009136329 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06f40076f0 con 0x7f06f813c650 2020-06-12T17:49:40.903 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.886+0000 7f06ffac0700 1 -- 172.21.15.38:0/4009136329 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f8065ee0 con 0x7f06f813c650 2020-06-12T17:49:40.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.887+0000 7f06fd05b700 1 --2- 172.21.15.38:0/4009136329 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f813c650 0x7f06f813bcf0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f06f40032c0 tx=0x7f06f4008110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:40.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.887+0000 7f06ffac0700 1 -- 172.21.15.38:0/4009136329 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f813f3c0 con 0x7f06f813c650 2020-06-12T17:49:40.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.888+0000 7f06e6ffd700 1 -- 172.21.15.38:0/4009136329 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f06f40122b0 con 0x7f06f813c650 2020-06-12T17:49:40.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.888+0000 7f06fd05b700 1 --2- 172.21.15.38:0/4009136329 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f813c650 0x7f06f813bcf0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f06f40032c0 tx=0x7f06f4008110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:40.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.888+0000 7f06e6ffd700 1 --2- 172.21.15.38:0/4009136329 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06d804d470 0x7f06d804f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:40.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.888+0000 7f06e6ffd700 1 -- 172.21.15.38:0/4009136329 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f06f4061420 con 0x7f06f813c650 2020-06-12T17:49:40.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.888+0000 7f06fd85c700 1 --2- 172.21.15.38:0/4009136329 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06d804d470 0x7f06d804f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:40.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.888+0000 7f06fd85c700 1 --2- 172.21.15.38:0/4009136329 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06d804d470 0x7f06d804f930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f06e8002f30 tx=0x7f06e8007e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:40.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.888+0000 7f06fd85c700 1 --2- 172.21.15.38:0/4009136329 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06d804d470 0x7f06d804f930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f06e8002f30 tx=0x7f06e8007e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:40.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.888+0000 7f06fd85c700 1 --2- 172.21.15.38:0/4009136329 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06d804d470 0x7f06d804f930 secure :-1 s=READY pgs=212 cs=0 l=1 rx=0x7f06e8002f30 tx=0x7f06e8007e50).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:40.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.892+0000 7f06fd05b700 1 --2- 172.21.15.38:0/4009136329 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f813c650 0x7f06f813bcf0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f06f40032c0 tx=0x7f06f4008110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:40.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:40.892+0000 7f06e6ffd700 1 -- 172.21.15.38:0/4009136329 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f06f403cb80 con 0x7f06f813c650 2020-06-12T17:49:41.090 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.087+0000 7f06ffac0700 1 -- 172.21.15.38:0/4009136329 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_3521", "target": ["mon-mgr", ""]}) v1 -- 0x7f06f813c150 con 0x7f06d804d470 2020-06-12T17:49:41.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.108+0000 7f06fd85c700 1 --2- 172.21.15.38:0/4009136329 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06d804d470 0x7f06d804f930 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f06e8002f30 tx=0x7f06e8007e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:41.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.108+0000 7f06e6ffd700 1 -- 172.21.15.38:0/4009136329 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f06f813c150 con 0x7f06d804d470 2020-06-12T17:49:41.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.110+0000 7f06ffac0700 1 -- 172.21.15.38:0/4009136329 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06d804d470 msgr2=0x7f06d804f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:41.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.110+0000 7f06ffac0700 1 --2- 172.21.15.38:0/4009136329 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06d804d470 0x7f06d804f930 secure :-1 s=READY pgs=212 cs=0 l=1 rx=0x7f06e8002f30 tx=0x7f06e8007e50).stop 2020-06-12T17:49:41.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.110+0000 7f06ffac0700 1 -- 172.21.15.38:0/4009136329 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f813c650 msgr2=0x7f06f813bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:41.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.110+0000 7f06ffac0700 1 --2- 172.21.15.38:0/4009136329 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f813c650 0x7f06f813bcf0 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7f06f40032c0 tx=0x7f06f4008110).stop 2020-06-12T17:49:41.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.110+0000 7f06ffac0700 1 -- 172.21.15.38:0/4009136329 shutdown_connections 2020-06-12T17:49:41.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.110+0000 7f06ffac0700 1 --2- 172.21.15.38:0/4009136329 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06d804d470 0x7f06d804f930 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:41.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.110+0000 7f06ffac0700 1 --2- 172.21.15.38:0/4009136329 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06f80b3ac0 0x7f06f813ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:41.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.110+0000 7f06ffac0700 1 --2- 172.21.15.38:0/4009136329 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06f813c650 0x7f06f813bcf0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:41.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.110+0000 7f06ffac0700 1 -- 172.21.15.38:0/4009136329 >> 172.21.15.38:0/4009136329 conn(0x7f06f80b5a20 msgr2=0x7f06f80b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:41.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.110+0000 7f06ffac0700 1 -- 172.21.15.38:0/4009136329 shutdown_connections 2020-06-12T17:49:41.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.110+0000 7f06ffac0700 1 -- 172.21.15.38:0/4009136329 wait complete. 2020-06-12T17:49:41.123 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_3521 2020-06-12T17:49:41.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.236+0000 7f29b691c700 1 Processor -- start 2020-06-12T17:49:41.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.236+0000 7f29b691c700 1 -- start start 2020-06-12T17:49:41.242 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.237+0000 7f29b691c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b00b15c0 0x7f29b00b2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:41.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.237+0000 7f29b691c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f29b00afc20 0x7f29b00b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:41.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.237+0000 7f29b691c700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b00b2900 con 0x7f29b00b11e0 2020-06-12T17:49:41.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.237+0000 7f29b691c700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b00ae7d0 con 0x7f29b00afc20 2020-06-12T17:49:41.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.237+0000 7f29b691c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b00b1ad0 con 0x7f29b00b15c0 2020-06-12T17:49:41.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.237+0000 7f29b611b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f29b00afc20 0x7f29b00b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:41.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.237+0000 7f29b591a700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f29b00b11e0 0x7f29b00ae0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39824/0 (socket says 172.21.15.38:39824) 2020-06-12T17:49:41.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.237+0000 7f29b611b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f29b00afc20 0x7f29b00b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38008/0 (socket says 172.21.15.38:38008) 2020-06-12T17:49:41.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.237+0000 7f29b591a700 1 -- 172.21.15.38:0/239570637 learned_addr learned my addr 172.21.15.38:0/239570637 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:41.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.238+0000 7f29b5119700 1 --2- 172.21.15.38:0/239570637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b00b15c0 0x7f29b00b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:41.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.238+0000 7f29b611b700 1 -- 172.21.15.38:0/239570637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b00b15c0 msgr2=0x7f29b00b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:41.245 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.238+0000 7f29b611b700 1 --2- 172.21.15.38:0/239570637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b00b15c0 0x7f29b00b2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:41.245 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.238+0000 7f29b611b700 1 -- 172.21.15.38:0/239570637 >> v1:172.21.15.38:6789/0 conn(0x7f29b00b11e0 legacy=0x7f29b00ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:41.245 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.238+0000 7f29b4918700 1 -- 172.21.15.38:0/239570637 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1787283209 0 0) 0x7f29b00b2900 con 0x7f29b00b11e0 2020-06-12T17:49:41.245 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.238+0000 7f29b611b700 1 -- 172.21.15.38:0/239570637 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b00b1d70 con 0x7f29b00afc20 2020-06-12T17:49:41.245 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.238+0000 7f29b611b700 1 --2- 172.21.15.38:0/239570637 >> v2:172.21.15.38:3300/0 conn(0x7f29b00afc20 0x7f29b00b0070 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f29a80032b0 tx=0x7f29a80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:41.246 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.238+0000 7f29b611b700 1 --2- 172.21.15.38:0/239570637 >> v2:172.21.15.38:3300/0 conn(0x7f29b00afc20 0x7f29b00b0070 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f29a80032b0 tx=0x7f29a80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:41.246 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.238+0000 7f29b611b700 1 --2- 172.21.15.38:0/239570637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b00afc20 0x7f29b00b0070 secure :-1 s=READY pgs=532 cs=0 l=1 rx=0x7f29a80032b0 tx=0x7f29a80081e0).ready entity=mon.0 client_cookie=9211270a7ff209e8 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:41.246 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.238+0000 7f29b611b700 1 --2- 172.21.15.38:0/239570637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b00afc20 0x7f29b00b0070 secure :-1 s=THROTTLE_DONE pgs=532 cs=0 l=1 rx=0x7f29a80032b0 tx=0x7f29a80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:41.246 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.238+0000 7f29b611b700 1 --2- 172.21.15.38:0/239570637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b00afc20 0x7f29b00b0070 secure :-1 s=THROTTLE_DONE pgs=532 cs=0 l=1 rx=0x7f29a80032b0 tx=0x7f29a80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:41.246 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.238+0000 7f29b4918700 1 -- 172.21.15.38:0/239570637 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29a8011e90 con 0x7f29b00afc20 2020-06-12T17:49:41.247 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.238+0000 7f29b611b700 1 --2- 172.21.15.38:0/239570637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b00afc20 0x7f29b00b0070 secure :-1 s=THROTTLE_DONE pgs=532 cs=0 l=1 rx=0x7f29a80032b0 tx=0x7f29a80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:41.247 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.238+0000 7f29b4918700 1 -- 172.21.15.38:0/239570637 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a800a160 con 0x7f29b00afc20 2020-06-12T17:49:41.247 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.238+0000 7f29b4918700 1 -- 172.21.15.38:0/239570637 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29a800a500 con 0x7f29b00afc20 2020-06-12T17:49:41.247 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.238+0000 7f29b691c700 1 -- 172.21.15.38:0/239570637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b00afc20 msgr2=0x7f29b00b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:41.247 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.238+0000 7f29b691c700 1 --2- 172.21.15.38:0/239570637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b00afc20 0x7f29b00b0070 secure :-1 s=READY pgs=532 cs=0 l=1 rx=0x7f29a80032b0 tx=0x7f29a80081e0).stop 2020-06-12T17:49:41.248 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.238+0000 7f29b691c700 1 -- 172.21.15.38:0/239570637 shutdown_connections 2020-06-12T17:49:41.248 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.238+0000 7f29b691c700 1 --2- 172.21.15.38:0/239570637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b00afc20 0x7f29b00b0070 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:41.248 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.238+0000 7f29b691c700 1 --2- 172.21.15.38:0/239570637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b00b15c0 0x7f29b00b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:41.248 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.238+0000 7f29b691c700 1 -- 172.21.15.38:0/239570637 >> 172.21.15.38:0/239570637 conn(0x7f29b00b4cc0 msgr2=0x7f29b00b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:41.248 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.239+0000 7f29b691c700 1 -- 172.21.15.38:0/239570637 shutdown_connections 2020-06-12T17:49:41.248 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.239+0000 7f29b691c700 1 -- 172.21.15.38:0/239570637 wait complete. 2020-06-12T17:49:41.252 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.239+0000 7f29b691c700 1 Processor -- start 2020-06-12T17:49:41.253 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.240+0000 7f29b691c700 1 -- start start 2020-06-12T17:49:41.253 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.240+0000 7f29b691c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f29b00afc20 0x7f29b0140ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:41.253 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.240+0000 7f29b691c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b00b11e0 0x7f29b0140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:41.253 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.240+0000 7f29b691c700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b00b6e00 con 0x7f29b00b15c0 2020-06-12T17:49:41.253 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.240+0000 7f29b691c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b0140350 con 0x7f29b00afc20 2020-06-12T17:49:41.254 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.240+0000 7f29b691c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b01405f0 con 0x7f29b00b11e0 2020-06-12T17:49:41.255 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.240+0000 7f29b611b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f29b00b15c0 0x7f29b013fab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39832/0 (socket says 172.21.15.38:39832) 2020-06-12T17:49:41.255 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.240+0000 7f29b611b700 1 -- 172.21.15.38:0/1151019368 learned_addr learned my addr 172.21.15.38:0/1151019368 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:41.255 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.240+0000 7f29b591a700 1 --2- 172.21.15.38:0/1151019368 >> v2:172.21.15.150:3300/0 conn(0x7f29b00afc20 0x7f29b0140ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:41.255 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.240+0000 7f29b5119700 1 --2- 172.21.15.38:0/1151019368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b00b11e0 0x7f29b0140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:41.255 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.241+0000 7f29a2ffd700 1 -- 172.21.15.38:0/1151019368 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2499438201 0 0) 0x7f29b00b6e00 con 0x7f29b00b15c0 2020-06-12T17:49:41.256 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.241+0000 7f29a2ffd700 1 -- 172.21.15.38:0/1151019368 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2990002fe0 con 0x7f29b00b15c0 2020-06-12T17:49:41.256 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.241+0000 7f29a2ffd700 1 -- 172.21.15.38:0/1151019368 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 971312099 0 0) 0x7f2990002fe0 con 0x7f29b00b15c0 2020-06-12T17:49:41.256 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.241+0000 7f29a2ffd700 1 -- 172.21.15.38:0/1151019368 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f29b00b6e00 con 0x7f29b00b15c0 2020-06-12T17:49:41.256 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.241+0000 7f29a2ffd700 1 -- 172.21.15.38:0/1151019368 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f29a800a570 con 0x7f29b00b15c0 2020-06-12T17:49:41.256 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.241+0000 7f29b5119700 1 -- 172.21.15.38:0/1151019368 >> v2:172.21.15.150:3300/0 conn(0x7f29b00afc20 msgr2=0x7f29b0140ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:41.257 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.241+0000 7f29b5119700 1 --2- 172.21.15.38:0/1151019368 >> v2:172.21.15.150:3300/0 conn(0x7f29b00afc20 0x7f29b0140ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:41.257 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.241+0000 7f29b5119700 1 -- 172.21.15.38:0/1151019368 >> v1:172.21.15.38:6789/0 conn(0x7f29b00b15c0 legacy=0x7f29b013fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:41.257 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.241+0000 7f29b5119700 1 -- 172.21.15.38:0/1151019368 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b013a480 con 0x7f29b00b11e0 2020-06-12T17:49:41.261 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.241+0000 7f29b591a700 1 --2- 172.21.15.38:0/1151019368 >> v2:172.21.15.150:3300/0 conn(0x7f29b00afc20 0x7f29b0140ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:49:41.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.241+0000 7f29b5119700 1 --2- 172.21.15.38:0/1151019368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b00b11e0 0x7f29b0140fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f29ac002f30 tx=0x7f29ac00e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:41.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.241+0000 7f29b5119700 1 --2- 172.21.15.38:0/1151019368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b00b11e0 0x7f29b0140fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f29ac002f30 tx=0x7f29ac00e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:41.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.241+0000 7f29b5119700 1 --2- 172.21.15.38:0/1151019368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b00b11e0 0x7f29b0140fd0 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f29ac002f30 tx=0x7f29ac00e0c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:41.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.241+0000 7f29b5119700 1 --2- 172.21.15.38:0/1151019368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b00b11e0 0x7f29b0140fd0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f29ac002f30 tx=0x7f29ac00e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:41.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.241+0000 7f29a2ffd700 1 -- 172.21.15.38:0/1151019368 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29ac007540 con 0x7f29b00b11e0 2020-06-12T17:49:41.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.241+0000 7f29b5119700 1 --2- 172.21.15.38:0/1151019368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b00b11e0 0x7f29b0140fd0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f29ac002f30 tx=0x7f29ac00e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:41.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.241+0000 7f29b5119700 1 --2- 172.21.15.38:0/1151019368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b00b11e0 0x7f29b0140fd0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f29ac002f30 tx=0x7f29ac00e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:41.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.241+0000 7f29a2ffd700 1 -- 172.21.15.38:0/1151019368 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac0058a0 con 0x7f29b00b11e0 2020-06-12T17:49:41.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.241+0000 7f29b691c700 1 -- 172.21.15.38:0/1151019368 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b013a6d0 con 0x7f29b00b11e0 2020-06-12T17:49:41.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.241+0000 7f29a2ffd700 1 -- 172.21.15.38:0/1151019368 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29ac005c00 con 0x7f29b00b11e0 2020-06-12T17:49:41.264 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.241+0000 7f29b691c700 1 -- 172.21.15.38:0/1151019368 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b013aba0 con 0x7f29b00b11e0 2020-06-12T17:49:41.264 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.242+0000 7f29b5119700 1 --2- 172.21.15.38:0/1151019368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b00b11e0 0x7f29b0140fd0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f29ac002f30 tx=0x7f29ac00e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:41.264 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.242+0000 7f29b691c700 1 -- 172.21.15.38:0/1151019368 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b01401c0 con 0x7f29b00b11e0 2020-06-12T17:49:41.265 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.242+0000 7f29a2ffd700 1 -- 172.21.15.38:0/1151019368 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f29ac00e200 con 0x7f29b00b11e0 2020-06-12T17:49:41.265 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.242+0000 7f29b5119700 1 --2- 172.21.15.38:0/1151019368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b00b11e0 0x7f29b0140fd0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f29ac002f30 tx=0x7f29ac00e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:41.265 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.243+0000 7f29a2ffd700 1 --2- 172.21.15.38:0/1151019368 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f299004db40 0x7f2990050000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:41.265 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.243+0000 7f29a2ffd700 1 -- 172.21.15.38:0/1151019368 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f29ac060ba0 con 0x7f29b00b11e0 2020-06-12T17:49:41.265 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.243+0000 7f29b591a700 1 --2- 172.21.15.38:0/1151019368 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f299004db40 0x7f2990050000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:41.266 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.243+0000 7f29b591a700 1 --2- 172.21.15.38:0/1151019368 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f299004db40 0x7f2990050000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f29a4000b80 tx=0x7f29a4001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:41.266 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.243+0000 7f29b591a700 1 --2- 172.21.15.38:0/1151019368 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f299004db40 0x7f2990050000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f29a4000b80 tx=0x7f29a4001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:41.266 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.243+0000 7f29b591a700 1 --2- 172.21.15.38:0/1151019368 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f299004db40 0x7f2990050000 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7f29a4000b80 tx=0x7f29a4001680).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:41.266 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.247+0000 7f29b5119700 1 --2- 172.21.15.38:0/1151019368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b00b11e0 0x7f29b0140fd0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f29ac002f30 tx=0x7f29ac00e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:41.266 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.247+0000 7f29a2ffd700 1 -- 172.21.15.38:0/1151019368 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f29ac03c3b0 con 0x7f29b00b11e0 2020-06-12T17:49:41.445 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.441+0000 7f29b691c700 1 -- 172.21.15.38:0/1151019368 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_3521", "target": ["mon-mgr", ""]}) v1 -- 0x7f29b0056c30 con 0x7f299004db40 2020-06-12T17:49:41.455 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.445+0000 7f29b591a700 1 --2- 172.21.15.38:0/1151019368 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f299004db40 0x7f2990050000 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f29a4000b80 tx=0x7f29a4001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:41.455 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.445+0000 7f29a2ffd700 1 -- 172.21.15.38:0/1151019368 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f29b0056c30 con 0x7f299004db40 2020-06-12T17:49:41.455 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.446+0000 7f29b691c700 1 -- 172.21.15.38:0/1151019368 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f299004db40 msgr2=0x7f2990050000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:41.455 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.446+0000 7f29b691c700 1 --2- 172.21.15.38:0/1151019368 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f299004db40 0x7f2990050000 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7f29a4000b80 tx=0x7f29a4001680).stop 2020-06-12T17:49:41.456 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.446+0000 7f29b691c700 1 -- 172.21.15.38:0/1151019368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b00b11e0 msgr2=0x7f29b0140fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:41.456 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.446+0000 7f29b691c700 1 --2- 172.21.15.38:0/1151019368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b00b11e0 0x7f29b0140fd0 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f29ac002f30 tx=0x7f29ac00e0c0).stop 2020-06-12T17:49:41.456 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.446+0000 7f29b691c700 1 -- 172.21.15.38:0/1151019368 shutdown_connections 2020-06-12T17:49:41.456 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.446+0000 7f29b691c700 1 --2- 172.21.15.38:0/1151019368 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f299004db40 0x7f2990050000 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:41.456 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.446+0000 7f29b691c700 1 --2- 172.21.15.38:0/1151019368 >> v2:172.21.15.150:3300/0 conn(0x7f29b00afc20 0x7f29b0140ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:41.457 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.446+0000 7f29b691c700 1 --2- 172.21.15.38:0/1151019368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b00b11e0 0x7f29b0140fd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:41.457 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.446+0000 7f29b691c700 1 -- 172.21.15.38:0/1151019368 >> 172.21.15.38:0/1151019368 conn(0x7f29b00b4cc0 msgr2=0x7f29b00b8200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:41.457 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.446+0000 7f29b691c700 1 -- 172.21.15.38:0/1151019368 shutdown_connections 2020-06-12T17:49:41.457 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:41.446+0000 7f29b691c700 1 -- 172.21.15.38:0/1151019368 wait complete. 2020-06-12T17:49:41.458 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_3521/7030d300-45d1-4c8d-a068-f574d4f5e2ec 2020-06-12T17:49:41.460 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_3521 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_3521/7030d300-45d1-4c8d-a068-f574d4f5e2ec 2020-06-12T17:49:41.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:41.461 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:41.461 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:41.476 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:41.477 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:41.477 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3521/7030d300-45d1-4c8d-a068-f574d4f5e2ec/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:41.568 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:41.569 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:41.569 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120517 s, 87.0 MB/s 2020-06-12T17:49:41.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:41.570 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:41.571 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:41.585 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:41.586 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:41.587 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3521/7030d300-45d1-4c8d-a068-f574d4f5e2ec/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:41.672 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:41.673 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:41.673 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01017 s, 103 MB/s 2020-06-12T17:49:41.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:41.674 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:41.675 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:41.690 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:41.690 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:41.691 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3521/7030d300-45d1-4c8d-a068-f574d4f5e2ec/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:41.778 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:41.779 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:41.779 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113138 s, 92.7 MB/s 2020-06-12T17:49:41.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:41.780 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:41.781 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:41.796 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:41.796 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:41.797 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3521/7030d300-45d1-4c8d-a068-f574d4f5e2ec/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:41.884 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:41.885 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:41.885 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011797 s, 88.9 MB/s 2020-06-12T17:49:41.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:41.887 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:41.887 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:41.902 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:41.903 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:41.904 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3521/7030d300-45d1-4c8d-a068-f574d4f5e2ec/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:41.994 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:41.994 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:41.994 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115927 s, 90.5 MB/s 2020-06-12T17:49:41.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:41.996 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:41.996 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:42.011 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:42.011 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:42.012 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3521/7030d300-45d1-4c8d-a068-f574d4f5e2ec/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:42.099 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:42.099 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:42.100 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996363 s, 105 MB/s 2020-06-12T17:49:42.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:42.102 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:42.102 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:42.117 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:42.118 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:42.118 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3521/7030d300-45d1-4c8d-a068-f574d4f5e2ec/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:42.206 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:42.206 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:42.206 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115711 s, 90.6 MB/s 2020-06-12T17:49:42.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:42.208 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:42.209 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:42.224 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:42.224 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:42.225 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3521/7030d300-45d1-4c8d-a068-f574d4f5e2ec/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:42.311 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:42.311 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:42.311 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954393 s, 110 MB/s 2020-06-12T17:49:42.312 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:42.313 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:42.314 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:42.330 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:42.331 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:42.332 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3521/7030d300-45d1-4c8d-a068-f574d4f5e2ec/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:42.418 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:42.419 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:42.419 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112775 s, 93.0 MB/s 2020-06-12T17:49:42.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:42.420 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:42.421 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:42.437 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:42.437 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:42.438 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3521/7030d300-45d1-4c8d-a068-f574d4f5e2ec/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:42.525 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:42.525 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:42.526 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130042 s, 80.6 MB/s 2020-06-12T17:49:42.527 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_9609 2020-06-12T17:49:42.644 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.641+0000 7fabe1252700 1 Processor -- start 2020-06-12T17:49:42.645 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.641+0000 7fabe1252700 1 -- start start 2020-06-12T17:49:42.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabe1252700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fabdc0ad5b0 0x7fabdc0b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:42.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabe1252700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fabdc09d8d0 0x7fabdc1421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:42.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabe1252700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabdc146d20 con 0x7fabdc146680 2020-06-12T17:49:42.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabe1252700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabdc066a80 con 0x7fabdc0ad5b0 2020-06-12T17:49:42.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabe1252700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabdc146f50 con 0x7fabdc09d8d0 2020-06-12T17:49:42.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabda59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fabdc0ad5b0 0x7fabdc0b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:42.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabda59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fabdc0ad5b0 0x7fabdc0b2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38022/0 (socket says 172.21.15.38:38022) 2020-06-12T17:49:42.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabdad9d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fabdc146680 0x7fabdc09d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39836/0 (socket says 172.21.15.38:39836) 2020-06-12T17:49:42.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabda59c700 1 -- 172.21.15.38:0/2817374554 learned_addr learned my addr 172.21.15.38:0/2817374554 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:42.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabdb59e700 1 --2- 172.21.15.38:0/2817374554 >> v2:172.21.15.150:3300/0 conn(0x7fabdc09d8d0 0x7fabdc1421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:42.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabda59c700 1 -- 172.21.15.38:0/2817374554 >> v2:172.21.15.150:3300/0 conn(0x7fabdc09d8d0 msgr2=0x7fabdc1421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:42.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabda59c700 1 --2- 172.21.15.38:0/2817374554 >> v2:172.21.15.150:3300/0 conn(0x7fabdc09d8d0 0x7fabdc1421d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:42.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabda59c700 1 -- 172.21.15.38:0/2817374554 >> v1:172.21.15.38:6789/0 conn(0x7fabdc146680 legacy=0x7fabdc09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:42.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabda59c700 1 -- 172.21.15.38:0/2817374554 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabdc146a60 con 0x7fabdc0ad5b0 2020-06-12T17:49:42.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabd9d9b700 1 -- 172.21.15.38:0/2817374554 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1824437282 0 0) 0x7fabdc146d20 con 0x7fabdc146680 2020-06-12T17:49:42.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabdb59e700 1 --2- 172.21.15.38:0/2817374554 >> v2:172.21.15.150:3300/0 conn(0x7fabdc09d8d0 0x7fabdc1421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:49:42.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabda59c700 1 --2- 172.21.15.38:0/2817374554 >> v2:172.21.15.38:3300/0 conn(0x7fabdc0ad5b0 0x7fabdc0b2eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fabc4002f30 tx=0x7fabc4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:42.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabda59c700 1 --2- 172.21.15.38:0/2817374554 >> v2:172.21.15.38:3300/0 conn(0x7fabdc0ad5b0 0x7fabdc0b2eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fabc4002f30 tx=0x7fabc4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:42.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabda59c700 1 --2- 172.21.15.38:0/2817374554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabdc0ad5b0 0x7fabdc0b2eb0 secure :-1 s=READY pgs=535 cs=0 l=1 rx=0x7fabc4002f30 tx=0x7fabc4007e60).ready entity=mon.0 client_cookie=6ccfeda5dab81a4 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:42.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabda59c700 1 --2- 172.21.15.38:0/2817374554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabdc0ad5b0 0x7fabdc0b2eb0 secure :-1 s=THROTTLE_DONE pgs=535 cs=0 l=1 rx=0x7fabc4002f30 tx=0x7fabc4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:42.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabda59c700 1 --2- 172.21.15.38:0/2817374554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabdc0ad5b0 0x7fabdc0b2eb0 secure :-1 s=THROTTLE_DONE pgs=535 cs=0 l=1 rx=0x7fabc4002f30 tx=0x7fabc4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:42.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabd9d9b700 1 -- 172.21.15.38:0/2817374554 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabc40116e0 con 0x7fabdc0ad5b0 2020-06-12T17:49:42.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabda59c700 1 --2- 172.21.15.38:0/2817374554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabdc0ad5b0 0x7fabdc0b2eb0 secure :-1 s=THROTTLE_DONE pgs=535 cs=0 l=1 rx=0x7fabc4002f30 tx=0x7fabc4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:42.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabd9d9b700 1 -- 172.21.15.38:0/2817374554 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc4011840 con 0x7fabdc0ad5b0 2020-06-12T17:49:42.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabd9d9b700 1 -- 172.21.15.38:0/2817374554 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabc4011be0 con 0x7fabdc0ad5b0 2020-06-12T17:49:42.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabe1252700 1 -- 172.21.15.38:0/2817374554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabdc0ad5b0 msgr2=0x7fabdc0b2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:42.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.642+0000 7fabe1252700 1 --2- 172.21.15.38:0/2817374554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabdc0ad5b0 0x7fabdc0b2eb0 secure :-1 s=READY pgs=535 cs=0 l=1 rx=0x7fabc4002f30 tx=0x7fabc4007e60).stop 2020-06-12T17:49:42.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.643+0000 7fabe1252700 1 -- 172.21.15.38:0/2817374554 shutdown_connections 2020-06-12T17:49:42.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.643+0000 7fabe1252700 1 --2- 172.21.15.38:0/2817374554 >> v2:172.21.15.150:3300/0 conn(0x7fabdc09d8d0 0x7fabdc1421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:42.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.643+0000 7fabe1252700 1 --2- 172.21.15.38:0/2817374554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabdc0ad5b0 0x7fabdc0b2eb0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:42.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.643+0000 7fabe1252700 1 -- 172.21.15.38:0/2817374554 >> 172.21.15.38:0/2817374554 conn(0x7fabdc0b5a20 msgr2=0x7fabdc05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:42.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.643+0000 7fabe1252700 1 -- 172.21.15.38:0/2817374554 shutdown_connections 2020-06-12T17:49:42.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.643+0000 7fabe1252700 1 -- 172.21.15.38:0/2817374554 wait complete. 2020-06-12T17:49:42.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.644+0000 7fabe1252700 1 Processor -- start 2020-06-12T17:49:42.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.644+0000 7fabe1252700 1 -- start start 2020-06-12T17:49:42.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.645+0000 7fabe1252700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fabdc09d8d0 0x7fabdc0b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:42.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.645+0000 7fabe1252700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fabdc0ad5b0 0x7fabdc12dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:42.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.645+0000 7fabe1252700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fabdc146680 0x7fabdc1324a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:42.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.645+0000 7fabe1252700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabdc132900 con 0x7fabdc146680 2020-06-12T17:49:42.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.645+0000 7fabe1252700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabdc0b0ff0 con 0x7fabdc0ad5b0 2020-06-12T17:49:42.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.645+0000 7fabe1252700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc131090 con 0x7fabdc09d8d0 2020-06-12T17:49:42.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.645+0000 7fabdb59e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fabdc146680 0x7fabdc1324a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:42.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.645+0000 7fabdb59e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fabdc146680 0x7fabdc1324a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38030/0 (socket says 172.21.15.38:38030) 2020-06-12T17:49:42.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.645+0000 7fabdb59e700 1 -- 172.21.15.38:0/660564897 learned_addr learned my addr 172.21.15.38:0/660564897 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:42.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.645+0000 7fabdad9d700 1 --2- 172.21.15.38:0/660564897 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fabdc09d8d0 0x7fabdc0b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:42.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.645+0000 7fabda59c700 1 --2- 172.21.15.38:0/660564897 >> v2:172.21.15.150:3300/0 conn(0x7fabdc0ad5b0 0x7fabdc12dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:42.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.645+0000 7fabdb59e700 1 -- 172.21.15.38:0/660564897 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fabdc09d8d0 msgr2=0x7fabdc0b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:42.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.645+0000 7fabdb59e700 1 --2- 172.21.15.38:0/660564897 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fabdc09d8d0 0x7fabdc0b0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:42.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.645+0000 7fabdb59e700 1 -- 172.21.15.38:0/660564897 >> v2:172.21.15.150:3300/0 conn(0x7fabdc0ad5b0 msgr2=0x7fabdc12dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:42.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.645+0000 7fabdb59e700 1 --2- 172.21.15.38:0/660564897 >> v2:172.21.15.150:3300/0 conn(0x7fabdc0ad5b0 0x7fabdc12dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:42.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.645+0000 7fabdb59e700 1 -- 172.21.15.38:0/660564897 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabdc0b2ac0 con 0x7fabdc146680 2020-06-12T17:49:42.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.645+0000 7fabdb59e700 1 --2- 172.21.15.38:0/660564897 >> v2:172.21.15.38:3300/0 conn(0x7fabdc146680 0x7fabdc1324a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fabcc002ef0 tx=0x7fabcc007e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:42.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.645+0000 7fabdb59e700 1 --2- 172.21.15.38:0/660564897 >> v2:172.21.15.38:3300/0 conn(0x7fabdc146680 0x7fabdc1324a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fabcc002ef0 tx=0x7fabcc007e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:42.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.645+0000 7fabdb59e700 1 --2- 172.21.15.38:0/660564897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabdc146680 0x7fabdc1324a0 secure :-1 s=READY pgs=536 cs=0 l=1 rx=0x7fabcc002ef0 tx=0x7fabcc007e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:42.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.645+0000 7fabdb59e700 1 --2- 172.21.15.38:0/660564897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabdc146680 0x7fabdc1324a0 secure :-1 s=THROTTLE_DONE pgs=536 cs=0 l=1 rx=0x7fabcc002ef0 tx=0x7fabcc007e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:42.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.645+0000 7fabd3fff700 1 -- 172.21.15.38:0/660564897 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabcc008e80 con 0x7fabdc146680 2020-06-12T17:49:42.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.645+0000 7fabdb59e700 1 --2- 172.21.15.38:0/660564897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabdc146680 0x7fabdc1324a0 secure :-1 s=THROTTLE_DONE pgs=536 cs=0 l=1 rx=0x7fabcc002ef0 tx=0x7fabcc007e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:42.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.646+0000 7fabdb59e700 1 --2- 172.21.15.38:0/660564897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabdc146680 0x7fabdc1324a0 secure :-1 s=THROTTLE_DONE pgs=536 cs=0 l=1 rx=0x7fabcc002ef0 tx=0x7fabcc007e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:42.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.646+0000 7fabd3fff700 1 -- 172.21.15.38:0/660564897 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabcc007160 con 0x7fabdc146680 2020-06-12T17:49:42.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.646+0000 7fabd3fff700 1 -- 172.21.15.38:0/660564897 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabcc007540 con 0x7fabdc146680 2020-06-12T17:49:42.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.646+0000 7fabe1252700 1 -- 172.21.15.38:0/660564897 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabdc131530 con 0x7fabdc146680 2020-06-12T17:49:42.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.646+0000 7fabe1252700 1 -- 172.21.15.38:0/660564897 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabdc12e5d0 con 0x7fabdc146680 2020-06-12T17:49:42.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.646+0000 7fabdb59e700 1 --2- 172.21.15.38:0/660564897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabdc146680 0x7fabdc1324a0 secure :-1 s=THROTTLE_DONE pgs=536 cs=0 l=1 rx=0x7fabcc002ef0 tx=0x7fabcc007e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:42.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.646+0000 7fabe1252700 1 -- 172.21.15.38:0/660564897 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabdc056c30 con 0x7fabdc146680 2020-06-12T17:49:42.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.647+0000 7fabd3fff700 1 -- 172.21.15.38:0/660564897 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fabcc0059c0 con 0x7fabdc146680 2020-06-12T17:49:42.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.647+0000 7fabdb59e700 1 --2- 172.21.15.38:0/660564897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabdc146680 0x7fabdc1324a0 secure :-1 s=THROTTLE_DONE pgs=536 cs=0 l=1 rx=0x7fabcc002ef0 tx=0x7fabcc007e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:42.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.647+0000 7fabd3fff700 1 --2- 172.21.15.38:0/660564897 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fabc004d490 0x7fabc004f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:42.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.647+0000 7fabd3fff700 1 -- 172.21.15.38:0/660564897 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fabcc060b60 con 0x7fabdc146680 2020-06-12T17:49:42.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.647+0000 7fabdad9d700 1 --2- 172.21.15.38:0/660564897 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fabc004d490 0x7fabc004f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:42.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.647+0000 7fabdad9d700 1 --2- 172.21.15.38:0/660564897 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fabc004d490 0x7fabc004f950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fabd4000f00 tx=0x7fabd4001a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:42.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.648+0000 7fabdad9d700 1 --2- 172.21.15.38:0/660564897 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fabc004d490 0x7fabc004f950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fabd4000f00 tx=0x7fabd4001a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:42.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.648+0000 7fabdad9d700 1 --2- 172.21.15.38:0/660564897 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fabc004d490 0x7fabc004f950 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7fabd4000f00 tx=0x7fabd4001a60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:42.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.651+0000 7fabdb59e700 1 --2- 172.21.15.38:0/660564897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabdc146680 0x7fabdc1324a0 secure :-1 s=THROTTLE_DONE pgs=536 cs=0 l=1 rx=0x7fabcc002ef0 tx=0x7fabcc007e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:42.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.651+0000 7fabd3fff700 1 -- 172.21.15.38:0/660564897 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fabcc03c320 con 0x7fabdc146680 2020-06-12T17:49:42.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.844+0000 7fabe1252700 1 -- 172.21.15.38:0/660564897 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_9609", "target": ["mon-mgr", ""]}) v1 -- 0x7fabdc05a5e0 con 0x7fabc004d490 2020-06-12T17:49:42.865 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.862+0000 7fabdad9d700 1 --2- 172.21.15.38:0/660564897 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fabc004d490 0x7fabc004f950 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7fabd4000f00 tx=0x7fabd4001a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:42.866 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.862+0000 7fabd3fff700 1 -- 172.21.15.38:0/660564897 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fabdc05a5e0 con 0x7fabc004d490 2020-06-12T17:49:42.867 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.864+0000 7fabe1252700 1 -- 172.21.15.38:0/660564897 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fabc004d490 msgr2=0x7fabc004f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:42.868 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.864+0000 7fabe1252700 1 --2- 172.21.15.38:0/660564897 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fabc004d490 0x7fabc004f950 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7fabd4000f00 tx=0x7fabd4001a60).stop 2020-06-12T17:49:42.868 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.864+0000 7fabe1252700 1 -- 172.21.15.38:0/660564897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabdc146680 msgr2=0x7fabdc1324a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:42.868 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.864+0000 7fabe1252700 1 --2- 172.21.15.38:0/660564897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabdc146680 0x7fabdc1324a0 secure :-1 s=READY pgs=536 cs=0 l=1 rx=0x7fabcc002ef0 tx=0x7fabcc007e70).stop 2020-06-12T17:49:42.868 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.864+0000 7fabe1252700 1 -- 172.21.15.38:0/660564897 shutdown_connections 2020-06-12T17:49:42.868 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.864+0000 7fabe1252700 1 --2- 172.21.15.38:0/660564897 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fabc004d490 0x7fabc004f950 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:42.869 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.864+0000 7fabe1252700 1 --2- 172.21.15.38:0/660564897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabdc146680 0x7fabdc1324a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:42.869 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.864+0000 7fabe1252700 1 --2- 172.21.15.38:0/660564897 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fabdc09d8d0 0x7fabdc0b0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:42.869 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.864+0000 7fabe1252700 1 --2- 172.21.15.38:0/660564897 >> v2:172.21.15.150:3300/0 conn(0x7fabdc0ad5b0 0x7fabdc12dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:42.869 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.864+0000 7fabe1252700 1 -- 172.21.15.38:0/660564897 >> 172.21.15.38:0/660564897 conn(0x7fabdc0b5a20 msgr2=0x7fabdc0b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:42.869 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.864+0000 7fabe1252700 1 -- 172.21.15.38:0/660564897 shutdown_connections 2020-06-12T17:49:42.870 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.864+0000 7fabe1252700 1 -- 172.21.15.38:0/660564897 wait complete. 2020-06-12T17:49:42.877 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_9609 2020-06-12T17:49:42.995 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.991+0000 7f60c6b36700 1 Processor -- start 2020-06-12T17:49:42.995 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.991+0000 7f60c6b36700 1 -- start start 2020-06-12T17:49:42.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.992+0000 7f60c6b36700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60c0146680 0x7f60c00ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:42.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.992+0000 7f60c6b36700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f60c009d8d0 0x7f60c01421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:42.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.992+0000 7f60c6b36700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c0146d20 con 0x7f60c00b2eb0 2020-06-12T17:49:42.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.992+0000 7f60c6b36700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c0066a80 con 0x7f60c009d8d0 2020-06-12T17:49:42.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.992+0000 7f60c6b36700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c0146f50 con 0x7f60c0146680 2020-06-12T17:49:42.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.992+0000 7f60c50d3700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f60c009d8d0 0x7f60c01421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:42.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.992+0000 7f60c50d3700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f60c009d8d0 0x7f60c01421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38034/0 (socket says 172.21.15.38:38034) 2020-06-12T17:49:42.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.992+0000 7f60c50d3700 1 -- 172.21.15.38:0/1922119137 learned_addr learned my addr 172.21.15.38:0/1922119137 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:42.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.992+0000 7f60c50d3700 1 -- 172.21.15.38:0/1922119137 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60c0146680 msgr2=0x7f60c00ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:43.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.992+0000 7f60c50d3700 1 --2- 172.21.15.38:0/1922119137 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60c0146680 0x7f60c00ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:43.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.993+0000 7f60c50d3700 1 -- 172.21.15.38:0/1922119137 >> v1:172.21.15.150:6789/0 conn(0x7f60c00b2eb0 legacy=0x7f60c009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:43.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.993+0000 7f60c50d3700 1 -- 172.21.15.38:0/1922119137 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c0146a60 con 0x7f60c009d8d0 2020-06-12T17:49:43.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.993+0000 7f60c50d3700 1 --2- 172.21.15.38:0/1922119137 >> v2:172.21.15.38:3300/0 conn(0x7f60c009d8d0 0x7f60c01421d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f60c00ada10 tx=0x7f60b80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:43.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.993+0000 7f60c50d3700 1 --2- 172.21.15.38:0/1922119137 >> v2:172.21.15.38:3300/0 conn(0x7f60c009d8d0 0x7f60c01421d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f60c00ada10 tx=0x7f60b80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:43.001 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.993+0000 7f60c50d3700 1 --2- 172.21.15.38:0/1922119137 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60c009d8d0 0x7f60c01421d0 secure :-1 s=READY pgs=537 cs=0 l=1 rx=0x7f60c00ada10 tx=0x7f60b80081e0).ready entity=mon.0 client_cookie=725339fda2bd394a server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:43.001 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.993+0000 7f60c50d3700 1 --2- 172.21.15.38:0/1922119137 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60c009d8d0 0x7f60c01421d0 secure :-1 s=THROTTLE_DONE pgs=537 cs=0 l=1 rx=0x7f60c00ada10 tx=0x7f60b80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:43.001 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.993+0000 7f60bf7fe700 1 -- 172.21.15.38:0/1922119137 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60b800a160 con 0x7f60c009d8d0 2020-06-12T17:49:43.001 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.993+0000 7f60c50d3700 1 --2- 172.21.15.38:0/1922119137 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60c009d8d0 0x7f60c01421d0 secure :-1 s=THROTTLE_DONE pgs=537 cs=0 l=1 rx=0x7f60c00ada10 tx=0x7f60b80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:43.001 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.993+0000 7f60bf7fe700 1 -- 172.21.15.38:0/1922119137 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b800a2c0 con 0x7f60c009d8d0 2020-06-12T17:49:43.002 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.993+0000 7f60c50d3700 1 --2- 172.21.15.38:0/1922119137 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60c009d8d0 0x7f60c01421d0 secure :-1 s=THROTTLE_DONE pgs=537 cs=0 l=1 rx=0x7f60c00ada10 tx=0x7f60b80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:43.002 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.993+0000 7f60bf7fe700 1 -- 172.21.15.38:0/1922119137 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60b800a6e0 con 0x7f60c009d8d0 2020-06-12T17:49:43.002 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.993+0000 7f60c6b36700 1 -- 172.21.15.38:0/1922119137 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60c009d8d0 msgr2=0x7f60c01421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:43.002 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.993+0000 7f60c6b36700 1 --2- 172.21.15.38:0/1922119137 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60c009d8d0 0x7f60c01421d0 secure :-1 s=READY pgs=537 cs=0 l=1 rx=0x7f60c00ada10 tx=0x7f60b80081e0).stop 2020-06-12T17:49:43.002 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.993+0000 7f60c6b36700 1 -- 172.21.15.38:0/1922119137 shutdown_connections 2020-06-12T17:49:43.003 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.993+0000 7f60c6b36700 1 --2- 172.21.15.38:0/1922119137 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60c0146680 0x7f60c00ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:43.003 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.993+0000 7f60c6b36700 1 --2- 172.21.15.38:0/1922119137 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60c009d8d0 0x7f60c01421d0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:43.003 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.993+0000 7f60c6b36700 1 -- 172.21.15.38:0/1922119137 >> 172.21.15.38:0/1922119137 conn(0x7f60c00b5a20 msgr2=0x7f60c005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:43.003 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.993+0000 7f60c6b36700 1 -- 172.21.15.38:0/1922119137 shutdown_connections 2020-06-12T17:49:43.003 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.993+0000 7f60c6b36700 1 -- 172.21.15.38:0/1922119137 wait complete. 2020-06-12T17:49:43.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.994+0000 7f60c6b36700 1 Processor -- start 2020-06-12T17:49:43.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.994+0000 7f60c6b36700 1 -- start start 2020-06-12T17:49:43.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.995+0000 7f60c6b36700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60c009d8d0 0x7f60c0063ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:43.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.995+0000 7f60c6b36700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c0065940 con 0x7f60c0146680 2020-06-12T17:49:43.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.995+0000 7f60c6b36700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c0154c50 con 0x7f60c00b2eb0 2020-06-12T17:49:43.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.995+0000 7f60c6b36700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c0063800 con 0x7f60c009d8d0 2020-06-12T17:49:43.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.995+0000 7f60c50d3700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f60c0146680 0x7f60c0061a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39860/0 (socket says 172.21.15.38:39860) 2020-06-12T17:49:43.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.995+0000 7f60c50d3700 1 -- 172.21.15.38:0/3314229226 learned_addr learned my addr 172.21.15.38:0/3314229226 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:43.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.995+0000 7f60c48d2700 1 --2- 172.21.15.38:0/3314229226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60c009d8d0 0x7f60c0063ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:43.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.995+0000 7f60bdffb700 1 -- 172.21.15.38:0/3314229226 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930720447 0 0) 0x7f60c0065940 con 0x7f60c0146680 2020-06-12T17:49:43.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.995+0000 7f60bdffb700 1 -- 172.21.15.38:0/3314229226 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60a0002fe0 con 0x7f60c0146680 2020-06-12T17:49:43.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.996+0000 7f60bdffb700 1 -- 172.21.15.38:0/3314229226 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1098694412 0 0) 0x7f60c0154c50 con 0x7f60c00b2eb0 2020-06-12T17:49:43.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.996+0000 7f60bdffb700 1 -- 172.21.15.38:0/3314229226 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60c0065940 con 0x7f60c00b2eb0 2020-06-12T17:49:43.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.996+0000 7f60bdffb700 1 -- 172.21.15.38:0/3314229226 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 629697703 0 0) 0x7f60a0002fe0 con 0x7f60c0146680 2020-06-12T17:49:43.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.996+0000 7f60c48d2700 1 -- 172.21.15.38:0/3314229226 >> v1:172.21.15.150:6789/0 conn(0x7f60c00b2eb0 legacy=0x7f60c0065de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:43.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.996+0000 7f60c48d2700 1 -- 172.21.15.38:0/3314229226 >> v1:172.21.15.38:6789/0 conn(0x7f60c0146680 legacy=0x7f60c0061a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:43.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.996+0000 7f60c48d2700 1 -- 172.21.15.38:0/3314229226 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c00664f0 con 0x7f60c009d8d0 2020-06-12T17:49:43.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.996+0000 7f60c48d2700 1 --2- 172.21.15.38:0/3314229226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60c009d8d0 0x7f60c0063ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f60b8007c00 tx=0x7f60b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:43.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.996+0000 7f60c48d2700 1 --2- 172.21.15.38:0/3314229226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60c009d8d0 0x7f60c0063ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f60b8007c00 tx=0x7f60b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:43.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.996+0000 7f60c48d2700 1 --2- 172.21.15.38:0/3314229226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60c009d8d0 0x7f60c0063ed0 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f60b8007c00 tx=0x7f60b0007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:43.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.996+0000 7f60c48d2700 1 --2- 172.21.15.38:0/3314229226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60c009d8d0 0x7f60c0063ed0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f60b8007c00 tx=0x7f60b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:43.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.996+0000 7f60bdffb700 1 -- 172.21.15.38:0/3314229226 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60b800ad60 con 0x7f60c009d8d0 2020-06-12T17:49:43.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.996+0000 7f60c48d2700 1 --2- 172.21.15.38:0/3314229226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60c009d8d0 0x7f60c0063ed0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f60b8007c00 tx=0x7f60b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:43.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.996+0000 7f60c48d2700 1 --2- 172.21.15.38:0/3314229226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60c009d8d0 0x7f60c0063ed0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f60b8007c00 tx=0x7f60b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:43.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.996+0000 7f60bdffb700 1 -- 172.21.15.38:0/3314229226 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b0005c00 con 0x7f60c009d8d0 2020-06-12T17:49:43.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.996+0000 7f60c6b36700 1 -- 172.21.15.38:0/3314229226 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c0062140 con 0x7f60c009d8d0 2020-06-12T17:49:43.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.996+0000 7f60bdffb700 1 -- 172.21.15.38:0/3314229226 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60b0005d70 con 0x7f60c009d8d0 2020-06-12T17:49:43.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.996+0000 7f60c6b36700 1 -- 172.21.15.38:0/3314229226 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c01548e0 con 0x7f60c009d8d0 2020-06-12T17:49:43.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.997+0000 7f60c48d2700 1 --2- 172.21.15.38:0/3314229226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60c009d8d0 0x7f60c0063ed0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f60b8007c00 tx=0x7f60b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:43.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.997+0000 7f60c6b36700 1 -- 172.21.15.38:0/3314229226 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c0065b40 con 0x7f60c009d8d0 2020-06-12T17:49:43.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.997+0000 7f60bdffb700 1 -- 172.21.15.38:0/3314229226 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f60b0007350 con 0x7f60c009d8d0 2020-06-12T17:49:43.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.997+0000 7f60c48d2700 1 --2- 172.21.15.38:0/3314229226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60c009d8d0 0x7f60c0063ed0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f60b8007c00 tx=0x7f60b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:43.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.998+0000 7f60bdffb700 1 --2- 172.21.15.38:0/3314229226 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f60a004d9c0 0x7f60a004fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:43.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.998+0000 7f60bdffb700 1 -- 172.21.15.38:0/3314229226 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f60b0060640 con 0x7f60c009d8d0 2020-06-12T17:49:43.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.998+0000 7f60bffff700 1 --2- 172.21.15.38:0/3314229226 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f60a004d9c0 0x7f60a004fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:43.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.998+0000 7f60bffff700 1 --2- 172.21.15.38:0/3314229226 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f60a004d9c0 0x7f60a004fe80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f60b4001040 tx=0x7f60b4002600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:43.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.998+0000 7f60bffff700 1 --2- 172.21.15.38:0/3314229226 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f60a004d9c0 0x7f60a004fe80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f60b4001040 tx=0x7f60b4002600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:43.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:42.998+0000 7f60bffff700 1 --2- 172.21.15.38:0/3314229226 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f60a004d9c0 0x7f60a004fe80 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7f60b4001040 tx=0x7f60b4002600).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:43.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:43.001+0000 7f60c48d2700 1 --2- 172.21.15.38:0/3314229226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60c009d8d0 0x7f60c0063ed0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f60b8007c00 tx=0x7f60b0007e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:43.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:43.001+0000 7f60bdffb700 1 -- 172.21.15.38:0/3314229226 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f60c0065b40 con 0x7f60c009d8d0 2020-06-12T17:49:43.203 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:43.200+0000 7f60c6b36700 1 -- 172.21.15.38:0/3314229226 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_9609", "target": ["mon-mgr", ""]}) v1 -- 0x7f60c0063940 con 0x7f60a004d9c0 2020-06-12T17:49:43.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:43.204+0000 7f60bffff700 1 --2- 172.21.15.38:0/3314229226 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f60a004d9c0 0x7f60a004fe80 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f60b4001040 tx=0x7f60b4002600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:43.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:43.204+0000 7f60bdffb700 1 -- 172.21.15.38:0/3314229226 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f60c0063940 con 0x7f60a004d9c0 2020-06-12T17:49:43.207 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_9609/2c38f78a-95a7-4a45-8121-da73c796b723 2020-06-12T17:49:43.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:43.204+0000 7f60c6b36700 1 -- 172.21.15.38:0/3314229226 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f60a004d9c0 msgr2=0x7f60a004fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:43.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:43.204+0000 7f60c6b36700 1 --2- 172.21.15.38:0/3314229226 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f60a004d9c0 0x7f60a004fe80 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7f60b4001040 tx=0x7f60b4002600).stop 2020-06-12T17:49:43.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:43.204+0000 7f60c6b36700 1 -- 172.21.15.38:0/3314229226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60c009d8d0 msgr2=0x7f60c0063ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:43.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:43.204+0000 7f60c6b36700 1 --2- 172.21.15.38:0/3314229226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60c009d8d0 0x7f60c0063ed0 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f60b8007c00 tx=0x7f60b0007e00).stop 2020-06-12T17:49:43.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:43.204+0000 7f60c6b36700 1 -- 172.21.15.38:0/3314229226 shutdown_connections 2020-06-12T17:49:43.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:43.204+0000 7f60c6b36700 1 --2- 172.21.15.38:0/3314229226 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f60a004d9c0 0x7f60a004fe80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:43.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:43.204+0000 7f60c6b36700 1 --2- 172.21.15.38:0/3314229226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60c009d8d0 0x7f60c0063ed0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:43.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:43.204+0000 7f60c6b36700 1 -- 172.21.15.38:0/3314229226 >> 172.21.15.38:0/3314229226 conn(0x7f60c00b5a20 msgr2=0x7f60c00b64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:43.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:43.204+0000 7f60c6b36700 1 -- 172.21.15.38:0/3314229226 shutdown_connections 2020-06-12T17:49:43.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:43.204+0000 7f60c6b36700 1 -- 172.21.15.38:0/3314229226 wait complete. 2020-06-12T17:49:43.221 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_9609 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_9609/2c38f78a-95a7-4a45-8121-da73c796b723 2020-06-12T17:49:43.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:43.222 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:43.223 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:43.238 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:43.238 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:43.239 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9609/2c38f78a-95a7-4a45-8121-da73c796b723/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:43.329 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:43.329 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:43.329 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011572 s, 90.6 MB/s 2020-06-12T17:49:43.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:43.331 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:43.331 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:43.346 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:43.347 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:43.347 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9609/2c38f78a-95a7-4a45-8121-da73c796b723/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:43.434 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:43.435 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:43.435 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105263 s, 99.6 MB/s 2020-06-12T17:49:43.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:43.437 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:43.437 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:43.452 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:43.453 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:43.453 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9609/2c38f78a-95a7-4a45-8121-da73c796b723/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:43.541 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:43.542 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:43.542 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134195 s, 78.1 MB/s 2020-06-12T17:49:43.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:43.544 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:43.544 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:43.559 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:43.559 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:43.560 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9609/2c38f78a-95a7-4a45-8121-da73c796b723/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:43.647 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:43.647 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:43.648 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107517 s, 97.5 MB/s 2020-06-12T17:49:43.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:43.649 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:43.650 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:43.666 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:43.666 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:43.667 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9609/2c38f78a-95a7-4a45-8121-da73c796b723/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:43.755 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:43.755 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:43.755 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124934 s, 83.9 MB/s 2020-06-12T17:49:43.756 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:43.757 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:43.759 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:43.774 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:43.774 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:43.775 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9609/2c38f78a-95a7-4a45-8121-da73c796b723/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:43.861 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:43.862 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:43.862 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106257 s, 98.7 MB/s 2020-06-12T17:49:43.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:43.864 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:43.864 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:43.879 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:43.879 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:43.880 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9609/2c38f78a-95a7-4a45-8121-da73c796b723/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:43.968 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:43.969 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:43.969 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115204 s, 91.0 MB/s 2020-06-12T17:49:43.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:43.971 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:43.972 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:43.987 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:43.987 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:43.988 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9609/2c38f78a-95a7-4a45-8121-da73c796b723/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:44.074 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:44.075 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:44.075 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112147 s, 93.5 MB/s 2020-06-12T17:49:44.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:44.076 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:44.077 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:44.091 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:44.092 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:44.093 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9609/2c38f78a-95a7-4a45-8121-da73c796b723/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:44.182 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:44.182 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:44.183 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130197 s, 80.5 MB/s 2020-06-12T17:49:44.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:44.184 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:44.184 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:44.200 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:44.200 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:44.201 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9609/2c38f78a-95a7-4a45-8121-da73c796b723/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:44.288 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:44.289 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:44.289 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011553 s, 90.8 MB/s 2020-06-12T17:49:44.290 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_8558 2020-06-12T17:49:44.407 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.404+0000 7fd1f3b49700 1 Processor -- start 2020-06-12T17:49:44.408 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.404+0000 7fd1f3b49700 1 -- start start 2020-06-12T17:49:44.411 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.405+0000 7fd1f3b49700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1ec146680 0x7fd1ec0ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:44.411 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.405+0000 7fd1f3b49700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd1ec0b2eb0 0x7fd1ec09d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:44.411 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.405+0000 7fd1f3b49700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ec146d20 con 0x7fd1ec09d620 2020-06-12T17:49:44.411 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.405+0000 7fd1f3b49700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ec066a80 con 0x7fd1ec0b2eb0 2020-06-12T17:49:44.411 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.405+0000 7fd1f3b49700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec146f50 con 0x7fd1ec146680 2020-06-12T17:49:44.412 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.405+0000 7fd1f10e4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd1ec0b2eb0 0x7fd1ec09d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:44.412 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.405+0000 7fd1f20e6700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd1ec09d620 0x7fd1ec09b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39864/0 (socket says 172.21.15.38:39864) 2020-06-12T17:49:44.412 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.405+0000 7fd1f20e6700 1 -- 172.21.15.38:0/850069678 learned_addr learned my addr 172.21.15.38:0/850069678 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:44.412 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.405+0000 7fd1f18e5700 1 --2- 172.21.15.38:0/850069678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1ec146680 0x7fd1ec0ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:44.412 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.405+0000 7fd1f10e4700 1 -- 172.21.15.38:0/850069678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1ec146680 msgr2=0x7fd1ec0ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:44.413 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.405+0000 7fd1f10e4700 1 --2- 172.21.15.38:0/850069678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1ec146680 0x7fd1ec0ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:44.413 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.405+0000 7fd1f10e4700 1 -- 172.21.15.38:0/850069678 >> v1:172.21.15.38:6789/0 conn(0x7fd1ec09d620 legacy=0x7fd1ec09b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:44.413 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.405+0000 7fd1f10e4700 1 -- 172.21.15.38:0/850069678 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec146a60 con 0x7fd1ec0b2eb0 2020-06-12T17:49:44.413 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.405+0000 7fd1f18e5700 1 --2- 172.21.15.38:0/850069678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1ec146680 0x7fd1ec0ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:49:44.413 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.405+0000 7fd1f10e4700 1 --2- 172.21.15.38:0/850069678 >> v2:172.21.15.38:3300/0 conn(0x7fd1ec0b2eb0 0x7fd1ec09d1c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd1e8002f30 tx=0x7fd1e8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.414 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.406+0000 7fd1f10e4700 1 --2- 172.21.15.38:0/850069678 >> v2:172.21.15.38:3300/0 conn(0x7fd1ec0b2eb0 0x7fd1ec09d1c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd1e8002f30 tx=0x7fd1e8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.414 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.406+0000 7fd1f10e4700 1 --2- 172.21.15.38:0/850069678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1ec0b2eb0 0x7fd1ec09d1c0 secure :-1 s=READY pgs=540 cs=0 l=1 rx=0x7fd1e8002f30 tx=0x7fd1e8007e60).ready entity=mon.0 client_cookie=f0b64dfe5e9f901d server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:44.414 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.406+0000 7fd1f10e4700 1 --2- 172.21.15.38:0/850069678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1ec0b2eb0 0x7fd1ec09d1c0 secure :-1 s=THROTTLE_DONE pgs=540 cs=0 l=1 rx=0x7fd1e8002f30 tx=0x7fd1e8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.414 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.406+0000 7fd1f08e3700 1 -- 172.21.15.38:0/850069678 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1e8011430 con 0x7fd1ec0b2eb0 2020-06-12T17:49:44.414 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.406+0000 7fd1f10e4700 1 --2- 172.21.15.38:0/850069678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1ec0b2eb0 0x7fd1ec09d1c0 secure :-1 s=THROTTLE_DONE pgs=540 cs=0 l=1 rx=0x7fd1e8002f30 tx=0x7fd1e8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.415 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.406+0000 7fd1f10e4700 1 --2- 172.21.15.38:0/850069678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1ec0b2eb0 0x7fd1ec09d1c0 secure :-1 s=THROTTLE_DONE pgs=540 cs=0 l=1 rx=0x7fd1e8002f30 tx=0x7fd1e8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.415 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.406+0000 7fd1f08e3700 1 -- 172.21.15.38:0/850069678 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e8011590 con 0x7fd1ec0b2eb0 2020-06-12T17:49:44.415 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.406+0000 7fd1f08e3700 1 -- 172.21.15.38:0/850069678 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1e80119b0 con 0x7fd1ec0b2eb0 2020-06-12T17:49:44.415 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.406+0000 7fd1f3b49700 1 -- 172.21.15.38:0/850069678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1ec0b2eb0 msgr2=0x7fd1ec09d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:44.415 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.406+0000 7fd1f3b49700 1 --2- 172.21.15.38:0/850069678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1ec0b2eb0 0x7fd1ec09d1c0 secure :-1 s=READY pgs=540 cs=0 l=1 rx=0x7fd1e8002f30 tx=0x7fd1e8007e60).stop 2020-06-12T17:49:44.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.406+0000 7fd1f3b49700 1 -- 172.21.15.38:0/850069678 shutdown_connections 2020-06-12T17:49:44.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.406+0000 7fd1f3b49700 1 --2- 172.21.15.38:0/850069678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1ec146680 0x7fd1ec0ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:44.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.406+0000 7fd1f3b49700 1 --2- 172.21.15.38:0/850069678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1ec0b2eb0 0x7fd1ec09d1c0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:44.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.406+0000 7fd1f3b49700 1 -- 172.21.15.38:0/850069678 >> 172.21.15.38:0/850069678 conn(0x7fd1ec0b5a20 msgr2=0x7fd1ec05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:44.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.406+0000 7fd1f3b49700 1 -- 172.21.15.38:0/850069678 shutdown_connections 2020-06-12T17:49:44.417 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.406+0000 7fd1f3b49700 1 -- 172.21.15.38:0/850069678 wait complete. 2020-06-12T17:49:44.417 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.407+0000 7fd1f3b49700 1 Processor -- start 2020-06-12T17:49:44.417 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.407+0000 7fd1f3b49700 1 -- start start 2020-06-12T17:49:44.420 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.408+0000 7fd1f3b49700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd1ec09d620 0x7fd1ec062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:44.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.408+0000 7fd1f3b49700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd1ec146680 0x7fd1ec1574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:44.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.408+0000 7fd1f3b49700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ec157930 con 0x7fd1ec0b2eb0 2020-06-12T17:49:44.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.408+0000 7fd1f3b49700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ec09a910 con 0x7fd1ec09d620 2020-06-12T17:49:44.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.408+0000 7fd1f3b49700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ec09abb0 con 0x7fd1ec146680 2020-06-12T17:49:44.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.408+0000 7fd1f18e5700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd1ec09d620 0x7fd1ec062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:44.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.408+0000 7fd1f10e4700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd1ec0b2eb0 0x7fd1ec09cb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39870/0 (socket says 172.21.15.38:39870) 2020-06-12T17:49:44.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.408+0000 7fd1f18e5700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd1ec09d620 0x7fd1ec062d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38052/0 (socket says 172.21.15.38:38052) 2020-06-12T17:49:44.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.408+0000 7fd1f10e4700 1 -- 172.21.15.38:0/908696992 learned_addr learned my addr 172.21.15.38:0/908696992 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:44.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.408+0000 7fd1f20e6700 1 --2- 172.21.15.38:0/908696992 >> v2:172.21.15.150:3300/0 conn(0x7fd1ec146680 0x7fd1ec1574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:44.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.408+0000 7fd1f18e5700 1 -- 172.21.15.38:0/908696992 >> v2:172.21.15.150:3300/0 conn(0x7fd1ec146680 msgr2=0x7fd1ec1574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:44.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.408+0000 7fd1f18e5700 1 --2- 172.21.15.38:0/908696992 >> v2:172.21.15.150:3300/0 conn(0x7fd1ec146680 0x7fd1ec1574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:44.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.408+0000 7fd1f18e5700 1 -- 172.21.15.38:0/908696992 >> v1:172.21.15.38:6789/0 conn(0x7fd1ec0b2eb0 legacy=0x7fd1ec09cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:44.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.408+0000 7fd1daffd700 1 -- 172.21.15.38:0/908696992 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3785364966 0 0) 0x7fd1ec157930 con 0x7fd1ec0b2eb0 2020-06-12T17:49:44.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.408+0000 7fd1f18e5700 1 -- 172.21.15.38:0/908696992 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec09ae50 con 0x7fd1ec09d620 2020-06-12T17:49:44.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.408+0000 7fd1f20e6700 1 --2- 172.21.15.38:0/908696992 >> v2:172.21.15.150:3300/0 conn(0x7fd1ec146680 0x7fd1ec1574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:49:44.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.408+0000 7fd1f18e5700 1 --2- 172.21.15.38:0/908696992 >> v2:172.21.15.38:3300/0 conn(0x7fd1ec09d620 0x7fd1ec062d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd1ec0b40b0 tx=0x7fd1dc00dfa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.408+0000 7fd1f18e5700 1 --2- 172.21.15.38:0/908696992 >> v2:172.21.15.38:3300/0 conn(0x7fd1ec09d620 0x7fd1ec062d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd1ec0b40b0 tx=0x7fd1dc00dfa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.408+0000 7fd1f18e5700 1 --2- 172.21.15.38:0/908696992 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1ec09d620 0x7fd1ec062d40 secure :-1 s=READY pgs=542 cs=0 l=1 rx=0x7fd1ec0b40b0 tx=0x7fd1dc00dfa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:44.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.409+0000 7fd1f18e5700 1 --2- 172.21.15.38:0/908696992 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1ec09d620 0x7fd1ec062d40 secure :-1 s=THROTTLE_DONE pgs=542 cs=0 l=1 rx=0x7fd1ec0b40b0 tx=0x7fd1dc00dfa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.409+0000 7fd1daffd700 1 -- 172.21.15.38:0/908696992 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1dc005e90 con 0x7fd1ec09d620 2020-06-12T17:49:44.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.409+0000 7fd1f18e5700 1 --2- 172.21.15.38:0/908696992 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1ec09d620 0x7fd1ec062d40 secure :-1 s=THROTTLE_DONE pgs=542 cs=0 l=1 rx=0x7fd1ec0b40b0 tx=0x7fd1dc00dfa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.409+0000 7fd1f18e5700 1 --2- 172.21.15.38:0/908696992 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1ec09d620 0x7fd1ec062d40 secure :-1 s=THROTTLE_DONE pgs=542 cs=0 l=1 rx=0x7fd1ec0b40b0 tx=0x7fd1dc00dfa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.409+0000 7fd1daffd700 1 -- 172.21.15.38:0/908696992 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1dc007160 con 0x7fd1ec09d620 2020-06-12T17:49:44.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.409+0000 7fd1f3b49700 1 -- 172.21.15.38:0/908696992 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ec09d290 con 0x7fd1ec09d620 2020-06-12T17:49:44.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.409+0000 7fd1daffd700 1 -- 172.21.15.38:0/908696992 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1dc007540 con 0x7fd1ec09d620 2020-06-12T17:49:44.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.409+0000 7fd1f3b49700 1 -- 172.21.15.38:0/908696992 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ec09a4e0 con 0x7fd1ec09d620 2020-06-12T17:49:44.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.409+0000 7fd1f18e5700 1 --2- 172.21.15.38:0/908696992 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1ec09d620 0x7fd1ec062d40 secure :-1 s=THROTTLE_DONE pgs=542 cs=0 l=1 rx=0x7fd1ec0b40b0 tx=0x7fd1dc00dfa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.410+0000 7fd1daffd700 1 -- 172.21.15.38:0/908696992 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fd1dc012100 con 0x7fd1ec09d620 2020-06-12T17:49:44.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.410+0000 7fd1f18e5700 1 --2- 172.21.15.38:0/908696992 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1ec09d620 0x7fd1ec062d40 secure :-1 s=THROTTLE_DONE pgs=542 cs=0 l=1 rx=0x7fd1ec0b40b0 tx=0x7fd1dc00dfa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.410+0000 7fd1f3b49700 1 -- 172.21.15.38:0/908696992 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1ec067b20 con 0x7fd1ec09d620 2020-06-12T17:49:44.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.410+0000 7fd1daffd700 1 --2- 172.21.15.38:0/908696992 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd1cc04d5a0 0x7fd1cc04fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:44.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.410+0000 7fd1daffd700 1 -- 172.21.15.38:0/908696992 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd1dc007e40 con 0x7fd1ec09d620 2020-06-12T17:49:44.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.411+0000 7fd1f10e4700 1 --2- 172.21.15.38:0/908696992 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd1cc04d5a0 0x7fd1cc04fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:44.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.411+0000 7fd1f10e4700 1 --2- 172.21.15.38:0/908696992 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd1cc04d5a0 0x7fd1cc04fa60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd1e8002ed0 tx=0x7fd1e8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.411+0000 7fd1f10e4700 1 --2- 172.21.15.38:0/908696992 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd1cc04d5a0 0x7fd1cc04fa60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd1e8002ed0 tx=0x7fd1e8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.411+0000 7fd1f10e4700 1 --2- 172.21.15.38:0/908696992 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd1cc04d5a0 0x7fd1cc04fa60 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7fd1e8002ed0 tx=0x7fd1e8007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:44.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.414+0000 7fd1f18e5700 1 --2- 172.21.15.38:0/908696992 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1ec09d620 0x7fd1ec062d40 secure :-1 s=THROTTLE_DONE pgs=542 cs=0 l=1 rx=0x7fd1ec0b40b0 tx=0x7fd1dc00dfa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.414+0000 7fd1daffd700 1 -- 172.21.15.38:0/908696992 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fd1dc03c5b0 con 0x7fd1ec09d620 2020-06-12T17:49:44.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.609+0000 7fd1f3b49700 1 -- 172.21.15.38:0/908696992 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_8558", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1ec056c30 con 0x7fd1cc04d5a0 2020-06-12T17:49:44.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.627+0000 7fd1f10e4700 1 --2- 172.21.15.38:0/908696992 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd1cc04d5a0 0x7fd1cc04fa60 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7fd1e8002ed0 tx=0x7fd1e8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.631 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.627+0000 7fd1daffd700 1 -- 172.21.15.38:0/908696992 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd1ec056c30 con 0x7fd1cc04d5a0 2020-06-12T17:49:44.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.629+0000 7fd1f3b49700 1 -- 172.21.15.38:0/908696992 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd1cc04d5a0 msgr2=0x7fd1cc04fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:44.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.629+0000 7fd1f3b49700 1 --2- 172.21.15.38:0/908696992 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd1cc04d5a0 0x7fd1cc04fa60 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7fd1e8002ed0 tx=0x7fd1e8007e60).stop 2020-06-12T17:49:44.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.629+0000 7fd1f3b49700 1 -- 172.21.15.38:0/908696992 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1ec09d620 msgr2=0x7fd1ec062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:44.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.629+0000 7fd1f3b49700 1 --2- 172.21.15.38:0/908696992 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1ec09d620 0x7fd1ec062d40 secure :-1 s=READY pgs=542 cs=0 l=1 rx=0x7fd1ec0b40b0 tx=0x7fd1dc00dfa0).stop 2020-06-12T17:49:44.633 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.629+0000 7fd1f3b49700 1 -- 172.21.15.38:0/908696992 shutdown_connections 2020-06-12T17:49:44.634 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.629+0000 7fd1f3b49700 1 --2- 172.21.15.38:0/908696992 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd1cc04d5a0 0x7fd1cc04fa60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:44.634 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.629+0000 7fd1f3b49700 1 --2- 172.21.15.38:0/908696992 >> v2:172.21.15.150:3300/0 conn(0x7fd1ec146680 0x7fd1ec1574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:44.634 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.629+0000 7fd1f3b49700 1 --2- 172.21.15.38:0/908696992 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1ec09d620 0x7fd1ec062d40 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:44.634 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.629+0000 7fd1f3b49700 1 -- 172.21.15.38:0/908696992 >> 172.21.15.38:0/908696992 conn(0x7fd1ec0b5a20 msgr2=0x7fd1ec0b1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:44.634 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.629+0000 7fd1f3b49700 1 -- 172.21.15.38:0/908696992 shutdown_connections 2020-06-12T17:49:44.635 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.629+0000 7fd1f3b49700 1 -- 172.21.15.38:0/908696992 wait complete. 2020-06-12T17:49:44.642 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_8558 2020-06-12T17:49:44.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.755+0000 7f6ad535b700 1 Processor -- start 2020-06-12T17:49:44.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.755+0000 7f6ad535b700 1 -- start start 2020-06-12T17:49:44.761 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.756+0000 7f6ad535b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6ad00ad5b0 0x7f6ad00b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:44.762 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.756+0000 7f6ad535b700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad0146d20 con 0x7f6ad0146680 2020-06-12T17:49:44.762 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.756+0000 7f6ad535b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad0066a80 con 0x7f6ad009d8d0 2020-06-12T17:49:44.762 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.756+0000 7f6ad535b700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad0146f50 con 0x7f6ad00ad5b0 2020-06-12T17:49:44.762 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.756+0000 7f6ace7fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6ad00ad5b0 0x7f6ad00b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:44.762 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.756+0000 7f6aceffd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6ad0146680 0x7f6ad009d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39876/0 (socket says 172.21.15.38:39876) 2020-06-12T17:49:44.763 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.756+0000 7f6aceffd700 1 -- 172.21.15.38:0/3127113511 learned_addr learned my addr 172.21.15.38:0/3127113511 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:44.763 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.757+0000 7f6ace7fc700 1 -- 172.21.15.38:0/3127113511 >> v1:172.21.15.150:6789/0 conn(0x7f6ad009d8d0 legacy=0x7f6ad01421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:44.763 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.757+0000 7f6ace7fc700 1 -- 172.21.15.38:0/3127113511 >> v1:172.21.15.38:6789/0 conn(0x7f6ad0146680 legacy=0x7f6ad009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:44.763 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.757+0000 7f6acdffb700 1 -- 172.21.15.38:0/3127113511 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2013419816 0 0) 0x7f6ad0146d20 con 0x7f6ad0146680 2020-06-12T17:49:44.763 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.757+0000 7f6ace7fc700 1 -- 172.21.15.38:0/3127113511 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad0146a60 con 0x7f6ad00ad5b0 2020-06-12T17:49:44.764 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.757+0000 7f6ace7fc700 1 --2- 172.21.15.38:0/3127113511 >> v2:172.21.15.38:3300/0 conn(0x7f6ad00ad5b0 0x7f6ad00b2eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6ac0002f30 tx=0x7f6ac0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.764 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.757+0000 7f6ace7fc700 1 --2- 172.21.15.38:0/3127113511 >> v2:172.21.15.38:3300/0 conn(0x7f6ad00ad5b0 0x7f6ad00b2eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6ac0002f30 tx=0x7f6ac0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.764 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.757+0000 7f6ace7fc700 1 --2- 172.21.15.38:0/3127113511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ad00ad5b0 0x7f6ad00b2eb0 secure :-1 s=READY pgs=544 cs=0 l=1 rx=0x7f6ac0002f30 tx=0x7f6ac0007e60).ready entity=mon.0 client_cookie=98cb56f538492bbd server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:44.764 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.757+0000 7f6ace7fc700 1 --2- 172.21.15.38:0/3127113511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ad00ad5b0 0x7f6ad00b2eb0 secure :-1 s=THROTTLE_DONE pgs=544 cs=0 l=1 rx=0x7f6ac0002f30 tx=0x7f6ac0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.764 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.757+0000 7f6acdffb700 1 -- 172.21.15.38:0/3127113511 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ac0011430 con 0x7f6ad00ad5b0 2020-06-12T17:49:44.765 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.757+0000 7f6ace7fc700 1 --2- 172.21.15.38:0/3127113511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ad00ad5b0 0x7f6ad00b2eb0 secure :-1 s=THROTTLE_DONE pgs=544 cs=0 l=1 rx=0x7f6ac0002f30 tx=0x7f6ac0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.765 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.757+0000 7f6ace7fc700 1 --2- 172.21.15.38:0/3127113511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ad00ad5b0 0x7f6ad00b2eb0 secure :-1 s=THROTTLE_DONE pgs=544 cs=0 l=1 rx=0x7f6ac0002f30 tx=0x7f6ac0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.765 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.757+0000 7f6acdffb700 1 -- 172.21.15.38:0/3127113511 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac0011590 con 0x7f6ad00ad5b0 2020-06-12T17:49:44.765 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.757+0000 7f6acdffb700 1 -- 172.21.15.38:0/3127113511 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ac0011970 con 0x7f6ad00ad5b0 2020-06-12T17:49:44.766 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.757+0000 7f6ad535b700 1 -- 172.21.15.38:0/3127113511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ad00ad5b0 msgr2=0x7f6ad00b2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:44.766 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.757+0000 7f6ad535b700 1 --2- 172.21.15.38:0/3127113511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ad00ad5b0 0x7f6ad00b2eb0 secure :-1 s=READY pgs=544 cs=0 l=1 rx=0x7f6ac0002f30 tx=0x7f6ac0007e60).stop 2020-06-12T17:49:44.766 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.758+0000 7f6ad535b700 1 -- 172.21.15.38:0/3127113511 shutdown_connections 2020-06-12T17:49:44.767 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.758+0000 7f6ad535b700 1 --2- 172.21.15.38:0/3127113511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ad00ad5b0 0x7f6ad00b2eb0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:44.767 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.758+0000 7f6ad535b700 1 -- 172.21.15.38:0/3127113511 >> 172.21.15.38:0/3127113511 conn(0x7f6ad00b5a20 msgr2=0x7f6ad005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:44.767 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.758+0000 7f6ad535b700 1 -- 172.21.15.38:0/3127113511 shutdown_connections 2020-06-12T17:49:44.767 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.758+0000 7f6ad535b700 1 -- 172.21.15.38:0/3127113511 wait complete. 2020-06-12T17:49:44.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.758+0000 7f6ad535b700 1 Processor -- start 2020-06-12T17:49:44.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.759+0000 7f6ad535b700 1 -- start start 2020-06-12T17:49:44.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.759+0000 7f6ad535b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6ad00ad5b0 0x7f6ad00b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:44.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.759+0000 7f6ad535b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ad0146680 0x7f6ad00b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:44.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.759+0000 7f6ad535b700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad00b3f20 con 0x7f6ad009d8d0 2020-06-12T17:49:44.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.759+0000 7f6ad535b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad00b1020 con 0x7f6ad00ad5b0 2020-06-12T17:49:44.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.759+0000 7f6ad535b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad00b12c0 con 0x7f6ad0146680 2020-06-12T17:49:44.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.759+0000 7f6aceffd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6ad009d8d0 0x7f6ad0064dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39880/0 (socket says 172.21.15.38:39880) 2020-06-12T17:49:44.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.759+0000 7f6aceffd700 1 -- 172.21.15.38:0/1996969592 learned_addr learned my addr 172.21.15.38:0/1996969592 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:44.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.759+0000 7f6abffff700 1 -- 172.21.15.38:0/1996969592 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 749926761 0 0) 0x7f6ac4000ff0 con 0x7f6ad009d8d0 2020-06-12T17:49:44.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.759+0000 7f6abffff700 1 -- 172.21.15.38:0/1996969592 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6aac002fe0 con 0x7f6ad009d8d0 2020-06-12T17:49:44.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6ace7fc700 1 --2- 172.21.15.38:0/1996969592 >> v2:172.21.15.150:3300/0 conn(0x7f6ad00ad5b0 0x7f6ad00b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:44.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6acf7fe700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ad0146680 0x7f6ad00b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:44.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6abffff700 1 -- 172.21.15.38:0/1996969592 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2754348969 0 0) 0x7f6aac002fe0 con 0x7f6ad009d8d0 2020-06-12T17:49:44.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6abffff700 1 -- 172.21.15.38:0/1996969592 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6ac4000ff0 con 0x7f6ad009d8d0 2020-06-12T17:49:44.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6abffff700 1 -- 172.21.15.38:0/1996969592 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f6ac40019a0 con 0x7f6ad009d8d0 2020-06-12T17:49:44.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6abffff700 1 -- 172.21.15.38:0/1996969592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ad0146680 msgr2=0x7f6ad00b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:44.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6abffff700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ad0146680 0x7f6ad00b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:44.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6abffff700 1 -- 172.21.15.38:0/1996969592 >> v2:172.21.15.150:3300/0 conn(0x7f6ad00ad5b0 msgr2=0x7f6ad00b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:44.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6abffff700 1 --2- 172.21.15.38:0/1996969592 >> v2:172.21.15.150:3300/0 conn(0x7f6ad00ad5b0 0x7f6ad00b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:44.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6abffff700 1 -- 172.21.15.38:0/1996969592 >> v1:172.21.15.38:6789/0 conn(0x7f6ad009d8d0 legacy=0x7f6ad0064dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:44.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6abffff700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ad0146680 0x7f6aac0049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:44.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6abffff700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6aac004e10 0x7f6aac003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:44.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6abffff700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6aac003d80 0x7f6aac004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:44.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6abffff700 1 -- 172.21.15.38:0/1996969592 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad00b1020 con 0x7f6aac003d80 2020-06-12T17:49:44.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6abffff700 1 -- 172.21.15.38:0/1996969592 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad00b12c0 con 0x7f6aac004e10 2020-06-12T17:49:44.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6abffff700 1 -- 172.21.15.38:0/1996969592 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac005330 con 0x7f6ad0146680 2020-06-12T17:49:44.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6acf7fe700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6aac003d80 0x7f6aac004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:44.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6ace7fc700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6aac004e10 0x7f6aac003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:44.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6aceffd700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ad0146680 0x7f6aac0049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:44.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6acf7fe700 1 -- 172.21.15.38:0/1996969592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ad0146680 msgr2=0x7f6aac0049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:44.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6acf7fe700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ad0146680 0x7f6aac0049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:44.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6acf7fe700 1 -- 172.21.15.38:0/1996969592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6aac004e10 msgr2=0x7f6aac003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:44.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6acf7fe700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6aac004e10 0x7f6aac003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:44.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6acf7fe700 1 -- 172.21.15.38:0/1996969592 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad00b1560 con 0x7f6aac003d80 2020-06-12T17:49:44.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6ad535b700 1 -- 172.21.15.38:0/1996969592 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad0063a10 con 0x7f6aac003d80 2020-06-12T17:49:44.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6acf7fe700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6aac003d80 0x7f6aac004200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ac80022d0 tx=0x7f6ac8002a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6ad535b700 1 -- 172.21.15.38:0/1996969592 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad0066300 con 0x7f6aac003d80 2020-06-12T17:49:44.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6acf7fe700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6aac003d80 0x7f6aac004200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ac80022d0 tx=0x7f6ac8002a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.760+0000 7f6acf7fe700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6aac003d80 0x7f6aac004200 secure :-1 s=READY pgs=546 cs=0 l=1 rx=0x7f6ac80022d0 tx=0x7f6ac8002a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:44.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.761+0000 7f6acf7fe700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6aac003d80 0x7f6aac004200 secure :-1 s=THROTTLE_DONE pgs=546 cs=0 l=1 rx=0x7f6ac80022d0 tx=0x7f6ac8002a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.761+0000 7f6abffff700 1 -- 172.21.15.38:0/1996969592 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ac8006c40 con 0x7f6aac003d80 2020-06-12T17:49:44.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.761+0000 7f6acf7fe700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6aac003d80 0x7f6aac004200 secure :-1 s=THROTTLE_DONE pgs=546 cs=0 l=1 rx=0x7f6ac80022d0 tx=0x7f6ac8002a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.780 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.761+0000 7f6acf7fe700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6aac003d80 0x7f6aac004200 secure :-1 s=THROTTLE_DONE pgs=546 cs=0 l=1 rx=0x7f6ac80022d0 tx=0x7f6ac8002a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.780 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.761+0000 7f6abffff700 1 -- 172.21.15.38:0/1996969592 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac8006da0 con 0x7f6aac003d80 2020-06-12T17:49:44.780 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.761+0000 7f6abffff700 1 -- 172.21.15.38:0/1996969592 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ac80035b0 con 0x7f6aac003d80 2020-06-12T17:49:44.780 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.761+0000 7f6acf7fe700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6aac003d80 0x7f6aac004200 secure :-1 s=THROTTLE_DONE pgs=546 cs=0 l=1 rx=0x7f6ac80022d0 tx=0x7f6ac8002a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.780 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.761+0000 7f6ad535b700 1 -- 172.21.15.38:0/1996969592 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab0003340 con 0x7f6aac003d80 2020-06-12T17:49:44.780 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.762+0000 7f6abffff700 1 -- 172.21.15.38:0/1996969592 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f6ac8003710 con 0x7f6aac003d80 2020-06-12T17:49:44.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.762+0000 7f6acf7fe700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6aac003d80 0x7f6aac004200 secure :-1 s=THROTTLE_DONE pgs=546 cs=0 l=1 rx=0x7f6ac80022d0 tx=0x7f6ac8002a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.762+0000 7f6abffff700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6aac055740 0x7f6aac057c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:44.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.762+0000 7f6abffff700 1 -- 172.21.15.38:0/1996969592 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f6ac8060d70 con 0x7f6aac003d80 2020-06-12T17:49:44.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.762+0000 7f6aceffd700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6aac055740 0x7f6aac057c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:44.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.762+0000 7f6aceffd700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6aac055740 0x7f6aac057c00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ac4005540 tx=0x7f6ac400ebd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.762+0000 7f6aceffd700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6aac055740 0x7f6aac057c00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ac4005540 tx=0x7f6ac400ebd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.762+0000 7f6aceffd700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6aac055740 0x7f6aac057c00 secure :-1 s=READY pgs=217 cs=0 l=1 rx=0x7f6ac4005540 tx=0x7f6ac400ebd0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:44.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.765+0000 7f6acf7fe700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6aac003d80 0x7f6aac004200 secure :-1 s=THROTTLE_DONE pgs=546 cs=0 l=1 rx=0x7f6ac80022d0 tx=0x7f6ac8002a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.765+0000 7f6abffff700 1 -- 172.21.15.38:0/1996969592 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f6ac803c550 con 0x7f6aac003d80 2020-06-12T17:49:44.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.958+0000 7f6ad535b700 1 -- 172.21.15.38:0/1996969592 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_8558", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ab0002200 con 0x7f6aac055740 2020-06-12T17:49:44.965 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.962+0000 7f6aceffd700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6aac055740 0x7f6aac057c00 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f6ac4005540 tx=0x7f6ac400ebd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:44.965 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.962+0000 7f6abffff700 1 -- 172.21.15.38:0/1996969592 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f6ab0002200 con 0x7f6aac055740 2020-06-12T17:49:44.966 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_8558/e4381b1b-48c5-44bd-95dc-f75d15d00ccd 2020-06-12T17:49:44.967 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.963+0000 7f6ad535b700 1 -- 172.21.15.38:0/1996969592 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6aac055740 msgr2=0x7f6aac057c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:44.967 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.963+0000 7f6ad535b700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6aac055740 0x7f6aac057c00 secure :-1 s=READY pgs=217 cs=0 l=1 rx=0x7f6ac4005540 tx=0x7f6ac400ebd0).stop 2020-06-12T17:49:44.967 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.963+0000 7f6ad535b700 1 -- 172.21.15.38:0/1996969592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6aac003d80 msgr2=0x7f6aac004200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:44.968 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.963+0000 7f6ad535b700 1 --2- 172.21.15.38:0/1996969592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6aac003d80 0x7f6aac004200 secure :-1 s=READY pgs=546 cs=0 l=1 rx=0x7f6ac80022d0 tx=0x7f6ac8002a10).stop 2020-06-12T17:49:44.968 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.963+0000 7f6acf7fe700 1 -- 172.21.15.38:0/1996969592 reap_dead start 2020-06-12T17:49:44.968 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.963+0000 7f6acf7fe700 1 -- 172.21.15.38:0/1996969592 reap_dead start 2020-06-12T17:49:44.968 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.963+0000 7f6ad535b700 1 -- 172.21.15.38:0/1996969592 shutdown_connections 2020-06-12T17:49:44.969 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.963+0000 7f6ad535b700 1 -- 172.21.15.38:0/1996969592 >> 172.21.15.38:0/1996969592 conn(0x7f6ad00b5a20 msgr2=0x7f6ad0145940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:44.969 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.963+0000 7f6ad535b700 1 -- 172.21.15.38:0/1996969592 shutdown_connections 2020-06-12T17:49:44.969 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:44.963+0000 7f6ad535b700 1 -- 172.21.15.38:0/1996969592 wait complete. 2020-06-12T17:49:44.976 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_8558 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_8558/e4381b1b-48c5-44bd-95dc-f75d15d00ccd 2020-06-12T17:49:44.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:44.977 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:44.978 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:44.992 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:44.993 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:44.994 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8558/e4381b1b-48c5-44bd-95dc-f75d15d00ccd/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:45.083 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:45.084 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:45.084 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111312 s, 94.2 MB/s 2020-06-12T17:49:45.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:45.086 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:45.086 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:45.100 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:45.101 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:45.102 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8558/e4381b1b-48c5-44bd-95dc-f75d15d00ccd/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:45.188 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:45.189 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:45.189 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113005 s, 92.8 MB/s 2020-06-12T17:49:45.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:45.190 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:45.191 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:45.206 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:45.206 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:45.207 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8558/e4381b1b-48c5-44bd-95dc-f75d15d00ccd/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:45.293 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:45.294 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:45.294 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105976 s, 98.9 MB/s 2020-06-12T17:49:45.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:45.296 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:45.296 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:45.311 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:45.312 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:45.313 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8558/e4381b1b-48c5-44bd-95dc-f75d15d00ccd/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:45.400 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:45.400 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:45.400 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112739 s, 93.0 MB/s 2020-06-12T17:49:45.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:45.402 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:45.402 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:45.417 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:45.418 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:45.418 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8558/e4381b1b-48c5-44bd-95dc-f75d15d00ccd/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:45.507 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:45.507 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:45.507 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117735 s, 89.1 MB/s 2020-06-12T17:49:45.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:45.509 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:45.509 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:45.525 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:45.525 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:45.526 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8558/e4381b1b-48c5-44bd-95dc-f75d15d00ccd/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:45.610 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:45.610 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:45.610 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108831 s, 96.3 MB/s 2020-06-12T17:49:45.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:45.612 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:45.613 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:45.627 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:45.628 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:45.629 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8558/e4381b1b-48c5-44bd-95dc-f75d15d00ccd/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:45.717 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:45.717 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:45.718 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123098 s, 85.2 MB/s 2020-06-12T17:49:45.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:45.719 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:45.720 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:45.774 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:45.775 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:45.775 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8558/e4381b1b-48c5-44bd-95dc-f75d15d00ccd/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:45.862 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:45.862 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:45.862 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109104 s, 96.1 MB/s 2020-06-12T17:49:45.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:45.864 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:45.864 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:45.879 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:45.879 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:45.880 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8558/e4381b1b-48c5-44bd-95dc-f75d15d00ccd/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:45.968 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:45.968 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:45.969 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108747 s, 96.4 MB/s 2020-06-12T17:49:45.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:45.970 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:45.971 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:45.986 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:45.986 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:45.987 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8558/e4381b1b-48c5-44bd-95dc-f75d15d00ccd/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:46.075 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:46.075 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:46.076 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113027 s, 92.8 MB/s 2020-06-12T17:49:46.077 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_5225 2020-06-12T17:49:46.194 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.191+0000 7f25f96f2700 1 Processor -- start 2020-06-12T17:49:46.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.191+0000 7f25f96f2700 1 -- start start 2020-06-12T17:49:46.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.192+0000 7f25f96f2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f25f4146680 0x7f25f40ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:46.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.192+0000 7f25f96f2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f409d8d0 0x7f25f41421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:46.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.192+0000 7f25f96f2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f4146d20 con 0x7f25f40b2eb0 2020-06-12T17:49:46.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.192+0000 7f25f96f2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f4066a80 con 0x7f25f4146680 2020-06-12T17:49:46.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.192+0000 7f25f96f2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4146f50 con 0x7f25f409d8d0 2020-06-12T17:49:46.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.192+0000 7f25f2ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f25f4146680 0x7f25f40ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:46.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.192+0000 7f25f37fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f409d8d0 0x7f25f41421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:46.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.192+0000 7f25f37fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f409d8d0 0x7f25f41421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:57536/0 (socket says 172.21.15.38:57536) 2020-06-12T17:49:46.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.192+0000 7f25f37fe700 1 -- 172.21.15.38:0/3446757824 learned_addr learned my addr 172.21.15.38:0/3446757824 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:46.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.192+0000 7f25f27fc700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f25f40b2eb0 0x7f25f409d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:60626/0 (socket says 172.21.15.38:60626) 2020-06-12T17:49:46.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.192+0000 7f25f37fe700 1 -- 172.21.15.38:0/3446757824 >> v2:172.21.15.150:3300/0 conn(0x7f25f4146680 msgr2=0x7f25f40ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:46.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.192+0000 7f25f37fe700 1 --2- 172.21.15.38:0/3446757824 >> v2:172.21.15.150:3300/0 conn(0x7f25f4146680 0x7f25f40ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:46.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.192+0000 7f25f37fe700 1 -- 172.21.15.38:0/3446757824 >> v1:172.21.15.150:6789/0 conn(0x7f25f40b2eb0 legacy=0x7f25f409d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:46.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.192+0000 7f25f37fe700 1 -- 172.21.15.38:0/3446757824 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f4146a60 con 0x7f25f409d8d0 2020-06-12T17:49:46.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.193+0000 7f25f37fe700 1 --2- 172.21.15.38:0/3446757824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f409d8d0 0x7f25f41421d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f25e4002f30 tx=0x7f25e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.193+0000 7f25f37fe700 1 --2- 172.21.15.38:0/3446757824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f409d8d0 0x7f25f41421d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f25e4002f30 tx=0x7f25e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.193+0000 7f25f37fe700 1 --2- 172.21.15.38:0/3446757824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f409d8d0 0x7f25f41421d0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f25e4002f30 tx=0x7f25e4007e60).ready entity=mon.2 client_cookie=6cad0e7ff87368b8 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:46.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.193+0000 7f25f37fe700 1 --2- 172.21.15.38:0/3446757824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f409d8d0 0x7f25f41421d0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f25e4002f30 tx=0x7f25e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.193+0000 7f25f1ffb700 1 -- 172.21.15.38:0/3446757824 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25e4011630 con 0x7f25f409d8d0 2020-06-12T17:49:46.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.193+0000 7f25f37fe700 1 --2- 172.21.15.38:0/3446757824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f409d8d0 0x7f25f41421d0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f25e4002f30 tx=0x7f25e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.193+0000 7f25f37fe700 1 --2- 172.21.15.38:0/3446757824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f409d8d0 0x7f25f41421d0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f25e4002f30 tx=0x7f25e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.193+0000 7f25f1ffb700 1 -- 172.21.15.38:0/3446757824 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e4011790 con 0x7f25f409d8d0 2020-06-12T17:49:46.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.193+0000 7f25f1ffb700 1 -- 172.21.15.38:0/3446757824 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25e4011bb0 con 0x7f25f409d8d0 2020-06-12T17:49:46.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.193+0000 7f25f96f2700 1 -- 172.21.15.38:0/3446757824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f409d8d0 msgr2=0x7f25f41421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:46.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.193+0000 7f25f96f2700 1 --2- 172.21.15.38:0/3446757824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f409d8d0 0x7f25f41421d0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f25e4002f30 tx=0x7f25e4007e60).stop 2020-06-12T17:49:46.203 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.193+0000 7f25f96f2700 1 -- 172.21.15.38:0/3446757824 shutdown_connections 2020-06-12T17:49:46.203 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.193+0000 7f25f96f2700 1 --2- 172.21.15.38:0/3446757824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f409d8d0 0x7f25f41421d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:46.203 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.193+0000 7f25f96f2700 1 --2- 172.21.15.38:0/3446757824 >> v2:172.21.15.150:3300/0 conn(0x7f25f4146680 0x7f25f40ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:46.203 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.193+0000 7f25f96f2700 1 -- 172.21.15.38:0/3446757824 >> 172.21.15.38:0/3446757824 conn(0x7f25f40b5a20 msgr2=0x7f25f405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:46.203 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.193+0000 7f25f96f2700 1 -- 172.21.15.38:0/3446757824 shutdown_connections 2020-06-12T17:49:46.204 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.193+0000 7f25f96f2700 1 -- 172.21.15.38:0/3446757824 wait complete. 2020-06-12T17:49:46.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.194+0000 7f25f96f2700 1 Processor -- start 2020-06-12T17:49:46.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.194+0000 7f25f96f2700 1 -- start start 2020-06-12T17:49:46.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.195+0000 7f25f96f2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f25f40b2eb0 0x7f25f40618e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:46.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.195+0000 7f25f96f2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f25f4146680 0x7f25f413ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:46.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.195+0000 7f25f96f2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f413f3d0 con 0x7f25f409d8d0 2020-06-12T17:49:46.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.195+0000 7f25f96f2700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f4064cd0 con 0x7f25f4146680 2020-06-12T17:49:46.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.195+0000 7f25f96f2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f4064f70 con 0x7f25f40b2eb0 2020-06-12T17:49:46.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.195+0000 7f25f37fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f25f4146680 0x7f25f413ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:46.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.195+0000 7f25f37fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f25f4146680 0x7f25f413ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38086/0 (socket says 172.21.15.38:38086) 2020-06-12T17:49:46.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.195+0000 7f25f37fe700 1 -- 172.21.15.38:0/90380025 learned_addr learned my addr 172.21.15.38:0/90380025 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:46.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.195+0000 7f25f27fc700 1 --2- 172.21.15.38:0/90380025 >> v2:172.21.15.150:3300/0 conn(0x7f25f40b2eb0 0x7f25f40618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:46.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.195+0000 7f25f37fe700 1 -- 172.21.15.38:0/90380025 >> v2:172.21.15.150:3300/0 conn(0x7f25f40b2eb0 msgr2=0x7f25f40618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:46.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.195+0000 7f25f37fe700 1 --2- 172.21.15.38:0/90380025 >> v2:172.21.15.150:3300/0 conn(0x7f25f40b2eb0 0x7f25f40618e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:46.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.195+0000 7f25f37fe700 1 -- 172.21.15.38:0/90380025 >> v1:172.21.15.150:6789/0 conn(0x7f25f409d8d0 legacy=0x7f25f413a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:46.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.195+0000 7f25f37fe700 1 -- 172.21.15.38:0/90380025 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f4065210 con 0x7f25f4146680 2020-06-12T17:49:46.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.196+0000 7f25f37fe700 1 --2- 172.21.15.38:0/90380025 >> v2:172.21.15.38:3300/0 conn(0x7f25f4146680 0x7f25f413ef70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f25e4002f30 tx=0x7f25e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.196+0000 7f25f37fe700 1 --2- 172.21.15.38:0/90380025 >> v2:172.21.15.38:3300/0 conn(0x7f25f4146680 0x7f25f413ef70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f25e4002f30 tx=0x7f25e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.196+0000 7f25f37fe700 1 --2- 172.21.15.38:0/90380025 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25f4146680 0x7f25f413ef70 secure :-1 s=READY pgs=547 cs=0 l=1 rx=0x7f25e4002f30 tx=0x7f25e4007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:46.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.196+0000 7f25f37fe700 1 --2- 172.21.15.38:0/90380025 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25f4146680 0x7f25f413ef70 secure :-1 s=THROTTLE_DONE pgs=547 cs=0 l=1 rx=0x7f25e4002f30 tx=0x7f25e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.196+0000 7f25e3fff700 1 -- 172.21.15.38:0/90380025 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25e4011c70 con 0x7f25f4146680 2020-06-12T17:49:46.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.196+0000 7f25f37fe700 1 --2- 172.21.15.38:0/90380025 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25f4146680 0x7f25f413ef70 secure :-1 s=THROTTLE_DONE pgs=547 cs=0 l=1 rx=0x7f25e4002f30 tx=0x7f25e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.196+0000 7f25f37fe700 1 --2- 172.21.15.38:0/90380025 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25f4146680 0x7f25f413ef70 secure :-1 s=THROTTLE_DONE pgs=547 cs=0 l=1 rx=0x7f25e4002f30 tx=0x7f25e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.196+0000 7f25e3fff700 1 -- 172.21.15.38:0/90380025 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e4011e20 con 0x7f25f4146680 2020-06-12T17:49:46.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.196+0000 7f25f96f2700 1 -- 172.21.15.38:0/90380025 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f413abc0 con 0x7f25f4146680 2020-06-12T17:49:46.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.196+0000 7f25e3fff700 1 -- 172.21.15.38:0/90380025 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25e4007530 con 0x7f25f4146680 2020-06-12T17:49:46.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.196+0000 7f25f96f2700 1 -- 172.21.15.38:0/90380025 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f4064800 con 0x7f25f4146680 2020-06-12T17:49:46.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.196+0000 7f25f37fe700 1 --2- 172.21.15.38:0/90380025 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25f4146680 0x7f25f413ef70 secure :-1 s=THROTTLE_DONE pgs=547 cs=0 l=1 rx=0x7f25e4002f30 tx=0x7f25e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.197+0000 7f25f96f2700 1 -- 172.21.15.38:0/90380025 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f4066f60 con 0x7f25f4146680 2020-06-12T17:49:46.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.197+0000 7f25e3fff700 1 -- 172.21.15.38:0/90380025 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f25e40056c0 con 0x7f25f4146680 2020-06-12T17:49:46.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.197+0000 7f25f37fe700 1 --2- 172.21.15.38:0/90380025 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25f4146680 0x7f25f413ef70 secure :-1 s=THROTTLE_DONE pgs=547 cs=0 l=1 rx=0x7f25e4002f30 tx=0x7f25e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.197+0000 7f25e3fff700 1 --2- 172.21.15.38:0/90380025 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f25d004d5f0 0x7f25d004fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:46.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.197+0000 7f25e3fff700 1 -- 172.21.15.38:0/90380025 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f25e4061390 con 0x7f25f4146680 2020-06-12T17:49:46.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.197+0000 7f25f2ffd700 1 --2- 172.21.15.38:0/90380025 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f25d004d5f0 0x7f25d004fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:46.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.197+0000 7f25f2ffd700 1 --2- 172.21.15.38:0/90380025 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f25d004d5f0 0x7f25d004fab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f25f40aeff0 tx=0x7f25ec0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.198+0000 7f25f2ffd700 1 --2- 172.21.15.38:0/90380025 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f25d004d5f0 0x7f25d004fab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f25f40aeff0 tx=0x7f25ec0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.198+0000 7f25f2ffd700 1 --2- 172.21.15.38:0/90380025 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f25d004d5f0 0x7f25d004fab0 secure :-1 s=READY pgs=218 cs=0 l=1 rx=0x7f25f40aeff0 tx=0x7f25ec0081e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:46.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.200+0000 7f25f37fe700 1 --2- 172.21.15.38:0/90380025 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25f4146680 0x7f25f413ef70 secure :-1 s=THROTTLE_DONE pgs=547 cs=0 l=1 rx=0x7f25e4002f30 tx=0x7f25e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.200+0000 7f25e3fff700 1 -- 172.21.15.38:0/90380025 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f25f4066f60 con 0x7f25f4146680 2020-06-12T17:49:46.400 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.396+0000 7f25f96f2700 1 -- 172.21.15.38:0/90380025 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_5225", "target": ["mon-mgr", ""]}) v1 -- 0x7f25f413ae70 con 0x7f25d004d5f0 2020-06-12T17:49:46.419 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.416+0000 7f25f2ffd700 1 --2- 172.21.15.38:0/90380025 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f25d004d5f0 0x7f25d004fab0 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f25f40aeff0 tx=0x7f25ec0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.420 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.416+0000 7f25e3fff700 1 -- 172.21.15.38:0/90380025 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f25ec005d60 con 0x7f25d004d5f0 2020-06-12T17:49:46.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.418+0000 7f25f96f2700 1 -- 172.21.15.38:0/90380025 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f25d004d5f0 msgr2=0x7f25d004fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:46.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.418+0000 7f25f96f2700 1 --2- 172.21.15.38:0/90380025 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f25d004d5f0 0x7f25d004fab0 secure :-1 s=READY pgs=218 cs=0 l=1 rx=0x7f25f40aeff0 tx=0x7f25ec0081e0).stop 2020-06-12T17:49:46.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.418+0000 7f25f96f2700 1 -- 172.21.15.38:0/90380025 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25f4146680 msgr2=0x7f25f413ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:46.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.418+0000 7f25f96f2700 1 --2- 172.21.15.38:0/90380025 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25f4146680 0x7f25f413ef70 secure :-1 s=READY pgs=547 cs=0 l=1 rx=0x7f25e4002f30 tx=0x7f25e4007e60).stop 2020-06-12T17:49:46.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.418+0000 7f25f96f2700 1 -- 172.21.15.38:0/90380025 shutdown_connections 2020-06-12T17:49:46.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.418+0000 7f25f96f2700 1 --2- 172.21.15.38:0/90380025 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f25d004d5f0 0x7f25d004fab0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:46.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.418+0000 7f25f96f2700 1 --2- 172.21.15.38:0/90380025 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25f4146680 0x7f25f413ef70 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:46.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.418+0000 7f25f96f2700 1 --2- 172.21.15.38:0/90380025 >> v2:172.21.15.150:3300/0 conn(0x7f25f40b2eb0 0x7f25f40618e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:46.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.418+0000 7f25f96f2700 1 -- 172.21.15.38:0/90380025 >> 172.21.15.38:0/90380025 conn(0x7f25f40b5a20 msgr2=0x7f25f40b7020 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:46.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.418+0000 7f25f96f2700 1 -- 172.21.15.38:0/90380025 shutdown_connections 2020-06-12T17:49:46.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.418+0000 7f25f96f2700 1 -- 172.21.15.38:0/90380025 wait complete. 2020-06-12T17:49:46.431 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_5225 2020-06-12T17:49:46.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.545+0000 7f71a3f44700 1 Processor -- start 2020-06-12T17:49:46.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.545+0000 7f71a3f44700 1 -- start start 2020-06-12T17:49:46.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.546+0000 7f71a3f44700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f719c146680 0x7f719c0ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:46.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.546+0000 7f71a3f44700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719c146d20 con 0x7f719c0b2eb0 2020-06-12T17:49:46.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.546+0000 7f71a3f44700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719c066a80 con 0x7f719c09d8d0 2020-06-12T17:49:46.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.546+0000 7f71a3f44700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c146f50 con 0x7f719c146680 2020-06-12T17:49:46.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.546+0000 7f71a14df700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f719c0b2eb0 0x7f719c09d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39906/0 (socket says 172.21.15.38:39906) 2020-06-12T17:49:46.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.546+0000 7f71a14df700 1 -- 172.21.15.38:0/1417257517 learned_addr learned my addr 172.21.15.38:0/1417257517 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:46.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.546+0000 7f71a1ce0700 1 --2- 172.21.15.38:0/1417257517 >> v2:172.21.15.150:3300/0 conn(0x7f719c146680 0x7f719c0ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:46.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.546+0000 7f71a0cde700 1 -- 172.21.15.38:0/1417257517 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3121489643 0 0) 0x7f719c146d20 con 0x7f719c0b2eb0 2020-06-12T17:49:46.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.546+0000 7f71a0cde700 1 -- 172.21.15.38:0/1417257517 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7184003230 con 0x7f719c0b2eb0 2020-06-12T17:49:46.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a0cde700 1 -- 172.21.15.38:0/1417257517 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3842401310 0 0) 0x7f7184003230 con 0x7f719c0b2eb0 2020-06-12T17:49:46.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a0cde700 1 -- 172.21.15.38:0/1417257517 >> v2:172.21.15.150:3300/0 conn(0x7f719c146680 msgr2=0x7f719c0ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:46.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a0cde700 1 --2- 172.21.15.38:0/1417257517 >> v2:172.21.15.150:3300/0 conn(0x7f719c146680 0x7f719c0ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:46.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a0cde700 1 -- 172.21.15.38:0/1417257517 >> v1:172.21.15.150:6789/0 conn(0x7f719c09d8d0 legacy=0x7f719c1421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:46.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a0cde700 1 -- 172.21.15.38:0/1417257517 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c146a60 con 0x7f719c0b2eb0 2020-06-12T17:49:46.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a0cde700 1 -- 172.21.15.38:0/1417257517 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f7198001a50 con 0x7f719c0b2eb0 2020-06-12T17:49:46.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a0cde700 1 -- 172.21.15.38:0/1417257517 >> v1:172.21.15.38:6789/0 conn(0x7f719c0b2eb0 legacy=0x7f719c09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:46.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a0cde700 1 --2- 172.21.15.38:0/1417257517 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7184003720 0x7f7184003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:46.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a0cde700 1 --2- 172.21.15.38:0/1417257517 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7184004020 0x7f71840044f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:46.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a0cde700 1 --2- 172.21.15.38:0/1417257517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7184004a60 0x7f7184004f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:46.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a0cde700 1 -- 172.21.15.38:0/1417257517 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c146f50 con 0x7f7184004a60 2020-06-12T17:49:46.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a0cde700 1 -- 172.21.15.38:0/1417257517 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718400b830 con 0x7f7184004020 2020-06-12T17:49:46.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a0cde700 1 -- 172.21.15.38:0/1417257517 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718400b9f0 con 0x7f7184003720 2020-06-12T17:49:46.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a24e1700 1 --2- 172.21.15.38:0/1417257517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7184004a60 0x7f7184004f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:46.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a14df700 1 --2- 172.21.15.38:0/1417257517 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7184004020 0x7f71840044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:46.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a1ce0700 1 --2- 172.21.15.38:0/1417257517 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7184003720 0x7f7184003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:46.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a24e1700 1 -- 172.21.15.38:0/1417257517 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7184003720 msgr2=0x7f7184003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:46.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a24e1700 1 --2- 172.21.15.38:0/1417257517 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7184003720 0x7f7184003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:46.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a24e1700 1 -- 172.21.15.38:0/1417257517 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7184004020 msgr2=0x7f71840044f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:46.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a24e1700 1 --2- 172.21.15.38:0/1417257517 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7184004020 0x7f71840044f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:46.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a24e1700 1 -- 172.21.15.38:0/1417257517 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7184003230 con 0x7f7184004a60 2020-06-12T17:49:46.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a24e1700 1 --2- 172.21.15.38:0/1417257517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7184004a60 0x7f7184004f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7194000fe0 tx=0x7f71940018f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a24e1700 1 -- 172.21.15.38:0/1417257517 reap_dead start 2020-06-12T17:49:46.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a24e1700 1 --2- 172.21.15.38:0/1417257517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7184004a60 0x7f7184004f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7194000fe0 tx=0x7f71940018f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a24e1700 1 --2- 172.21.15.38:0/1417257517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7184004a60 0x7f7184004f10 secure :-1 s=READY pgs=549 cs=0 l=1 rx=0x7f7194000fe0 tx=0x7f71940018f0).ready entity=mon.0 client_cookie=a1855d94ef72bd4b server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:46.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a24e1700 1 --2- 172.21.15.38:0/1417257517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7184004a60 0x7f7184004f10 secure :-1 s=THROTTLE_DONE pgs=549 cs=0 l=1 rx=0x7f7194000fe0 tx=0x7f71940018f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a24e1700 1 --2- 172.21.15.38:0/1417257517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7184004a60 0x7f7184004f10 secure :-1 s=THROTTLE_DONE pgs=549 cs=0 l=1 rx=0x7f7194000fe0 tx=0x7f71940018f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a0cde700 1 -- 172.21.15.38:0/1417257517 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7194003540 con 0x7f7184004a60 2020-06-12T17:49:46.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a24e1700 1 --2- 172.21.15.38:0/1417257517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7184004a60 0x7f7184004f10 secure :-1 s=THROTTLE_DONE pgs=549 cs=0 l=1 rx=0x7f7194000fe0 tx=0x7f71940018f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.547+0000 7f71a0cde700 1 -- 172.21.15.38:0/1417257517 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71940036a0 con 0x7f7184004a60 2020-06-12T17:49:46.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.548+0000 7f71a0cde700 1 -- 172.21.15.38:0/1417257517 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7194003a00 con 0x7f7184004a60 2020-06-12T17:49:46.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.548+0000 7f71a3f44700 1 -- 172.21.15.38:0/1417257517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7184004a60 msgr2=0x7f7184004f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:46.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.548+0000 7f71a3f44700 1 --2- 172.21.15.38:0/1417257517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7184004a60 0x7f7184004f10 secure :-1 s=READY pgs=549 cs=0 l=1 rx=0x7f7194000fe0 tx=0x7f71940018f0).stop 2020-06-12T17:49:46.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.548+0000 7f71a3f44700 1 -- 172.21.15.38:0/1417257517 shutdown_connections 2020-06-12T17:49:46.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.548+0000 7f71a3f44700 1 --2- 172.21.15.38:0/1417257517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7184004a60 0x7f7184004f10 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:46.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.548+0000 7f71a3f44700 1 -- 172.21.15.38:0/1417257517 >> 172.21.15.38:0/1417257517 conn(0x7f719c0b5a20 msgr2=0x7f719c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:46.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.548+0000 7f71a3f44700 1 -- 172.21.15.38:0/1417257517 shutdown_connections 2020-06-12T17:49:46.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.548+0000 7f71a3f44700 1 -- 172.21.15.38:0/1417257517 wait complete. 2020-06-12T17:49:46.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.549+0000 7f71a3f44700 1 Processor -- start 2020-06-12T17:49:46.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.549+0000 7f71a3f44700 1 -- start start 2020-06-12T17:49:46.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.550+0000 7f71a3f44700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7184004a60 0x7f719c062a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:46.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.550+0000 7f71a3f44700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f719c0b0560 0x7f719c063750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:46.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.550+0000 7f71a3f44700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719c0aed50 con 0x7f719c0af730 2020-06-12T17:49:46.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.550+0000 7f71a3f44700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c0aeff0 con 0x7f7184004a60 2020-06-12T17:49:46.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.550+0000 7f71a3f44700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0af290 con 0x7f719c0b0560 2020-06-12T17:49:46.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.550+0000 7f71a24e1700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f719c0af730 0x7f719c0b7320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39922/0 (socket says 172.21.15.38:39922) 2020-06-12T17:49:46.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.550+0000 7f71a24e1700 1 -- 172.21.15.38:0/402960861 learned_addr learned my addr 172.21.15.38:0/402960861 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:46.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.550+0000 7f718affd700 1 -- 172.21.15.38:0/402960861 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 695006228 0 0) 0x7f719c0aed50 con 0x7f719c0af730 2020-06-12T17:49:46.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.550+0000 7f718affd700 1 -- 172.21.15.38:0/402960861 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f717c002fe0 con 0x7f719c0af730 2020-06-12T17:49:46.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.550+0000 7f71a14df700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f719c0b0560 0x7f719c063750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:46.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.550+0000 7f71a1ce0700 1 --2- 172.21.15.38:0/402960861 >> v2:172.21.15.150:3300/0 conn(0x7f7184004a60 0x7f719c062a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:46.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.550+0000 7f718affd700 1 -- 172.21.15.38:0/402960861 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 845521753 0 0) 0x7f717c002fe0 con 0x7f719c0af730 2020-06-12T17:49:46.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.550+0000 7f718affd700 1 -- 172.21.15.38:0/402960861 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f719c0aed50 con 0x7f719c0af730 2020-06-12T17:49:46.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.550+0000 7f718affd700 1 -- 172.21.15.38:0/402960861 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f7194001280 con 0x7f719c0af730 2020-06-12T17:49:46.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.550+0000 7f718affd700 1 -- 172.21.15.38:0/402960861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f719c0b0560 msgr2=0x7f719c063750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:46.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.550+0000 7f718affd700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f719c0b0560 0x7f719c063750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:46.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.550+0000 7f718affd700 1 -- 172.21.15.38:0/402960861 >> v2:172.21.15.150:3300/0 conn(0x7f7184004a60 msgr2=0x7f719c062a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:46.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.550+0000 7f718affd700 1 --2- 172.21.15.38:0/402960861 >> v2:172.21.15.150:3300/0 conn(0x7f7184004a60 0x7f719c062a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:46.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.550+0000 7f718affd700 1 -- 172.21.15.38:0/402960861 >> v1:172.21.15.38:6789/0 conn(0x7f719c0af730 legacy=0x7f719c0b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:46.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.550+0000 7f718affd700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f717c004a80 0x7f717c004e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:46.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.550+0000 7f718affd700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f717c003920 0x7f717c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:46.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.551+0000 7f718affd700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f717c004200 0x7f717c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:46.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.551+0000 7f718affd700 1 -- 172.21.15.38:0/402960861 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0aeff0 con 0x7f717c003920 2020-06-12T17:49:46.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.551+0000 7f718affd700 1 -- 172.21.15.38:0/402960861 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0af290 con 0x7f717c004a80 2020-06-12T17:49:46.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.551+0000 7f718affd700 1 -- 172.21.15.38:0/402960861 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717c004680 con 0x7f717c004200 2020-06-12T17:49:46.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.551+0000 7f71a14df700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f719c0b0560 0x7f719c063750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:49:46.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.551+0000 7f71a1ce0700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f717c004a80 0x7f717c004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:46.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.551+0000 7f71a24e1700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f717c004200 0x7f717c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:46.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.551+0000 7f71a14df700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f717c003920 0x7f717c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:46.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.551+0000 7f71a14df700 1 -- 172.21.15.38:0/402960861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f717c004200 msgr2=0x7f717c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:46.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.551+0000 7f71a14df700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f717c004200 0x7f717c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:46.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.551+0000 7f71a14df700 1 -- 172.21.15.38:0/402960861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f717c004a80 msgr2=0x7f717c004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:46.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.551+0000 7f71a14df700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f717c004a80 0x7f717c004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:46.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.551+0000 7f71a14df700 1 -- 172.21.15.38:0/402960861 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c063bb0 con 0x7f717c003920 2020-06-12T17:49:46.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.551+0000 7f71a3f44700 1 -- 172.21.15.38:0/402960861 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719c0afbc0 con 0x7f717c003920 2020-06-12T17:49:46.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.551+0000 7f71a14df700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f717c003920 0x7f717c003da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7198001760 tx=0x7f719c0b61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.551+0000 7f71a3f44700 1 -- 172.21.15.38:0/402960861 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719c0b7a30 con 0x7f717c003920 2020-06-12T17:49:46.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.551+0000 7f71a14df700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f717c003920 0x7f717c003da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7198001760 tx=0x7f719c0b61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.551+0000 7f71a14df700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f717c003920 0x7f717c003da0 secure :-1 s=READY pgs=551 cs=0 l=1 rx=0x7f7198001760 tx=0x7f719c0b61c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:46.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.551+0000 7f71a14df700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f717c003920 0x7f717c003da0 secure :-1 s=THROTTLE_DONE pgs=551 cs=0 l=1 rx=0x7f7198001760 tx=0x7f719c0b61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.551+0000 7f71a14df700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f717c003920 0x7f717c003da0 secure :-1 s=THROTTLE_DONE pgs=551 cs=0 l=1 rx=0x7f7198001760 tx=0x7f719c0b61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.551+0000 7f718affd700 1 -- 172.21.15.38:0/402960861 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7198011e40 con 0x7f717c003920 2020-06-12T17:49:46.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.551+0000 7f71a14df700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f717c003920 0x7f717c003da0 secure :-1 s=THROTTLE_DONE pgs=551 cs=0 l=1 rx=0x7f7198001760 tx=0x7f719c0b61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.551+0000 7f718affd700 1 -- 172.21.15.38:0/402960861 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719800b9a0 con 0x7f717c003920 2020-06-12T17:49:46.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.551+0000 7f718affd700 1 -- 172.21.15.38:0/402960861 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f719800bdc0 con 0x7f717c003920 2020-06-12T17:49:46.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.552+0000 7f71a14df700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f717c003920 0x7f717c003da0 secure :-1 s=THROTTLE_DONE pgs=551 cs=0 l=1 rx=0x7f7198001760 tx=0x7f719c0b61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.552+0000 7f71a3f44700 1 -- 172.21.15.38:0/402960861 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719c056c30 con 0x7f717c003920 2020-06-12T17:49:46.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.552+0000 7f718affd700 1 -- 172.21.15.38:0/402960861 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f71980014d0 con 0x7f717c003920 2020-06-12T17:49:46.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.552+0000 7f71a14df700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f717c003920 0x7f717c003da0 secure :-1 s=THROTTLE_DONE pgs=551 cs=0 l=1 rx=0x7f7198001760 tx=0x7f719c0b61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.552+0000 7f718affd700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f717c055c30 0x7f717c0580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:46.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.553+0000 7f718affd700 1 -- 172.21.15.38:0/402960861 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7198060e70 con 0x7f717c003920 2020-06-12T17:49:46.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.553+0000 7f71a1ce0700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f717c055c30 0x7f717c0580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:46.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.553+0000 7f71a1ce0700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f717c055c30 0x7f717c0580f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f718c002f30 tx=0x7f718c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.553+0000 7f71a1ce0700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f717c055c30 0x7f717c0580f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f718c002f30 tx=0x7f718c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.553+0000 7f71a1ce0700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f717c055c30 0x7f717c0580f0 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7f718c002f30 tx=0x7f718c007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:46.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.556+0000 7f71a14df700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f717c003920 0x7f717c003da0 secure :-1 s=THROTTLE_DONE pgs=551 cs=0 l=1 rx=0x7f7198001760 tx=0x7f719c0b61c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.556+0000 7f718affd700 1 -- 172.21.15.38:0/402960861 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f719803c5f0 con 0x7f717c003920 2020-06-12T17:49:46.752 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.748+0000 7f71a3f44700 1 -- 172.21.15.38:0/402960861 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_5225", "target": ["mon-mgr", ""]}) v1 -- 0x7f719c05a5e0 con 0x7f717c055c30 2020-06-12T17:49:46.755 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.752+0000 7f71a1ce0700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f717c055c30 0x7f717c0580f0 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f718c002f30 tx=0x7f718c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:46.755 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.752+0000 7f718affd700 1 -- 172.21.15.38:0/402960861 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f719c05a5e0 con 0x7f717c055c30 2020-06-12T17:49:46.756 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_5225/b68a79f5-83e0-4f4b-9c6f-540352f4e5cf 2020-06-12T17:49:46.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.753+0000 7f71a3f44700 1 -- 172.21.15.38:0/402960861 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f717c055c30 msgr2=0x7f717c0580f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:46.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.753+0000 7f71a3f44700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f717c055c30 0x7f717c0580f0 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7f718c002f30 tx=0x7f718c007e60).stop 2020-06-12T17:49:46.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.753+0000 7f71a3f44700 1 -- 172.21.15.38:0/402960861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f717c003920 msgr2=0x7f717c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:46.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.753+0000 7f71a3f44700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f717c003920 0x7f717c003da0 secure :-1 s=READY pgs=551 cs=0 l=1 rx=0x7f7198001760 tx=0x7f719c0b61c0).stop 2020-06-12T17:49:46.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.753+0000 7f71a24e1700 1 -- 172.21.15.38:0/402960861 reap_dead start 2020-06-12T17:49:46.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.753+0000 7f71a3f44700 1 -- 172.21.15.38:0/402960861 shutdown_connections 2020-06-12T17:49:46.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.753+0000 7f71a3f44700 1 --2- 172.21.15.38:0/402960861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f717c003920 0x7f717c003da0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:46.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.753+0000 7f71a3f44700 1 -- 172.21.15.38:0/402960861 >> 172.21.15.38:0/402960861 conn(0x7f719c0b5a20 msgr2=0x7f719c09c170 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:46.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.754+0000 7f71a3f44700 1 -- 172.21.15.38:0/402960861 shutdown_connections 2020-06-12T17:49:46.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:46.754+0000 7f71a3f44700 1 -- 172.21.15.38:0/402960861 wait complete. 2020-06-12T17:49:46.767 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_5225 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_5225/b68a79f5-83e0-4f4b-9c6f-540352f4e5cf 2020-06-12T17:49:46.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:46.768 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:46.768 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:46.783 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:46.784 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:46.784 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5225/b68a79f5-83e0-4f4b-9c6f-540352f4e5cf/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:46.876 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:46.876 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:46.876 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123165 s, 85.1 MB/s 2020-06-12T17:49:46.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:46.878 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:46.878 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:46.893 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:46.894 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:46.894 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5225/b68a79f5-83e0-4f4b-9c6f-540352f4e5cf/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:46.983 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:46.983 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:46.984 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123131 s, 85.2 MB/s 2020-06-12T17:49:46.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:46.985 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:46.986 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:47.000 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:47.001 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:47.002 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5225/b68a79f5-83e0-4f4b-9c6f-540352f4e5cf/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:47.088 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:47.089 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:47.089 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109939 s, 95.4 MB/s 2020-06-12T17:49:47.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:47.090 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:47.091 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:47.106 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:47.106 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:47.107 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5225/b68a79f5-83e0-4f4b-9c6f-540352f4e5cf/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:47.195 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:47.196 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:47.196 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128719 s, 81.5 MB/s 2020-06-12T17:49:47.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:47.198 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:47.198 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:47.213 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:47.213 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:47.214 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5225/b68a79f5-83e0-4f4b-9c6f-540352f4e5cf/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:47.300 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:47.300 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:47.300 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102477 s, 102 MB/s 2020-06-12T17:49:47.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:47.302 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:47.303 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:47.318 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:47.318 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:47.319 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5225/b68a79f5-83e0-4f4b-9c6f-540352f4e5cf/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:47.406 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:47.407 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:47.407 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109852 s, 95.5 MB/s 2020-06-12T17:49:47.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:47.409 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:47.409 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:47.424 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:47.425 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:47.425 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5225/b68a79f5-83e0-4f4b-9c6f-540352f4e5cf/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:47.511 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:47.512 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:47.512 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110839 s, 94.6 MB/s 2020-06-12T17:49:47.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:47.514 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:47.514 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:47.530 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:47.531 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:47.531 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5225/b68a79f5-83e0-4f4b-9c6f-540352f4e5cf/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:47.599 INFO:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-06-12T17:49:47.615 INFO:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-06-12T17:49:47.622 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:47.622 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:47.622 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145186 s, 72.2 MB/s 2020-06-12T17:49:47.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:47.624 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:47.624 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:47.678 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:47.678 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:47.679 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5225/b68a79f5-83e0-4f4b-9c6f-540352f4e5cf/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:47.782 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:47.782 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:47.783 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132531 s, 79.1 MB/s 2020-06-12T17:49:47.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:47.784 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:47.785 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:47.800 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:47.800 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:47.801 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5225/b68a79f5-83e0-4f4b-9c6f-540352f4e5cf/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:47.887 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:47.888 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:47.888 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107399 s, 97.6 MB/s 2020-06-12T17:49:47.889 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_3385 2020-06-12T17:49:48.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.003+0000 7efc46793700 1 Processor -- start 2020-06-12T17:49:48.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.003+0000 7efc46793700 1 -- start start 2020-06-12T17:49:48.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.004+0000 7efc46793700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efc40146680 0x7efc400ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:48.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.004+0000 7efc46793700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efc400b2eb0 0x7efc4009d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:48.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.004+0000 7efc46793700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc40146d20 con 0x7efc4009d620 2020-06-12T17:49:48.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.004+0000 7efc46793700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc40066a80 con 0x7efc40146680 2020-06-12T17:49:48.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.004+0000 7efc46793700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc40146f50 con 0x7efc400b2eb0 2020-06-12T17:49:48.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.004+0000 7efc3ffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efc40146680 0x7efc400ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:48.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.004+0000 7efc3ffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efc40146680 0x7efc400ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38116/0 (socket says 172.21.15.38:38116) 2020-06-12T17:49:48.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.004+0000 7efc3ffff700 1 -- 172.21.15.38:0/3009860934 learned_addr learned my addr 172.21.15.38:0/3009860934 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:48.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.004+0000 7efc44d30700 1 --1- 172.21.15.38:0/3009860934 >> v1:172.21.15.38:6789/0 conn(0x7efc4009d620 0x7efc4009b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39936/0 (socket says 172.21.15.38:39936) 2020-06-12T17:49:48.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.005+0000 7efc3f7fe700 1 --2- 172.21.15.38:0/3009860934 >> v2:172.21.15.150:3300/0 conn(0x7efc400b2eb0 0x7efc4009d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:48.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.005+0000 7efc3ffff700 1 -- 172.21.15.38:0/3009860934 >> v2:172.21.15.150:3300/0 conn(0x7efc400b2eb0 msgr2=0x7efc4009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:48.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.005+0000 7efc3ffff700 1 --2- 172.21.15.38:0/3009860934 >> v2:172.21.15.150:3300/0 conn(0x7efc400b2eb0 0x7efc4009d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:48.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.005+0000 7efc3effd700 1 -- 172.21.15.38:0/3009860934 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 331152647 0 0) 0x7efc40146d20 con 0x7efc4009d620 2020-06-12T17:49:48.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.005+0000 7efc3ffff700 1 -- 172.21.15.38:0/3009860934 >> v1:172.21.15.38:6789/0 conn(0x7efc4009d620 legacy=0x7efc4009b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:48.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.005+0000 7efc3ffff700 1 -- 172.21.15.38:0/3009860934 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc40146a60 con 0x7efc40146680 2020-06-12T17:49:48.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.005+0000 7efc3ffff700 1 --2- 172.21.15.38:0/3009860934 >> v2:172.21.15.38:3300/0 conn(0x7efc40146680 0x7efc400ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efc30002f30 tx=0x7efc30007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.005+0000 7efc3ffff700 1 --2- 172.21.15.38:0/3009860934 >> v2:172.21.15.38:3300/0 conn(0x7efc40146680 0x7efc400ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efc30002f30 tx=0x7efc30007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.005+0000 7efc3ffff700 1 --2- 172.21.15.38:0/3009860934 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc40146680 0x7efc400ad5b0 secure :-1 s=READY pgs=553 cs=0 l=1 rx=0x7efc30002f30 tx=0x7efc30007e60).ready entity=mon.0 client_cookie=c718ecc44e60195e server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:48.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.005+0000 7efc3ffff700 1 --2- 172.21.15.38:0/3009860934 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc40146680 0x7efc400ad5b0 secure :-1 s=THROTTLE_DONE pgs=553 cs=0 l=1 rx=0x7efc30002f30 tx=0x7efc30007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.005+0000 7efc3effd700 1 -- 172.21.15.38:0/3009860934 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc30013de0 con 0x7efc40146680 2020-06-12T17:49:48.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.005+0000 7efc3ffff700 1 --2- 172.21.15.38:0/3009860934 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc40146680 0x7efc400ad5b0 secure :-1 s=THROTTLE_DONE pgs=553 cs=0 l=1 rx=0x7efc30002f30 tx=0x7efc30007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.005+0000 7efc3ffff700 1 --2- 172.21.15.38:0/3009860934 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc40146680 0x7efc400ad5b0 secure :-1 s=THROTTLE_DONE pgs=553 cs=0 l=1 rx=0x7efc30002f30 tx=0x7efc30007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.005+0000 7efc3effd700 1 -- 172.21.15.38:0/3009860934 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3000c160 con 0x7efc40146680 2020-06-12T17:49:48.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.005+0000 7efc3effd700 1 -- 172.21.15.38:0/3009860934 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc3000c500 con 0x7efc40146680 2020-06-12T17:49:48.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.005+0000 7efc46793700 1 -- 172.21.15.38:0/3009860934 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc40146680 msgr2=0x7efc400ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:48.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.005+0000 7efc46793700 1 --2- 172.21.15.38:0/3009860934 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc40146680 0x7efc400ad5b0 secure :-1 s=READY pgs=553 cs=0 l=1 rx=0x7efc30002f30 tx=0x7efc30007e60).stop 2020-06-12T17:49:48.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.005+0000 7efc46793700 1 -- 172.21.15.38:0/3009860934 shutdown_connections 2020-06-12T17:49:48.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.005+0000 7efc46793700 1 --2- 172.21.15.38:0/3009860934 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc40146680 0x7efc400ad5b0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:48.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.005+0000 7efc46793700 1 --2- 172.21.15.38:0/3009860934 >> v2:172.21.15.150:3300/0 conn(0x7efc400b2eb0 0x7efc4009d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:48.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.005+0000 7efc46793700 1 -- 172.21.15.38:0/3009860934 >> 172.21.15.38:0/3009860934 conn(0x7efc400b5a20 msgr2=0x7efc4005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:48.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.005+0000 7efc46793700 1 -- 172.21.15.38:0/3009860934 shutdown_connections 2020-06-12T17:49:48.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.005+0000 7efc46793700 1 -- 172.21.15.38:0/3009860934 wait complete. 2020-06-12T17:49:48.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.006+0000 7efc46793700 1 Processor -- start 2020-06-12T17:49:48.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.006+0000 7efc46793700 1 -- start start 2020-06-12T17:49:48.020 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.007+0000 7efc46793700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efc400b2eb0 0x7efc40090f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:48.020 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.007+0000 7efc46793700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efc40146680 0x7efc40092680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:48.021 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.007+0000 7efc46793700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc40091360 con 0x7efc4009d620 2020-06-12T17:49:48.021 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.007+0000 7efc46793700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc401533d0 con 0x7efc400b2eb0 2020-06-12T17:49:48.021 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.007+0000 7efc46793700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc40157760 con 0x7efc40146680 2020-06-12T17:49:48.021 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.007+0000 7efc3ffff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7efc4009d620 0x7efc40065ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39938/0 (socket says 172.21.15.38:39938) 2020-06-12T17:49:48.021 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.007+0000 7efc3ffff700 1 -- 172.21.15.38:0/1615919314 learned_addr learned my addr 172.21.15.38:0/1615919314 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:48.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.007+0000 7efc3f7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efc400b2eb0 0x7efc40090f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:48.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.008+0000 7efc44d30700 1 --2- 172.21.15.38:0/1615919314 >> v2:172.21.15.150:3300/0 conn(0x7efc40146680 0x7efc40092680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:48.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.008+0000 7efc3d7fa700 1 -- 172.21.15.38:0/1615919314 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1676421828 0 0) 0x7efc40091360 con 0x7efc4009d620 2020-06-12T17:49:48.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.008+0000 7efc3d7fa700 1 -- 172.21.15.38:0/1615919314 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc20002fe0 con 0x7efc4009d620 2020-06-12T17:49:48.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.008+0000 7efc3f7fe700 1 -- 172.21.15.38:0/1615919314 >> v2:172.21.15.150:3300/0 conn(0x7efc40146680 msgr2=0x7efc40092680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:48.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.008+0000 7efc3f7fe700 1 --2- 172.21.15.38:0/1615919314 >> v2:172.21.15.150:3300/0 conn(0x7efc40146680 0x7efc40092680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:48.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.008+0000 7efc3f7fe700 1 -- 172.21.15.38:0/1615919314 >> v1:172.21.15.38:6789/0 conn(0x7efc4009d620 legacy=0x7efc40065ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:48.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.008+0000 7efc3f7fe700 1 -- 172.21.15.38:0/1615919314 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc401535f0 con 0x7efc400b2eb0 2020-06-12T17:49:48.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.008+0000 7efc3f7fe700 1 --2- 172.21.15.38:0/1615919314 >> v2:172.21.15.38:3300/0 conn(0x7efc400b2eb0 0x7efc40090f00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efc34002f30 tx=0x7efc34007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.008+0000 7efc3f7fe700 1 --2- 172.21.15.38:0/1615919314 >> v2:172.21.15.38:3300/0 conn(0x7efc400b2eb0 0x7efc40090f00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efc34002f30 tx=0x7efc34007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.008+0000 7efc3f7fe700 1 --2- 172.21.15.38:0/1615919314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc400b2eb0 0x7efc40090f00 secure :-1 s=READY pgs=555 cs=0 l=1 rx=0x7efc34002f30 tx=0x7efc34007ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:48.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.008+0000 7efc3f7fe700 1 --2- 172.21.15.38:0/1615919314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc400b2eb0 0x7efc40090f00 secure :-1 s=THROTTLE_DONE pgs=555 cs=0 l=1 rx=0x7efc34002f30 tx=0x7efc34007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.008+0000 7efc3d7fa700 1 -- 172.21.15.38:0/1615919314 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc3400a350 con 0x7efc400b2eb0 2020-06-12T17:49:48.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.008+0000 7efc3f7fe700 1 --2- 172.21.15.38:0/1615919314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc400b2eb0 0x7efc40090f00 secure :-1 s=THROTTLE_DONE pgs=555 cs=0 l=1 rx=0x7efc34002f30 tx=0x7efc34007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.008+0000 7efc3f7fe700 1 --2- 172.21.15.38:0/1615919314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc400b2eb0 0x7efc40090f00 secure :-1 s=THROTTLE_DONE pgs=555 cs=0 l=1 rx=0x7efc34002f30 tx=0x7efc34007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.008+0000 7efc3d7fa700 1 -- 172.21.15.38:0/1615919314 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3400a4b0 con 0x7efc400b2eb0 2020-06-12T17:49:48.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.008+0000 7efc46793700 1 -- 172.21.15.38:0/1615919314 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc40090b40 con 0x7efc400b2eb0 2020-06-12T17:49:48.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.008+0000 7efc3d7fa700 1 -- 172.21.15.38:0/1615919314 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc3400a8d0 con 0x7efc400b2eb0 2020-06-12T17:49:48.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.008+0000 7efc46793700 1 -- 172.21.15.38:0/1615919314 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc40157530 con 0x7efc400b2eb0 2020-06-12T17:49:48.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.009+0000 7efc3f7fe700 1 --2- 172.21.15.38:0/1615919314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc400b2eb0 0x7efc40090f00 secure :-1 s=THROTTLE_DONE pgs=555 cs=0 l=1 rx=0x7efc34002f30 tx=0x7efc34007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.009+0000 7efc46793700 1 -- 172.21.15.38:0/1615919314 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc40056c30 con 0x7efc400b2eb0 2020-06-12T17:49:48.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.009+0000 7efc3d7fa700 1 -- 172.21.15.38:0/1615919314 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7efc3400ab40 con 0x7efc400b2eb0 2020-06-12T17:49:48.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.009+0000 7efc3f7fe700 1 --2- 172.21.15.38:0/1615919314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc400b2eb0 0x7efc40090f00 secure :-1 s=THROTTLE_DONE pgs=555 cs=0 l=1 rx=0x7efc34002f30 tx=0x7efc34007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.010+0000 7efc3d7fa700 1 --2- 172.21.15.38:0/1615919314 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efc2004d910 0x7efc2004fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:48.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.010+0000 7efc3d7fa700 1 -- 172.21.15.38:0/1615919314 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7efc34060d00 con 0x7efc400b2eb0 2020-06-12T17:49:48.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.010+0000 7efc3ffff700 1 --2- 172.21.15.38:0/1615919314 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efc2004d910 0x7efc2004fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:48.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.010+0000 7efc3ffff700 1 --2- 172.21.15.38:0/1615919314 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efc2004d910 0x7efc2004fdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efc300084c0 tx=0x7efc30007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.010+0000 7efc3ffff700 1 --2- 172.21.15.38:0/1615919314 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efc2004d910 0x7efc2004fdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efc300084c0 tx=0x7efc30007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.010+0000 7efc3ffff700 1 --2- 172.21.15.38:0/1615919314 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efc2004d910 0x7efc2004fdd0 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7efc300084c0 tx=0x7efc30007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:48.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.013+0000 7efc3f7fe700 1 --2- 172.21.15.38:0/1615919314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc400b2eb0 0x7efc40090f00 secure :-1 s=THROTTLE_DONE pgs=555 cs=0 l=1 rx=0x7efc34002f30 tx=0x7efc34007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.013+0000 7efc3d7fa700 1 -- 172.21.15.38:0/1615919314 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7efc3403c420 con 0x7efc400b2eb0 2020-06-12T17:49:48.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.206+0000 7efc46793700 1 -- 172.21.15.38:0/1615919314 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_3385", "target": ["mon-mgr", ""]}) v1 -- 0x7efc401537f0 con 0x7efc2004d910 2020-06-12T17:49:48.229 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.226+0000 7efc3ffff700 1 --2- 172.21.15.38:0/1615919314 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efc2004d910 0x7efc2004fdd0 secure :-1 s=THROTTLE_DONE pgs=220 cs=0 l=1 rx=0x7efc300084c0 tx=0x7efc30007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.229 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.226+0000 7efc3d7fa700 1 -- 172.21.15.38:0/1615919314 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7efc30013bf0 con 0x7efc2004d910 2020-06-12T17:49:48.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.227+0000 7efc46793700 1 -- 172.21.15.38:0/1615919314 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efc2004d910 msgr2=0x7efc2004fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:48.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.227+0000 7efc46793700 1 --2- 172.21.15.38:0/1615919314 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efc2004d910 0x7efc2004fdd0 secure :-1 s=READY pgs=220 cs=0 l=1 rx=0x7efc300084c0 tx=0x7efc30007e60).stop 2020-06-12T17:49:48.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.227+0000 7efc46793700 1 -- 172.21.15.38:0/1615919314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc400b2eb0 msgr2=0x7efc40090f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:48.232 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.227+0000 7efc46793700 1 --2- 172.21.15.38:0/1615919314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc400b2eb0 0x7efc40090f00 secure :-1 s=READY pgs=555 cs=0 l=1 rx=0x7efc34002f30 tx=0x7efc34007ee0).stop 2020-06-12T17:49:48.232 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.227+0000 7efc46793700 1 -- 172.21.15.38:0/1615919314 shutdown_connections 2020-06-12T17:49:48.232 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.227+0000 7efc46793700 1 --2- 172.21.15.38:0/1615919314 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efc2004d910 0x7efc2004fdd0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:48.232 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.227+0000 7efc46793700 1 --2- 172.21.15.38:0/1615919314 >> v2:172.21.15.150:3300/0 conn(0x7efc40146680 0x7efc40092680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:48.232 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.227+0000 7efc46793700 1 --2- 172.21.15.38:0/1615919314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc400b2eb0 0x7efc40090f00 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:48.233 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.227+0000 7efc46793700 1 -- 172.21.15.38:0/1615919314 >> 172.21.15.38:0/1615919314 conn(0x7efc400b5a20 msgr2=0x7efc4009c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:48.233 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.227+0000 7efc46793700 1 -- 172.21.15.38:0/1615919314 shutdown_connections 2020-06-12T17:49:48.233 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.227+0000 7efc46793700 1 -- 172.21.15.38:0/1615919314 wait complete. 2020-06-12T17:49:48.241 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_3385 2020-06-12T17:49:48.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.355+0000 7ff96cc57700 1 Processor -- start 2020-06-12T17:49:48.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.355+0000 7ff96cc57700 1 -- start start 2020-06-12T17:49:48.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.356+0000 7ff96cc57700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9680b43b0 0x7ff9680b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:48.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.356+0000 7ff96cc57700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff9681466b0 0x7ff968146b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:48.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.356+0000 7ff96cc57700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9680b6af0 con 0x7ff968060a40 2020-06-12T17:49:48.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.356+0000 7ff96cc57700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff968145f70 con 0x7ff9681466b0 2020-06-12T17:49:48.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.356+0000 7ff96cc57700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff968146210 con 0x7ff9680b43b0 2020-06-12T17:49:48.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.356+0000 7ff967fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff9681466b0 0x7ff968146b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:48.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.356+0000 7ff966ffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9680b43b0 0x7ff9680b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:48.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.356+0000 7ff9677fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7ff968060a40 0x7ff9680b0730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:60678/0 (socket says 172.21.15.38:60678) 2020-06-12T17:49:48.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.356+0000 7ff9677fe700 1 -- 172.21.15.38:0/2811352955 learned_addr learned my addr 172.21.15.38:0/2811352955 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:48.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.357+0000 7ff967fff700 1 -- 172.21.15.38:0/2811352955 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9680b43b0 msgr2=0x7ff9680b64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:48.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.357+0000 7ff967fff700 1 --2- 172.21.15.38:0/2811352955 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9680b43b0 0x7ff9680b64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:48.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.357+0000 7ff967fff700 1 -- 172.21.15.38:0/2811352955 >> v1:172.21.15.150:6789/0 conn(0x7ff968060a40 legacy=0x7ff9680b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:48.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.357+0000 7ff9667fc700 1 -- 172.21.15.38:0/2811352955 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006130093 0 0) 0x7ff9680b6af0 con 0x7ff968060a40 2020-06-12T17:49:48.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.357+0000 7ff967fff700 1 -- 172.21.15.38:0/2811352955 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9680b0e40 con 0x7ff9681466b0 2020-06-12T17:49:48.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.357+0000 7ff966ffd700 1 --2- 172.21.15.38:0/2811352955 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9680b43b0 0x7ff9680b64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:49:48.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.357+0000 7ff967fff700 1 --2- 172.21.15.38:0/2811352955 >> v2:172.21.15.150:3300/0 conn(0x7ff9681466b0 0x7ff968146b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff9600032b0 tx=0x7ff9600081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.357+0000 7ff967fff700 1 --2- 172.21.15.38:0/2811352955 >> v2:172.21.15.150:3300/0 conn(0x7ff9681466b0 0x7ff968146b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff9600032b0 tx=0x7ff9600081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.357+0000 7ff967fff700 1 --2- 172.21.15.38:0/2811352955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9681466b0 0x7ff968146b20 secure :-1 s=READY pgs=326 cs=0 l=1 rx=0x7ff9600032b0 tx=0x7ff9600081e0).ready entity=mon.1 client_cookie=a11be27d56f82194 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:48.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.357+0000 7ff967fff700 1 --2- 172.21.15.38:0/2811352955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9681466b0 0x7ff968146b20 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7ff9600032b0 tx=0x7ff9600081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.357+0000 7ff9667fc700 1 -- 172.21.15.38:0/2811352955 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff960010d70 con 0x7ff9681466b0 2020-06-12T17:49:48.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.357+0000 7ff967fff700 1 --2- 172.21.15.38:0/2811352955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9681466b0 0x7ff968146b20 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7ff9600032b0 tx=0x7ff9600081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.357+0000 7ff967fff700 1 --2- 172.21.15.38:0/2811352955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9681466b0 0x7ff968146b20 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7ff9600032b0 tx=0x7ff9600081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.357+0000 7ff9667fc700 1 -- 172.21.15.38:0/2811352955 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9600110c0 con 0x7ff9681466b0 2020-06-12T17:49:48.367 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.357+0000 7ff9667fc700 1 -- 172.21.15.38:0/2811352955 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9600114a0 con 0x7ff9681466b0 2020-06-12T17:49:48.367 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.357+0000 7ff96cc57700 1 -- 172.21.15.38:0/2811352955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9681466b0 msgr2=0x7ff968146b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:48.367 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.357+0000 7ff96cc57700 1 --2- 172.21.15.38:0/2811352955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9681466b0 0x7ff968146b20 secure :-1 s=READY pgs=326 cs=0 l=1 rx=0x7ff9600032b0 tx=0x7ff9600081e0).stop 2020-06-12T17:49:48.367 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.358+0000 7ff96cc57700 1 -- 172.21.15.38:0/2811352955 shutdown_connections 2020-06-12T17:49:48.367 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.358+0000 7ff96cc57700 1 --2- 172.21.15.38:0/2811352955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9681466b0 0x7ff968146b20 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:48.368 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.358+0000 7ff96cc57700 1 --2- 172.21.15.38:0/2811352955 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9680b43b0 0x7ff9680b64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:48.368 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.358+0000 7ff96cc57700 1 -- 172.21.15.38:0/2811352955 >> 172.21.15.38:0/2811352955 conn(0x7ff9680ba410 msgr2=0x7ff9680ba820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:48.368 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.358+0000 7ff96cc57700 1 -- 172.21.15.38:0/2811352955 shutdown_connections 2020-06-12T17:49:48.368 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.358+0000 7ff96cc57700 1 -- 172.21.15.38:0/2811352955 wait complete. 2020-06-12T17:49:48.369 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.359+0000 7ff96cc57700 1 Processor -- start 2020-06-12T17:49:48.369 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.359+0000 7ff96cc57700 1 -- start start 2020-06-12T17:49:48.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.360+0000 7ff96cc57700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff9681466b0 0x7ff968147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:48.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.360+0000 7ff96cc57700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff968063710 con 0x7ff9680b43b0 2020-06-12T17:49:48.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.360+0000 7ff96cc57700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff968063940 con 0x7ff968060a40 2020-06-12T17:49:48.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.360+0000 7ff96cc57700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff968063be0 con 0x7ff9681466b0 2020-06-12T17:49:48.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.360+0000 7ff966ffd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff9680b43b0 0x7ff968065190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39954/0 (socket says 172.21.15.38:39954) 2020-06-12T17:49:48.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.360+0000 7ff966ffd700 1 -- 172.21.15.38:0/3936556190 learned_addr learned my addr 172.21.15.38:0/3936556190 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:48.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.360+0000 7ff967fff700 1 --2- 172.21.15.38:0/3936556190 >> v2:172.21.15.150:3300/0 conn(0x7ff9681466b0 0x7ff968147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:48.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.360+0000 7ff964ff9700 1 -- 172.21.15.38:0/3936556190 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570593067 0 0) 0x7ff968063710 con 0x7ff9680b43b0 2020-06-12T17:49:48.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.360+0000 7ff964ff9700 1 -- 172.21.15.38:0/3936556190 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff948002fe0 con 0x7ff9680b43b0 2020-06-12T17:49:48.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.360+0000 7ff964ff9700 1 -- 172.21.15.38:0/3936556190 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1515679105 0 0) 0x7ff968063940 con 0x7ff968060a40 2020-06-12T17:49:48.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.360+0000 7ff967fff700 1 -- 172.21.15.38:0/3936556190 >> v1:172.21.15.150:6789/0 conn(0x7ff968060a40 legacy=0x7ff96813ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:48.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.360+0000 7ff967fff700 1 -- 172.21.15.38:0/3936556190 >> v1:172.21.15.38:6789/0 conn(0x7ff9680b43b0 legacy=0x7ff968065190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:48.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.360+0000 7ff967fff700 1 -- 172.21.15.38:0/3936556190 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff968063e80 con 0x7ff9681466b0 2020-06-12T17:49:48.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.360+0000 7ff967fff700 1 --2- 172.21.15.38:0/3936556190 >> v2:172.21.15.150:3300/0 conn(0x7ff9681466b0 0x7ff968147d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff9600032b0 tx=0x7ff9600081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.360+0000 7ff967fff700 1 --2- 172.21.15.38:0/3936556190 >> v2:172.21.15.150:3300/0 conn(0x7ff9681466b0 0x7ff968147d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff9600032b0 tx=0x7ff9600081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.360+0000 7ff967fff700 1 --2- 172.21.15.38:0/3936556190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9681466b0 0x7ff968147d00 secure :-1 s=READY pgs=328 cs=0 l=1 rx=0x7ff9600032b0 tx=0x7ff9600081e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:48.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.360+0000 7ff967fff700 1 --2- 172.21.15.38:0/3936556190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9681466b0 0x7ff968147d00 secure :-1 s=THROTTLE_DONE pgs=328 cs=0 l=1 rx=0x7ff9600032b0 tx=0x7ff9600081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.360+0000 7ff967fff700 1 --2- 172.21.15.38:0/3936556190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9681466b0 0x7ff968147d00 secure :-1 s=THROTTLE_DONE pgs=328 cs=0 l=1 rx=0x7ff9600032b0 tx=0x7ff9600081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.376 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.360+0000 7ff964ff9700 1 -- 172.21.15.38:0/3936556190 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff960011e10 con 0x7ff9681466b0 2020-06-12T17:49:48.376 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.360+0000 7ff967fff700 1 --2- 172.21.15.38:0/3936556190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9681466b0 0x7ff968147d00 secure :-1 s=THROTTLE_DONE pgs=328 cs=0 l=1 rx=0x7ff9600032b0 tx=0x7ff9600081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.376 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.360+0000 7ff964ff9700 1 -- 172.21.15.38:0/3936556190 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff960005a40 con 0x7ff9681466b0 2020-06-12T17:49:48.376 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.360+0000 7ff964ff9700 1 -- 172.21.15.38:0/3936556190 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff960005da0 con 0x7ff9681466b0 2020-06-12T17:49:48.376 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.360+0000 7ff96cc57700 1 -- 172.21.15.38:0/3936556190 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96813f530 con 0x7ff9681466b0 2020-06-12T17:49:48.377 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.360+0000 7ff96cc57700 1 -- 172.21.15.38:0/3936556190 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96814a250 con 0x7ff9681466b0 2020-06-12T17:49:48.377 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.361+0000 7ff967fff700 1 --2- 172.21.15.38:0/3936556190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9681466b0 0x7ff968147d00 secure :-1 s=THROTTLE_DONE pgs=328 cs=0 l=1 rx=0x7ff9600032b0 tx=0x7ff9600081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.377 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.361+0000 7ff96cc57700 1 -- 172.21.15.38:0/3936556190 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff968064010 con 0x7ff9681466b0 2020-06-12T17:49:48.377 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.362+0000 7ff964ff9700 1 -- 172.21.15.38:0/3936556190 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7ff960008420 con 0x7ff9681466b0 2020-06-12T17:49:48.377 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.362+0000 7ff967fff700 1 --2- 172.21.15.38:0/3936556190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9681466b0 0x7ff968147d00 secure :-1 s=THROTTLE_DONE pgs=328 cs=0 l=1 rx=0x7ff9600032b0 tx=0x7ff9600081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.378 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.362+0000 7ff964ff9700 1 --2- 172.21.15.38:0/3936556190 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff94804d840 0x7ff94804fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:48.378 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.362+0000 7ff964ff9700 1 -- 172.21.15.38:0/3936556190 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff96000f0c0 con 0x7ff9681466b0 2020-06-12T17:49:48.378 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.362+0000 7ff9677fe700 1 --2- 172.21.15.38:0/3936556190 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff94804d840 0x7ff94804fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:48.378 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.362+0000 7ff9677fe700 1 --2- 172.21.15.38:0/3936556190 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff94804d840 0x7ff94804fd00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff958001130 tx=0x7ff958001500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.379 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.362+0000 7ff9677fe700 1 --2- 172.21.15.38:0/3936556190 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff94804d840 0x7ff94804fd00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff958001130 tx=0x7ff958001500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.379 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.362+0000 7ff9677fe700 1 --2- 172.21.15.38:0/3936556190 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff94804d840 0x7ff94804fd00 secure :-1 s=READY pgs=221 cs=0 l=1 rx=0x7ff958001130 tx=0x7ff958001500).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:48.379 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.366+0000 7ff967fff700 1 --2- 172.21.15.38:0/3936556190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9681466b0 0x7ff968147d00 secure :-1 s=THROTTLE_DONE pgs=328 cs=0 l=1 rx=0x7ff9600032b0 tx=0x7ff9600081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.379 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.366+0000 7ff964ff9700 1 -- 172.21.15.38:0/3936556190 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7ff96003ca60 con 0x7ff9681466b0 2020-06-12T17:49:48.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.562+0000 7ff96cc57700 1 -- 172.21.15.38:0/3936556190 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_3385", "target": ["mon-mgr", ""]}) v1 -- 0x7ff968056c30 con 0x7ff94804d840 2020-06-12T17:49:48.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.566+0000 7ff9677fe700 1 --2- 172.21.15.38:0/3936556190 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff94804d840 0x7ff94804fd00 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7ff958001130 tx=0x7ff958001500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:48.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.566+0000 7ff964ff9700 1 -- 172.21.15.38:0/3936556190 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7ff968056c30 con 0x7ff94804d840 2020-06-12T17:49:48.570 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_3385/3575c2d8-fd93-40c8-9536-e3871c14c42b 2020-06-12T17:49:48.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.567+0000 7ff96cc57700 1 -- 172.21.15.38:0/3936556190 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff94804d840 msgr2=0x7ff94804fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:48.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.567+0000 7ff96cc57700 1 --2- 172.21.15.38:0/3936556190 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff94804d840 0x7ff94804fd00 secure :-1 s=READY pgs=221 cs=0 l=1 rx=0x7ff958001130 tx=0x7ff958001500).stop 2020-06-12T17:49:48.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.567+0000 7ff96cc57700 1 -- 172.21.15.38:0/3936556190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9681466b0 msgr2=0x7ff968147d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:48.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.567+0000 7ff96cc57700 1 --2- 172.21.15.38:0/3936556190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9681466b0 0x7ff968147d00 secure :-1 s=READY pgs=328 cs=0 l=1 rx=0x7ff9600032b0 tx=0x7ff9600081e0).stop 2020-06-12T17:49:48.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.567+0000 7ff96cc57700 1 -- 172.21.15.38:0/3936556190 shutdown_connections 2020-06-12T17:49:48.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.567+0000 7ff96cc57700 1 --2- 172.21.15.38:0/3936556190 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff94804d840 0x7ff94804fd00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:48.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.567+0000 7ff96cc57700 1 --2- 172.21.15.38:0/3936556190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9681466b0 0x7ff968147d00 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:48.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.567+0000 7ff96cc57700 1 -- 172.21.15.38:0/3936556190 >> 172.21.15.38:0/3936556190 conn(0x7ff9680ba410 msgr2=0x7ff96805ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:48.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.567+0000 7ff96cc57700 1 -- 172.21.15.38:0/3936556190 shutdown_connections 2020-06-12T17:49:48.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:48.567+0000 7ff96cc57700 1 -- 172.21.15.38:0/3936556190 wait complete. 2020-06-12T17:49:48.581 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_3385 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_3385/3575c2d8-fd93-40c8-9536-e3871c14c42b 2020-06-12T17:49:48.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:48.582 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:48.583 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:48.598 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:48.598 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:48.599 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3385/3575c2d8-fd93-40c8-9536-e3871c14c42b/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:48.689 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:48.690 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:48.690 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01181 s, 88.8 MB/s 2020-06-12T17:49:48.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:48.692 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:48.693 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:48.708 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:48.708 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:48.709 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3385/3575c2d8-fd93-40c8-9536-e3871c14c42b/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:48.794 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:48.794 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:48.795 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922379 s, 114 MB/s 2020-06-12T17:49:48.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:48.796 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:48.797 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:48.820 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:48.820 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:48.821 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3385/3575c2d8-fd93-40c8-9536-e3871c14c42b/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:48.908 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:48.909 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:48.909 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120961 s, 86.7 MB/s 2020-06-12T17:49:48.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:48.910 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:48.911 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:48.926 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:48.927 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:48.927 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3385/3575c2d8-fd93-40c8-9536-e3871c14c42b/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:49.016 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:49.017 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:49.017 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107263 s, 97.8 MB/s 2020-06-12T17:49:49.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:49.019 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:49.019 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:49.036 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:49.036 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:49.037 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3385/3575c2d8-fd93-40c8-9536-e3871c14c42b/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:49.127 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:49.128 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:49.128 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011193 s, 93.7 MB/s 2020-06-12T17:49:49.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:49.129 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:49.130 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:49.145 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:49.145 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:49.146 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3385/3575c2d8-fd93-40c8-9536-e3871c14c42b/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:49.232 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:49.233 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:49.233 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106337 s, 98.6 MB/s 2020-06-12T17:49:49.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:49.234 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:49.235 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:49.250 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:49.251 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:49.251 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3385/3575c2d8-fd93-40c8-9536-e3871c14c42b/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:49.337 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:49.337 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:49.338 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103113 s, 102 MB/s 2020-06-12T17:49:49.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:49.339 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:49.340 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:49.355 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:49.355 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:49.356 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3385/3575c2d8-fd93-40c8-9536-e3871c14c42b/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:49.442 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:49.443 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:49.443 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00993133 s, 106 MB/s 2020-06-12T17:49:49.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:49.444 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:49.445 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:49.460 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:49.461 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:49.461 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3385/3575c2d8-fd93-40c8-9536-e3871c14c42b/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:49.548 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:49.549 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:49.549 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100964 s, 104 MB/s 2020-06-12T17:49:49.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:49.551 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:49.552 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:49.573 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:49.573 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:49.574 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3385/3575c2d8-fd93-40c8-9536-e3871c14c42b/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:49.660 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:49.661 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:49.661 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107627 s, 97.4 MB/s 2020-06-12T17:49:49.663 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_1586 2020-06-12T17:49:49.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.777+0000 7fba5ab3c700 1 Processor -- start 2020-06-12T17:49:49.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.777+0000 7fba5ab3c700 1 -- start start 2020-06-12T17:49:49.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.778+0000 7fba5ab3c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fba540ad5b0 0x7fba540b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:49.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.778+0000 7fba5ab3c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fba5409d8d0 0x7fba541421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:49.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.778+0000 7fba5ab3c700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba54146d20 con 0x7fba54146680 2020-06-12T17:49:49.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.778+0000 7fba5ab3c700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba54066a80 con 0x7fba5409d8d0 2020-06-12T17:49:49.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.778+0000 7fba5ab3c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba54146f50 con 0x7fba540ad5b0 2020-06-12T17:49:49.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.778+0000 7fba590d9700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fba5409d8d0 0x7fba541421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:49.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.778+0000 7fba590d9700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fba5409d8d0 0x7fba541421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38148/0 (socket says 172.21.15.38:38148) 2020-06-12T17:49:49.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.778+0000 7fba588d8700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fba54146680 0x7fba5409d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39960/0 (socket says 172.21.15.38:39960) 2020-06-12T17:49:49.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.778+0000 7fba590d9700 1 -- 172.21.15.38:0/1828534066 learned_addr learned my addr 172.21.15.38:0/1828534066 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:49.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.778+0000 7fba53fff700 1 --2- 172.21.15.38:0/1828534066 >> v2:172.21.15.150:3300/0 conn(0x7fba540ad5b0 0x7fba540b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:49.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.778+0000 7fba590d9700 1 -- 172.21.15.38:0/1828534066 >> v2:172.21.15.150:3300/0 conn(0x7fba540ad5b0 msgr2=0x7fba540b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:49.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.778+0000 7fba590d9700 1 --2- 172.21.15.38:0/1828534066 >> v2:172.21.15.150:3300/0 conn(0x7fba540ad5b0 0x7fba540b2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:49.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.778+0000 7fba590d9700 1 -- 172.21.15.38:0/1828534066 >> v1:172.21.15.38:6789/0 conn(0x7fba54146680 legacy=0x7fba5409d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:49.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.778+0000 7fba590d9700 1 -- 172.21.15.38:0/1828534066 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba54146a60 con 0x7fba5409d8d0 2020-06-12T17:49:49.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.778+0000 7fba537fe700 1 -- 172.21.15.38:0/1828534066 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2806771217 0 0) 0x7fba54146d20 con 0x7fba54146680 2020-06-12T17:49:49.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.778+0000 7fba590d9700 1 --2- 172.21.15.38:0/1828534066 >> v2:172.21.15.38:3300/0 conn(0x7fba5409d8d0 0x7fba541421d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fba4c0032b0 tx=0x7fba4c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:49.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.779+0000 7fba590d9700 1 --2- 172.21.15.38:0/1828534066 >> v2:172.21.15.38:3300/0 conn(0x7fba5409d8d0 0x7fba541421d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fba4c0032b0 tx=0x7fba4c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:49.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.779+0000 7fba590d9700 1 --2- 172.21.15.38:0/1828534066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba5409d8d0 0x7fba541421d0 secure :-1 s=READY pgs=558 cs=0 l=1 rx=0x7fba4c0032b0 tx=0x7fba4c0081e0).ready entity=mon.0 client_cookie=8dd91b5499c080f8 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:49.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.779+0000 7fba590d9700 1 --2- 172.21.15.38:0/1828534066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba5409d8d0 0x7fba541421d0 secure :-1 s=THROTTLE_DONE pgs=558 cs=0 l=1 rx=0x7fba4c0032b0 tx=0x7fba4c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:49.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.779+0000 7fba537fe700 1 -- 172.21.15.38:0/1828534066 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba4c00a160 con 0x7fba5409d8d0 2020-06-12T17:49:49.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.779+0000 7fba590d9700 1 --2- 172.21.15.38:0/1828534066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba5409d8d0 0x7fba541421d0 secure :-1 s=THROTTLE_DONE pgs=558 cs=0 l=1 rx=0x7fba4c0032b0 tx=0x7fba4c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:49.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.779+0000 7fba590d9700 1 --2- 172.21.15.38:0/1828534066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba5409d8d0 0x7fba541421d0 secure :-1 s=THROTTLE_DONE pgs=558 cs=0 l=1 rx=0x7fba4c0032b0 tx=0x7fba4c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:49.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.779+0000 7fba537fe700 1 -- 172.21.15.38:0/1828534066 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c00a2c0 con 0x7fba5409d8d0 2020-06-12T17:49:49.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.779+0000 7fba537fe700 1 -- 172.21.15.38:0/1828534066 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba4c00a660 con 0x7fba5409d8d0 2020-06-12T17:49:49.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.779+0000 7fba5ab3c700 1 -- 172.21.15.38:0/1828534066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba5409d8d0 msgr2=0x7fba541421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:49.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.779+0000 7fba5ab3c700 1 --2- 172.21.15.38:0/1828534066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba5409d8d0 0x7fba541421d0 secure :-1 s=READY pgs=558 cs=0 l=1 rx=0x7fba4c0032b0 tx=0x7fba4c0081e0).stop 2020-06-12T17:49:49.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.779+0000 7fba5ab3c700 1 -- 172.21.15.38:0/1828534066 shutdown_connections 2020-06-12T17:49:49.800 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.779+0000 7fba5ab3c700 1 --2- 172.21.15.38:0/1828534066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba5409d8d0 0x7fba541421d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:49.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.779+0000 7fba5ab3c700 1 --2- 172.21.15.38:0/1828534066 >> v2:172.21.15.150:3300/0 conn(0x7fba540ad5b0 0x7fba540b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:49.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.779+0000 7fba5ab3c700 1 -- 172.21.15.38:0/1828534066 >> 172.21.15.38:0/1828534066 conn(0x7fba540b5a20 msgr2=0x7fba5405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:49.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.779+0000 7fba5ab3c700 1 -- 172.21.15.38:0/1828534066 shutdown_connections 2020-06-12T17:49:49.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.779+0000 7fba5ab3c700 1 -- 172.21.15.38:0/1828534066 wait complete. 2020-06-12T17:49:49.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.780+0000 7fba5ab3c700 1 Processor -- start 2020-06-12T17:49:49.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.780+0000 7fba5ab3c700 1 -- start start 2020-06-12T17:49:49.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.781+0000 7fba5ab3c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fba5409d8d0 0x7fba540660e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:49.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.781+0000 7fba5ab3c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba540ad5b0 0x7fba540b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:49.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.781+0000 7fba5ab3c700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba54157a80 con 0x7fba54146680 2020-06-12T17:49:49.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.781+0000 7fba5ab3c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba54153980 con 0x7fba5409d8d0 2020-06-12T17:49:49.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.781+0000 7fba5ab3c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba54153670 con 0x7fba540ad5b0 2020-06-12T17:49:49.805 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.781+0000 7fba590d9700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fba54146680 0x7fba54153e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39970/0 (socket says 172.21.15.38:39970) 2020-06-12T17:49:49.805 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.781+0000 7fba590d9700 1 -- 172.21.15.38:0/3330515690 learned_addr learned my addr 172.21.15.38:0/3330515690 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:49.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.781+0000 7fba588d8700 1 --2- 172.21.15.38:0/3330515690 >> v2:172.21.15.150:3300/0 conn(0x7fba5409d8d0 0x7fba540660e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:49.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.781+0000 7fba53fff700 1 --2- 172.21.15.38:0/3330515690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba540ad5b0 0x7fba540b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:49.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.781+0000 7fba51ffb700 1 -- 172.21.15.38:0/3330515690 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3578269725 0 0) 0x7fba54157a80 con 0x7fba54146680 2020-06-12T17:49:49.807 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.781+0000 7fba51ffb700 1 -- 172.21.15.38:0/3330515690 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba34002fe0 con 0x7fba54146680 2020-06-12T17:49:49.807 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.782+0000 7fba51ffb700 1 -- 172.21.15.38:0/3330515690 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 417672991 0 0) 0x7fba34002fe0 con 0x7fba54146680 2020-06-12T17:49:49.807 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.782+0000 7fba51ffb700 1 -- 172.21.15.38:0/3330515690 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fba54157a80 con 0x7fba54146680 2020-06-12T17:49:49.808 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.782+0000 7fba51ffb700 1 -- 172.21.15.38:0/3330515690 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fba4c0089e0 con 0x7fba54146680 2020-06-12T17:49:49.808 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.782+0000 7fba53fff700 1 -- 172.21.15.38:0/3330515690 >> v2:172.21.15.150:3300/0 conn(0x7fba5409d8d0 msgr2=0x7fba540660e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:49.808 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.782+0000 7fba53fff700 1 --2- 172.21.15.38:0/3330515690 >> v2:172.21.15.150:3300/0 conn(0x7fba5409d8d0 0x7fba540660e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:49.809 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.782+0000 7fba53fff700 1 -- 172.21.15.38:0/3330515690 >> v1:172.21.15.38:6789/0 conn(0x7fba54146680 legacy=0x7fba54153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:49.809 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.782+0000 7fba53fff700 1 -- 172.21.15.38:0/3330515690 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba540636d0 con 0x7fba540ad5b0 2020-06-12T17:49:49.809 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.782+0000 7fba588d8700 1 --2- 172.21.15.38:0/3330515690 >> v2:172.21.15.150:3300/0 conn(0x7fba5409d8d0 0x7fba540660e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:49:49.810 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.782+0000 7fba53fff700 1 --2- 172.21.15.38:0/3330515690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba540ad5b0 0x7fba540b3900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fba48002f30 tx=0x7fba48007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:49.810 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.782+0000 7fba53fff700 1 --2- 172.21.15.38:0/3330515690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba540ad5b0 0x7fba540b3900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fba48002f30 tx=0x7fba48007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:49.810 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.782+0000 7fba53fff700 1 --2- 172.21.15.38:0/3330515690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba540ad5b0 0x7fba540b3900 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7fba48002f30 tx=0x7fba48007ee0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:49.812 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.782+0000 7fba53fff700 1 --2- 172.21.15.38:0/3330515690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba540ad5b0 0x7fba540b3900 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fba48002f30 tx=0x7fba48007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:49.812 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.782+0000 7fba51ffb700 1 -- 172.21.15.38:0/3330515690 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba48008ea0 con 0x7fba540ad5b0 2020-06-12T17:49:49.813 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.782+0000 7fba53fff700 1 --2- 172.21.15.38:0/3330515690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba540ad5b0 0x7fba540b3900 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fba48002f30 tx=0x7fba48007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:49.813 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.782+0000 7fba53fff700 1 --2- 172.21.15.38:0/3330515690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba540ad5b0 0x7fba540b3900 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fba48002f30 tx=0x7fba48007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:49.813 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.782+0000 7fba51ffb700 1 -- 172.21.15.38:0/3330515690 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba48011e90 con 0x7fba540ad5b0 2020-06-12T17:49:49.814 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.782+0000 7fba5ab3c700 1 -- 172.21.15.38:0/3330515690 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba54154530 con 0x7fba540ad5b0 2020-06-12T17:49:49.814 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.782+0000 7fba51ffb700 1 -- 172.21.15.38:0/3330515690 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba48007340 con 0x7fba540ad5b0 2020-06-12T17:49:49.814 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.782+0000 7fba5ab3c700 1 -- 172.21.15.38:0/3330515690 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba54064c70 con 0x7fba540ad5b0 2020-06-12T17:49:49.815 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.783+0000 7fba53fff700 1 --2- 172.21.15.38:0/3330515690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba540ad5b0 0x7fba540b3900 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fba48002f30 tx=0x7fba48007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:49.815 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.783+0000 7fba5ab3c700 1 -- 172.21.15.38:0/3330515690 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba541537e0 con 0x7fba540ad5b0 2020-06-12T17:49:49.815 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.783+0000 7fba51ffb700 1 -- 172.21.15.38:0/3330515690 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fba480056c0 con 0x7fba540ad5b0 2020-06-12T17:49:49.816 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.783+0000 7fba53fff700 1 --2- 172.21.15.38:0/3330515690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba540ad5b0 0x7fba540b3900 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fba48002f30 tx=0x7fba48007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:49.816 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.784+0000 7fba51ffb700 1 --2- 172.21.15.38:0/3330515690 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fba3404db20 0x7fba3404ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:49.816 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.784+0000 7fba51ffb700 1 -- 172.21.15.38:0/3330515690 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fba4800b0a0 con 0x7fba540ad5b0 2020-06-12T17:49:49.817 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.784+0000 7fba588d8700 1 --2- 172.21.15.38:0/3330515690 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fba3404db20 0x7fba3404ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:49.817 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.784+0000 7fba588d8700 1 --2- 172.21.15.38:0/3330515690 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fba3404db20 0x7fba3404ffe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fba44000b80 tx=0x7fba440016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:49.817 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.784+0000 7fba588d8700 1 --2- 172.21.15.38:0/3330515690 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fba3404db20 0x7fba3404ffe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fba44000b80 tx=0x7fba440016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:49.818 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.784+0000 7fba588d8700 1 --2- 172.21.15.38:0/3330515690 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fba3404db20 0x7fba3404ffe0 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7fba44000b80 tx=0x7fba440016e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:49.819 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.788+0000 7fba53fff700 1 --2- 172.21.15.38:0/3330515690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba540ad5b0 0x7fba540b3900 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fba48002f30 tx=0x7fba48007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:49.819 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.788+0000 7fba51ffb700 1 -- 172.21.15.38:0/3330515690 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fba541537e0 con 0x7fba540ad5b0 2020-06-12T17:49:49.985 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:49.982+0000 7fba5ab3c700 1 -- 172.21.15.38:0/3330515690 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_1586", "target": ["mon-mgr", ""]}) v1 -- 0x7fba541537b0 con 0x7fba3404db20 2020-06-12T17:49:50.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.001+0000 7fba588d8700 1 --2- 172.21.15.38:0/3330515690 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fba3404db20 0x7fba3404ffe0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7fba44000b80 tx=0x7fba440016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:50.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.001+0000 7fba51ffb700 1 -- 172.21.15.38:0/3330515690 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fba541537b0 con 0x7fba3404db20 2020-06-12T17:49:50.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.002+0000 7fba5ab3c700 1 -- 172.21.15.38:0/3330515690 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fba3404db20 msgr2=0x7fba3404ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:50.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.002+0000 7fba5ab3c700 1 --2- 172.21.15.38:0/3330515690 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fba3404db20 0x7fba3404ffe0 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7fba44000b80 tx=0x7fba440016e0).stop 2020-06-12T17:49:50.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.002+0000 7fba5ab3c700 1 -- 172.21.15.38:0/3330515690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba540ad5b0 msgr2=0x7fba540b3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:50.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.002+0000 7fba5ab3c700 1 --2- 172.21.15.38:0/3330515690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba540ad5b0 0x7fba540b3900 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7fba48002f30 tx=0x7fba48007ee0).stop 2020-06-12T17:49:50.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.002+0000 7fba5ab3c700 1 -- 172.21.15.38:0/3330515690 shutdown_connections 2020-06-12T17:49:50.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.002+0000 7fba5ab3c700 1 --2- 172.21.15.38:0/3330515690 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fba3404db20 0x7fba3404ffe0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:50.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.002+0000 7fba5ab3c700 1 --2- 172.21.15.38:0/3330515690 >> v2:172.21.15.150:3300/0 conn(0x7fba5409d8d0 0x7fba540660e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:50.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.002+0000 7fba5ab3c700 1 --2- 172.21.15.38:0/3330515690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba540ad5b0 0x7fba540b3900 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:50.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.002+0000 7fba5ab3c700 1 -- 172.21.15.38:0/3330515690 >> 172.21.15.38:0/3330515690 conn(0x7fba540b5a20 msgr2=0x7fba5405ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:50.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.002+0000 7fba5ab3c700 1 -- 172.21.15.38:0/3330515690 shutdown_connections 2020-06-12T17:49:50.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.002+0000 7fba5ab3c700 1 -- 172.21.15.38:0/3330515690 wait complete. 2020-06-12T17:49:50.016 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_1586 2020-06-12T17:49:50.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.131+0000 7f29699c4700 1 Processor -- start 2020-06-12T17:49:50.144 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.131+0000 7f29699c4700 1 -- start start 2020-06-12T17:49:50.144 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.132+0000 7f29699c4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f296409dd30 0x7f2964066b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:50.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.132+0000 7f29699c4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f296409b190 0x7f29641431e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.132+0000 7f29699c4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2964147550 con 0x7f2964143640 2020-06-12T17:49:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.132+0000 7f29699c4700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2964067380 con 0x7f296409b190 2020-06-12T17:49:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.132+0000 7f29699c4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296409e110 con 0x7f296409dd30 2020-06-12T17:49:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.132+0000 7f29627fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f296409b190 0x7f29641431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.132+0000 7f29627fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f296409b190 0x7f29641431e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38158/0 (socket says 172.21.15.38:38158) 2020-06-12T17:49:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.132+0000 7f29627fc700 1 -- 172.21.15.38:0/2618171442 learned_addr learned my addr 172.21.15.38:0/2618171442 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.132+0000 7f2962ffd700 1 --2- 172.21.15.38:0/2618171442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f296409dd30 0x7f2964066b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.133+0000 7f29627fc700 1 -- 172.21.15.38:0/2618171442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f296409dd30 msgr2=0x7f2964066b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.133+0000 7f29627fc700 1 --2- 172.21.15.38:0/2618171442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f296409dd30 0x7f2964066b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:50.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.133+0000 7f29627fc700 1 -- 172.21.15.38:0/2618171442 >> v1:172.21.15.150:6789/0 conn(0x7f2964143640 legacy=0x7f29640ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:50.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.133+0000 7f29627fc700 1 -- 172.21.15.38:0/2618171442 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2964067000 con 0x7f296409b190 2020-06-12T17:49:50.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.133+0000 7f29627fc700 1 --2- 172.21.15.38:0/2618171442 >> v2:172.21.15.38:3300/0 conn(0x7f296409b190 0x7f29641431e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2964061380 tx=0x7f29540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:50.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.133+0000 7f29627fc700 1 --2- 172.21.15.38:0/2618171442 >> v2:172.21.15.38:3300/0 conn(0x7f296409b190 0x7f29641431e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2964061380 tx=0x7f29540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:50.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.133+0000 7f29627fc700 1 --2- 172.21.15.38:0/2618171442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f296409b190 0x7f29641431e0 secure :-1 s=READY pgs=560 cs=0 l=1 rx=0x7f2964061380 tx=0x7f29540081e0).ready entity=mon.0 client_cookie=fa77f4b848eaf9e3 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:50.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.133+0000 7f29627fc700 1 --2- 172.21.15.38:0/2618171442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f296409b190 0x7f29641431e0 secure :-1 s=THROTTLE_DONE pgs=560 cs=0 l=1 rx=0x7f2964061380 tx=0x7f29540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:50.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.133+0000 7f2961ffb700 1 -- 172.21.15.38:0/2618171442 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f295400a160 con 0x7f296409b190 2020-06-12T17:49:50.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.133+0000 7f29627fc700 1 --2- 172.21.15.38:0/2618171442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f296409b190 0x7f29641431e0 secure :-1 s=THROTTLE_DONE pgs=560 cs=0 l=1 rx=0x7f2964061380 tx=0x7f29540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:50.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.133+0000 7f29627fc700 1 --2- 172.21.15.38:0/2618171442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f296409b190 0x7f29641431e0 secure :-1 s=THROTTLE_DONE pgs=560 cs=0 l=1 rx=0x7f2964061380 tx=0x7f29540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:50.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.133+0000 7f2961ffb700 1 -- 172.21.15.38:0/2618171442 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295400a2c0 con 0x7f296409b190 2020-06-12T17:49:50.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.133+0000 7f2961ffb700 1 -- 172.21.15.38:0/2618171442 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f295400a6e0 con 0x7f296409b190 2020-06-12T17:49:50.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.133+0000 7f29699c4700 1 -- 172.21.15.38:0/2618171442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f296409b190 msgr2=0x7f29641431e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:50.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.133+0000 7f29699c4700 1 --2- 172.21.15.38:0/2618171442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f296409b190 0x7f29641431e0 secure :-1 s=READY pgs=560 cs=0 l=1 rx=0x7f2964061380 tx=0x7f29540081e0).stop 2020-06-12T17:49:50.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.133+0000 7f29699c4700 1 -- 172.21.15.38:0/2618171442 shutdown_connections 2020-06-12T17:49:50.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.133+0000 7f29699c4700 1 --2- 172.21.15.38:0/2618171442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f296409dd30 0x7f2964066b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:50.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.133+0000 7f29699c4700 1 --2- 172.21.15.38:0/2618171442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f296409b190 0x7f29641431e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:50.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.133+0000 7f29699c4700 1 -- 172.21.15.38:0/2618171442 >> 172.21.15.38:0/2618171442 conn(0x7f29640b5a20 msgr2=0x7f296405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:50.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.133+0000 7f29699c4700 1 -- 172.21.15.38:0/2618171442 shutdown_connections 2020-06-12T17:49:50.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.133+0000 7f29699c4700 1 -- 172.21.15.38:0/2618171442 wait complete. 2020-06-12T17:49:50.156 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.134+0000 7f29699c4700 1 Processor -- start 2020-06-12T17:49:50.156 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.134+0000 7f29699c4700 1 -- start start 2020-06-12T17:49:50.156 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.135+0000 7f29699c4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f296409b190 0x7f29640b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:50.156 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.135+0000 7f29699c4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2964143640 0x7f2964156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:50.157 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.135+0000 7f29699c4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f296409d760 con 0x7f296409dd30 2020-06-12T17:49:50.157 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.135+0000 7f29699c4700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2964153660 con 0x7f296409b190 2020-06-12T17:49:50.157 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.135+0000 7f29699c4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2964153900 con 0x7f2964143640 2020-06-12T17:49:50.157 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.135+0000 7f2962ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f296409b190 0x7f29640b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:50.158 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.135+0000 7f2962ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f296409b190 0x7f29640b14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38160/0 (socket says 172.21.15.38:38160) 2020-06-12T17:49:50.158 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.135+0000 7f2962ffd700 1 -- 172.21.15.38:0/3661475720 learned_addr learned my addr 172.21.15.38:0/3661475720 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:50.158 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.135+0000 7f29637fe700 1 --2- 172.21.15.38:0/3661475720 >> v2:172.21.15.150:3300/0 conn(0x7f2964143640 0x7f2964156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:50.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.136+0000 7f2962ffd700 1 -- 172.21.15.38:0/3661475720 >> v2:172.21.15.150:3300/0 conn(0x7f2964143640 msgr2=0x7f2964156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:50.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.136+0000 7f2962ffd700 1 --2- 172.21.15.38:0/3661475720 >> v2:172.21.15.150:3300/0 conn(0x7f2964143640 0x7f2964156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:50.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.136+0000 7f2962ffd700 1 -- 172.21.15.38:0/3661475720 >> v1:172.21.15.150:6789/0 conn(0x7f296409dd30 legacy=0x7f2964157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:50.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.136+0000 7f2962ffd700 1 -- 172.21.15.38:0/3661475720 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2964153ba0 con 0x7f296409b190 2020-06-12T17:49:50.160 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.136+0000 7f29637fe700 1 --2- 172.21.15.38:0/3661475720 >> v2:172.21.15.150:3300/0 conn(0x7f2964143640 0x7f2964156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:49:50.160 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.136+0000 7f2962ffd700 1 --2- 172.21.15.38:0/3661475720 >> v2:172.21.15.38:3300/0 conn(0x7f296409b190 0x7f29640b14b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2958003070 tx=0x7f295800e1a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:50.160 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.136+0000 7f2962ffd700 1 --2- 172.21.15.38:0/3661475720 >> v2:172.21.15.38:3300/0 conn(0x7f296409b190 0x7f29640b14b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2958003070 tx=0x7f295800e1a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:50.160 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.136+0000 7f2962ffd700 1 --2- 172.21.15.38:0/3661475720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f296409b190 0x7f29640b14b0 secure :-1 s=READY pgs=561 cs=0 l=1 rx=0x7f2958003070 tx=0x7f295800e1a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:50.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.136+0000 7f2962ffd700 1 --2- 172.21.15.38:0/3661475720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f296409b190 0x7f29640b14b0 secure :-1 s=THROTTLE_DONE pgs=561 cs=0 l=1 rx=0x7f2958003070 tx=0x7f295800e1a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:50.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.136+0000 7f2962ffd700 1 --2- 172.21.15.38:0/3661475720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f296409b190 0x7f29640b14b0 secure :-1 s=THROTTLE_DONE pgs=561 cs=0 l=1 rx=0x7f2958003070 tx=0x7f295800e1a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:50.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.136+0000 7f2953fff700 1 -- 172.21.15.38:0/3661475720 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2958012ad0 con 0x7f296409b190 2020-06-12T17:49:50.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.136+0000 7f2962ffd700 1 --2- 172.21.15.38:0/3661475720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f296409b190 0x7f29640b14b0 secure :-1 s=THROTTLE_DONE pgs=561 cs=0 l=1 rx=0x7f2958003070 tx=0x7f295800e1a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:50.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.136+0000 7f2953fff700 1 -- 172.21.15.38:0/3661475720 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2958012c30 con 0x7f296409b190 2020-06-12T17:49:50.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.136+0000 7f29699c4700 1 -- 172.21.15.38:0/3661475720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2964157940 con 0x7f296409b190 2020-06-12T17:49:50.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.136+0000 7f2953fff700 1 -- 172.21.15.38:0/3661475720 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29580091a0 con 0x7f296409b190 2020-06-12T17:49:50.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.136+0000 7f29699c4700 1 -- 172.21.15.38:0/3661475720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29640b7ca0 con 0x7f296409b190 2020-06-12T17:49:50.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.137+0000 7f2962ffd700 1 --2- 172.21.15.38:0/3661475720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f296409b190 0x7f29640b14b0 secure :-1 s=THROTTLE_DONE pgs=561 cs=0 l=1 rx=0x7f2958003070 tx=0x7f295800e1a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:50.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.137+0000 7f29699c4700 1 -- 172.21.15.38:0/3661475720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2964056c30 con 0x7f296409b190 2020-06-12T17:49:50.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.137+0000 7f2953fff700 1 -- 172.21.15.38:0/3661475720 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f2958007170 con 0x7f296409b190 2020-06-12T17:49:50.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.137+0000 7f2962ffd700 1 --2- 172.21.15.38:0/3661475720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f296409b190 0x7f29640b14b0 secure :-1 s=THROTTLE_DONE pgs=561 cs=0 l=1 rx=0x7f2958003070 tx=0x7f295800e1a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:50.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.137+0000 7f2953fff700 1 --2- 172.21.15.38:0/3661475720 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f294004d630 0x7f294004faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:50.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.137+0000 7f2953fff700 1 -- 172.21.15.38:0/3661475720 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f29580615e0 con 0x7f296409b190 2020-06-12T17:49:50.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.138+0000 7f29627fc700 1 --2- 172.21.15.38:0/3661475720 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f294004d630 0x7f294004faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:50.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.138+0000 7f29627fc700 1 --2- 172.21.15.38:0/3661475720 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f294004d630 0x7f294004faf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2964090460 tx=0x7f29540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:50.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.138+0000 7f29627fc700 1 --2- 172.21.15.38:0/3661475720 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f294004d630 0x7f294004faf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2964090460 tx=0x7f29540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:50.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.138+0000 7f29627fc700 1 --2- 172.21.15.38:0/3661475720 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f294004d630 0x7f294004faf0 secure :-1 s=READY pgs=223 cs=0 l=1 rx=0x7f2964090460 tx=0x7f29540081e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:50.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.141+0000 7f2962ffd700 1 --2- 172.21.15.38:0/3661475720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f296409b190 0x7f29640b14b0 secure :-1 s=THROTTLE_DONE pgs=561 cs=0 l=1 rx=0x7f2958003070 tx=0x7f295800e1a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:50.166 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.141+0000 7f2953fff700 1 -- 172.21.15.38:0/3661475720 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f295803cd00 con 0x7f296409b190 2020-06-12T17:49:50.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.334+0000 7f29699c4700 1 -- 172.21.15.38:0/3661475720 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_1586", "target": ["mon-mgr", ""]}) v1 -- 0x7f2964153d30 con 0x7f294004d630 2020-06-12T17:49:50.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.338+0000 7f29627fc700 1 --2- 172.21.15.38:0/3661475720 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f294004d630 0x7f294004faf0 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7f2964090460 tx=0x7f29540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:50.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.338+0000 7f2953fff700 1 -- 172.21.15.38:0/3661475720 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f2964153d30 con 0x7f294004d630 2020-06-12T17:49:50.342 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_1586/408564f7-423a-45f2-bbe9-02f2cbeee816 2020-06-12T17:49:50.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.339+0000 7f29699c4700 1 -- 172.21.15.38:0/3661475720 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f294004d630 msgr2=0x7f294004faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:50.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.339+0000 7f29699c4700 1 --2- 172.21.15.38:0/3661475720 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f294004d630 0x7f294004faf0 secure :-1 s=READY pgs=223 cs=0 l=1 rx=0x7f2964090460 tx=0x7f29540081e0).stop 2020-06-12T17:49:50.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.339+0000 7f29699c4700 1 -- 172.21.15.38:0/3661475720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f296409b190 msgr2=0x7f29640b14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:50.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.339+0000 7f29699c4700 1 --2- 172.21.15.38:0/3661475720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f296409b190 0x7f29640b14b0 secure :-1 s=READY pgs=561 cs=0 l=1 rx=0x7f2958003070 tx=0x7f295800e1a0).stop 2020-06-12T17:49:50.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.339+0000 7f29699c4700 1 -- 172.21.15.38:0/3661475720 shutdown_connections 2020-06-12T17:49:50.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.339+0000 7f29699c4700 1 --2- 172.21.15.38:0/3661475720 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f294004d630 0x7f294004faf0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:50.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.339+0000 7f29699c4700 1 --2- 172.21.15.38:0/3661475720 >> v2:172.21.15.150:3300/0 conn(0x7f2964143640 0x7f2964156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:50.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.339+0000 7f29699c4700 1 --2- 172.21.15.38:0/3661475720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f296409b190 0x7f29640b14b0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:50.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.339+0000 7f29699c4700 1 -- 172.21.15.38:0/3661475720 >> 172.21.15.38:0/3661475720 conn(0x7f29640b5a20 msgr2=0x7f29640b6390 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:50.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.339+0000 7f29699c4700 1 -- 172.21.15.38:0/3661475720 shutdown_connections 2020-06-12T17:49:50.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:50.339+0000 7f29699c4700 1 -- 172.21.15.38:0/3661475720 wait complete. 2020-06-12T17:49:50.353 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_1586 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_1586/408564f7-423a-45f2-bbe9-02f2cbeee816 2020-06-12T17:49:50.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:50.354 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:50.354 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:50.369 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:50.370 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:50.371 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1586/408564f7-423a-45f2-bbe9-02f2cbeee816/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:50.461 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:50.461 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:50.461 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011174 s, 93.8 MB/s 2020-06-12T17:49:50.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:50.463 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:50.464 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:50.479 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:50.479 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:50.480 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1586/408564f7-423a-45f2-bbe9-02f2cbeee816/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:50.564 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:50.564 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:50.565 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010311 s, 102 MB/s 2020-06-12T17:49:50.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:50.566 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:50.567 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:50.582 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:50.582 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:50.583 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1586/408564f7-423a-45f2-bbe9-02f2cbeee816/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:50.675 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:50.675 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:50.676 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114877 s, 91.3 MB/s 2020-06-12T17:49:50.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:50.677 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:50.678 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:50.695 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:50.695 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:50.696 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1586/408564f7-423a-45f2-bbe9-02f2cbeee816/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:50.782 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:50.782 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:50.783 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102495 s, 102 MB/s 2020-06-12T17:49:50.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:50.784 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:50.785 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:50.800 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:50.801 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:50.801 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1586/408564f7-423a-45f2-bbe9-02f2cbeee816/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:50.890 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:50.890 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:50.890 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124729 s, 84.1 MB/s 2020-06-12T17:49:50.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:50.892 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:50.892 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:50.907 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:50.908 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:50.909 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1586/408564f7-423a-45f2-bbe9-02f2cbeee816/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:50.997 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:50.998 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:50.998 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107027 s, 98.0 MB/s 2020-06-12T17:49:50.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:51.000 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:51.000 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:51.015 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:51.016 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:51.016 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1586/408564f7-423a-45f2-bbe9-02f2cbeee816/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:51.103 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:51.104 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:51.104 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00978494 s, 107 MB/s 2020-06-12T17:49:51.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:51.106 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:51.106 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:51.121 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:51.122 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:51.123 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1586/408564f7-423a-45f2-bbe9-02f2cbeee816/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:51.216 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:51.216 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:51.216 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167032 s, 62.8 MB/s 2020-06-12T17:49:51.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:51.219 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:51.219 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:51.235 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:51.235 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:51.236 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1586/408564f7-423a-45f2-bbe9-02f2cbeee816/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:51.323 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:51.324 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:51.324 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117657 s, 89.1 MB/s 2020-06-12T17:49:51.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:51.326 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:51.326 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:51.342 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:51.342 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:51.343 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1586/408564f7-423a-45f2-bbe9-02f2cbeee816/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:51.432 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:51.433 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:51.434 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117156 s, 89.5 MB/s 2020-06-12T17:49:51.435 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_8479 2020-06-12T17:49:51.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.549+0000 7f147c881700 1 Processor -- start 2020-06-12T17:49:51.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.549+0000 7f147c881700 1 -- start start 2020-06-12T17:49:51.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.549+0000 7f147c881700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1478146680 0x7f14780ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:51.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.549+0000 7f147c881700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f14780b2eb0 0x7f147809d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:51.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.549+0000 7f147c881700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f147809d620 0x7f147809dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:51.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.549+0000 7f147c881700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1478146d20 con 0x7f14780b2eb0 2020-06-12T17:49:51.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.549+0000 7f147c881700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147809df30 con 0x7f1478146680 2020-06-12T17:49:51.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.549+0000 7f147c881700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1478066a80 con 0x7f147809d620 2020-06-12T17:49:51.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.550+0000 7f1475d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f14780b2eb0 0x7f147809d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:51.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.550+0000 7f1475d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f14780b2eb0 0x7f147809d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38168/0 (socket says 172.21.15.38:38168) 2020-06-12T17:49:51.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.550+0000 7f1475d9b700 1 -- 172.21.15.38:0/1418385165 learned_addr learned my addr 172.21.15.38:0/1418385165 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:51.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.550+0000 7f1476d9d700 1 --2- 172.21.15.38:0/1418385165 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f147809d620 0x7f147809dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:51.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.550+0000 7f147659c700 1 --2- 172.21.15.38:0/1418385165 >> v2:172.21.15.150:3300/0 conn(0x7f1478146680 0x7f14780ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:51.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.550+0000 7f1475d9b700 1 -- 172.21.15.38:0/1418385165 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f147809d620 msgr2=0x7f147809dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:51.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.550+0000 7f1475d9b700 1 --2- 172.21.15.38:0/1418385165 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f147809d620 0x7f147809dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:51.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.550+0000 7f1475d9b700 1 -- 172.21.15.38:0/1418385165 >> v2:172.21.15.150:3300/0 conn(0x7f1478146680 msgr2=0x7f14780ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:51.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.550+0000 7f1475d9b700 1 --2- 172.21.15.38:0/1418385165 >> v2:172.21.15.150:3300/0 conn(0x7f1478146680 0x7f14780ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:51.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.550+0000 7f1475d9b700 1 -- 172.21.15.38:0/1418385165 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1478146f50 con 0x7f14780b2eb0 2020-06-12T17:49:51.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.550+0000 7f1475d9b700 1 --2- 172.21.15.38:0/1418385165 >> v2:172.21.15.38:3300/0 conn(0x7f14780b2eb0 0x7f147809d1c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f14680032b0 tx=0x7f14680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.550+0000 7f1475d9b700 1 --2- 172.21.15.38:0/1418385165 >> v2:172.21.15.38:3300/0 conn(0x7f14780b2eb0 0x7f147809d1c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f14680032b0 tx=0x7f14680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.550+0000 7f1475d9b700 1 --2- 172.21.15.38:0/1418385165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14780b2eb0 0x7f147809d1c0 secure :-1 s=READY pgs=562 cs=0 l=1 rx=0x7f14680032b0 tx=0x7f14680081e0).ready entity=mon.0 client_cookie=d4daf1c011028c53 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:51.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.550+0000 7f1475d9b700 1 --2- 172.21.15.38:0/1418385165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14780b2eb0 0x7f147809d1c0 secure :-1 s=THROTTLE_DONE pgs=562 cs=0 l=1 rx=0x7f14680032b0 tx=0x7f14680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.550+0000 7f147559a700 1 -- 172.21.15.38:0/1418385165 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1468011df0 con 0x7f14780b2eb0 2020-06-12T17:49:51.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.550+0000 7f1475d9b700 1 --2- 172.21.15.38:0/1418385165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14780b2eb0 0x7f147809d1c0 secure :-1 s=THROTTLE_DONE pgs=562 cs=0 l=1 rx=0x7f14680032b0 tx=0x7f14680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.550+0000 7f1475d9b700 1 --2- 172.21.15.38:0/1418385165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14780b2eb0 0x7f147809d1c0 secure :-1 s=THROTTLE_DONE pgs=562 cs=0 l=1 rx=0x7f14680032b0 tx=0x7f14680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.550+0000 7f147559a700 1 -- 172.21.15.38:0/1418385165 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146800a160 con 0x7f14780b2eb0 2020-06-12T17:49:51.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.550+0000 7f147559a700 1 -- 172.21.15.38:0/1418385165 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f146800a540 con 0x7f14780b2eb0 2020-06-12T17:49:51.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.550+0000 7f147c881700 1 -- 172.21.15.38:0/1418385165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14780b2eb0 msgr2=0x7f147809d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:51.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.550+0000 7f147c881700 1 --2- 172.21.15.38:0/1418385165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14780b2eb0 0x7f147809d1c0 secure :-1 s=READY pgs=562 cs=0 l=1 rx=0x7f14680032b0 tx=0x7f14680081e0).stop 2020-06-12T17:49:51.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.551+0000 7f147c881700 1 -- 172.21.15.38:0/1418385165 shutdown_connections 2020-06-12T17:49:51.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.551+0000 7f147c881700 1 --2- 172.21.15.38:0/1418385165 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f147809d620 0x7f147809dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:51.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.551+0000 7f147c881700 1 --2- 172.21.15.38:0/1418385165 >> v2:172.21.15.150:3300/0 conn(0x7f1478146680 0x7f14780ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:51.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.551+0000 7f147c881700 1 --2- 172.21.15.38:0/1418385165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14780b2eb0 0x7f147809d1c0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:51.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.551+0000 7f147c881700 1 -- 172.21.15.38:0/1418385165 >> 172.21.15.38:0/1418385165 conn(0x7f14780b5a20 msgr2=0x7f147805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:51.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.551+0000 7f147c881700 1 -- 172.21.15.38:0/1418385165 shutdown_connections 2020-06-12T17:49:51.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.551+0000 7f147c881700 1 -- 172.21.15.38:0/1418385165 wait complete. 2020-06-12T17:49:51.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.552+0000 7f147c881700 1 Processor -- start 2020-06-12T17:49:51.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.552+0000 7f147c881700 1 -- start start 2020-06-12T17:49:51.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.553+0000 7f147c881700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f147809d620 0x7f14780b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:51.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.553+0000 7f147c881700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f14780b2eb0 0x7f1478139a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:51.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.553+0000 7f147c881700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14780618c0 con 0x7f1478146680 2020-06-12T17:49:51.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.553+0000 7f147c881700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14780b1300 con 0x7f14780b2eb0 2020-06-12T17:49:51.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.553+0000 7f147c881700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1478061af0 con 0x7f147809d620 2020-06-12T17:49:51.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.553+0000 7f1475d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f14780b2eb0 0x7f1478139a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:51.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.553+0000 7f1475d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f14780b2eb0 0x7f1478139a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38172/0 (socket says 172.21.15.38:38172) 2020-06-12T17:49:51.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.553+0000 7f1475d9b700 1 -- 172.21.15.38:0/134965996 learned_addr learned my addr 172.21.15.38:0/134965996 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:51.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.553+0000 7f1476d9d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f1478146680 0x7f14780b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39990/0 (socket says 172.21.15.38:39990) 2020-06-12T17:49:51.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.553+0000 7f147659c700 1 --2- 172.21.15.38:0/134965996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f147809d620 0x7f14780b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:51.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.553+0000 7f1475d9b700 1 -- 172.21.15.38:0/134965996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f147809d620 msgr2=0x7f14780b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:51.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.553+0000 7f1475d9b700 1 --2- 172.21.15.38:0/134965996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f147809d620 0x7f14780b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:51.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.553+0000 7f1475d9b700 1 -- 172.21.15.38:0/134965996 >> v1:172.21.15.38:6789/0 conn(0x7f1478146680 legacy=0x7f14780b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:51.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.553+0000 7f146f7fe700 1 -- 172.21.15.38:0/134965996 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3007701894 0 0) 0x7f14780618c0 con 0x7f1478146680 2020-06-12T17:49:51.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.553+0000 7f1475d9b700 1 -- 172.21.15.38:0/134965996 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14780b1570 con 0x7f14780b2eb0 2020-06-12T17:49:51.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.553+0000 7f1475d9b700 1 --2- 172.21.15.38:0/134965996 >> v2:172.21.15.38:3300/0 conn(0x7f14780b2eb0 0x7f1478139a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f14680032b0 tx=0x7f14680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.553+0000 7f1475d9b700 1 --2- 172.21.15.38:0/134965996 >> v2:172.21.15.38:3300/0 conn(0x7f14780b2eb0 0x7f1478139a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f14680032b0 tx=0x7f14680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.553+0000 7f1475d9b700 1 --2- 172.21.15.38:0/134965996 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14780b2eb0 0x7f1478139a10 secure :-1 s=READY pgs=564 cs=0 l=1 rx=0x7f14680032b0 tx=0x7f14680081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:51.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.553+0000 7f1475d9b700 1 --2- 172.21.15.38:0/134965996 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14780b2eb0 0x7f1478139a10 secure :-1 s=THROTTLE_DONE pgs=564 cs=0 l=1 rx=0x7f14680032b0 tx=0x7f14680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.553+0000 7f146f7fe700 1 -- 172.21.15.38:0/134965996 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f146800a5c0 con 0x7f14780b2eb0 2020-06-12T17:49:51.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.553+0000 7f1475d9b700 1 --2- 172.21.15.38:0/134965996 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14780b2eb0 0x7f1478139a10 secure :-1 s=THROTTLE_DONE pgs=564 cs=0 l=1 rx=0x7f14680032b0 tx=0x7f14680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.553+0000 7f1475d9b700 1 --2- 172.21.15.38:0/134965996 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14780b2eb0 0x7f1478139a10 secure :-1 s=THROTTLE_DONE pgs=564 cs=0 l=1 rx=0x7f14680032b0 tx=0x7f14680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.553+0000 7f146f7fe700 1 -- 172.21.15.38:0/134965996 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1468005c30 con 0x7f14780b2eb0 2020-06-12T17:49:51.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.553+0000 7f147c881700 1 -- 172.21.15.38:0/134965996 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14780b0620 con 0x7f14780b2eb0 2020-06-12T17:49:51.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.553+0000 7f146f7fe700 1 -- 172.21.15.38:0/134965996 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1468007150 con 0x7f14780b2eb0 2020-06-12T17:49:51.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.553+0000 7f147c881700 1 -- 172.21.15.38:0/134965996 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14780b2310 con 0x7f14780b2eb0 2020-06-12T17:49:51.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.554+0000 7f1475d9b700 1 --2- 172.21.15.38:0/134965996 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14780b2eb0 0x7f1478139a10 secure :-1 s=THROTTLE_DONE pgs=564 cs=0 l=1 rx=0x7f14680032b0 tx=0x7f14680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.554+0000 7f146f7fe700 1 -- 172.21.15.38:0/134965996 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f1468007340 con 0x7f14780b2eb0 2020-06-12T17:49:51.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.554+0000 7f1475d9b700 1 --2- 172.21.15.38:0/134965996 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14780b2eb0 0x7f1478139a10 secure :-1 s=THROTTLE_DONE pgs=564 cs=0 l=1 rx=0x7f14680032b0 tx=0x7f14680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.554+0000 7f147c881700 1 -- 172.21.15.38:0/134965996 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14780b1760 con 0x7f14780b2eb0 2020-06-12T17:49:51.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.555+0000 7f146f7fe700 1 --2- 172.21.15.38:0/134965996 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f145c04d4d0 0x7f145c04f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:51.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.555+0000 7f146f7fe700 1 -- 172.21.15.38:0/134965996 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1468061aa0 con 0x7f14780b2eb0 2020-06-12T17:49:51.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.555+0000 7f147659c700 1 --2- 172.21.15.38:0/134965996 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f145c04d4d0 0x7f145c04f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:51.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.555+0000 7f147659c700 1 --2- 172.21.15.38:0/134965996 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f145c04d4d0 0x7f145c04f990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1460002f30 tx=0x7f1460007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.555+0000 7f147659c700 1 --2- 172.21.15.38:0/134965996 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f145c04d4d0 0x7f145c04f990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1460002f30 tx=0x7f1460007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.555+0000 7f147659c700 1 --2- 172.21.15.38:0/134965996 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f145c04d4d0 0x7f145c04f990 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7f1460002f30 tx=0x7f1460007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:51.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.558+0000 7f1475d9b700 1 --2- 172.21.15.38:0/134965996 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14780b2eb0 0x7f1478139a10 secure :-1 s=THROTTLE_DONE pgs=564 cs=0 l=1 rx=0x7f14680032b0 tx=0x7f14680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.585 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.558+0000 7f146f7fe700 1 -- 172.21.15.38:0/134965996 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f146803d2e0 con 0x7f14780b2eb0 2020-06-12T17:49:51.755 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.752+0000 7f147c881700 1 -- 172.21.15.38:0/134965996 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_8479", "target": ["mon-mgr", ""]}) v1 -- 0x7f1478067b20 con 0x7f145c04d4d0 2020-06-12T17:49:51.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.769+0000 7f147659c700 1 --2- 172.21.15.38:0/134965996 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f145c04d4d0 0x7f145c04f990 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7f1460002f30 tx=0x7f1460007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.769+0000 7f146f7fe700 1 -- 172.21.15.38:0/134965996 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1478067b20 con 0x7f145c04d4d0 2020-06-12T17:49:51.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.770+0000 7f147c881700 1 -- 172.21.15.38:0/134965996 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f145c04d4d0 msgr2=0x7f145c04f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:51.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.770+0000 7f147c881700 1 --2- 172.21.15.38:0/134965996 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f145c04d4d0 0x7f145c04f990 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7f1460002f30 tx=0x7f1460007e60).stop 2020-06-12T17:49:51.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.770+0000 7f147c881700 1 -- 172.21.15.38:0/134965996 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14780b2eb0 msgr2=0x7f1478139a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:51.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.770+0000 7f147c881700 1 --2- 172.21.15.38:0/134965996 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14780b2eb0 0x7f1478139a10 secure :-1 s=READY pgs=564 cs=0 l=1 rx=0x7f14680032b0 tx=0x7f14680081e0).stop 2020-06-12T17:49:51.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.770+0000 7f147c881700 1 -- 172.21.15.38:0/134965996 shutdown_connections 2020-06-12T17:49:51.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.770+0000 7f147c881700 1 --2- 172.21.15.38:0/134965996 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f145c04d4d0 0x7f145c04f990 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:51.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.770+0000 7f147c881700 1 --2- 172.21.15.38:0/134965996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f147809d620 0x7f14780b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:51.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.770+0000 7f147c881700 1 --2- 172.21.15.38:0/134965996 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14780b2eb0 0x7f1478139a10 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:51.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.770+0000 7f147c881700 1 -- 172.21.15.38:0/134965996 >> 172.21.15.38:0/134965996 conn(0x7f14780b5a20 msgr2=0x7f14780b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:51.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.770+0000 7f147c881700 1 -- 172.21.15.38:0/134965996 shutdown_connections 2020-06-12T17:49:51.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.770+0000 7f147c881700 1 -- 172.21.15.38:0/134965996 wait complete. 2020-06-12T17:49:51.784 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_8479 2020-06-12T17:49:51.901 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.897+0000 7f93fa8fe700 1 Processor -- start 2020-06-12T17:49:51.901 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.897+0000 7f93fa8fe700 1 -- start start 2020-06-12T17:49:51.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.898+0000 7f93fa8fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f93f4146680 0x7f93f40ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:51.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.898+0000 7f93fa8fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93f409d8d0 0x7f93f41421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:51.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.898+0000 7f93fa8fe700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f4146d20 con 0x7f93f40b2eb0 2020-06-12T17:49:51.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.898+0000 7f93fa8fe700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f4066a80 con 0x7f93f4146680 2020-06-12T17:49:51.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.898+0000 7f93fa8fe700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f4146f50 con 0x7f93f409d8d0 2020-06-12T17:49:51.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.898+0000 7f93f3fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f93f4146680 0x7f93f40ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:51.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.898+0000 7f93f3fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f93f4146680 0x7f93f40ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38182/0 (socket says 172.21.15.38:38182) 2020-06-12T17:49:51.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.898+0000 7f93f3fff700 1 -- 172.21.15.38:0/2247533803 learned_addr learned my addr 172.21.15.38:0/2247533803 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:51.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.898+0000 7f93f8e9b700 1 --2- 172.21.15.38:0/2247533803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93f409d8d0 0x7f93f41421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:51.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.898+0000 7f93f3fff700 1 -- 172.21.15.38:0/2247533803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93f409d8d0 msgr2=0x7f93f41421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:51.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.898+0000 7f93f3fff700 1 --2- 172.21.15.38:0/2247533803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93f409d8d0 0x7f93f41421d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:51.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.898+0000 7f93f3fff700 1 -- 172.21.15.38:0/2247533803 >> v1:172.21.15.150:6789/0 conn(0x7f93f40b2eb0 legacy=0x7f93f409d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:51.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.898+0000 7f93f3fff700 1 -- 172.21.15.38:0/2247533803 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f4146a60 con 0x7f93f4146680 2020-06-12T17:49:51.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.898+0000 7f93f3fff700 1 --2- 172.21.15.38:0/2247533803 >> v2:172.21.15.38:3300/0 conn(0x7f93f4146680 0x7f93f40ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f93f4061380 tx=0x7f93e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.898+0000 7f93f3fff700 1 --2- 172.21.15.38:0/2247533803 >> v2:172.21.15.38:3300/0 conn(0x7f93f4146680 0x7f93f40ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f93f4061380 tx=0x7f93e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.898+0000 7f93f3fff700 1 --2- 172.21.15.38:0/2247533803 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f4146680 0x7f93f40ad5b0 secure :-1 s=READY pgs=565 cs=0 l=1 rx=0x7f93f4061380 tx=0x7f93e4007e60).ready entity=mon.0 client_cookie=9e48a7caeedfcf95 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:51.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.898+0000 7f93f3fff700 1 --2- 172.21.15.38:0/2247533803 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f4146680 0x7f93f40ad5b0 secure :-1 s=THROTTLE_DONE pgs=565 cs=0 l=1 rx=0x7f93f4061380 tx=0x7f93e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.898+0000 7f93f3fff700 1 --2- 172.21.15.38:0/2247533803 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f4146680 0x7f93f40ad5b0 secure :-1 s=THROTTLE_DONE pgs=565 cs=0 l=1 rx=0x7f93f4061380 tx=0x7f93e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.898+0000 7f93f2ffd700 1 -- 172.21.15.38:0/2247533803 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93e40116a0 con 0x7f93f4146680 2020-06-12T17:49:51.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.898+0000 7f93f3fff700 1 --2- 172.21.15.38:0/2247533803 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f4146680 0x7f93f40ad5b0 secure :-1 s=THROTTLE_DONE pgs=565 cs=0 l=1 rx=0x7f93f4061380 tx=0x7f93e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.899+0000 7f93f2ffd700 1 -- 172.21.15.38:0/2247533803 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e4011800 con 0x7f93f4146680 2020-06-12T17:49:51.909 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.899+0000 7f93f2ffd700 1 -- 172.21.15.38:0/2247533803 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93e4011c20 con 0x7f93f4146680 2020-06-12T17:49:51.909 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.899+0000 7f93fa8fe700 1 -- 172.21.15.38:0/2247533803 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f4146680 msgr2=0x7f93f40ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:51.909 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.899+0000 7f93fa8fe700 1 --2- 172.21.15.38:0/2247533803 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f4146680 0x7f93f40ad5b0 secure :-1 s=READY pgs=565 cs=0 l=1 rx=0x7f93f4061380 tx=0x7f93e4007e60).stop 2020-06-12T17:49:51.909 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.899+0000 7f93fa8fe700 1 -- 172.21.15.38:0/2247533803 shutdown_connections 2020-06-12T17:49:51.909 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.899+0000 7f93fa8fe700 1 --2- 172.21.15.38:0/2247533803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93f409d8d0 0x7f93f41421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:51.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.899+0000 7f93fa8fe700 1 --2- 172.21.15.38:0/2247533803 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f4146680 0x7f93f40ad5b0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:51.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.899+0000 7f93fa8fe700 1 -- 172.21.15.38:0/2247533803 >> 172.21.15.38:0/2247533803 conn(0x7f93f40b5a20 msgr2=0x7f93f405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:51.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.899+0000 7f93fa8fe700 1 -- 172.21.15.38:0/2247533803 shutdown_connections 2020-06-12T17:49:51.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.899+0000 7f93fa8fe700 1 -- 172.21.15.38:0/2247533803 wait complete. 2020-06-12T17:49:51.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.900+0000 7f93fa8fe700 1 Processor -- start 2020-06-12T17:49:51.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.900+0000 7f93fa8fe700 1 -- start start 2020-06-12T17:49:51.913 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.901+0000 7f93fa8fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f93f409d8d0 0x7f93f4065440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:51.914 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.901+0000 7f93fa8fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93f4146680 0x7f93f413ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:51.914 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.901+0000 7f93fa8fe700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f4141aa0 con 0x7f93f40b2eb0 2020-06-12T17:49:51.914 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.901+0000 7f93fa8fe700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f4064bc0 con 0x7f93f409d8d0 2020-06-12T17:49:51.914 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.901+0000 7f93fa8fe700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f4063710 con 0x7f93f4146680 2020-06-12T17:49:51.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.901+0000 7f93f3fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f93f409d8d0 0x7f93f4065440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:51.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.901+0000 7f93f3fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f93f409d8d0 0x7f93f4065440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38184/0 (socket says 172.21.15.38:38184) 2020-06-12T17:49:51.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.901+0000 7f93f3fff700 1 -- 172.21.15.38:0/2299538564 learned_addr learned my addr 172.21.15.38:0/2299538564 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:51.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.901+0000 7f93f3fff700 1 -- 172.21.15.38:0/2299538564 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93f4146680 msgr2=0x7f93f413ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:51.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.901+0000 7f93f3fff700 1 --2- 172.21.15.38:0/2299538564 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93f4146680 0x7f93f413ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.901+0000 7f93f3fff700 1 -- 172.21.15.38:0/2299538564 >> v1:172.21.15.150:6789/0 conn(0x7f93f40b2eb0 legacy=0x7f93f413e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.901+0000 7f93f3fff700 1 -- 172.21.15.38:0/2299538564 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f4141f10 con 0x7f93f409d8d0 2020-06-12T17:49:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.901+0000 7f93f3fff700 1 --2- 172.21.15.38:0/2299538564 >> v2:172.21.15.38:3300/0 conn(0x7f93f409d8d0 0x7f93f4065440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f93f40625e0 tx=0x7f93e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.901+0000 7f93f3fff700 1 --2- 172.21.15.38:0/2299538564 >> v2:172.21.15.38:3300/0 conn(0x7f93f409d8d0 0x7f93f4065440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f93f40625e0 tx=0x7f93e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.901+0000 7f93f3fff700 1 --2- 172.21.15.38:0/2299538564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f409d8d0 0x7f93f4065440 secure :-1 s=READY pgs=566 cs=0 l=1 rx=0x7f93f40625e0 tx=0x7f93e4007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:51.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.901+0000 7f93f3fff700 1 --2- 172.21.15.38:0/2299538564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f409d8d0 0x7f93f4065440 secure :-1 s=THROTTLE_DONE pgs=566 cs=0 l=1 rx=0x7f93f40625e0 tx=0x7f93e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.901+0000 7f93f3fff700 1 --2- 172.21.15.38:0/2299538564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f409d8d0 0x7f93f4065440 secure :-1 s=THROTTLE_DONE pgs=566 cs=0 l=1 rx=0x7f93f40625e0 tx=0x7f93e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.901+0000 7f93f17fa700 1 -- 172.21.15.38:0/2299538564 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93e4007150 con 0x7f93f409d8d0 2020-06-12T17:49:51.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.901+0000 7f93f3fff700 1 --2- 172.21.15.38:0/2299538564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f409d8d0 0x7f93f4065440 secure :-1 s=THROTTLE_DONE pgs=566 cs=0 l=1 rx=0x7f93f40625e0 tx=0x7f93e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.902+0000 7f93f17fa700 1 -- 172.21.15.38:0/2299538564 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e40072b0 con 0x7f93f409d8d0 2020-06-12T17:49:51.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.902+0000 7f93fa8fe700 1 -- 172.21.15.38:0/2299538564 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f40632e0 con 0x7f93f409d8d0 2020-06-12T17:49:51.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.902+0000 7f93f17fa700 1 -- 172.21.15.38:0/2299538564 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93e40056c0 con 0x7f93f409d8d0 2020-06-12T17:49:51.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.902+0000 7f93fa8fe700 1 -- 172.21.15.38:0/2299538564 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f4141780 con 0x7f93f409d8d0 2020-06-12T17:49:51.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.902+0000 7f93f3fff700 1 --2- 172.21.15.38:0/2299538564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f409d8d0 0x7f93f4065440 secure :-1 s=THROTTLE_DONE pgs=566 cs=0 l=1 rx=0x7f93f40625e0 tx=0x7f93e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.903+0000 7f93fa8fe700 1 -- 172.21.15.38:0/2299538564 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f4056c30 con 0x7f93f409d8d0 2020-06-12T17:49:51.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.903+0000 7f93f17fa700 1 -- 172.21.15.38:0/2299538564 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f93e4005930 con 0x7f93f409d8d0 2020-06-12T17:49:51.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.903+0000 7f93f3fff700 1 --2- 172.21.15.38:0/2299538564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f409d8d0 0x7f93f4065440 secure :-1 s=THROTTLE_DONE pgs=566 cs=0 l=1 rx=0x7f93f40625e0 tx=0x7f93e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.903+0000 7f93f17fa700 1 --2- 172.21.15.38:0/2299538564 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f93d404d6b0 0x7f93d404fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:51.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.903+0000 7f93f17fa700 1 -- 172.21.15.38:0/2299538564 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f93e40615c0 con 0x7f93f409d8d0 2020-06-12T17:49:51.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.903+0000 7f93f37fe700 1 --2- 172.21.15.38:0/2299538564 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f93d404d6b0 0x7f93d404fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:51.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.903+0000 7f93f37fe700 1 --2- 172.21.15.38:0/2299538564 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f93d404d6b0 0x7f93d404fb70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f93e8001fe0 tx=0x7f93e80023a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.903+0000 7f93f37fe700 1 --2- 172.21.15.38:0/2299538564 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f93d404d6b0 0x7f93d404fb70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f93e8001fe0 tx=0x7f93e80023a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.903+0000 7f93f37fe700 1 --2- 172.21.15.38:0/2299538564 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f93d404d6b0 0x7f93d404fb70 secure :-1 s=READY pgs=225 cs=0 l=1 rx=0x7f93e8001fe0 tx=0x7f93e80023a0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:51.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.906+0000 7f93f3fff700 1 --2- 172.21.15.38:0/2299538564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f409d8d0 0x7f93f4065440 secure :-1 s=THROTTLE_DONE pgs=566 cs=0 l=1 rx=0x7f93f40625e0 tx=0x7f93e4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:51.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:51.906+0000 7f93f17fa700 1 -- 172.21.15.38:0/2299538564 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f93e403ce00 con 0x7f93f409d8d0 2020-06-12T17:49:52.104 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:52.100+0000 7f93fa8fe700 1 -- 172.21.15.38:0/2299538564 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_8479", "target": ["mon-mgr", ""]}) v1 -- 0x7f93f4056c30 con 0x7f93d404d6b0 2020-06-12T17:49:52.107 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:52.104+0000 7f93f37fe700 1 --2- 172.21.15.38:0/2299538564 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f93d404d6b0 0x7f93d404fb70 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7f93e8001fe0 tx=0x7f93e80023a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:52.107 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:52.104+0000 7f93f17fa700 1 -- 172.21.15.38:0/2299538564 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f93f4056c30 con 0x7f93d404d6b0 2020-06-12T17:49:52.108 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_8479/71c1d8e8-1338-4ba8-bb51-b80fbe474e07 2020-06-12T17:49:52.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:52.105+0000 7f93fa8fe700 1 -- 172.21.15.38:0/2299538564 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f93d404d6b0 msgr2=0x7f93d404fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:52.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:52.105+0000 7f93fa8fe700 1 --2- 172.21.15.38:0/2299538564 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f93d404d6b0 0x7f93d404fb70 secure :-1 s=READY pgs=225 cs=0 l=1 rx=0x7f93e8001fe0 tx=0x7f93e80023a0).stop 2020-06-12T17:49:52.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:52.105+0000 7f93fa8fe700 1 -- 172.21.15.38:0/2299538564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f409d8d0 msgr2=0x7f93f4065440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:52.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:52.105+0000 7f93fa8fe700 1 --2- 172.21.15.38:0/2299538564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f409d8d0 0x7f93f4065440 secure :-1 s=READY pgs=566 cs=0 l=1 rx=0x7f93f40625e0 tx=0x7f93e4007e60).stop 2020-06-12T17:49:52.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:52.105+0000 7f93fa8fe700 1 -- 172.21.15.38:0/2299538564 shutdown_connections 2020-06-12T17:49:52.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:52.105+0000 7f93fa8fe700 1 --2- 172.21.15.38:0/2299538564 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f93d404d6b0 0x7f93d404fb70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:52.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:52.105+0000 7f93fa8fe700 1 --2- 172.21.15.38:0/2299538564 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93f4146680 0x7f93f413ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:52.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:52.105+0000 7f93fa8fe700 1 --2- 172.21.15.38:0/2299538564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f409d8d0 0x7f93f4065440 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:52.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:52.105+0000 7f93fa8fe700 1 -- 172.21.15.38:0/2299538564 >> 172.21.15.38:0/2299538564 conn(0x7f93f40b5a20 msgr2=0x7f93f40b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:52.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:52.105+0000 7f93fa8fe700 1 -- 172.21.15.38:0/2299538564 shutdown_connections 2020-06-12T17:49:52.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:52.105+0000 7f93fa8fe700 1 -- 172.21.15.38:0/2299538564 wait complete. 2020-06-12T17:49:52.118 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_8479 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_8479/71c1d8e8-1338-4ba8-bb51-b80fbe474e07 2020-06-12T17:49:52.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:52.120 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:52.121 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:52.136 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:52.136 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:52.137 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8479/71c1d8e8-1338-4ba8-bb51-b80fbe474e07/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:52.227 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:52.227 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:52.228 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942745 s, 111 MB/s 2020-06-12T17:49:52.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:52.230 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:52.230 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:52.254 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:52.254 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:52.255 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8479/71c1d8e8-1338-4ba8-bb51-b80fbe474e07/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:52.343 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:52.344 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:52.344 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134798 s, 77.8 MB/s 2020-06-12T17:49:52.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:52.345 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:52.346 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:52.361 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:52.362 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:52.362 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8479/71c1d8e8-1338-4ba8-bb51-b80fbe474e07/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:52.449 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:52.450 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:52.450 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110235 s, 95.1 MB/s 2020-06-12T17:49:52.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:52.451 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:52.452 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:52.467 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:52.468 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:52.468 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8479/71c1d8e8-1338-4ba8-bb51-b80fbe474e07/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:52.560 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:52.560 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:52.560 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109306 s, 95.9 MB/s 2020-06-12T17:49:52.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:52.562 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:52.562 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:52.577 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:52.578 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:52.578 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8479/71c1d8e8-1338-4ba8-bb51-b80fbe474e07/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:52.666 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:52.667 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:52.667 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117973 s, 88.9 MB/s 2020-06-12T17:49:52.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:52.669 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:52.669 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:52.684 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:52.685 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:52.685 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8479/71c1d8e8-1338-4ba8-bb51-b80fbe474e07/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:52.771 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:52.772 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:52.772 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106766 s, 98.2 MB/s 2020-06-12T17:49:52.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:52.774 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:52.774 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:52.789 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:52.790 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:52.790 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8479/71c1d8e8-1338-4ba8-bb51-b80fbe474e07/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:52.877 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:52.878 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:52.878 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114093 s, 91.9 MB/s 2020-06-12T17:49:52.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:52.879 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:52.880 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:52.901 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:52.902 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:52.902 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8479/71c1d8e8-1338-4ba8-bb51-b80fbe474e07/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:52.992 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:52.992 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:52.992 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120219 s, 87.2 MB/s 2020-06-12T17:49:52.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:52.994 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:52.994 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:53.011 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:53.011 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:53.012 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8479/71c1d8e8-1338-4ba8-bb51-b80fbe474e07/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:53.100 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:53.100 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:53.100 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115745 s, 90.6 MB/s 2020-06-12T17:49:53.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:53.102 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:53.103 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:53.119 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:53.119 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:53.120 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8479/71c1d8e8-1338-4ba8-bb51-b80fbe474e07/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:53.207 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:53.208 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:53.208 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011142 s, 94.1 MB/s 2020-06-12T17:49:53.209 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_4793 2020-06-12T17:49:53.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.321+0000 7fe1ac2aa700 1 Processor -- start 2020-06-12T17:49:53.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.321+0000 7fe1ac2aa700 1 -- start start 2020-06-12T17:49:53.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.322+0000 7fe1ac2aa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1a409df00 0x7fe1a413c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:53.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.322+0000 7fe1ac2aa700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a409b960 con 0x7fe1a40b3ac0 2020-06-12T17:49:53.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.322+0000 7fe1ac2aa700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a409bc00 con 0x7fe1a4142e90 2020-06-12T17:49:53.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.322+0000 7fe1ac2aa700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a40b48f0 con 0x7fe1a409df00 2020-06-12T17:49:53.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.322+0000 7fe1aa046700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe1a40b3ac0 0x7fe1a413bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40008/0 (socket says 172.21.15.38:40008) 2020-06-12T17:49:53.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.322+0000 7fe1aa046700 1 -- 172.21.15.38:0/3104040475 learned_addr learned my addr 172.21.15.38:0/3104040475 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:53.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.322+0000 7fe1a9044700 1 -- 172.21.15.38:0/3104040475 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930977733 0 0) 0x7fe1a409b960 con 0x7fe1a40b3ac0 2020-06-12T17:49:53.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.322+0000 7fe1a9044700 1 -- 172.21.15.38:0/3104040475 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe18c003230 con 0x7fe1a40b3ac0 2020-06-12T17:49:53.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.322+0000 7fe1a9845700 1 --2- 172.21.15.38:0/3104040475 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1a409df00 0x7fe1a413c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:53.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9044700 1 -- 172.21.15.38:0/3104040475 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2731004009 0 0) 0x7fe18c003230 con 0x7fe1a40b3ac0 2020-06-12T17:49:53.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9044700 1 -- 172.21.15.38:0/3104040475 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1a409df00 msgr2=0x7fe1a413c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:53.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9044700 1 --2- 172.21.15.38:0/3104040475 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1a409df00 0x7fe1a413c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:53.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9044700 1 -- 172.21.15.38:0/3104040475 >> v1:172.21.15.150:6789/0 conn(0x7fe1a4142e90 legacy=0x7fe1a4066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:53.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9044700 1 -- 172.21.15.38:0/3104040475 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a40b3ea0 con 0x7fe1a40b3ac0 2020-06-12T17:49:53.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9044700 1 -- 172.21.15.38:0/3104040475 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fe1940016d0 con 0x7fe1a40b3ac0 2020-06-12T17:49:53.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9044700 1 -- 172.21.15.38:0/3104040475 >> v1:172.21.15.38:6789/0 conn(0x7fe1a40b3ac0 legacy=0x7fe1a413bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:53.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9044700 1 --2- 172.21.15.38:0/3104040475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe18c003750 0x7fe18c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:53.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9044700 1 --2- 172.21.15.38:0/3104040475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe18c004090 0x7fe18c004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:53.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9044700 1 --2- 172.21.15.38:0/3104040475 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1a409df00 0x7fe18c004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:53.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9044700 1 -- 172.21.15.38:0/3104040475 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a40b48f0 con 0x7fe18c004090 2020-06-12T17:49:53.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9044700 1 -- 172.21.15.38:0/3104040475 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c004fb0 con 0x7fe18c003750 2020-06-12T17:49:53.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9044700 1 -- 172.21.15.38:0/3104040475 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c005170 con 0x7fe1a409df00 2020-06-12T17:49:53.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9845700 1 --2- 172.21.15.38:0/3104040475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe18c004090 0x7fe18c004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:53.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1aa046700 1 --2- 172.21.15.38:0/3104040475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe18c003750 0x7fe18c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:53.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1aa847700 1 --2- 172.21.15.38:0/3104040475 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1a409df00 0x7fe18c004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:53.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9845700 1 -- 172.21.15.38:0/3104040475 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1a409df00 msgr2=0x7fe18c004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:53.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9845700 1 --2- 172.21.15.38:0/3104040475 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1a409df00 0x7fe18c004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:53.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9845700 1 -- 172.21.15.38:0/3104040475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe18c003750 msgr2=0x7fe18c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:53.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9845700 1 --2- 172.21.15.38:0/3104040475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe18c003750 0x7fe18c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:53.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9845700 1 -- 172.21.15.38:0/3104040475 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18c003230 con 0x7fe18c004090 2020-06-12T17:49:53.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9845700 1 --2- 172.21.15.38:0/3104040475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe18c004090 0x7fe18c004570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe1a0008910 tx=0x7fe1a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9845700 1 --2- 172.21.15.38:0/3104040475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe18c004090 0x7fe18c004570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe1a0008910 tx=0x7fe1a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9845700 1 --2- 172.21.15.38:0/3104040475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe18c004090 0x7fe18c004570 secure :-1 s=READY pgs=568 cs=0 l=1 rx=0x7fe1a0008910 tx=0x7fe1a0007e60).ready entity=mon.0 client_cookie=e38b356182920e39 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:53.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9845700 1 --2- 172.21.15.38:0/3104040475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe18c004090 0x7fe18c004570 secure :-1 s=THROTTLE_DONE pgs=568 cs=0 l=1 rx=0x7fe1a0008910 tx=0x7fe1a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9845700 1 --2- 172.21.15.38:0/3104040475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe18c004090 0x7fe18c004570 secure :-1 s=THROTTLE_DONE pgs=568 cs=0 l=1 rx=0x7fe1a0008910 tx=0x7fe1a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9044700 1 -- 172.21.15.38:0/3104040475 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1a0008d30 con 0x7fe18c004090 2020-06-12T17:49:53.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9845700 1 --2- 172.21.15.38:0/3104040475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe18c004090 0x7fe18c004570 secure :-1 s=THROTTLE_DONE pgs=568 cs=0 l=1 rx=0x7fe1a0008910 tx=0x7fe1a0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9044700 1 -- 172.21.15.38:0/3104040475 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a0008e90 con 0x7fe18c004090 2020-06-12T17:49:53.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1a9044700 1 -- 172.21.15.38:0/3104040475 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1a0010a20 con 0x7fe18c004090 2020-06-12T17:49:53.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1ac2aa700 1 -- 172.21.15.38:0/3104040475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe18c004090 msgr2=0x7fe18c004570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:53.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1ac2aa700 1 --2- 172.21.15.38:0/3104040475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe18c004090 0x7fe18c004570 secure :-1 s=READY pgs=568 cs=0 l=1 rx=0x7fe1a0008910 tx=0x7fe1a0007e60).stop 2020-06-12T17:49:53.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.323+0000 7fe1aa847700 1 -- 172.21.15.38:0/3104040475 reap_dead start 2020-06-12T17:49:53.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.324+0000 7fe1ac2aa700 1 -- 172.21.15.38:0/3104040475 shutdown_connections 2020-06-12T17:49:53.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.324+0000 7fe1ac2aa700 1 -- 172.21.15.38:0/3104040475 >> 172.21.15.38:0/3104040475 conn(0x7fe1a40b5a20 msgr2=0x7fe1a405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:53.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.324+0000 7fe1ac2aa700 1 -- 172.21.15.38:0/3104040475 shutdown_connections 2020-06-12T17:49:53.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.324+0000 7fe1ac2aa700 1 -- 172.21.15.38:0/3104040475 wait complete. 2020-06-12T17:49:53.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.325+0000 7fe1ac2aa700 1 Processor -- start 2020-06-12T17:49:53.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.325+0000 7fe1ac2aa700 1 -- start start 2020-06-12T17:49:53.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.326+0000 7fe1ac2aa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1a40b6710 0x7fe1a4065920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:53.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.326+0000 7fe1ac2aa700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe1a4154440 0x7fe1a4156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:53.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.326+0000 7fe1ac2aa700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a4145950 con 0x7fe1a4065d80 2020-06-12T17:49:53.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.326+0000 7fe1ac2aa700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a4145740 con 0x7fe1a4154440 2020-06-12T17:49:53.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.326+0000 7fe1ac2aa700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a40b6af0 con 0x7fe1a40b6710 2020-06-12T17:49:53.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.326+0000 7fe1aa847700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe1a4154440 0x7fe1a4156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:53.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.326+0000 7fe1aa847700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe1a4154440 0x7fe1a4156df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38208/0 (socket says 172.21.15.38:38208) 2020-06-12T17:49:53.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.326+0000 7fe1aa847700 1 -- 172.21.15.38:0/3667018032 learned_addr learned my addr 172.21.15.38:0/3667018032 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:53.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.326+0000 7fe1aa046700 1 --2- 172.21.15.38:0/3667018032 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1a40b6710 0x7fe1a4065920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:53.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.326+0000 7fe1aa847700 1 -- 172.21.15.38:0/3667018032 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1a40b6710 msgr2=0x7fe1a4065920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:53.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.326+0000 7fe1aa847700 1 --2- 172.21.15.38:0/3667018032 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1a40b6710 0x7fe1a4065920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:53.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.326+0000 7fe1aa847700 1 -- 172.21.15.38:0/3667018032 >> v1:172.21.15.150:6789/0 conn(0x7fe1a4065d80 legacy=0x7fe1a4153d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:53.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.326+0000 7fe1aa847700 1 -- 172.21.15.38:0/3667018032 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a41537f0 con 0x7fe1a4154440 2020-06-12T17:49:53.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.326+0000 7fe1aa847700 1 --2- 172.21.15.38:0/3667018032 >> v2:172.21.15.38:3300/0 conn(0x7fe1a4154440 0x7fe1a4156df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe1940010d0 tx=0x7fe19c001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.326+0000 7fe1aa847700 1 --2- 172.21.15.38:0/3667018032 >> v2:172.21.15.38:3300/0 conn(0x7fe1a4154440 0x7fe1a4156df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe1940010d0 tx=0x7fe19c001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.326+0000 7fe1aa847700 1 --2- 172.21.15.38:0/3667018032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1a4154440 0x7fe1a4156df0 secure :-1 s=READY pgs=569 cs=0 l=1 rx=0x7fe1940010d0 tx=0x7fe19c001bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:53.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.326+0000 7fe1aa847700 1 --2- 172.21.15.38:0/3667018032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1a4154440 0x7fe1a4156df0 secure :-1 s=THROTTLE_DONE pgs=569 cs=0 l=1 rx=0x7fe1940010d0 tx=0x7fe19c001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.326+0000 7fe1aa847700 1 --2- 172.21.15.38:0/3667018032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1a4154440 0x7fe1a4156df0 secure :-1 s=THROTTLE_DONE pgs=569 cs=0 l=1 rx=0x7fe1940010d0 tx=0x7fe19c001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.326+0000 7fe1937fe700 1 -- 172.21.15.38:0/3667018032 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe19c0125d0 con 0x7fe1a4154440 2020-06-12T17:49:53.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.326+0000 7fe1aa847700 1 --2- 172.21.15.38:0/3667018032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1a4154440 0x7fe1a4156df0 secure :-1 s=THROTTLE_DONE pgs=569 cs=0 l=1 rx=0x7fe1940010d0 tx=0x7fe19c001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.326+0000 7fe1937fe700 1 -- 172.21.15.38:0/3667018032 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19c012730 con 0x7fe1a4154440 2020-06-12T17:49:53.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.326+0000 7fe1937fe700 1 -- 172.21.15.38:0/3667018032 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe19c012a90 con 0x7fe1a4154440 2020-06-12T17:49:53.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.326+0000 7fe1ac2aa700 1 -- 172.21.15.38:0/3667018032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a4143580 con 0x7fe1a4154440 2020-06-12T17:49:53.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.326+0000 7fe1ac2aa700 1 -- 172.21.15.38:0/3667018032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a4145440 con 0x7fe1a4154440 2020-06-12T17:49:53.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.327+0000 7fe1aa847700 1 --2- 172.21.15.38:0/3667018032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1a4154440 0x7fe1a4156df0 secure :-1 s=THROTTLE_DONE pgs=569 cs=0 l=1 rx=0x7fe1940010d0 tx=0x7fe19c001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.328+0000 7fe1937fe700 1 -- 172.21.15.38:0/3667018032 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fe19c012bf0 con 0x7fe1a4154440 2020-06-12T17:49:53.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.328+0000 7fe1aa847700 1 --2- 172.21.15.38:0/3667018032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1a4154440 0x7fe1a4156df0 secure :-1 s=THROTTLE_DONE pgs=569 cs=0 l=1 rx=0x7fe1940010d0 tx=0x7fe19c001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.328+0000 7fe1ac2aa700 1 -- 172.21.15.38:0/3667018032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a4153a40 con 0x7fe1a4154440 2020-06-12T17:49:53.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.328+0000 7fe1937fe700 1 --2- 172.21.15.38:0/3667018032 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe18404d660 0x7fe18404fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:53.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.328+0000 7fe1937fe700 1 -- 172.21.15.38:0/3667018032 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe19c060b60 con 0x7fe1a4154440 2020-06-12T17:49:53.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.328+0000 7fe1aa046700 1 --2- 172.21.15.38:0/3667018032 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe18404d660 0x7fe18404fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:53.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.328+0000 7fe1aa046700 1 --2- 172.21.15.38:0/3667018032 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe18404d660 0x7fe18404fb20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe1940013e0 tx=0x7fe1a40ae460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.328+0000 7fe1aa046700 1 --2- 172.21.15.38:0/3667018032 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe18404d660 0x7fe18404fb20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe1940013e0 tx=0x7fe1a40ae460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.328+0000 7fe1aa046700 1 --2- 172.21.15.38:0/3667018032 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe18404d660 0x7fe18404fb20 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7fe1940013e0 tx=0x7fe1a40ae460).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:53.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.331+0000 7fe1aa847700 1 --2- 172.21.15.38:0/3667018032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1a4154440 0x7fe1a4156df0 secure :-1 s=THROTTLE_DONE pgs=569 cs=0 l=1 rx=0x7fe1940010d0 tx=0x7fe19c001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.331+0000 7fe1937fe700 1 -- 172.21.15.38:0/3667018032 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fe19c03c340 con 0x7fe1a4154440 2020-06-12T17:49:53.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.529+0000 7fe1ac2aa700 1 -- 172.21.15.38:0/3667018032 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_4793", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1a4056c30 con 0x7fe18404d660 2020-06-12T17:49:53.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.547+0000 7fe1aa046700 1 --2- 172.21.15.38:0/3667018032 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe18404d660 0x7fe18404fb20 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fe1940013e0 tx=0x7fe1a40ae460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.547+0000 7fe1937fe700 1 -- 172.21.15.38:0/3667018032 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe1a4056c30 con 0x7fe18404d660 2020-06-12T17:49:53.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.548+0000 7fe1ac2aa700 1 -- 172.21.15.38:0/3667018032 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe18404d660 msgr2=0x7fe18404fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:53.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.548+0000 7fe1ac2aa700 1 --2- 172.21.15.38:0/3667018032 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe18404d660 0x7fe18404fb20 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7fe1940013e0 tx=0x7fe1a40ae460).stop 2020-06-12T17:49:53.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.548+0000 7fe1ac2aa700 1 -- 172.21.15.38:0/3667018032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1a4154440 msgr2=0x7fe1a4156df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:53.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.548+0000 7fe1ac2aa700 1 --2- 172.21.15.38:0/3667018032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1a4154440 0x7fe1a4156df0 secure :-1 s=READY pgs=569 cs=0 l=1 rx=0x7fe1940010d0 tx=0x7fe19c001bc0).stop 2020-06-12T17:49:53.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.549+0000 7fe1ac2aa700 1 -- 172.21.15.38:0/3667018032 shutdown_connections 2020-06-12T17:49:53.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.549+0000 7fe1ac2aa700 1 --2- 172.21.15.38:0/3667018032 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe18404d660 0x7fe18404fb20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:53.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.549+0000 7fe1ac2aa700 1 --2- 172.21.15.38:0/3667018032 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1a40b6710 0x7fe1a4065920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:53.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.549+0000 7fe1ac2aa700 1 --2- 172.21.15.38:0/3667018032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1a4154440 0x7fe1a4156df0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:53.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.549+0000 7fe1ac2aa700 1 -- 172.21.15.38:0/3667018032 >> 172.21.15.38:0/3667018032 conn(0x7fe1a40b5a20 msgr2=0x7fe1a413c170 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:53.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.549+0000 7fe1ac2aa700 1 -- 172.21.15.38:0/3667018032 shutdown_connections 2020-06-12T17:49:53.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.549+0000 7fe1ac2aa700 1 -- 172.21.15.38:0/3667018032 wait complete. 2020-06-12T17:49:53.563 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_4793 2020-06-12T17:49:53.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.676+0000 7f7a532ec700 1 Processor -- start 2020-06-12T17:49:53.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.676+0000 7f7a532ec700 1 -- start start 2020-06-12T17:49:53.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.677+0000 7f7a532ec700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7a4c0b3ac0 0x7f7a4c09df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:53.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.677+0000 7f7a532ec700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7a4c13c650 0x7f7a4c066790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:53.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.677+0000 7f7a532ec700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4c09b960 con 0x7f7a4c142e90 2020-06-12T17:49:53.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.677+0000 7f7a532ec700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4c09bc00 con 0x7f7a4c0b3ac0 2020-06-12T17:49:53.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.677+0000 7f7a532ec700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4c0b48f0 con 0x7f7a4c13c650 2020-06-12T17:49:53.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.677+0000 7f7a51088700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7a4c0b3ac0 0x7f7a4c09df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:53.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.677+0000 7f7a50887700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7a4c142e90 0x7f7a4c13bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40030/0 (socket says 172.21.15.38:40030) 2020-06-12T17:49:53.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.677+0000 7f7a51088700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7a4c0b3ac0 0x7f7a4c09df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38212/0 (socket says 172.21.15.38:38212) 2020-06-12T17:49:53.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.677+0000 7f7a50887700 1 -- 172.21.15.38:0/1711097075 learned_addr learned my addr 172.21.15.38:0/1711097075 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:53.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.677+0000 7f7a51889700 1 --2- 172.21.15.38:0/1711097075 >> v2:172.21.15.150:3300/0 conn(0x7f7a4c13c650 0x7f7a4c066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:53.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.677+0000 7f7a51088700 1 -- 172.21.15.38:0/1711097075 >> v2:172.21.15.150:3300/0 conn(0x7f7a4c13c650 msgr2=0x7f7a4c066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:53.686 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.677+0000 7f7a51088700 1 --2- 172.21.15.38:0/1711097075 >> v2:172.21.15.150:3300/0 conn(0x7f7a4c13c650 0x7f7a4c066790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:53.686 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.677+0000 7f7a51088700 1 -- 172.21.15.38:0/1711097075 >> v1:172.21.15.38:6789/0 conn(0x7f7a4c142e90 legacy=0x7f7a4c13bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:53.686 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.677+0000 7f7a3bfff700 1 -- 172.21.15.38:0/1711097075 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556113104 0 0) 0x7f7a4c09b960 con 0x7f7a4c142e90 2020-06-12T17:49:53.686 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.677+0000 7f7a51088700 1 -- 172.21.15.38:0/1711097075 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c0b3ea0 con 0x7f7a4c0b3ac0 2020-06-12T17:49:53.687 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.677+0000 7f7a51088700 1 --2- 172.21.15.38:0/1711097075 >> v2:172.21.15.38:3300/0 conn(0x7f7a4c0b3ac0 0x7f7a4c09df00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7a3c002f30 tx=0x7f7a3c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.687 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.677+0000 7f7a51088700 1 --2- 172.21.15.38:0/1711097075 >> v2:172.21.15.38:3300/0 conn(0x7f7a4c0b3ac0 0x7f7a4c09df00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7a3c002f30 tx=0x7f7a3c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.687 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.678+0000 7f7a51088700 1 --2- 172.21.15.38:0/1711097075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a4c0b3ac0 0x7f7a4c09df00 secure :-1 s=READY pgs=571 cs=0 l=1 rx=0x7f7a3c002f30 tx=0x7f7a3c007e60).ready entity=mon.0 client_cookie=7500d9c741b1ca6e server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:53.687 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.678+0000 7f7a51088700 1 --2- 172.21.15.38:0/1711097075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a4c0b3ac0 0x7f7a4c09df00 secure :-1 s=THROTTLE_DONE pgs=571 cs=0 l=1 rx=0x7f7a3c002f30 tx=0x7f7a3c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.687 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.678+0000 7f7a3bfff700 1 -- 172.21.15.38:0/1711097075 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a3c012540 con 0x7f7a4c0b3ac0 2020-06-12T17:49:53.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.678+0000 7f7a51088700 1 --2- 172.21.15.38:0/1711097075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a4c0b3ac0 0x7f7a4c09df00 secure :-1 s=THROTTLE_DONE pgs=571 cs=0 l=1 rx=0x7f7a3c002f30 tx=0x7f7a3c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.678+0000 7f7a3bfff700 1 -- 172.21.15.38:0/1711097075 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3c0126a0 con 0x7f7a4c0b3ac0 2020-06-12T17:49:53.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.678+0000 7f7a51088700 1 --2- 172.21.15.38:0/1711097075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a4c0b3ac0 0x7f7a4c09df00 secure :-1 s=THROTTLE_DONE pgs=571 cs=0 l=1 rx=0x7f7a3c002f30 tx=0x7f7a3c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.678+0000 7f7a3bfff700 1 -- 172.21.15.38:0/1711097075 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a3c012a40 con 0x7f7a4c0b3ac0 2020-06-12T17:49:53.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.678+0000 7f7a532ec700 1 -- 172.21.15.38:0/1711097075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a4c0b3ac0 msgr2=0x7f7a4c09df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:53.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.678+0000 7f7a532ec700 1 --2- 172.21.15.38:0/1711097075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a4c0b3ac0 0x7f7a4c09df00 secure :-1 s=READY pgs=571 cs=0 l=1 rx=0x7f7a3c002f30 tx=0x7f7a3c007e60).stop 2020-06-12T17:49:53.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.678+0000 7f7a532ec700 1 -- 172.21.15.38:0/1711097075 shutdown_connections 2020-06-12T17:49:53.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.678+0000 7f7a532ec700 1 --2- 172.21.15.38:0/1711097075 >> v2:172.21.15.150:3300/0 conn(0x7f7a4c13c650 0x7f7a4c066790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:53.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.678+0000 7f7a532ec700 1 --2- 172.21.15.38:0/1711097075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a4c0b3ac0 0x7f7a4c09df00 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:53.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.678+0000 7f7a532ec700 1 -- 172.21.15.38:0/1711097075 >> 172.21.15.38:0/1711097075 conn(0x7f7a4c0b5a20 msgr2=0x7f7a4c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:53.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.678+0000 7f7a532ec700 1 -- 172.21.15.38:0/1711097075 shutdown_connections 2020-06-12T17:49:53.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.678+0000 7f7a532ec700 1 -- 172.21.15.38:0/1711097075 wait complete. 2020-06-12T17:49:53.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.679+0000 7f7a532ec700 1 Processor -- start 2020-06-12T17:49:53.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.679+0000 7f7a532ec700 1 -- start start 2020-06-12T17:49:53.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.680+0000 7f7a532ec700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a4c13c650 0x7f7a4c0b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:53.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.680+0000 7f7a532ec700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4c14f4b0 con 0x7f7a4c142e90 2020-06-12T17:49:53.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.680+0000 7f7a532ec700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4c0b1730 con 0x7f7a4c0b3ac0 2020-06-12T17:49:53.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.680+0000 7f7a532ec700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c0afb70 con 0x7f7a4c13c650 2020-06-12T17:49:53.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.680+0000 7f7a51889700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7a4c142e90 0x7f7a4c0b22d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40038/0 (socket says 172.21.15.38:40038) 2020-06-12T17:49:53.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.680+0000 7f7a51889700 1 -- 172.21.15.38:0/3277615928 learned_addr learned my addr 172.21.15.38:0/3277615928 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:53.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.680+0000 7f7a50887700 1 --2- 172.21.15.38:0/3277615928 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a4c13c650 0x7f7a4c0b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:53.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.680+0000 7f7a3a7fc700 1 -- 172.21.15.38:0/3277615928 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073870231 0 0) 0x7f7a4c14f4b0 con 0x7f7a4c142e90 2020-06-12T17:49:53.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.680+0000 7f7a3a7fc700 1 -- 172.21.15.38:0/3277615928 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a2c002fe0 con 0x7f7a4c142e90 2020-06-12T17:49:53.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.680+0000 7f7a3a7fc700 1 -- 172.21.15.38:0/3277615928 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964301408 0 0) 0x7f7a4c0b1730 con 0x7f7a4c0b3ac0 2020-06-12T17:49:53.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.680+0000 7f7a3a7fc700 1 -- 172.21.15.38:0/3277615928 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a4c14f4b0 con 0x7f7a4c0b3ac0 2020-06-12T17:49:53.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.681+0000 7f7a50887700 1 -- 172.21.15.38:0/3277615928 >> v1:172.21.15.150:6789/0 conn(0x7f7a4c0b3ac0 legacy=0x7f7a4c0af460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:53.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.681+0000 7f7a3a7fc700 1 -- 172.21.15.38:0/3277615928 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4081890352 0 0) 0x7f7a2c002fe0 con 0x7f7a4c142e90 2020-06-12T17:49:53.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.681+0000 7f7a50887700 1 -- 172.21.15.38:0/3277615928 >> v1:172.21.15.38:6789/0 conn(0x7f7a4c142e90 legacy=0x7f7a4c0b22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:53.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.681+0000 7f7a50887700 1 -- 172.21.15.38:0/3277615928 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c0b19d0 con 0x7f7a4c13c650 2020-06-12T17:49:53.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.681+0000 7f7a50887700 1 --2- 172.21.15.38:0/3277615928 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a4c13c650 0x7f7a4c0b1e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7a44002240 tx=0x7f7a480016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.681+0000 7f7a50887700 1 --2- 172.21.15.38:0/3277615928 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a4c13c650 0x7f7a4c0b1e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7a44002240 tx=0x7f7a480016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.681+0000 7f7a50887700 1 --2- 172.21.15.38:0/3277615928 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a4c13c650 0x7f7a4c0b1e70 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7f7a44002240 tx=0x7f7a480016e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:53.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.681+0000 7f7a50887700 1 --2- 172.21.15.38:0/3277615928 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a4c13c650 0x7f7a4c0b1e70 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f7a44002240 tx=0x7f7a480016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.681+0000 7f7a3a7fc700 1 -- 172.21.15.38:0/3277615928 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a44002940 con 0x7f7a4c13c650 2020-06-12T17:49:53.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.681+0000 7f7a50887700 1 --2- 172.21.15.38:0/3277615928 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a4c13c650 0x7f7a4c0b1e70 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f7a44002240 tx=0x7f7a480016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.681+0000 7f7a3a7fc700 1 -- 172.21.15.38:0/3277615928 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a48005ab0 con 0x7f7a4c13c650 2020-06-12T17:49:53.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.681+0000 7f7a532ec700 1 -- 172.21.15.38:0/3277615928 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a4c14f090 con 0x7f7a4c13c650 2020-06-12T17:49:53.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.681+0000 7f7a50887700 1 --2- 172.21.15.38:0/3277615928 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a4c13c650 0x7f7a4c0b1e70 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f7a44002240 tx=0x7f7a480016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.681+0000 7f7a3a7fc700 1 -- 172.21.15.38:0/3277615928 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a48005e10 con 0x7f7a4c13c650 2020-06-12T17:49:53.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.681+0000 7f7a532ec700 1 -- 172.21.15.38:0/3277615928 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a4c150050 con 0x7f7a4c13c650 2020-06-12T17:49:53.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.682+0000 7f7a50887700 1 --2- 172.21.15.38:0/3277615928 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a4c13c650 0x7f7a4c0b1e70 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f7a44002240 tx=0x7f7a480016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.682+0000 7f7a532ec700 1 -- 172.21.15.38:0/3277615928 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4c0b1570 con 0x7f7a4c13c650 2020-06-12T17:49:53.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.682+0000 7f7a3a7fc700 1 -- 172.21.15.38:0/3277615928 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f7a4800a320 con 0x7f7a4c13c650 2020-06-12T17:49:53.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.682+0000 7f7a50887700 1 --2- 172.21.15.38:0/3277615928 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a4c13c650 0x7f7a4c0b1e70 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f7a44002240 tx=0x7f7a480016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.682+0000 7f7a3a7fc700 1 --2- 172.21.15.38:0/3277615928 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7a2c04fbc0 0x7f7a2c052080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:53.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.682+0000 7f7a3a7fc700 1 -- 172.21.15.38:0/3277615928 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7a48060a20 con 0x7f7a4c13c650 2020-06-12T17:49:53.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.683+0000 7f7a51088700 1 --2- 172.21.15.38:0/3277615928 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7a2c04fbc0 0x7f7a2c052080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:53.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.683+0000 7f7a51088700 1 --2- 172.21.15.38:0/3277615928 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7a2c04fbc0 0x7f7a2c052080 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7a3c007ed0 tx=0x7f7a3c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.683+0000 7f7a51088700 1 --2- 172.21.15.38:0/3277615928 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7a2c04fbc0 0x7f7a2c052080 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7a3c007ed0 tx=0x7f7a3c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.683+0000 7f7a51088700 1 --2- 172.21.15.38:0/3277615928 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7a2c04fbc0 0x7f7a2c052080 secure :-1 s=READY pgs=227 cs=0 l=1 rx=0x7f7a3c007ed0 tx=0x7f7a3c007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:53.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.686+0000 7f7a50887700 1 --2- 172.21.15.38:0/3277615928 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a4c13c650 0x7f7a4c0b1e70 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f7a44002240 tx=0x7f7a480016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.686+0000 7f7a3a7fc700 1 -- 172.21.15.38:0/3277615928 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f7a4803c120 con 0x7f7a4c13c650 2020-06-12T17:49:53.883 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.879+0000 7f7a532ec700 1 -- 172.21.15.38:0/3277615928 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_4793", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a4c09e360 con 0x7f7a2c04fbc0 2020-06-12T17:49:53.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.884+0000 7f7a51088700 1 --2- 172.21.15.38:0/3277615928 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7a2c04fbc0 0x7f7a2c052080 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f7a3c007ed0 tx=0x7f7a3c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:53.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.884+0000 7f7a3a7fc700 1 -- 172.21.15.38:0/3277615928 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f7a4c09e360 con 0x7f7a2c04fbc0 2020-06-12T17:49:53.888 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_4793/19161504-3d57-4ac0-84c6-79f23aa180a4 2020-06-12T17:49:53.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.884+0000 7f7a532ec700 1 -- 172.21.15.38:0/3277615928 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7a2c04fbc0 msgr2=0x7f7a2c052080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:53.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.884+0000 7f7a532ec700 1 --2- 172.21.15.38:0/3277615928 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7a2c04fbc0 0x7f7a2c052080 secure :-1 s=READY pgs=227 cs=0 l=1 rx=0x7f7a3c007ed0 tx=0x7f7a3c007e60).stop 2020-06-12T17:49:53.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.884+0000 7f7a532ec700 1 -- 172.21.15.38:0/3277615928 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a4c13c650 msgr2=0x7f7a4c0b1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:53.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.884+0000 7f7a532ec700 1 --2- 172.21.15.38:0/3277615928 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a4c13c650 0x7f7a4c0b1e70 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7f7a44002240 tx=0x7f7a480016e0).stop 2020-06-12T17:49:53.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.884+0000 7f7a532ec700 1 -- 172.21.15.38:0/3277615928 shutdown_connections 2020-06-12T17:49:53.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.884+0000 7f7a532ec700 1 --2- 172.21.15.38:0/3277615928 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7a2c04fbc0 0x7f7a2c052080 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:53.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.884+0000 7f7a532ec700 1 --2- 172.21.15.38:0/3277615928 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a4c13c650 0x7f7a4c0b1e70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:53.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.884+0000 7f7a532ec700 1 -- 172.21.15.38:0/3277615928 >> 172.21.15.38:0/3277615928 conn(0x7f7a4c0b5a20 msgr2=0x7f7a4c0666d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:53.891 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.884+0000 7f7a532ec700 1 -- 172.21.15.38:0/3277615928 shutdown_connections 2020-06-12T17:49:53.892 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:53.884+0000 7f7a532ec700 1 -- 172.21.15.38:0/3277615928 wait complete. 2020-06-12T17:49:53.899 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_4793 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_4793/19161504-3d57-4ac0-84c6-79f23aa180a4 2020-06-12T17:49:53.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:53.900 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:53.900 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:53.915 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:53.916 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:53.917 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4793/19161504-3d57-4ac0-84c6-79f23aa180a4/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:54.009 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:54.009 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:54.010 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122096 s, 85.9 MB/s 2020-06-12T17:49:54.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:54.011 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:54.012 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:54.026 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:54.027 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:54.028 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4793/19161504-3d57-4ac0-84c6-79f23aa180a4/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:54.122 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:54.123 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:54.123 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122169 s, 85.8 MB/s 2020-06-12T17:49:54.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:54.125 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:54.125 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:54.140 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:54.141 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:54.141 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4793/19161504-3d57-4ac0-84c6-79f23aa180a4/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:54.228 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:54.229 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:54.229 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112799 s, 93.0 MB/s 2020-06-12T17:49:54.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:54.231 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:54.231 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:54.246 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:54.246 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:54.247 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4793/19161504-3d57-4ac0-84c6-79f23aa180a4/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:54.336 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:54.336 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:54.336 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121659 s, 86.2 MB/s 2020-06-12T17:49:54.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:54.338 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:54.338 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:54.355 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:54.356 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:54.357 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4793/19161504-3d57-4ac0-84c6-79f23aa180a4/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:54.450 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:54.450 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:54.451 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012538 s, 83.6 MB/s 2020-06-12T17:49:54.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:54.454 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:54.454 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:54.469 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:54.469 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:54.470 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4793/19161504-3d57-4ac0-84c6-79f23aa180a4/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:54.559 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:54.560 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:54.560 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103292 s, 102 MB/s 2020-06-12T17:49:54.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:54.561 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:54.561 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:54.576 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:54.577 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:54.577 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4793/19161504-3d57-4ac0-84c6-79f23aa180a4/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:54.663 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:54.663 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:54.663 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105859 s, 99.1 MB/s 2020-06-12T17:49:54.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:54.665 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:54.665 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:54.680 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:54.681 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:54.682 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4793/19161504-3d57-4ac0-84c6-79f23aa180a4/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:54.767 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:54.768 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:54.768 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010461 s, 100 MB/s 2020-06-12T17:49:54.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:54.770 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:54.771 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:54.787 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:54.787 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:54.788 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4793/19161504-3d57-4ac0-84c6-79f23aa180a4/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:54.875 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:54.875 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:54.876 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113836 s, 92.1 MB/s 2020-06-12T17:49:54.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:54.877 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:54.878 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:54.893 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:54.893 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:54.894 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4793/19161504-3d57-4ac0-84c6-79f23aa180a4/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:54.982 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:54.983 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:54.983 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109563 s, 95.7 MB/s 2020-06-12T17:49:54.984 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_2930 2020-06-12T17:49:55.102 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.098+0000 7f3474eb8700 1 Processor -- start 2020-06-12T17:49:55.102 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.098+0000 7f3474eb8700 1 -- start start 2020-06-12T17:49:55.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.098+0000 7f3474eb8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f347009d0b0 0x7f347013c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:55.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.098+0000 7f3474eb8700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f347009b960 con 0x7f34700b3ac0 2020-06-12T17:49:55.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.098+0000 7f3474eb8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f347009bc00 con 0x7f347009df00 2020-06-12T17:49:55.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.099+0000 7f3474eb8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34700b48f0 con 0x7f347009d0b0 2020-06-12T17:49:55.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.099+0000 7f346e59c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f34700b3ac0 0x7f347013bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40042/0 (socket says 172.21.15.38:40042) 2020-06-12T17:49:55.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.099+0000 7f346e59c700 1 -- 172.21.15.38:0/793803269 learned_addr learned my addr 172.21.15.38:0/793803269 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:55.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.099+0000 7f346d59a700 1 -- 172.21.15.38:0/793803269 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 885858395 0 0) 0x7f347009b960 con 0x7f34700b3ac0 2020-06-12T17:49:55.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.099+0000 7f346d59a700 1 -- 172.21.15.38:0/793803269 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3450003230 con 0x7f34700b3ac0 2020-06-12T17:49:55.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.099+0000 7f346ed9d700 1 --2- 172.21.15.38:0/793803269 >> v2:172.21.15.150:3300/0 conn(0x7f347009d0b0 0x7f347013c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:55.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.099+0000 7f346d59a700 1 -- 172.21.15.38:0/793803269 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 907457694 0 0) 0x7f3450003230 con 0x7f34700b3ac0 2020-06-12T17:49:55.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.099+0000 7f346d59a700 1 -- 172.21.15.38:0/793803269 >> v2:172.21.15.150:3300/0 conn(0x7f347009d0b0 msgr2=0x7f347013c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:55.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.099+0000 7f346d59a700 1 --2- 172.21.15.38:0/793803269 >> v2:172.21.15.150:3300/0 conn(0x7f347009d0b0 0x7f347013c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:55.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.099+0000 7f346d59a700 1 -- 172.21.15.38:0/793803269 >> v1:172.21.15.150:6789/0 conn(0x7f347009df00 legacy=0x7f3470066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:55.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.099+0000 7f346d59a700 1 -- 172.21.15.38:0/793803269 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34700b3ea0 con 0x7f34700b3ac0 2020-06-12T17:49:55.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.099+0000 7f346d59a700 1 -- 172.21.15.38:0/793803269 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f34580016d0 con 0x7f34700b3ac0 2020-06-12T17:49:55.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.099+0000 7f346d59a700 1 -- 172.21.15.38:0/793803269 >> v1:172.21.15.38:6789/0 conn(0x7f34700b3ac0 legacy=0x7f347013bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:55.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.099+0000 7f346d59a700 1 --2- 172.21.15.38:0/793803269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3450003720 0x7f3450003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:55.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.099+0000 7f346d59a700 1 --2- 172.21.15.38:0/793803269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34500044d0 0x7f3450004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:55.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.099+0000 7f346d59a700 1 --2- 172.21.15.38:0/793803269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3450004db0 0x7f345000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:55.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.099+0000 7f346d59a700 1 -- 172.21.15.38:0/793803269 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34700b48f0 con 0x7f34500044d0 2020-06-12T17:49:55.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.099+0000 7f346d59a700 1 -- 172.21.15.38:0/793803269 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34500041c0 con 0x7f3450004db0 2020-06-12T17:49:55.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.099+0000 7f346d59a700 1 -- 172.21.15.38:0/793803269 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345000bb80 con 0x7f3450003720 2020-06-12T17:49:55.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.099+0000 7f346dd9b700 1 --2- 172.21.15.38:0/793803269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34500044d0 0x7f3450004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:55.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.099+0000 7f346e59c700 1 --2- 172.21.15.38:0/793803269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3450003720 0x7f3450003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:55.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.099+0000 7f346ed9d700 1 --2- 172.21.15.38:0/793803269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3450004db0 0x7f345000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:55.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.100+0000 7f346dd9b700 1 -- 172.21.15.38:0/793803269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3450003720 msgr2=0x7f3450003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:55.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.100+0000 7f346dd9b700 1 --2- 172.21.15.38:0/793803269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3450003720 0x7f3450003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:55.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.100+0000 7f346dd9b700 1 -- 172.21.15.38:0/793803269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3450004db0 msgr2=0x7f345000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:55.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.100+0000 7f346dd9b700 1 --2- 172.21.15.38:0/793803269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3450004db0 0x7f345000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:55.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.100+0000 7f346ed9d700 1 -- 172.21.15.38:0/793803269 reap_dead start 2020-06-12T17:49:55.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.100+0000 7f346dd9b700 1 -- 172.21.15.38:0/793803269 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3450003230 con 0x7f34500044d0 2020-06-12T17:49:55.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.100+0000 7f346e59c700 1 --2- 172.21.15.38:0/793803269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3450003720 0x7f3450003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:49:55.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.100+0000 7f346dd9b700 1 --2- 172.21.15.38:0/793803269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34500044d0 0x7f3450004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f34700ae340 tx=0x7f3460001c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.100+0000 7f346dd9b700 1 --2- 172.21.15.38:0/793803269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34500044d0 0x7f3450004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f34700ae340 tx=0x7f3460001c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.100+0000 7f346dd9b700 1 --2- 172.21.15.38:0/793803269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34500044d0 0x7f3450004950 secure :-1 s=READY pgs=574 cs=0 l=1 rx=0x7f34700ae340 tx=0x7f3460001c50).ready entity=mon.0 client_cookie=ebd21b642ec3daef server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:55.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.100+0000 7f346dd9b700 1 --2- 172.21.15.38:0/793803269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34500044d0 0x7f3450004950 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7f34700ae340 tx=0x7f3460001c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.100+0000 7f346dd9b700 1 --2- 172.21.15.38:0/793803269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34500044d0 0x7f3450004950 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7f34700ae340 tx=0x7f3460001c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.100+0000 7f346d59a700 1 -- 172.21.15.38:0/793803269 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3460006c40 con 0x7f34500044d0 2020-06-12T17:49:55.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.100+0000 7f346dd9b700 1 --2- 172.21.15.38:0/793803269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34500044d0 0x7f3450004950 secure :-1 s=THROTTLE_DONE pgs=574 cs=0 l=1 rx=0x7f34700ae340 tx=0x7f3460001c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.100+0000 7f346d59a700 1 -- 172.21.15.38:0/793803269 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3460006da0 con 0x7f34500044d0 2020-06-12T17:49:55.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.100+0000 7f346d59a700 1 -- 172.21.15.38:0/793803269 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3460002730 con 0x7f34500044d0 2020-06-12T17:49:55.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.100+0000 7f3474eb8700 1 -- 172.21.15.38:0/793803269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34500044d0 msgr2=0x7f3450004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:55.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.100+0000 7f3474eb8700 1 --2- 172.21.15.38:0/793803269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34500044d0 0x7f3450004950 secure :-1 s=READY pgs=574 cs=0 l=1 rx=0x7f34700ae340 tx=0x7f3460001c50).stop 2020-06-12T17:49:55.118 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.100+0000 7f3474eb8700 1 -- 172.21.15.38:0/793803269 shutdown_connections 2020-06-12T17:49:55.118 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.100+0000 7f3474eb8700 1 --2- 172.21.15.38:0/793803269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34500044d0 0x7f3450004950 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:55.118 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.100+0000 7f3474eb8700 1 -- 172.21.15.38:0/793803269 >> 172.21.15.38:0/793803269 conn(0x7f34700b5a20 msgr2=0x7f347005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:55.118 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.101+0000 7f3474eb8700 1 -- 172.21.15.38:0/793803269 shutdown_connections 2020-06-12T17:49:55.118 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.101+0000 7f3474eb8700 1 -- 172.21.15.38:0/793803269 wait complete. 2020-06-12T17:49:55.119 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.101+0000 7f3474eb8700 1 Processor -- start 2020-06-12T17:49:55.119 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.102+0000 7f3474eb8700 1 -- start start 2020-06-12T17:49:55.119 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.102+0000 7f3474eb8700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f34500044d0 0x7f34700b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:55.119 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.102+0000 7f3474eb8700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3470146120 con 0x7f3470145cc0 2020-06-12T17:49:55.119 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.102+0000 7f3474eb8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3470065990 con 0x7f347008ef70 2020-06-12T17:49:55.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.102+0000 7f3474eb8700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3470154270 con 0x7f34500044d0 2020-06-12T17:49:55.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.102+0000 7f346dd9b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f3470145cc0 0x7f34700660d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40056/0 (socket says 172.21.15.38:40056) 2020-06-12T17:49:55.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.102+0000 7f346e59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f34500044d0 0x7f34700b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:55.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.102+0000 7f346dd9b700 1 -- 172.21.15.38:0/1746847855 learned_addr learned my addr 172.21.15.38:0/1746847855 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:55.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.103+0000 7f346e59c700 1 -- 172.21.15.38:0/1746847855 >> v1:172.21.15.150:6789/0 conn(0x7f347008ef70 legacy=0x7f3470153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:55.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.103+0000 7f346e59c700 1 -- 172.21.15.38:0/1746847855 >> v1:172.21.15.38:6789/0 conn(0x7f3470145cc0 legacy=0x7f34700660d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:55.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.103+0000 7f34677fe700 1 -- 172.21.15.38:0/1746847855 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775412363 0 0) 0x7f3450003230 con 0x7f3470145cc0 2020-06-12T17:49:55.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.103+0000 7f346e59c700 1 -- 172.21.15.38:0/1746847855 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34700b19c0 con 0x7f34500044d0 2020-06-12T17:49:55.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.103+0000 7f346e59c700 1 --2- 172.21.15.38:0/1746847855 >> v2:172.21.15.38:3300/0 conn(0x7f34500044d0 0x7f34700b0da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f34580013e0 tx=0x7f3470142490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.103+0000 7f346e59c700 1 --2- 172.21.15.38:0/1746847855 >> v2:172.21.15.38:3300/0 conn(0x7f34500044d0 0x7f34700b0da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f34580013e0 tx=0x7f3470142490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.103+0000 7f346e59c700 1 --2- 172.21.15.38:0/1746847855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34500044d0 0x7f34700b0da0 secure :-1 s=READY pgs=576 cs=0 l=1 rx=0x7f34580013e0 tx=0x7f3470142490).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:55.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.103+0000 7f346e59c700 1 --2- 172.21.15.38:0/1746847855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34500044d0 0x7f34700b0da0 secure :-1 s=THROTTLE_DONE pgs=576 cs=0 l=1 rx=0x7f34580013e0 tx=0x7f3470142490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.103+0000 7f346e59c700 1 --2- 172.21.15.38:0/1746847855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34500044d0 0x7f34700b0da0 secure :-1 s=THROTTLE_DONE pgs=576 cs=0 l=1 rx=0x7f34580013e0 tx=0x7f3470142490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.103+0000 7f34677fe700 1 -- 172.21.15.38:0/1746847855 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f345800cea0 con 0x7f34500044d0 2020-06-12T17:49:55.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.103+0000 7f346e59c700 1 --2- 172.21.15.38:0/1746847855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34500044d0 0x7f34700b0da0 secure :-1 s=THROTTLE_DONE pgs=576 cs=0 l=1 rx=0x7f34580013e0 tx=0x7f3470142490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.103+0000 7f34677fe700 1 -- 172.21.15.38:0/1746847855 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34580045b0 con 0x7f34500044d0 2020-06-12T17:49:55.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.103+0000 7f3474eb8700 1 -- 172.21.15.38:0/1746847855 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34700667e0 con 0x7f34500044d0 2020-06-12T17:49:55.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.103+0000 7f34677fe700 1 -- 172.21.15.38:0/1746847855 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3458004950 con 0x7f34500044d0 2020-06-12T17:49:55.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.103+0000 7f3474eb8700 1 -- 172.21.15.38:0/1746847855 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f347008f5c0 con 0x7f34500044d0 2020-06-12T17:49:55.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.104+0000 7f346e59c700 1 --2- 172.21.15.38:0/1746847855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34500044d0 0x7f34700b0da0 secure :-1 s=THROTTLE_DONE pgs=576 cs=0 l=1 rx=0x7f34580013e0 tx=0x7f3470142490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.104+0000 7f3474eb8700 1 -- 172.21.15.38:0/1746847855 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3470056c30 con 0x7f34500044d0 2020-06-12T17:49:55.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.104+0000 7f34677fe700 1 -- 172.21.15.38:0/1746847855 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f3458004bc0 con 0x7f34500044d0 2020-06-12T17:49:55.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.104+0000 7f346e59c700 1 --2- 172.21.15.38:0/1746847855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34500044d0 0x7f34700b0da0 secure :-1 s=THROTTLE_DONE pgs=576 cs=0 l=1 rx=0x7f34580013e0 tx=0x7f3470142490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.104+0000 7f34677fe700 1 --2- 172.21.15.38:0/1746847855 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f345404d4a0 0x7f345404f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:55.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.104+0000 7f34677fe700 1 -- 172.21.15.38:0/1746847855 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3458060f20 con 0x7f34500044d0 2020-06-12T17:49:55.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.105+0000 7f346dd9b700 1 --2- 172.21.15.38:0/1746847855 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f345404d4a0 0x7f345404f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:55.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.105+0000 7f346dd9b700 1 --2- 172.21.15.38:0/1746847855 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f345404d4a0 0x7f345404f960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f346000fa10 tx=0x7f3460001c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.105+0000 7f346dd9b700 1 --2- 172.21.15.38:0/1746847855 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f345404d4a0 0x7f345404f960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f346000fa10 tx=0x7f3460001c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.105+0000 7f346dd9b700 1 --2- 172.21.15.38:0/1746847855 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f345404d4a0 0x7f345404f960 secure :-1 s=READY pgs=228 cs=0 l=1 rx=0x7f346000fa10 tx=0x7f3460001c50).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:55.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.108+0000 7f346e59c700 1 --2- 172.21.15.38:0/1746847855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34500044d0 0x7f34700b0da0 secure :-1 s=THROTTLE_DONE pgs=576 cs=0 l=1 rx=0x7f34580013e0 tx=0x7f3470142490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.129 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.108+0000 7f34677fe700 1 -- 172.21.15.38:0/1746847855 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f345803c700 con 0x7f34500044d0 2020-06-12T17:49:55.306 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.301+0000 7f3474eb8700 1 -- 172.21.15.38:0/1746847855 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_2930", "target": ["mon-mgr", ""]}) v1 -- 0x7f347005a5e0 con 0x7f345404d4a0 2020-06-12T17:49:55.324 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.319+0000 7f346dd9b700 1 --2- 172.21.15.38:0/1746847855 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f345404d4a0 0x7f345404f960 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7f346000fa10 tx=0x7f3460001c50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.324 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.319+0000 7f34677fe700 1 -- 172.21.15.38:0/1746847855 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f347005a5e0 con 0x7f345404d4a0 2020-06-12T17:49:55.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.321+0000 7f3474eb8700 1 -- 172.21.15.38:0/1746847855 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f345404d4a0 msgr2=0x7f345404f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:55.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.321+0000 7f3474eb8700 1 --2- 172.21.15.38:0/1746847855 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f345404d4a0 0x7f345404f960 secure :-1 s=READY pgs=228 cs=0 l=1 rx=0x7f346000fa10 tx=0x7f3460001c50).stop 2020-06-12T17:49:55.327 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.321+0000 7f3474eb8700 1 -- 172.21.15.38:0/1746847855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34500044d0 msgr2=0x7f34700b0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:55.327 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.321+0000 7f3474eb8700 1 --2- 172.21.15.38:0/1746847855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34500044d0 0x7f34700b0da0 secure :-1 s=READY pgs=576 cs=0 l=1 rx=0x7f34580013e0 tx=0x7f3470142490).stop 2020-06-12T17:49:55.327 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.321+0000 7f3474eb8700 1 -- 172.21.15.38:0/1746847855 shutdown_connections 2020-06-12T17:49:55.327 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.321+0000 7f3474eb8700 1 --2- 172.21.15.38:0/1746847855 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f345404d4a0 0x7f345404f960 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:55.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.321+0000 7f3474eb8700 1 --2- 172.21.15.38:0/1746847855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34500044d0 0x7f34700b0da0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:55.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.321+0000 7f3474eb8700 1 -- 172.21.15.38:0/1746847855 >> 172.21.15.38:0/1746847855 conn(0x7f34700b5a20 msgr2=0x7f347005ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:55.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.321+0000 7f3474eb8700 1 -- 172.21.15.38:0/1746847855 shutdown_connections 2020-06-12T17:49:55.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.321+0000 7f3474eb8700 1 -- 172.21.15.38:0/1746847855 wait complete. 2020-06-12T17:49:55.336 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_2930 2020-06-12T17:49:55.453 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.449+0000 7f230d834700 1 Processor -- start 2020-06-12T17:49:55.453 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.449+0000 7f230d834700 1 -- start start 2020-06-12T17:49:55.456 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.449+0000 7f230d834700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2308146680 0x7f23080ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:55.456 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.449+0000 7f230d834700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f230809d8d0 0x7f23081421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:55.456 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.449+0000 7f230d834700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2308146d20 con 0x7f23080b2eb0 2020-06-12T17:49:55.457 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.449+0000 7f230d834700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2308066a80 con 0x7f2308146680 2020-06-12T17:49:55.457 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.449+0000 7f230d834700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2308146f50 con 0x7f230809d8d0 2020-06-12T17:49:55.457 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.450+0000 7f2306ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2308146680 0x7f23080ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:55.458 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.450+0000 7f2306ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2308146680 0x7f23080ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38246/0 (socket says 172.21.15.38:38246) 2020-06-12T17:49:55.458 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.450+0000 7f2306ffd700 1 -- 172.21.15.38:0/2393818199 learned_addr learned my addr 172.21.15.38:0/2393818199 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:55.458 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.450+0000 7f23077fe700 1 --2- 172.21.15.38:0/2393818199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f230809d8d0 0x7f23081421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:55.458 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.450+0000 7f2306ffd700 1 -- 172.21.15.38:0/2393818199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f230809d8d0 msgr2=0x7f23081421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:55.458 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.450+0000 7f2306ffd700 1 --2- 172.21.15.38:0/2393818199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f230809d8d0 0x7f23081421d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:55.459 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.450+0000 7f2306ffd700 1 -- 172.21.15.38:0/2393818199 >> v1:172.21.15.150:6789/0 conn(0x7f23080b2eb0 legacy=0x7f230809d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:55.459 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.450+0000 7f2306ffd700 1 -- 172.21.15.38:0/2393818199 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2308146a60 con 0x7f2308146680 2020-06-12T17:49:55.459 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.450+0000 7f2306ffd700 1 --2- 172.21.15.38:0/2393818199 >> v2:172.21.15.38:3300/0 conn(0x7f2308146680 0x7f23080ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f22f0002f30 tx=0x7f22f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.459 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.450+0000 7f2306ffd700 1 --2- 172.21.15.38:0/2393818199 >> v2:172.21.15.38:3300/0 conn(0x7f2308146680 0x7f23080ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f22f0002f30 tx=0x7f22f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.459 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.450+0000 7f2306ffd700 1 --2- 172.21.15.38:0/2393818199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2308146680 0x7f23080ad5b0 secure :-1 s=READY pgs=577 cs=0 l=1 rx=0x7f22f0002f30 tx=0x7f22f0007e60).ready entity=mon.0 client_cookie=896858439d566680 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:55.459 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.450+0000 7f2306ffd700 1 --2- 172.21.15.38:0/2393818199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2308146680 0x7f23080ad5b0 secure :-1 s=THROTTLE_DONE pgs=577 cs=0 l=1 rx=0x7f22f0002f30 tx=0x7f22f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.460 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.450+0000 7f2305ffb700 1 -- 172.21.15.38:0/2393818199 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22f0011630 con 0x7f2308146680 2020-06-12T17:49:55.460 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.450+0000 7f2306ffd700 1 --2- 172.21.15.38:0/2393818199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2308146680 0x7f23080ad5b0 secure :-1 s=THROTTLE_DONE pgs=577 cs=0 l=1 rx=0x7f22f0002f30 tx=0x7f22f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.460 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.450+0000 7f2306ffd700 1 --2- 172.21.15.38:0/2393818199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2308146680 0x7f23080ad5b0 secure :-1 s=THROTTLE_DONE pgs=577 cs=0 l=1 rx=0x7f22f0002f30 tx=0x7f22f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.460 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.450+0000 7f2305ffb700 1 -- 172.21.15.38:0/2393818199 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f0011790 con 0x7f2308146680 2020-06-12T17:49:55.460 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.450+0000 7f2305ffb700 1 -- 172.21.15.38:0/2393818199 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22f0011bb0 con 0x7f2308146680 2020-06-12T17:49:55.461 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.450+0000 7f230d834700 1 -- 172.21.15.38:0/2393818199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2308146680 msgr2=0x7f23080ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:55.461 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.450+0000 7f230d834700 1 --2- 172.21.15.38:0/2393818199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2308146680 0x7f23080ad5b0 secure :-1 s=READY pgs=577 cs=0 l=1 rx=0x7f22f0002f30 tx=0x7f22f0007e60).stop 2020-06-12T17:49:55.461 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.451+0000 7f230d834700 1 -- 172.21.15.38:0/2393818199 shutdown_connections 2020-06-12T17:49:55.461 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.451+0000 7f230d834700 1 --2- 172.21.15.38:0/2393818199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f230809d8d0 0x7f23081421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:55.461 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.451+0000 7f230d834700 1 --2- 172.21.15.38:0/2393818199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2308146680 0x7f23080ad5b0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.451+0000 7f230d834700 1 -- 172.21.15.38:0/2393818199 >> 172.21.15.38:0/2393818199 conn(0x7f23080b5a20 msgr2=0x7f230805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.451+0000 7f230d834700 1 -- 172.21.15.38:0/2393818199 shutdown_connections 2020-06-12T17:49:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.451+0000 7f230d834700 1 -- 172.21.15.38:0/2393818199 wait complete. 2020-06-12T17:49:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.452+0000 7f230d834700 1 Processor -- start 2020-06-12T17:49:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.452+0000 7f230d834700 1 -- start start 2020-06-12T17:49:55.465 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.453+0000 7f230d834700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f230809d8d0 0x7f2308093730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:55.465 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.453+0000 7f230d834700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f230813b370 con 0x7f2308146680 2020-06-12T17:49:55.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.453+0000 7f230d834700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f230813b610 con 0x7f23080b2eb0 2020-06-12T17:49:55.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.453+0000 7f230d834700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f230813b8b0 con 0x7f230809d8d0 2020-06-12T17:49:55.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.453+0000 7f2306ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f230809d8d0 0x7f2308093730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:55.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.453+0000 7f23077fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f2308146680 0x7f230813bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40072/0 (socket says 172.21.15.38:40072) 2020-06-12T17:49:55.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.453+0000 7f2306ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f230809d8d0 0x7f2308093730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38252/0 (socket says 172.21.15.38:38252) 2020-06-12T17:49:55.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.453+0000 7f23077fe700 1 -- 172.21.15.38:0/2716380426 learned_addr learned my addr 172.21.15.38:0/2716380426 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:55.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.453+0000 7f2306ffd700 1 -- 172.21.15.38:0/2716380426 >> v1:172.21.15.150:6789/0 conn(0x7f23080b2eb0 legacy=0x7f2308093f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:55.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.453+0000 7f2306ffd700 1 -- 172.21.15.38:0/2716380426 >> v1:172.21.15.38:6789/0 conn(0x7f2308146680 legacy=0x7f230813bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:55.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.453+0000 7f22fffff700 1 -- 172.21.15.38:0/2716380426 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120396201 0 0) 0x7f230813b370 con 0x7f2308146680 2020-06-12T17:49:55.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.453+0000 7f2306ffd700 1 -- 172.21.15.38:0/2716380426 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2308094660 con 0x7f230809d8d0 2020-06-12T17:49:55.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.453+0000 7f2306ffd700 1 --2- 172.21.15.38:0/2716380426 >> v2:172.21.15.38:3300/0 conn(0x7f230809d8d0 0x7f2308093730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f22f0002f30 tx=0x7f22f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.453+0000 7f2306ffd700 1 --2- 172.21.15.38:0/2716380426 >> v2:172.21.15.38:3300/0 conn(0x7f230809d8d0 0x7f2308093730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f22f0002f30 tx=0x7f22f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.453+0000 7f2306ffd700 1 --2- 172.21.15.38:0/2716380426 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f230809d8d0 0x7f2308093730 secure :-1 s=READY pgs=579 cs=0 l=1 rx=0x7f22f0002f30 tx=0x7f22f0007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:55.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.453+0000 7f2306ffd700 1 --2- 172.21.15.38:0/2716380426 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f230809d8d0 0x7f2308093730 secure :-1 s=THROTTLE_DONE pgs=579 cs=0 l=1 rx=0x7f22f0002f30 tx=0x7f22f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.453+0000 7f22fffff700 1 -- 172.21.15.38:0/2716380426 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22f0011e20 con 0x7f230809d8d0 2020-06-12T17:49:55.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.453+0000 7f2306ffd700 1 --2- 172.21.15.38:0/2716380426 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f230809d8d0 0x7f2308093730 secure :-1 s=THROTTLE_DONE pgs=579 cs=0 l=1 rx=0x7f22f0002f30 tx=0x7f22f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.453+0000 7f2306ffd700 1 --2- 172.21.15.38:0/2716380426 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f230809d8d0 0x7f2308093730 secure :-1 s=THROTTLE_DONE pgs=579 cs=0 l=1 rx=0x7f22f0002f30 tx=0x7f22f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.453+0000 7f22fffff700 1 -- 172.21.15.38:0/2716380426 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f0007340 con 0x7f230809d8d0 2020-06-12T17:49:55.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.453+0000 7f230d834700 1 -- 172.21.15.38:0/2716380426 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23080948b0 con 0x7f230809d8d0 2020-06-12T17:49:55.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.453+0000 7f22fffff700 1 -- 172.21.15.38:0/2716380426 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22f00056c0 con 0x7f230809d8d0 2020-06-12T17:49:55.470 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.453+0000 7f230d834700 1 -- 172.21.15.38:0/2716380426 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23080922a0 con 0x7f230809d8d0 2020-06-12T17:49:55.470 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.454+0000 7f2306ffd700 1 --2- 172.21.15.38:0/2716380426 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f230809d8d0 0x7f2308093730 secure :-1 s=THROTTLE_DONE pgs=579 cs=0 l=1 rx=0x7f22f0002f30 tx=0x7f22f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.470 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.454+0000 7f230d834700 1 -- 172.21.15.38:0/2716380426 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f230813b1d0 con 0x7f230809d8d0 2020-06-12T17:49:55.470 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.454+0000 7f22fffff700 1 -- 172.21.15.38:0/2716380426 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f22f0005930 con 0x7f230809d8d0 2020-06-12T17:49:55.470 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.454+0000 7f2306ffd700 1 --2- 172.21.15.38:0/2716380426 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f230809d8d0 0x7f2308093730 secure :-1 s=THROTTLE_DONE pgs=579 cs=0 l=1 rx=0x7f22f0002f30 tx=0x7f22f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.471 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.455+0000 7f22fffff700 1 --2- 172.21.15.38:0/2716380426 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f22ec04d500 0x7f22ec04f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:55.471 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.455+0000 7f22fffff700 1 -- 172.21.15.38:0/2716380426 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f22f0061350 con 0x7f230809d8d0 2020-06-12T17:49:55.471 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.455+0000 7f23067fc700 1 --2- 172.21.15.38:0/2716380426 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f22ec04d500 0x7f22ec04f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:55.472 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.455+0000 7f23067fc700 1 --2- 172.21.15.38:0/2716380426 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f22ec04d500 0x7f22ec04f9c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f23080b76c0 tx=0x7f22f8002470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.472 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.455+0000 7f23067fc700 1 --2- 172.21.15.38:0/2716380426 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f22ec04d500 0x7f22ec04f9c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f23080b76c0 tx=0x7f22f8002470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.472 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.455+0000 7f23067fc700 1 --2- 172.21.15.38:0/2716380426 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f22ec04d500 0x7f22ec04f9c0 secure :-1 s=READY pgs=229 cs=0 l=1 rx=0x7f23080b76c0 tx=0x7f22f8002470).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:55.473 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.458+0000 7f2306ffd700 1 --2- 172.21.15.38:0/2716380426 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f230809d8d0 0x7f2308093730 secure :-1 s=THROTTLE_DONE pgs=579 cs=0 l=1 rx=0x7f22f0002f30 tx=0x7f22f0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.473 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.458+0000 7f22fffff700 1 -- 172.21.15.38:0/2716380426 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f230813b1d0 con 0x7f230809d8d0 2020-06-12T17:49:55.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.654+0000 7f230d834700 1 -- 172.21.15.38:0/2716380426 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_2930", "target": ["mon-mgr", ""]}) v1 -- 0x7f230813b1d0 con 0x7f22ec04d500 2020-06-12T17:49:55.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.658+0000 7f23067fc700 1 --2- 172.21.15.38:0/2716380426 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f22ec04d500 0x7f22ec04f9c0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7f23080b76c0 tx=0x7f22f8002470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:55.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.658+0000 7f22fffff700 1 -- 172.21.15.38:0/2716380426 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f230813b1d0 con 0x7f22ec04d500 2020-06-12T17:49:55.662 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_2930/2cd57eb3-3a55-4583-9ac4-a459bdff12ce 2020-06-12T17:49:55.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.659+0000 7f230d834700 1 -- 172.21.15.38:0/2716380426 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f22ec04d500 msgr2=0x7f22ec04f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:55.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.659+0000 7f230d834700 1 --2- 172.21.15.38:0/2716380426 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f22ec04d500 0x7f22ec04f9c0 secure :-1 s=READY pgs=229 cs=0 l=1 rx=0x7f23080b76c0 tx=0x7f22f8002470).stop 2020-06-12T17:49:55.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.659+0000 7f230d834700 1 -- 172.21.15.38:0/2716380426 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f230809d8d0 msgr2=0x7f2308093730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:55.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.659+0000 7f230d834700 1 --2- 172.21.15.38:0/2716380426 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f230809d8d0 0x7f2308093730 secure :-1 s=READY pgs=579 cs=0 l=1 rx=0x7f22f0002f30 tx=0x7f22f0007e60).stop 2020-06-12T17:49:55.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.659+0000 7f230d834700 1 -- 172.21.15.38:0/2716380426 shutdown_connections 2020-06-12T17:49:55.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.659+0000 7f230d834700 1 --2- 172.21.15.38:0/2716380426 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f22ec04d500 0x7f22ec04f9c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:55.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.659+0000 7f230d834700 1 --2- 172.21.15.38:0/2716380426 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f230809d8d0 0x7f2308093730 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:55.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.659+0000 7f230d834700 1 -- 172.21.15.38:0/2716380426 >> 172.21.15.38:0/2716380426 conn(0x7f23080b5a20 msgr2=0x7f2308065920 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:55.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.659+0000 7f230d834700 1 -- 172.21.15.38:0/2716380426 shutdown_connections 2020-06-12T17:49:55.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:55.659+0000 7f230d834700 1 -- 172.21.15.38:0/2716380426 wait complete. 2020-06-12T17:49:55.673 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_2930 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_2930/2cd57eb3-3a55-4583-9ac4-a459bdff12ce 2020-06-12T17:49:55.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:55.674 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:55.675 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:55.689 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:55.690 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:55.691 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2930/2cd57eb3-3a55-4583-9ac4-a459bdff12ce/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:55.780 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:55.780 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:55.781 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105691 s, 99.2 MB/s 2020-06-12T17:49:55.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:55.782 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:55.783 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:55.797 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:55.798 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:55.799 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2930/2cd57eb3-3a55-4583-9ac4-a459bdff12ce/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:55.886 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:55.887 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:55.887 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121515 s, 86.3 MB/s 2020-06-12T17:49:55.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:55.888 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:55.889 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:55.903 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:55.906 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:55.907 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2930/2cd57eb3-3a55-4583-9ac4-a459bdff12ce/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:55.993 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:55.994 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:55.994 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115174 s, 91.0 MB/s 2020-06-12T17:49:55.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:55.995 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:55.996 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:56.011 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:56.011 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:56.012 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2930/2cd57eb3-3a55-4583-9ac4-a459bdff12ce/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:56.099 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:56.099 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:56.099 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110375 s, 95.0 MB/s 2020-06-12T17:49:56.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:56.101 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:56.101 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:56.119 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:56.120 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:56.121 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2930/2cd57eb3-3a55-4583-9ac4-a459bdff12ce/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:56.206 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:56.207 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:56.207 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107203 s, 97.8 MB/s 2020-06-12T17:49:56.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:56.209 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:56.209 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:56.224 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:56.224 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:56.225 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2930/2cd57eb3-3a55-4583-9ac4-a459bdff12ce/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:56.318 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:56.318 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:56.318 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126249 s, 83.1 MB/s 2020-06-12T17:49:56.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:56.320 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:56.320 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:56.335 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:56.336 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:56.336 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2930/2cd57eb3-3a55-4583-9ac4-a459bdff12ce/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:56.422 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:56.422 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:56.422 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010036 s, 104 MB/s 2020-06-12T17:49:56.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:56.424 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:56.424 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:56.439 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:56.440 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:56.440 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2930/2cd57eb3-3a55-4583-9ac4-a459bdff12ce/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:56.528 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:56.528 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:56.528 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110504 s, 94.9 MB/s 2020-06-12T17:49:56.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:56.530 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:56.530 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:56.545 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:56.546 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:56.546 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2930/2cd57eb3-3a55-4583-9ac4-a459bdff12ce/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:56.632 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:56.633 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:56.633 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099766 s, 105 MB/s 2020-06-12T17:49:56.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:56.636 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:56.636 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:56.651 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:56.651 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:56.652 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2930/2cd57eb3-3a55-4583-9ac4-a459bdff12ce/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:56.740 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:56.740 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:56.740 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125652 s, 83.5 MB/s 2020-06-12T17:49:56.742 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_1257 2020-06-12T17:49:56.859 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.854+0000 7f06e13a4700 1 Processor -- start 2020-06-12T17:49:56.859 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.854+0000 7f06e13a4700 1 -- start start 2020-06-12T17:49:56.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.855+0000 7f06e13a4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f06dc060320 0x7f06dc1468d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:56.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.855+0000 7f06e13a4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f06dc140100 0x7f06dc05b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:56.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.855+0000 7f06e13a4700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06dc146df0 con 0x7f06dc0b7920 2020-06-12T17:49:56.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.855+0000 7f06e13a4700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06dc0a0b10 con 0x7f06dc140100 2020-06-12T17:49:56.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.855+0000 7f06e13a4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06dc0a2030 con 0x7f06dc060320 2020-06-12T17:49:56.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.855+0000 7f06db7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f06dc140100 0x7f06dc05b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:56.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.855+0000 7f06db7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f06dc140100 0x7f06dc05b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38260/0 (socket says 172.21.15.38:38260) 2020-06-12T17:49:56.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.855+0000 7f06db7fe700 1 -- 172.21.15.38:0/2113594560 learned_addr learned my addr 172.21.15.38:0/2113594560 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:56.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.855+0000 7f06da7fc700 1 --1- 172.21.15.38:0/2113594560 >> v1:172.21.15.38:6789/0 conn(0x7f06dc0b7920 0x7f06dc13f9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40076/0 (socket says 172.21.15.38:40076) 2020-06-12T17:49:56.874 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.856+0000 7f06daffd700 1 --2- 172.21.15.38:0/2113594560 >> v2:172.21.15.150:3300/0 conn(0x7f06dc060320 0x7f06dc1468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:56.874 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.856+0000 7f06db7fe700 1 -- 172.21.15.38:0/2113594560 >> v2:172.21.15.150:3300/0 conn(0x7f06dc060320 msgr2=0x7f06dc1468d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:56.874 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.856+0000 7f06db7fe700 1 --2- 172.21.15.38:0/2113594560 >> v2:172.21.15.150:3300/0 conn(0x7f06dc060320 0x7f06dc1468d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:56.874 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.856+0000 7f06db7fe700 1 -- 172.21.15.38:0/2113594560 >> v1:172.21.15.38:6789/0 conn(0x7f06dc0b7920 legacy=0x7f06dc13f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:56.874 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.856+0000 7f06d9ffb700 1 -- 172.21.15.38:0/2113594560 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693414240 0 0) 0x7f06dc146df0 con 0x7f06dc0b7920 2020-06-12T17:49:56.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.856+0000 7f06db7fe700 1 -- 172.21.15.38:0/2113594560 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc0a22d0 con 0x7f06dc140100 2020-06-12T17:49:56.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.856+0000 7f06daffd700 1 --2- 172.21.15.38:0/2113594560 >> v2:172.21.15.150:3300/0 conn(0x7f06dc060320 0x7f06dc1468d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:49:56.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.856+0000 7f06db7fe700 1 --2- 172.21.15.38:0/2113594560 >> v2:172.21.15.38:3300/0 conn(0x7f06dc140100 0x7f06dc05b180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f06d40032b0 tx=0x7f06d40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:56.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.856+0000 7f06db7fe700 1 --2- 172.21.15.38:0/2113594560 >> v2:172.21.15.38:3300/0 conn(0x7f06dc140100 0x7f06dc05b180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f06d40032b0 tx=0x7f06d40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:56.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.856+0000 7f06db7fe700 1 --2- 172.21.15.38:0/2113594560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06dc140100 0x7f06dc05b180 secure :-1 s=READY pgs=581 cs=0 l=1 rx=0x7f06d40032b0 tx=0x7f06d40081e0).ready entity=mon.0 client_cookie=7569b48607f0816a server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:56.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.856+0000 7f06db7fe700 1 --2- 172.21.15.38:0/2113594560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06dc140100 0x7f06dc05b180 secure :-1 s=THROTTLE_DONE pgs=581 cs=0 l=1 rx=0x7f06d40032b0 tx=0x7f06d40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:56.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.856+0000 7f06d9ffb700 1 -- 172.21.15.38:0/2113594560 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06d400a160 con 0x7f06dc140100 2020-06-12T17:49:56.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.856+0000 7f06db7fe700 1 --2- 172.21.15.38:0/2113594560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06dc140100 0x7f06dc05b180 secure :-1 s=THROTTLE_DONE pgs=581 cs=0 l=1 rx=0x7f06d40032b0 tx=0x7f06d40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:56.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.856+0000 7f06db7fe700 1 --2- 172.21.15.38:0/2113594560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06dc140100 0x7f06dc05b180 secure :-1 s=THROTTLE_DONE pgs=581 cs=0 l=1 rx=0x7f06d40032b0 tx=0x7f06d40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:56.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.856+0000 7f06d9ffb700 1 -- 172.21.15.38:0/2113594560 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d400a2c0 con 0x7f06dc140100 2020-06-12T17:49:56.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.856+0000 7f06d9ffb700 1 -- 172.21.15.38:0/2113594560 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06d400a660 con 0x7f06dc140100 2020-06-12T17:49:56.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.856+0000 7f06e13a4700 1 -- 172.21.15.38:0/2113594560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06dc140100 msgr2=0x7f06dc05b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:56.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.856+0000 7f06e13a4700 1 --2- 172.21.15.38:0/2113594560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06dc140100 0x7f06dc05b180 secure :-1 s=READY pgs=581 cs=0 l=1 rx=0x7f06d40032b0 tx=0x7f06d40081e0).stop 2020-06-12T17:49:56.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.856+0000 7f06e13a4700 1 -- 172.21.15.38:0/2113594560 shutdown_connections 2020-06-12T17:49:56.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.856+0000 7f06e13a4700 1 --2- 172.21.15.38:0/2113594560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06dc140100 0x7f06dc05b180 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:56.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.856+0000 7f06e13a4700 1 --2- 172.21.15.38:0/2113594560 >> v2:172.21.15.150:3300/0 conn(0x7f06dc060320 0x7f06dc1468d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:56.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.856+0000 7f06e13a4700 1 -- 172.21.15.38:0/2113594560 >> 172.21.15.38:0/2113594560 conn(0x7f06dc0b91b0 msgr2=0x7f06dc0b95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:56.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.857+0000 7f06e13a4700 1 -- 172.21.15.38:0/2113594560 shutdown_connections 2020-06-12T17:49:56.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.857+0000 7f06e13a4700 1 -- 172.21.15.38:0/2113594560 wait complete. 2020-06-12T17:49:56.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.857+0000 7f06e13a4700 1 Processor -- start 2020-06-12T17:49:56.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.857+0000 7f06e13a4700 1 -- start start 2020-06-12T17:49:56.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.858+0000 7f06e13a4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06dc060320 0x7f06dc0bc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:56.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.858+0000 7f06e13a4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f06dc140100 0x7f06dc0bb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:56.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.858+0000 7f06e13a4700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06dc153280 con 0x7f06dc0b7920 2020-06-12T17:49:56.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.858+0000 7f06e13a4700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06dc13f980 con 0x7f06dc140100 2020-06-12T17:49:56.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.858+0000 7f06e13a4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc0b17b0 con 0x7f06dc060320 2020-06-12T17:49:56.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.858+0000 7f06da7fc700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f06dc0b7920 0x7f06dc153950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40080/0 (socket says 172.21.15.38:40080) 2020-06-12T17:49:56.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.858+0000 7f06db7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f06dc140100 0x7f06dc0bb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:56.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.858+0000 7f06da7fc700 1 -- 172.21.15.38:0/353024098 learned_addr learned my addr 172.21.15.38:0/353024098 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:56.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.858+0000 7f06daffd700 1 --2- 172.21.15.38:0/353024098 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06dc060320 0x7f06dc0bc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:56.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.859+0000 7f06db7fe700 1 -- 172.21.15.38:0/353024098 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06dc060320 msgr2=0x7f06dc0bc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:56.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.859+0000 7f06db7fe700 1 --2- 172.21.15.38:0/353024098 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06dc060320 0x7f06dc0bc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:56.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.859+0000 7f06db7fe700 1 -- 172.21.15.38:0/353024098 >> v1:172.21.15.38:6789/0 conn(0x7f06dc0b7920 legacy=0x7f06dc153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:56.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.859+0000 7f06db7fe700 1 -- 172.21.15.38:0/353024098 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc1534b0 con 0x7f06dc140100 2020-06-12T17:49:56.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.859+0000 7f06cbfff700 1 -- 172.21.15.38:0/353024098 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990296676 0 0) 0x7f06dc153280 con 0x7f06dc0b7920 2020-06-12T17:49:56.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.859+0000 7f06daffd700 1 --2- 172.21.15.38:0/353024098 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06dc060320 0x7f06dc0bc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:49:56.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.859+0000 7f06db7fe700 1 --2- 172.21.15.38:0/353024098 >> v2:172.21.15.38:3300/0 conn(0x7f06dc140100 0x7f06dc0bb710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f06d40032b0 tx=0x7f06d40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:56.882 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.859+0000 7f06db7fe700 1 --2- 172.21.15.38:0/353024098 >> v2:172.21.15.38:3300/0 conn(0x7f06dc140100 0x7f06dc0bb710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f06d40032b0 tx=0x7f06d40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:56.882 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.859+0000 7f06db7fe700 1 --2- 172.21.15.38:0/353024098 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06dc140100 0x7f06dc0bb710 secure :-1 s=READY pgs=583 cs=0 l=1 rx=0x7f06d40032b0 tx=0x7f06d40081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:56.882 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.859+0000 7f06db7fe700 1 --2- 172.21.15.38:0/353024098 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06dc140100 0x7f06dc0bb710 secure :-1 s=THROTTLE_DONE pgs=583 cs=0 l=1 rx=0x7f06d40032b0 tx=0x7f06d40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:56.882 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.859+0000 7f06cbfff700 1 -- 172.21.15.38:0/353024098 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06d4005c30 con 0x7f06dc140100 2020-06-12T17:49:56.882 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.859+0000 7f06db7fe700 1 --2- 172.21.15.38:0/353024098 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06dc140100 0x7f06dc0bb710 secure :-1 s=THROTTLE_DONE pgs=583 cs=0 l=1 rx=0x7f06d40032b0 tx=0x7f06d40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:56.883 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.859+0000 7f06db7fe700 1 --2- 172.21.15.38:0/353024098 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06dc140100 0x7f06dc0bb710 secure :-1 s=THROTTLE_DONE pgs=583 cs=0 l=1 rx=0x7f06d40032b0 tx=0x7f06d40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:56.883 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.859+0000 7f06cbfff700 1 -- 172.21.15.38:0/353024098 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d4005d90 con 0x7f06dc140100 2020-06-12T17:49:56.883 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.859+0000 7f06e13a4700 1 -- 172.21.15.38:0/353024098 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06dc0b1a50 con 0x7f06dc140100 2020-06-12T17:49:56.884 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.859+0000 7f06cbfff700 1 -- 172.21.15.38:0/353024098 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06d4007340 con 0x7f06dc140100 2020-06-12T17:49:56.884 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.859+0000 7f06e13a4700 1 -- 172.21.15.38:0/353024098 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06dc142e50 con 0x7f06dc140100 2020-06-12T17:49:56.884 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.860+0000 7f06db7fe700 1 --2- 172.21.15.38:0/353024098 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06dc140100 0x7f06dc0bb710 secure :-1 s=THROTTLE_DONE pgs=583 cs=0 l=1 rx=0x7f06d40032b0 tx=0x7f06d40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:56.884 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.860+0000 7f06e13a4700 1 -- 172.21.15.38:0/353024098 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06dc056c30 con 0x7f06dc140100 2020-06-12T17:49:56.884 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.860+0000 7f06cbfff700 1 -- 172.21.15.38:0/353024098 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f06d40075b0 con 0x7f06dc140100 2020-06-12T17:49:56.884 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.860+0000 7f06db7fe700 1 --2- 172.21.15.38:0/353024098 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06dc140100 0x7f06dc0bb710 secure :-1 s=THROTTLE_DONE pgs=583 cs=0 l=1 rx=0x7f06d40032b0 tx=0x7f06d40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:56.885 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.860+0000 7f06cbfff700 1 --2- 172.21.15.38:0/353024098 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06b804d580 0x7f06b804fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:56.885 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.860+0000 7f06cbfff700 1 -- 172.21.15.38:0/353024098 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f06d4061d00 con 0x7f06dc140100 2020-06-12T17:49:56.885 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.860+0000 7f06daffd700 1 --2- 172.21.15.38:0/353024098 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06b804d580 0x7f06b804fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:56.885 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.861+0000 7f06daffd700 1 --2- 172.21.15.38:0/353024098 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06b804d580 0x7f06b804fa40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f06d0002f30 tx=0x7f06d0007c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:56.885 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.861+0000 7f06daffd700 1 --2- 172.21.15.38:0/353024098 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06b804d580 0x7f06b804fa40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f06d0002f30 tx=0x7f06d0007c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:56.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.861+0000 7f06daffd700 1 --2- 172.21.15.38:0/353024098 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06b804d580 0x7f06b804fa40 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7f06d0002f30 tx=0x7f06d0007c30).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:56.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.864+0000 7f06db7fe700 1 --2- 172.21.15.38:0/353024098 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06dc140100 0x7f06dc0bb710 secure :-1 s=THROTTLE_DONE pgs=583 cs=0 l=1 rx=0x7f06d40032b0 tx=0x7f06d40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:56.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:56.864+0000 7f06cbfff700 1 -- 172.21.15.38:0/353024098 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f06d403d540 con 0x7f06dc140100 2020-06-12T17:49:57.062 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.057+0000 7f06e13a4700 1 -- 172.21.15.38:0/353024098 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_1257", "target": ["mon-mgr", ""]}) v1 -- 0x7f06dc1536b0 con 0x7f06b804d580 2020-06-12T17:49:57.080 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.076+0000 7f06daffd700 1 --2- 172.21.15.38:0/353024098 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06b804d580 0x7f06b804fa40 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f06d0002f30 tx=0x7f06d0007c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:57.081 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.076+0000 7f06cbfff700 1 -- 172.21.15.38:0/353024098 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f06d0007290 con 0x7f06b804d580 2020-06-12T17:49:57.082 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.079+0000 7f06e13a4700 1 -- 172.21.15.38:0/353024098 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06b804d580 msgr2=0x7f06b804fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:57.083 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.079+0000 7f06e13a4700 1 --2- 172.21.15.38:0/353024098 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06b804d580 0x7f06b804fa40 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7f06d0002f30 tx=0x7f06d0007c30).stop 2020-06-12T17:49:57.083 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.079+0000 7f06e13a4700 1 -- 172.21.15.38:0/353024098 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06dc140100 msgr2=0x7f06dc0bb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:57.083 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.079+0000 7f06e13a4700 1 --2- 172.21.15.38:0/353024098 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06dc140100 0x7f06dc0bb710 secure :-1 s=READY pgs=583 cs=0 l=1 rx=0x7f06d40032b0 tx=0x7f06d40081e0).stop 2020-06-12T17:49:57.083 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.079+0000 7f06e13a4700 1 -- 172.21.15.38:0/353024098 shutdown_connections 2020-06-12T17:49:57.083 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.079+0000 7f06e13a4700 1 --2- 172.21.15.38:0/353024098 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06b804d580 0x7f06b804fa40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:57.084 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.079+0000 7f06e13a4700 1 --2- 172.21.15.38:0/353024098 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06dc140100 0x7f06dc0bb710 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:57.084 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.079+0000 7f06e13a4700 1 --2- 172.21.15.38:0/353024098 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06dc060320 0x7f06dc0bc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:57.084 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.079+0000 7f06e13a4700 1 -- 172.21.15.38:0/353024098 >> 172.21.15.38:0/353024098 conn(0x7f06dc0b91b0 msgr2=0x7f06dc0a0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:57.084 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.079+0000 7f06e13a4700 1 -- 172.21.15.38:0/353024098 shutdown_connections 2020-06-12T17:49:57.085 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.079+0000 7f06e13a4700 1 -- 172.21.15.38:0/353024098 wait complete. 2020-06-12T17:49:57.092 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_1257 2020-06-12T17:49:57.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.205+0000 7f04dd834700 1 Processor -- start 2020-06-12T17:49:57.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.205+0000 7f04dd834700 1 -- start start 2020-06-12T17:49:57.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.205+0000 7f04dd834700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f04d81448f0 0x7f04d8147a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:57.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.205+0000 7f04dd834700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d8144d80 con 0x7f04d809ed40 2020-06-12T17:49:57.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.205+0000 7f04dd834700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d80b90c0 con 0x7f04d8144440 2020-06-12T17:49:57.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.205+0000 7f04dd834700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d8143db0 con 0x7f04d81448f0 2020-06-12T17:49:57.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.206+0000 7f04d6ffd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f04d809ed40 0x7f04d8066110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40086/0 (socket says 172.21.15.38:40086) 2020-06-12T17:49:57.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.206+0000 7f04d6ffd700 1 -- 172.21.15.38:0/2616737821 learned_addr learned my addr 172.21.15.38:0/2616737821 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:57.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.206+0000 7f04d77fe700 1 --2- 172.21.15.38:0/2616737821 >> v2:172.21.15.150:3300/0 conn(0x7f04d81448f0 0x7f04d8147a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:57.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.206+0000 7f04d5ffb700 1 -- 172.21.15.38:0/2616737821 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249628978 0 0) 0x7f04d8144d80 con 0x7f04d809ed40 2020-06-12T17:49:57.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.206+0000 7f04d5ffb700 1 -- 172.21.15.38:0/2616737821 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04bc003230 con 0x7f04d809ed40 2020-06-12T17:49:57.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.206+0000 7f04d5ffb700 1 -- 172.21.15.38:0/2616737821 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3127222015 0 0) 0x7f04bc003230 con 0x7f04d809ed40 2020-06-12T17:49:57.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.206+0000 7f04d5ffb700 1 -- 172.21.15.38:0/2616737821 >> v2:172.21.15.150:3300/0 conn(0x7f04d81448f0 msgr2=0x7f04d8147a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:57.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.206+0000 7f04d5ffb700 1 --2- 172.21.15.38:0/2616737821 >> v2:172.21.15.150:3300/0 conn(0x7f04d81448f0 0x7f04d8147a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:57.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.206+0000 7f04d5ffb700 1 -- 172.21.15.38:0/2616737821 >> v1:172.21.15.150:6789/0 conn(0x7f04d8144440 legacy=0x7f04d8147380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:57.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.206+0000 7f04d5ffb700 1 -- 172.21.15.38:0/2616737821 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d8143fa0 con 0x7f04d809ed40 2020-06-12T17:49:57.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.206+0000 7f04d5ffb700 1 -- 172.21.15.38:0/2616737821 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f04cc0016d0 con 0x7f04d809ed40 2020-06-12T17:49:57.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.206+0000 7f04d5ffb700 1 -- 172.21.15.38:0/2616737821 >> v1:172.21.15.38:6789/0 conn(0x7f04d809ed40 legacy=0x7f04d8066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:57.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.206+0000 7f04d5ffb700 1 --2- 172.21.15.38:0/2616737821 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04bc003720 0x7f04bc003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:57.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.206+0000 7f04d5ffb700 1 --2- 172.21.15.38:0/2616737821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04bc004020 0x7f04bc0044f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:57.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.206+0000 7f04d5ffb700 1 --2- 172.21.15.38:0/2616737821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04bc004a60 0x7f04bc004f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:57.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.206+0000 7f04d5ffb700 1 -- 172.21.15.38:0/2616737821 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc00b800 con 0x7f04bc004a60 2020-06-12T17:49:57.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.206+0000 7f04d5ffb700 1 -- 172.21.15.38:0/2616737821 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc00b970 con 0x7f04bc004020 2020-06-12T17:49:57.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.206+0000 7f04d5ffb700 1 -- 172.21.15.38:0/2616737821 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc00bb30 con 0x7f04bc003720 2020-06-12T17:49:57.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.206+0000 7f04d77fe700 1 --2- 172.21.15.38:0/2616737821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04bc004a60 0x7f04bc004f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:57.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.206+0000 7f04d6ffd700 1 --2- 172.21.15.38:0/2616737821 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04bc003720 0x7f04bc003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:57.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.207+0000 7f04d67fc700 1 --2- 172.21.15.38:0/2616737821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04bc004020 0x7f04bc0044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:57.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.207+0000 7f04d77fe700 1 -- 172.21.15.38:0/2616737821 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04bc003720 msgr2=0x7f04bc003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:57.222 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.207+0000 7f04d77fe700 1 --2- 172.21.15.38:0/2616737821 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04bc003720 0x7f04bc003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:57.222 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.207+0000 7f04d77fe700 1 -- 172.21.15.38:0/2616737821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04bc004020 msgr2=0x7f04bc0044f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:57.222 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.207+0000 7f04d77fe700 1 --2- 172.21.15.38:0/2616737821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04bc004020 0x7f04bc0044f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:57.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.207+0000 7f04d77fe700 1 -- 172.21.15.38:0/2616737821 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04bc003230 con 0x7f04bc004a60 2020-06-12T17:49:57.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.207+0000 7f04d6ffd700 1 --2- 172.21.15.38:0/2616737821 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04bc003720 0x7f04bc003b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:49:57.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.207+0000 7f04d77fe700 1 --2- 172.21.15.38:0/2616737821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04bc004a60 0x7f04bc004f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f04d00032b0 tx=0x7f04d00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:57.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.207+0000 7f04d77fe700 1 -- 172.21.15.38:0/2616737821 reap_dead start 2020-06-12T17:49:57.224 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.207+0000 7f04d77fe700 1 --2- 172.21.15.38:0/2616737821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04bc004a60 0x7f04bc004f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f04d00032b0 tx=0x7f04d00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:57.224 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.207+0000 7f04d77fe700 1 --2- 172.21.15.38:0/2616737821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04bc004a60 0x7f04bc004f10 secure :-1 s=READY pgs=585 cs=0 l=1 rx=0x7f04d00032b0 tx=0x7f04d00081e0).ready entity=mon.0 client_cookie=1e56ddc138967f35 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:57.224 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.207+0000 7f04d77fe700 1 --2- 172.21.15.38:0/2616737821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04bc004a60 0x7f04bc004f10 secure :-1 s=THROTTLE_DONE pgs=585 cs=0 l=1 rx=0x7f04d00032b0 tx=0x7f04d00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:57.224 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.207+0000 7f04d5ffb700 1 -- 172.21.15.38:0/2616737821 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04d0005c30 con 0x7f04bc004a60 2020-06-12T17:49:57.224 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.207+0000 7f04d77fe700 1 --2- 172.21.15.38:0/2616737821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04bc004a60 0x7f04bc004f10 secure :-1 s=THROTTLE_DONE pgs=585 cs=0 l=1 rx=0x7f04d00032b0 tx=0x7f04d00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:57.225 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.207+0000 7f04d5ffb700 1 -- 172.21.15.38:0/2616737821 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d0005d90 con 0x7f04bc004a60 2020-06-12T17:49:57.225 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.207+0000 7f04d77fe700 1 --2- 172.21.15.38:0/2616737821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04bc004a60 0x7f04bc004f10 secure :-1 s=THROTTLE_DONE pgs=585 cs=0 l=1 rx=0x7f04d00032b0 tx=0x7f04d00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:57.225 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.207+0000 7f04d5ffb700 1 -- 172.21.15.38:0/2616737821 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04d00112b0 con 0x7f04bc004a60 2020-06-12T17:49:57.225 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.207+0000 7f04dd834700 1 -- 172.21.15.38:0/2616737821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04bc004a60 msgr2=0x7f04bc004f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:57.226 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.207+0000 7f04dd834700 1 --2- 172.21.15.38:0/2616737821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04bc004a60 0x7f04bc004f10 secure :-1 s=READY pgs=585 cs=0 l=1 rx=0x7f04d00032b0 tx=0x7f04d00081e0).stop 2020-06-12T17:49:57.226 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.208+0000 7f04dd834700 1 -- 172.21.15.38:0/2616737821 shutdown_connections 2020-06-12T17:49:57.226 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.208+0000 7f04dd834700 1 --2- 172.21.15.38:0/2616737821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04bc004a60 0x7f04bc004f10 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:57.226 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.208+0000 7f04dd834700 1 -- 172.21.15.38:0/2616737821 >> 172.21.15.38:0/2616737821 conn(0x7f04d80b94a0 msgr2=0x7f04d80b98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:57.226 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.208+0000 7f04dd834700 1 -- 172.21.15.38:0/2616737821 shutdown_connections 2020-06-12T17:49:57.226 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.208+0000 7f04dd834700 1 -- 172.21.15.38:0/2616737821 wait complete. 2020-06-12T17:49:57.227 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.209+0000 7f04dd834700 1 Processor -- start 2020-06-12T17:49:57.227 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.209+0000 7f04dd834700 1 -- start start 2020-06-12T17:49:57.227 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.209+0000 7f04dd834700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f04bc004a60 0x7f04d8152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:57.227 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.209+0000 7f04dd834700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f04d80602a0 0x7f04d813e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:57.227 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.209+0000 7f04dd834700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d8152070 con 0x7f04d8143920 2020-06-12T17:49:57.228 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.209+0000 7f04dd834700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d8060730 con 0x7f04d80602a0 2020-06-12T17:49:57.228 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.209+0000 7f04dd834700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d8143da0 con 0x7f04bc004a60 2020-06-12T17:49:57.228 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.209+0000 7f04d77fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f04d80602a0 0x7f04d813e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:57.228 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.210+0000 7f04d77fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f04d80602a0 0x7f04d813e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38286/0 (socket says 172.21.15.38:38286) 2020-06-12T17:49:57.228 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.210+0000 7f04d77fe700 1 -- 172.21.15.38:0/2677802663 learned_addr learned my addr 172.21.15.38:0/2677802663 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:57.229 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.210+0000 7f04d6ffd700 1 --2- 172.21.15.38:0/2677802663 >> v2:172.21.15.150:3300/0 conn(0x7f04bc004a60 0x7f04d8152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:57.229 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.210+0000 7f04d77fe700 1 -- 172.21.15.38:0/2677802663 >> v2:172.21.15.150:3300/0 conn(0x7f04bc004a60 msgr2=0x7f04d8152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:57.229 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.210+0000 7f04d77fe700 1 --2- 172.21.15.38:0/2677802663 >> v2:172.21.15.150:3300/0 conn(0x7f04bc004a60 0x7f04d8152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:57.229 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.210+0000 7f04d77fe700 1 -- 172.21.15.38:0/2677802663 >> v1:172.21.15.150:6789/0 conn(0x7f04d8143920 legacy=0x7f04d813e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:57.229 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.210+0000 7f04d77fe700 1 -- 172.21.15.38:0/2677802663 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d81522a0 con 0x7f04d80602a0 2020-06-12T17:49:57.230 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.210+0000 7f04d77fe700 1 --2- 172.21.15.38:0/2677802663 >> v2:172.21.15.38:3300/0 conn(0x7f04d80602a0 0x7f04d813e860 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f04d00032b0 tx=0x7f04d00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:57.230 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.210+0000 7f04d77fe700 1 --2- 172.21.15.38:0/2677802663 >> v2:172.21.15.38:3300/0 conn(0x7f04d80602a0 0x7f04d813e860 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f04d00032b0 tx=0x7f04d00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:57.230 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.210+0000 7f04d77fe700 1 --2- 172.21.15.38:0/2677802663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04d80602a0 0x7f04d813e860 secure :-1 s=READY pgs=586 cs=0 l=1 rx=0x7f04d00032b0 tx=0x7f04d00081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:57.230 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.210+0000 7f04d77fe700 1 --2- 172.21.15.38:0/2677802663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04d80602a0 0x7f04d813e860 secure :-1 s=THROTTLE_DONE pgs=586 cs=0 l=1 rx=0x7f04d00032b0 tx=0x7f04d00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:57.230 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.210+0000 7f04c7fff700 1 -- 172.21.15.38:0/2677802663 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04d0007970 con 0x7f04d80602a0 2020-06-12T17:49:57.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.210+0000 7f04d77fe700 1 --2- 172.21.15.38:0/2677802663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04d80602a0 0x7f04d813e860 secure :-1 s=THROTTLE_DONE pgs=586 cs=0 l=1 rx=0x7f04d00032b0 tx=0x7f04d00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:57.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.210+0000 7f04d77fe700 1 --2- 172.21.15.38:0/2677802663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04d80602a0 0x7f04d813e860 secure :-1 s=THROTTLE_DONE pgs=586 cs=0 l=1 rx=0x7f04d00032b0 tx=0x7f04d00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:57.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.210+0000 7f04c7fff700 1 -- 172.21.15.38:0/2677802663 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d0007f50 con 0x7f04d80602a0 2020-06-12T17:49:57.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.210+0000 7f04c7fff700 1 -- 172.21.15.38:0/2677802663 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04d000f7e0 con 0x7f04d80602a0 2020-06-12T17:49:57.232 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.210+0000 7f04dd834700 1 -- 172.21.15.38:0/2677802663 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d8152540 con 0x7f04d80602a0 2020-06-12T17:49:57.232 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.210+0000 7f04dd834700 1 -- 172.21.15.38:0/2677802663 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d8142340 con 0x7f04d80602a0 2020-06-12T17:49:57.232 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.211+0000 7f04d77fe700 1 --2- 172.21.15.38:0/2677802663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04d80602a0 0x7f04d813e860 secure :-1 s=THROTTLE_DONE pgs=586 cs=0 l=1 rx=0x7f04d00032b0 tx=0x7f04d00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:57.233 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.211+0000 7f04c7fff700 1 -- 172.21.15.38:0/2677802663 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f04d000fa20 con 0x7f04d80602a0 2020-06-12T17:49:57.233 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.211+0000 7f04d77fe700 1 --2- 172.21.15.38:0/2677802663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04d80602a0 0x7f04d813e860 secure :-1 s=THROTTLE_DONE pgs=586 cs=0 l=1 rx=0x7f04d00032b0 tx=0x7f04d00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:57.233 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.211+0000 7f04dd834700 1 -- 172.21.15.38:0/2677802663 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d8152990 con 0x7f04d80602a0 2020-06-12T17:49:57.234 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.211+0000 7f04c7fff700 1 --2- 172.21.15.38:0/2677802663 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f04b404d4f0 0x7f04b404f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:57.234 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.212+0000 7f04c7fff700 1 -- 172.21.15.38:0/2677802663 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f04d00618f0 con 0x7f04d80602a0 2020-06-12T17:49:57.234 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.212+0000 7f04d6ffd700 1 --2- 172.21.15.38:0/2677802663 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f04b404d4f0 0x7f04b404f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:57.235 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.212+0000 7f04d6ffd700 1 --2- 172.21.15.38:0/2677802663 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f04b404d4f0 0x7f04b404f9b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f04cc0013e0 tx=0x7f04d80b7710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:57.235 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.212+0000 7f04d6ffd700 1 --2- 172.21.15.38:0/2677802663 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f04b404d4f0 0x7f04b404f9b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f04cc0013e0 tx=0x7f04d80b7710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:57.236 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.212+0000 7f04d6ffd700 1 --2- 172.21.15.38:0/2677802663 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f04b404d4f0 0x7f04b404f9b0 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7f04cc0013e0 tx=0x7f04d80b7710).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:57.236 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.216+0000 7f04d77fe700 1 --2- 172.21.15.38:0/2677802663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04d80602a0 0x7f04d813e860 secure :-1 s=THROTTLE_DONE pgs=586 cs=0 l=1 rx=0x7f04d00032b0 tx=0x7f04d00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:57.236 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.216+0000 7f04c7fff700 1 -- 172.21.15.38:0/2677802663 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f04d003d0b0 con 0x7f04d80602a0 2020-06-12T17:49:57.414 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.410+0000 7f04dd834700 1 -- 172.21.15.38:0/2677802663 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_1257", "target": ["mon-mgr", ""]}) v1 -- 0x7f04d8056c30 con 0x7f04b404d4f0 2020-06-12T17:49:57.417 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.414+0000 7f04d6ffd700 1 --2- 172.21.15.38:0/2677802663 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f04b404d4f0 0x7f04b404f9b0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f04cc0013e0 tx=0x7f04d80b7710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:57.418 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.414+0000 7f04c7fff700 1 -- 172.21.15.38:0/2677802663 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f04d8056c30 con 0x7f04b404d4f0 2020-06-12T17:49:57.418 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_1257/5a19ed36-e0e1-463e-bc27-e95397e63319 2020-06-12T17:49:57.419 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.415+0000 7f04dd834700 1 -- 172.21.15.38:0/2677802663 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f04b404d4f0 msgr2=0x7f04b404f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:57.419 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.415+0000 7f04dd834700 1 --2- 172.21.15.38:0/2677802663 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f04b404d4f0 0x7f04b404f9b0 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7f04cc0013e0 tx=0x7f04d80b7710).stop 2020-06-12T17:49:57.420 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.415+0000 7f04dd834700 1 -- 172.21.15.38:0/2677802663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04d80602a0 msgr2=0x7f04d813e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:57.420 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.415+0000 7f04dd834700 1 --2- 172.21.15.38:0/2677802663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04d80602a0 0x7f04d813e860 secure :-1 s=READY pgs=586 cs=0 l=1 rx=0x7f04d00032b0 tx=0x7f04d00081e0).stop 2020-06-12T17:49:57.420 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.415+0000 7f04dd834700 1 -- 172.21.15.38:0/2677802663 shutdown_connections 2020-06-12T17:49:57.420 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.415+0000 7f04dd834700 1 --2- 172.21.15.38:0/2677802663 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f04b404d4f0 0x7f04b404f9b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:57.420 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.415+0000 7f04dd834700 1 --2- 172.21.15.38:0/2677802663 >> v2:172.21.15.150:3300/0 conn(0x7f04bc004a60 0x7f04d8152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:57.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.415+0000 7f04dd834700 1 --2- 172.21.15.38:0/2677802663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04d80602a0 0x7f04d813e860 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:57.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.415+0000 7f04dd834700 1 -- 172.21.15.38:0/2677802663 >> 172.21.15.38:0/2677802663 conn(0x7f04d80b94a0 msgr2=0x7f04d8063330 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:57.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.415+0000 7f04dd834700 1 -- 172.21.15.38:0/2677802663 shutdown_connections 2020-06-12T17:49:57.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:57.415+0000 7f04dd834700 1 -- 172.21.15.38:0/2677802663 wait complete. 2020-06-12T17:49:57.429 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_1257 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_1257/5a19ed36-e0e1-463e-bc27-e95397e63319 2020-06-12T17:49:57.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:57.430 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:57.431 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:57.446 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:57.446 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:57.447 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1257/5a19ed36-e0e1-463e-bc27-e95397e63319/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:57.536 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:57.537 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:57.537 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112299 s, 93.4 MB/s 2020-06-12T17:49:57.538 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:57.539 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:57.539 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:57.554 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:57.555 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:57.555 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1257/5a19ed36-e0e1-463e-bc27-e95397e63319/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:57.641 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:57.642 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:57.642 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100453 s, 104 MB/s 2020-06-12T17:49:57.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:57.644 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:57.644 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:57.659 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:57.660 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:57.660 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1257/5a19ed36-e0e1-463e-bc27-e95397e63319/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:57.751 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:57.751 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:57.751 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138318 s, 75.8 MB/s 2020-06-12T17:49:57.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:57.753 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:57.753 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:57.769 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:57.769 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:57.770 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1257/5a19ed36-e0e1-463e-bc27-e95397e63319/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:57.862 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:57.863 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:57.863 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152091 s, 68.9 MB/s 2020-06-12T17:49:57.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:57.864 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:57.865 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:57.881 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:57.882 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:57.882 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1257/5a19ed36-e0e1-463e-bc27-e95397e63319/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:57.971 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:57.971 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:57.971 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103569 s, 101 MB/s 2020-06-12T17:49:57.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:57.973 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:57.973 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:57.988 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:57.989 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:57.990 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1257/5a19ed36-e0e1-463e-bc27-e95397e63319/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:58.078 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:58.079 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:58.079 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108735 s, 96.4 MB/s 2020-06-12T17:49:58.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:58.081 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:58.081 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:58.098 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:58.098 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:58.099 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1257/5a19ed36-e0e1-463e-bc27-e95397e63319/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:58.184 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:58.185 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:58.185 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948564 s, 111 MB/s 2020-06-12T17:49:58.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:58.187 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:58.187 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:58.202 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:58.203 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:58.203 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1257/5a19ed36-e0e1-463e-bc27-e95397e63319/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:58.291 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:58.291 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:58.291 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116005 s, 90.4 MB/s 2020-06-12T17:49:58.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:58.293 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:58.293 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:58.308 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:58.309 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:58.309 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1257/5a19ed36-e0e1-463e-bc27-e95397e63319/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:58.403 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:58.404 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:58.405 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160764 s, 65.2 MB/s 2020-06-12T17:49:58.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:58.406 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:58.407 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:58.422 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:58.422 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:58.423 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1257/5a19ed36-e0e1-463e-bc27-e95397e63319/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:58.514 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:58.514 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:58.515 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156053 s, 67.2 MB/s 2020-06-12T17:49:58.516 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_7720 2020-06-12T17:49:58.635 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.629+0000 7fd50d9fb700 1 Processor -- start 2020-06-12T17:49:58.635 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.629+0000 7fd50d9fb700 1 -- start start 2020-06-12T17:49:58.635 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.630+0000 7fd50d9fb700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd50809df00 0x7fd50813c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:58.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.630+0000 7fd50d9fb700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd50809b960 con 0x7fd508142e90 2020-06-12T17:49:58.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.630+0000 7fd50d9fb700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd50809bc00 con 0x7fd5080b3ac0 2020-06-12T17:49:58.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.630+0000 7fd50d9fb700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd508143270 con 0x7fd50809df00 2020-06-12T17:49:58.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.630+0000 7fd5067fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd50809df00 0x7fd50813c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:58.636 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.630+0000 7fd5067fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd50809df00 0x7fd50813c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38290/0 (socket says 172.21.15.38:38290) 2020-06-12T17:49:58.637 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.630+0000 7fd5077fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd508142e90 0x7fd508066790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40106/0 (socket says 172.21.15.38:40106) 2020-06-12T17:49:58.637 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.630+0000 7fd5067fc700 1 -- 172.21.15.38:0/3340140715 learned_addr learned my addr 172.21.15.38:0/3340140715 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:58.637 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.630+0000 7fd5067fc700 1 -- 172.21.15.38:0/3340140715 >> v1:172.21.15.150:6789/0 conn(0x7fd5080b3ac0 legacy=0x7fd50813bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:58.637 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.630+0000 7fd5067fc700 1 -- 172.21.15.38:0/3340140715 >> v1:172.21.15.38:6789/0 conn(0x7fd508142e90 legacy=0x7fd508066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:58.637 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.630+0000 7fd505ffb700 1 -- 172.21.15.38:0/3340140715 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836698910 0 0) 0x7fd50809b960 con 0x7fd508142e90 2020-06-12T17:49:58.638 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.630+0000 7fd5067fc700 1 -- 172.21.15.38:0/3340140715 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5080b48f0 con 0x7fd50809df00 2020-06-12T17:49:58.638 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.630+0000 7fd5067fc700 1 --2- 172.21.15.38:0/3340140715 >> v2:172.21.15.38:3300/0 conn(0x7fd50809df00 0x7fd50813c650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd4f8002f30 tx=0x7fd4f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:58.638 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.630+0000 7fd5067fc700 1 --2- 172.21.15.38:0/3340140715 >> v2:172.21.15.38:3300/0 conn(0x7fd50809df00 0x7fd50813c650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd4f8002f30 tx=0x7fd4f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:58.638 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.631+0000 7fd5067fc700 1 --2- 172.21.15.38:0/3340140715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd50809df00 0x7fd50813c650 secure :-1 s=READY pgs=588 cs=0 l=1 rx=0x7fd4f8002f30 tx=0x7fd4f8007e60).ready entity=mon.0 client_cookie=7242f7814c069aa server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:58.638 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.631+0000 7fd5067fc700 1 --2- 172.21.15.38:0/3340140715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd50809df00 0x7fd50813c650 secure :-1 s=THROTTLE_DONE pgs=588 cs=0 l=1 rx=0x7fd4f8002f30 tx=0x7fd4f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:58.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.631+0000 7fd505ffb700 1 -- 172.21.15.38:0/3340140715 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4f8009e40 con 0x7fd50809df00 2020-06-12T17:49:58.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.631+0000 7fd5067fc700 1 --2- 172.21.15.38:0/3340140715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd50809df00 0x7fd50813c650 secure :-1 s=THROTTLE_DONE pgs=588 cs=0 l=1 rx=0x7fd4f8002f30 tx=0x7fd4f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:58.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.631+0000 7fd505ffb700 1 -- 172.21.15.38:0/3340140715 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f80129e0 con 0x7fd50809df00 2020-06-12T17:49:58.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.631+0000 7fd5067fc700 1 --2- 172.21.15.38:0/3340140715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd50809df00 0x7fd50813c650 secure :-1 s=THROTTLE_DONE pgs=588 cs=0 l=1 rx=0x7fd4f8002f30 tx=0x7fd4f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:58.639 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.631+0000 7fd505ffb700 1 -- 172.21.15.38:0/3340140715 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4f8012d80 con 0x7fd50809df00 2020-06-12T17:49:58.642 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.631+0000 7fd50d9fb700 1 -- 172.21.15.38:0/3340140715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd50809df00 msgr2=0x7fd50813c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:58.642 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.631+0000 7fd50d9fb700 1 --2- 172.21.15.38:0/3340140715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd50809df00 0x7fd50813c650 secure :-1 s=READY pgs=588 cs=0 l=1 rx=0x7fd4f8002f30 tx=0x7fd4f8007e60).stop 2020-06-12T17:49:58.643 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.631+0000 7fd50d9fb700 1 -- 172.21.15.38:0/3340140715 shutdown_connections 2020-06-12T17:49:58.643 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.631+0000 7fd50d9fb700 1 --2- 172.21.15.38:0/3340140715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd50809df00 0x7fd50813c650 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:58.643 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.631+0000 7fd50d9fb700 1 -- 172.21.15.38:0/3340140715 >> 172.21.15.38:0/3340140715 conn(0x7fd5080b5a20 msgr2=0x7fd50805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:58.643 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.631+0000 7fd50d9fb700 1 -- 172.21.15.38:0/3340140715 shutdown_connections 2020-06-12T17:49:58.643 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.631+0000 7fd50d9fb700 1 -- 172.21.15.38:0/3340140715 wait complete. 2020-06-12T17:49:58.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.632+0000 7fd50d9fb700 1 Processor -- start 2020-06-12T17:49:58.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.632+0000 7fd50d9fb700 1 -- start start 2020-06-12T17:49:58.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.633+0000 7fd50d9fb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd50809df00 0x7fd508140e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:58.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.633+0000 7fd50d9fb700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd508142e90 0x7fd50813c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:58.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.633+0000 7fd50d9fb700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd508154ea0 con 0x7fd5080b3ac0 2020-06-12T17:49:58.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.633+0000 7fd50d9fb700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd508063270 con 0x7fd508142e90 2020-06-12T17:49:58.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.633+0000 7fd50d9fb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd508155140 con 0x7fd50809df00 2020-06-12T17:49:58.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.633+0000 7fd5077fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd508142e90 0x7fd50813c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:58.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.633+0000 7fd5067fc700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd5080b3ac0 0x7fd50813bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40110/0 (socket says 172.21.15.38:40110) 2020-06-12T17:49:58.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.633+0000 7fd5077fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd508142e90 0x7fd50813c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38298/0 (socket says 172.21.15.38:38298) 2020-06-12T17:49:58.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.633+0000 7fd5067fc700 1 -- 172.21.15.38:0/659168151 learned_addr learned my addr 172.21.15.38:0/659168151 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:49:58.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.633+0000 7fd506ffd700 1 --2- 172.21.15.38:0/659168151 >> v2:172.21.15.150:3300/0 conn(0x7fd50809df00 0x7fd508140e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:58.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.633+0000 7fd5077fe700 1 -- 172.21.15.38:0/659168151 >> v2:172.21.15.150:3300/0 conn(0x7fd50809df00 msgr2=0x7fd508140e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:58.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.633+0000 7fd4f7fff700 1 -- 172.21.15.38:0/659168151 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678975073 0 0) 0x7fd508154ea0 con 0x7fd5080b3ac0 2020-06-12T17:49:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.633+0000 7fd5077fe700 1 --2- 172.21.15.38:0/659168151 >> v2:172.21.15.150:3300/0 conn(0x7fd50809df00 0x7fd508140e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.633+0000 7fd5077fe700 1 -- 172.21.15.38:0/659168151 >> v1:172.21.15.38:6789/0 conn(0x7fd5080b3ac0 legacy=0x7fd50813bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.633+0000 7fd5077fe700 1 -- 172.21.15.38:0/659168151 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5081553e0 con 0x7fd508142e90 2020-06-12T17:49:58.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.633+0000 7fd5077fe700 1 --2- 172.21.15.38:0/659168151 >> v2:172.21.15.38:3300/0 conn(0x7fd508142e90 0x7fd50813c650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd500001210 tx=0x7fd500001a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:58.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.633+0000 7fd5077fe700 1 --2- 172.21.15.38:0/659168151 >> v2:172.21.15.38:3300/0 conn(0x7fd508142e90 0x7fd50813c650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd500001210 tx=0x7fd500001a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:58.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.633+0000 7fd5077fe700 1 --2- 172.21.15.38:0/659168151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd508142e90 0x7fd50813c650 secure :-1 s=READY pgs=590 cs=0 l=1 rx=0x7fd500001210 tx=0x7fd500001a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:58.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.634+0000 7fd5077fe700 1 --2- 172.21.15.38:0/659168151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd508142e90 0x7fd50813c650 secure :-1 s=THROTTLE_DONE pgs=590 cs=0 l=1 rx=0x7fd500001210 tx=0x7fd500001a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:58.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.634+0000 7fd4f7fff700 1 -- 172.21.15.38:0/659168151 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd500004c50 con 0x7fd508142e90 2020-06-12T17:49:58.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.634+0000 7fd5077fe700 1 --2- 172.21.15.38:0/659168151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd508142e90 0x7fd50813c650 secure :-1 s=THROTTLE_DONE pgs=590 cs=0 l=1 rx=0x7fd500001210 tx=0x7fd500001a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:58.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.634+0000 7fd50d9fb700 1 -- 172.21.15.38:0/659168151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5080b1cd0 con 0x7fd508142e90 2020-06-12T17:49:58.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.634+0000 7fd4f7fff700 1 -- 172.21.15.38:0/659168151 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd500004db0 con 0x7fd508142e90 2020-06-12T17:49:58.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.634+0000 7fd5077fe700 1 --2- 172.21.15.38:0/659168151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd508142e90 0x7fd50813c650 secure :-1 s=THROTTLE_DONE pgs=590 cs=0 l=1 rx=0x7fd500001210 tx=0x7fd500001a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:58.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.634+0000 7fd4f7fff700 1 -- 172.21.15.38:0/659168151 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5000127a0 con 0x7fd508142e90 2020-06-12T17:49:58.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.634+0000 7fd50d9fb700 1 -- 172.21.15.38:0/659168151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd508154a70 con 0x7fd508142e90 2020-06-12T17:49:58.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.634+0000 7fd5077fe700 1 --2- 172.21.15.38:0/659168151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd508142e90 0x7fd50813c650 secure :-1 s=THROTTLE_DONE pgs=590 cs=0 l=1 rx=0x7fd500001210 tx=0x7fd500001a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:58.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.635+0000 7fd50d9fb700 1 -- 172.21.15.38:0/659168151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd508155570 con 0x7fd508142e90 2020-06-12T17:49:58.655 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.635+0000 7fd4f7fff700 1 -- 172.21.15.38:0/659168151 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fd500012a20 con 0x7fd508142e90 2020-06-12T17:49:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.635+0000 7fd5077fe700 1 --2- 172.21.15.38:0/659168151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd508142e90 0x7fd50813c650 secure :-1 s=THROTTLE_DONE pgs=590 cs=0 l=1 rx=0x7fd500001210 tx=0x7fd500001a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.635+0000 7fd4f7fff700 1 --2- 172.21.15.38:0/659168151 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd4e404d3a0 0x7fd4e404f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.635+0000 7fd4f7fff700 1 -- 172.21.15.38:0/659168151 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd500061340 con 0x7fd508142e90 2020-06-12T17:49:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.635+0000 7fd506ffd700 1 --2- 172.21.15.38:0/659168151 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd4e404d3a0 0x7fd4e404f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.635+0000 7fd506ffd700 1 --2- 172.21.15.38:0/659168151 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd4e404d3a0 0x7fd4e404f860 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd50813cb40 tx=0x7fd4fc001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:58.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.636+0000 7fd506ffd700 1 --2- 172.21.15.38:0/659168151 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd4e404d3a0 0x7fd4e404f860 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd50813cb40 tx=0x7fd4fc001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:58.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.636+0000 7fd506ffd700 1 --2- 172.21.15.38:0/659168151 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd4e404d3a0 0x7fd4e404f860 secure :-1 s=READY pgs=232 cs=0 l=1 rx=0x7fd50813cb40 tx=0x7fd4fc001400).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:58.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.638+0000 7fd5077fe700 1 --2- 172.21.15.38:0/659168151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd508142e90 0x7fd50813c650 secure :-1 s=THROTTLE_DONE pgs=590 cs=0 l=1 rx=0x7fd500001210 tx=0x7fd500001a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:58.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.638+0000 7fd4f7fff700 1 -- 172.21.15.38:0/659168151 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fd50003ca40 con 0x7fd508142e90 2020-06-12T17:49:58.835 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.832+0000 7fd50d9fb700 1 -- 172.21.15.38:0/659168151 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_7720", "target": ["mon-mgr", ""]}) v1 -- 0x7fd508056c30 con 0x7fd4e404d3a0 2020-06-12T17:49:58.855 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.852+0000 7fd506ffd700 1 --2- 172.21.15.38:0/659168151 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd4e404d3a0 0x7fd4e404f860 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7fd50813cb40 tx=0x7fd4fc001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:58.856 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.852+0000 7fd4f7fff700 1 -- 172.21.15.38:0/659168151 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd508056c30 con 0x7fd4e404d3a0 2020-06-12T17:49:58.857 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.853+0000 7fd50d9fb700 1 -- 172.21.15.38:0/659168151 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd4e404d3a0 msgr2=0x7fd4e404f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:58.857 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.853+0000 7fd50d9fb700 1 --2- 172.21.15.38:0/659168151 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd4e404d3a0 0x7fd4e404f860 secure :-1 s=READY pgs=232 cs=0 l=1 rx=0x7fd50813cb40 tx=0x7fd4fc001400).stop 2020-06-12T17:49:58.858 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.853+0000 7fd50d9fb700 1 -- 172.21.15.38:0/659168151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd508142e90 msgr2=0x7fd50813c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:58.858 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.853+0000 7fd50d9fb700 1 --2- 172.21.15.38:0/659168151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd508142e90 0x7fd50813c650 secure :-1 s=READY pgs=590 cs=0 l=1 rx=0x7fd500001210 tx=0x7fd500001a00).stop 2020-06-12T17:49:58.858 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.853+0000 7fd50d9fb700 1 -- 172.21.15.38:0/659168151 shutdown_connections 2020-06-12T17:49:58.858 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.853+0000 7fd50d9fb700 1 --2- 172.21.15.38:0/659168151 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd4e404d3a0 0x7fd4e404f860 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:58.858 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.853+0000 7fd50d9fb700 1 --2- 172.21.15.38:0/659168151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd508142e90 0x7fd50813c650 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:58.859 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.853+0000 7fd50d9fb700 1 --2- 172.21.15.38:0/659168151 >> v2:172.21.15.150:3300/0 conn(0x7fd50809df00 0x7fd508140e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:58.859 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.853+0000 7fd50d9fb700 1 -- 172.21.15.38:0/659168151 >> 172.21.15.38:0/659168151 conn(0x7fd5080b5a20 msgr2=0x7fd50809cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:58.859 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.854+0000 7fd50d9fb700 1 -- 172.21.15.38:0/659168151 shutdown_connections 2020-06-12T17:49:58.859 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.854+0000 7fd50d9fb700 1 -- 172.21.15.38:0/659168151 wait complete. 2020-06-12T17:49:58.868 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_7720 2020-06-12T17:49:58.986 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.982+0000 7fe25548f700 1 Processor -- start 2020-06-12T17:49:58.986 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.982+0000 7fe25548f700 1 -- start start 2020-06-12T17:49:58.989 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.983+0000 7fe25548f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe25005b5e0 0x7fe2500b9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:58.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.983+0000 7fe25548f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2500b73a0 0x7fe2501461a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:49:58.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.983+0000 7fe25548f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe25014a100 con 0x7fe25005b9c0 2020-06-12T17:49:58.991 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.983+0000 7fe25548f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe25014a3a0 con 0x7fe25005b5e0 2020-06-12T17:49:58.993 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.983+0000 7fe25548f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2500b8400 con 0x7fe2500b73a0 2020-06-12T17:49:58.993 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.984+0000 7fe24f7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2500b73a0 0x7fe2501461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:58.994 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.984+0000 7fe24effd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe25005b5e0 0x7fe2500b9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:58.994 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.984+0000 7fe24effd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe25005b5e0 0x7fe2500b9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:47778/0 (socket says 172.21.15.38:47778) 2020-06-12T17:49:58.994 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.984+0000 7fe24effd700 1 -- 172.21.15.38:0/2384692830 learned_addr learned my addr 172.21.15.38:0/2384692830 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:58.994 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.984+0000 7fe24effd700 1 -- 172.21.15.38:0/2384692830 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2500b73a0 msgr2=0x7fe2501461a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:49:58.994 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.984+0000 7fe24effd700 1 --2- 172.21.15.38:0/2384692830 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2500b73a0 0x7fe2501461a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:58.995 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.984+0000 7fe24effd700 1 -- 172.21.15.38:0/2384692830 >> v1:172.21.15.150:6789/0 conn(0x7fe25005b9c0 legacy=0x7fe2500b7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:58.995 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.984+0000 7fe24effd700 1 -- 172.21.15.38:0/2384692830 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25009db70 con 0x7fe25005b5e0 2020-06-12T17:49:58.995 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.984+0000 7fe24dffb700 1 -- 172.21.15.38:0/2384692830 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4245822732 0 0) 0x7fe25014a100 con 0x7fe25005b9c0 2020-06-12T17:49:58.995 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.984+0000 7fe24f7fe700 1 --2- 172.21.15.38:0/2384692830 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2500b73a0 0x7fe2501461a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:49:58.995 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.984+0000 7fe24effd700 1 --2- 172.21.15.38:0/2384692830 >> v2:172.21.15.150:3300/0 conn(0x7fe25005b5e0 0x7fe2500b9030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe244002f30 tx=0x7fe244007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:58.996 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.984+0000 7fe24effd700 1 --2- 172.21.15.38:0/2384692830 >> v2:172.21.15.150:3300/0 conn(0x7fe25005b5e0 0x7fe2500b9030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe244002f30 tx=0x7fe244007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:58.996 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.984+0000 7fe24effd700 1 --2- 172.21.15.38:0/2384692830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe25005b5e0 0x7fe2500b9030 secure :-1 s=READY pgs=343 cs=0 l=1 rx=0x7fe244002f30 tx=0x7fe244007e60).ready entity=mon.1 client_cookie=776cb247a4a8238f server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:58.996 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.984+0000 7fe24effd700 1 --2- 172.21.15.38:0/2384692830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe25005b5e0 0x7fe2500b9030 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7fe244002f30 tx=0x7fe244007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:58.996 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.984+0000 7fe24dffb700 1 -- 172.21.15.38:0/2384692830 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe244011630 con 0x7fe25005b5e0 2020-06-12T17:49:58.996 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.984+0000 7fe24effd700 1 --2- 172.21.15.38:0/2384692830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe25005b5e0 0x7fe2500b9030 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7fe244002f30 tx=0x7fe244007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:58.996 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.984+0000 7fe24effd700 1 --2- 172.21.15.38:0/2384692830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe25005b5e0 0x7fe2500b9030 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7fe244002f30 tx=0x7fe244007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:58.997 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.984+0000 7fe24dffb700 1 -- 172.21.15.38:0/2384692830 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe244011790 con 0x7fe25005b5e0 2020-06-12T17:49:58.997 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.984+0000 7fe24dffb700 1 -- 172.21.15.38:0/2384692830 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe244011b70 con 0x7fe25005b5e0 2020-06-12T17:49:58.997 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.984+0000 7fe25548f700 1 -- 172.21.15.38:0/2384692830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe25005b5e0 msgr2=0x7fe2500b9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:58.997 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.984+0000 7fe25548f700 1 --2- 172.21.15.38:0/2384692830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe25005b5e0 0x7fe2500b9030 secure :-1 s=READY pgs=343 cs=0 l=1 rx=0x7fe244002f30 tx=0x7fe244007e60).stop 2020-06-12T17:49:58.997 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.985+0000 7fe25548f700 1 -- 172.21.15.38:0/2384692830 shutdown_connections 2020-06-12T17:49:58.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.985+0000 7fe25548f700 1 --2- 172.21.15.38:0/2384692830 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2500b73a0 0x7fe2501461a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:49:58.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.985+0000 7fe25548f700 1 --2- 172.21.15.38:0/2384692830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe25005b5e0 0x7fe2500b9030 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:58.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.985+0000 7fe25548f700 1 -- 172.21.15.38:0/2384692830 >> 172.21.15.38:0/2384692830 conn(0x7fe2500b94a0 msgr2=0x7fe2500b98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:58.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.985+0000 7fe25548f700 1 -- 172.21.15.38:0/2384692830 shutdown_connections 2020-06-12T17:49:58.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.985+0000 7fe25548f700 1 -- 172.21.15.38:0/2384692830 wait complete. 2020-06-12T17:49:58.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.986+0000 7fe25548f700 1 Processor -- start 2020-06-12T17:49:58.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.986+0000 7fe25548f700 1 -- start start 2020-06-12T17:49:59.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.987+0000 7fe25548f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe25005b5e0 0x7fe2501457f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:59.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.987+0000 7fe25548f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2500b73a0 0x7fe25013cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:59.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.987+0000 7fe25548f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe250153d40 con 0x7fe25005b9c0 2020-06-12T17:49:59.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.987+0000 7fe25548f700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe250153fe0 con 0x7fe25005b5e0 2020-06-12T17:49:59.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.987+0000 7fe25548f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe250154280 con 0x7fe2500b73a0 2020-06-12T17:49:59.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.987+0000 7fe24effd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe25005b5e0 0x7fe2501457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:59.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.987+0000 7fe24effd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe25005b5e0 0x7fe2501457f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38306/0 (socket says 172.21.15.38:38306) 2020-06-12T17:49:59.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.987+0000 7fe24effd700 1 -- 172.21.15.38:0/3944233951 learned_addr learned my addr 172.21.15.38:0/3944233951 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:49:59.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.987+0000 7fe24f7fe700 1 --2- 172.21.15.38:0/3944233951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2500b73a0 0x7fe25013cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:59.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.987+0000 7fe24effd700 1 -- 172.21.15.38:0/3944233951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2500b73a0 msgr2=0x7fe25013cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:59.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.987+0000 7fe24effd700 1 --2- 172.21.15.38:0/3944233951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2500b73a0 0x7fe25013cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:59.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.987+0000 7fe24effd700 1 -- 172.21.15.38:0/3944233951 >> v1:172.21.15.150:6789/0 conn(0x7fe25005b9c0 legacy=0x7fe25013c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:59.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.987+0000 7fe24effd700 1 -- 172.21.15.38:0/3944233951 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe250141b70 con 0x7fe25005b5e0 2020-06-12T17:49:59.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.987+0000 7fe24effd700 1 --2- 172.21.15.38:0/3944233951 >> v2:172.21.15.38:3300/0 conn(0x7fe25005b5e0 0x7fe2501457f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe244002f30 tx=0x7fe244007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:59.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.987+0000 7fe24effd700 1 --2- 172.21.15.38:0/3944233951 >> v2:172.21.15.38:3300/0 conn(0x7fe25005b5e0 0x7fe2501457f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe244002f30 tx=0x7fe244007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:59.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.987+0000 7fe24effd700 1 --2- 172.21.15.38:0/3944233951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe25005b5e0 0x7fe2501457f0 secure :-1 s=READY pgs=591 cs=0 l=1 rx=0x7fe244002f30 tx=0x7fe244007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:59.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.987+0000 7fe24effd700 1 --2- 172.21.15.38:0/3944233951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe25005b5e0 0x7fe2501457f0 secure :-1 s=THROTTLE_DONE pgs=591 cs=0 l=1 rx=0x7fe244002f30 tx=0x7fe244007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:59.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.987+0000 7fe23ffff700 1 -- 172.21.15.38:0/3944233951 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe244011be0 con 0x7fe25005b5e0 2020-06-12T17:49:59.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.987+0000 7fe24effd700 1 --2- 172.21.15.38:0/3944233951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe25005b5e0 0x7fe2501457f0 secure :-1 s=THROTTLE_DONE pgs=591 cs=0 l=1 rx=0x7fe244002f30 tx=0x7fe244007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:59.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.987+0000 7fe24effd700 1 --2- 172.21.15.38:0/3944233951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe25005b5e0 0x7fe2501457f0 secure :-1 s=THROTTLE_DONE pgs=591 cs=0 l=1 rx=0x7fe244002f30 tx=0x7fe244007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:59.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.987+0000 7fe23ffff700 1 -- 172.21.15.38:0/3944233951 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe244007150 con 0x7fe25005b5e0 2020-06-12T17:49:59.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.987+0000 7fe25548f700 1 -- 172.21.15.38:0/3944233951 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe250141dc0 con 0x7fe25005b5e0 2020-06-12T17:49:59.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.987+0000 7fe23ffff700 1 -- 172.21.15.38:0/3944233951 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe244007530 con 0x7fe25005b5e0 2020-06-12T17:49:59.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.987+0000 7fe25548f700 1 -- 172.21.15.38:0/3944233951 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25013eb50 con 0x7fe25005b5e0 2020-06-12T17:49:59.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.988+0000 7fe24effd700 1 --2- 172.21.15.38:0/3944233951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe25005b5e0 0x7fe2501457f0 secure :-1 s=THROTTLE_DONE pgs=591 cs=0 l=1 rx=0x7fe244002f30 tx=0x7fe244007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:59.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.988+0000 7fe25548f700 1 -- 172.21.15.38:0/3944233951 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe250056c30 con 0x7fe25005b5e0 2020-06-12T17:49:59.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.988+0000 7fe23ffff700 1 -- 172.21.15.38:0/3944233951 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fe2440056c0 con 0x7fe25005b5e0 2020-06-12T17:49:59.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.989+0000 7fe24effd700 1 --2- 172.21.15.38:0/3944233951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe25005b5e0 0x7fe2501457f0 secure :-1 s=THROTTLE_DONE pgs=591 cs=0 l=1 rx=0x7fe244002f30 tx=0x7fe244007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:59.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.989+0000 7fe23ffff700 1 --2- 172.21.15.38:0/3944233951 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe22c04d6a0 0x7fe22c04fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:49:59.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.989+0000 7fe23ffff700 1 -- 172.21.15.38:0/3944233951 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe244061080 con 0x7fe25005b5e0 2020-06-12T17:49:59.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.989+0000 7fe24e7fc700 1 --2- 172.21.15.38:0/3944233951 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe22c04d6a0 0x7fe22c04fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:49:59.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.989+0000 7fe24e7fc700 1 --2- 172.21.15.38:0/3944233951 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe22c04d6a0 0x7fe22c04fb60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe25013f090 tx=0x7fe2400024b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:59.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.989+0000 7fe24e7fc700 1 --2- 172.21.15.38:0/3944233951 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe22c04d6a0 0x7fe22c04fb60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe25013f090 tx=0x7fe2400024b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:59.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.989+0000 7fe24e7fc700 1 --2- 172.21.15.38:0/3944233951 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe22c04d6a0 0x7fe22c04fb60 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7fe25013f090 tx=0x7fe2400024b0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:49:59.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.992+0000 7fe24effd700 1 --2- 172.21.15.38:0/3944233951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe25005b5e0 0x7fe2501457f0 secure :-1 s=THROTTLE_DONE pgs=591 cs=0 l=1 rx=0x7fe244002f30 tx=0x7fe244007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:59.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:58.992+0000 7fe23ffff700 1 -- 172.21.15.38:0/3944233951 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fe24403c840 con 0x7fe25005b5e0 2020-06-12T17:49:59.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:59.185+0000 7fe25548f700 1 -- 172.21.15.38:0/3944233951 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_7720", "target": ["mon-mgr", ""]}) v1 -- 0x7fe250141dc0 con 0x7fe22c04d6a0 2020-06-12T17:49:59.192 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:59.188+0000 7fe24e7fc700 1 --2- 172.21.15.38:0/3944233951 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe22c04d6a0 0x7fe22c04fb60 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7fe25013f090 tx=0x7fe2400024b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:49:59.192 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:59.188+0000 7fe23ffff700 1 -- 172.21.15.38:0/3944233951 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7fe250141dc0 con 0x7fe22c04d6a0 2020-06-12T17:49:59.192 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_7720/3242537b-9091-4a40-ade2-169ba7143845 2020-06-12T17:49:59.194 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:59.190+0000 7fe25548f700 1 -- 172.21.15.38:0/3944233951 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe22c04d6a0 msgr2=0x7fe22c04fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:59.194 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:59.190+0000 7fe25548f700 1 --2- 172.21.15.38:0/3944233951 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe22c04d6a0 0x7fe22c04fb60 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7fe25013f090 tx=0x7fe2400024b0).stop 2020-06-12T17:49:59.194 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:59.190+0000 7fe25548f700 1 -- 172.21.15.38:0/3944233951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe25005b5e0 msgr2=0x7fe2501457f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:49:59.194 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:59.190+0000 7fe25548f700 1 --2- 172.21.15.38:0/3944233951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe25005b5e0 0x7fe2501457f0 secure :-1 s=READY pgs=591 cs=0 l=1 rx=0x7fe244002f30 tx=0x7fe244007e60).stop 2020-06-12T17:49:59.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:59.190+0000 7fe25548f700 1 -- 172.21.15.38:0/3944233951 shutdown_connections 2020-06-12T17:49:59.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:59.190+0000 7fe25548f700 1 --2- 172.21.15.38:0/3944233951 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe22c04d6a0 0x7fe22c04fb60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:59.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:59.190+0000 7fe25548f700 1 --2- 172.21.15.38:0/3944233951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2500b73a0 0x7fe25013cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:59.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:59.190+0000 7fe25548f700 1 --2- 172.21.15.38:0/3944233951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe25005b5e0 0x7fe2501457f0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:49:59.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:59.190+0000 7fe25548f700 1 -- 172.21.15.38:0/3944233951 >> 172.21.15.38:0/3944233951 conn(0x7fe2500b94a0 msgr2=0x7fe25009c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:49:59.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:59.190+0000 7fe25548f700 1 -- 172.21.15.38:0/3944233951 shutdown_connections 2020-06-12T17:49:59.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:49:59.190+0000 7fe25548f700 1 -- 172.21.15.38:0/3944233951 wait complete. 2020-06-12T17:49:59.203 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_7720 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_7720/3242537b-9091-4a40-ade2-169ba7143845 2020-06-12T17:49:59.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:59.205 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:59.205 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:59.222 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:59.223 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:59.223 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7720/3242537b-9091-4a40-ade2-169ba7143845/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:59.312 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:59.312 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:59.313 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104721 s, 100 MB/s 2020-06-12T17:49:59.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:59.314 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:59.315 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:59.331 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:59.332 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:59.333 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7720/3242537b-9091-4a40-ade2-169ba7143845/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:59.419 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:59.419 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:59.419 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010867 s, 96.5 MB/s 2020-06-12T17:49:59.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:59.421 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:59.421 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:59.436 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:59.437 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:59.437 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7720/3242537b-9091-4a40-ade2-169ba7143845/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:59.524 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:59.524 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:59.524 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115313 s, 90.9 MB/s 2020-06-12T17:49:59.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:59.526 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:59.526 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:59.541 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:59.542 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:59.542 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7720/3242537b-9091-4a40-ade2-169ba7143845/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:59.644 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:59.644 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:59.645 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108344 s, 96.8 MB/s 2020-06-12T17:49:59.646 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:59.646 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:59.647 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:59.662 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:59.662 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:59.663 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7720/3242537b-9091-4a40-ade2-169ba7143845/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:59.750 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:59.750 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:59.750 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106237 s, 98.7 MB/s 2020-06-12T17:49:59.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:59.752 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:59.752 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:59.769 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:59.770 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:59.770 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7720/3242537b-9091-4a40-ade2-169ba7143845/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:59.860 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:59.860 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:59.861 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00901316 s, 116 MB/s 2020-06-12T17:49:59.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:59.862 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:59.863 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:59.878 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:59.879 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:59.879 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7720/3242537b-9091-4a40-ade2-169ba7143845/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:49:59.969 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:49:59.970 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:49:59.970 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100451 s, 104 MB/s 2020-06-12T17:49:59.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:49:59.971 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:49:59.972 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:49:59.994 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:49:59.994 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:49:59.995 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7720/3242537b-9091-4a40-ade2-169ba7143845/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:00.083 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:00.083 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:00.084 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101414 s, 103 MB/s 2020-06-12T17:50:00.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:00.085 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:00.086 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:00.101 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:00.102 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:00.102 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7720/3242537b-9091-4a40-ade2-169ba7143845/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:00.190 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:00.191 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:00.191 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117292 s, 89.4 MB/s 2020-06-12T17:50:00.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:00.192 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:00.193 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:00.208 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:00.209 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:00.209 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7720/3242537b-9091-4a40-ade2-169ba7143845/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:00.298 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:00.299 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:00.299 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132157 s, 79.3 MB/s 2020-06-12T17:50:00.300 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_583 2020-06-12T17:50:00.418 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.415+0000 7fe535d6f700 1 Processor -- start 2020-06-12T17:50:00.419 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.415+0000 7fe535d6f700 1 -- start start 2020-06-12T17:50:00.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.416+0000 7fe535d6f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5300ad5b0 0x7fe5300b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:00.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.416+0000 7fe535d6f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe53009d8d0 0x7fe5301421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:00.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.416+0000 7fe535d6f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe530146d20 con 0x7fe530146680 2020-06-12T17:50:00.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.416+0000 7fe535d6f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe530066a80 con 0x7fe53009d8d0 2020-06-12T17:50:00.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.416+0000 7fe535d6f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe530146f50 con 0x7fe5300ad5b0 2020-06-12T17:50:00.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.416+0000 7fe52effd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5300ad5b0 0x7fe5300b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:00.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.416+0000 7fe52ffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe53009d8d0 0x7fe5301421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:00.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.416+0000 7fe52effd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5300ad5b0 0x7fe5300b2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:57772/0 (socket says 172.21.15.38:57772) 2020-06-12T17:50:00.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.416+0000 7fe52effd700 1 -- 172.21.15.38:0/2847491858 learned_addr learned my addr 172.21.15.38:0/2847491858 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:00.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.416+0000 7fe52ffff700 1 --2- 172.21.15.38:0/2847491858 >> v2:172.21.15.150:3300/0 conn(0x7fe53009d8d0 0x7fe5301421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:47790/0 (socket says 172.21.15.38:47790) 2020-06-12T17:50:00.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.416+0000 7fe52f7fe700 1 --1- 172.21.15.38:0/2847491858 >> v1:172.21.15.150:6789/0 conn(0x7fe530146680 0x7fe53009d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:60862/0 (socket says 172.21.15.38:60862) 2020-06-12T17:50:00.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.416+0000 7fe52effd700 1 -- 172.21.15.38:0/2847491858 >> v2:172.21.15.150:3300/0 conn(0x7fe53009d8d0 msgr2=0x7fe5301421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:00.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.416+0000 7fe52effd700 1 --2- 172.21.15.38:0/2847491858 >> v2:172.21.15.150:3300/0 conn(0x7fe53009d8d0 0x7fe5301421d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:00.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.416+0000 7fe52effd700 1 -- 172.21.15.38:0/2847491858 >> v1:172.21.15.150:6789/0 conn(0x7fe530146680 legacy=0x7fe53009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:00.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.416+0000 7fe52effd700 1 -- 172.21.15.38:0/2847491858 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe530146a60 con 0x7fe5300ad5b0 2020-06-12T17:50:00.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.416+0000 7fe52ffff700 1 --2- 172.21.15.38:0/2847491858 >> v2:172.21.15.150:3300/0 conn(0x7fe53009d8d0 0x7fe5301421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:50:00.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.416+0000 7fe52effd700 1 --2- 172.21.15.38:0/2847491858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5300ad5b0 0x7fe5300b2eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe524002f30 tx=0x7fe524007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.417+0000 7fe52effd700 1 --2- 172.21.15.38:0/2847491858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5300ad5b0 0x7fe5300b2eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe524002f30 tx=0x7fe524007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.425 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.417+0000 7fe52effd700 1 --2- 172.21.15.38:0/2847491858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5300ad5b0 0x7fe5300b2eb0 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7fe524002f30 tx=0x7fe524007e60).ready entity=mon.2 client_cookie=4c3853695af86dc7 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:00.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.417+0000 7fe52effd700 1 --2- 172.21.15.38:0/2847491858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5300ad5b0 0x7fe5300b2eb0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fe524002f30 tx=0x7fe524007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.417+0000 7fe52e7fc700 1 -- 172.21.15.38:0/2847491858 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe524013d30 con 0x7fe5300ad5b0 2020-06-12T17:50:00.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.417+0000 7fe52effd700 1 --2- 172.21.15.38:0/2847491858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5300ad5b0 0x7fe5300b2eb0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fe524002f30 tx=0x7fe524007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.417+0000 7fe52e7fc700 1 -- 172.21.15.38:0/2847491858 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe524013e90 con 0x7fe5300ad5b0 2020-06-12T17:50:00.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.417+0000 7fe52effd700 1 --2- 172.21.15.38:0/2847491858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5300ad5b0 0x7fe5300b2eb0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fe524002f30 tx=0x7fe524007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.417+0000 7fe52e7fc700 1 -- 172.21.15.38:0/2847491858 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe52400c350 con 0x7fe5300ad5b0 2020-06-12T17:50:00.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.417+0000 7fe535d6f700 1 -- 172.21.15.38:0/2847491858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5300ad5b0 msgr2=0x7fe5300b2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:00.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.417+0000 7fe535d6f700 1 --2- 172.21.15.38:0/2847491858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5300ad5b0 0x7fe5300b2eb0 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7fe524002f30 tx=0x7fe524007e60).stop 2020-06-12T17:50:00.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.417+0000 7fe535d6f700 1 -- 172.21.15.38:0/2847491858 shutdown_connections 2020-06-12T17:50:00.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.417+0000 7fe535d6f700 1 --2- 172.21.15.38:0/2847491858 >> v2:172.21.15.150:3300/0 conn(0x7fe53009d8d0 0x7fe5301421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:00.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.417+0000 7fe535d6f700 1 --2- 172.21.15.38:0/2847491858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5300ad5b0 0x7fe5300b2eb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:00.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.417+0000 7fe535d6f700 1 -- 172.21.15.38:0/2847491858 >> 172.21.15.38:0/2847491858 conn(0x7fe5300b5a20 msgr2=0x7fe53005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:00.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.417+0000 7fe535d6f700 1 -- 172.21.15.38:0/2847491858 shutdown_connections 2020-06-12T17:50:00.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.417+0000 7fe535d6f700 1 -- 172.21.15.38:0/2847491858 wait complete. 2020-06-12T17:50:00.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.418+0000 7fe535d6f700 1 Processor -- start 2020-06-12T17:50:00.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.418+0000 7fe535d6f700 1 -- start start 2020-06-12T17:50:00.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.419+0000 7fe535d6f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe53009d8d0 0x7fe530141bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:00.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.419+0000 7fe535d6f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe530146680 0x7fe530142010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:00.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.419+0000 7fe535d6f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe530065460 con 0x7fe5300ad5b0 2020-06-12T17:50:00.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.419+0000 7fe535d6f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5300651c0 con 0x7fe530146680 2020-06-12T17:50:00.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.419+0000 7fe535d6f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5300b2410 con 0x7fe53009d8d0 2020-06-12T17:50:00.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.419+0000 7fe52f7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe53009d8d0 0x7fe530141bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:00.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.419+0000 7fe52ffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe530146680 0x7fe530142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:00.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.419+0000 7fe52f7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe53009d8d0 0x7fe530141bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:57776/0 (socket says 172.21.15.38:57776) 2020-06-12T17:50:00.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.419+0000 7fe52f7fe700 1 -- 172.21.15.38:0/1695228991 learned_addr learned my addr 172.21.15.38:0/1695228991 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:00.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.420+0000 7fe52f7fe700 1 -- 172.21.15.38:0/1695228991 >> v2:172.21.15.150:3300/0 conn(0x7fe530146680 msgr2=0x7fe530142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:00.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.420+0000 7fe52f7fe700 1 --2- 172.21.15.38:0/1695228991 >> v2:172.21.15.150:3300/0 conn(0x7fe530146680 0x7fe530142010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:00.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.420+0000 7fe52f7fe700 1 -- 172.21.15.38:0/1695228991 >> v1:172.21.15.150:6789/0 conn(0x7fe5300ad5b0 legacy=0x7fe530061890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:00.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.420+0000 7fe52f7fe700 1 -- 172.21.15.38:0/1695228991 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5300b1ff0 con 0x7fe53009d8d0 2020-06-12T17:50:00.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.420+0000 7fe52f7fe700 1 --2- 172.21.15.38:0/1695228991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe53009d8d0 0x7fe530141bb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe520001000 tx=0x7fe520001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.420+0000 7fe52f7fe700 1 --2- 172.21.15.38:0/1695228991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe53009d8d0 0x7fe530141bb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe520001000 tx=0x7fe520001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.435 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.420+0000 7fe52f7fe700 1 --2- 172.21.15.38:0/1695228991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe53009d8d0 0x7fe530141bb0 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7fe520001000 tx=0x7fe520001800).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:00.435 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.420+0000 7fe52f7fe700 1 --2- 172.21.15.38:0/1695228991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe53009d8d0 0x7fe530141bb0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fe520001000 tx=0x7fe520001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.435 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.420+0000 7fe52cff9700 1 -- 172.21.15.38:0/1695228991 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe52000c970 con 0x7fe53009d8d0 2020-06-12T17:50:00.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.420+0000 7fe52f7fe700 1 --2- 172.21.15.38:0/1695228991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe53009d8d0 0x7fe530141bb0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fe520001000 tx=0x7fe520001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.420+0000 7fe52f7fe700 1 --2- 172.21.15.38:0/1695228991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe53009d8d0 0x7fe530141bb0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fe520001000 tx=0x7fe520001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.420+0000 7fe52cff9700 1 -- 172.21.15.38:0/1695228991 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52000cad0 con 0x7fe53009d8d0 2020-06-12T17:50:00.437 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.420+0000 7fe52cff9700 1 -- 172.21.15.38:0/1695228991 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5200044f0 con 0x7fe53009d8d0 2020-06-12T17:50:00.437 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.420+0000 7fe535d6f700 1 -- 172.21.15.38:0/1695228991 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5300b28b0 con 0x7fe53009d8d0 2020-06-12T17:50:00.437 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.420+0000 7fe535d6f700 1 -- 172.21.15.38:0/1695228991 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5300621e0 con 0x7fe53009d8d0 2020-06-12T17:50:00.437 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.421+0000 7fe52f7fe700 1 --2- 172.21.15.38:0/1695228991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe53009d8d0 0x7fe530141bb0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fe520001000 tx=0x7fe520001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.421+0000 7fe535d6f700 1 -- 172.21.15.38:0/1695228991 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe530056c30 con 0x7fe53009d8d0 2020-06-12T17:50:00.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.421+0000 7fe52cff9700 1 -- 172.21.15.38:0/1695228991 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fe520004760 con 0x7fe53009d8d0 2020-06-12T17:50:00.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.421+0000 7fe52f7fe700 1 --2- 172.21.15.38:0/1695228991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe53009d8d0 0x7fe530141bb0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fe520001000 tx=0x7fe520001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.421+0000 7fe52cff9700 1 --2- 172.21.15.38:0/1695228991 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe51004d6a0 0x7fe51004fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:00.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.421+0000 7fe52cff9700 1 -- 172.21.15.38:0/1695228991 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe520060a10 con 0x7fe53009d8d0 2020-06-12T17:50:00.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.422+0000 7fe52effd700 1 --2- 172.21.15.38:0/1695228991 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe51004d6a0 0x7fe51004fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:00.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.422+0000 7fe52effd700 1 --2- 172.21.15.38:0/1695228991 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe51004d6a0 0x7fe51004fb60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe5301457e0 tx=0x7fe524007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.422+0000 7fe52effd700 1 --2- 172.21.15.38:0/1695228991 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe51004d6a0 0x7fe51004fb60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe5301457e0 tx=0x7fe524007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.422+0000 7fe52effd700 1 --2- 172.21.15.38:0/1695228991 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe51004d6a0 0x7fe51004fb60 secure :-1 s=READY pgs=234 cs=0 l=1 rx=0x7fe5301457e0 tx=0x7fe524007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:00.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.425+0000 7fe52f7fe700 1 --2- 172.21.15.38:0/1695228991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe53009d8d0 0x7fe530141bb0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7fe520001000 tx=0x7fe520001800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.425+0000 7fe52cff9700 1 -- 172.21.15.38:0/1695228991 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fe52003c190 con 0x7fe53009d8d0 2020-06-12T17:50:00.628 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.625+0000 7fe535d6f700 1 -- 172.21.15.38:0/1695228991 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_583", "target": ["mon-mgr", ""]}) v1 -- 0x7fe53009b350 con 0x7fe51004d6a0 2020-06-12T17:50:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.642+0000 7fe52effd700 1 --2- 172.21.15.38:0/1695228991 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe51004d6a0 0x7fe51004fb60 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7fe5301457e0 tx=0x7fe524007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.642+0000 7fe52cff9700 1 -- 172.21.15.38:0/1695228991 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe53009b350 con 0x7fe51004d6a0 2020-06-12T17:50:00.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.644+0000 7fe535d6f700 1 -- 172.21.15.38:0/1695228991 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe51004d6a0 msgr2=0x7fe51004fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:00.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.644+0000 7fe535d6f700 1 --2- 172.21.15.38:0/1695228991 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe51004d6a0 0x7fe51004fb60 secure :-1 s=READY pgs=234 cs=0 l=1 rx=0x7fe5301457e0 tx=0x7fe524007e60).stop 2020-06-12T17:50:00.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.644+0000 7fe535d6f700 1 -- 172.21.15.38:0/1695228991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe53009d8d0 msgr2=0x7fe530141bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:00.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.644+0000 7fe535d6f700 1 --2- 172.21.15.38:0/1695228991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe53009d8d0 0x7fe530141bb0 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7fe520001000 tx=0x7fe520001800).stop 2020-06-12T17:50:00.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.644+0000 7fe535d6f700 1 -- 172.21.15.38:0/1695228991 shutdown_connections 2020-06-12T17:50:00.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.644+0000 7fe535d6f700 1 --2- 172.21.15.38:0/1695228991 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe51004d6a0 0x7fe51004fb60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:00.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.644+0000 7fe535d6f700 1 --2- 172.21.15.38:0/1695228991 >> v2:172.21.15.150:3300/0 conn(0x7fe530146680 0x7fe530142010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:00.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.644+0000 7fe535d6f700 1 --2- 172.21.15.38:0/1695228991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe53009d8d0 0x7fe530141bb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:00.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.644+0000 7fe535d6f700 1 -- 172.21.15.38:0/1695228991 >> 172.21.15.38:0/1695228991 conn(0x7fe5300b5a20 msgr2=0x7fe5300b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:00.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.644+0000 7fe535d6f700 1 -- 172.21.15.38:0/1695228991 shutdown_connections 2020-06-12T17:50:00.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.644+0000 7fe535d6f700 1 -- 172.21.15.38:0/1695228991 wait complete. 2020-06-12T17:50:00.657 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_583 2020-06-12T17:50:00.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.771+0000 7f8110267700 1 Processor -- start 2020-06-12T17:50:00.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.771+0000 7f8110267700 1 -- start start 2020-06-12T17:50:00.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.772+0000 7f8110267700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f810809df00 0x7f810813c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:00.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.772+0000 7f8110267700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8108142e90 0x7f8108066790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:00.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.772+0000 7f8110267700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810809b960 con 0x7f81080b3ac0 2020-06-12T17:50:00.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.772+0000 7f8110267700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8108143270 con 0x7f810809df00 2020-06-12T17:50:00.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.772+0000 7f8110267700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810809bc00 con 0x7f8108142e90 2020-06-12T17:50:00.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.772+0000 7f810d802700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f810809df00 0x7f810813c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:00.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.772+0000 7f810e003700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f81080b3ac0 0x7f810813bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40142/0 (socket says 172.21.15.38:40142) 2020-06-12T17:50:00.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.772+0000 7f810e003700 1 -- 172.21.15.38:0/3277169307 learned_addr learned my addr 172.21.15.38:0/3277169307 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:00.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.772+0000 7f810e804700 1 --2- 172.21.15.38:0/3277169307 >> v2:172.21.15.150:3300/0 conn(0x7f8108142e90 0x7f8108066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:00.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.772+0000 7f810d802700 1 -- 172.21.15.38:0/3277169307 >> v2:172.21.15.150:3300/0 conn(0x7f8108142e90 msgr2=0x7f8108066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:00.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.772+0000 7f810d802700 1 --2- 172.21.15.38:0/3277169307 >> v2:172.21.15.150:3300/0 conn(0x7f8108142e90 0x7f8108066790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:00.780 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.772+0000 7f810d802700 1 -- 172.21.15.38:0/3277169307 >> v1:172.21.15.38:6789/0 conn(0x7f81080b3ac0 legacy=0x7f810813bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:00.780 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.772+0000 7f810d802700 1 -- 172.21.15.38:0/3277169307 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81080b48f0 con 0x7f810809df00 2020-06-12T17:50:00.780 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.772+0000 7f810e804700 1 --2- 172.21.15.38:0/3277169307 >> v2:172.21.15.150:3300/0 conn(0x7f8108142e90 0x7f8108066790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:50:00.780 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.772+0000 7f810d802700 1 --2- 172.21.15.38:0/3277169307 >> v2:172.21.15.38:3300/0 conn(0x7f810809df00 0x7f810813c650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f80fc002f30 tx=0x7f80fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.780 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.773+0000 7f810d802700 1 --2- 172.21.15.38:0/3277169307 >> v2:172.21.15.38:3300/0 conn(0x7f810809df00 0x7f810813c650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f80fc002f30 tx=0x7f80fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.773+0000 7f810d802700 1 --2- 172.21.15.38:0/3277169307 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f810809df00 0x7f810813c650 secure :-1 s=READY pgs=593 cs=0 l=1 rx=0x7f80fc002f30 tx=0x7f80fc007e60).ready entity=mon.0 client_cookie=7d2abf930e65a3c6 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:00.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.772+0000 7f810d001700 1 -- 172.21.15.38:0/3277169307 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331491838 0 0) 0x7f810809b960 con 0x7f81080b3ac0 2020-06-12T17:50:00.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.773+0000 7f810d802700 1 --2- 172.21.15.38:0/3277169307 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f810809df00 0x7f810813c650 secure :-1 s=THROTTLE_DONE pgs=593 cs=0 l=1 rx=0x7f80fc002f30 tx=0x7f80fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.773+0000 7f810d001700 1 -- 172.21.15.38:0/3277169307 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80fc011430 con 0x7f810809df00 2020-06-12T17:50:00.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.773+0000 7f810d802700 1 --2- 172.21.15.38:0/3277169307 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f810809df00 0x7f810813c650 secure :-1 s=THROTTLE_DONE pgs=593 cs=0 l=1 rx=0x7f80fc002f30 tx=0x7f80fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.773+0000 7f810d001700 1 -- 172.21.15.38:0/3277169307 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80fc011590 con 0x7f810809df00 2020-06-12T17:50:00.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.773+0000 7f810d802700 1 --2- 172.21.15.38:0/3277169307 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f810809df00 0x7f810813c650 secure :-1 s=THROTTLE_DONE pgs=593 cs=0 l=1 rx=0x7f80fc002f30 tx=0x7f80fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.773+0000 7f810d001700 1 -- 172.21.15.38:0/3277169307 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80fc011930 con 0x7f810809df00 2020-06-12T17:50:00.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.773+0000 7f8110267700 1 -- 172.21.15.38:0/3277169307 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f810809df00 msgr2=0x7f810813c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:00.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.773+0000 7f8110267700 1 --2- 172.21.15.38:0/3277169307 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f810809df00 0x7f810813c650 secure :-1 s=READY pgs=593 cs=0 l=1 rx=0x7f80fc002f30 tx=0x7f80fc007e60).stop 2020-06-12T17:50:00.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.773+0000 7f8110267700 1 -- 172.21.15.38:0/3277169307 shutdown_connections 2020-06-12T17:50:00.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.773+0000 7f8110267700 1 --2- 172.21.15.38:0/3277169307 >> v2:172.21.15.150:3300/0 conn(0x7f8108142e90 0x7f8108066790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:00.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.773+0000 7f8110267700 1 --2- 172.21.15.38:0/3277169307 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f810809df00 0x7f810813c650 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:00.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.773+0000 7f8110267700 1 -- 172.21.15.38:0/3277169307 >> 172.21.15.38:0/3277169307 conn(0x7f81080b5a20 msgr2=0x7f810805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:00.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.774+0000 7f8110267700 1 -- 172.21.15.38:0/3277169307 shutdown_connections 2020-06-12T17:50:00.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.774+0000 7f8110267700 1 -- 172.21.15.38:0/3277169307 wait complete. 2020-06-12T17:50:00.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.775+0000 7f8110267700 1 Processor -- start 2020-06-12T17:50:00.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.775+0000 7f8110267700 1 -- start start 2020-06-12T17:50:00.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.775+0000 7f8110267700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f810809df00 0x7f8108061890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:00.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.775+0000 7f8110267700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8108142e90 0x7f81080ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:00.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.775+0000 7f8110267700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8108061cf0 con 0x7f81080b3ac0 2020-06-12T17:50:00.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.775+0000 7f8110267700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81080b2740 con 0x7f8108142e90 2020-06-12T17:50:00.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.775+0000 7f8110267700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81080ae930 con 0x7f810809df00 2020-06-12T17:50:00.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.775+0000 7f810e804700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8108142e90 0x7f81080ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:00.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.775+0000 7f810e804700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8108142e90 0x7f81080ae4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38336/0 (socket says 172.21.15.38:38336) 2020-06-12T17:50:00.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.775+0000 7f810e804700 1 -- 172.21.15.38:0/336743921 learned_addr learned my addr 172.21.15.38:0/336743921 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:00.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.775+0000 7f810e003700 1 --2- 172.21.15.38:0/336743921 >> v2:172.21.15.150:3300/0 conn(0x7f810809df00 0x7f8108061890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:00.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.776+0000 7f810e804700 1 -- 172.21.15.38:0/336743921 >> v2:172.21.15.150:3300/0 conn(0x7f810809df00 msgr2=0x7f8108061890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:00.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.776+0000 7f810e804700 1 --2- 172.21.15.38:0/336743921 >> v2:172.21.15.150:3300/0 conn(0x7f810809df00 0x7f8108061890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:00.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.776+0000 7f810e804700 1 -- 172.21.15.38:0/336743921 >> v1:172.21.15.150:6789/0 conn(0x7f81080b3ac0 legacy=0x7f81080b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:00.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.776+0000 7f810e804700 1 -- 172.21.15.38:0/336743921 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81081449a0 con 0x7f8108142e90 2020-06-12T17:50:00.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.776+0000 7f810e804700 1 --2- 172.21.15.38:0/336743921 >> v2:172.21.15.38:3300/0 conn(0x7f8108142e90 0x7f81080ae4d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f80f8002f30 tx=0x7f80f800dfe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.776+0000 7f810e804700 1 --2- 172.21.15.38:0/336743921 >> v2:172.21.15.38:3300/0 conn(0x7f8108142e90 0x7f81080ae4d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f80f8002f30 tx=0x7f80f800dfe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.776+0000 7f810e804700 1 --2- 172.21.15.38:0/336743921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8108142e90 0x7f81080ae4d0 secure :-1 s=READY pgs=594 cs=0 l=1 rx=0x7f80f8002f30 tx=0x7f80f800dfe0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:00.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.776+0000 7f810e804700 1 --2- 172.21.15.38:0/336743921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8108142e90 0x7f81080ae4d0 secure :-1 s=THROTTLE_DONE pgs=594 cs=0 l=1 rx=0x7f80f8002f30 tx=0x7f80f800dfe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.776+0000 7f81077fe700 1 -- 172.21.15.38:0/336743921 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80f8005e90 con 0x7f8108142e90 2020-06-12T17:50:00.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.776+0000 7f810e804700 1 --2- 172.21.15.38:0/336743921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8108142e90 0x7f81080ae4d0 secure :-1 s=THROTTLE_DONE pgs=594 cs=0 l=1 rx=0x7f80f8002f30 tx=0x7f80f800dfe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.776+0000 7f8110267700 1 -- 172.21.15.38:0/336743921 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8108144c40 con 0x7f8108142e90 2020-06-12T17:50:00.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.776+0000 7f810e804700 1 --2- 172.21.15.38:0/336743921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8108142e90 0x7f81080ae4d0 secure :-1 s=THROTTLE_DONE pgs=594 cs=0 l=1 rx=0x7f80f8002f30 tx=0x7f80f800dfe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.776+0000 7f81077fe700 1 -- 172.21.15.38:0/336743921 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f8007160 con 0x7f8108142e90 2020-06-12T17:50:00.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.776+0000 7f81077fe700 1 -- 172.21.15.38:0/336743921 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80f8007580 con 0x7f8108142e90 2020-06-12T17:50:00.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.776+0000 7f8110267700 1 -- 172.21.15.38:0/336743921 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810812f490 con 0x7f8108142e90 2020-06-12T17:50:00.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.777+0000 7f810e804700 1 --2- 172.21.15.38:0/336743921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8108142e90 0x7f81080ae4d0 secure :-1 s=THROTTLE_DONE pgs=594 cs=0 l=1 rx=0x7f80f8002f30 tx=0x7f80f800dfe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.777+0000 7f81077fe700 1 -- 172.21.15.38:0/336743921 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f80f80143e0 con 0x7f8108142e90 2020-06-12T17:50:00.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.777+0000 7f810e804700 1 --2- 172.21.15.38:0/336743921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8108142e90 0x7f81080ae4d0 secure :-1 s=THROTTLE_DONE pgs=594 cs=0 l=1 rx=0x7f80f8002f30 tx=0x7f80f800dfe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.777+0000 7f8110267700 1 -- 172.21.15.38:0/336743921 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8108056c30 con 0x7f8108142e90 2020-06-12T17:50:00.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.777+0000 7f81077fe700 1 --2- 172.21.15.38:0/336743921 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f80e804d600 0x7f80e804fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:00.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.777+0000 7f81077fe700 1 -- 172.21.15.38:0/336743921 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f80f8007e40 con 0x7f8108142e90 2020-06-12T17:50:00.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.777+0000 7f810e003700 1 --2- 172.21.15.38:0/336743921 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f80e804d600 0x7f80e804fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:00.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.778+0000 7f810e003700 1 --2- 172.21.15.38:0/336743921 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f80e804d600 0x7f80e804fac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8100000f00 tx=0x7f8100001930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.778+0000 7f810e003700 1 --2- 172.21.15.38:0/336743921 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f80e804d600 0x7f80e804fac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8100000f00 tx=0x7f8100001930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.778+0000 7f810e003700 1 --2- 172.21.15.38:0/336743921 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f80e804d600 0x7f80e804fac0 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7f8100000f00 tx=0x7f8100001930).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:00.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.781+0000 7f810e804700 1 --2- 172.21.15.38:0/336743921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8108142e90 0x7f81080ae4d0 secure :-1 s=THROTTLE_DONE pgs=594 cs=0 l=1 rx=0x7f80f8002f30 tx=0x7f80f800dfe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.781+0000 7f81077fe700 1 -- 172.21.15.38:0/336743921 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f80f803ebd0 con 0x7f8108142e90 2020-06-12T17:50:00.984 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.980+0000 7f8110267700 1 -- 172.21.15.38:0/336743921 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_583", "target": ["mon-mgr", ""]}) v1 -- 0x7f8108144dd0 con 0x7f80e804d600 2020-06-12T17:50:00.987 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.984+0000 7f810e003700 1 --2- 172.21.15.38:0/336743921 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f80e804d600 0x7f80e804fac0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f8100000f00 tx=0x7f8100001930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:00.987 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.984+0000 7f81077fe700 1 -- 172.21.15.38:0/336743921 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+69 (secure 0 0 0) 0x7f8108144dd0 con 0x7f80e804d600 2020-06-12T17:50:00.988 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_583/75f297ba-5824-4adc-a638-92443bf95d22 2020-06-12T17:50:00.989 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.985+0000 7f8110267700 1 -- 172.21.15.38:0/336743921 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f80e804d600 msgr2=0x7f80e804fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:00.989 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.985+0000 7f8110267700 1 --2- 172.21.15.38:0/336743921 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f80e804d600 0x7f80e804fac0 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7f8100000f00 tx=0x7f8100001930).stop 2020-06-12T17:50:00.989 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.985+0000 7f8110267700 1 -- 172.21.15.38:0/336743921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8108142e90 msgr2=0x7f81080ae4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:00.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.985+0000 7f8110267700 1 --2- 172.21.15.38:0/336743921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8108142e90 0x7f81080ae4d0 secure :-1 s=READY pgs=594 cs=0 l=1 rx=0x7f80f8002f30 tx=0x7f80f800dfe0).stop 2020-06-12T17:50:00.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.985+0000 7f8110267700 1 -- 172.21.15.38:0/336743921 shutdown_connections 2020-06-12T17:50:00.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.985+0000 7f8110267700 1 --2- 172.21.15.38:0/336743921 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f80e804d600 0x7f80e804fac0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:00.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.985+0000 7f8110267700 1 --2- 172.21.15.38:0/336743921 >> v2:172.21.15.150:3300/0 conn(0x7f810809df00 0x7f8108061890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:00.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.985+0000 7f8110267700 1 --2- 172.21.15.38:0/336743921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8108142e90 0x7f81080ae4d0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:00.991 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.985+0000 7f8110267700 1 -- 172.21.15.38:0/336743921 >> 172.21.15.38:0/336743921 conn(0x7f81080b5a20 msgr2=0x7f810813eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:00.991 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.985+0000 7f8110267700 1 -- 172.21.15.38:0/336743921 shutdown_connections 2020-06-12T17:50:00.991 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:00.985+0000 7f8110267700 1 -- 172.21.15.38:0/336743921 wait complete. 2020-06-12T17:50:00.999 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_583 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_583/75f297ba-5824-4adc-a638-92443bf95d22 2020-06-12T17:50:00.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:01.000 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:01.000 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:01.016 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:01.016 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:01.017 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_583/75f297ba-5824-4adc-a638-92443bf95d22/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:01.107 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:01.108 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:01.108 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106511 s, 98.4 MB/s 2020-06-12T17:50:01.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:01.110 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:01.110 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:01.126 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:01.126 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:01.127 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_583/75f297ba-5824-4adc-a638-92443bf95d22/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:01.213 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:01.213 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:01.213 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102914 s, 102 MB/s 2020-06-12T17:50:01.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:01.216 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:01.217 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:01.232 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:01.232 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:01.233 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_583/75f297ba-5824-4adc-a638-92443bf95d22/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:01.319 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:01.320 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:01.320 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112278 s, 93.4 MB/s 2020-06-12T17:50:01.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:01.322 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:01.322 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:01.338 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:01.339 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:01.339 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_583/75f297ba-5824-4adc-a638-92443bf95d22/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:01.428 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:01.428 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:01.428 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119286 s, 87.9 MB/s 2020-06-12T17:50:01.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:01.429 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:01.430 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:01.446 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:01.447 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:01.447 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_583/75f297ba-5824-4adc-a638-92443bf95d22/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:01.533 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:01.534 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:01.534 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105665 s, 99.2 MB/s 2020-06-12T17:50:01.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:01.535 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:01.536 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:01.551 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:01.551 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:01.552 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_583/75f297ba-5824-4adc-a638-92443bf95d22/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:01.639 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:01.640 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:01.640 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107103 s, 97.9 MB/s 2020-06-12T17:50:01.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:01.643 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:01.643 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:01.658 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:01.658 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:01.659 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_583/75f297ba-5824-4adc-a638-92443bf95d22/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:01.745 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:01.745 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:01.746 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101406 s, 103 MB/s 2020-06-12T17:50:01.747 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:01.747 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:01.748 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:01.762 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:01.763 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:01.765 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_583/75f297ba-5824-4adc-a638-92443bf95d22/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:01.850 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:01.850 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:01.850 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105563 s, 99.3 MB/s 2020-06-12T17:50:01.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:01.852 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:01.852 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:01.868 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:01.868 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:01.869 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_583/75f297ba-5824-4adc-a638-92443bf95d22/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:01.961 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:01.962 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:01.962 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117483 s, 89.3 MB/s 2020-06-12T17:50:01.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:01.964 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:01.964 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:01.980 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:01.981 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:01.982 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_583/75f297ba-5824-4adc-a638-92443bf95d22/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:02.070 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:02.070 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:02.071 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112132 s, 93.5 MB/s 2020-06-12T17:50:02.072 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_8859 2020-06-12T17:50:02.195 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.185+0000 7f39dbfc4700 1 Processor -- start 2020-06-12T17:50:02.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.185+0000 7f39dbfc4700 1 -- start start 2020-06-12T17:50:02.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.186+0000 7f39dbfc4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39d4146680 0x7f39d40ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:02.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.186+0000 7f39dbfc4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f39d40b2eb0 0x7f39d409d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:02.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.186+0000 7f39dbfc4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f39d409d620 0x7f39d409da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:02.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.186+0000 7f39dbfc4700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d4146d20 con 0x7f39d409d620 2020-06-12T17:50:02.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.186+0000 7f39dbfc4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d4066a80 con 0x7f39d40b2eb0 2020-06-12T17:50:02.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.186+0000 7f39dbfc4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d4146f50 con 0x7f39d4146680 2020-06-12T17:50:02.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.186+0000 7f39da561700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f39d409d620 0x7f39d409da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:02.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.186+0000 7f39da561700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f39d409d620 0x7f39d409da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38342/0 (socket says 172.21.15.38:38342) 2020-06-12T17:50:02.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.186+0000 7f39da561700 1 -- 172.21.15.38:0/1165308150 learned_addr learned my addr 172.21.15.38:0/1165308150 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:02.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.186+0000 7f39d9d60700 1 --2- 172.21.15.38:0/1165308150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39d4146680 0x7f39d40ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:02.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.186+0000 7f39d955f700 1 --2- 172.21.15.38:0/1165308150 >> v2:172.21.15.150:3300/0 conn(0x7f39d40b2eb0 0x7f39d409d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:02.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.186+0000 7f39da561700 1 -- 172.21.15.38:0/1165308150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39d4146680 msgr2=0x7f39d40ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:02.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.186+0000 7f39da561700 1 --2- 172.21.15.38:0/1165308150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39d4146680 0x7f39d40ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:02.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.186+0000 7f39da561700 1 -- 172.21.15.38:0/1165308150 >> v2:172.21.15.150:3300/0 conn(0x7f39d40b2eb0 msgr2=0x7f39d409d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:02.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.186+0000 7f39da561700 1 --2- 172.21.15.38:0/1165308150 >> v2:172.21.15.150:3300/0 conn(0x7f39d40b2eb0 0x7f39d409d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:02.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.186+0000 7f39da561700 1 -- 172.21.15.38:0/1165308150 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d4146a60 con 0x7f39d409d620 2020-06-12T17:50:02.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.186+0000 7f39d9d60700 1 --2- 172.21.15.38:0/1165308150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39d4146680 0x7f39d40ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:50:02.203 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.186+0000 7f39d955f700 1 --2- 172.21.15.38:0/1165308150 >> v2:172.21.15.150:3300/0 conn(0x7f39d40b2eb0 0x7f39d409d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:50:02.203 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.186+0000 7f39da561700 1 --2- 172.21.15.38:0/1165308150 >> v2:172.21.15.38:3300/0 conn(0x7f39d409d620 0x7f39d409da90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f39cc002f30 tx=0x7f39cc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.203 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.187+0000 7f39da561700 1 --2- 172.21.15.38:0/1165308150 >> v2:172.21.15.38:3300/0 conn(0x7f39d409d620 0x7f39d409da90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f39cc002f30 tx=0x7f39cc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.204 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.187+0000 7f39da561700 1 --2- 172.21.15.38:0/1165308150 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39d409d620 0x7f39d409da90 secure :-1 s=READY pgs=595 cs=0 l=1 rx=0x7f39cc002f30 tx=0x7f39cc007e60).ready entity=mon.0 client_cookie=56a7bac4e1102b6e server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:02.204 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.187+0000 7f39da561700 1 --2- 172.21.15.38:0/1165308150 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39d409d620 0x7f39d409da90 secure :-1 s=THROTTLE_DONE pgs=595 cs=0 l=1 rx=0x7f39cc002f30 tx=0x7f39cc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.204 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.187+0000 7f39d8d5e700 1 -- 172.21.15.38:0/1165308150 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39cc0116e0 con 0x7f39d409d620 2020-06-12T17:50:02.204 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.187+0000 7f39da561700 1 --2- 172.21.15.38:0/1165308150 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39d409d620 0x7f39d409da90 secure :-1 s=THROTTLE_DONE pgs=595 cs=0 l=1 rx=0x7f39cc002f30 tx=0x7f39cc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.205 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.187+0000 7f39da561700 1 --2- 172.21.15.38:0/1165308150 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39d409d620 0x7f39d409da90 secure :-1 s=THROTTLE_DONE pgs=595 cs=0 l=1 rx=0x7f39cc002f30 tx=0x7f39cc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.205 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.187+0000 7f39d8d5e700 1 -- 172.21.15.38:0/1165308150 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39cc011840 con 0x7f39d409d620 2020-06-12T17:50:02.205 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.187+0000 7f39d8d5e700 1 -- 172.21.15.38:0/1165308150 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39cc011c20 con 0x7f39d409d620 2020-06-12T17:50:02.205 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.187+0000 7f39dbfc4700 1 -- 172.21.15.38:0/1165308150 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39d409d620 msgr2=0x7f39d409da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:02.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.187+0000 7f39dbfc4700 1 --2- 172.21.15.38:0/1165308150 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39d409d620 0x7f39d409da90 secure :-1 s=READY pgs=595 cs=0 l=1 rx=0x7f39cc002f30 tx=0x7f39cc007e60).stop 2020-06-12T17:50:02.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.187+0000 7f39dbfc4700 1 -- 172.21.15.38:0/1165308150 shutdown_connections 2020-06-12T17:50:02.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.187+0000 7f39dbfc4700 1 --2- 172.21.15.38:0/1165308150 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39d409d620 0x7f39d409da90 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:02.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.187+0000 7f39dbfc4700 1 --2- 172.21.15.38:0/1165308150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39d4146680 0x7f39d40ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:02.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.187+0000 7f39dbfc4700 1 --2- 172.21.15.38:0/1165308150 >> v2:172.21.15.150:3300/0 conn(0x7f39d40b2eb0 0x7f39d409d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:02.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.187+0000 7f39dbfc4700 1 -- 172.21.15.38:0/1165308150 >> 172.21.15.38:0/1165308150 conn(0x7f39d40b5a20 msgr2=0x7f39d405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:02.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.187+0000 7f39dbfc4700 1 -- 172.21.15.38:0/1165308150 shutdown_connections 2020-06-12T17:50:02.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.187+0000 7f39dbfc4700 1 -- 172.21.15.38:0/1165308150 wait complete. 2020-06-12T17:50:02.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.188+0000 7f39dbfc4700 1 Processor -- start 2020-06-12T17:50:02.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.188+0000 7f39dbfc4700 1 -- start start 2020-06-12T17:50:02.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.189+0000 7f39dbfc4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f39d409d620 0x7f39d4063ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:02.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.189+0000 7f39dbfc4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39d4146680 0x7f39d408f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:02.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.189+0000 7f39dbfc4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d4064d30 con 0x7f39d40b2eb0 2020-06-12T17:50:02.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.189+0000 7f39dbfc4700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d4143c60 con 0x7f39d409d620 2020-06-12T17:50:02.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.189+0000 7f39dbfc4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d4143f00 con 0x7f39d4146680 2020-06-12T17:50:02.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.189+0000 7f39d9d60700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f39d409d620 0x7f39d4063ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:02.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.189+0000 7f39d9d60700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f39d409d620 0x7f39d4063ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38344/0 (socket says 172.21.15.38:38344) 2020-06-12T17:50:02.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.189+0000 7f39d9d60700 1 -- 172.21.15.38:0/1344405227 learned_addr learned my addr 172.21.15.38:0/1344405227 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:02.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.189+0000 7f39da561700 1 --2- 172.21.15.38:0/1344405227 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39d4146680 0x7f39d408f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:02.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.189+0000 7f39d9d60700 1 -- 172.21.15.38:0/1344405227 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39d4146680 msgr2=0x7f39d408f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:02.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.189+0000 7f39d9d60700 1 --2- 172.21.15.38:0/1344405227 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39d4146680 0x7f39d408f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:02.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.189+0000 7f39d9d60700 1 -- 172.21.15.38:0/1344405227 >> v1:172.21.15.150:6789/0 conn(0x7f39d40b2eb0 legacy=0x7f39d408ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:02.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.189+0000 7f39d9d60700 1 -- 172.21.15.38:0/1344405227 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d41441a0 con 0x7f39d409d620 2020-06-12T17:50:02.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.189+0000 7f39da561700 1 --2- 172.21.15.38:0/1344405227 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39d4146680 0x7f39d408f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:50:02.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.189+0000 7f39d9d60700 1 --2- 172.21.15.38:0/1344405227 >> v2:172.21.15.38:3300/0 conn(0x7f39d409d620 0x7f39d4063ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f39d4061960 tx=0x7f39c4007ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.189+0000 7f39d9d60700 1 --2- 172.21.15.38:0/1344405227 >> v2:172.21.15.38:3300/0 conn(0x7f39d409d620 0x7f39d4063ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f39d4061960 tx=0x7f39c4007ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.189+0000 7f39d9d60700 1 --2- 172.21.15.38:0/1344405227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39d409d620 0x7f39d4063ce0 secure :-1 s=READY pgs=596 cs=0 l=1 rx=0x7f39d4061960 tx=0x7f39c4007ed0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:02.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.190+0000 7f39d9d60700 1 --2- 172.21.15.38:0/1344405227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39d409d620 0x7f39d4063ce0 secure :-1 s=THROTTLE_DONE pgs=596 cs=0 l=1 rx=0x7f39d4061960 tx=0x7f39c4007ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.190+0000 7f39c2ffd700 1 -- 172.21.15.38:0/1344405227 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39c4007540 con 0x7f39d409d620 2020-06-12T17:50:02.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.190+0000 7f39d9d60700 1 --2- 172.21.15.38:0/1344405227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39d409d620 0x7f39d4063ce0 secure :-1 s=THROTTLE_DONE pgs=596 cs=0 l=1 rx=0x7f39d4061960 tx=0x7f39c4007ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.190+0000 7f39d9d60700 1 --2- 172.21.15.38:0/1344405227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39d409d620 0x7f39d4063ce0 secure :-1 s=THROTTLE_DONE pgs=596 cs=0 l=1 rx=0x7f39d4061960 tx=0x7f39c4007ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.190+0000 7f39c2ffd700 1 -- 172.21.15.38:0/1344405227 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c4008a40 con 0x7f39d409d620 2020-06-12T17:50:02.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.190+0000 7f39c2ffd700 1 -- 172.21.15.38:0/1344405227 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39c4008e60 con 0x7f39d409d620 2020-06-12T17:50:02.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.190+0000 7f39dbfc4700 1 -- 172.21.15.38:0/1344405227 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d408f9c0 con 0x7f39d409d620 2020-06-12T17:50:02.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.190+0000 7f39dbfc4700 1 -- 172.21.15.38:0/1344405227 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d4066310 con 0x7f39d409d620 2020-06-12T17:50:02.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.190+0000 7f39d9d60700 1 --2- 172.21.15.38:0/1344405227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39d409d620 0x7f39d4063ce0 secure :-1 s=THROTTLE_DONE pgs=596 cs=0 l=1 rx=0x7f39d4061960 tx=0x7f39c4007ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.191+0000 7f39c2ffd700 1 -- 172.21.15.38:0/1344405227 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f39c40059c0 con 0x7f39d409d620 2020-06-12T17:50:02.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.191+0000 7f39d9d60700 1 --2- 172.21.15.38:0/1344405227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39d409d620 0x7f39d4063ce0 secure :-1 s=THROTTLE_DONE pgs=596 cs=0 l=1 rx=0x7f39d4061960 tx=0x7f39c4007ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.191+0000 7f39dbfc4700 1 -- 172.21.15.38:0/1344405227 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d4143ab0 con 0x7f39d409d620 2020-06-12T17:50:02.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.191+0000 7f39c2ffd700 1 --2- 172.21.15.38:0/1344405227 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f39b404d650 0x7f39b404fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:02.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.191+0000 7f39c2ffd700 1 -- 172.21.15.38:0/1344405227 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f39c4060d00 con 0x7f39d409d620 2020-06-12T17:50:02.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.191+0000 7f39d955f700 1 --2- 172.21.15.38:0/1344405227 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f39b404d650 0x7f39b404fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:02.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.191+0000 7f39d955f700 1 --2- 172.21.15.38:0/1344405227 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f39b404d650 0x7f39b404fb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f39d00032b0 tx=0x7f39d0009f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.192+0000 7f39d955f700 1 --2- 172.21.15.38:0/1344405227 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f39b404d650 0x7f39b404fb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f39d00032b0 tx=0x7f39d0009f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.192+0000 7f39d955f700 1 --2- 172.21.15.38:0/1344405227 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f39b404d650 0x7f39b404fb10 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7f39d00032b0 tx=0x7f39d0009f80).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:02.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.194+0000 7f39d9d60700 1 --2- 172.21.15.38:0/1344405227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39d409d620 0x7f39d4063ce0 secure :-1 s=THROTTLE_DONE pgs=596 cs=0 l=1 rx=0x7f39d4061960 tx=0x7f39c4007ed0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.195+0000 7f39c2ffd700 1 -- 172.21.15.38:0/1344405227 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f39c403c480 con 0x7f39d409d620 2020-06-12T17:50:02.392 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.389+0000 7f39dbfc4700 1 -- 172.21.15.38:0/1344405227 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_8859", "target": ["mon-mgr", ""]}) v1 -- 0x7f39d409c740 con 0x7f39b404d650 2020-06-12T17:50:02.411 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.407+0000 7f39d955f700 1 --2- 172.21.15.38:0/1344405227 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f39b404d650 0x7f39b404fb10 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7f39d00032b0 tx=0x7f39d0009f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.411 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.407+0000 7f39c2ffd700 1 -- 172.21.15.38:0/1344405227 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f39d409c740 con 0x7f39b404d650 2020-06-12T17:50:02.412 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.409+0000 7f39dbfc4700 1 -- 172.21.15.38:0/1344405227 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f39b404d650 msgr2=0x7f39b404fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:02.413 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.409+0000 7f39dbfc4700 1 --2- 172.21.15.38:0/1344405227 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f39b404d650 0x7f39b404fb10 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7f39d00032b0 tx=0x7f39d0009f80).stop 2020-06-12T17:50:02.413 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.409+0000 7f39dbfc4700 1 -- 172.21.15.38:0/1344405227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39d409d620 msgr2=0x7f39d4063ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:02.413 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.409+0000 7f39dbfc4700 1 --2- 172.21.15.38:0/1344405227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39d409d620 0x7f39d4063ce0 secure :-1 s=READY pgs=596 cs=0 l=1 rx=0x7f39d4061960 tx=0x7f39c4007ed0).stop 2020-06-12T17:50:02.413 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.409+0000 7f39dbfc4700 1 -- 172.21.15.38:0/1344405227 shutdown_connections 2020-06-12T17:50:02.414 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.409+0000 7f39dbfc4700 1 --2- 172.21.15.38:0/1344405227 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f39b404d650 0x7f39b404fb10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:02.414 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.409+0000 7f39dbfc4700 1 --2- 172.21.15.38:0/1344405227 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39d4146680 0x7f39d408f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:02.414 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.409+0000 7f39dbfc4700 1 --2- 172.21.15.38:0/1344405227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39d409d620 0x7f39d4063ce0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:02.414 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.409+0000 7f39dbfc4700 1 -- 172.21.15.38:0/1344405227 >> 172.21.15.38:0/1344405227 conn(0x7f39d40b5a20 msgr2=0x7f39d409b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:02.414 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.409+0000 7f39dbfc4700 1 -- 172.21.15.38:0/1344405227 shutdown_connections 2020-06-12T17:50:02.415 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.409+0000 7f39dbfc4700 1 -- 172.21.15.38:0/1344405227 wait complete. 2020-06-12T17:50:02.422 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_8859 2020-06-12T17:50:02.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.536+0000 7fe8a40f3700 1 Processor -- start 2020-06-12T17:50:02.540 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.536+0000 7fe8a40f3700 1 -- start start 2020-06-12T17:50:02.543 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.537+0000 7fe8a40f3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe89c146680 0x7fe89c0ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:02.543 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.537+0000 7fe8a40f3700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe89c0b2eb0 0x7fe89c09d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:02.543 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.537+0000 7fe8a40f3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89c146d20 con 0x7fe89c09d620 2020-06-12T17:50:02.543 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.537+0000 7fe8a40f3700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89c066a80 con 0x7fe89c0b2eb0 2020-06-12T17:50:02.543 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.537+0000 7fe8a40f3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c146f50 con 0x7fe89c146680 2020-06-12T17:50:02.544 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.537+0000 7fe8a168e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe89c0b2eb0 0x7fe89c09d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:02.544 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.537+0000 7fe8a168e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe89c0b2eb0 0x7fe89c09d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38352/0 (socket says 172.21.15.38:38352) 2020-06-12T17:50:02.544 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.537+0000 7fe8a168e700 1 -- 172.21.15.38:0/2406639675 learned_addr learned my addr 172.21.15.38:0/2406639675 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:02.544 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.537+0000 7fe8a1e8f700 1 --2- 172.21.15.38:0/2406639675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe89c146680 0x7fe89c0ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:02.545 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.537+0000 7fe8a168e700 1 -- 172.21.15.38:0/2406639675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe89c146680 msgr2=0x7fe89c0ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:02.545 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.537+0000 7fe8a168e700 1 --2- 172.21.15.38:0/2406639675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe89c146680 0x7fe89c0ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:02.545 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.537+0000 7fe8a168e700 1 -- 172.21.15.38:0/2406639675 >> v1:172.21.15.150:6789/0 conn(0x7fe89c09d620 legacy=0x7fe89c09b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:02.545 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.537+0000 7fe8a168e700 1 -- 172.21.15.38:0/2406639675 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c146a60 con 0x7fe89c0b2eb0 2020-06-12T17:50:02.545 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.537+0000 7fe8a168e700 1 --2- 172.21.15.38:0/2406639675 >> v2:172.21.15.38:3300/0 conn(0x7fe89c0b2eb0 0x7fe89c09d1c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe898002f30 tx=0x7fe898007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.546 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.537+0000 7fe8a168e700 1 --2- 172.21.15.38:0/2406639675 >> v2:172.21.15.38:3300/0 conn(0x7fe89c0b2eb0 0x7fe89c09d1c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe898002f30 tx=0x7fe898007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.546 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.538+0000 7fe8a168e700 1 --2- 172.21.15.38:0/2406639675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe89c0b2eb0 0x7fe89c09d1c0 secure :-1 s=READY pgs=597 cs=0 l=1 rx=0x7fe898002f30 tx=0x7fe898007e60).ready entity=mon.0 client_cookie=f12eb1c19c792ff6 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:02.546 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.538+0000 7fe8a168e700 1 --2- 172.21.15.38:0/2406639675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe89c0b2eb0 0x7fe89c09d1c0 secure :-1 s=THROTTLE_DONE pgs=597 cs=0 l=1 rx=0x7fe898002f30 tx=0x7fe898007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.546 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.538+0000 7fe8a0e8d700 1 -- 172.21.15.38:0/2406639675 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe898011630 con 0x7fe89c0b2eb0 2020-06-12T17:50:02.546 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.538+0000 7fe8a168e700 1 --2- 172.21.15.38:0/2406639675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe89c0b2eb0 0x7fe89c09d1c0 secure :-1 s=THROTTLE_DONE pgs=597 cs=0 l=1 rx=0x7fe898002f30 tx=0x7fe898007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.538+0000 7fe8a0e8d700 1 -- 172.21.15.38:0/2406639675 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe898011790 con 0x7fe89c0b2eb0 2020-06-12T17:50:02.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.538+0000 7fe8a168e700 1 --2- 172.21.15.38:0/2406639675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe89c0b2eb0 0x7fe89c09d1c0 secure :-1 s=THROTTLE_DONE pgs=597 cs=0 l=1 rx=0x7fe898002f30 tx=0x7fe898007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.538+0000 7fe8a0e8d700 1 -- 172.21.15.38:0/2406639675 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe898011bb0 con 0x7fe89c0b2eb0 2020-06-12T17:50:02.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.538+0000 7fe8a40f3700 1 -- 172.21.15.38:0/2406639675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe89c0b2eb0 msgr2=0x7fe89c09d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:02.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.538+0000 7fe8a40f3700 1 --2- 172.21.15.38:0/2406639675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe89c0b2eb0 0x7fe89c09d1c0 secure :-1 s=READY pgs=597 cs=0 l=1 rx=0x7fe898002f30 tx=0x7fe898007e60).stop 2020-06-12T17:50:02.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.538+0000 7fe8a40f3700 1 -- 172.21.15.38:0/2406639675 shutdown_connections 2020-06-12T17:50:02.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.538+0000 7fe8a40f3700 1 --2- 172.21.15.38:0/2406639675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe89c146680 0x7fe89c0ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:02.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.538+0000 7fe8a40f3700 1 --2- 172.21.15.38:0/2406639675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe89c0b2eb0 0x7fe89c09d1c0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:02.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.538+0000 7fe8a40f3700 1 -- 172.21.15.38:0/2406639675 >> 172.21.15.38:0/2406639675 conn(0x7fe89c0b5a20 msgr2=0x7fe89c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:02.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.538+0000 7fe8a40f3700 1 -- 172.21.15.38:0/2406639675 shutdown_connections 2020-06-12T17:50:02.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.538+0000 7fe8a40f3700 1 -- 172.21.15.38:0/2406639675 wait complete. 2020-06-12T17:50:02.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.539+0000 7fe8a40f3700 1 Processor -- start 2020-06-12T17:50:02.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.539+0000 7fe8a40f3700 1 -- start start 2020-06-12T17:50:02.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.540+0000 7fe8a40f3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe89c09d620 0x7fe89c157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:02.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.540+0000 7fe8a40f3700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89c063580 con 0x7fe89c146680 2020-06-12T17:50:02.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.540+0000 7fe8a40f3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89c09ad50 con 0x7fe89c0b2eb0 2020-06-12T17:50:02.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.540+0000 7fe8a40f3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c09aff0 con 0x7fe89c09d620 2020-06-12T17:50:02.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.540+0000 7fe8a2690700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe89c146680 0x7fe89c062800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40178/0 (socket says 172.21.15.38:40178) 2020-06-12T17:50:02.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.540+0000 7fe8a2690700 1 -- 172.21.15.38:0/3323485022 learned_addr learned my addr 172.21.15.38:0/3323485022 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:02.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.540+0000 7fe8a1e8f700 1 --2- 172.21.15.38:0/3323485022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe89c09d620 0x7fe89c157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:02.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.540+0000 7fe88effd700 1 -- 172.21.15.38:0/3323485022 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 414606326 0 0) 0x7fe89c063580 con 0x7fe89c146680 2020-06-12T17:50:02.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.540+0000 7fe88effd700 1 -- 172.21.15.38:0/3323485022 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe87c002fe0 con 0x7fe89c146680 2020-06-12T17:50:02.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.540+0000 7fe88effd700 1 -- 172.21.15.38:0/3323485022 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512638457 0 0) 0x7fe89c09ad50 con 0x7fe89c0b2eb0 2020-06-12T17:50:02.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.540+0000 7fe88effd700 1 -- 172.21.15.38:0/3323485022 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe89c063580 con 0x7fe89c0b2eb0 2020-06-12T17:50:02.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.541+0000 7fe8a1e8f700 1 -- 172.21.15.38:0/3323485022 >> v1:172.21.15.150:6789/0 conn(0x7fe89c0b2eb0 legacy=0x7fe89c0b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:02.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.541+0000 7fe8a1e8f700 1 -- 172.21.15.38:0/3323485022 >> v1:172.21.15.38:6789/0 conn(0x7fe89c146680 legacy=0x7fe89c062800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:02.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.541+0000 7fe8a1e8f700 1 -- 172.21.15.38:0/3323485022 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c09b290 con 0x7fe89c09d620 2020-06-12T17:50:02.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.541+0000 7fe8a1e8f700 1 --2- 172.21.15.38:0/3323485022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe89c09d620 0x7fe89c157540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe890002f30 tx=0x7fe890007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.541+0000 7fe8a1e8f700 1 --2- 172.21.15.38:0/3323485022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe89c09d620 0x7fe89c157540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe890002f30 tx=0x7fe890007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.541+0000 7fe8a1e8f700 1 --2- 172.21.15.38:0/3323485022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe89c09d620 0x7fe89c157540 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7fe890002f30 tx=0x7fe890007e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:02.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.541+0000 7fe8a1e8f700 1 --2- 172.21.15.38:0/3323485022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe89c09d620 0x7fe89c157540 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7fe890002f30 tx=0x7fe890007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.541+0000 7fe88effd700 1 -- 172.21.15.38:0/3323485022 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe890007530 con 0x7fe89c09d620 2020-06-12T17:50:02.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.541+0000 7fe8a1e8f700 1 --2- 172.21.15.38:0/3323485022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe89c09d620 0x7fe89c157540 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7fe890002f30 tx=0x7fe890007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.541+0000 7fe88effd700 1 -- 172.21.15.38:0/3323485022 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8900056c0 con 0x7fe89c09d620 2020-06-12T17:50:02.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.541+0000 7fe8a1e8f700 1 --2- 172.21.15.38:0/3323485022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe89c09d620 0x7fe89c157540 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7fe890002f30 tx=0x7fe890007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.541+0000 7fe8a40f3700 1 -- 172.21.15.38:0/3323485022 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe89c1579a0 con 0x7fe89c09d620 2020-06-12T17:50:02.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.541+0000 7fe88effd700 1 -- 172.21.15.38:0/3323485022 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe890005aa0 con 0x7fe89c09d620 2020-06-12T17:50:02.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.541+0000 7fe8a40f3700 1 -- 172.21.15.38:0/3323485022 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe89c062f10 con 0x7fe89c09d620 2020-06-12T17:50:02.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.542+0000 7fe8a1e8f700 1 --2- 172.21.15.38:0/3323485022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe89c09d620 0x7fe89c157540 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7fe890002f30 tx=0x7fe890007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.542+0000 7fe8a40f3700 1 -- 172.21.15.38:0/3323485022 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe89c09ab90 con 0x7fe89c09d620 2020-06-12T17:50:02.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.542+0000 7fe88effd700 1 -- 172.21.15.38:0/3323485022 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fe890005d20 con 0x7fe89c09d620 2020-06-12T17:50:02.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.542+0000 7fe8a1e8f700 1 --2- 172.21.15.38:0/3323485022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe89c09d620 0x7fe89c157540 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7fe890002f30 tx=0x7fe890007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.542+0000 7fe88effd700 1 --2- 172.21.15.38:0/3323485022 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe87c04da10 0x7fe87c04fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:02.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.542+0000 7fe88effd700 1 -- 172.21.15.38:0/3323485022 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe89000d0c0 con 0x7fe89c09d620 2020-06-12T17:50:02.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.543+0000 7fe8a168e700 1 --2- 172.21.15.38:0/3323485022 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe87c04da10 0x7fe87c04fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:02.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.543+0000 7fe8a168e700 1 --2- 172.21.15.38:0/3323485022 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe87c04da10 0x7fe87c04fed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe898007ed0 tx=0x7fe898007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.543+0000 7fe8a168e700 1 --2- 172.21.15.38:0/3323485022 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe87c04da10 0x7fe87c04fed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe898007ed0 tx=0x7fe898007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.543+0000 7fe8a168e700 1 --2- 172.21.15.38:0/3323485022 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe87c04da10 0x7fe87c04fed0 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7fe898007ed0 tx=0x7fe898007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:02.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.546+0000 7fe8a1e8f700 1 --2- 172.21.15.38:0/3323485022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe89c09d620 0x7fe89c157540 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7fe890002f30 tx=0x7fe890007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.546+0000 7fe88effd700 1 -- 172.21.15.38:0/3323485022 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fe89003c590 con 0x7fe89c09d620 2020-06-12T17:50:02.749 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.742+0000 7fe8a40f3700 1 -- 172.21.15.38:0/3323485022 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_8859", "target": ["mon-mgr", ""]}) v1 -- 0x7fe89c056c30 con 0x7fe87c04da10 2020-06-12T17:50:02.750 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.746+0000 7fe8a168e700 1 --2- 172.21.15.38:0/3323485022 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe87c04da10 0x7fe87c04fed0 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7fe898007ed0 tx=0x7fe898007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:02.750 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.746+0000 7fe88effd700 1 -- 172.21.15.38:0/3323485022 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7fe89c056c30 con 0x7fe87c04da10 2020-06-12T17:50:02.751 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_8859/5b199884-a010-442a-a2b7-df88adb5aeb6 2020-06-12T17:50:02.752 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.747+0000 7fe8a40f3700 1 -- 172.21.15.38:0/3323485022 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe87c04da10 msgr2=0x7fe87c04fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:02.752 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.747+0000 7fe8a40f3700 1 --2- 172.21.15.38:0/3323485022 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe87c04da10 0x7fe87c04fed0 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7fe898007ed0 tx=0x7fe898007e60).stop 2020-06-12T17:50:02.752 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.747+0000 7fe8a40f3700 1 -- 172.21.15.38:0/3323485022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe89c09d620 msgr2=0x7fe89c157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:02.752 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.747+0000 7fe8a40f3700 1 --2- 172.21.15.38:0/3323485022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe89c09d620 0x7fe89c157540 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7fe890002f30 tx=0x7fe890007e60).stop 2020-06-12T17:50:02.753 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.747+0000 7fe8a40f3700 1 -- 172.21.15.38:0/3323485022 shutdown_connections 2020-06-12T17:50:02.753 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.747+0000 7fe8a40f3700 1 --2- 172.21.15.38:0/3323485022 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe87c04da10 0x7fe87c04fed0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:02.753 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.747+0000 7fe8a40f3700 1 --2- 172.21.15.38:0/3323485022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe89c09d620 0x7fe89c157540 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:02.753 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.747+0000 7fe8a40f3700 1 -- 172.21.15.38:0/3323485022 >> 172.21.15.38:0/3323485022 conn(0x7fe89c0b5a20 msgr2=0x7fe89c0b7040 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:02.753 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.747+0000 7fe8a40f3700 1 -- 172.21.15.38:0/3323485022 shutdown_connections 2020-06-12T17:50:02.754 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:02.747+0000 7fe8a40f3700 1 -- 172.21.15.38:0/3323485022 wait complete. 2020-06-12T17:50:02.761 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_8859 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_8859/5b199884-a010-442a-a2b7-df88adb5aeb6 2020-06-12T17:50:02.761 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:02.762 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:02.762 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:02.778 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:02.779 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:02.779 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8859/5b199884-a010-442a-a2b7-df88adb5aeb6/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:02.890 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:02.891 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:02.891 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112047 s, 93.6 MB/s 2020-06-12T17:50:02.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:02.892 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:02.892 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:02.908 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:02.908 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:02.909 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8859/5b199884-a010-442a-a2b7-df88adb5aeb6/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:02.999 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:02.999 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:02.999 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127015 s, 82.6 MB/s 2020-06-12T17:50:03.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:03.001 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:03.001 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:03.017 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:03.018 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:03.018 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8859/5b199884-a010-442a-a2b7-df88adb5aeb6/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:03.105 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:03.105 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:03.105 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106374 s, 98.6 MB/s 2020-06-12T17:50:03.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:03.107 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:03.107 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:03.122 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:03.123 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:03.124 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8859/5b199884-a010-442a-a2b7-df88adb5aeb6/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:03.210 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:03.210 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:03.211 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103902 s, 101 MB/s 2020-06-12T17:50:03.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:03.212 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:03.213 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:03.228 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:03.229 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:03.230 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8859/5b199884-a010-442a-a2b7-df88adb5aeb6/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:03.318 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:03.318 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:03.319 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118864 s, 88.2 MB/s 2020-06-12T17:50:03.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:03.320 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:03.320 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:03.336 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:03.336 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:03.337 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8859/5b199884-a010-442a-a2b7-df88adb5aeb6/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:03.425 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:03.426 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:03.426 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996848 s, 105 MB/s 2020-06-12T17:50:03.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:03.427 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:03.428 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:03.443 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:03.443 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:03.444 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8859/5b199884-a010-442a-a2b7-df88adb5aeb6/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:03.530 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:03.531 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:03.531 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113121 s, 92.7 MB/s 2020-06-12T17:50:03.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:03.533 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:03.533 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:03.551 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:03.551 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:03.552 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8859/5b199884-a010-442a-a2b7-df88adb5aeb6/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:03.638 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:03.638 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:03.639 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100526 s, 104 MB/s 2020-06-12T17:50:03.640 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:03.640 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:03.641 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:03.656 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:03.656 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:03.657 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8859/5b199884-a010-442a-a2b7-df88adb5aeb6/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:03.745 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:03.746 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:03.746 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127226 s, 82.4 MB/s 2020-06-12T17:50:03.747 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:03.748 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:03.748 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:03.764 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:03.764 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:03.765 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8859/5b199884-a010-442a-a2b7-df88adb5aeb6/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:03.850 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:03.850 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:03.850 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929203 s, 113 MB/s 2020-06-12T17:50:03.851 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_7611 2020-06-12T17:50:03.969 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.965+0000 7f20688d8700 1 Processor -- start 2020-06-12T17:50:03.969 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.965+0000 7f20688d8700 1 -- start start 2020-06-12T17:50:03.971 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.966+0000 7f20688d8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f206409b190 0x7f2064066b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:03.972 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.966+0000 7f20688d8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20641438f0 0x7f20640b3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:03.972 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.966+0000 7f20688d8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2064147550 con 0x7f206409dd30 2020-06-12T17:50:03.972 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.966+0000 7f20688d8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2064067380 con 0x7f206409b190 2020-06-12T17:50:03.972 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.966+0000 7f20688d8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206409e110 con 0x7f20641438f0 2020-06-12T17:50:03.972 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.967+0000 7f2061d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f206409b190 0x7f2064066b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:03.973 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.967+0000 7f206259c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f206409dd30 0x7f20641431e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:60914/0 (socket says 172.21.15.38:60914) 2020-06-12T17:50:03.973 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.967+0000 7f2062d9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20641438f0 0x7f20640b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:03.973 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.967+0000 7f206259c700 1 -- 172.21.15.38:0/3312790103 learned_addr learned my addr 172.21.15.38:0/3312790103 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:03.973 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.967+0000 7f2061d9b700 1 -- 172.21.15.38:0/3312790103 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20641438f0 msgr2=0x7f20640b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:03.973 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.967+0000 7f2061d9b700 1 --2- 172.21.15.38:0/3312790103 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20641438f0 0x7f20640b3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:03.974 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.967+0000 7f2061d9b700 1 -- 172.21.15.38:0/3312790103 >> v1:172.21.15.150:6789/0 conn(0x7f206409dd30 legacy=0x7f20641431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:03.974 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.967+0000 7f2061d9b700 1 -- 172.21.15.38:0/3312790103 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2064067000 con 0x7f206409b190 2020-06-12T17:50:03.974 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.967+0000 7f206159a700 1 -- 172.21.15.38:0/3312790103 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376725610 0 0) 0x7f2064147550 con 0x7f206409dd30 2020-06-12T17:50:03.974 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.967+0000 7f2061d9b700 1 --2- 172.21.15.38:0/3312790103 >> v2:172.21.15.150:3300/0 conn(0x7f206409b190 0x7f2064066b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f20540032b0 tx=0x7f20540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:03.974 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.967+0000 7f2061d9b700 1 --2- 172.21.15.38:0/3312790103 >> v2:172.21.15.150:3300/0 conn(0x7f206409b190 0x7f2064066b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f20540032b0 tx=0x7f20540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:03.975 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.967+0000 7f2061d9b700 1 --2- 172.21.15.38:0/3312790103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f206409b190 0x7f2064066b20 secure :-1 s=READY pgs=352 cs=0 l=1 rx=0x7f20540032b0 tx=0x7f20540081e0).ready entity=mon.1 client_cookie=952b4c7dc6aafafa server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:03.975 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.967+0000 7f2061d9b700 1 --2- 172.21.15.38:0/3312790103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f206409b190 0x7f2064066b20 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7f20540032b0 tx=0x7f20540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:03.975 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.967+0000 7f206159a700 1 -- 172.21.15.38:0/3312790103 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2054011de0 con 0x7f206409b190 2020-06-12T17:50:03.975 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.967+0000 7f2061d9b700 1 --2- 172.21.15.38:0/3312790103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f206409b190 0x7f2064066b20 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7f20540032b0 tx=0x7f20540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:03.975 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.967+0000 7f2061d9b700 1 --2- 172.21.15.38:0/3312790103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f206409b190 0x7f2064066b20 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7f20540032b0 tx=0x7f20540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:03.976 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.967+0000 7f206159a700 1 -- 172.21.15.38:0/3312790103 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205400a160 con 0x7f206409b190 2020-06-12T17:50:03.976 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.967+0000 7f206159a700 1 -- 172.21.15.38:0/3312790103 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f205400a540 con 0x7f206409b190 2020-06-12T17:50:03.976 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.967+0000 7f20688d8700 1 -- 172.21.15.38:0/3312790103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f206409b190 msgr2=0x7f2064066b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:03.976 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.967+0000 7f20688d8700 1 --2- 172.21.15.38:0/3312790103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f206409b190 0x7f2064066b20 secure :-1 s=READY pgs=352 cs=0 l=1 rx=0x7f20540032b0 tx=0x7f20540081e0).stop 2020-06-12T17:50:03.976 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.968+0000 7f20688d8700 1 -- 172.21.15.38:0/3312790103 shutdown_connections 2020-06-12T17:50:03.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.968+0000 7f20688d8700 1 --2- 172.21.15.38:0/3312790103 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20641438f0 0x7f20640b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:03.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.968+0000 7f20688d8700 1 --2- 172.21.15.38:0/3312790103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f206409b190 0x7f2064066b20 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:03.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.968+0000 7f20688d8700 1 -- 172.21.15.38:0/3312790103 >> 172.21.15.38:0/3312790103 conn(0x7f20640b5a20 msgr2=0x7f206405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:03.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.968+0000 7f20688d8700 1 -- 172.21.15.38:0/3312790103 shutdown_connections 2020-06-12T17:50:03.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.968+0000 7f20688d8700 1 -- 172.21.15.38:0/3312790103 wait complete. 2020-06-12T17:50:03.982 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.969+0000 7f20688d8700 1 Processor -- start 2020-06-12T17:50:03.982 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.969+0000 7f20688d8700 1 -- start start 2020-06-12T17:50:03.982 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.969+0000 7f20688d8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f206409b190 0x7f206409d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:03.983 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.969+0000 7f20688d8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f206409dd30 0x7f20640b7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:03.983 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.969+0000 7f20688d8700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2064157730 con 0x7f20641438f0 2020-06-12T17:50:03.983 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.969+0000 7f20688d8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20640b80b0 con 0x7f206409dd30 2020-06-12T17:50:03.983 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.969+0000 7f20688d8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2064153430 con 0x7f206409b190 2020-06-12T17:50:03.983 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.970+0000 7f2062d9d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f20641438f0 0x7f2064153b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40190/0 (socket says 172.21.15.38:40190) 2020-06-12T17:50:03.984 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.970+0000 7f2062d9d700 1 -- 172.21.15.38:0/3453584019 learned_addr learned my addr 172.21.15.38:0/3453584019 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:03.984 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.970+0000 7f206259c700 1 --2- 172.21.15.38:0/3453584019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f206409b190 0x7f206409d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:03.984 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.970+0000 7f2061d9b700 1 --2- 172.21.15.38:0/3453584019 >> v2:172.21.15.150:3300/0 conn(0x7f206409dd30 0x7f20640b7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:03.984 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.970+0000 7f20537fe700 1 -- 172.21.15.38:0/3453584019 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2535605533 0 0) 0x7f2064157730 con 0x7f20641438f0 2020-06-12T17:50:03.984 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.970+0000 7f20537fe700 1 -- 172.21.15.38:0/3453584019 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2040002fe0 con 0x7f20641438f0 2020-06-12T17:50:03.985 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.970+0000 7f2061d9b700 1 -- 172.21.15.38:0/3453584019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f206409b190 msgr2=0x7f206409d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:03.985 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.970+0000 7f2061d9b700 1 --2- 172.21.15.38:0/3453584019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f206409b190 0x7f206409d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:03.985 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.970+0000 7f2061d9b700 1 -- 172.21.15.38:0/3453584019 >> v1:172.21.15.38:6789/0 conn(0x7f20641438f0 legacy=0x7f2064153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:03.985 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.970+0000 7f2061d9b700 1 -- 172.21.15.38:0/3453584019 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20641536d0 con 0x7f206409dd30 2020-06-12T17:50:03.985 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.970+0000 7f2061d9b700 1 --2- 172.21.15.38:0/3453584019 >> v2:172.21.15.150:3300/0 conn(0x7f206409dd30 0x7f20640b7c50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f20540032b0 tx=0x7f20540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:03.986 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.970+0000 7f2061d9b700 1 --2- 172.21.15.38:0/3453584019 >> v2:172.21.15.150:3300/0 conn(0x7f206409dd30 0x7f20640b7c50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f20540032b0 tx=0x7f20540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:03.986 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.970+0000 7f2061d9b700 1 --2- 172.21.15.38:0/3453584019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f206409dd30 0x7f20640b7c50 secure :-1 s=READY pgs=353 cs=0 l=1 rx=0x7f20540032b0 tx=0x7f20540081e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:03.986 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.970+0000 7f2061d9b700 1 --2- 172.21.15.38:0/3453584019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f206409dd30 0x7f20640b7c50 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7f20540032b0 tx=0x7f20540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:03.986 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.970+0000 7f20537fe700 1 -- 172.21.15.38:0/3453584019 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2054011ea0 con 0x7f206409dd30 2020-06-12T17:50:03.986 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.970+0000 7f2061d9b700 1 --2- 172.21.15.38:0/3453584019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f206409dd30 0x7f20640b7c50 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7f20540032b0 tx=0x7f20540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:03.987 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.970+0000 7f2061d9b700 1 --2- 172.21.15.38:0/3453584019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f206409dd30 0x7f20640b7c50 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7f20540032b0 tx=0x7f20540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:03.987 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.970+0000 7f20537fe700 1 -- 172.21.15.38:0/3453584019 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2054005c30 con 0x7f206409dd30 2020-06-12T17:50:03.987 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.970+0000 7f20688d8700 1 -- 172.21.15.38:0/3453584019 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20640b2ab0 con 0x7f206409dd30 2020-06-12T17:50:03.988 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.970+0000 7f20537fe700 1 -- 172.21.15.38:0/3453584019 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2054007150 con 0x7f206409dd30 2020-06-12T17:50:03.988 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.970+0000 7f20688d8700 1 -- 172.21.15.38:0/3453584019 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20641574a0 con 0x7f206409dd30 2020-06-12T17:50:03.988 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.971+0000 7f2061d9b700 1 --2- 172.21.15.38:0/3453584019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f206409dd30 0x7f20640b7c50 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7f20540032b0 tx=0x7f20540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:03.988 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.971+0000 7f20688d8700 1 -- 172.21.15.38:0/3453584019 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2064153860 con 0x7f206409dd30 2020-06-12T17:50:03.988 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.972+0000 7f20537fe700 1 -- 172.21.15.38:0/3453584019 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f2054007350 con 0x7f206409dd30 2020-06-12T17:50:03.988 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.972+0000 7f2061d9b700 1 --2- 172.21.15.38:0/3453584019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f206409dd30 0x7f20640b7c50 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7f20540032b0 tx=0x7f20540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:03.989 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.972+0000 7f20537fe700 1 --2- 172.21.15.38:0/3453584019 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f204004d900 0x7f204004fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:03.989 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.972+0000 7f20537fe700 1 -- 172.21.15.38:0/3453584019 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2054061b10 con 0x7f206409dd30 2020-06-12T17:50:03.989 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.972+0000 7f206259c700 1 --2- 172.21.15.38:0/3453584019 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f204004d900 0x7f204004fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:03.989 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.972+0000 7f206259c700 1 --2- 172.21.15.38:0/3453584019 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f204004d900 0x7f204004fdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2058000b80 tx=0x7f2058001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:03.989 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.972+0000 7f206259c700 1 --2- 172.21.15.38:0/3453584019 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f204004d900 0x7f204004fdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2058000b80 tx=0x7f2058001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:03.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.972+0000 7f206259c700 1 --2- 172.21.15.38:0/3453584019 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f204004d900 0x7f204004fdc0 secure :-1 s=READY pgs=238 cs=0 l=1 rx=0x7f2058000b80 tx=0x7f2058001680).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:03.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.976+0000 7f2061d9b700 1 --2- 172.21.15.38:0/3453584019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f206409dd30 0x7f20640b7c50 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7f20540032b0 tx=0x7f20540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:03.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:03.976+0000 7f20537fe700 1 -- 172.21.15.38:0/3453584019 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f205403d330 con 0x7f206409dd30 2020-06-12T17:50:04.176 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.173+0000 7f20688d8700 1 -- 172.21.15.38:0/3453584019 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_7611", "target": ["mon-mgr", ""]}) v1 -- 0x7f2064056c30 con 0x7f204004d900 2020-06-12T17:50:04.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.193+0000 7f206259c700 1 --2- 172.21.15.38:0/3453584019 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f204004d900 0x7f204004fdc0 secure :-1 s=THROTTLE_DONE pgs=238 cs=0 l=1 rx=0x7f2058000b80 tx=0x7f2058001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:04.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.193+0000 7f20537fe700 1 -- 172.21.15.38:0/3453584019 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2064056c30 con 0x7f204004d900 2020-06-12T17:50:04.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.194+0000 7f20688d8700 1 -- 172.21.15.38:0/3453584019 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f204004d900 msgr2=0x7f204004fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:04.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.194+0000 7f20688d8700 1 --2- 172.21.15.38:0/3453584019 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f204004d900 0x7f204004fdc0 secure :-1 s=READY pgs=238 cs=0 l=1 rx=0x7f2058000b80 tx=0x7f2058001680).stop 2020-06-12T17:50:04.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.194+0000 7f20688d8700 1 -- 172.21.15.38:0/3453584019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f206409dd30 msgr2=0x7f20640b7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:04.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.194+0000 7f20688d8700 1 --2- 172.21.15.38:0/3453584019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f206409dd30 0x7f20640b7c50 secure :-1 s=READY pgs=353 cs=0 l=1 rx=0x7f20540032b0 tx=0x7f20540081e0).stop 2020-06-12T17:50:04.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.194+0000 7f20688d8700 1 -- 172.21.15.38:0/3453584019 shutdown_connections 2020-06-12T17:50:04.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.194+0000 7f20688d8700 1 --2- 172.21.15.38:0/3453584019 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f204004d900 0x7f204004fdc0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:04.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.194+0000 7f20688d8700 1 --2- 172.21.15.38:0/3453584019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f206409b190 0x7f206409d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:04.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.194+0000 7f20688d8700 1 --2- 172.21.15.38:0/3453584019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f206409dd30 0x7f20640b7c50 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:04.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.194+0000 7f20688d8700 1 -- 172.21.15.38:0/3453584019 >> 172.21.15.38:0/3453584019 conn(0x7f20640b5a20 msgr2=0x7f20641431e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:04.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.195+0000 7f20688d8700 1 -- 172.21.15.38:0/3453584019 shutdown_connections 2020-06-12T17:50:04.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.195+0000 7f20688d8700 1 -- 172.21.15.38:0/3453584019 wait complete. 2020-06-12T17:50:04.208 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_7611 2020-06-12T17:50:04.325 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.322+0000 7f1bc40fc700 1 Processor -- start 2020-06-12T17:50:04.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.322+0000 7f1bc40fc700 1 -- start start 2020-06-12T17:50:04.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.323+0000 7f1bc40fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1bbc09df00 0x7f1bbc13c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:04.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.323+0000 7f1bc40fc700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bbc09b960 con 0x7f1bbc0b3ac0 2020-06-12T17:50:04.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.323+0000 7f1bc40fc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bbc09bc00 con 0x7f1bbc142e90 2020-06-12T17:50:04.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.323+0000 7f1bc40fc700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bbc143270 con 0x7f1bbc09df00 2020-06-12T17:50:04.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.323+0000 7f1bc1697700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1bbc09df00 0x7f1bbc13c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:04.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.323+0000 7f1bc1697700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1bbc09df00 0x7f1bbc13c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38384/0 (socket says 172.21.15.38:38384) 2020-06-12T17:50:04.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.323+0000 7f1bc1e98700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f1bbc0b3ac0 0x7f1bbc13bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40196/0 (socket says 172.21.15.38:40196) 2020-06-12T17:50:04.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.323+0000 7f1bc1697700 1 -- 172.21.15.38:0/1720132572 learned_addr learned my addr 172.21.15.38:0/1720132572 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:04.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.323+0000 7f1bc1697700 1 -- 172.21.15.38:0/1720132572 >> v1:172.21.15.150:6789/0 conn(0x7f1bbc142e90 legacy=0x7f1bbc066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:04.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.323+0000 7f1bc1697700 1 -- 172.21.15.38:0/1720132572 >> v1:172.21.15.38:6789/0 conn(0x7f1bbc0b3ac0 legacy=0x7f1bbc13bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:04.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.323+0000 7f1bc1697700 1 -- 172.21.15.38:0/1720132572 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bbc0b48f0 con 0x7f1bbc09df00 2020-06-12T17:50:04.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.323+0000 7f1bc1697700 1 --2- 172.21.15.38:0/1720132572 >> v2:172.21.15.38:3300/0 conn(0x7f1bbc09df00 0x7f1bbc13c650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1bb80032b0 tx=0x7f1bb80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:04.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.323+0000 7f1bc1697700 1 --2- 172.21.15.38:0/1720132572 >> v2:172.21.15.38:3300/0 conn(0x7f1bbc09df00 0x7f1bbc13c650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1bb80032b0 tx=0x7f1bb80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:04.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.323+0000 7f1bc1697700 1 --2- 172.21.15.38:0/1720132572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bbc09df00 0x7f1bbc13c650 secure :-1 s=READY pgs=601 cs=0 l=1 rx=0x7f1bb80032b0 tx=0x7f1bb80081e0).ready entity=mon.0 client_cookie=4e7d4a994d6573fb server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:04.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.323+0000 7f1bc1697700 1 --2- 172.21.15.38:0/1720132572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bbc09df00 0x7f1bbc13c650 secure :-1 s=THROTTLE_DONE pgs=601 cs=0 l=1 rx=0x7f1bb80032b0 tx=0x7f1bb80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:04.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.323+0000 7f1bc0e96700 1 -- 172.21.15.38:0/1720132572 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bb800a160 con 0x7f1bbc09df00 2020-06-12T17:50:04.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.323+0000 7f1bc1697700 1 --2- 172.21.15.38:0/1720132572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bbc09df00 0x7f1bbc13c650 secure :-1 s=THROTTLE_DONE pgs=601 cs=0 l=1 rx=0x7f1bb80032b0 tx=0x7f1bb80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:04.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.324+0000 7f1bc0e96700 1 -- 172.21.15.38:0/1720132572 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb800a2c0 con 0x7f1bbc09df00 2020-06-12T17:50:04.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.324+0000 7f1bc1697700 1 --2- 172.21.15.38:0/1720132572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bbc09df00 0x7f1bbc13c650 secure :-1 s=THROTTLE_DONE pgs=601 cs=0 l=1 rx=0x7f1bb80032b0 tx=0x7f1bb80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:04.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.324+0000 7f1bc0e96700 1 -- 172.21.15.38:0/1720132572 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bb800a6a0 con 0x7f1bbc09df00 2020-06-12T17:50:04.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.324+0000 7f1bc40fc700 1 -- 172.21.15.38:0/1720132572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bbc09df00 msgr2=0x7f1bbc13c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:04.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.324+0000 7f1bc40fc700 1 --2- 172.21.15.38:0/1720132572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bbc09df00 0x7f1bbc13c650 secure :-1 s=READY pgs=601 cs=0 l=1 rx=0x7f1bb80032b0 tx=0x7f1bb80081e0).stop 2020-06-12T17:50:04.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.324+0000 7f1bc40fc700 1 -- 172.21.15.38:0/1720132572 shutdown_connections 2020-06-12T17:50:04.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.324+0000 7f1bc40fc700 1 --2- 172.21.15.38:0/1720132572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bbc09df00 0x7f1bbc13c650 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:04.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.324+0000 7f1bc40fc700 1 -- 172.21.15.38:0/1720132572 >> 172.21.15.38:0/1720132572 conn(0x7f1bbc0b5a20 msgr2=0x7f1bbc05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:04.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.324+0000 7f1bc40fc700 1 -- 172.21.15.38:0/1720132572 shutdown_connections 2020-06-12T17:50:04.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.324+0000 7f1bc40fc700 1 -- 172.21.15.38:0/1720132572 wait complete. 2020-06-12T17:50:04.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.325+0000 7f1bc40fc700 1 Processor -- start 2020-06-12T17:50:04.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.325+0000 7f1bc40fc700 1 -- start start 2020-06-12T17:50:04.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1bc40fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1bbc09df00 0x7f1bbc061890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:04.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1bc40fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1bbc0b3ac0 0x7f1bbc063570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:04.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1bc40fc700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bbc061cf0 con 0x7f1bbc142e90 2020-06-12T17:50:04.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1bc40fc700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bbc063ef0 con 0x7f1bbc0b3ac0 2020-06-12T17:50:04.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1bc40fc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bbc064190 con 0x7f1bbc09df00 2020-06-12T17:50:04.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1bc1697700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1bbc0b3ac0 0x7f1bbc063570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:04.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1bc1697700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1bbc0b3ac0 0x7f1bbc063570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38388/0 (socket says 172.21.15.38:38388) 2020-06-12T17:50:04.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1bc1697700 1 -- 172.21.15.38:0/2040434517 learned_addr learned my addr 172.21.15.38:0/2040434517 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:04.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1bc2699700 1 --1- 172.21.15.38:0/2040434517 >> v1:172.21.15.38:6789/0 conn(0x7f1bbc142e90 0x7f1bbc13bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40206/0 (socket says 172.21.15.38:40206) 2020-06-12T17:50:04.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1bc1e98700 1 --2- 172.21.15.38:0/2040434517 >> v2:172.21.15.150:3300/0 conn(0x7f1bbc09df00 0x7f1bbc061890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:04.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1bc1697700 1 -- 172.21.15.38:0/2040434517 >> v2:172.21.15.150:3300/0 conn(0x7f1bbc09df00 msgr2=0x7f1bbc061890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:04.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1bc1697700 1 --2- 172.21.15.38:0/2040434517 >> v2:172.21.15.150:3300/0 conn(0x7f1bbc09df00 0x7f1bbc061890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:04.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1bc1697700 1 -- 172.21.15.38:0/2040434517 >> v1:172.21.15.38:6789/0 conn(0x7f1bbc142e90 legacy=0x7f1bbc13bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:04.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1bc1697700 1 -- 172.21.15.38:0/2040434517 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bbc1536a0 con 0x7f1bbc0b3ac0 2020-06-12T17:50:04.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1baaffd700 1 -- 172.21.15.38:0/2040434517 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2957991981 0 0) 0x7f1bbc09bc00 con 0x7f1bbc142e90 2020-06-12T17:50:04.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1bc1e98700 1 --2- 172.21.15.38:0/2040434517 >> v2:172.21.15.150:3300/0 conn(0x7f1bbc09df00 0x7f1bbc061890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:50:04.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1bc1697700 1 --2- 172.21.15.38:0/2040434517 >> v2:172.21.15.38:3300/0 conn(0x7f1bbc0b3ac0 0x7f1bbc063570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1bb80032b0 tx=0x7f1bb80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:04.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1bc1697700 1 --2- 172.21.15.38:0/2040434517 >> v2:172.21.15.38:3300/0 conn(0x7f1bbc0b3ac0 0x7f1bbc063570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1bb80032b0 tx=0x7f1bb80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:04.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1bc1697700 1 --2- 172.21.15.38:0/2040434517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bbc0b3ac0 0x7f1bbc063570 secure :-1 s=READY pgs=603 cs=0 l=1 rx=0x7f1bb80032b0 tx=0x7f1bb80081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:04.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1bc1697700 1 --2- 172.21.15.38:0/2040434517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bbc0b3ac0 0x7f1bbc063570 secure :-1 s=THROTTLE_DONE pgs=603 cs=0 l=1 rx=0x7f1bb80032b0 tx=0x7f1bb80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:04.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1baaffd700 1 -- 172.21.15.38:0/2040434517 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bb8005c30 con 0x7f1bbc0b3ac0 2020-06-12T17:50:04.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1bc1697700 1 --2- 172.21.15.38:0/2040434517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bbc0b3ac0 0x7f1bbc063570 secure :-1 s=THROTTLE_DONE pgs=603 cs=0 l=1 rx=0x7f1bb80032b0 tx=0x7f1bb80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:04.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1baaffd700 1 -- 172.21.15.38:0/2040434517 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb8005d90 con 0x7f1bbc0b3ac0 2020-06-12T17:50:04.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1bc1697700 1 --2- 172.21.15.38:0/2040434517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bbc0b3ac0 0x7f1bbc063570 secure :-1 s=THROTTLE_DONE pgs=603 cs=0 l=1 rx=0x7f1bb80032b0 tx=0x7f1bb80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:04.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1bc40fc700 1 -- 172.21.15.38:0/2040434517 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bbc153a40 con 0x7f1bbc0b3ac0 2020-06-12T17:50:04.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1baaffd700 1 -- 172.21.15.38:0/2040434517 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bb800f760 con 0x7f1bbc0b3ac0 2020-06-12T17:50:04.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.326+0000 7f1bc40fc700 1 -- 172.21.15.38:0/2040434517 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bbc13c810 con 0x7f1bbc0b3ac0 2020-06-12T17:50:04.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.327+0000 7f1bc1697700 1 --2- 172.21.15.38:0/2040434517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bbc0b3ac0 0x7f1bbc063570 secure :-1 s=THROTTLE_DONE pgs=603 cs=0 l=1 rx=0x7f1bb80032b0 tx=0x7f1bb80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:04.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.328+0000 7f1bc40fc700 1 -- 172.21.15.38:0/2040434517 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bbc063d50 con 0x7f1bbc0b3ac0 2020-06-12T17:50:04.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.328+0000 7f1baaffd700 1 -- 172.21.15.38:0/2040434517 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f1bb800f9a0 con 0x7f1bbc0b3ac0 2020-06-12T17:50:04.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.328+0000 7f1bc1697700 1 --2- 172.21.15.38:0/2040434517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bbc0b3ac0 0x7f1bbc063570 secure :-1 s=THROTTLE_DONE pgs=603 cs=0 l=1 rx=0x7f1bb80032b0 tx=0x7f1bb80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:04.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.328+0000 7f1baaffd700 1 --2- 172.21.15.38:0/2040434517 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1b9c04d3d0 0x7f1b9c04f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:04.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.328+0000 7f1baaffd700 1 -- 172.21.15.38:0/2040434517 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1bb8061fb0 con 0x7f1bbc0b3ac0 2020-06-12T17:50:04.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.328+0000 7f1bc1e98700 1 --2- 172.21.15.38:0/2040434517 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1b9c04d3d0 0x7f1b9c04f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:04.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.329+0000 7f1bc1e98700 1 --2- 172.21.15.38:0/2040434517 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1b9c04d3d0 0x7f1b9c04f890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1bbc061380 tx=0x7f1bac001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:04.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.329+0000 7f1bc1e98700 1 --2- 172.21.15.38:0/2040434517 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1b9c04d3d0 0x7f1b9c04f890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1bbc061380 tx=0x7f1bac001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:04.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.329+0000 7f1bc1e98700 1 --2- 172.21.15.38:0/2040434517 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1b9c04d3d0 0x7f1b9c04f890 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7f1bbc061380 tx=0x7f1bac001680).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:04.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.331+0000 7f1bc1697700 1 --2- 172.21.15.38:0/2040434517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bbc0b3ac0 0x7f1bbc063570 secure :-1 s=THROTTLE_DONE pgs=603 cs=0 l=1 rx=0x7f1bb80032b0 tx=0x7f1bb80081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:04.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.331+0000 7f1baaffd700 1 -- 172.21.15.38:0/2040434517 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f1bbc063d50 con 0x7f1bbc0b3ac0 2020-06-12T17:50:04.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.530+0000 7f1bc40fc700 1 -- 172.21.15.38:0/2040434517 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_7611", "target": ["mon-mgr", ""]}) v1 -- 0x7f1bbc064630 con 0x7f1b9c04d3d0 2020-06-12T17:50:04.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.534+0000 7f1bc1e98700 1 --2- 172.21.15.38:0/2040434517 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1b9c04d3d0 0x7f1b9c04f890 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f1bbc061380 tx=0x7f1bac001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:04.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.534+0000 7f1baaffd700 1 -- 172.21.15.38:0/2040434517 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f1bac00c150 con 0x7f1b9c04d3d0 2020-06-12T17:50:04.538 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_7611/d222c26b-37c1-4efd-86ac-eda3e1f5915a 2020-06-12T17:50:04.540 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.536+0000 7f1bc40fc700 1 -- 172.21.15.38:0/2040434517 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1b9c04d3d0 msgr2=0x7f1b9c04f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:04.540 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.536+0000 7f1bc40fc700 1 --2- 172.21.15.38:0/2040434517 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1b9c04d3d0 0x7f1b9c04f890 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7f1bbc061380 tx=0x7f1bac001680).stop 2020-06-12T17:50:04.540 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.536+0000 7f1bc40fc700 1 -- 172.21.15.38:0/2040434517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bbc0b3ac0 msgr2=0x7f1bbc063570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:04.540 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.536+0000 7f1bc40fc700 1 --2- 172.21.15.38:0/2040434517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bbc0b3ac0 0x7f1bbc063570 secure :-1 s=READY pgs=603 cs=0 l=1 rx=0x7f1bb80032b0 tx=0x7f1bb80081e0).stop 2020-06-12T17:50:04.541 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.536+0000 7f1bc40fc700 1 -- 172.21.15.38:0/2040434517 shutdown_connections 2020-06-12T17:50:04.541 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.536+0000 7f1bc40fc700 1 --2- 172.21.15.38:0/2040434517 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1b9c04d3d0 0x7f1b9c04f890 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:04.541 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.536+0000 7f1bc40fc700 1 --2- 172.21.15.38:0/2040434517 >> v2:172.21.15.150:3300/0 conn(0x7f1bbc09df00 0x7f1bbc061890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:04.541 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.536+0000 7f1bc40fc700 1 --2- 172.21.15.38:0/2040434517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bbc0b3ac0 0x7f1bbc063570 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:04.541 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.536+0000 7f1bc40fc700 1 -- 172.21.15.38:0/2040434517 >> 172.21.15.38:0/2040434517 conn(0x7f1bbc0b5a20 msgr2=0x7f1bbc09cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:04.542 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.536+0000 7f1bc40fc700 1 -- 172.21.15.38:0/2040434517 shutdown_connections 2020-06-12T17:50:04.542 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:04.536+0000 7f1bc40fc700 1 -- 172.21.15.38:0/2040434517 wait complete. 2020-06-12T17:50:04.549 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_7611 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_7611/d222c26b-37c1-4efd-86ac-eda3e1f5915a 2020-06-12T17:50:04.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:04.550 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:04.551 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:04.566 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:04.567 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:04.567 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7611/d222c26b-37c1-4efd-86ac-eda3e1f5915a/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:04.656 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:04.656 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:04.656 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108004 s, 97.1 MB/s 2020-06-12T17:50:04.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:04.658 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:04.658 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:04.674 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:04.674 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:04.675 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7611/d222c26b-37c1-4efd-86ac-eda3e1f5915a/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:04.761 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:04.761 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:04.761 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010876 s, 96.4 MB/s 2020-06-12T17:50:04.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:04.763 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:04.764 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:04.779 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:04.779 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:04.780 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7611/d222c26b-37c1-4efd-86ac-eda3e1f5915a/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:04.867 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:04.868 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:04.868 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954814 s, 110 MB/s 2020-06-12T17:50:04.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:04.869 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:04.870 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:04.885 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:04.886 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:04.886 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7611/d222c26b-37c1-4efd-86ac-eda3e1f5915a/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:04.977 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:04.977 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:04.977 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113727 s, 92.2 MB/s 2020-06-12T17:50:04.978 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:04.979 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:04.979 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:04.995 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:04.996 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:04.997 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7611/d222c26b-37c1-4efd-86ac-eda3e1f5915a/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:05.082 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:05.082 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:05.083 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959331 s, 109 MB/s 2020-06-12T17:50:05.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:05.084 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:05.084 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:05.103 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:05.103 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:05.104 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7611/d222c26b-37c1-4efd-86ac-eda3e1f5915a/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:05.200 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:05.200 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:05.201 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104429 s, 100 MB/s 2020-06-12T17:50:05.202 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:05.203 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:05.204 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:05.221 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:05.222 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:05.223 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7611/d222c26b-37c1-4efd-86ac-eda3e1f5915a/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:05.311 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:05.311 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:05.312 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103177 s, 102 MB/s 2020-06-12T17:50:05.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:05.313 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:05.314 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:05.328 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:05.338 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:05.342 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7611/d222c26b-37c1-4efd-86ac-eda3e1f5915a/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:05.426 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:05.426 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:05.427 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113438 s, 92.4 MB/s 2020-06-12T17:50:05.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:05.428 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:05.429 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:05.444 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:05.445 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:05.445 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7611/d222c26b-37c1-4efd-86ac-eda3e1f5915a/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:05.536 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:05.537 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:05.537 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110741 s, 94.7 MB/s 2020-06-12T17:50:05.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:05.540 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:05.540 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:05.557 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:05.558 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:05.558 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7611/d222c26b-37c1-4efd-86ac-eda3e1f5915a/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:05.646 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:05.647 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:05.647 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125017 s, 83.9 MB/s 2020-06-12T17:50:05.649 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_7455 2020-06-12T17:50:05.768 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.765+0000 7f12e1c0a700 1 Processor -- start 2020-06-12T17:50:05.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.765+0000 7f12e1c0a700 1 -- start start 2020-06-12T17:50:05.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.766+0000 7f12e1c0a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12dc0ad5b0 0x7f12dc0b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:05.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.766+0000 7f12e1c0a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f12dc09d8d0 0x7f12dc1421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:05.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.766+0000 7f12e1c0a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12dc146d20 con 0x7f12dc146680 2020-06-12T17:50:05.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.766+0000 7f12e1c0a700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12dc066a80 con 0x7f12dc09d8d0 2020-06-12T17:50:05.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.766+0000 7f12e1c0a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc146f50 con 0x7f12dc0ad5b0 2020-06-12T17:50:05.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.766+0000 7f12dbfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f12dc09d8d0 0x7f12dc1421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:05.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.766+0000 7f12dbfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f12dc09d8d0 0x7f12dc1421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38398/0 (socket says 172.21.15.38:38398) 2020-06-12T17:50:05.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.766+0000 7f12dbfff700 1 -- 172.21.15.38:0/3546665619 learned_addr learned my addr 172.21.15.38:0/3546665619 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:05.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.766+0000 7f12daffd700 1 --2- 172.21.15.38:0/3546665619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12dc0ad5b0 0x7f12dc0b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:05.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.766+0000 7f12dbfff700 1 -- 172.21.15.38:0/3546665619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12dc0ad5b0 msgr2=0x7f12dc0b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:05.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.766+0000 7f12dbfff700 1 --2- 172.21.15.38:0/3546665619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12dc0ad5b0 0x7f12dc0b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:05.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.766+0000 7f12dbfff700 1 -- 172.21.15.38:0/3546665619 >> v1:172.21.15.150:6789/0 conn(0x7f12dc146680 legacy=0x7f12dc09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:05.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.766+0000 7f12dbfff700 1 -- 172.21.15.38:0/3546665619 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc146a60 con 0x7f12dc09d8d0 2020-06-12T17:50:05.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.766+0000 7f12dbfff700 1 --2- 172.21.15.38:0/3546665619 >> v2:172.21.15.38:3300/0 conn(0x7f12dc09d8d0 0x7f12dc1421d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f12d40032b0 tx=0x7f12d40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:05.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.766+0000 7f12dbfff700 1 --2- 172.21.15.38:0/3546665619 >> v2:172.21.15.38:3300/0 conn(0x7f12dc09d8d0 0x7f12dc1421d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f12d40032b0 tx=0x7f12d40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:05.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.766+0000 7f12dbfff700 1 --2- 172.21.15.38:0/3546665619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12dc09d8d0 0x7f12dc1421d0 secure :-1 s=READY pgs=604 cs=0 l=1 rx=0x7f12d40032b0 tx=0x7f12d40081e0).ready entity=mon.0 client_cookie=32974c7f0be1d0e7 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:05.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.766+0000 7f12dbfff700 1 --2- 172.21.15.38:0/3546665619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12dc09d8d0 0x7f12dc1421d0 secure :-1 s=THROTTLE_DONE pgs=604 cs=0 l=1 rx=0x7f12d40032b0 tx=0x7f12d40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:05.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.766+0000 7f12dbfff700 1 --2- 172.21.15.38:0/3546665619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12dc09d8d0 0x7f12dc1421d0 secure :-1 s=THROTTLE_DONE pgs=604 cs=0 l=1 rx=0x7f12d40032b0 tx=0x7f12d40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:05.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.766+0000 7f12da7fc700 1 -- 172.21.15.38:0/3546665619 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12d4011ea0 con 0x7f12dc09d8d0 2020-06-12T17:50:05.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.766+0000 7f12dbfff700 1 --2- 172.21.15.38:0/3546665619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12dc09d8d0 0x7f12dc1421d0 secure :-1 s=THROTTLE_DONE pgs=604 cs=0 l=1 rx=0x7f12d40032b0 tx=0x7f12d40081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:05.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.766+0000 7f12da7fc700 1 -- 172.21.15.38:0/3546665619 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d400a160 con 0x7f12dc09d8d0 2020-06-12T17:50:05.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.766+0000 7f12da7fc700 1 -- 172.21.15.38:0/3546665619 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12d400a580 con 0x7f12dc09d8d0 2020-06-12T17:50:05.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.766+0000 7f12e1c0a700 1 -- 172.21.15.38:0/3546665619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12dc09d8d0 msgr2=0x7f12dc1421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:05.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.766+0000 7f12e1c0a700 1 --2- 172.21.15.38:0/3546665619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12dc09d8d0 0x7f12dc1421d0 secure :-1 s=READY pgs=604 cs=0 l=1 rx=0x7f12d40032b0 tx=0x7f12d40081e0).stop 2020-06-12T17:50:05.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.767+0000 7f12e1c0a700 1 -- 172.21.15.38:0/3546665619 shutdown_connections 2020-06-12T17:50:05.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.767+0000 7f12e1c0a700 1 --2- 172.21.15.38:0/3546665619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12dc09d8d0 0x7f12dc1421d0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:05.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.767+0000 7f12e1c0a700 1 --2- 172.21.15.38:0/3546665619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12dc0ad5b0 0x7f12dc0b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:05.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.767+0000 7f12e1c0a700 1 -- 172.21.15.38:0/3546665619 >> 172.21.15.38:0/3546665619 conn(0x7f12dc0b5a20 msgr2=0x7f12dc05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:05.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.767+0000 7f12e1c0a700 1 -- 172.21.15.38:0/3546665619 shutdown_connections 2020-06-12T17:50:05.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.767+0000 7f12e1c0a700 1 -- 172.21.15.38:0/3546665619 wait complete. 2020-06-12T17:50:05.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.768+0000 7f12e1c0a700 1 Processor -- start 2020-06-12T17:50:05.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.768+0000 7f12e1c0a700 1 -- start start 2020-06-12T17:50:05.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.769+0000 7f12e1c0a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f12dc0ad5b0 0x7f12dc0644f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:05.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.769+0000 7f12e1c0a700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12dc08f2f0 con 0x7f12dc09d8d0 2020-06-12T17:50:05.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.769+0000 7f12e1c0a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12dc062b10 con 0x7f12dc146680 2020-06-12T17:50:05.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.769+0000 7f12e1c0a700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12dc08f590 con 0x7f12dc0ad5b0 2020-06-12T17:50:05.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.769+0000 7f12db7fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f12dc09d8d0 0x7f12dc08f820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40216/0 (socket says 172.21.15.38:40216) 2020-06-12T17:50:05.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.769+0000 7f12db7fe700 1 -- 172.21.15.38:0/3067599068 learned_addr learned my addr 172.21.15.38:0/3067599068 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:05.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.769+0000 7f12daffd700 1 --2- 172.21.15.38:0/3067599068 >> v2:172.21.15.38:3300/0 conn(0x7f12dc0ad5b0 0x7f12dc0644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:05.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.769+0000 7f12daffd700 1 -- 172.21.15.38:0/3067599068 >> v1:172.21.15.150:6789/0 conn(0x7f12dc146680 legacy=0x7f12dc142700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:05.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.769+0000 7f12daffd700 1 -- 172.21.15.38:0/3067599068 >> v1:172.21.15.38:6789/0 conn(0x7f12dc09d8d0 legacy=0x7f12dc08f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:05.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.769+0000 7f12daffd700 1 -- 172.21.15.38:0/3067599068 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc0b2390 con 0x7f12dc0ad5b0 2020-06-12T17:50:05.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.769+0000 7f12d8ff9700 1 -- 172.21.15.38:0/3067599068 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2530818268 0 0) 0x7f12dc08f2f0 con 0x7f12dc09d8d0 2020-06-12T17:50:05.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.769+0000 7f12daffd700 1 --2- 172.21.15.38:0/3067599068 >> v2:172.21.15.38:3300/0 conn(0x7f12dc0ad5b0 0x7f12dc0644f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f12d0002f30 tx=0x7f12d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:05.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.769+0000 7f12daffd700 1 --2- 172.21.15.38:0/3067599068 >> v2:172.21.15.38:3300/0 conn(0x7f12dc0ad5b0 0x7f12dc0644f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f12d0002f30 tx=0x7f12d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:05.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.769+0000 7f12daffd700 1 --2- 172.21.15.38:0/3067599068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12dc0ad5b0 0x7f12dc0644f0 secure :-1 s=READY pgs=606 cs=0 l=1 rx=0x7f12d0002f30 tx=0x7f12d0007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:05.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.769+0000 7f12daffd700 1 --2- 172.21.15.38:0/3067599068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12dc0ad5b0 0x7f12dc0644f0 secure :-1 s=THROTTLE_DONE pgs=606 cs=0 l=1 rx=0x7f12d0002f30 tx=0x7f12d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:05.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.769+0000 7f12d8ff9700 1 -- 172.21.15.38:0/3067599068 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12d0007530 con 0x7f12dc0ad5b0 2020-06-12T17:50:05.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.769+0000 7f12daffd700 1 --2- 172.21.15.38:0/3067599068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12dc0ad5b0 0x7f12dc0644f0 secure :-1 s=THROTTLE_DONE pgs=606 cs=0 l=1 rx=0x7f12d0002f30 tx=0x7f12d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:05.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.769+0000 7f12e1c0a700 1 -- 172.21.15.38:0/3067599068 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12dc08ee50 con 0x7f12dc0ad5b0 2020-06-12T17:50:05.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.769+0000 7f12d8ff9700 1 -- 172.21.15.38:0/3067599068 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d0014880 con 0x7f12dc0ad5b0 2020-06-12T17:50:05.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.769+0000 7f12daffd700 1 --2- 172.21.15.38:0/3067599068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12dc0ad5b0 0x7f12dc0644f0 secure :-1 s=THROTTLE_DONE pgs=606 cs=0 l=1 rx=0x7f12d0002f30 tx=0x7f12d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:05.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.769+0000 7f12d8ff9700 1 -- 172.21.15.38:0/3067599068 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12d0014ca0 con 0x7f12dc0ad5b0 2020-06-12T17:50:05.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.770+0000 7f12e1c0a700 1 -- 172.21.15.38:0/3067599068 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12dc143050 con 0x7f12dc0ad5b0 2020-06-12T17:50:05.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.770+0000 7f12daffd700 1 --2- 172.21.15.38:0/3067599068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12dc0ad5b0 0x7f12dc0644f0 secure :-1 s=THROTTLE_DONE pgs=606 cs=0 l=1 rx=0x7f12d0002f30 tx=0x7f12d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:05.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.770+0000 7f12e1c0a700 1 -- 172.21.15.38:0/3067599068 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12dc08f160 con 0x7f12dc0ad5b0 2020-06-12T17:50:05.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.770+0000 7f12d8ff9700 1 -- 172.21.15.38:0/3067599068 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f12d00056c0 con 0x7f12dc0ad5b0 2020-06-12T17:50:05.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.771+0000 7f12daffd700 1 --2- 172.21.15.38:0/3067599068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12dc0ad5b0 0x7f12dc0644f0 secure :-1 s=THROTTLE_DONE pgs=606 cs=0 l=1 rx=0x7f12d0002f30 tx=0x7f12d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:05.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.771+0000 7f12d8ff9700 1 --2- 172.21.15.38:0/3067599068 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f12bc04d4b0 0x7f12bc04f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:05.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.771+0000 7f12d8ff9700 1 -- 172.21.15.38:0/3067599068 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f12d000d0c0 con 0x7f12dc0ad5b0 2020-06-12T17:50:05.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.771+0000 7f12db7fe700 1 --2- 172.21.15.38:0/3067599068 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f12bc04d4b0 0x7f12bc04f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:05.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.771+0000 7f12db7fe700 1 --2- 172.21.15.38:0/3067599068 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f12bc04d4b0 0x7f12bc04f970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f12cc001260 tx=0x7f12cc001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:05.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.771+0000 7f12db7fe700 1 --2- 172.21.15.38:0/3067599068 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f12bc04d4b0 0x7f12bc04f970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f12cc001260 tx=0x7f12cc001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:05.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.771+0000 7f12db7fe700 1 --2- 172.21.15.38:0/3067599068 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f12bc04d4b0 0x7f12bc04f970 secure :-1 s=READY pgs=240 cs=0 l=1 rx=0x7f12cc001260 tx=0x7f12cc001680).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:05.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.774+0000 7f12daffd700 1 --2- 172.21.15.38:0/3067599068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12dc0ad5b0 0x7f12dc0644f0 secure :-1 s=THROTTLE_DONE pgs=606 cs=0 l=1 rx=0x7f12d0002f30 tx=0x7f12d0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:05.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.774+0000 7f12d8ff9700 1 -- 172.21.15.38:0/3067599068 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f12d003e8d0 con 0x7f12dc0ad5b0 2020-06-12T17:50:05.970 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.966+0000 7f12e1c0a700 1 -- 172.21.15.38:0/3067599068 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_7455", "target": ["mon-mgr", ""]}) v1 -- 0x7f12dc069b70 con 0x7f12bc04d4b0 2020-06-12T17:50:05.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.986+0000 7f12db7fe700 1 --2- 172.21.15.38:0/3067599068 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f12bc04d4b0 0x7f12bc04f970 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f12cc001260 tx=0x7f12cc001680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:05.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.986+0000 7f12d8ff9700 1 -- 172.21.15.38:0/3067599068 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f12dc069b70 con 0x7f12bc04d4b0 2020-06-12T17:50:05.992 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.988+0000 7f12e1c0a700 1 -- 172.21.15.38:0/3067599068 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f12bc04d4b0 msgr2=0x7f12bc04f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:05.992 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.988+0000 7f12e1c0a700 1 --2- 172.21.15.38:0/3067599068 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f12bc04d4b0 0x7f12bc04f970 secure :-1 s=READY pgs=240 cs=0 l=1 rx=0x7f12cc001260 tx=0x7f12cc001680).stop 2020-06-12T17:50:05.993 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.988+0000 7f12e1c0a700 1 -- 172.21.15.38:0/3067599068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12dc0ad5b0 msgr2=0x7f12dc0644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:05.993 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.988+0000 7f12e1c0a700 1 --2- 172.21.15.38:0/3067599068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12dc0ad5b0 0x7f12dc0644f0 secure :-1 s=READY pgs=606 cs=0 l=1 rx=0x7f12d0002f30 tx=0x7f12d0007e60).stop 2020-06-12T17:50:05.994 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.988+0000 7f12e1c0a700 1 -- 172.21.15.38:0/3067599068 shutdown_connections 2020-06-12T17:50:05.994 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.988+0000 7f12e1c0a700 1 --2- 172.21.15.38:0/3067599068 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f12bc04d4b0 0x7f12bc04f970 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:05.994 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.988+0000 7f12e1c0a700 1 --2- 172.21.15.38:0/3067599068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12dc0ad5b0 0x7f12dc0644f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:05.994 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.988+0000 7f12e1c0a700 1 -- 172.21.15.38:0/3067599068 >> 172.21.15.38:0/3067599068 conn(0x7f12dc0b5a20 msgr2=0x7f12dc1459c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:05.994 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.988+0000 7f12e1c0a700 1 -- 172.21.15.38:0/3067599068 shutdown_connections 2020-06-12T17:50:05.995 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:05.988+0000 7f12e1c0a700 1 -- 172.21.15.38:0/3067599068 wait complete. 2020-06-12T17:50:06.002 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_7455 2020-06-12T17:50:06.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.116+0000 7f32995fa700 1 Processor -- start 2020-06-12T17:50:06.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.116+0000 7f32995fa700 1 -- start start 2020-06-12T17:50:06.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.117+0000 7f32995fa700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f32940ad5b0 0x7f32940b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:06.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.117+0000 7f32995fa700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3294146d20 con 0x7f329409d8d0 2020-06-12T17:50:06.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.117+0000 7f32995fa700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3294066a80 con 0x7f3294146680 2020-06-12T17:50:06.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.117+0000 7f32995fa700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3294146f50 con 0x7f32940ad5b0 2020-06-12T17:50:06.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.117+0000 7f32937fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f329409d8d0 0x7f32941421d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40228/0 (socket says 172.21.15.38:40228) 2020-06-12T17:50:06.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.117+0000 7f32937fe700 1 -- 172.21.15.38:0/1563997797 learned_addr learned my addr 172.21.15.38:0/1563997797 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:06.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.118+0000 7f32927fc700 1 --2- 172.21.15.38:0/1563997797 >> v2:172.21.15.150:3300/0 conn(0x7f32940ad5b0 0x7f32940b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:06.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.118+0000 7f3291ffb700 1 -- 172.21.15.38:0/1563997797 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3044428663 0 0) 0x7f3294146d20 con 0x7f329409d8d0 2020-06-12T17:50:06.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.118+0000 7f3291ffb700 1 -- 172.21.15.38:0/1563997797 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3278003230 con 0x7f329409d8d0 2020-06-12T17:50:06.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.118+0000 7f3291ffb700 1 -- 172.21.15.38:0/1563997797 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1520529119 0 0) 0x7f3278003230 con 0x7f329409d8d0 2020-06-12T17:50:06.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.118+0000 7f3291ffb700 1 -- 172.21.15.38:0/1563997797 >> v2:172.21.15.150:3300/0 conn(0x7f32940ad5b0 msgr2=0x7f32940b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:06.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.118+0000 7f3291ffb700 1 --2- 172.21.15.38:0/1563997797 >> v2:172.21.15.150:3300/0 conn(0x7f32940ad5b0 0x7f32940b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:06.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.118+0000 7f3291ffb700 1 -- 172.21.15.38:0/1563997797 >> v1:172.21.15.150:6789/0 conn(0x7f3294146680 legacy=0x7f329409d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:06.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.118+0000 7f3291ffb700 1 -- 172.21.15.38:0/1563997797 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3294146a60 con 0x7f329409d8d0 2020-06-12T17:50:06.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.118+0000 7f3291ffb700 1 -- 172.21.15.38:0/1563997797 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f328c0016d0 con 0x7f329409d8d0 2020-06-12T17:50:06.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.118+0000 7f3291ffb700 1 -- 172.21.15.38:0/1563997797 >> v1:172.21.15.38:6789/0 conn(0x7f329409d8d0 legacy=0x7f32941421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:06.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.118+0000 7f3291ffb700 1 --2- 172.21.15.38:0/1563997797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3278003720 0x7f3278003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:06.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.118+0000 7f3291ffb700 1 --2- 172.21.15.38:0/1563997797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f32780044d0 0x7f3278004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:06.135 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.118+0000 7f3291ffb700 1 --2- 172.21.15.38:0/1563997797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3278004db0 0x7f327800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:06.135 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.118+0000 7f3291ffb700 1 -- 172.21.15.38:0/1563997797 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3294146f50 con 0x7f3278004db0 2020-06-12T17:50:06.135 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.118+0000 7f3291ffb700 1 -- 172.21.15.38:0/1563997797 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32780041c0 con 0x7f3278003720 2020-06-12T17:50:06.135 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.118+0000 7f3291ffb700 1 -- 172.21.15.38:0/1563997797 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327800dd90 con 0x7f32780044d0 2020-06-12T17:50:06.135 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.118+0000 7f32937fe700 1 --2- 172.21.15.38:0/1563997797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3278004db0 0x7f327800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:06.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.118+0000 7f3292ffd700 1 --2- 172.21.15.38:0/1563997797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3278003720 0x7f3278003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:06.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.118+0000 7f32927fc700 1 --2- 172.21.15.38:0/1563997797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f32780044d0 0x7f3278004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:06.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.118+0000 7f32937fe700 1 -- 172.21.15.38:0/1563997797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f32780044d0 msgr2=0x7f3278004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:06.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.118+0000 7f32937fe700 1 --2- 172.21.15.38:0/1563997797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f32780044d0 0x7f3278004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:06.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.118+0000 7f32937fe700 1 -- 172.21.15.38:0/1563997797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3278003720 msgr2=0x7f3278003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:06.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.118+0000 7f32937fe700 1 --2- 172.21.15.38:0/1563997797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3278003720 0x7f3278003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:06.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.119+0000 7f32937fe700 1 -- 172.21.15.38:0/1563997797 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3278003230 con 0x7f3278004db0 2020-06-12T17:50:06.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.119+0000 7f32937fe700 1 --2- 172.21.15.38:0/1563997797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3278004db0 0x7f327800b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f328c0013e0 tx=0x7f32940aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:06.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.119+0000 7f32937fe700 1 -- 172.21.15.38:0/1563997797 reap_dead start 2020-06-12T17:50:06.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.119+0000 7f32937fe700 1 --2- 172.21.15.38:0/1563997797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3278004db0 0x7f327800b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f328c0013e0 tx=0x7f32940aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:06.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.119+0000 7f32937fe700 1 --2- 172.21.15.38:0/1563997797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3278004db0 0x7f327800b720 secure :-1 s=READY pgs=608 cs=0 l=1 rx=0x7f328c0013e0 tx=0x7f32940aec70).ready entity=mon.0 client_cookie=2b2e9e63568762db server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:06.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.119+0000 7f32937fe700 1 --2- 172.21.15.38:0/1563997797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3278004db0 0x7f327800b720 secure :-1 s=THROTTLE_DONE pgs=608 cs=0 l=1 rx=0x7f328c0013e0 tx=0x7f32940aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:06.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.119+0000 7f3291ffb700 1 -- 172.21.15.38:0/1563997797 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f328c00ce90 con 0x7f3278004db0 2020-06-12T17:50:06.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.119+0000 7f32937fe700 1 --2- 172.21.15.38:0/1563997797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3278004db0 0x7f327800b720 secure :-1 s=THROTTLE_DONE pgs=608 cs=0 l=1 rx=0x7f328c0013e0 tx=0x7f32940aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:06.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.119+0000 7f3291ffb700 1 -- 172.21.15.38:0/1563997797 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328c00e160 con 0x7f3278004db0 2020-06-12T17:50:06.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.119+0000 7f32937fe700 1 --2- 172.21.15.38:0/1563997797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3278004db0 0x7f327800b720 secure :-1 s=THROTTLE_DONE pgs=608 cs=0 l=1 rx=0x7f328c0013e0 tx=0x7f32940aec70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:06.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.119+0000 7f3291ffb700 1 -- 172.21.15.38:0/1563997797 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f328c00e4c0 con 0x7f3278004db0 2020-06-12T17:50:06.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.119+0000 7f32995fa700 1 -- 172.21.15.38:0/1563997797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3278004db0 msgr2=0x7f327800b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:06.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.119+0000 7f32995fa700 1 --2- 172.21.15.38:0/1563997797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3278004db0 0x7f327800b720 secure :-1 s=READY pgs=608 cs=0 l=1 rx=0x7f328c0013e0 tx=0x7f32940aec70).stop 2020-06-12T17:50:06.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.119+0000 7f32995fa700 1 -- 172.21.15.38:0/1563997797 shutdown_connections 2020-06-12T17:50:06.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.119+0000 7f32995fa700 1 --2- 172.21.15.38:0/1563997797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3278004db0 0x7f327800b720 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:06.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.119+0000 7f32995fa700 1 -- 172.21.15.38:0/1563997797 >> 172.21.15.38:0/1563997797 conn(0x7f32940b5a20 msgr2=0x7f329405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:06.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.119+0000 7f32995fa700 1 -- 172.21.15.38:0/1563997797 shutdown_connections 2020-06-12T17:50:06.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.119+0000 7f32995fa700 1 -- 172.21.15.38:0/1563997797 wait complete. 2020-06-12T17:50:06.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.120+0000 7f32995fa700 1 Processor -- start 2020-06-12T17:50:06.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.120+0000 7f32995fa700 1 -- start start 2020-06-12T17:50:06.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.121+0000 7f32995fa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3278004db0 0x7f32940b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:06.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.121+0000 7f32995fa700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3294065a70 0x7f32940b1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:06.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.121+0000 7f32995fa700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f329413c3a0 con 0x7f32940b1ad0 2020-06-12T17:50:06.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.121+0000 7f32995fa700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32940aed90 con 0x7f3294065a70 2020-06-12T17:50:06.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.121+0000 7f32995fa700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3294065ef0 con 0x7f3278004db0 2020-06-12T17:50:06.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.121+0000 7f32927fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3294065a70 0x7f32940b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:06.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.121+0000 7f32927fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3294065a70 0x7f32940b1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:47898/0 (socket says 172.21.15.38:47898) 2020-06-12T17:50:06.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.121+0000 7f32937fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f32940b1ad0 0x7f32940af180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:60972/0 (socket says 172.21.15.38:60972) 2020-06-12T17:50:06.144 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.121+0000 7f3292ffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3278004db0 0x7f32940b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:06.144 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.121+0000 7f32937fe700 1 -- 172.21.15.38:0/2507546474 learned_addr learned my addr 172.21.15.38:0/2507546474 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:06.144 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.122+0000 7f32927fc700 1 -- 172.21.15.38:0/2507546474 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3278004db0 msgr2=0x7f32940b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:06.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.122+0000 7f32927fc700 1 --2- 172.21.15.38:0/2507546474 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3278004db0 0x7f32940b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:06.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.122+0000 7f32927fc700 1 -- 172.21.15.38:0/2507546474 >> v1:172.21.15.150:6789/0 conn(0x7f32940b1ad0 legacy=0x7f32940af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:06.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.122+0000 7f3283fff700 1 -- 172.21.15.38:0/2507546474 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1319786415 0 0) 0x7f329413c3a0 con 0x7f32940b1ad0 2020-06-12T17:50:06.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.122+0000 7f32927fc700 1 -- 172.21.15.38:0/2507546474 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3294154300 con 0x7f3294065a70 2020-06-12T17:50:06.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.122+0000 7f3292ffd700 1 --2- 172.21.15.38:0/2507546474 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3278004db0 0x7f32940b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:50:06.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.122+0000 7f32927fc700 1 --2- 172.21.15.38:0/2507546474 >> v2:172.21.15.150:3300/0 conn(0x7f3294065a70 0x7f32940b1670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f32840032b0 tx=0x7f32840081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:06.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.122+0000 7f32927fc700 1 --2- 172.21.15.38:0/2507546474 >> v2:172.21.15.150:3300/0 conn(0x7f3294065a70 0x7f32940b1670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f32840032b0 tx=0x7f32840081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:06.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.122+0000 7f32927fc700 1 --2- 172.21.15.38:0/2507546474 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3294065a70 0x7f32940b1670 secure :-1 s=READY pgs=359 cs=0 l=1 rx=0x7f32840032b0 tx=0x7f32840081e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:06.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.122+0000 7f32927fc700 1 --2- 172.21.15.38:0/2507546474 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3294065a70 0x7f32940b1670 secure :-1 s=THROTTLE_DONE pgs=359 cs=0 l=1 rx=0x7f32840032b0 tx=0x7f32840081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:06.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.122+0000 7f3283fff700 1 -- 172.21.15.38:0/2507546474 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32840089a0 con 0x7f3294065a70 2020-06-12T17:50:06.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.122+0000 7f32927fc700 1 --2- 172.21.15.38:0/2507546474 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3294065a70 0x7f32940b1670 secure :-1 s=THROTTLE_DONE pgs=359 cs=0 l=1 rx=0x7f32840032b0 tx=0x7f32840081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:06.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.122+0000 7f3283fff700 1 -- 172.21.15.38:0/2507546474 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3284008b00 con 0x7f3294065a70 2020-06-12T17:50:06.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.122+0000 7f32927fc700 1 --2- 172.21.15.38:0/2507546474 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3294065a70 0x7f32940b1670 secure :-1 s=THROTTLE_DONE pgs=359 cs=0 l=1 rx=0x7f32840032b0 tx=0x7f32840081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:06.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.122+0000 7f32995fa700 1 -- 172.21.15.38:0/2507546474 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32941573f0 con 0x7f3294065a70 2020-06-12T17:50:06.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.122+0000 7f3283fff700 1 -- 172.21.15.38:0/2507546474 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3284007160 con 0x7f3294065a70 2020-06-12T17:50:06.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.122+0000 7f32995fa700 1 -- 172.21.15.38:0/2507546474 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3294157040 con 0x7f3294065a70 2020-06-12T17:50:06.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.123+0000 7f32927fc700 1 --2- 172.21.15.38:0/2507546474 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3294065a70 0x7f32940b1670 secure :-1 s=THROTTLE_DONE pgs=359 cs=0 l=1 rx=0x7f32840032b0 tx=0x7f32840081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:06.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.123+0000 7f32995fa700 1 -- 172.21.15.38:0/2507546474 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3294157780 con 0x7f3294065a70 2020-06-12T17:50:06.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.123+0000 7f3283fff700 1 -- 172.21.15.38:0/2507546474 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f328400b250 con 0x7f3294065a70 2020-06-12T17:50:06.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.123+0000 7f32927fc700 1 --2- 172.21.15.38:0/2507546474 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3294065a70 0x7f32940b1670 secure :-1 s=THROTTLE_DONE pgs=359 cs=0 l=1 rx=0x7f32840032b0 tx=0x7f32840081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:06.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.123+0000 7f3283fff700 1 --2- 172.21.15.38:0/2507546474 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f327004d420 0x7f327004f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:06.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.123+0000 7f3283fff700 1 -- 172.21.15.38:0/2507546474 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3284061220 con 0x7f3294065a70 2020-06-12T17:50:06.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.124+0000 7f3292ffd700 1 --2- 172.21.15.38:0/2507546474 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f327004d420 0x7f327004f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:06.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.124+0000 7f3292ffd700 1 --2- 172.21.15.38:0/2507546474 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f327004d420 0x7f327004f8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3288001000 tx=0x7f3288001870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:06.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.124+0000 7f3292ffd700 1 --2- 172.21.15.38:0/2507546474 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f327004d420 0x7f327004f8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3288001000 tx=0x7f3288001870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:06.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.124+0000 7f3292ffd700 1 --2- 172.21.15.38:0/2507546474 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f327004d420 0x7f327004f8e0 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7f3288001000 tx=0x7f3288001870).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:06.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.127+0000 7f32927fc700 1 --2- 172.21.15.38:0/2507546474 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3294065a70 0x7f32940b1670 secure :-1 s=THROTTLE_DONE pgs=359 cs=0 l=1 rx=0x7f32840032b0 tx=0x7f32840081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:06.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.127+0000 7f3283fff700 1 -- 172.21.15.38:0/2507546474 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f328403c920 con 0x7f3294065a70 2020-06-12T17:50:06.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.324+0000 7f32995fa700 1 -- 172.21.15.38:0/2507546474 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_7455", "target": ["mon-mgr", ""]}) v1 -- 0x7f32940aeee0 con 0x7f327004d420 2020-06-12T17:50:06.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.327+0000 7f3292ffd700 1 --2- 172.21.15.38:0/2507546474 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f327004d420 0x7f327004f8e0 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f3288001000 tx=0x7f3288001870).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:06.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.327+0000 7f3283fff700 1 -- 172.21.15.38:0/2507546474 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f328800b190 con 0x7f327004d420 2020-06-12T17:50:06.332 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_7455/624f09bc-5949-43ea-8ee0-580831d225a6 2020-06-12T17:50:06.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.329+0000 7f32995fa700 1 -- 172.21.15.38:0/2507546474 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f327004d420 msgr2=0x7f327004f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:06.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.329+0000 7f32995fa700 1 --2- 172.21.15.38:0/2507546474 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f327004d420 0x7f327004f8e0 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7f3288001000 tx=0x7f3288001870).stop 2020-06-12T17:50:06.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.329+0000 7f32995fa700 1 -- 172.21.15.38:0/2507546474 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3294065a70 msgr2=0x7f32940b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:06.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.329+0000 7f32995fa700 1 --2- 172.21.15.38:0/2507546474 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3294065a70 0x7f32940b1670 secure :-1 s=READY pgs=359 cs=0 l=1 rx=0x7f32840032b0 tx=0x7f32840081e0).stop 2020-06-12T17:50:06.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.329+0000 7f32995fa700 1 -- 172.21.15.38:0/2507546474 shutdown_connections 2020-06-12T17:50:06.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.329+0000 7f32995fa700 1 --2- 172.21.15.38:0/2507546474 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f327004d420 0x7f327004f8e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:06.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.329+0000 7f32995fa700 1 --2- 172.21.15.38:0/2507546474 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3278004db0 0x7f32940b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:06.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.329+0000 7f32995fa700 1 --2- 172.21.15.38:0/2507546474 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3294065a70 0x7f32940b1670 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:06.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.329+0000 7f32995fa700 1 -- 172.21.15.38:0/2507546474 >> 172.21.15.38:0/2507546474 conn(0x7f32940b5a20 msgr2=0x7f32940b39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:06.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.329+0000 7f32995fa700 1 -- 172.21.15.38:0/2507546474 shutdown_connections 2020-06-12T17:50:06.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:06.329+0000 7f32995fa700 1 -- 172.21.15.38:0/2507546474 wait complete. 2020-06-12T17:50:06.343 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_7455 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_7455/624f09bc-5949-43ea-8ee0-580831d225a6 2020-06-12T17:50:06.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:06.344 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:06.344 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:06.365 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:06.365 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:06.366 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7455/624f09bc-5949-43ea-8ee0-580831d225a6/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:06.461 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:06.462 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:06.462 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133359 s, 78.6 MB/s 2020-06-12T17:50:06.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:06.463 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:06.464 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:06.480 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:06.481 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:06.481 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7455/624f09bc-5949-43ea-8ee0-580831d225a6/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:06.568 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:06.569 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:06.569 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116185 s, 90.3 MB/s 2020-06-12T17:50:06.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:06.571 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:06.575 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:06.594 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:06.594 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:06.595 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7455/624f09bc-5949-43ea-8ee0-580831d225a6/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:06.686 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:06.687 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:06.687 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156326 s, 67.1 MB/s 2020-06-12T17:50:06.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:06.688 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:06.693 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:06.708 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:06.709 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:06.710 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7455/624f09bc-5949-43ea-8ee0-580831d225a6/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:06.795 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:06.796 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:06.796 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101302 s, 104 MB/s 2020-06-12T17:50:06.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:06.797 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:06.798 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:06.815 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:06.815 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:06.816 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7455/624f09bc-5949-43ea-8ee0-580831d225a6/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:06.905 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:06.906 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:06.906 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156143 s, 67.2 MB/s 2020-06-12T17:50:06.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:06.907 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:06.908 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:06.923 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:06.923 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:06.924 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7455/624f09bc-5949-43ea-8ee0-580831d225a6/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:07.012 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:07.012 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:07.013 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00980003 s, 107 MB/s 2020-06-12T17:50:07.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:07.014 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:07.015 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:07.029 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:07.030 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:07.030 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7455/624f09bc-5949-43ea-8ee0-580831d225a6/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:07.119 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:07.120 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:07.120 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128375 s, 81.7 MB/s 2020-06-12T17:50:07.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:07.122 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:07.122 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:07.137 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:07.138 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:07.138 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7455/624f09bc-5949-43ea-8ee0-580831d225a6/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:07.226 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:07.226 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:07.226 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108753 s, 96.4 MB/s 2020-06-12T17:50:07.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:07.228 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:07.228 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:07.243 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:07.243 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:07.244 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7455/624f09bc-5949-43ea-8ee0-580831d225a6/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:07.332 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:07.332 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:07.332 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112114 s, 93.5 MB/s 2020-06-12T17:50:07.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:07.334 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:07.334 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:07.349 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:07.350 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:07.350 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7455/624f09bc-5949-43ea-8ee0-580831d225a6/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:07.439 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:07.440 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:07.440 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114005 s, 92.0 MB/s 2020-06-12T17:50:07.441 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_7127 2020-06-12T17:50:07.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.555+0000 7fb86af2c700 1 Processor -- start 2020-06-12T17:50:07.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.555+0000 7fb86af2c700 1 -- start start 2020-06-12T17:50:07.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.555+0000 7fb86af2c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb8640b3ac0 0x7fb86409df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:07.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.555+0000 7fb86af2c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb86413c650 0x7fb864066790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:07.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.555+0000 7fb86af2c700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86409b960 con 0x7fb864142e90 2020-06-12T17:50:07.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.555+0000 7fb86af2c700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb86409bc00 con 0x7fb86413c650 2020-06-12T17:50:07.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.555+0000 7fb86af2c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8640b48f0 con 0x7fb8640b3ac0 2020-06-12T17:50:07.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.556+0000 7fb8694c9700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb86413c650 0x7fb864066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:07.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.556+0000 7fb863fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb864142e90 0x7fb86413bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40248/0 (socket says 172.21.15.38:40248) 2020-06-12T17:50:07.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.556+0000 7fb863fff700 1 -- 172.21.15.38:0/3395201331 learned_addr learned my addr 172.21.15.38:0/3395201331 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:07.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.556+0000 7fb868cc8700 1 --2- 172.21.15.38:0/3395201331 >> v2:172.21.15.150:3300/0 conn(0x7fb8640b3ac0 0x7fb86409df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:07.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.556+0000 7fb8694c9700 1 -- 172.21.15.38:0/3395201331 >> v2:172.21.15.150:3300/0 conn(0x7fb8640b3ac0 msgr2=0x7fb86409df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:07.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.556+0000 7fb8694c9700 1 --2- 172.21.15.38:0/3395201331 >> v2:172.21.15.150:3300/0 conn(0x7fb8640b3ac0 0x7fb86409df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:07.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.556+0000 7fb8694c9700 1 -- 172.21.15.38:0/3395201331 >> v1:172.21.15.38:6789/0 conn(0x7fb864142e90 legacy=0x7fb86413bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:07.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.556+0000 7fb8694c9700 1 -- 172.21.15.38:0/3395201331 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8640b3ea0 con 0x7fb86413c650 2020-06-12T17:50:07.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.556+0000 7fb8637fe700 1 -- 172.21.15.38:0/3395201331 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 482879963 0 0) 0x7fb86409b960 con 0x7fb864142e90 2020-06-12T17:50:07.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.556+0000 7fb868cc8700 1 --2- 172.21.15.38:0/3395201331 >> v2:172.21.15.150:3300/0 conn(0x7fb8640b3ac0 0x7fb86409df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:50:07.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.556+0000 7fb8694c9700 1 --2- 172.21.15.38:0/3395201331 >> v2:172.21.15.38:3300/0 conn(0x7fb86413c650 0x7fb864066790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb85c0032b0 tx=0x7fb85c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.556+0000 7fb8694c9700 1 --2- 172.21.15.38:0/3395201331 >> v2:172.21.15.38:3300/0 conn(0x7fb86413c650 0x7fb864066790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb85c0032b0 tx=0x7fb85c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.556+0000 7fb8694c9700 1 --2- 172.21.15.38:0/3395201331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86413c650 0x7fb864066790 secure :-1 s=READY pgs=610 cs=0 l=1 rx=0x7fb85c0032b0 tx=0x7fb85c0081e0).ready entity=mon.0 client_cookie=53a215a51def0d14 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:07.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.556+0000 7fb8694c9700 1 --2- 172.21.15.38:0/3395201331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86413c650 0x7fb864066790 secure :-1 s=THROTTLE_DONE pgs=610 cs=0 l=1 rx=0x7fb85c0032b0 tx=0x7fb85c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.556+0000 7fb8637fe700 1 -- 172.21.15.38:0/3395201331 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb85c011e90 con 0x7fb86413c650 2020-06-12T17:50:07.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.556+0000 7fb8694c9700 1 --2- 172.21.15.38:0/3395201331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86413c650 0x7fb864066790 secure :-1 s=THROTTLE_DONE pgs=610 cs=0 l=1 rx=0x7fb85c0032b0 tx=0x7fb85c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.556+0000 7fb8637fe700 1 -- 172.21.15.38:0/3395201331 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c00a160 con 0x7fb86413c650 2020-06-12T17:50:07.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.556+0000 7fb8694c9700 1 --2- 172.21.15.38:0/3395201331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86413c650 0x7fb864066790 secure :-1 s=THROTTLE_DONE pgs=610 cs=0 l=1 rx=0x7fb85c0032b0 tx=0x7fb85c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.556+0000 7fb8637fe700 1 -- 172.21.15.38:0/3395201331 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb85c00a4c0 con 0x7fb86413c650 2020-06-12T17:50:07.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.556+0000 7fb86af2c700 1 -- 172.21.15.38:0/3395201331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86413c650 msgr2=0x7fb864066790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:07.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.556+0000 7fb86af2c700 1 --2- 172.21.15.38:0/3395201331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86413c650 0x7fb864066790 secure :-1 s=READY pgs=610 cs=0 l=1 rx=0x7fb85c0032b0 tx=0x7fb85c0081e0).stop 2020-06-12T17:50:07.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.557+0000 7fb86af2c700 1 -- 172.21.15.38:0/3395201331 shutdown_connections 2020-06-12T17:50:07.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.557+0000 7fb86af2c700 1 --2- 172.21.15.38:0/3395201331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86413c650 0x7fb864066790 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:07.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.557+0000 7fb86af2c700 1 --2- 172.21.15.38:0/3395201331 >> v2:172.21.15.150:3300/0 conn(0x7fb8640b3ac0 0x7fb86409df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:07.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.557+0000 7fb86af2c700 1 -- 172.21.15.38:0/3395201331 >> 172.21.15.38:0/3395201331 conn(0x7fb8640b5a20 msgr2=0x7fb86405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:07.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.557+0000 7fb86af2c700 1 -- 172.21.15.38:0/3395201331 shutdown_connections 2020-06-12T17:50:07.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.557+0000 7fb86af2c700 1 -- 172.21.15.38:0/3395201331 wait complete. 2020-06-12T17:50:07.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.558+0000 7fb86af2c700 1 Processor -- start 2020-06-12T17:50:07.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.558+0000 7fb86af2c700 1 -- start start 2020-06-12T17:50:07.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.559+0000 7fb86af2c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb864142e90 0x7fb864065f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:07.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.559+0000 7fb86af2c700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb864140fc0 con 0x7fb86413c650 2020-06-12T17:50:07.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.559+0000 7fb86af2c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8640663d0 con 0x7fb8640b3ac0 2020-06-12T17:50:07.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.559+0000 7fb86af2c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb86413c4f0 con 0x7fb864142e90 2020-06-12T17:50:07.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.559+0000 7fb863fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb86413c650 0x7fb8640b05e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40252/0 (socket says 172.21.15.38:40252) 2020-06-12T17:50:07.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.559+0000 7fb863fff700 1 -- 172.21.15.38:0/725899724 learned_addr learned my addr 172.21.15.38:0/725899724 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:07.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.559+0000 7fb8694c9700 1 --2- 172.21.15.38:0/725899724 >> v2:172.21.15.150:3300/0 conn(0x7fb864142e90 0x7fb864065f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:07.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.559+0000 7fb861ffb700 1 -- 172.21.15.38:0/725899724 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1965561651 0 0) 0x7fb864140fc0 con 0x7fb86413c650 2020-06-12T17:50:07.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.559+0000 7fb861ffb700 1 -- 172.21.15.38:0/725899724 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb844002fe0 con 0x7fb86413c650 2020-06-12T17:50:07.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.559+0000 7fb861ffb700 1 -- 172.21.15.38:0/725899724 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2580024731 0 0) 0x7fb844002fe0 con 0x7fb86413c650 2020-06-12T17:50:07.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.559+0000 7fb861ffb700 1 -- 172.21.15.38:0/725899724 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb864140fc0 con 0x7fb86413c650 2020-06-12T17:50:07.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.559+0000 7fb861ffb700 1 -- 172.21.15.38:0/725899724 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fb858001960 con 0x7fb86413c650 2020-06-12T17:50:07.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.559+0000 7fb861ffb700 1 -- 172.21.15.38:0/725899724 >> v2:172.21.15.150:3300/0 conn(0x7fb864142e90 msgr2=0x7fb864065f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:07.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.559+0000 7fb861ffb700 1 --2- 172.21.15.38:0/725899724 >> v2:172.21.15.150:3300/0 conn(0x7fb864142e90 0x7fb864065f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:07.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.559+0000 7fb861ffb700 1 -- 172.21.15.38:0/725899724 >> v1:172.21.15.150:6789/0 conn(0x7fb8640b3ac0 legacy=0x7fb864066770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:07.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.559+0000 7fb861ffb700 1 -- 172.21.15.38:0/725899724 >> v1:172.21.15.38:6789/0 conn(0x7fb86413c650 legacy=0x7fb8640b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:07.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.559+0000 7fb861ffb700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8440049b0 0x7fb844004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:07.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.559+0000 7fb861ffb700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb844003920 0x7fb844003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:07.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.559+0000 7fb861ffb700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8440041c0 0x7fb84400b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:07.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.559+0000 7fb861ffb700 1 -- 172.21.15.38:0/725899724 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86413c4f0 con 0x7fb844003920 2020-06-12T17:50:07.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.559+0000 7fb861ffb700 1 -- 172.21.15.38:0/725899724 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb844004670 con 0x7fb8440049b0 2020-06-12T17:50:07.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.559+0000 7fb861ffb700 1 -- 172.21.15.38:0/725899724 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84400bbb0 con 0x7fb8440041c0 2020-06-12T17:50:07.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.559+0000 7fb863fff700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb844003920 0x7fb844003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:07.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.559+0000 7fb868cc8700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8440049b0 0x7fb844004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:07.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.559+0000 7fb8694c9700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8440041c0 0x7fb84400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:07.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.560+0000 7fb863fff700 1 -- 172.21.15.38:0/725899724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8440041c0 msgr2=0x7fb84400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:07.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.560+0000 7fb863fff700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8440041c0 0x7fb84400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:07.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.560+0000 7fb863fff700 1 -- 172.21.15.38:0/725899724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8440049b0 msgr2=0x7fb844004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:07.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.560+0000 7fb863fff700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8440049b0 0x7fb844004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:07.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.560+0000 7fb863fff700 1 -- 172.21.15.38:0/725899724 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb864141220 con 0x7fb844003920 2020-06-12T17:50:07.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.560+0000 7fb8694c9700 1 -- 172.21.15.38:0/725899724 reap_dead start 2020-06-12T17:50:07.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.560+0000 7fb86af2c700 1 -- 172.21.15.38:0/725899724 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb864141520 con 0x7fb844003920 2020-06-12T17:50:07.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.560+0000 7fb863fff700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb844003920 0x7fb844003d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb858001670 tx=0x7fb85800eab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.560+0000 7fb86af2c700 1 -- 172.21.15.38:0/725899724 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb864065f70 con 0x7fb844003920 2020-06-12T17:50:07.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.560+0000 7fb863fff700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb844003920 0x7fb844003d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb858001670 tx=0x7fb85800eab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.560+0000 7fb863fff700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb844003920 0x7fb844003d60 secure :-1 s=READY pgs=612 cs=0 l=1 rx=0x7fb858001670 tx=0x7fb85800eab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:07.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.560+0000 7fb863fff700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb844003920 0x7fb844003d60 secure :-1 s=THROTTLE_DONE pgs=612 cs=0 l=1 rx=0x7fb858001670 tx=0x7fb85800eab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.560+0000 7fb861ffb700 1 -- 172.21.15.38:0/725899724 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb858008440 con 0x7fb844003920 2020-06-12T17:50:07.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.560+0000 7fb863fff700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb844003920 0x7fb844003d60 secure :-1 s=THROTTLE_DONE pgs=612 cs=0 l=1 rx=0x7fb858001670 tx=0x7fb85800eab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.560+0000 7fb861ffb700 1 -- 172.21.15.38:0/725899724 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8580057b0 con 0x7fb844003920 2020-06-12T17:50:07.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.560+0000 7fb863fff700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb844003920 0x7fb844003d60 secure :-1 s=THROTTLE_DONE pgs=612 cs=0 l=1 rx=0x7fb858001670 tx=0x7fb85800eab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.560+0000 7fb861ffb700 1 -- 172.21.15.38:0/725899724 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb858005b90 con 0x7fb844003920 2020-06-12T17:50:07.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.560+0000 7fb863fff700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb844003920 0x7fb844003d60 secure :-1 s=THROTTLE_DONE pgs=612 cs=0 l=1 rx=0x7fb858001670 tx=0x7fb85800eab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.561+0000 7fb86af2c700 1 -- 172.21.15.38:0/725899724 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb840003340 con 0x7fb844003920 2020-06-12T17:50:07.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.561+0000 7fb861ffb700 1 -- 172.21.15.38:0/725899724 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fb858005cf0 con 0x7fb844003920 2020-06-12T17:50:07.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.561+0000 7fb863fff700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb844003920 0x7fb844003d60 secure :-1 s=THROTTLE_DONE pgs=612 cs=0 l=1 rx=0x7fb858001670 tx=0x7fb85800eab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.561+0000 7fb861ffb700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb844051460 0x7fb844053920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:07.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.561+0000 7fb861ffb700 1 -- 172.21.15.38:0/725899724 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb858061720 con 0x7fb844003920 2020-06-12T17:50:07.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.561+0000 7fb868cc8700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb844051460 0x7fb844053920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:07.585 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.561+0000 7fb868cc8700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb844051460 0x7fb844053920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb8640672e0 tx=0x7fb854001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.585 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.562+0000 7fb868cc8700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb844051460 0x7fb844053920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb8640672e0 tx=0x7fb854001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.585 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.562+0000 7fb868cc8700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb844051460 0x7fb844053920 secure :-1 s=READY pgs=242 cs=0 l=1 rx=0x7fb8640672e0 tx=0x7fb854001400).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:07.585 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.565+0000 7fb863fff700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb844003920 0x7fb844003d60 secure :-1 s=THROTTLE_DONE pgs=612 cs=0 l=1 rx=0x7fb858001670 tx=0x7fb85800eab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.565+0000 7fb861ffb700 1 -- 172.21.15.38:0/725899724 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fb85803ce80 con 0x7fb844003920 2020-06-12T17:50:07.764 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.760+0000 7fb86af2c700 1 -- 172.21.15.38:0/725899724 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_7127", "target": ["mon-mgr", ""]}) v1 -- 0x7fb840002200 con 0x7fb844051460 2020-06-12T17:50:07.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.779+0000 7fb868cc8700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb844051460 0x7fb844053920 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7fb8640672e0 tx=0x7fb854001400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.779+0000 7fb861ffb700 1 -- 172.21.15.38:0/725899724 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb840002200 con 0x7fb844051460 2020-06-12T17:50:07.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.780+0000 7fb86af2c700 1 -- 172.21.15.38:0/725899724 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb844051460 msgr2=0x7fb844053920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:07.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.780+0000 7fb86af2c700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb844051460 0x7fb844053920 secure :-1 s=READY pgs=242 cs=0 l=1 rx=0x7fb8640672e0 tx=0x7fb854001400).stop 2020-06-12T17:50:07.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.780+0000 7fb86af2c700 1 -- 172.21.15.38:0/725899724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb844003920 msgr2=0x7fb844003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:07.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.780+0000 7fb86af2c700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb844003920 0x7fb844003d60 secure :-1 s=READY pgs=612 cs=0 l=1 rx=0x7fb858001670 tx=0x7fb85800eab0).stop 2020-06-12T17:50:07.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.780+0000 7fb86af2c700 1 -- 172.21.15.38:0/725899724 shutdown_connections 2020-06-12T17:50:07.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.780+0000 7fb86af2c700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb844051460 0x7fb844053920 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:07.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.780+0000 7fb86af2c700 1 --2- 172.21.15.38:0/725899724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb844003920 0x7fb844003d60 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:07.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.780+0000 7fb86af2c700 1 -- 172.21.15.38:0/725899724 >> 172.21.15.38:0/725899724 conn(0x7fb8640b5a20 msgr2=0x7fb864145400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:07.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.780+0000 7fb86af2c700 1 -- 172.21.15.38:0/725899724 shutdown_connections 2020-06-12T17:50:07.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.780+0000 7fb86af2c700 1 -- 172.21.15.38:0/725899724 wait complete. 2020-06-12T17:50:07.809 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_7127 2020-06-12T17:50:07.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.923+0000 7ff425f0b700 1 Processor -- start 2020-06-12T17:50:07.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.923+0000 7ff425f0b700 1 -- start start 2020-06-12T17:50:07.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.924+0000 7ff425f0b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4200ad5b0 0x7ff4200b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:07.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.924+0000 7ff425f0b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff42009d8d0 0x7ff4201421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:07.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.924+0000 7ff425f0b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff420146d20 con 0x7ff420146680 2020-06-12T17:50:07.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.924+0000 7ff425f0b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff420066a80 con 0x7ff42009d8d0 2020-06-12T17:50:07.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.924+0000 7ff425f0b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff420146f50 con 0x7ff4200ad5b0 2020-06-12T17:50:07.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.924+0000 7ff41ffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff42009d8d0 0x7ff4201421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:07.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.924+0000 7ff41effd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4200ad5b0 0x7ff4200b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:07.932 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.925+0000 7ff41effd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4200ad5b0 0x7ff4200b2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:57906/0 (socket says 172.21.15.38:57906) 2020-06-12T17:50:07.932 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.925+0000 7ff41ffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff42009d8d0 0x7ff4201421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:47928/0 (socket says 172.21.15.38:47928) 2020-06-12T17:50:07.932 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.925+0000 7ff41effd700 1 -- 172.21.15.38:0/3551683016 learned_addr learned my addr 172.21.15.38:0/3551683016 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:07.932 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.925+0000 7ff41f7fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7ff420146680 0x7ff42009d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:60996/0 (socket says 172.21.15.38:60996) 2020-06-12T17:50:07.933 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.925+0000 7ff41effd700 1 -- 172.21.15.38:0/3551683016 >> v2:172.21.15.150:3300/0 conn(0x7ff42009d8d0 msgr2=0x7ff4201421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:07.934 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.925+0000 7ff41effd700 1 --2- 172.21.15.38:0/3551683016 >> v2:172.21.15.150:3300/0 conn(0x7ff42009d8d0 0x7ff4201421d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:07.934 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.925+0000 7ff41effd700 1 -- 172.21.15.38:0/3551683016 >> v1:172.21.15.150:6789/0 conn(0x7ff420146680 legacy=0x7ff42009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:07.934 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.925+0000 7ff41effd700 1 -- 172.21.15.38:0/3551683016 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff420146a60 con 0x7ff4200ad5b0 2020-06-12T17:50:07.934 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.925+0000 7ff41e7fc700 1 -- 172.21.15.38:0/3551683016 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2718439270 0 0) 0x7ff420146d20 con 0x7ff420146680 2020-06-12T17:50:07.934 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.925+0000 7ff41ffff700 1 --2- 172.21.15.38:0/3551683016 >> v2:172.21.15.150:3300/0 conn(0x7ff42009d8d0 0x7ff4201421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:50:07.935 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.925+0000 7ff41effd700 1 --2- 172.21.15.38:0/3551683016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4200ad5b0 0x7ff4200b2eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff414002f30 tx=0x7ff414007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.935 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.925+0000 7ff41effd700 1 --2- 172.21.15.38:0/3551683016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4200ad5b0 0x7ff4200b2eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff414002f30 tx=0x7ff414007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.935 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.925+0000 7ff41effd700 1 --2- 172.21.15.38:0/3551683016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4200ad5b0 0x7ff4200b2eb0 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7ff414002f30 tx=0x7ff414007e60).ready entity=mon.2 client_cookie=6821d1fee83de3c5 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:07.935 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.925+0000 7ff41effd700 1 --2- 172.21.15.38:0/3551683016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4200ad5b0 0x7ff4200b2eb0 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7ff414002f30 tx=0x7ff414007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.935 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.925+0000 7ff41e7fc700 1 -- 172.21.15.38:0/3551683016 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff414011630 con 0x7ff4200ad5b0 2020-06-12T17:50:07.936 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.925+0000 7ff41effd700 1 --2- 172.21.15.38:0/3551683016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4200ad5b0 0x7ff4200b2eb0 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7ff414002f30 tx=0x7ff414007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.936 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.925+0000 7ff41effd700 1 --2- 172.21.15.38:0/3551683016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4200ad5b0 0x7ff4200b2eb0 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7ff414002f30 tx=0x7ff414007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.936 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.925+0000 7ff41e7fc700 1 -- 172.21.15.38:0/3551683016 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff414011790 con 0x7ff4200ad5b0 2020-06-12T17:50:07.936 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.925+0000 7ff41e7fc700 1 -- 172.21.15.38:0/3551683016 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff414011b70 con 0x7ff4200ad5b0 2020-06-12T17:50:07.936 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.925+0000 7ff425f0b700 1 -- 172.21.15.38:0/3551683016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4200ad5b0 msgr2=0x7ff4200b2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:07.937 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.925+0000 7ff425f0b700 1 --2- 172.21.15.38:0/3551683016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4200ad5b0 0x7ff4200b2eb0 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7ff414002f30 tx=0x7ff414007e60).stop 2020-06-12T17:50:07.937 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.926+0000 7ff425f0b700 1 -- 172.21.15.38:0/3551683016 shutdown_connections 2020-06-12T17:50:07.937 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.926+0000 7ff425f0b700 1 --2- 172.21.15.38:0/3551683016 >> v2:172.21.15.150:3300/0 conn(0x7ff42009d8d0 0x7ff4201421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:07.937 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.926+0000 7ff425f0b700 1 --2- 172.21.15.38:0/3551683016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4200ad5b0 0x7ff4200b2eb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:07.937 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.926+0000 7ff425f0b700 1 -- 172.21.15.38:0/3551683016 >> 172.21.15.38:0/3551683016 conn(0x7ff4200b5a20 msgr2=0x7ff42005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:07.938 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.926+0000 7ff425f0b700 1 -- 172.21.15.38:0/3551683016 shutdown_connections 2020-06-12T17:50:07.938 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.926+0000 7ff425f0b700 1 -- 172.21.15.38:0/3551683016 wait complete. 2020-06-12T17:50:07.938 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.927+0000 7ff425f0b700 1 Processor -- start 2020-06-12T17:50:07.938 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.927+0000 7ff425f0b700 1 -- start start 2020-06-12T17:50:07.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.928+0000 7ff425f0b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff42009d8d0 0x7ff420066270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:07.942 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.928+0000 7ff425f0b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff420146680 0x7ff4200626b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:07.942 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.928+0000 7ff425f0b700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4200649b0 con 0x7ff4200ad5b0 2020-06-12T17:50:07.942 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.928+0000 7ff425f0b700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff420064c50 con 0x7ff42009d8d0 2020-06-12T17:50:07.942 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.928+0000 7ff425f0b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff420064ef0 con 0x7ff420146680 2020-06-12T17:50:07.942 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.928+0000 7ff41f7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff42009d8d0 0x7ff420066270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:07.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.928+0000 7ff41effd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff4200ad5b0 0x7ff42013d400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40272/0 (socket says 172.21.15.38:40272) 2020-06-12T17:50:07.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.928+0000 7ff41effd700 1 -- 172.21.15.38:0/799919162 learned_addr learned my addr 172.21.15.38:0/799919162 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:07.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.928+0000 7ff41ffff700 1 --2- 172.21.15.38:0/799919162 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff420146680 0x7ff4200626b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:07.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.928+0000 7ff41f7fe700 1 -- 172.21.15.38:0/799919162 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff420146680 msgr2=0x7ff4200626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:07.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.928+0000 7ff41f7fe700 1 --2- 172.21.15.38:0/799919162 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff420146680 0x7ff4200626b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:07.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.928+0000 7ff41f7fe700 1 -- 172.21.15.38:0/799919162 >> v1:172.21.15.38:6789/0 conn(0x7ff4200ad5b0 legacy=0x7ff42013d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:07.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.928+0000 7ff41f7fe700 1 -- 172.21.15.38:0/799919162 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42013db10 con 0x7ff42009d8d0 2020-06-12T17:50:07.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.928+0000 7ff41cff9700 1 -- 172.21.15.38:0/799919162 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4184582794 0 0) 0x7ff4200649b0 con 0x7ff4200ad5b0 2020-06-12T17:50:07.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.928+0000 7ff41f7fe700 1 --2- 172.21.15.38:0/799919162 >> v2:172.21.15.38:3300/0 conn(0x7ff42009d8d0 0x7ff420066270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff410000b80 tx=0x7ff4100016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.928+0000 7ff41f7fe700 1 --2- 172.21.15.38:0/799919162 >> v2:172.21.15.38:3300/0 conn(0x7ff42009d8d0 0x7ff420066270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff410000b80 tx=0x7ff4100016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.928+0000 7ff41f7fe700 1 --2- 172.21.15.38:0/799919162 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff42009d8d0 0x7ff420066270 secure :-1 s=READY pgs=614 cs=0 l=1 rx=0x7ff410000b80 tx=0x7ff4100016e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:07.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.928+0000 7ff41f7fe700 1 --2- 172.21.15.38:0/799919162 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff42009d8d0 0x7ff420066270 secure :-1 s=THROTTLE_DONE pgs=614 cs=0 l=1 rx=0x7ff410000b80 tx=0x7ff4100016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.928+0000 7ff41cff9700 1 -- 172.21.15.38:0/799919162 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff410011600 con 0x7ff42009d8d0 2020-06-12T17:50:07.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.928+0000 7ff41f7fe700 1 --2- 172.21.15.38:0/799919162 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff42009d8d0 0x7ff420066270 secure :-1 s=THROTTLE_DONE pgs=614 cs=0 l=1 rx=0x7ff410000b80 tx=0x7ff4100016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.928+0000 7ff41f7fe700 1 --2- 172.21.15.38:0/799919162 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff42009d8d0 0x7ff420066270 secure :-1 s=THROTTLE_DONE pgs=614 cs=0 l=1 rx=0x7ff410000b80 tx=0x7ff4100016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.946 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.928+0000 7ff41cff9700 1 -- 172.21.15.38:0/799919162 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff410011760 con 0x7ff42009d8d0 2020-06-12T17:50:07.946 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.928+0000 7ff425f0b700 1 -- 172.21.15.38:0/799919162 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4200b1f80 con 0x7ff42009d8d0 2020-06-12T17:50:07.946 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.928+0000 7ff41cff9700 1 -- 172.21.15.38:0/799919162 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff410011b80 con 0x7ff42009d8d0 2020-06-12T17:50:07.946 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.928+0000 7ff425f0b700 1 -- 172.21.15.38:0/799919162 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff420062c70 con 0x7ff42009d8d0 2020-06-12T17:50:07.946 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.929+0000 7ff41f7fe700 1 --2- 172.21.15.38:0/799919162 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff42009d8d0 0x7ff420066270 secure :-1 s=THROTTLE_DONE pgs=614 cs=0 l=1 rx=0x7ff410000b80 tx=0x7ff4100016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.929+0000 7ff425f0b700 1 -- 172.21.15.38:0/799919162 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff42013dd60 con 0x7ff42009d8d0 2020-06-12T17:50:07.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.929+0000 7ff41cff9700 1 -- 172.21.15.38:0/799919162 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7ff41000b0a0 con 0x7ff42009d8d0 2020-06-12T17:50:07.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.930+0000 7ff41f7fe700 1 --2- 172.21.15.38:0/799919162 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff42009d8d0 0x7ff420066270 secure :-1 s=THROTTLE_DONE pgs=614 cs=0 l=1 rx=0x7ff410000b80 tx=0x7ff4100016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.930+0000 7ff41cff9700 1 --2- 172.21.15.38:0/799919162 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff40004d460 0x7ff40004f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:07.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.930+0000 7ff41cff9700 1 -- 172.21.15.38:0/799919162 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff410060d60 con 0x7ff42009d8d0 2020-06-12T17:50:07.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.930+0000 7ff41effd700 1 --2- 172.21.15.38:0/799919162 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff40004d460 0x7ff40004f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:07.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.930+0000 7ff41effd700 1 --2- 172.21.15.38:0/799919162 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff40004d460 0x7ff40004f920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff414002ed0 tx=0x7ff414007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.930+0000 7ff41effd700 1 --2- 172.21.15.38:0/799919162 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff40004d460 0x7ff40004f920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff414002ed0 tx=0x7ff414007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.931+0000 7ff41effd700 1 --2- 172.21.15.38:0/799919162 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff40004d460 0x7ff40004f920 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7ff414002ed0 tx=0x7ff414007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:07.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.933+0000 7ff41f7fe700 1 --2- 172.21.15.38:0/799919162 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff42009d8d0 0x7ff420066270 secure :-1 s=THROTTLE_DONE pgs=614 cs=0 l=1 rx=0x7ff410000b80 tx=0x7ff4100016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:07.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:07.933+0000 7ff41cff9700 1 -- 172.21.15.38:0/799919162 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7ff41003c4e0 con 0x7ff42009d8d0 2020-06-12T17:50:08.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:08.130+0000 7ff425f0b700 1 -- 172.21.15.38:0/799919162 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_7127", "target": ["mon-mgr", ""]}) v1 -- 0x7ff420061510 con 0x7ff40004d460 2020-06-12T17:50:08.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:08.133+0000 7ff41effd700 1 --2- 172.21.15.38:0/799919162 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff40004d460 0x7ff40004f920 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7ff414002ed0 tx=0x7ff414007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:08.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:08.133+0000 7ff41cff9700 1 -- 172.21.15.38:0/799919162 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7ff420061510 con 0x7ff40004d460 2020-06-12T17:50:08.137 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_7127/efb81559-74c9-4b11-bc69-39c6e9d5e3eb 2020-06-12T17:50:08.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:08.134+0000 7ff425f0b700 1 -- 172.21.15.38:0/799919162 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff40004d460 msgr2=0x7ff40004f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:08.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:08.134+0000 7ff425f0b700 1 --2- 172.21.15.38:0/799919162 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff40004d460 0x7ff40004f920 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7ff414002ed0 tx=0x7ff414007e60).stop 2020-06-12T17:50:08.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:08.134+0000 7ff425f0b700 1 -- 172.21.15.38:0/799919162 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff42009d8d0 msgr2=0x7ff420066270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:08.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:08.134+0000 7ff425f0b700 1 --2- 172.21.15.38:0/799919162 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff42009d8d0 0x7ff420066270 secure :-1 s=READY pgs=614 cs=0 l=1 rx=0x7ff410000b80 tx=0x7ff4100016e0).stop 2020-06-12T17:50:08.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:08.134+0000 7ff425f0b700 1 -- 172.21.15.38:0/799919162 shutdown_connections 2020-06-12T17:50:08.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:08.134+0000 7ff425f0b700 1 --2- 172.21.15.38:0/799919162 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff40004d460 0x7ff40004f920 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:08.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:08.134+0000 7ff425f0b700 1 --2- 172.21.15.38:0/799919162 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff420146680 0x7ff4200626b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:08.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:08.134+0000 7ff425f0b700 1 --2- 172.21.15.38:0/799919162 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff42009d8d0 0x7ff420066270 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:08.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:08.134+0000 7ff425f0b700 1 -- 172.21.15.38:0/799919162 >> 172.21.15.38:0/799919162 conn(0x7ff4200b5a20 msgr2=0x7ff4200b6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:08.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:08.134+0000 7ff425f0b700 1 -- 172.21.15.38:0/799919162 shutdown_connections 2020-06-12T17:50:08.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:08.134+0000 7ff425f0b700 1 -- 172.21.15.38:0/799919162 wait complete. 2020-06-12T17:50:08.148 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_7127 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_7127/efb81559-74c9-4b11-bc69-39c6e9d5e3eb 2020-06-12T17:50:08.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:08.149 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:08.149 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:08.164 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:08.165 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:08.165 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7127/efb81559-74c9-4b11-bc69-39c6e9d5e3eb/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:08.256 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:08.256 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:08.257 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102724 s, 102 MB/s 2020-06-12T17:50:08.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:08.258 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:08.259 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:08.275 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:08.276 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:08.276 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7127/efb81559-74c9-4b11-bc69-39c6e9d5e3eb/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:08.364 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:08.364 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:08.365 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124828 s, 84.0 MB/s 2020-06-12T17:50:08.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:08.371 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:08.372 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:08.389 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:08.389 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:08.390 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7127/efb81559-74c9-4b11-bc69-39c6e9d5e3eb/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:08.478 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:08.478 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:08.479 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111788 s, 93.8 MB/s 2020-06-12T17:50:08.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:08.480 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:08.481 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:08.496 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:08.497 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:08.497 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7127/efb81559-74c9-4b11-bc69-39c6e9d5e3eb/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:08.584 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:08.585 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:08.585 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109778 s, 95.5 MB/s 2020-06-12T17:50:08.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:08.588 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:08.589 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:08.604 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:08.604 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:08.605 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7127/efb81559-74c9-4b11-bc69-39c6e9d5e3eb/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:08.692 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:08.693 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:08.693 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111105 s, 94.4 MB/s 2020-06-12T17:50:08.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:08.695 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:08.696 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:08.713 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:08.713 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:08.714 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7127/efb81559-74c9-4b11-bc69-39c6e9d5e3eb/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:08.800 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:08.800 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:08.801 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951031 s, 110 MB/s 2020-06-12T17:50:08.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:08.803 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:08.804 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:08.819 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:08.820 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:08.821 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7127/efb81559-74c9-4b11-bc69-39c6e9d5e3eb/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:08.907 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:08.908 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:08.908 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011346 s, 92.4 MB/s 2020-06-12T17:50:08.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:08.910 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:08.911 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:08.927 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:08.927 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:08.928 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7127/efb81559-74c9-4b11-bc69-39c6e9d5e3eb/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:09.015 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:09.016 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:09.016 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938556 s, 112 MB/s 2020-06-12T17:50:09.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:09.027 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:09.028 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:09.044 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:09.044 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:09.045 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7127/efb81559-74c9-4b11-bc69-39c6e9d5e3eb/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:09.136 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:09.136 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:09.136 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144908 s, 72.4 MB/s 2020-06-12T17:50:09.137 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:09.138 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:09.138 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:09.154 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:09.154 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:09.155 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7127/efb81559-74c9-4b11-bc69-39c6e9d5e3eb/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:09.242 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:09.242 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:09.243 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104888 s, 100 MB/s 2020-06-12T17:50:09.244 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_3373 2020-06-12T17:50:09.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.362+0000 7f81a200e700 1 Processor -- start 2020-06-12T17:50:09.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.362+0000 7f81a200e700 1 -- start start 2020-06-12T17:50:09.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.362+0000 7f81a200e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f819c0ad5b0 0x7f819c0b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:09.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.362+0000 7f81a200e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f819c09d8d0 0x7f819c1421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:09.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.362+0000 7f81a200e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819c146d20 con 0x7f819c146680 2020-06-12T17:50:09.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.362+0000 7f81a200e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f819c066a80 con 0x7f819c0ad5b0 2020-06-12T17:50:09.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.362+0000 7f81a200e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819c146f50 con 0x7f819c09d8d0 2020-06-12T17:50:09.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.363+0000 7f819affd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f819c0ad5b0 0x7f819c0b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:09.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.363+0000 7f819affd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f819c0ad5b0 0x7f819c0b2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38462/0 (socket says 172.21.15.38:38462) 2020-06-12T17:50:09.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.363+0000 7f819b7fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f819c146680 0x7f819c09d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40278/0 (socket says 172.21.15.38:40278) 2020-06-12T17:50:09.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.363+0000 7f819affd700 1 -- 172.21.15.38:0/162100773 learned_addr learned my addr 172.21.15.38:0/162100773 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:09.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.363+0000 7f819bfff700 1 --2- 172.21.15.38:0/162100773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f819c09d8d0 0x7f819c1421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:09.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.363+0000 7f819affd700 1 -- 172.21.15.38:0/162100773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f819c09d8d0 msgr2=0x7f819c1421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:09.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.363+0000 7f819affd700 1 --2- 172.21.15.38:0/162100773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f819c09d8d0 0x7f819c1421d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:09.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.363+0000 7f819affd700 1 -- 172.21.15.38:0/162100773 >> v1:172.21.15.38:6789/0 conn(0x7f819c146680 legacy=0x7f819c09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:09.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.363+0000 7f819affd700 1 -- 172.21.15.38:0/162100773 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c146a60 con 0x7f819c0ad5b0 2020-06-12T17:50:09.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.363+0000 7f819affd700 1 --2- 172.21.15.38:0/162100773 >> v2:172.21.15.38:3300/0 conn(0x7f819c0ad5b0 0x7f819c0b2eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f818c002f30 tx=0x7f818c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.363+0000 7f819affd700 1 --2- 172.21.15.38:0/162100773 >> v2:172.21.15.38:3300/0 conn(0x7f819c0ad5b0 0x7f819c0b2eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f818c002f30 tx=0x7f818c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.363+0000 7f819affd700 1 --2- 172.21.15.38:0/162100773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f819c0ad5b0 0x7f819c0b2eb0 secure :-1 s=READY pgs=616 cs=0 l=1 rx=0x7f818c002f30 tx=0x7f818c007e60).ready entity=mon.0 client_cookie=e5ecb2e915fcb055 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:09.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.363+0000 7f819affd700 1 --2- 172.21.15.38:0/162100773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f819c0ad5b0 0x7f819c0b2eb0 secure :-1 s=THROTTLE_DONE pgs=616 cs=0 l=1 rx=0x7f818c002f30 tx=0x7f818c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.376 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.363+0000 7f819affd700 1 --2- 172.21.15.38:0/162100773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f819c0ad5b0 0x7f819c0b2eb0 secure :-1 s=THROTTLE_DONE pgs=616 cs=0 l=1 rx=0x7f818c002f30 tx=0x7f818c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.376 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.363+0000 7f819a7fc700 1 -- 172.21.15.38:0/162100773 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f818c0116e0 con 0x7f819c0ad5b0 2020-06-12T17:50:09.376 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.363+0000 7f819affd700 1 --2- 172.21.15.38:0/162100773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f819c0ad5b0 0x7f819c0b2eb0 secure :-1 s=THROTTLE_DONE pgs=616 cs=0 l=1 rx=0x7f818c002f30 tx=0x7f818c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.376 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.363+0000 7f819a7fc700 1 -- 172.21.15.38:0/162100773 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818c011840 con 0x7f819c0ad5b0 2020-06-12T17:50:09.377 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.363+0000 7f819a7fc700 1 -- 172.21.15.38:0/162100773 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f818c011c20 con 0x7f819c0ad5b0 2020-06-12T17:50:09.378 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.363+0000 7f81a200e700 1 -- 172.21.15.38:0/162100773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f819c0ad5b0 msgr2=0x7f819c0b2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:09.378 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.363+0000 7f81a200e700 1 --2- 172.21.15.38:0/162100773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f819c0ad5b0 0x7f819c0b2eb0 secure :-1 s=READY pgs=616 cs=0 l=1 rx=0x7f818c002f30 tx=0x7f818c007e60).stop 2020-06-12T17:50:09.378 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.364+0000 7f81a200e700 1 -- 172.21.15.38:0/162100773 shutdown_connections 2020-06-12T17:50:09.378 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.364+0000 7f81a200e700 1 --2- 172.21.15.38:0/162100773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f819c09d8d0 0x7f819c1421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:09.379 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.364+0000 7f81a200e700 1 --2- 172.21.15.38:0/162100773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f819c0ad5b0 0x7f819c0b2eb0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:09.379 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.364+0000 7f81a200e700 1 -- 172.21.15.38:0/162100773 >> 172.21.15.38:0/162100773 conn(0x7f819c0b5a20 msgr2=0x7f819c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:09.379 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.364+0000 7f81a200e700 1 -- 172.21.15.38:0/162100773 shutdown_connections 2020-06-12T17:50:09.379 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.364+0000 7f81a200e700 1 -- 172.21.15.38:0/162100773 wait complete. 2020-06-12T17:50:09.379 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.365+0000 7f81a200e700 1 Processor -- start 2020-06-12T17:50:09.380 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.365+0000 7f81a200e700 1 -- start start 2020-06-12T17:50:09.380 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.365+0000 7f81a200e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f819c09d8d0 0x7f819c13d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:09.380 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.365+0000 7f81a200e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f819c146680 0x7f819c0b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:09.380 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.365+0000 7f81a200e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819c140890 con 0x7f819c0ad5b0 2020-06-12T17:50:09.380 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.365+0000 7f81a200e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f819c062f10 con 0x7f819c146680 2020-06-12T17:50:09.380 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.365+0000 7f81a200e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f819c0631b0 con 0x7f819c09d8d0 2020-06-12T17:50:09.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.366+0000 7f819bfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f819c146680 0x7f819c0b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:09.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.366+0000 7f819bfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f819c146680 0x7f819c0b1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38470/0 (socket says 172.21.15.38:38470) 2020-06-12T17:50:09.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.366+0000 7f819bfff700 1 -- 172.21.15.38:0/1032552915 learned_addr learned my addr 172.21.15.38:0/1032552915 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:09.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.366+0000 7f819b7fe700 1 --2- 172.21.15.38:0/1032552915 >> v2:172.21.15.150:3300/0 conn(0x7f819c09d8d0 0x7f819c13d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:09.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.366+0000 7f819bfff700 1 -- 172.21.15.38:0/1032552915 >> v2:172.21.15.150:3300/0 conn(0x7f819c09d8d0 msgr2=0x7f819c13d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:09.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.366+0000 7f819bfff700 1 --2- 172.21.15.38:0/1032552915 >> v2:172.21.15.150:3300/0 conn(0x7f819c09d8d0 0x7f819c13d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:09.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.366+0000 7f819bfff700 1 -- 172.21.15.38:0/1032552915 >> v1:172.21.15.150:6789/0 conn(0x7f819c0ad5b0 legacy=0x7f819c140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:09.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.366+0000 7f819bfff700 1 -- 172.21.15.38:0/1032552915 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c063450 con 0x7f819c146680 2020-06-12T17:50:09.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.366+0000 7f819bfff700 1 --2- 172.21.15.38:0/1032552915 >> v2:172.21.15.38:3300/0 conn(0x7f819c146680 0x7f819c0b1ba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f81940032b0 tx=0x7f819400e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.366+0000 7f819bfff700 1 --2- 172.21.15.38:0/1032552915 >> v2:172.21.15.38:3300/0 conn(0x7f819c146680 0x7f819c0b1ba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f81940032b0 tx=0x7f819400e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.366+0000 7f819bfff700 1 --2- 172.21.15.38:0/1032552915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f819c146680 0x7f819c0b1ba0 secure :-1 s=READY pgs=617 cs=0 l=1 rx=0x7f81940032b0 tx=0x7f819400e440).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:09.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.366+0000 7f819bfff700 1 --2- 172.21.15.38:0/1032552915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f819c146680 0x7f819c0b1ba0 secure :-1 s=THROTTLE_DONE pgs=617 cs=0 l=1 rx=0x7f81940032b0 tx=0x7f819400e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.366+0000 7f819bfff700 1 --2- 172.21.15.38:0/1032552915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f819c146680 0x7f819c0b1ba0 secure :-1 s=THROTTLE_DONE pgs=617 cs=0 l=1 rx=0x7f81940032b0 tx=0x7f819400e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.366+0000 7f8198ff9700 1 -- 172.21.15.38:0/1032552915 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8194005e30 con 0x7f819c146680 2020-06-12T17:50:09.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.366+0000 7f819bfff700 1 --2- 172.21.15.38:0/1032552915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f819c146680 0x7f819c0b1ba0 secure :-1 s=THROTTLE_DONE pgs=617 cs=0 l=1 rx=0x7f81940032b0 tx=0x7f819400e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.366+0000 7f8198ff9700 1 -- 172.21.15.38:0/1032552915 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8194007540 con 0x7f819c146680 2020-06-12T17:50:09.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.366+0000 7f81a200e700 1 -- 172.21.15.38:0/1032552915 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819c065280 con 0x7f819c146680 2020-06-12T17:50:09.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.366+0000 7f8198ff9700 1 -- 172.21.15.38:0/1032552915 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f819400e580 con 0x7f819c146680 2020-06-12T17:50:09.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.366+0000 7f81a200e700 1 -- 172.21.15.38:0/1032552915 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f819c150870 con 0x7f819c146680 2020-06-12T17:50:09.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.367+0000 7f819bfff700 1 --2- 172.21.15.38:0/1032552915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f819c146680 0x7f819c0b1ba0 secure :-1 s=THROTTLE_DONE pgs=617 cs=0 l=1 rx=0x7f81940032b0 tx=0x7f819400e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.367+0000 7f81a200e700 1 -- 172.21.15.38:0/1032552915 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f819c0635e0 con 0x7f819c146680 2020-06-12T17:50:09.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.367+0000 7f8198ff9700 1 -- 172.21.15.38:0/1032552915 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f8194010180 con 0x7f819c146680 2020-06-12T17:50:09.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.367+0000 7f819bfff700 1 --2- 172.21.15.38:0/1032552915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f819c146680 0x7f819c0b1ba0 secure :-1 s=THROTTLE_DONE pgs=617 cs=0 l=1 rx=0x7f81940032b0 tx=0x7f819400e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.368+0000 7f8198ff9700 1 --2- 172.21.15.38:0/1032552915 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f817c04d5e0 0x7f817c04faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:09.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.368+0000 7f8198ff9700 1 -- 172.21.15.38:0/1032552915 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8194061060 con 0x7f819c146680 2020-06-12T17:50:09.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.368+0000 7f819b7fe700 1 --2- 172.21.15.38:0/1032552915 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f817c04d5e0 0x7f817c04faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:09.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.368+0000 7f819b7fe700 1 --2- 172.21.15.38:0/1032552915 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f817c04d5e0 0x7f817c04faa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f819c061380 tx=0x7f8190001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.368+0000 7f819b7fe700 1 --2- 172.21.15.38:0/1032552915 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f817c04d5e0 0x7f817c04faa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f819c061380 tx=0x7f8190001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.368+0000 7f819b7fe700 1 --2- 172.21.15.38:0/1032552915 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f817c04d5e0 0x7f817c04faa0 secure :-1 s=READY pgs=244 cs=0 l=1 rx=0x7f819c061380 tx=0x7f8190001700).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:09.387 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.371+0000 7f819bfff700 1 --2- 172.21.15.38:0/1032552915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f819c146680 0x7f819c0b1ba0 secure :-1 s=THROTTLE_DONE pgs=617 cs=0 l=1 rx=0x7f81940032b0 tx=0x7f819400e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.387 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.371+0000 7f8198ff9700 1 -- 172.21.15.38:0/1032552915 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f819403c7e0 con 0x7f819c146680 2020-06-12T17:50:09.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.569+0000 7f81a200e700 1 -- 172.21.15.38:0/1032552915 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_3373", "target": ["mon-mgr", ""]}) v1 -- 0x7f819c0b23b0 con 0x7f817c04d5e0 2020-06-12T17:50:09.599 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.588+0000 7f819b7fe700 1 --2- 172.21.15.38:0/1032552915 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f817c04d5e0 0x7f817c04faa0 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7f819c061380 tx=0x7f8190001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.599 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.588+0000 7f8198ff9700 1 -- 172.21.15.38:0/1032552915 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f819c0b23b0 con 0x7f817c04d5e0 2020-06-12T17:50:09.599 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.590+0000 7f81a200e700 1 -- 172.21.15.38:0/1032552915 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f817c04d5e0 msgr2=0x7f817c04faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:09.600 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.590+0000 7f81a200e700 1 --2- 172.21.15.38:0/1032552915 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f817c04d5e0 0x7f817c04faa0 secure :-1 s=READY pgs=244 cs=0 l=1 rx=0x7f819c061380 tx=0x7f8190001700).stop 2020-06-12T17:50:09.600 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.590+0000 7f81a200e700 1 -- 172.21.15.38:0/1032552915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f819c146680 msgr2=0x7f819c0b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:09.600 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.590+0000 7f81a200e700 1 --2- 172.21.15.38:0/1032552915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f819c146680 0x7f819c0b1ba0 secure :-1 s=READY pgs=617 cs=0 l=1 rx=0x7f81940032b0 tx=0x7f819400e440).stop 2020-06-12T17:50:09.600 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.590+0000 7f81a200e700 1 -- 172.21.15.38:0/1032552915 shutdown_connections 2020-06-12T17:50:09.600 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.590+0000 7f81a200e700 1 --2- 172.21.15.38:0/1032552915 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f817c04d5e0 0x7f817c04faa0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:09.601 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.590+0000 7f81a200e700 1 --2- 172.21.15.38:0/1032552915 >> v2:172.21.15.150:3300/0 conn(0x7f819c09d8d0 0x7f819c13d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:09.601 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.590+0000 7f81a200e700 1 --2- 172.21.15.38:0/1032552915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f819c146680 0x7f819c0b1ba0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:09.601 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.590+0000 7f81a200e700 1 -- 172.21.15.38:0/1032552915 >> 172.21.15.38:0/1032552915 conn(0x7f819c0b5a20 msgr2=0x7f819c0b7040 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:09.601 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.590+0000 7f81a200e700 1 -- 172.21.15.38:0/1032552915 shutdown_connections 2020-06-12T17:50:09.602 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.590+0000 7f81a200e700 1 -- 172.21.15.38:0/1032552915 wait complete. 2020-06-12T17:50:09.603 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_3373 2020-06-12T17:50:09.720 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.717+0000 7fdcfbff2700 1 Processor -- start 2020-06-12T17:50:09.721 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.717+0000 7fdcfbff2700 1 -- start start 2020-06-12T17:50:09.723 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.718+0000 7fdcfbff2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdcf40b3ac0 0x7fdcf409df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:09.723 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.718+0000 7fdcfbff2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdcf413c650 0x7fdcf4066790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:09.724 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.718+0000 7fdcfbff2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf409b960 con 0x7fdcf4142e90 2020-06-12T17:50:09.724 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.718+0000 7fdcfbff2700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcf409bc00 con 0x7fdcf413c650 2020-06-12T17:50:09.724 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.718+0000 7fdcfbff2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf40b48f0 con 0x7fdcf40b3ac0 2020-06-12T17:50:09.724 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.718+0000 7fdcfa58f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdcf413c650 0x7fdcf4066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:09.724 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.718+0000 7fdcfa58f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdcf413c650 0x7fdcf4066790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38480/0 (socket says 172.21.15.38:38480) 2020-06-12T17:50:09.725 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.718+0000 7fdcfa58f700 1 -- 172.21.15.38:0/3871496028 learned_addr learned my addr 172.21.15.38:0/3871496028 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:09.725 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.718+0000 7fdcf9d8e700 1 --2- 172.21.15.38:0/3871496028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdcf40b3ac0 0x7fdcf409df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:09.725 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.718+0000 7fdcfa58f700 1 -- 172.21.15.38:0/3871496028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdcf40b3ac0 msgr2=0x7fdcf409df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:09.725 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.718+0000 7fdcfa58f700 1 --2- 172.21.15.38:0/3871496028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdcf40b3ac0 0x7fdcf409df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:09.725 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.718+0000 7fdcfa58f700 1 -- 172.21.15.38:0/3871496028 >> v1:172.21.15.150:6789/0 conn(0x7fdcf4142e90 legacy=0x7fdcf413bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:09.726 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.718+0000 7fdcfa58f700 1 -- 172.21.15.38:0/3871496028 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf40b3ea0 con 0x7fdcf413c650 2020-06-12T17:50:09.726 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.718+0000 7fdcfa58f700 1 --2- 172.21.15.38:0/3871496028 >> v2:172.21.15.38:3300/0 conn(0x7fdcf413c650 0x7fdcf4066790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdcec002f30 tx=0x7fdcec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.726 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.719+0000 7fdcfa58f700 1 --2- 172.21.15.38:0/3871496028 >> v2:172.21.15.38:3300/0 conn(0x7fdcf413c650 0x7fdcf4066790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdcec002f30 tx=0x7fdcec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.726 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.719+0000 7fdcfa58f700 1 --2- 172.21.15.38:0/3871496028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcf413c650 0x7fdcf4066790 secure :-1 s=READY pgs=618 cs=0 l=1 rx=0x7fdcec002f30 tx=0x7fdcec007e60).ready entity=mon.0 client_cookie=58882c28c5f72043 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:09.726 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.719+0000 7fdcfa58f700 1 --2- 172.21.15.38:0/3871496028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcf413c650 0x7fdcf4066790 secure :-1 s=THROTTLE_DONE pgs=618 cs=0 l=1 rx=0x7fdcec002f30 tx=0x7fdcec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.727 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.719+0000 7fdcf8d8c700 1 -- 172.21.15.38:0/3871496028 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcec0127f0 con 0x7fdcf413c650 2020-06-12T17:50:09.727 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.719+0000 7fdcfa58f700 1 --2- 172.21.15.38:0/3871496028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcf413c650 0x7fdcf4066790 secure :-1 s=THROTTLE_DONE pgs=618 cs=0 l=1 rx=0x7fdcec002f30 tx=0x7fdcec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.727 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.719+0000 7fdcfa58f700 1 --2- 172.21.15.38:0/3871496028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcf413c650 0x7fdcf4066790 secure :-1 s=THROTTLE_DONE pgs=618 cs=0 l=1 rx=0x7fdcec002f30 tx=0x7fdcec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.727 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.719+0000 7fdcf8d8c700 1 -- 172.21.15.38:0/3871496028 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcec012950 con 0x7fdcf413c650 2020-06-12T17:50:09.728 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.719+0000 7fdcf8d8c700 1 -- 172.21.15.38:0/3871496028 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcec012d70 con 0x7fdcf413c650 2020-06-12T17:50:09.728 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.719+0000 7fdcfbff2700 1 -- 172.21.15.38:0/3871496028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcf413c650 msgr2=0x7fdcf4066790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:09.728 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.719+0000 7fdcfbff2700 1 --2- 172.21.15.38:0/3871496028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcf413c650 0x7fdcf4066790 secure :-1 s=READY pgs=618 cs=0 l=1 rx=0x7fdcec002f30 tx=0x7fdcec007e60).stop 2020-06-12T17:50:09.728 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.719+0000 7fdcfbff2700 1 -- 172.21.15.38:0/3871496028 shutdown_connections 2020-06-12T17:50:09.728 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.719+0000 7fdcfbff2700 1 --2- 172.21.15.38:0/3871496028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdcf40b3ac0 0x7fdcf409df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:09.729 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.719+0000 7fdcfbff2700 1 --2- 172.21.15.38:0/3871496028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcf413c650 0x7fdcf4066790 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:09.729 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.719+0000 7fdcfbff2700 1 -- 172.21.15.38:0/3871496028 >> 172.21.15.38:0/3871496028 conn(0x7fdcf40b5a20 msgr2=0x7fdcf405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:09.729 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.719+0000 7fdcfbff2700 1 -- 172.21.15.38:0/3871496028 shutdown_connections 2020-06-12T17:50:09.729 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.719+0000 7fdcfbff2700 1 -- 172.21.15.38:0/3871496028 wait complete. 2020-06-12T17:50:09.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.720+0000 7fdcfbff2700 1 Processor -- start 2020-06-12T17:50:09.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.720+0000 7fdcfbff2700 1 -- start start 2020-06-12T17:50:09.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.721+0000 7fdcfbff2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdcf4142e90 0x7fdcf413ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:09.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.721+0000 7fdcfbff2700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf40af670 con 0x7fdcf413c650 2020-06-12T17:50:09.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.721+0000 7fdcfbff2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf40af8a0 con 0x7fdcf40b3ac0 2020-06-12T17:50:09.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.721+0000 7fdcfbff2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf413ef30 con 0x7fdcf4142e90 2020-06-12T17:50:09.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.721+0000 7fdcf958d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fdcf413c650 0x7fdcf413ca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40300/0 (socket says 172.21.15.38:40300) 2020-06-12T17:50:09.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.721+0000 7fdcf958d700 1 -- 172.21.15.38:0/2844329489 learned_addr learned my addr 172.21.15.38:0/2844329489 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:09.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.721+0000 7fdcfa58f700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdcf4142e90 0x7fdcf413ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:09.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.721+0000 7fdce2ffd700 1 -- 172.21.15.38:0/2844329489 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2863576640 0 0) 0x7fdcf40af670 con 0x7fdcf413c650 2020-06-12T17:50:09.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.721+0000 7fdce2ffd700 1 -- 172.21.15.38:0/2844329489 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcd4002fe0 con 0x7fdcf413c650 2020-06-12T17:50:09.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.721+0000 7fdce2ffd700 1 -- 172.21.15.38:0/2844329489 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1660451106 0 0) 0x7fdcf40af8a0 con 0x7fdcf40b3ac0 2020-06-12T17:50:09.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.721+0000 7fdce2ffd700 1 -- 172.21.15.38:0/2844329489 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcf40af670 con 0x7fdcf40b3ac0 2020-06-12T17:50:09.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdce2ffd700 1 -- 172.21.15.38:0/2844329489 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3908381210 0 0) 0x7fdcd4002fe0 con 0x7fdcf413c650 2020-06-12T17:50:09.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdce2ffd700 1 -- 172.21.15.38:0/2844329489 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdcf40af8a0 con 0x7fdcf413c650 2020-06-12T17:50:09.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdce2ffd700 1 -- 172.21.15.38:0/2844329489 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fdcf0001d40 con 0x7fdcf413c650 2020-06-12T17:50:09.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdce2ffd700 1 -- 172.21.15.38:0/2844329489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdcf4142e90 msgr2=0x7fdcf413ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:09.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdce2ffd700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdcf4142e90 0x7fdcf413ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:09.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdce2ffd700 1 -- 172.21.15.38:0/2844329489 >> v1:172.21.15.150:6789/0 conn(0x7fdcf40b3ac0 legacy=0x7fdcf40b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:09.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdce2ffd700 1 -- 172.21.15.38:0/2844329489 >> v1:172.21.15.38:6789/0 conn(0x7fdcf413c650 legacy=0x7fdcf413ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:09.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdce2ffd700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcd4004b20 0x7fdcd4004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:09.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdce2ffd700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcd4003ab0 0x7fdcd4003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:09.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdce2ffd700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdcd4004350 0x7fdcd400b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:09.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdce2ffd700 1 -- 172.21.15.38:0/2844329489 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd40047d0 con 0x7fdcd4004b20 2020-06-12T17:50:09.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdce2ffd700 1 -- 172.21.15.38:0/2844329489 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd4004940 con 0x7fdcd4003ab0 2020-06-12T17:50:09.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdce2ffd700 1 -- 172.21.15.38:0/2844329489 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd400bc00 con 0x7fdcd4004350 2020-06-12T17:50:09.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdcfa58f700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdcf4142e90 0x7fdcf413ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:50:09.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdcf9d8e700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcd4004b20 0x7fdcd4004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:09.740 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdcf958d700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcd4003ab0 0x7fdcd4003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:09.740 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdcfa58f700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdcd4004350 0x7fdcd400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:09.740 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdcf9d8e700 1 -- 172.21.15.38:0/2844329489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdcd4004350 msgr2=0x7fdcd400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:09.740 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdcf9d8e700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdcd4004350 0x7fdcd400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:09.740 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdcf9d8e700 1 -- 172.21.15.38:0/2844329489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcd4003ab0 msgr2=0x7fdcd4003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:09.741 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdcf9d8e700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcd4003ab0 0x7fdcd4003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:09.741 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdcf9d8e700 1 -- 172.21.15.38:0/2844329489 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf4066c70 con 0x7fdcd4004b20 2020-06-12T17:50:09.741 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdcfbff2700 1 -- 172.21.15.38:0/2844329489 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf413f7f0 con 0x7fdcd4004b20 2020-06-12T17:50:09.741 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdcfa58f700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdcd4004350 0x7fdcd400b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:50:09.741 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdcf9d8e700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcd4004b20 0x7fdcd4004f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdcd4004a80 tx=0x7fdce4008230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.741 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdcfbff2700 1 -- 172.21.15.38:0/2844329489 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf4141350 con 0x7fdcd4004b20 2020-06-12T17:50:09.742 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdcf9d8e700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcd4004b20 0x7fdcd4004f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdcd4004a80 tx=0x7fdce4008230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.742 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdcf9d8e700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcd4004b20 0x7fdcd4004f40 secure :-1 s=READY pgs=620 cs=0 l=1 rx=0x7fdcd4004a80 tx=0x7fdce4008230).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:09.742 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdcf9d8e700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcd4004b20 0x7fdcd4004f40 secure :-1 s=THROTTLE_DONE pgs=620 cs=0 l=1 rx=0x7fdcd4004a80 tx=0x7fdce4008230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.742 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdce2ffd700 1 -- 172.21.15.38:0/2844329489 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdce4013cb0 con 0x7fdcd4004b20 2020-06-12T17:50:09.742 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdcf9d8e700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcd4004b20 0x7fdcd4004f40 secure :-1 s=THROTTLE_DONE pgs=620 cs=0 l=1 rx=0x7fdcd4004a80 tx=0x7fdce4008230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.743 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdcf9d8e700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcd4004b20 0x7fdcd4004f40 secure :-1 s=THROTTLE_DONE pgs=620 cs=0 l=1 rx=0x7fdcd4004a80 tx=0x7fdce4008230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.743 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdce2ffd700 1 -- 172.21.15.38:0/2844329489 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce4013e50 con 0x7fdcd4004b20 2020-06-12T17:50:09.743 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.722+0000 7fdce2ffd700 1 -- 172.21.15.38:0/2844329489 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdce40058b0 con 0x7fdcd4004b20 2020-06-12T17:50:09.743 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.723+0000 7fdcf9d8e700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcd4004b20 0x7fdcd4004f40 secure :-1 s=THROTTLE_DONE pgs=620 cs=0 l=1 rx=0x7fdcd4004a80 tx=0x7fdce4008230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.743 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.723+0000 7fdcfbff2700 1 -- 172.21.15.38:0/2844329489 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf4067b20 con 0x7fdcd4004b20 2020-06-12T17:50:09.744 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.723+0000 7fdce2ffd700 1 -- 172.21.15.38:0/2844329489 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fdce4005a10 con 0x7fdcd4004b20 2020-06-12T17:50:09.744 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.723+0000 7fdcf9d8e700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcd4004b20 0x7fdcd4004f40 secure :-1 s=THROTTLE_DONE pgs=620 cs=0 l=1 rx=0x7fdcd4004a80 tx=0x7fdce4008230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.744 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.724+0000 7fdce2ffd700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdcd405a380 0x7fdcd405c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:09.744 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.724+0000 7fdce2ffd700 1 -- 172.21.15.38:0/2844329489 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fdce4060e80 con 0x7fdcd4004b20 2020-06-12T17:50:09.744 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.724+0000 7fdcf958d700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdcd405a380 0x7fdcd405c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:09.745 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.724+0000 7fdcf958d700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdcd405a380 0x7fdcd405c840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdcf0001b10 tx=0x7fdcf000ed00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.745 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.724+0000 7fdcf958d700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdcd405a380 0x7fdcd405c840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdcf0001b10 tx=0x7fdcf000ed00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.745 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.724+0000 7fdcf958d700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdcd405a380 0x7fdcd405c840 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7fdcf0001b10 tx=0x7fdcf000ed00).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:09.745 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.727+0000 7fdcf9d8e700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcd4004b20 0x7fdcd4004f40 secure :-1 s=THROTTLE_DONE pgs=620 cs=0 l=1 rx=0x7fdcd4004a80 tx=0x7fdce4008230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.745 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.727+0000 7fdce2ffd700 1 -- 172.21.15.38:0/2844329489 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fdce403c660 con 0x7fdcd4004b20 2020-06-12T17:50:09.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.921+0000 7fdcfbff2700 1 -- 172.21.15.38:0/2844329489 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_3373", "target": ["mon-mgr", ""]}) v1 -- 0x7fdcf4056c30 con 0x7fdcd405a380 2020-06-12T17:50:09.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.924+0000 7fdcf958d700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdcd405a380 0x7fdcd405c840 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7fdcf0001b10 tx=0x7fdcf000ed00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:09.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.924+0000 7fdce2ffd700 1 -- 172.21.15.38:0/2844329489 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7fdcf4056c30 con 0x7fdcd405a380 2020-06-12T17:50:09.928 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_3373/4f9cc1aa-9ecf-49e6-b601-d98ee0732f90 2020-06-12T17:50:09.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.925+0000 7fdcfbff2700 1 -- 172.21.15.38:0/2844329489 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdcd405a380 msgr2=0x7fdcd405c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:09.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.925+0000 7fdcfbff2700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdcd405a380 0x7fdcd405c840 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7fdcf0001b10 tx=0x7fdcf000ed00).stop 2020-06-12T17:50:09.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.925+0000 7fdcfbff2700 1 -- 172.21.15.38:0/2844329489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcd4004b20 msgr2=0x7fdcd4004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:09.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.925+0000 7fdcfbff2700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcd4004b20 0x7fdcd4004f40 secure :-1 s=READY pgs=620 cs=0 l=1 rx=0x7fdcd4004a80 tx=0x7fdce4008230).stop 2020-06-12T17:50:09.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.925+0000 7fdcfa58f700 1 -- 172.21.15.38:0/2844329489 reap_dead start 2020-06-12T17:50:09.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.925+0000 7fdcfbff2700 1 -- 172.21.15.38:0/2844329489 shutdown_connections 2020-06-12T17:50:09.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.925+0000 7fdcfbff2700 1 --2- 172.21.15.38:0/2844329489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcd4004b20 0x7fdcd4004f40 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:09.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.925+0000 7fdcfbff2700 1 -- 172.21.15.38:0/2844329489 >> 172.21.15.38:0/2844329489 conn(0x7fdcf40b5a20 msgr2=0x7fdcf40b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:09.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.925+0000 7fdcfbff2700 1 -- 172.21.15.38:0/2844329489 shutdown_connections 2020-06-12T17:50:09.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:09.925+0000 7fdcfbff2700 1 -- 172.21.15.38:0/2844329489 wait complete. 2020-06-12T17:50:09.939 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_3373 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_3373/4f9cc1aa-9ecf-49e6-b601-d98ee0732f90 2020-06-12T17:50:09.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:09.940 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:09.941 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:09.956 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:09.956 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:09.956 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3373/4f9cc1aa-9ecf-49e6-b601-d98ee0732f90/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:10.047 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:10.047 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:10.048 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110874 s, 94.6 MB/s 2020-06-12T17:50:10.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:10.050 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:10.051 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:10.066 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:10.066 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:10.067 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3373/4f9cc1aa-9ecf-49e6-b601-d98ee0732f90/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:10.154 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:10.155 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:10.155 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119454 s, 87.8 MB/s 2020-06-12T17:50:10.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:10.157 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:10.157 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:10.171 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:10.173 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:10.173 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3373/4f9cc1aa-9ecf-49e6-b601-d98ee0732f90/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:10.261 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:10.261 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:10.261 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912978 s, 115 MB/s 2020-06-12T17:50:10.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:10.263 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:10.263 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:10.278 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:10.279 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:10.279 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3373/4f9cc1aa-9ecf-49e6-b601-d98ee0732f90/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:10.367 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:10.368 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:10.368 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126443 s, 82.9 MB/s 2020-06-12T17:50:10.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:10.369 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:10.370 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:10.385 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:10.385 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:10.386 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3373/4f9cc1aa-9ecf-49e6-b601-d98ee0732f90/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:10.473 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:10.473 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:10.473 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111419 s, 94.1 MB/s 2020-06-12T17:50:10.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:10.475 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:10.476 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:10.490 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:10.491 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:10.491 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3373/4f9cc1aa-9ecf-49e6-b601-d98ee0732f90/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:10.575 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:10.575 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:10.576 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010653 s, 98.4 MB/s 2020-06-12T17:50:10.576 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:10.577 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:10.577 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:10.592 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:10.592 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:10.593 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3373/4f9cc1aa-9ecf-49e6-b601-d98ee0732f90/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:10.684 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:10.685 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:10.685 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115493 s, 90.8 MB/s 2020-06-12T17:50:10.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:10.687 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:10.687 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:10.702 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:10.702 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:10.703 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3373/4f9cc1aa-9ecf-49e6-b601-d98ee0732f90/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:10.792 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:10.792 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:10.793 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121851 s, 86.1 MB/s 2020-06-12T17:50:10.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:10.794 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:10.794 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:10.809 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:10.810 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:10.811 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3373/4f9cc1aa-9ecf-49e6-b601-d98ee0732f90/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:10.897 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:10.897 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:10.897 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105908 s, 99.0 MB/s 2020-06-12T17:50:10.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:10.899 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:10.899 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:10.915 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:10.915 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:10.916 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3373/4f9cc1aa-9ecf-49e6-b601-d98ee0732f90/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:11.006 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:11.007 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:11.007 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114905 s, 91.3 MB/s 2020-06-12T17:50:11.008 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_3903 2020-06-12T17:50:11.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.132+0000 7f3e83244700 1 Processor -- start 2020-06-12T17:50:11.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.132+0000 7f3e83244700 1 -- start start 2020-06-12T17:50:11.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.133+0000 7f3e83244700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3e7c0ad5b0 0x7f3e7c0b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:11.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.133+0000 7f3e83244700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3e7c09d8d0 0x7f3e7c1421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:11.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.133+0000 7f3e83244700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e7c146d20 con 0x7f3e7c146680 2020-06-12T17:50:11.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.133+0000 7f3e83244700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e7c066a80 con 0x7f3e7c09d8d0 2020-06-12T17:50:11.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.133+0000 7f3e83244700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e7c146f50 con 0x7f3e7c0ad5b0 2020-06-12T17:50:11.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.133+0000 7f3e817e1700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3e7c09d8d0 0x7f3e7c1421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:11.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.133+0000 7f3e817e1700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3e7c09d8d0 0x7f3e7c1421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38496/0 (socket says 172.21.15.38:38496) 2020-06-12T17:50:11.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.133+0000 7f3e817e1700 1 -- 172.21.15.38:0/2164735428 learned_addr learned my addr 172.21.15.38:0/2164735428 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:11.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.133+0000 7f3e80fe0700 1 --1- 172.21.15.38:0/2164735428 >> v1:172.21.15.38:6789/0 conn(0x7f3e7c146680 0x7f3e7c09d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40312/0 (socket says 172.21.15.38:40312) 2020-06-12T17:50:11.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.134+0000 7f3e7bfff700 1 --2- 172.21.15.38:0/2164735428 >> v2:172.21.15.150:3300/0 conn(0x7f3e7c0ad5b0 0x7f3e7c0b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:11.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.134+0000 7f3e817e1700 1 -- 172.21.15.38:0/2164735428 >> v2:172.21.15.150:3300/0 conn(0x7f3e7c0ad5b0 msgr2=0x7f3e7c0b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:11.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.134+0000 7f3e817e1700 1 --2- 172.21.15.38:0/2164735428 >> v2:172.21.15.150:3300/0 conn(0x7f3e7c0ad5b0 0x7f3e7c0b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:11.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.134+0000 7f3e817e1700 1 -- 172.21.15.38:0/2164735428 >> v1:172.21.15.38:6789/0 conn(0x7f3e7c146680 legacy=0x7f3e7c09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:11.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.134+0000 7f3e7b7fe700 1 -- 172.21.15.38:0/2164735428 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22965525 0 0) 0x7f3e7c146d20 con 0x7f3e7c146680 2020-06-12T17:50:11.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.134+0000 7f3e817e1700 1 -- 172.21.15.38:0/2164735428 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7c146a60 con 0x7f3e7c09d8d0 2020-06-12T17:50:11.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.134+0000 7f3e7bfff700 1 --2- 172.21.15.38:0/2164735428 >> v2:172.21.15.150:3300/0 conn(0x7f3e7c0ad5b0 0x7f3e7c0b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:50:11.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.134+0000 7f3e817e1700 1 --2- 172.21.15.38:0/2164735428 >> v2:172.21.15.38:3300/0 conn(0x7f3e7c09d8d0 0x7f3e7c1421d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3e7c0b61f0 tx=0x7f3e740081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.134+0000 7f3e817e1700 1 --2- 172.21.15.38:0/2164735428 >> v2:172.21.15.38:3300/0 conn(0x7f3e7c09d8d0 0x7f3e7c1421d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3e7c0b61f0 tx=0x7f3e740081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.156 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.134+0000 7f3e817e1700 1 --2- 172.21.15.38:0/2164735428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e7c09d8d0 0x7f3e7c1421d0 secure :-1 s=READY pgs=622 cs=0 l=1 rx=0x7f3e7c0b61f0 tx=0x7f3e740081e0).ready entity=mon.0 client_cookie=223ee0a393214030 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:11.156 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.134+0000 7f3e817e1700 1 --2- 172.21.15.38:0/2164735428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e7c09d8d0 0x7f3e7c1421d0 secure :-1 s=THROTTLE_DONE pgs=622 cs=0 l=1 rx=0x7f3e7c0b61f0 tx=0x7f3e740081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.156 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.134+0000 7f3e7b7fe700 1 -- 172.21.15.38:0/2164735428 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e7400a160 con 0x7f3e7c09d8d0 2020-06-12T17:50:11.156 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.134+0000 7f3e817e1700 1 --2- 172.21.15.38:0/2164735428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e7c09d8d0 0x7f3e7c1421d0 secure :-1 s=THROTTLE_DONE pgs=622 cs=0 l=1 rx=0x7f3e7c0b61f0 tx=0x7f3e740081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.156 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.134+0000 7f3e7b7fe700 1 -- 172.21.15.38:0/2164735428 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7400a2c0 con 0x7f3e7c09d8d0 2020-06-12T17:50:11.157 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.134+0000 7f3e817e1700 1 --2- 172.21.15.38:0/2164735428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e7c09d8d0 0x7f3e7c1421d0 secure :-1 s=THROTTLE_DONE pgs=622 cs=0 l=1 rx=0x7f3e7c0b61f0 tx=0x7f3e740081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.157 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.134+0000 7f3e83244700 1 -- 172.21.15.38:0/2164735428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e7c09d8d0 msgr2=0x7f3e7c1421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:11.157 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.134+0000 7f3e7b7fe700 1 -- 172.21.15.38:0/2164735428 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e7400a660 con 0x7f3e7c09d8d0 2020-06-12T17:50:11.157 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.134+0000 7f3e83244700 1 --2- 172.21.15.38:0/2164735428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e7c09d8d0 0x7f3e7c1421d0 secure :-1 s=READY pgs=622 cs=0 l=1 rx=0x7f3e7c0b61f0 tx=0x7f3e740081e0).stop 2020-06-12T17:50:11.157 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.134+0000 7f3e83244700 1 -- 172.21.15.38:0/2164735428 shutdown_connections 2020-06-12T17:50:11.158 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.134+0000 7f3e83244700 1 --2- 172.21.15.38:0/2164735428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e7c09d8d0 0x7f3e7c1421d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:11.158 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.134+0000 7f3e83244700 1 --2- 172.21.15.38:0/2164735428 >> v2:172.21.15.150:3300/0 conn(0x7f3e7c0ad5b0 0x7f3e7c0b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:11.158 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.134+0000 7f3e83244700 1 -- 172.21.15.38:0/2164735428 >> 172.21.15.38:0/2164735428 conn(0x7f3e7c0b5a20 msgr2=0x7f3e7c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:11.158 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.134+0000 7f3e83244700 1 -- 172.21.15.38:0/2164735428 shutdown_connections 2020-06-12T17:50:11.158 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.135+0000 7f3e83244700 1 -- 172.21.15.38:0/2164735428 wait complete. 2020-06-12T17:50:11.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.135+0000 7f3e83244700 1 Processor -- start 2020-06-12T17:50:11.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.135+0000 7f3e83244700 1 -- start start 2020-06-12T17:50:11.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.136+0000 7f3e83244700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3e7c09d8d0 0x7f3e7c062690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:11.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.136+0000 7f3e83244700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3e7c0ad5b0 0x7f3e7c0b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:11.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.136+0000 7f3e83244700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e7c062e70 con 0x7f3e7c146680 2020-06-12T17:50:11.160 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.136+0000 7f3e83244700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e7c0630e0 con 0x7f3e7c0ad5b0 2020-06-12T17:50:11.160 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.136+0000 7f3e83244700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e7c066390 con 0x7f3e7c09d8d0 2020-06-12T17:50:11.160 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.136+0000 7f3e7bfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3e7c0ad5b0 0x7f3e7c0b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:11.160 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.136+0000 7f3e7bfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3e7c0ad5b0 0x7f3e7c0b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38500/0 (socket says 172.21.15.38:38500) 2020-06-12T17:50:11.160 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.136+0000 7f3e7bfff700 1 -- 172.21.15.38:0/492384957 learned_addr learned my addr 172.21.15.38:0/492384957 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:11.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.137+0000 7f3e80fe0700 1 --2- 172.21.15.38:0/492384957 >> v2:172.21.15.150:3300/0 conn(0x7f3e7c09d8d0 0x7f3e7c062690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:11.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.137+0000 7f3e7bfff700 1 -- 172.21.15.38:0/492384957 >> v2:172.21.15.150:3300/0 conn(0x7f3e7c09d8d0 msgr2=0x7f3e7c062690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:11.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.137+0000 7f3e7bfff700 1 --2- 172.21.15.38:0/492384957 >> v2:172.21.15.150:3300/0 conn(0x7f3e7c09d8d0 0x7f3e7c062690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:11.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.137+0000 7f3e7bfff700 1 -- 172.21.15.38:0/492384957 >> v1:172.21.15.38:6789/0 conn(0x7f3e7c146680 legacy=0x7f3e7c0aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:11.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.137+0000 7f3e79ffb700 1 -- 172.21.15.38:0/492384957 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3463320263 0 0) 0x7f3e7c062e70 con 0x7f3e7c146680 2020-06-12T17:50:11.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.137+0000 7f3e7bfff700 1 -- 172.21.15.38:0/492384957 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7c063580 con 0x7f3e7c0ad5b0 2020-06-12T17:50:11.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.137+0000 7f3e7bfff700 1 --2- 172.21.15.38:0/492384957 >> v2:172.21.15.38:3300/0 conn(0x7f3e7c0ad5b0 0x7f3e7c0b1e30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3e70002f30 tx=0x7f3e70007f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.137+0000 7f3e7bfff700 1 --2- 172.21.15.38:0/492384957 >> v2:172.21.15.38:3300/0 conn(0x7f3e7c0ad5b0 0x7f3e7c0b1e30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3e70002f30 tx=0x7f3e70007f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.137+0000 7f3e7bfff700 1 --2- 172.21.15.38:0/492384957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e7c0ad5b0 0x7f3e7c0b1e30 secure :-1 s=READY pgs=624 cs=0 l=1 rx=0x7f3e70002f30 tx=0x7f3e70007f80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:11.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.137+0000 7f3e7bfff700 1 --2- 172.21.15.38:0/492384957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e7c0ad5b0 0x7f3e7c0b1e30 secure :-1 s=THROTTLE_DONE pgs=624 cs=0 l=1 rx=0x7f3e70002f30 tx=0x7f3e70007f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.137+0000 7f3e7bfff700 1 --2- 172.21.15.38:0/492384957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e7c0ad5b0 0x7f3e7c0b1e30 secure :-1 s=THROTTLE_DONE pgs=624 cs=0 l=1 rx=0x7f3e70002f30 tx=0x7f3e70007f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.137+0000 7f3e79ffb700 1 -- 172.21.15.38:0/492384957 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e70007160 con 0x7f3e7c0ad5b0 2020-06-12T17:50:11.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.137+0000 7f3e7bfff700 1 --2- 172.21.15.38:0/492384957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e7c0ad5b0 0x7f3e7c0b1e30 secure :-1 s=THROTTLE_DONE pgs=624 cs=0 l=1 rx=0x7f3e70002f30 tx=0x7f3e70007f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.137+0000 7f3e79ffb700 1 -- 172.21.15.38:0/492384957 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e700072c0 con 0x7f3e7c0ad5b0 2020-06-12T17:50:11.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.137+0000 7f3e83244700 1 -- 172.21.15.38:0/492384957 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e7c063770 con 0x7f3e7c0ad5b0 2020-06-12T17:50:11.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.137+0000 7f3e79ffb700 1 -- 172.21.15.38:0/492384957 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e700059c0 con 0x7f3e7c0ad5b0 2020-06-12T17:50:11.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.137+0000 7f3e83244700 1 -- 172.21.15.38:0/492384957 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e7c09ccf0 con 0x7f3e7c0ad5b0 2020-06-12T17:50:11.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.138+0000 7f3e7bfff700 1 --2- 172.21.15.38:0/492384957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e7c0ad5b0 0x7f3e7c0b1e30 secure :-1 s=THROTTLE_DONE pgs=624 cs=0 l=1 rx=0x7f3e70002f30 tx=0x7f3e70007f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.138+0000 7f3e79ffb700 1 -- 172.21.15.38:0/492384957 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f3e70005c30 con 0x7f3e7c0ad5b0 2020-06-12T17:50:11.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.138+0000 7f3e7bfff700 1 --2- 172.21.15.38:0/492384957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e7c0ad5b0 0x7f3e7c0b1e30 secure :-1 s=THROTTLE_DONE pgs=624 cs=0 l=1 rx=0x7f3e70002f30 tx=0x7f3e70007f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.138+0000 7f3e83244700 1 -- 172.21.15.38:0/492384957 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e7c056c30 con 0x7f3e7c0ad5b0 2020-06-12T17:50:11.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.138+0000 7f3e79ffb700 1 --2- 172.21.15.38:0/492384957 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3e5c04d4c0 0x7f3e5c04f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:11.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.138+0000 7f3e79ffb700 1 -- 172.21.15.38:0/492384957 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3e70060dd0 con 0x7f3e7c0ad5b0 2020-06-12T17:50:11.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.139+0000 7f3e80fe0700 1 --2- 172.21.15.38:0/492384957 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3e5c04d4c0 0x7f3e5c04f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:11.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.139+0000 7f3e80fe0700 1 --2- 172.21.15.38:0/492384957 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3e5c04d4c0 0x7f3e5c04f980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3e6c000b80 tx=0x7f3e6c001650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.139+0000 7f3e80fe0700 1 --2- 172.21.15.38:0/492384957 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3e5c04d4c0 0x7f3e5c04f980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3e6c000b80 tx=0x7f3e6c001650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.166 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.139+0000 7f3e80fe0700 1 --2- 172.21.15.38:0/492384957 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3e5c04d4c0 0x7f3e5c04f980 secure :-1 s=READY pgs=246 cs=0 l=1 rx=0x7f3e6c000b80 tx=0x7f3e6c001650).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:11.166 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.142+0000 7f3e7bfff700 1 --2- 172.21.15.38:0/492384957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e7c0ad5b0 0x7f3e7c0b1e30 secure :-1 s=THROTTLE_DONE pgs=624 cs=0 l=1 rx=0x7f3e70002f30 tx=0x7f3e70007f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.166 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.142+0000 7f3e79ffb700 1 -- 172.21.15.38:0/492384957 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f3e7003c550 con 0x7f3e7c0ad5b0 2020-06-12T17:50:11.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.334+0000 7f3e83244700 1 -- 172.21.15.38:0/492384957 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_3903", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e7c063220 con 0x7f3e5c04d4c0 2020-06-12T17:50:11.355 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.352+0000 7f3e80fe0700 1 --2- 172.21.15.38:0/492384957 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3e5c04d4c0 0x7f3e5c04f980 secure :-1 s=THROTTLE_DONE pgs=246 cs=0 l=1 rx=0x7f3e6c000b80 tx=0x7f3e6c001650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.356 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.352+0000 7f3e79ffb700 1 -- 172.21.15.38:0/492384957 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3e7c063220 con 0x7f3e5c04d4c0 2020-06-12T17:50:11.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.353+0000 7f3e83244700 1 -- 172.21.15.38:0/492384957 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3e5c04d4c0 msgr2=0x7f3e5c04f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:11.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.353+0000 7f3e83244700 1 --2- 172.21.15.38:0/492384957 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3e5c04d4c0 0x7f3e5c04f980 secure :-1 s=READY pgs=246 cs=0 l=1 rx=0x7f3e6c000b80 tx=0x7f3e6c001650).stop 2020-06-12T17:50:11.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.353+0000 7f3e83244700 1 -- 172.21.15.38:0/492384957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e7c0ad5b0 msgr2=0x7f3e7c0b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:11.358 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.353+0000 7f3e83244700 1 --2- 172.21.15.38:0/492384957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e7c0ad5b0 0x7f3e7c0b1e30 secure :-1 s=READY pgs=624 cs=0 l=1 rx=0x7f3e70002f30 tx=0x7f3e70007f80).stop 2020-06-12T17:50:11.358 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.354+0000 7f3e83244700 1 -- 172.21.15.38:0/492384957 shutdown_connections 2020-06-12T17:50:11.358 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.354+0000 7f3e83244700 1 --2- 172.21.15.38:0/492384957 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3e5c04d4c0 0x7f3e5c04f980 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:11.358 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.354+0000 7f3e83244700 1 --2- 172.21.15.38:0/492384957 >> v2:172.21.15.150:3300/0 conn(0x7f3e7c09d8d0 0x7f3e7c062690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:11.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.354+0000 7f3e83244700 1 --2- 172.21.15.38:0/492384957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e7c0ad5b0 0x7f3e7c0b1e30 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:11.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.354+0000 7f3e83244700 1 -- 172.21.15.38:0/492384957 >> 172.21.15.38:0/492384957 conn(0x7f3e7c0b5a20 msgr2=0x7f3e7c0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:11.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.354+0000 7f3e83244700 1 -- 172.21.15.38:0/492384957 shutdown_connections 2020-06-12T17:50:11.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.354+0000 7f3e83244700 1 -- 172.21.15.38:0/492384957 wait complete. 2020-06-12T17:50:11.367 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_3903 2020-06-12T17:50:11.484 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.481+0000 7fb224f56700 1 Processor -- start 2020-06-12T17:50:11.485 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.481+0000 7fb224f56700 1 -- start start 2020-06-12T17:50:11.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.482+0000 7fb224f56700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb2200b3ac0 0x7fb22009df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:11.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.482+0000 7fb224f56700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb22013c650 0x7fb220066790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:11.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.482+0000 7fb224f56700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb22009b960 con 0x7fb220142e90 2020-06-12T17:50:11.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.482+0000 7fb224f56700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb22009bc00 con 0x7fb22013c650 2020-06-12T17:50:11.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.482+0000 7fb224f56700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2200b48f0 con 0x7fb2200b3ac0 2020-06-12T17:50:11.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.482+0000 7fb21ed9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb22013c650 0x7fb220066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:11.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.482+0000 7fb21ed9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb22013c650 0x7fb220066790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38506/0 (socket says 172.21.15.38:38506) 2020-06-12T17:50:11.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.482+0000 7fb21ed9d700 1 -- 172.21.15.38:0/2367206413 learned_addr learned my addr 172.21.15.38:0/2367206413 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:11.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.482+0000 7fb21e59c700 1 --2- 172.21.15.38:0/2367206413 >> v2:172.21.15.150:3300/0 conn(0x7fb2200b3ac0 0x7fb22009df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:11.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.482+0000 7fb21ed9d700 1 -- 172.21.15.38:0/2367206413 >> v2:172.21.15.150:3300/0 conn(0x7fb2200b3ac0 msgr2=0x7fb22009df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:11.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.482+0000 7fb21ed9d700 1 --2- 172.21.15.38:0/2367206413 >> v2:172.21.15.150:3300/0 conn(0x7fb2200b3ac0 0x7fb22009df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:11.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.482+0000 7fb21ed9d700 1 -- 172.21.15.38:0/2367206413 >> v1:172.21.15.150:6789/0 conn(0x7fb220142e90 legacy=0x7fb22013bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:11.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.482+0000 7fb21ed9d700 1 -- 172.21.15.38:0/2367206413 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2200b3ea0 con 0x7fb22013c650 2020-06-12T17:50:11.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.482+0000 7fb21e59c700 1 --2- 172.21.15.38:0/2367206413 >> v2:172.21.15.150:3300/0 conn(0x7fb2200b3ac0 0x7fb22009df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:50:11.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.482+0000 7fb21ed9d700 1 --2- 172.21.15.38:0/2367206413 >> v2:172.21.15.38:3300/0 conn(0x7fb22013c650 0x7fb220066790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb220061380 tx=0x7fb2180081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.483+0000 7fb21ed9d700 1 --2- 172.21.15.38:0/2367206413 >> v2:172.21.15.38:3300/0 conn(0x7fb22013c650 0x7fb220066790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb220061380 tx=0x7fb2180081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.483+0000 7fb21ed9d700 1 --2- 172.21.15.38:0/2367206413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb22013c650 0x7fb220066790 secure :-1 s=READY pgs=625 cs=0 l=1 rx=0x7fb220061380 tx=0x7fb2180081e0).ready entity=mon.0 client_cookie=a10b57215adfc4eb server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.483+0000 7fb21ed9d700 1 --2- 172.21.15.38:0/2367206413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb22013c650 0x7fb220066790 secure :-1 s=THROTTLE_DONE pgs=625 cs=0 l=1 rx=0x7fb220061380 tx=0x7fb2180081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.483+0000 7fb21ed9d700 1 --2- 172.21.15.38:0/2367206413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb22013c650 0x7fb220066790 secure :-1 s=THROTTLE_DONE pgs=625 cs=0 l=1 rx=0x7fb220061380 tx=0x7fb2180081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.483+0000 7fb21ed9d700 1 --2- 172.21.15.38:0/2367206413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb22013c650 0x7fb220066790 secure :-1 s=THROTTLE_DONE pgs=625 cs=0 l=1 rx=0x7fb220061380 tx=0x7fb2180081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.483+0000 7fb21d59a700 1 -- 172.21.15.38:0/2367206413 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb21800a160 con 0x7fb22013c650 2020-06-12T17:50:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.483+0000 7fb21d59a700 1 -- 172.21.15.38:0/2367206413 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21800a2c0 con 0x7fb22013c650 2020-06-12T17:50:11.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.483+0000 7fb21d59a700 1 -- 172.21.15.38:0/2367206413 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb21800a6a0 con 0x7fb22013c650 2020-06-12T17:50:11.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.483+0000 7fb224f56700 1 -- 172.21.15.38:0/2367206413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb22013c650 msgr2=0x7fb220066790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:11.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.483+0000 7fb224f56700 1 --2- 172.21.15.38:0/2367206413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb22013c650 0x7fb220066790 secure :-1 s=READY pgs=625 cs=0 l=1 rx=0x7fb220061380 tx=0x7fb2180081e0).stop 2020-06-12T17:50:11.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.483+0000 7fb224f56700 1 -- 172.21.15.38:0/2367206413 shutdown_connections 2020-06-12T17:50:11.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.483+0000 7fb224f56700 1 --2- 172.21.15.38:0/2367206413 >> v2:172.21.15.150:3300/0 conn(0x7fb2200b3ac0 0x7fb22009df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:11.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.483+0000 7fb224f56700 1 --2- 172.21.15.38:0/2367206413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb22013c650 0x7fb220066790 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:11.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.483+0000 7fb224f56700 1 -- 172.21.15.38:0/2367206413 >> 172.21.15.38:0/2367206413 conn(0x7fb2200b5a20 msgr2=0x7fb22005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:11.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.483+0000 7fb224f56700 1 -- 172.21.15.38:0/2367206413 shutdown_connections 2020-06-12T17:50:11.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.483+0000 7fb224f56700 1 -- 172.21.15.38:0/2367206413 wait complete. 2020-06-12T17:50:11.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.484+0000 7fb224f56700 1 Processor -- start 2020-06-12T17:50:11.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.484+0000 7fb224f56700 1 -- start start 2020-06-12T17:50:11.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.485+0000 7fb224f56700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb22013c650 0x7fb22009c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:11.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.485+0000 7fb224f56700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb220142e90 0x7fb22013b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:11.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.485+0000 7fb224f56700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb220097700 con 0x7fb2200b3ac0 2020-06-12T17:50:11.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.485+0000 7fb224f56700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2200979a0 con 0x7fb22013c650 2020-06-12T17:50:11.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.485+0000 7fb224f56700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb220097c40 con 0x7fb220142e90 2020-06-12T17:50:11.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.485+0000 7fb21dd9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb22013c650 0x7fb22009c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:11.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.485+0000 7fb21dd9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb22013c650 0x7fb22009c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38512/0 (socket says 172.21.15.38:38512) 2020-06-12T17:50:11.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.485+0000 7fb21dd9b700 1 -- 172.21.15.38:0/945062009 learned_addr learned my addr 172.21.15.38:0/945062009 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:11.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.485+0000 7fb21ed9d700 1 --2- 172.21.15.38:0/945062009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb220142e90 0x7fb22013b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:11.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.485+0000 7fb21dd9b700 1 -- 172.21.15.38:0/945062009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb220142e90 msgr2=0x7fb22013b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:11.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.485+0000 7fb21dd9b700 1 --2- 172.21.15.38:0/945062009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb220142e90 0x7fb22013b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:11.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.485+0000 7fb21dd9b700 1 -- 172.21.15.38:0/945062009 >> v1:172.21.15.150:6789/0 conn(0x7fb2200b3ac0 legacy=0x7fb2200b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:11.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.485+0000 7fb21dd9b700 1 -- 172.21.15.38:0/945062009 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2200980e0 con 0x7fb22013c650 2020-06-12T17:50:11.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.485+0000 7fb21dd9b700 1 --2- 172.21.15.38:0/945062009 >> v2:172.21.15.38:3300/0 conn(0x7fb22013c650 0x7fb22009c420 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb220099a00 tx=0x7fb210002860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.486+0000 7fb21dd9b700 1 --2- 172.21.15.38:0/945062009 >> v2:172.21.15.38:3300/0 conn(0x7fb22013c650 0x7fb22009c420 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb220099a00 tx=0x7fb210002860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.486+0000 7fb21dd9b700 1 --2- 172.21.15.38:0/945062009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb22013c650 0x7fb22009c420 secure :-1 s=READY pgs=626 cs=0 l=1 rx=0x7fb220099a00 tx=0x7fb210002860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:11.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.486+0000 7fb21dd9b700 1 --2- 172.21.15.38:0/945062009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb22013c650 0x7fb22009c420 secure :-1 s=THROTTLE_DONE pgs=626 cs=0 l=1 rx=0x7fb220099a00 tx=0x7fb210002860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.486+0000 7fb21dd9b700 1 --2- 172.21.15.38:0/945062009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb22013c650 0x7fb22009c420 secure :-1 s=THROTTLE_DONE pgs=626 cs=0 l=1 rx=0x7fb220099a00 tx=0x7fb210002860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.486+0000 7fb20f7fe700 1 -- 172.21.15.38:0/945062009 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb21000cc20 con 0x7fb22013c650 2020-06-12T17:50:11.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.486+0000 7fb21dd9b700 1 --2- 172.21.15.38:0/945062009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb22013c650 0x7fb22009c420 secure :-1 s=THROTTLE_DONE pgs=626 cs=0 l=1 rx=0x7fb220099a00 tx=0x7fb210002860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.502 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.486+0000 7fb20f7fe700 1 -- 172.21.15.38:0/945062009 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21000cd80 con 0x7fb22013c650 2020-06-12T17:50:11.502 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.486+0000 7fb224f56700 1 -- 172.21.15.38:0/945062009 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb220098560 con 0x7fb22013c650 2020-06-12T17:50:11.502 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.486+0000 7fb20f7fe700 1 -- 172.21.15.38:0/945062009 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb21000e350 con 0x7fb22013c650 2020-06-12T17:50:11.502 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.486+0000 7fb224f56700 1 -- 172.21.15.38:0/945062009 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22013ba10 con 0x7fb22013c650 2020-06-12T17:50:11.502 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.486+0000 7fb21dd9b700 1 --2- 172.21.15.38:0/945062009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb22013c650 0x7fb22009c420 secure :-1 s=THROTTLE_DONE pgs=626 cs=0 l=1 rx=0x7fb220099a00 tx=0x7fb210002860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.487+0000 7fb20f7fe700 1 -- 172.21.15.38:0/945062009 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fb21000e5c0 con 0x7fb22013c650 2020-06-12T17:50:11.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.487+0000 7fb21dd9b700 1 --2- 172.21.15.38:0/945062009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb22013c650 0x7fb22009c420 secure :-1 s=THROTTLE_DONE pgs=626 cs=0 l=1 rx=0x7fb220099a00 tx=0x7fb210002860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.487+0000 7fb224f56700 1 -- 172.21.15.38:0/945062009 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb220056c30 con 0x7fb22013c650 2020-06-12T17:50:11.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.487+0000 7fb20f7fe700 1 --2- 172.21.15.38:0/945062009 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb1fc04d5e0 0x7fb1fc04faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:11.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.487+0000 7fb20f7fe700 1 -- 172.21.15.38:0/945062009 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb210060cc0 con 0x7fb22013c650 2020-06-12T17:50:11.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.487+0000 7fb21e59c700 1 --2- 172.21.15.38:0/945062009 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb1fc04d5e0 0x7fb1fc04faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:11.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.487+0000 7fb21e59c700 1 --2- 172.21.15.38:0/945062009 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb1fc04d5e0 0x7fb1fc04faa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb22009da50 tx=0x7fb214001070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.488+0000 7fb21e59c700 1 --2- 172.21.15.38:0/945062009 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb1fc04d5e0 0x7fb1fc04faa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb22009da50 tx=0x7fb214001070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.504 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.488+0000 7fb21e59c700 1 --2- 172.21.15.38:0/945062009 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb1fc04d5e0 0x7fb1fc04faa0 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7fb22009da50 tx=0x7fb214001070).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:11.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.490+0000 7fb21dd9b700 1 --2- 172.21.15.38:0/945062009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb22013c650 0x7fb22009c420 secure :-1 s=THROTTLE_DONE pgs=626 cs=0 l=1 rx=0x7fb220099a00 tx=0x7fb210002860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.505 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.490+0000 7fb20f7fe700 1 -- 172.21.15.38:0/945062009 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fb21003c4a0 con 0x7fb22013c650 2020-06-12T17:50:11.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.684+0000 7fb224f56700 1 -- 172.21.15.38:0/945062009 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_3903", "target": ["mon-mgr", ""]}) v1 -- 0x7fb220097db0 con 0x7fb1fc04d5e0 2020-06-12T17:50:11.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.688+0000 7fb21e59c700 1 --2- 172.21.15.38:0/945062009 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb1fc04d5e0 0x7fb1fc04faa0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7fb22009da50 tx=0x7fb214001070).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:11.692 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.688+0000 7fb20f7fe700 1 -- 172.21.15.38:0/945062009 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7fb220097db0 con 0x7fb1fc04d5e0 2020-06-12T17:50:11.692 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_3903/625f1eea-6fd5-4dda-b3eb-a2cae2b3d675 2020-06-12T17:50:11.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.689+0000 7fb224f56700 1 -- 172.21.15.38:0/945062009 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb1fc04d5e0 msgr2=0x7fb1fc04faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:11.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.689+0000 7fb224f56700 1 --2- 172.21.15.38:0/945062009 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb1fc04d5e0 0x7fb1fc04faa0 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7fb22009da50 tx=0x7fb214001070).stop 2020-06-12T17:50:11.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.689+0000 7fb224f56700 1 -- 172.21.15.38:0/945062009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb22013c650 msgr2=0x7fb22009c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:11.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.689+0000 7fb224f56700 1 --2- 172.21.15.38:0/945062009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb22013c650 0x7fb22009c420 secure :-1 s=READY pgs=626 cs=0 l=1 rx=0x7fb220099a00 tx=0x7fb210002860).stop 2020-06-12T17:50:11.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.689+0000 7fb224f56700 1 -- 172.21.15.38:0/945062009 shutdown_connections 2020-06-12T17:50:11.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.689+0000 7fb224f56700 1 --2- 172.21.15.38:0/945062009 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb1fc04d5e0 0x7fb1fc04faa0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:11.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.689+0000 7fb224f56700 1 --2- 172.21.15.38:0/945062009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb220142e90 0x7fb22013b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:11.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.689+0000 7fb224f56700 1 --2- 172.21.15.38:0/945062009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb22013c650 0x7fb22009c420 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:11.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.689+0000 7fb224f56700 1 -- 172.21.15.38:0/945062009 >> 172.21.15.38:0/945062009 conn(0x7fb2200b5a20 msgr2=0x7fb2200b78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:11.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.689+0000 7fb224f56700 1 -- 172.21.15.38:0/945062009 shutdown_connections 2020-06-12T17:50:11.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:11.689+0000 7fb224f56700 1 -- 172.21.15.38:0/945062009 wait complete. 2020-06-12T17:50:11.703 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_3903 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_3903/625f1eea-6fd5-4dda-b3eb-a2cae2b3d675 2020-06-12T17:50:11.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:11.704 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:11.705 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:11.720 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:11.721 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:11.721 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3903/625f1eea-6fd5-4dda-b3eb-a2cae2b3d675/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:11.810 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:11.811 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:11.811 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107159 s, 97.9 MB/s 2020-06-12T17:50:11.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:11.812 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:11.813 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:11.828 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:11.829 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:11.829 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3903/625f1eea-6fd5-4dda-b3eb-a2cae2b3d675/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:11.917 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:11.918 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:11.918 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114696 s, 91.4 MB/s 2020-06-12T17:50:11.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:11.920 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:11.921 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:11.936 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:11.937 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:11.937 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3903/625f1eea-6fd5-4dda-b3eb-a2cae2b3d675/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:12.027 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:12.027 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:12.028 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125624 s, 83.5 MB/s 2020-06-12T17:50:12.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:12.029 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:12.029 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:12.048 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:12.048 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:12.049 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3903/625f1eea-6fd5-4dda-b3eb-a2cae2b3d675/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:12.136 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:12.136 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:12.136 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111194 s, 94.3 MB/s 2020-06-12T17:50:12.137 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:12.138 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:12.138 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:12.154 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:12.154 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:12.154 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3903/625f1eea-6fd5-4dda-b3eb-a2cae2b3d675/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:12.241 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:12.241 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:12.241 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101996 s, 103 MB/s 2020-06-12T17:50:12.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:12.243 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:12.243 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:12.258 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:12.259 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:12.260 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3903/625f1eea-6fd5-4dda-b3eb-a2cae2b3d675/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:12.347 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:12.347 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:12.348 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123815 s, 84.7 MB/s 2020-06-12T17:50:12.349 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:12.349 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:12.350 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:12.364 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:12.365 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:12.366 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3903/625f1eea-6fd5-4dda-b3eb-a2cae2b3d675/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:12.454 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:12.454 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:12.454 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115914 s, 90.5 MB/s 2020-06-12T17:50:12.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:12.461 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:12.461 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:12.481 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:12.481 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:12.482 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3903/625f1eea-6fd5-4dda-b3eb-a2cae2b3d675/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:12.567 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:12.567 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:12.568 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103267 s, 102 MB/s 2020-06-12T17:50:12.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:12.569 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:12.570 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:12.586 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:12.586 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:12.587 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3903/625f1eea-6fd5-4dda-b3eb-a2cae2b3d675/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:12.673 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:12.673 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:12.673 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099932 s, 105 MB/s 2020-06-12T17:50:12.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:12.675 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:12.675 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:12.690 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:12.691 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:12.692 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3903/625f1eea-6fd5-4dda-b3eb-a2cae2b3d675/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:12.782 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:12.783 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:12.783 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128353 s, 81.7 MB/s 2020-06-12T17:50:12.784 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_6359 2020-06-12T17:50:12.900 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.897+0000 7f96d070d700 1 Processor -- start 2020-06-12T17:50:12.901 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.897+0000 7f96d070d700 1 -- start start 2020-06-12T17:50:12.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.898+0000 7f96d070d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f96c80b5c70 0x7f96c80b5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:12.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.898+0000 7f96d070d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f96c805c4f0 0x7f96c80b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:12.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.898+0000 7f96d070d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96c80b3cc0 0x7f96c80b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:12.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.898+0000 7f96d070d700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c814a7b0 con 0x7f96c80b5c70 2020-06-12T17:50:12.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.898+0000 7f96d070d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c814a510 con 0x7f96c805c4f0 2020-06-12T17:50:12.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.898+0000 7f96d070d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c8146410 con 0x7f96c80b3cc0 2020-06-12T17:50:12.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.898+0000 7f96ce4a9700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f96c80b5c70 0x7f96c80b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:12.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.898+0000 7f96ce4a9700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f96c80b5c70 0x7f96c80b5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38518/0 (socket says 172.21.15.38:38518) 2020-06-12T17:50:12.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.898+0000 7f96ce4a9700 1 -- 172.21.15.38:0/251148132 learned_addr learned my addr 172.21.15.38:0/251148132 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:12.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.898+0000 7f96cdca8700 1 --2- 172.21.15.38:0/251148132 >> v2:172.21.15.150:3300/0 conn(0x7f96c805c4f0 0x7f96c80b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:12.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.899+0000 7f96cecaa700 1 --2- 172.21.15.38:0/251148132 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96c80b3cc0 0x7f96c80b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:12.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.899+0000 7f96ce4a9700 1 -- 172.21.15.38:0/251148132 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96c80b3cc0 msgr2=0x7f96c80b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:12.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.899+0000 7f96ce4a9700 1 --2- 172.21.15.38:0/251148132 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96c80b3cc0 0x7f96c80b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:12.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.899+0000 7f96ce4a9700 1 -- 172.21.15.38:0/251148132 >> v2:172.21.15.150:3300/0 conn(0x7f96c805c4f0 msgr2=0x7f96c80b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:12.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.899+0000 7f96ce4a9700 1 --2- 172.21.15.38:0/251148132 >> v2:172.21.15.150:3300/0 conn(0x7f96c805c4f0 0x7f96c80b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:12.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.899+0000 7f96ce4a9700 1 -- 172.21.15.38:0/251148132 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c80b6050 con 0x7f96c80b5c70 2020-06-12T17:50:12.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.899+0000 7f96cdca8700 1 --2- 172.21.15.38:0/251148132 >> v2:172.21.15.150:3300/0 conn(0x7f96c805c4f0 0x7f96c80b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:50:12.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.899+0000 7f96cecaa700 1 --2- 172.21.15.38:0/251148132 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96c80b3cc0 0x7f96c80b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:50:12.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.899+0000 7f96ce4a9700 1 --2- 172.21.15.38:0/251148132 >> v2:172.21.15.38:3300/0 conn(0x7f96c80b5c70 0x7f96c80b5120 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f96b8002f30 tx=0x7f96b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:12.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.899+0000 7f96ce4a9700 1 --2- 172.21.15.38:0/251148132 >> v2:172.21.15.38:3300/0 conn(0x7f96c80b5c70 0x7f96c80b5120 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f96b8002f30 tx=0x7f96b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:12.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.899+0000 7f96ce4a9700 1 --2- 172.21.15.38:0/251148132 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c80b5c70 0x7f96c80b5120 secure :-1 s=READY pgs=627 cs=0 l=1 rx=0x7f96b8002f30 tx=0x7f96b8007e60).ready entity=mon.0 client_cookie=b5c25b4dfeea162d server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:12.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.899+0000 7f96ce4a9700 1 --2- 172.21.15.38:0/251148132 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c80b5c70 0x7f96c80b5120 secure :-1 s=THROTTLE_DONE pgs=627 cs=0 l=1 rx=0x7f96b8002f30 tx=0x7f96b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:12.909 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.899+0000 7f96cd4a7700 1 -- 172.21.15.38:0/251148132 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96b80116e0 con 0x7f96c80b5c70 2020-06-12T17:50:12.909 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.899+0000 7f96ce4a9700 1 --2- 172.21.15.38:0/251148132 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c80b5c70 0x7f96c80b5120 secure :-1 s=THROTTLE_DONE pgs=627 cs=0 l=1 rx=0x7f96b8002f30 tx=0x7f96b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:12.909 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.899+0000 7f96ce4a9700 1 --2- 172.21.15.38:0/251148132 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c80b5c70 0x7f96c80b5120 secure :-1 s=THROTTLE_DONE pgs=627 cs=0 l=1 rx=0x7f96b8002f30 tx=0x7f96b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:12.909 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.899+0000 7f96cd4a7700 1 -- 172.21.15.38:0/251148132 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b8011840 con 0x7f96c80b5c70 2020-06-12T17:50:12.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.899+0000 7f96cd4a7700 1 -- 172.21.15.38:0/251148132 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96b8011be0 con 0x7f96c80b5c70 2020-06-12T17:50:12.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.899+0000 7f96d070d700 1 -- 172.21.15.38:0/251148132 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c80b5c70 msgr2=0x7f96c80b5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:12.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.899+0000 7f96d070d700 1 --2- 172.21.15.38:0/251148132 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c80b5c70 0x7f96c80b5120 secure :-1 s=READY pgs=627 cs=0 l=1 rx=0x7f96b8002f30 tx=0x7f96b8007e60).stop 2020-06-12T17:50:12.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.899+0000 7f96d070d700 1 -- 172.21.15.38:0/251148132 shutdown_connections 2020-06-12T17:50:12.910 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.899+0000 7f96d070d700 1 --2- 172.21.15.38:0/251148132 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c80b5c70 0x7f96c80b5120 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:12.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.899+0000 7f96d070d700 1 --2- 172.21.15.38:0/251148132 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96c80b3cc0 0x7f96c80b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:12.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.899+0000 7f96d070d700 1 --2- 172.21.15.38:0/251148132 >> v2:172.21.15.150:3300/0 conn(0x7f96c805c4f0 0x7f96c80b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:12.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.899+0000 7f96d070d700 1 -- 172.21.15.38:0/251148132 >> 172.21.15.38:0/251148132 conn(0x7f96c80b8ec0 msgr2=0x7f96c80b92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:12.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.900+0000 7f96d070d700 1 -- 172.21.15.38:0/251148132 shutdown_connections 2020-06-12T17:50:12.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.900+0000 7f96d070d700 1 -- 172.21.15.38:0/251148132 wait complete. 2020-06-12T17:50:12.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.900+0000 7f96d070d700 1 Processor -- start 2020-06-12T17:50:12.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.900+0000 7f96d070d700 1 -- start start 2020-06-12T17:50:12.914 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.901+0000 7f96d070d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f96c805c4f0 0x7f96c8147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:12.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.901+0000 7f96d070d700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c81568e0 con 0x7f96c80b5c70 2020-06-12T17:50:12.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.901+0000 7f96d070d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c8147ed0 con 0x7f96c80b3cc0 2020-06-12T17:50:12.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.901+0000 7f96d070d700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c8148170 con 0x7f96c805c4f0 2020-06-12T17:50:12.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.901+0000 7f96ce4a9700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f96c805c4f0 0x7f96c8147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:12.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.901+0000 7f96ce4a9700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f96c805c4f0 0x7f96c8147950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38524/0 (socket says 172.21.15.38:38524) 2020-06-12T17:50:12.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.901+0000 7f96cecaa700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f96c80b5c70 0x7f96c813faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40342/0 (socket says 172.21.15.38:40342) 2020-06-12T17:50:12.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.901+0000 7f96ce4a9700 1 -- 172.21.15.38:0/1379731429 learned_addr learned my addr 172.21.15.38:0/1379731429 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:12.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.902+0000 7f96ce4a9700 1 -- 172.21.15.38:0/1379731429 >> v1:172.21.15.150:6789/0 conn(0x7f96c80b3cc0 legacy=0x7f96c80657e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:12.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.902+0000 7f96ce4a9700 1 -- 172.21.15.38:0/1379731429 >> v1:172.21.15.38:6789/0 conn(0x7f96c80b5c70 legacy=0x7f96c813faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:12.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.902+0000 7f96ce4a9700 1 -- 172.21.15.38:0/1379731429 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c8154700 con 0x7f96c805c4f0 2020-06-12T17:50:12.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.902+0000 7f96b77fe700 1 -- 172.21.15.38:0/1379731429 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 883788469 0 0) 0x7f96c81568e0 con 0x7f96c80b5c70 2020-06-12T17:50:12.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.902+0000 7f96ce4a9700 1 --2- 172.21.15.38:0/1379731429 >> v2:172.21.15.38:3300/0 conn(0x7f96c805c4f0 0x7f96c8147950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f96b8002f30 tx=0x7f96b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:12.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.902+0000 7f96ce4a9700 1 --2- 172.21.15.38:0/1379731429 >> v2:172.21.15.38:3300/0 conn(0x7f96c805c4f0 0x7f96c8147950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f96b8002f30 tx=0x7f96b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:12.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.902+0000 7f96ce4a9700 1 --2- 172.21.15.38:0/1379731429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c805c4f0 0x7f96c8147950 secure :-1 s=READY pgs=629 cs=0 l=1 rx=0x7f96b8002f30 tx=0x7f96b8007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:12.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.902+0000 7f96ce4a9700 1 --2- 172.21.15.38:0/1379731429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c805c4f0 0x7f96c8147950 secure :-1 s=THROTTLE_DONE pgs=629 cs=0 l=1 rx=0x7f96b8002f30 tx=0x7f96b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:12.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.902+0000 7f96b77fe700 1 -- 172.21.15.38:0/1379731429 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96b8007150 con 0x7f96c805c4f0 2020-06-12T17:50:12.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.902+0000 7f96ce4a9700 1 --2- 172.21.15.38:0/1379731429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c805c4f0 0x7f96c8147950 secure :-1 s=THROTTLE_DONE pgs=629 cs=0 l=1 rx=0x7f96b8002f30 tx=0x7f96b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:12.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.902+0000 7f96b77fe700 1 -- 172.21.15.38:0/1379731429 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b80072b0 con 0x7f96c805c4f0 2020-06-12T17:50:12.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.902+0000 7f96ce4a9700 1 --2- 172.21.15.38:0/1379731429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c805c4f0 0x7f96c8147950 secure :-1 s=THROTTLE_DONE pgs=629 cs=0 l=1 rx=0x7f96b8002f30 tx=0x7f96b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:12.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.902+0000 7f96d070d700 1 -- 172.21.15.38:0/1379731429 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c8065ef0 con 0x7f96c805c4f0 2020-06-12T17:50:12.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.902+0000 7f96b77fe700 1 -- 172.21.15.38:0/1379731429 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96b80056c0 con 0x7f96c805c4f0 2020-06-12T17:50:12.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.902+0000 7f96d070d700 1 -- 172.21.15.38:0/1379731429 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c8155d70 con 0x7f96c805c4f0 2020-06-12T17:50:12.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.902+0000 7f96ce4a9700 1 --2- 172.21.15.38:0/1379731429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c805c4f0 0x7f96c8147950 secure :-1 s=THROTTLE_DONE pgs=629 cs=0 l=1 rx=0x7f96b8002f30 tx=0x7f96b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:12.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.903+0000 7f96b77fe700 1 -- 172.21.15.38:0/1379731429 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f96b80058c0 con 0x7f96c805c4f0 2020-06-12T17:50:12.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.903+0000 7f96ce4a9700 1 --2- 172.21.15.38:0/1379731429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c805c4f0 0x7f96c8147950 secure :-1 s=THROTTLE_DONE pgs=629 cs=0 l=1 rx=0x7f96b8002f30 tx=0x7f96b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:12.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.903+0000 7f96d070d700 1 -- 172.21.15.38:0/1379731429 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c8056c30 con 0x7f96c805c4f0 2020-06-12T17:50:12.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.903+0000 7f96b77fe700 1 --2- 172.21.15.38:0/1379731429 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f96a804d350 0x7f96a804f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:12.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.903+0000 7f96b77fe700 1 -- 172.21.15.38:0/1379731429 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f96b8061710 con 0x7f96c805c4f0 2020-06-12T17:50:12.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.903+0000 7f96cdca8700 1 --2- 172.21.15.38:0/1379731429 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f96a804d350 0x7f96a804f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:12.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.904+0000 7f96cdca8700 1 --2- 172.21.15.38:0/1379731429 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f96a804d350 0x7f96a804f810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f96c81412a0 tx=0x7f96c40013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:12.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.904+0000 7f96cdca8700 1 --2- 172.21.15.38:0/1379731429 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f96a804d350 0x7f96a804f810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f96c81412a0 tx=0x7f96c40013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:12.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.904+0000 7f96cdca8700 1 --2- 172.21.15.38:0/1379731429 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f96a804d350 0x7f96a804f810 secure :-1 s=READY pgs=248 cs=0 l=1 rx=0x7f96c81412a0 tx=0x7f96c40013e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:12.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.907+0000 7f96ce4a9700 1 --2- 172.21.15.38:0/1379731429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c805c4f0 0x7f96c8147950 secure :-1 s=THROTTLE_DONE pgs=629 cs=0 l=1 rx=0x7f96b8002f30 tx=0x7f96b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:12.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:12.907+0000 7f96b77fe700 1 -- 172.21.15.38:0/1379731429 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f96b803cf30 con 0x7f96c805c4f0 2020-06-12T17:50:13.101 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.098+0000 7f96d070d700 1 -- 172.21.15.38:0/1379731429 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_6359", "target": ["mon-mgr", ""]}) v1 -- 0x7f96c805cdb0 con 0x7f96a804d350 2020-06-12T17:50:13.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.121+0000 7f96cdca8700 1 --2- 172.21.15.38:0/1379731429 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f96a804d350 0x7f96a804f810 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7f96c81412a0 tx=0x7f96c40013e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:13.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.121+0000 7f96b77fe700 1 -- 172.21.15.38:0/1379731429 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f96c805cdb0 con 0x7f96a804d350 2020-06-12T17:50:13.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.123+0000 7f96d070d700 1 -- 172.21.15.38:0/1379731429 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f96a804d350 msgr2=0x7f96a804f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:13.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.123+0000 7f96d070d700 1 --2- 172.21.15.38:0/1379731429 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f96a804d350 0x7f96a804f810 secure :-1 s=READY pgs=248 cs=0 l=1 rx=0x7f96c81412a0 tx=0x7f96c40013e0).stop 2020-06-12T17:50:13.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.123+0000 7f96d070d700 1 -- 172.21.15.38:0/1379731429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c805c4f0 msgr2=0x7f96c8147950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:13.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.123+0000 7f96d070d700 1 --2- 172.21.15.38:0/1379731429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c805c4f0 0x7f96c8147950 secure :-1 s=READY pgs=629 cs=0 l=1 rx=0x7f96b8002f30 tx=0x7f96b8007e60).stop 2020-06-12T17:50:13.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.123+0000 7f96d070d700 1 -- 172.21.15.38:0/1379731429 shutdown_connections 2020-06-12T17:50:13.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.123+0000 7f96d070d700 1 --2- 172.21.15.38:0/1379731429 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f96a804d350 0x7f96a804f810 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:13.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.123+0000 7f96d070d700 1 --2- 172.21.15.38:0/1379731429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c805c4f0 0x7f96c8147950 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:13.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.123+0000 7f96d070d700 1 -- 172.21.15.38:0/1379731429 >> 172.21.15.38:0/1379731429 conn(0x7f96c80b8ec0 msgr2=0x7f96c809e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:13.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.123+0000 7f96d070d700 1 -- 172.21.15.38:0/1379731429 shutdown_connections 2020-06-12T17:50:13.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.123+0000 7f96d070d700 1 -- 172.21.15.38:0/1379731429 wait complete. 2020-06-12T17:50:13.137 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_6359 2020-06-12T17:50:13.264 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.250+0000 7f7acd70f700 1 Processor -- start 2020-06-12T17:50:13.264 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.250+0000 7f7acd70f700 1 -- start start 2020-06-12T17:50:13.265 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.251+0000 7f7acd70f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ac809df00 0x7f7ac813c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:13.265 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.251+0000 7f7acd70f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7ac8142e90 0x7f7ac8066790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:13.265 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.251+0000 7f7acd70f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac809b960 con 0x7f7ac80b3ac0 2020-06-12T17:50:13.265 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.251+0000 7f7acd70f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac809bc00 con 0x7f7ac8142e90 2020-06-12T17:50:13.268 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.251+0000 7f7acd70f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac80b48f0 con 0x7f7ac809df00 2020-06-12T17:50:13.269 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.251+0000 7f7ac77fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7ac8142e90 0x7f7ac8066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:13.269 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.251+0000 7f7ac67fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ac809df00 0x7f7ac813c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:13.269 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.251+0000 7f7ac6ffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f7ac80b3ac0 0x7f7ac813bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:32848/0 (socket says 172.21.15.38:32848) 2020-06-12T17:50:13.269 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.251+0000 7f7ac6ffd700 1 -- 172.21.15.38:0/1873535942 learned_addr learned my addr 172.21.15.38:0/1873535942 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:13.269 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.252+0000 7f7ac77fe700 1 -- 172.21.15.38:0/1873535942 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ac809df00 msgr2=0x7f7ac813c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:13.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.252+0000 7f7ac77fe700 1 --2- 172.21.15.38:0/1873535942 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ac809df00 0x7f7ac813c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:13.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.252+0000 7f7ac77fe700 1 -- 172.21.15.38:0/1873535942 >> v1:172.21.15.150:6789/0 conn(0x7f7ac80b3ac0 legacy=0x7f7ac813bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:13.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.252+0000 7f7ac5ffb700 1 -- 172.21.15.38:0/1873535942 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 622696186 0 0) 0x7f7ac809b960 con 0x7f7ac80b3ac0 2020-06-12T17:50:13.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.252+0000 7f7ac77fe700 1 -- 172.21.15.38:0/1873535942 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac80b3ea0 con 0x7f7ac8142e90 2020-06-12T17:50:13.270 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.252+0000 7f7ac67fc700 1 --2- 172.21.15.38:0/1873535942 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ac809df00 0x7f7ac813c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:50:13.271 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.252+0000 7f7ac77fe700 1 --2- 172.21.15.38:0/1873535942 >> v2:172.21.15.150:3300/0 conn(0x7f7ac8142e90 0x7f7ac8066790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7ac00032b0 tx=0x7f7ac00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:13.271 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.252+0000 7f7ac77fe700 1 --2- 172.21.15.38:0/1873535942 >> v2:172.21.15.150:3300/0 conn(0x7f7ac8142e90 0x7f7ac8066790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7ac00032b0 tx=0x7f7ac00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:13.275 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.252+0000 7f7ac77fe700 1 --2- 172.21.15.38:0/1873535942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ac8142e90 0x7f7ac8066790 secure :-1 s=READY pgs=369 cs=0 l=1 rx=0x7f7ac00032b0 tx=0x7f7ac00081e0).ready entity=mon.1 client_cookie=5f166ef87746a577 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:13.275 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.252+0000 7f7ac77fe700 1 --2- 172.21.15.38:0/1873535942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ac8142e90 0x7f7ac8066790 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7f7ac00032b0 tx=0x7f7ac00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:13.276 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.252+0000 7f7ac5ffb700 1 -- 172.21.15.38:0/1873535942 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ac0011de0 con 0x7f7ac8142e90 2020-06-12T17:50:13.276 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.252+0000 7f7ac77fe700 1 --2- 172.21.15.38:0/1873535942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ac8142e90 0x7f7ac8066790 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7f7ac00032b0 tx=0x7f7ac00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:13.276 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.252+0000 7f7ac5ffb700 1 -- 172.21.15.38:0/1873535942 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac000a160 con 0x7f7ac8142e90 2020-06-12T17:50:13.276 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.252+0000 7f7ac77fe700 1 --2- 172.21.15.38:0/1873535942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ac8142e90 0x7f7ac8066790 secure :-1 s=THROTTLE_DONE pgs=369 cs=0 l=1 rx=0x7f7ac00032b0 tx=0x7f7ac00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:13.276 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.252+0000 7f7acd70f700 1 -- 172.21.15.38:0/1873535942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ac8142e90 msgr2=0x7f7ac8066790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:13.277 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.252+0000 7f7ac5ffb700 1 -- 172.21.15.38:0/1873535942 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ac000a540 con 0x7f7ac8142e90 2020-06-12T17:50:13.277 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.252+0000 7f7acd70f700 1 --2- 172.21.15.38:0/1873535942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ac8142e90 0x7f7ac8066790 secure :-1 s=READY pgs=369 cs=0 l=1 rx=0x7f7ac00032b0 tx=0x7f7ac00081e0).stop 2020-06-12T17:50:13.277 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.253+0000 7f7acd70f700 1 -- 172.21.15.38:0/1873535942 shutdown_connections 2020-06-12T17:50:13.278 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.253+0000 7f7acd70f700 1 --2- 172.21.15.38:0/1873535942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ac8142e90 0x7f7ac8066790 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:13.278 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.253+0000 7f7acd70f700 1 --2- 172.21.15.38:0/1873535942 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ac809df00 0x7f7ac813c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:13.278 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.253+0000 7f7acd70f700 1 -- 172.21.15.38:0/1873535942 >> 172.21.15.38:0/1873535942 conn(0x7f7ac80b5a20 msgr2=0x7f7ac805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:13.278 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.253+0000 7f7acd70f700 1 -- 172.21.15.38:0/1873535942 shutdown_connections 2020-06-12T17:50:13.278 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.253+0000 7f7acd70f700 1 -- 172.21.15.38:0/1873535942 wait complete. 2020-06-12T17:50:13.278 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.254+0000 7f7acd70f700 1 Processor -- start 2020-06-12T17:50:13.279 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.254+0000 7f7acd70f700 1 -- start start 2020-06-12T17:50:13.279 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.254+0000 7f7acd70f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7ac80b3ac0 0x7f7ac813c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:13.279 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.254+0000 7f7acd70f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7ac8142e90 0x7f7ac80b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:13.279 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.254+0000 7f7acd70f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac8154e10 con 0x7f7ac809df00 2020-06-12T17:50:13.280 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.254+0000 7f7acd70f700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac8154c30 con 0x7f7ac8142e90 2020-06-12T17:50:13.280 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.254+0000 7f7acd70f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac80af640 con 0x7f7ac80b3ac0 2020-06-12T17:50:13.280 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.255+0000 7f7ac77fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7ac8142e90 0x7f7ac80b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:13.280 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.255+0000 7f7ac67fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7ac80b3ac0 0x7f7ac813c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:13.280 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.255+0000 7f7ac77fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7ac8142e90 0x7f7ac80b0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38542/0 (socket says 172.21.15.38:38542) 2020-06-12T17:50:13.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.255+0000 7f7ac77fe700 1 -- 172.21.15.38:0/3265056847 learned_addr learned my addr 172.21.15.38:0/3265056847 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:13.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.255+0000 7f7ac77fe700 1 -- 172.21.15.38:0/3265056847 >> v2:172.21.15.150:3300/0 conn(0x7f7ac80b3ac0 msgr2=0x7f7ac813c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:13.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.255+0000 7f7ac77fe700 1 --2- 172.21.15.38:0/3265056847 >> v2:172.21.15.150:3300/0 conn(0x7f7ac80b3ac0 0x7f7ac813c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:13.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.255+0000 7f7ac77fe700 1 -- 172.21.15.38:0/3265056847 >> v1:172.21.15.150:6789/0 conn(0x7f7ac809df00 legacy=0x7f7ac813bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:13.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.255+0000 7f7ac77fe700 1 -- 172.21.15.38:0/3265056847 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac81550b0 con 0x7f7ac8142e90 2020-06-12T17:50:13.282 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.255+0000 7f7ac77fe700 1 --2- 172.21.15.38:0/3265056847 >> v2:172.21.15.38:3300/0 conn(0x7f7ac8142e90 0x7f7ac80b0a00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7ac00032b0 tx=0x7f7ac00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:13.282 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.255+0000 7f7ac77fe700 1 --2- 172.21.15.38:0/3265056847 >> v2:172.21.15.38:3300/0 conn(0x7f7ac8142e90 0x7f7ac80b0a00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7ac00032b0 tx=0x7f7ac00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:13.282 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.255+0000 7f7ac77fe700 1 --2- 172.21.15.38:0/3265056847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ac8142e90 0x7f7ac80b0a00 secure :-1 s=READY pgs=630 cs=0 l=1 rx=0x7f7ac00032b0 tx=0x7f7ac00081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:13.282 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.255+0000 7f7ac77fe700 1 --2- 172.21.15.38:0/3265056847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ac8142e90 0x7f7ac80b0a00 secure :-1 s=THROTTLE_DONE pgs=630 cs=0 l=1 rx=0x7f7ac00032b0 tx=0x7f7ac00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:13.282 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.255+0000 7f7ab7fff700 1 -- 172.21.15.38:0/3265056847 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ac0005c30 con 0x7f7ac8142e90 2020-06-12T17:50:13.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.255+0000 7f7ac77fe700 1 --2- 172.21.15.38:0/3265056847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ac8142e90 0x7f7ac80b0a00 secure :-1 s=THROTTLE_DONE pgs=630 cs=0 l=1 rx=0x7f7ac00032b0 tx=0x7f7ac00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:13.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.255+0000 7f7ac77fe700 1 --2- 172.21.15.38:0/3265056847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ac8142e90 0x7f7ac80b0a00 secure :-1 s=THROTTLE_DONE pgs=630 cs=0 l=1 rx=0x7f7ac00032b0 tx=0x7f7ac00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:13.285 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.255+0000 7f7ab7fff700 1 -- 172.21.15.38:0/3265056847 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac0005d90 con 0x7f7ac8142e90 2020-06-12T17:50:13.286 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.255+0000 7f7ab7fff700 1 -- 172.21.15.38:0/3265056847 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ac0007340 con 0x7f7ac8142e90 2020-06-12T17:50:13.286 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.255+0000 7f7acd70f700 1 -- 172.21.15.38:0/3265056847 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac8151f70 con 0x7f7ac8142e90 2020-06-12T17:50:13.286 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.255+0000 7f7acd70f700 1 -- 172.21.15.38:0/3265056847 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac8154920 con 0x7f7ac8142e90 2020-06-12T17:50:13.286 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.256+0000 7f7ac77fe700 1 --2- 172.21.15.38:0/3265056847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ac8142e90 0x7f7ac80b0a00 secure :-1 s=THROTTLE_DONE pgs=630 cs=0 l=1 rx=0x7f7ac00032b0 tx=0x7f7ac00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:13.286 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.256+0000 7f7acd70f700 1 -- 172.21.15.38:0/3265056847 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac8056c30 con 0x7f7ac8142e90 2020-06-12T17:50:13.287 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.256+0000 7f7ab7fff700 1 -- 172.21.15.38:0/3265056847 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f7ac0008420 con 0x7f7ac8142e90 2020-06-12T17:50:13.287 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.256+0000 7f7ac77fe700 1 --2- 172.21.15.38:0/3265056847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ac8142e90 0x7f7ac80b0a00 secure :-1 s=THROTTLE_DONE pgs=630 cs=0 l=1 rx=0x7f7ac00032b0 tx=0x7f7ac00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:13.287 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.257+0000 7f7ab7fff700 1 --2- 172.21.15.38:0/3265056847 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7aa404d490 0x7f7aa404f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:13.287 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.257+0000 7f7ab7fff700 1 -- 172.21.15.38:0/3265056847 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7ac0061a70 con 0x7f7ac8142e90 2020-06-12T17:50:13.287 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.257+0000 7f7ac6ffd700 1 --2- 172.21.15.38:0/3265056847 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7aa404d490 0x7f7aa404f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:13.288 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.257+0000 7f7ac6ffd700 1 --2- 172.21.15.38:0/3265056847 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7aa404d490 0x7f7aa404f950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7ac80b2130 tx=0x7f7abc001310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:13.288 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.257+0000 7f7ac6ffd700 1 --2- 172.21.15.38:0/3265056847 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7aa404d490 0x7f7aa404f950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7ac80b2130 tx=0x7f7abc001310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:13.288 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.257+0000 7f7ac6ffd700 1 --2- 172.21.15.38:0/3265056847 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7aa404d490 0x7f7aa404f950 secure :-1 s=READY pgs=249 cs=0 l=1 rx=0x7f7ac80b2130 tx=0x7f7abc001310).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:13.288 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.260+0000 7f7ac77fe700 1 --2- 172.21.15.38:0/3265056847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ac8142e90 0x7f7ac80b0a00 secure :-1 s=THROTTLE_DONE pgs=630 cs=0 l=1 rx=0x7f7ac00032b0 tx=0x7f7ac00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:13.288 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.260+0000 7f7ab7fff700 1 -- 172.21.15.38:0/3265056847 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f7ac003d290 con 0x7f7ac8142e90 2020-06-12T17:50:13.462 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.458+0000 7f7acd70f700 1 -- 172.21.15.38:0/3265056847 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_6359", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ac81552b0 con 0x7f7aa404d490 2020-06-12T17:50:13.465 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.462+0000 7f7ac6ffd700 1 --2- 172.21.15.38:0/3265056847 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7aa404d490 0x7f7aa404f950 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7f7ac80b2130 tx=0x7f7abc001310).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:13.465 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.462+0000 7f7ab7fff700 1 -- 172.21.15.38:0/3265056847 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f7abc00cda0 con 0x7f7aa404d490 2020-06-12T17:50:13.466 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_6359/2a1a7b3c-d14e-42f2-8a27-76ff1485dfbf 2020-06-12T17:50:13.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.463+0000 7f7acd70f700 1 -- 172.21.15.38:0/3265056847 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7aa404d490 msgr2=0x7f7aa404f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:13.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.463+0000 7f7acd70f700 1 --2- 172.21.15.38:0/3265056847 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7aa404d490 0x7f7aa404f950 secure :-1 s=READY pgs=249 cs=0 l=1 rx=0x7f7ac80b2130 tx=0x7f7abc001310).stop 2020-06-12T17:50:13.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.463+0000 7f7acd70f700 1 -- 172.21.15.38:0/3265056847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ac8142e90 msgr2=0x7f7ac80b0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:13.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.463+0000 7f7acd70f700 1 --2- 172.21.15.38:0/3265056847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ac8142e90 0x7f7ac80b0a00 secure :-1 s=READY pgs=630 cs=0 l=1 rx=0x7f7ac00032b0 tx=0x7f7ac00081e0).stop 2020-06-12T17:50:13.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.464+0000 7f7acd70f700 1 -- 172.21.15.38:0/3265056847 shutdown_connections 2020-06-12T17:50:13.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.464+0000 7f7acd70f700 1 --2- 172.21.15.38:0/3265056847 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7aa404d490 0x7f7aa404f950 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:13.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.464+0000 7f7acd70f700 1 --2- 172.21.15.38:0/3265056847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ac8142e90 0x7f7ac80b0a00 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:13.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.464+0000 7f7acd70f700 1 --2- 172.21.15.38:0/3265056847 >> v2:172.21.15.150:3300/0 conn(0x7f7ac80b3ac0 0x7f7ac813c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:13.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.464+0000 7f7acd70f700 1 -- 172.21.15.38:0/3265056847 >> 172.21.15.38:0/3265056847 conn(0x7f7ac80b5a20 msgr2=0x7f7ac8140610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:13.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.464+0000 7f7acd70f700 1 -- 172.21.15.38:0/3265056847 shutdown_connections 2020-06-12T17:50:13.470 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:13.464+0000 7f7acd70f700 1 -- 172.21.15.38:0/3265056847 wait complete. 2020-06-12T17:50:13.477 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_6359 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_6359/2a1a7b3c-d14e-42f2-8a27-76ff1485dfbf 2020-06-12T17:50:13.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:13.478 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:13.479 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:13.493 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:13.494 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:13.495 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6359/2a1a7b3c-d14e-42f2-8a27-76ff1485dfbf/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:13.585 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:13.586 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:13.587 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116606 s, 89.9 MB/s 2020-06-12T17:50:13.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:13.588 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:13.589 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:13.603 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:13.604 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:13.604 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6359/2a1a7b3c-d14e-42f2-8a27-76ff1485dfbf/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:13.691 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:13.691 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:13.692 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101119 s, 104 MB/s 2020-06-12T17:50:13.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:13.693 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:13.694 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:13.709 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:13.709 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:13.710 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6359/2a1a7b3c-d14e-42f2-8a27-76ff1485dfbf/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:13.797 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:13.798 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:13.798 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119521 s, 87.7 MB/s 2020-06-12T17:50:13.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:13.801 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:13.801 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:13.816 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:13.816 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:13.817 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6359/2a1a7b3c-d14e-42f2-8a27-76ff1485dfbf/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:13.905 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:13.905 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:13.905 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113544 s, 92.3 MB/s 2020-06-12T17:50:13.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:13.907 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:13.907 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:13.922 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:13.923 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:13.923 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6359/2a1a7b3c-d14e-42f2-8a27-76ff1485dfbf/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:14.013 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:14.013 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:14.013 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110429 s, 95.0 MB/s 2020-06-12T17:50:14.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:14.015 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:14.015 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:14.030 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:14.031 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:14.031 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6359/2a1a7b3c-d14e-42f2-8a27-76ff1485dfbf/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:14.118 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:14.119 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:14.119 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116998 s, 89.6 MB/s 2020-06-12T17:50:14.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:14.121 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:14.121 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:14.136 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:14.137 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:14.138 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6359/2a1a7b3c-d14e-42f2-8a27-76ff1485dfbf/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:14.223 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:14.224 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:14.224 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104857 s, 100 MB/s 2020-06-12T17:50:14.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:14.226 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:14.226 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:14.241 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:14.242 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:14.242 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6359/2a1a7b3c-d14e-42f2-8a27-76ff1485dfbf/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:14.326 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:14.327 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:14.327 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928324 s, 113 MB/s 2020-06-12T17:50:14.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:14.329 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:14.329 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:14.345 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:14.345 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:14.346 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6359/2a1a7b3c-d14e-42f2-8a27-76ff1485dfbf/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:14.434 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:14.435 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:14.435 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128241 s, 81.8 MB/s 2020-06-12T17:50:14.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:14.437 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:14.437 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:14.453 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:14.454 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:14.455 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6359/2a1a7b3c-d14e-42f2-8a27-76ff1485dfbf/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:14.547 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:14.548 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:14.548 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128763 s, 81.4 MB/s 2020-06-12T17:50:14.550 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_910 2020-06-12T17:50:14.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.665+0000 7f70cea92700 1 Processor -- start 2020-06-12T17:50:14.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.665+0000 7f70cea92700 1 -- start start 2020-06-12T17:50:14.674 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.666+0000 7f70cea92700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f70c80b2eb0 0x7f70c814d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:14.674 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.666+0000 7f70cea92700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70c8146d20 con 0x7f70c8146680 2020-06-12T17:50:14.674 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.666+0000 7f70cea92700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70c8066a80 con 0x7f70c80ad5b0 2020-06-12T17:50:14.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.666+0000 7f70cea92700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70c8146f50 con 0x7f70c80b2eb0 2020-06-12T17:50:14.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.666+0000 7f70cd02f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f70c80b2eb0 0x7f70c814d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:14.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.666+0000 7f70cc82e700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f70c8146680 0x7f70c809d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40362/0 (socket says 172.21.15.38:40362) 2020-06-12T17:50:14.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.666+0000 7f70cc82e700 1 -- 172.21.15.38:0/1096960988 learned_addr learned my addr 172.21.15.38:0/1096960988 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:14.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.666+0000 7f70cd02f700 1 -- 172.21.15.38:0/1096960988 >> v1:172.21.15.150:6789/0 conn(0x7f70c80ad5b0 legacy=0x7f70c809d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:14.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.666+0000 7f70cd02f700 1 -- 172.21.15.38:0/1096960988 >> v1:172.21.15.38:6789/0 conn(0x7f70c8146680 legacy=0x7f70c809d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:14.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.666+0000 7f70c77fe700 1 -- 172.21.15.38:0/1096960988 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1838731348 0 0) 0x7f70c8146d20 con 0x7f70c8146680 2020-06-12T17:50:14.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.666+0000 7f70cd02f700 1 -- 172.21.15.38:0/1096960988 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c8146a60 con 0x7f70c80b2eb0 2020-06-12T17:50:14.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.666+0000 7f70cd02f700 1 --2- 172.21.15.38:0/1096960988 >> v2:172.21.15.38:3300/0 conn(0x7f70c80b2eb0 0x7f70c814d490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f70c80b61c0 tx=0x7f70c00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:14.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.667+0000 7f70cd02f700 1 --2- 172.21.15.38:0/1096960988 >> v2:172.21.15.38:3300/0 conn(0x7f70c80b2eb0 0x7f70c814d490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f70c80b61c0 tx=0x7f70c00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:14.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.667+0000 7f70cd02f700 1 --2- 172.21.15.38:0/1096960988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70c80b2eb0 0x7f70c814d490 secure :-1 s=READY pgs=632 cs=0 l=1 rx=0x7f70c80b61c0 tx=0x7f70c00081e0).ready entity=mon.0 client_cookie=7e7cd29c6fdcc0ba server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:14.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.667+0000 7f70cd02f700 1 --2- 172.21.15.38:0/1096960988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70c80b2eb0 0x7f70c814d490 secure :-1 s=THROTTLE_DONE pgs=632 cs=0 l=1 rx=0x7f70c80b61c0 tx=0x7f70c00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:14.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.667+0000 7f70c77fe700 1 -- 172.21.15.38:0/1096960988 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70c0011e50 con 0x7f70c80b2eb0 2020-06-12T17:50:14.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.667+0000 7f70cd02f700 1 --2- 172.21.15.38:0/1096960988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70c80b2eb0 0x7f70c814d490 secure :-1 s=THROTTLE_DONE pgs=632 cs=0 l=1 rx=0x7f70c80b61c0 tx=0x7f70c00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:14.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.667+0000 7f70c77fe700 1 -- 172.21.15.38:0/1096960988 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c000a160 con 0x7f70c80b2eb0 2020-06-12T17:50:14.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.667+0000 7f70cd02f700 1 --2- 172.21.15.38:0/1096960988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70c80b2eb0 0x7f70c814d490 secure :-1 s=THROTTLE_DONE pgs=632 cs=0 l=1 rx=0x7f70c80b61c0 tx=0x7f70c00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:14.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.667+0000 7f70c77fe700 1 -- 172.21.15.38:0/1096960988 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70c000a4c0 con 0x7f70c80b2eb0 2020-06-12T17:50:14.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.667+0000 7f70cea92700 1 -- 172.21.15.38:0/1096960988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70c80b2eb0 msgr2=0x7f70c814d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:14.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.667+0000 7f70cea92700 1 --2- 172.21.15.38:0/1096960988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70c80b2eb0 0x7f70c814d490 secure :-1 s=READY pgs=632 cs=0 l=1 rx=0x7f70c80b61c0 tx=0x7f70c00081e0).stop 2020-06-12T17:50:14.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.667+0000 7f70cea92700 1 -- 172.21.15.38:0/1096960988 shutdown_connections 2020-06-12T17:50:14.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.667+0000 7f70cea92700 1 --2- 172.21.15.38:0/1096960988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70c80b2eb0 0x7f70c814d490 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:14.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.667+0000 7f70cea92700 1 -- 172.21.15.38:0/1096960988 >> 172.21.15.38:0/1096960988 conn(0x7f70c80b5a20 msgr2=0x7f70c805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:14.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.667+0000 7f70cea92700 1 -- 172.21.15.38:0/1096960988 shutdown_connections 2020-06-12T17:50:14.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.667+0000 7f70cea92700 1 -- 172.21.15.38:0/1096960988 wait complete. 2020-06-12T17:50:14.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.668+0000 7f70cea92700 1 Processor -- start 2020-06-12T17:50:14.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.668+0000 7f70cea92700 1 -- start start 2020-06-12T17:50:14.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.669+0000 7f70cea92700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f70c80ad5b0 0x7f70c8062640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:14.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.669+0000 7f70cea92700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70c8142510 con 0x7f70c80b2eb0 2020-06-12T17:50:14.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.669+0000 7f70cea92700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70c8143050 con 0x7f70c8146680 2020-06-12T17:50:14.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.669+0000 7f70cea92700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70c8063bc0 con 0x7f70c80ad5b0 2020-06-12T17:50:14.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.669+0000 7f70cc82e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f70c80ad5b0 0x7f70c8062640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:14.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.669+0000 7f70cc82e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f70c80ad5b0 0x7f70c8062640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38554/0 (socket says 172.21.15.38:38554) 2020-06-12T17:50:14.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.669+0000 7f70c7fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f70c80b2eb0 0x7f70c8142940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40368/0 (socket says 172.21.15.38:40368) 2020-06-12T17:50:14.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.669+0000 7f70cc82e700 1 -- 172.21.15.38:0/2040652335 learned_addr learned my addr 172.21.15.38:0/2040652335 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:14.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.669+0000 7f70cc82e700 1 -- 172.21.15.38:0/2040652335 >> v1:172.21.15.150:6789/0 conn(0x7f70c8146680 legacy=0x7f70c81419f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:14.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.669+0000 7f70cc82e700 1 -- 172.21.15.38:0/2040652335 >> v1:172.21.15.38:6789/0 conn(0x7f70c80b2eb0 legacy=0x7f70c8142940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:14.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.669+0000 7f70c5ffb700 1 -- 172.21.15.38:0/2040652335 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 417660303 0 0) 0x7f70c8142510 con 0x7f70c80b2eb0 2020-06-12T17:50:14.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.669+0000 7f70cc82e700 1 -- 172.21.15.38:0/2040652335 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c8063e60 con 0x7f70c80ad5b0 2020-06-12T17:50:14.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.670+0000 7f70cc82e700 1 --2- 172.21.15.38:0/2040652335 >> v2:172.21.15.38:3300/0 conn(0x7f70c80ad5b0 0x7f70c8062640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f70b0000b80 tx=0x7f70b0001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:14.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.670+0000 7f70cc82e700 1 --2- 172.21.15.38:0/2040652335 >> v2:172.21.15.38:3300/0 conn(0x7f70c80ad5b0 0x7f70c8062640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f70b0000b80 tx=0x7f70b0001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:14.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.670+0000 7f70cc82e700 1 --2- 172.21.15.38:0/2040652335 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70c80ad5b0 0x7f70c8062640 secure :-1 s=READY pgs=634 cs=0 l=1 rx=0x7f70b0000b80 tx=0x7f70b0001700).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:14.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.670+0000 7f70cc82e700 1 --2- 172.21.15.38:0/2040652335 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70c80ad5b0 0x7f70c8062640 secure :-1 s=THROTTLE_DONE pgs=634 cs=0 l=1 rx=0x7f70b0000b80 tx=0x7f70b0001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:14.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.670+0000 7f70c5ffb700 1 -- 172.21.15.38:0/2040652335 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70b0005ca0 con 0x7f70c80ad5b0 2020-06-12T17:50:14.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.670+0000 7f70cc82e700 1 --2- 172.21.15.38:0/2040652335 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70c80ad5b0 0x7f70c8062640 secure :-1 s=THROTTLE_DONE pgs=634 cs=0 l=1 rx=0x7f70b0000b80 tx=0x7f70b0001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:14.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.670+0000 7f70cc82e700 1 --2- 172.21.15.38:0/2040652335 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70c80ad5b0 0x7f70c8062640 secure :-1 s=THROTTLE_DONE pgs=634 cs=0 l=1 rx=0x7f70b0000b80 tx=0x7f70b0001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:14.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.670+0000 7f70c5ffb700 1 -- 172.21.15.38:0/2040652335 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b0005e00 con 0x7f70c80ad5b0 2020-06-12T17:50:14.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.670+0000 7f70cea92700 1 -- 172.21.15.38:0/2040652335 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70c8142100 con 0x7f70c80ad5b0 2020-06-12T17:50:14.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.670+0000 7f70c5ffb700 1 -- 172.21.15.38:0/2040652335 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70b00062b0 con 0x7f70c80ad5b0 2020-06-12T17:50:14.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.670+0000 7f70cea92700 1 -- 172.21.15.38:0/2040652335 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c8063710 con 0x7f70c80ad5b0 2020-06-12T17:50:14.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.671+0000 7f70cc82e700 1 --2- 172.21.15.38:0/2040652335 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70c80ad5b0 0x7f70c8062640 secure :-1 s=THROTTLE_DONE pgs=634 cs=0 l=1 rx=0x7f70b0000b80 tx=0x7f70b0001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:14.687 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.671+0000 7f70c5ffb700 1 -- 172.21.15.38:0/2040652335 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f70b0006410 con 0x7f70c80ad5b0 2020-06-12T17:50:14.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.671+0000 7f70cc82e700 1 --2- 172.21.15.38:0/2040652335 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70c80ad5b0 0x7f70c8062640 secure :-1 s=THROTTLE_DONE pgs=634 cs=0 l=1 rx=0x7f70b0000b80 tx=0x7f70b0001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:14.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.671+0000 7f70cea92700 1 -- 172.21.15.38:0/2040652335 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70c8063a20 con 0x7f70c80ad5b0 2020-06-12T17:50:14.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.671+0000 7f70c5ffb700 1 --2- 172.21.15.38:0/2040652335 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f70ac04d530 0x7f70ac04f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:14.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.671+0000 7f70c5ffb700 1 -- 172.21.15.38:0/2040652335 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f70b0060fc0 con 0x7f70c80ad5b0 2020-06-12T17:50:14.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.672+0000 7f70c7fff700 1 --2- 172.21.15.38:0/2040652335 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f70ac04d530 0x7f70ac04f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:14.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.672+0000 7f70c7fff700 1 --2- 172.21.15.38:0/2040652335 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f70ac04d530 0x7f70ac04f9f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f70b8002230 tx=0x7f70b8002620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:14.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.672+0000 7f70c7fff700 1 --2- 172.21.15.38:0/2040652335 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f70ac04d530 0x7f70ac04f9f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f70b8002230 tx=0x7f70b8002620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:14.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.672+0000 7f70c7fff700 1 --2- 172.21.15.38:0/2040652335 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f70ac04d530 0x7f70ac04f9f0 secure :-1 s=READY pgs=250 cs=0 l=1 rx=0x7f70b8002230 tx=0x7f70b8002620).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:14.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.675+0000 7f70cc82e700 1 --2- 172.21.15.38:0/2040652335 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70c80ad5b0 0x7f70c8062640 secure :-1 s=THROTTLE_DONE pgs=634 cs=0 l=1 rx=0x7f70b0000b80 tx=0x7f70b0001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:14.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.675+0000 7f70c5ffb700 1 -- 172.21.15.38:0/2040652335 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f70c8063a20 con 0x7f70c80ad5b0 2020-06-12T17:50:14.871 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.867+0000 7f70cea92700 1 -- 172.21.15.38:0/2040652335 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_910", "target": ["mon-mgr", ""]}) v1 -- 0x7f70c81426a0 con 0x7f70ac04d530 2020-06-12T17:50:14.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.885+0000 7f70c7fff700 1 --2- 172.21.15.38:0/2040652335 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f70ac04d530 0x7f70ac04f9f0 secure :-1 s=THROTTLE_DONE pgs=250 cs=0 l=1 rx=0x7f70b8002230 tx=0x7f70b8002620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:14.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.885+0000 7f70c5ffb700 1 -- 172.21.15.38:0/2040652335 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f70b800c200 con 0x7f70ac04d530 2020-06-12T17:50:14.891 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.887+0000 7f70cea92700 1 -- 172.21.15.38:0/2040652335 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f70ac04d530 msgr2=0x7f70ac04f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:14.891 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.887+0000 7f70cea92700 1 --2- 172.21.15.38:0/2040652335 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f70ac04d530 0x7f70ac04f9f0 secure :-1 s=READY pgs=250 cs=0 l=1 rx=0x7f70b8002230 tx=0x7f70b8002620).stop 2020-06-12T17:50:14.891 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.887+0000 7f70cea92700 1 -- 172.21.15.38:0/2040652335 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70c80ad5b0 msgr2=0x7f70c8062640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:14.892 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.887+0000 7f70cea92700 1 --2- 172.21.15.38:0/2040652335 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70c80ad5b0 0x7f70c8062640 secure :-1 s=READY pgs=634 cs=0 l=1 rx=0x7f70b0000b80 tx=0x7f70b0001700).stop 2020-06-12T17:50:14.892 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.887+0000 7f70cea92700 1 -- 172.21.15.38:0/2040652335 shutdown_connections 2020-06-12T17:50:14.892 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.887+0000 7f70cea92700 1 --2- 172.21.15.38:0/2040652335 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f70ac04d530 0x7f70ac04f9f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:14.892 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.887+0000 7f70cea92700 1 --2- 172.21.15.38:0/2040652335 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70c80ad5b0 0x7f70c8062640 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:14.893 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.887+0000 7f70cea92700 1 -- 172.21.15.38:0/2040652335 >> 172.21.15.38:0/2040652335 conn(0x7f70c80b5a20 msgr2=0x7f70c81458f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:14.893 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.887+0000 7f70cea92700 1 -- 172.21.15.38:0/2040652335 shutdown_connections 2020-06-12T17:50:14.893 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:14.887+0000 7f70cea92700 1 -- 172.21.15.38:0/2040652335 wait complete. 2020-06-12T17:50:14.901 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_910 2020-06-12T17:50:15.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.014+0000 7fddf88d5700 1 Processor -- start 2020-06-12T17:50:15.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.014+0000 7fddf88d5700 1 -- start start 2020-06-12T17:50:15.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.015+0000 7fddf88d5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fddf409d0b0 0x7fddf413c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:15.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.015+0000 7fddf88d5700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf409b960 con 0x7fddf409df00 2020-06-12T17:50:15.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.015+0000 7fddf88d5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf409bc00 con 0x7fddf40b3ac0 2020-06-12T17:50:15.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.015+0000 7fddf88d5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf40b48f0 con 0x7fddf409d0b0 2020-06-12T17:50:15.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.015+0000 7fddf1d9b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fddf409df00 0x7fddf4066790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40376/0 (socket says 172.21.15.38:40376) 2020-06-12T17:50:15.028 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.015+0000 7fddf1d9b700 1 -- 172.21.15.38:0/543672009 learned_addr learned my addr 172.21.15.38:0/543672009 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:15.028 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf2d9d700 1 --2- 172.21.15.38:0/543672009 >> v2:172.21.15.150:3300/0 conn(0x7fddf409d0b0 0x7fddf413c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:15.029 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf159a700 1 -- 172.21.15.38:0/543672009 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593629862 0 0) 0x7fddf409b960 con 0x7fddf409df00 2020-06-12T17:50:15.029 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf159a700 1 -- 172.21.15.38:0/543672009 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddd8003230 con 0x7fddf409df00 2020-06-12T17:50:15.029 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf159a700 1 -- 172.21.15.38:0/543672009 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3622374857 0 0) 0x7fddd8003230 con 0x7fddf409df00 2020-06-12T17:50:15.030 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf159a700 1 -- 172.21.15.38:0/543672009 >> v2:172.21.15.150:3300/0 conn(0x7fddf409d0b0 msgr2=0x7fddf413c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:15.030 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf159a700 1 --2- 172.21.15.38:0/543672009 >> v2:172.21.15.150:3300/0 conn(0x7fddf409d0b0 0x7fddf413c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:15.030 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf159a700 1 -- 172.21.15.38:0/543672009 >> v1:172.21.15.150:6789/0 conn(0x7fddf40b3ac0 legacy=0x7fddf413bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:15.031 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf159a700 1 -- 172.21.15.38:0/543672009 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf40b3ea0 con 0x7fddf409df00 2020-06-12T17:50:15.031 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf159a700 1 -- 172.21.15.38:0/543672009 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fdde40016d0 con 0x7fddf409df00 2020-06-12T17:50:15.031 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf159a700 1 -- 172.21.15.38:0/543672009 >> v1:172.21.15.38:6789/0 conn(0x7fddf409df00 legacy=0x7fddf4066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:15.031 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf159a700 1 --2- 172.21.15.38:0/543672009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd8003720 0x7fddd8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:15.031 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf159a700 1 --2- 172.21.15.38:0/543672009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd80044d0 0x7fddd8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:15.032 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf159a700 1 --2- 172.21.15.38:0/543672009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddd8004db0 0x7fddd800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:15.032 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf159a700 1 -- 172.21.15.38:0/543672009 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf40b48f0 con 0x7fddd8003720 2020-06-12T17:50:15.032 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf159a700 1 -- 172.21.15.38:0/543672009 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd80041c0 con 0x7fddd8004db0 2020-06-12T17:50:15.032 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf159a700 1 -- 172.21.15.38:0/543672009 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd800bb80 con 0x7fddd80044d0 2020-06-12T17:50:15.033 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf259c700 1 --2- 172.21.15.38:0/543672009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd8003720 0x7fddd8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:15.035 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf2d9d700 1 --2- 172.21.15.38:0/543672009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddd8004db0 0x7fddd800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:15.035 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf1d9b700 1 --2- 172.21.15.38:0/543672009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd80044d0 0x7fddd8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:15.035 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf259c700 1 -- 172.21.15.38:0/543672009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd80044d0 msgr2=0x7fddd8004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:15.035 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf259c700 1 --2- 172.21.15.38:0/543672009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd80044d0 0x7fddd8004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:15.036 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf259c700 1 -- 172.21.15.38:0/543672009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddd8004db0 msgr2=0x7fddd800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:15.036 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf259c700 1 --2- 172.21.15.38:0/543672009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddd8004db0 0x7fddd800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:15.036 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf259c700 1 -- 172.21.15.38:0/543672009 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd8003230 con 0x7fddd8003720 2020-06-12T17:50:15.036 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf2d9d700 1 --2- 172.21.15.38:0/543672009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddd8004db0 0x7fddd800b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:50:15.037 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf1d9b700 1 --2- 172.21.15.38:0/543672009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddd80044d0 0x7fddd8004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:50:15.037 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf2d9d700 1 -- 172.21.15.38:0/543672009 reap_dead start 2020-06-12T17:50:15.037 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf259c700 1 --2- 172.21.15.38:0/543672009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd8003720 0x7fddd8003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fddf40ae340 tx=0x7fdde8001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:15.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf259c700 1 --2- 172.21.15.38:0/543672009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd8003720 0x7fddd8003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fddf40ae340 tx=0x7fdde8001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:15.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.016+0000 7fddf259c700 1 --2- 172.21.15.38:0/543672009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd8003720 0x7fddd8003b40 secure :-1 s=READY pgs=636 cs=0 l=1 rx=0x7fddf40ae340 tx=0x7fdde8001840).ready entity=mon.0 client_cookie=54b016909673d4bc server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:15.042 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.017+0000 7fddf259c700 1 --2- 172.21.15.38:0/543672009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd8003720 0x7fddd8003b40 secure :-1 s=THROTTLE_DONE pgs=636 cs=0 l=1 rx=0x7fddf40ae340 tx=0x7fdde8001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:15.043 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.017+0000 7fddf259c700 1 --2- 172.21.15.38:0/543672009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd8003720 0x7fddd8003b40 secure :-1 s=THROTTLE_DONE pgs=636 cs=0 l=1 rx=0x7fddf40ae340 tx=0x7fdde8001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:15.043 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.017+0000 7fddf159a700 1 -- 172.21.15.38:0/543672009 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdde8003540 con 0x7fddd8003720 2020-06-12T17:50:15.043 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.017+0000 7fddf259c700 1 --2- 172.21.15.38:0/543672009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd8003720 0x7fddd8003b40 secure :-1 s=THROTTLE_DONE pgs=636 cs=0 l=1 rx=0x7fddf40ae340 tx=0x7fdde8001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:15.043 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.017+0000 7fddf159a700 1 -- 172.21.15.38:0/543672009 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde80036a0 con 0x7fddd8003720 2020-06-12T17:50:15.044 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.017+0000 7fddf159a700 1 -- 172.21.15.38:0/543672009 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdde8003a40 con 0x7fddd8003720 2020-06-12T17:50:15.044 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.017+0000 7fddf88d5700 1 -- 172.21.15.38:0/543672009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd8003720 msgr2=0x7fddd8003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:15.044 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.017+0000 7fddf88d5700 1 --2- 172.21.15.38:0/543672009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd8003720 0x7fddd8003b40 secure :-1 s=READY pgs=636 cs=0 l=1 rx=0x7fddf40ae340 tx=0x7fdde8001840).stop 2020-06-12T17:50:15.044 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.017+0000 7fddf88d5700 1 -- 172.21.15.38:0/543672009 shutdown_connections 2020-06-12T17:50:15.044 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.017+0000 7fddf88d5700 1 --2- 172.21.15.38:0/543672009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd8003720 0x7fddd8003b40 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:15.045 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.017+0000 7fddf88d5700 1 -- 172.21.15.38:0/543672009 >> 172.21.15.38:0/543672009 conn(0x7fddf40b5a20 msgr2=0x7fddf405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:15.045 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.017+0000 7fddf88d5700 1 -- 172.21.15.38:0/543672009 shutdown_connections 2020-06-12T17:50:15.045 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.017+0000 7fddf88d5700 1 -- 172.21.15.38:0/543672009 wait complete. 2020-06-12T17:50:15.047 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.018+0000 7fddf88d5700 1 Processor -- start 2020-06-12T17:50:15.048 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.018+0000 7fddf88d5700 1 -- start start 2020-06-12T17:50:15.050 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.019+0000 7fddf88d5700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fddd8003720 0x7fddf40b1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:15.050 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.019+0000 7fddf88d5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddf41526e0 0x7fddf4145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:15.050 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.019+0000 7fddf88d5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf4145c60 con 0x7fddf413f3d0 2020-06-12T17:50:15.051 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.019+0000 7fddf88d5700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf4152d10 con 0x7fddd8003720 2020-06-12T17:50:15.051 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.019+0000 7fddf88d5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf4152fb0 con 0x7fddf41526e0 2020-06-12T17:50:15.051 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.019+0000 7fddf259c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fddd8003720 0x7fddf40b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:15.051 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.019+0000 7fddf259c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fddd8003720 0x7fddf40b1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38572/0 (socket says 172.21.15.38:38572) 2020-06-12T17:50:15.052 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.019+0000 7fddf259c700 1 -- 172.21.15.38:0/1564265970 learned_addr learned my addr 172.21.15.38:0/1564265970 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:15.052 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.019+0000 7fddf1d9b700 1 --2- 172.21.15.38:0/1564265970 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddf41526e0 0x7fddf4145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:15.052 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.019+0000 7fddf259c700 1 -- 172.21.15.38:0/1564265970 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddf41526e0 msgr2=0x7fddf4145800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:15.052 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.019+0000 7fddf259c700 1 --2- 172.21.15.38:0/1564265970 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddf41526e0 0x7fddf4145800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:15.052 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.019+0000 7fddf259c700 1 -- 172.21.15.38:0/1564265970 >> v1:172.21.15.150:6789/0 conn(0x7fddf413f3d0 legacy=0x7fddf413f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:15.053 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.019+0000 7fddf259c700 1 -- 172.21.15.38:0/1564265970 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf4153250 con 0x7fddd8003720 2020-06-12T17:50:15.055 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.019+0000 7fddf259c700 1 --2- 172.21.15.38:0/1564265970 >> v2:172.21.15.38:3300/0 conn(0x7fddd8003720 0x7fddf40b1680 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fddf40ae340 tx=0x7fdde8001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:15.055 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.019+0000 7fddf259c700 1 --2- 172.21.15.38:0/1564265970 >> v2:172.21.15.38:3300/0 conn(0x7fddd8003720 0x7fddf40b1680 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fddf40ae340 tx=0x7fdde8001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:15.056 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.019+0000 7fddf259c700 1 --2- 172.21.15.38:0/1564265970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd8003720 0x7fddf40b1680 secure :-1 s=READY pgs=637 cs=0 l=1 rx=0x7fddf40ae340 tx=0x7fdde8001840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:15.056 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.019+0000 7fddf259c700 1 --2- 172.21.15.38:0/1564265970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd8003720 0x7fddf40b1680 secure :-1 s=THROTTLE_DONE pgs=637 cs=0 l=1 rx=0x7fddf40ae340 tx=0x7fdde8001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:15.056 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.019+0000 7fddf259c700 1 --2- 172.21.15.38:0/1564265970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd8003720 0x7fddf40b1680 secure :-1 s=THROTTLE_DONE pgs=637 cs=0 l=1 rx=0x7fddf40ae340 tx=0x7fdde8001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:15.056 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.019+0000 7fdde37fe700 1 -- 172.21.15.38:0/1564265970 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdde8008350 con 0x7fddd8003720 2020-06-12T17:50:15.057 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.019+0000 7fddf259c700 1 --2- 172.21.15.38:0/1564265970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd8003720 0x7fddf40b1680 secure :-1 s=THROTTLE_DONE pgs=637 cs=0 l=1 rx=0x7fddf40ae340 tx=0x7fdde8001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:15.057 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.020+0000 7fdde37fe700 1 -- 172.21.15.38:0/1564265970 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde8008a80 con 0x7fddd8003720 2020-06-12T17:50:15.057 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.020+0000 7fddf88d5700 1 -- 172.21.15.38:0/1564265970 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf4062860 con 0x7fddd8003720 2020-06-12T17:50:15.057 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.020+0000 7fdde37fe700 1 -- 172.21.15.38:0/1564265970 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdde8008de0 con 0x7fddd8003720 2020-06-12T17:50:15.058 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.020+0000 7fddf88d5700 1 -- 172.21.15.38:0/1564265970 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf4062db0 con 0x7fddd8003720 2020-06-12T17:50:15.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.020+0000 7fddf259c700 1 --2- 172.21.15.38:0/1564265970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd8003720 0x7fddf40b1680 secure :-1 s=THROTTLE_DONE pgs=637 cs=0 l=1 rx=0x7fddf40ae340 tx=0x7fdde8001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:15.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.021+0000 7fdde37fe700 1 -- 172.21.15.38:0/1564265970 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fdde80064e0 con 0x7fddd8003720 2020-06-12T17:50:15.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.021+0000 7fddf259c700 1 --2- 172.21.15.38:0/1564265970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd8003720 0x7fddf40b1680 secure :-1 s=THROTTLE_DONE pgs=637 cs=0 l=1 rx=0x7fddf40ae340 tx=0x7fdde8001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:15.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.021+0000 7fddf88d5700 1 -- 172.21.15.38:0/1564265970 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf41533e0 con 0x7fddd8003720 2020-06-12T17:50:15.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.021+0000 7fdde37fe700 1 --2- 172.21.15.38:0/1564265970 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fddd004d520 0x7fddd004f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:15.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.021+0000 7fdde37fe700 1 -- 172.21.15.38:0/1564265970 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fdde8061660 con 0x7fddd8003720 2020-06-12T17:50:15.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.021+0000 7fddf1d9b700 1 --2- 172.21.15.38:0/1564265970 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fddd004d520 0x7fddd004f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:15.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.021+0000 7fddf1d9b700 1 --2- 172.21.15.38:0/1564265970 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fddd004d520 0x7fddd004f9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdde40013e0 tx=0x7fddf4142490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:15.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.021+0000 7fddf1d9b700 1 --2- 172.21.15.38:0/1564265970 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fddd004d520 0x7fddd004f9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdde40013e0 tx=0x7fddf4142490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:15.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.021+0000 7fddf1d9b700 1 --2- 172.21.15.38:0/1564265970 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fddd004d520 0x7fddd004f9e0 secure :-1 s=READY pgs=251 cs=0 l=1 rx=0x7fdde40013e0 tx=0x7fddf4142490).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:15.061 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.024+0000 7fddf259c700 1 --2- 172.21.15.38:0/1564265970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd8003720 0x7fddf40b1680 secure :-1 s=THROTTLE_DONE pgs=637 cs=0 l=1 rx=0x7fddf40ae340 tx=0x7fdde8001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:15.062 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.024+0000 7fdde37fe700 1 -- 172.21.15.38:0/1564265970 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fdde803ce40 con 0x7fddd8003720 2020-06-12T17:50:15.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.220+0000 7fddf88d5700 1 -- 172.21.15.38:0/1564265970 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_910", "target": ["mon-mgr", ""]}) v1 -- 0x7fddf4056c30 con 0x7fddd004d520 2020-06-12T17:50:15.227 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.223+0000 7fddf1d9b700 1 --2- 172.21.15.38:0/1564265970 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fddd004d520 0x7fddd004f9e0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fdde40013e0 tx=0x7fddf4142490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:15.227 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.223+0000 7fdde37fe700 1 -- 172.21.15.38:0/1564265970 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+69 (secure 0 0 0) 0x7fddf4056c30 con 0x7fddd004d520 2020-06-12T17:50:15.227 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_910/5926b75e-a7f1-4677-bffa-e43dd17d48fb 2020-06-12T17:50:15.228 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.225+0000 7fddf88d5700 1 -- 172.21.15.38:0/1564265970 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fddd004d520 msgr2=0x7fddd004f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:15.229 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.225+0000 7fddf88d5700 1 --2- 172.21.15.38:0/1564265970 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fddd004d520 0x7fddd004f9e0 secure :-1 s=READY pgs=251 cs=0 l=1 rx=0x7fdde40013e0 tx=0x7fddf4142490).stop 2020-06-12T17:50:15.229 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.225+0000 7fddf88d5700 1 -- 172.21.15.38:0/1564265970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd8003720 msgr2=0x7fddf40b1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:15.229 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.225+0000 7fddf88d5700 1 --2- 172.21.15.38:0/1564265970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd8003720 0x7fddf40b1680 secure :-1 s=READY pgs=637 cs=0 l=1 rx=0x7fddf40ae340 tx=0x7fdde8001840).stop 2020-06-12T17:50:15.229 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.225+0000 7fddf88d5700 1 -- 172.21.15.38:0/1564265970 shutdown_connections 2020-06-12T17:50:15.230 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.225+0000 7fddf88d5700 1 --2- 172.21.15.38:0/1564265970 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fddd004d520 0x7fddd004f9e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:15.230 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.225+0000 7fddf88d5700 1 --2- 172.21.15.38:0/1564265970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddd8003720 0x7fddf40b1680 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:15.230 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.225+0000 7fddf88d5700 1 --2- 172.21.15.38:0/1564265970 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddf41526e0 0x7fddf4145800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:15.230 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.225+0000 7fddf88d5700 1 -- 172.21.15.38:0/1564265970 >> 172.21.15.38:0/1564265970 conn(0x7fddf40b5a20 msgr2=0x7fddf40b7790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:15.230 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.225+0000 7fddf88d5700 1 -- 172.21.15.38:0/1564265970 shutdown_connections 2020-06-12T17:50:15.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:15.225+0000 7fddf88d5700 1 -- 172.21.15.38:0/1564265970 wait complete. 2020-06-12T17:50:15.238 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_910 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_910/5926b75e-a7f1-4677-bffa-e43dd17d48fb 2020-06-12T17:50:15.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:15.239 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:15.240 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:15.255 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:15.256 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:15.256 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_910/5926b75e-a7f1-4677-bffa-e43dd17d48fb/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:15.349 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:15.350 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:15.350 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131371 s, 79.8 MB/s 2020-06-12T17:50:15.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:15.352 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:15.352 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:15.368 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:15.368 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:15.369 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_910/5926b75e-a7f1-4677-bffa-e43dd17d48fb/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:15.457 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:15.457 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:15.458 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120147 s, 87.3 MB/s 2020-06-12T17:50:15.459 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:15.459 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:15.460 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:15.475 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:15.476 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:15.476 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_910/5926b75e-a7f1-4677-bffa-e43dd17d48fb/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:15.562 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:15.563 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:15.563 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107455 s, 97.6 MB/s 2020-06-12T17:50:15.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:15.565 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:15.566 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:15.580 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:15.581 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:15.582 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_910/5926b75e-a7f1-4677-bffa-e43dd17d48fb/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:15.669 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:15.669 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:15.669 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102179 s, 103 MB/s 2020-06-12T17:50:15.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:15.671 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:15.672 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:15.687 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:15.687 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:15.688 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_910/5926b75e-a7f1-4677-bffa-e43dd17d48fb/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:15.779 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:15.779 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:15.780 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112182 s, 93.5 MB/s 2020-06-12T17:50:15.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:15.781 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:15.782 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:15.798 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:15.799 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:15.799 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_910/5926b75e-a7f1-4677-bffa-e43dd17d48fb/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:15.885 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:15.886 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:15.886 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099822 s, 105 MB/s 2020-06-12T17:50:15.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:15.888 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:15.889 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:15.904 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:15.904 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:15.905 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_910/5926b75e-a7f1-4677-bffa-e43dd17d48fb/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:15.997 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:15.998 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:15.998 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013448 s, 78.0 MB/s 2020-06-12T17:50:15.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:16.000 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:16.000 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:16.015 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:16.017 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:16.017 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_910/5926b75e-a7f1-4677-bffa-e43dd17d48fb/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:16.103 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:16.104 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:16.104 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109474 s, 95.8 MB/s 2020-06-12T17:50:16.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:16.106 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:16.106 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:16.121 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:16.122 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:16.122 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_910/5926b75e-a7f1-4677-bffa-e43dd17d48fb/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:16.212 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:16.212 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:16.212 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113653 s, 92.3 MB/s 2020-06-12T17:50:16.213 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:16.214 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:16.215 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:16.230 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:16.231 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:16.232 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_910/5926b75e-a7f1-4677-bffa-e43dd17d48fb/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:16.320 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:16.321 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:16.321 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117202 s, 89.5 MB/s 2020-06-12T17:50:16.322 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_6318 2020-06-12T17:50:16.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.436+0000 7fcf452a1700 1 Processor -- start 2020-06-12T17:50:16.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.436+0000 7fcf452a1700 1 -- start start 2020-06-12T17:50:16.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.437+0000 7fcf452a1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcf40146680 0x7fcf400ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:16.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.437+0000 7fcf452a1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf400b2eb0 0x7fcf4009d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:16.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.437+0000 7fcf452a1700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcf4009d620 0x7fcf4009da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:16.443 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.437+0000 7fcf452a1700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf40146d20 con 0x7fcf4009d620 2020-06-12T17:50:16.444 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.437+0000 7fcf452a1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf40066a80 con 0x7fcf40146680 2020-06-12T17:50:16.444 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.437+0000 7fcf452a1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf40146f50 con 0x7fcf400b2eb0 2020-06-12T17:50:16.444 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.437+0000 7fcf3f7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcf4009d620 0x7fcf4009da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:16.444 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.437+0000 7fcf3f7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcf4009d620 0x7fcf4009da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38582/0 (socket says 172.21.15.38:38582) 2020-06-12T17:50:16.444 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.437+0000 7fcf3f7fe700 1 -- 172.21.15.38:0/85395780 learned_addr learned my addr 172.21.15.38:0/85395780 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:16.445 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.437+0000 7fcf3f7fe700 1 -- 172.21.15.38:0/85395780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf400b2eb0 msgr2=0x7fcf4009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:16.445 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.437+0000 7fcf3effd700 1 --2- 172.21.15.38:0/85395780 >> v2:172.21.15.150:3300/0 conn(0x7fcf40146680 0x7fcf400ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:16.445 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.437+0000 7fcf3e7fc700 1 --2- 172.21.15.38:0/85395780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf400b2eb0 0x7fcf4009d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:16.445 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.437+0000 7fcf3f7fe700 1 --2- 172.21.15.38:0/85395780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf400b2eb0 0x7fcf4009d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:16.445 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.437+0000 7fcf3f7fe700 1 -- 172.21.15.38:0/85395780 >> v2:172.21.15.150:3300/0 conn(0x7fcf40146680 msgr2=0x7fcf400ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:16.446 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.437+0000 7fcf3f7fe700 1 --2- 172.21.15.38:0/85395780 >> v2:172.21.15.150:3300/0 conn(0x7fcf40146680 0x7fcf400ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:16.446 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.437+0000 7fcf3f7fe700 1 -- 172.21.15.38:0/85395780 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf40146a60 con 0x7fcf4009d620 2020-06-12T17:50:16.446 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.437+0000 7fcf3effd700 1 --2- 172.21.15.38:0/85395780 >> v2:172.21.15.150:3300/0 conn(0x7fcf40146680 0x7fcf400ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:50:16.446 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.437+0000 7fcf3e7fc700 1 --2- 172.21.15.38:0/85395780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf400b2eb0 0x7fcf4009d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:50:16.446 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.437+0000 7fcf3f7fe700 1 --2- 172.21.15.38:0/85395780 >> v2:172.21.15.38:3300/0 conn(0x7fcf4009d620 0x7fcf4009da90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcf380032b0 tx=0x7fcf380081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.447 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.437+0000 7fcf3f7fe700 1 --2- 172.21.15.38:0/85395780 >> v2:172.21.15.38:3300/0 conn(0x7fcf4009d620 0x7fcf4009da90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcf380032b0 tx=0x7fcf380081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.447 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.437+0000 7fcf3f7fe700 1 --2- 172.21.15.38:0/85395780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf4009d620 0x7fcf4009da90 secure :-1 s=READY pgs=638 cs=0 l=1 rx=0x7fcf380032b0 tx=0x7fcf380081e0).ready entity=mon.0 client_cookie=51cfa50c677c75a1 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:16.447 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.438+0000 7fcf3f7fe700 1 --2- 172.21.15.38:0/85395780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf4009d620 0x7fcf4009da90 secure :-1 s=THROTTLE_DONE pgs=638 cs=0 l=1 rx=0x7fcf380032b0 tx=0x7fcf380081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.447 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.438+0000 7fcf3f7fe700 1 --2- 172.21.15.38:0/85395780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf4009d620 0x7fcf4009da90 secure :-1 s=THROTTLE_DONE pgs=638 cs=0 l=1 rx=0x7fcf380032b0 tx=0x7fcf380081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.448 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.438+0000 7fcf3dffb700 1 -- 172.21.15.38:0/85395780 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf3800a160 con 0x7fcf4009d620 2020-06-12T17:50:16.448 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.438+0000 7fcf3f7fe700 1 --2- 172.21.15.38:0/85395780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf4009d620 0x7fcf4009da90 secure :-1 s=THROTTLE_DONE pgs=638 cs=0 l=1 rx=0x7fcf380032b0 tx=0x7fcf380081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.448 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.438+0000 7fcf3dffb700 1 -- 172.21.15.38:0/85395780 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3800a2c0 con 0x7fcf4009d620 2020-06-12T17:50:16.448 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.438+0000 7fcf3dffb700 1 -- 172.21.15.38:0/85395780 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf3800a660 con 0x7fcf4009d620 2020-06-12T17:50:16.449 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.438+0000 7fcf452a1700 1 -- 172.21.15.38:0/85395780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf4009d620 msgr2=0x7fcf4009da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:16.449 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.438+0000 7fcf452a1700 1 --2- 172.21.15.38:0/85395780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf4009d620 0x7fcf4009da90 secure :-1 s=READY pgs=638 cs=0 l=1 rx=0x7fcf380032b0 tx=0x7fcf380081e0).stop 2020-06-12T17:50:16.449 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.438+0000 7fcf452a1700 1 -- 172.21.15.38:0/85395780 shutdown_connections 2020-06-12T17:50:16.449 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.438+0000 7fcf452a1700 1 --2- 172.21.15.38:0/85395780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf4009d620 0x7fcf4009da90 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:16.449 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.438+0000 7fcf452a1700 1 --2- 172.21.15.38:0/85395780 >> v2:172.21.15.150:3300/0 conn(0x7fcf40146680 0x7fcf400ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:16.450 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.438+0000 7fcf452a1700 1 --2- 172.21.15.38:0/85395780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf400b2eb0 0x7fcf4009d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:16.450 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.438+0000 7fcf452a1700 1 -- 172.21.15.38:0/85395780 >> 172.21.15.38:0/85395780 conn(0x7fcf400b5a20 msgr2=0x7fcf4005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:16.450 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.438+0000 7fcf452a1700 1 -- 172.21.15.38:0/85395780 shutdown_connections 2020-06-12T17:50:16.450 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.438+0000 7fcf452a1700 1 -- 172.21.15.38:0/85395780 wait complete. 2020-06-12T17:50:16.450 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.439+0000 7fcf452a1700 1 Processor -- start 2020-06-12T17:50:16.451 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.439+0000 7fcf452a1700 1 -- start start 2020-06-12T17:50:16.453 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.440+0000 7fcf452a1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf400b2eb0 0x7fcf400620b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:16.454 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.440+0000 7fcf452a1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcf40146680 0x7fcf4013e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:16.454 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.440+0000 7fcf452a1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf400affd0 con 0x7fcf4009d620 2020-06-12T17:50:16.454 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.440+0000 7fcf452a1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf40066580 con 0x7fcf40146680 2020-06-12T17:50:16.454 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.440+0000 7fcf452a1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf400b0270 con 0x7fcf400b2eb0 2020-06-12T17:50:16.455 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.440+0000 7fcf3f7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcf40146680 0x7fcf4013e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:16.455 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.440+0000 7fcf3e7fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf400b2eb0 0x7fcf400620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:16.455 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.440+0000 7fcf3f7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcf40146680 0x7fcf4013e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:48064/0 (socket says 172.21.15.38:48064) 2020-06-12T17:50:16.455 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.440+0000 7fcf3effd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fcf4009d620 0x7fcf401432f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:32900/0 (socket says 172.21.15.38:32900) 2020-06-12T17:50:16.455 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.440+0000 7fcf3f7fe700 1 -- 172.21.15.38:0/178175783 learned_addr learned my addr 172.21.15.38:0/178175783 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:16.456 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.441+0000 7fcf3f7fe700 1 -- 172.21.15.38:0/178175783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf400b2eb0 msgr2=0x7fcf400620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:16.456 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.441+0000 7fcf3f7fe700 1 --2- 172.21.15.38:0/178175783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf400b2eb0 0x7fcf400620b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:16.456 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.441+0000 7fcf3f7fe700 1 -- 172.21.15.38:0/178175783 >> v1:172.21.15.150:6789/0 conn(0x7fcf4009d620 legacy=0x7fcf401432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:16.456 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.441+0000 7fcf3f7fe700 1 -- 172.21.15.38:0/178175783 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf400b0510 con 0x7fcf40146680 2020-06-12T17:50:16.456 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.441+0000 7fcf3e7fc700 1 --2- 172.21.15.38:0/178175783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf400b2eb0 0x7fcf400620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:50:16.457 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.441+0000 7fcf3f7fe700 1 --2- 172.21.15.38:0/178175783 >> v2:172.21.15.150:3300/0 conn(0x7fcf40146680 0x7fcf4013e510 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcf380032b0 tx=0x7fcf380081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.457 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.441+0000 7fcf3f7fe700 1 --2- 172.21.15.38:0/178175783 >> v2:172.21.15.150:3300/0 conn(0x7fcf40146680 0x7fcf4013e510 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcf380032b0 tx=0x7fcf380081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.457 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.441+0000 7fcf3f7fe700 1 --2- 172.21.15.38:0/178175783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf40146680 0x7fcf4013e510 secure :-1 s=READY pgs=376 cs=0 l=1 rx=0x7fcf380032b0 tx=0x7fcf380081e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:16.457 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.441+0000 7fcf3f7fe700 1 --2- 172.21.15.38:0/178175783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf40146680 0x7fcf4013e510 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7fcf380032b0 tx=0x7fcf380081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.457 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.441+0000 7fcf3f7fe700 1 --2- 172.21.15.38:0/178175783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf40146680 0x7fcf4013e510 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7fcf380032b0 tx=0x7fcf380081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.458 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.441+0000 7fcf3f7fe700 1 --2- 172.21.15.38:0/178175783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf40146680 0x7fcf4013e510 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7fcf380032b0 tx=0x7fcf380081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.458 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.441+0000 7fcf2ffff700 1 -- 172.21.15.38:0/178175783 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf38005a40 con 0x7fcf40146680 2020-06-12T17:50:16.458 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.441+0000 7fcf2ffff700 1 -- 172.21.15.38:0/178175783 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf38005be0 con 0x7fcf40146680 2020-06-12T17:50:16.458 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.441+0000 7fcf452a1700 1 -- 172.21.15.38:0/178175783 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf40143a00 con 0x7fcf40146680 2020-06-12T17:50:16.459 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.441+0000 7fcf2ffff700 1 -- 172.21.15.38:0/178175783 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf3800d660 con 0x7fcf40146680 2020-06-12T17:50:16.459 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.441+0000 7fcf452a1700 1 -- 172.21.15.38:0/178175783 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf40063010 con 0x7fcf40146680 2020-06-12T17:50:16.459 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.443+0000 7fcf452a1700 1 -- 172.21.15.38:0/178175783 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf20003340 con 0x7fcf40146680 2020-06-12T17:50:16.459 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.444+0000 7fcf3f7fe700 1 --2- 172.21.15.38:0/178175783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf40146680 0x7fcf4013e510 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7fcf380032b0 tx=0x7fcf380081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.459 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.444+0000 7fcf2ffff700 1 -- 172.21.15.38:0/178175783 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fcf3800d7c0 con 0x7fcf40146680 2020-06-12T17:50:16.460 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.444+0000 7fcf3f7fe700 1 --2- 172.21.15.38:0/178175783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf40146680 0x7fcf4013e510 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7fcf380032b0 tx=0x7fcf380081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.460 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.445+0000 7fcf2ffff700 1 --2- 172.21.15.38:0/178175783 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcf1c04d630 0x7fcf1c04faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:16.460 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.445+0000 7fcf2ffff700 1 -- 172.21.15.38:0/178175783 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcf38063ad0 con 0x7fcf40146680 2020-06-12T17:50:16.460 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.445+0000 7fcf3effd700 1 --2- 172.21.15.38:0/178175783 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcf1c04d630 0x7fcf1c04faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:16.460 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.445+0000 7fcf3effd700 1 --2- 172.21.15.38:0/178175783 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcf1c04d630 0x7fcf1c04faf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcf400b0890 tx=0x7fcf34009b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.460 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.445+0000 7fcf3effd700 1 --2- 172.21.15.38:0/178175783 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcf1c04d630 0x7fcf1c04faf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcf400b0890 tx=0x7fcf34009b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.461 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.445+0000 7fcf3effd700 1 --2- 172.21.15.38:0/178175783 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcf1c04d630 0x7fcf1c04faf0 secure :-1 s=READY pgs=252 cs=0 l=1 rx=0x7fcf400b0890 tx=0x7fcf34009b60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:16.461 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.450+0000 7fcf3f7fe700 1 --2- 172.21.15.38:0/178175783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf40146680 0x7fcf4013e510 secure :-1 s=THROTTLE_DONE pgs=376 cs=0 l=1 rx=0x7fcf380032b0 tx=0x7fcf380081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.461 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.450+0000 7fcf2ffff700 1 -- 172.21.15.38:0/178175783 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fcf3803f310 con 0x7fcf40146680 2020-06-12T17:50:16.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.644+0000 7fcf452a1700 1 -- 172.21.15.38:0/178175783 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_6318", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf20002200 con 0x7fcf1c04d630 2020-06-12T17:50:16.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.664+0000 7fcf3effd700 1 --2- 172.21.15.38:0/178175783 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcf1c04d630 0x7fcf1c04faf0 secure :-1 s=THROTTLE_DONE pgs=252 cs=0 l=1 rx=0x7fcf400b0890 tx=0x7fcf34009b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.664+0000 7fcf2ffff700 1 -- 172.21.15.38:0/178175783 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcf20002200 con 0x7fcf1c04d630 2020-06-12T17:50:16.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.666+0000 7fcf452a1700 1 -- 172.21.15.38:0/178175783 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcf1c04d630 msgr2=0x7fcf1c04faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:16.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.666+0000 7fcf452a1700 1 --2- 172.21.15.38:0/178175783 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcf1c04d630 0x7fcf1c04faf0 secure :-1 s=READY pgs=252 cs=0 l=1 rx=0x7fcf400b0890 tx=0x7fcf34009b60).stop 2020-06-12T17:50:16.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.666+0000 7fcf452a1700 1 -- 172.21.15.38:0/178175783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf40146680 msgr2=0x7fcf4013e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:16.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.666+0000 7fcf452a1700 1 --2- 172.21.15.38:0/178175783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf40146680 0x7fcf4013e510 secure :-1 s=READY pgs=376 cs=0 l=1 rx=0x7fcf380032b0 tx=0x7fcf380081e0).stop 2020-06-12T17:50:16.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.666+0000 7fcf452a1700 1 -- 172.21.15.38:0/178175783 shutdown_connections 2020-06-12T17:50:16.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.666+0000 7fcf452a1700 1 --2- 172.21.15.38:0/178175783 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcf1c04d630 0x7fcf1c04faf0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:16.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.666+0000 7fcf452a1700 1 --2- 172.21.15.38:0/178175783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf40146680 0x7fcf4013e510 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:16.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.666+0000 7fcf452a1700 1 --2- 172.21.15.38:0/178175783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf400b2eb0 0x7fcf400620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:16.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.666+0000 7fcf452a1700 1 -- 172.21.15.38:0/178175783 >> 172.21.15.38:0/178175783 conn(0x7fcf400b5a20 msgr2=0x7fcf4009b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:16.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.666+0000 7fcf452a1700 1 -- 172.21.15.38:0/178175783 shutdown_connections 2020-06-12T17:50:16.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.666+0000 7fcf452a1700 1 -- 172.21.15.38:0/178175783 wait complete. 2020-06-12T17:50:16.679 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_6318 2020-06-12T17:50:16.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.793+0000 7fa3319b0700 1 Processor -- start 2020-06-12T17:50:16.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.793+0000 7fa3319b0700 1 -- start start 2020-06-12T17:50:16.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.793+0000 7fa3319b0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa32c0b15c0 0x7fa32c0b2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:16.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.793+0000 7fa3319b0700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa32c0b2900 con 0x7fa32c0b11e0 2020-06-12T17:50:16.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.793+0000 7fa3319b0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa32c0ae7d0 con 0x7fa32c0afc20 2020-06-12T17:50:16.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.794+0000 7fa3319b0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c0add30 con 0x7fa32c0b15c0 2020-06-12T17:50:16.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.794+0000 7fa3309ae700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa32c0b11e0 0x7fa32c0ae0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40408/0 (socket says 172.21.15.38:40408) 2020-06-12T17:50:16.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.794+0000 7fa3309ae700 1 -- 172.21.15.38:0/1574943665 learned_addr learned my addr 172.21.15.38:0/1574943665 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:16.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.794+0000 7fa32bfff700 1 --2- 172.21.15.38:0/1574943665 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa32c0b15c0 0x7fa32c0b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:16.807 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.794+0000 7fa32b7fe700 1 -- 172.21.15.38:0/1574943665 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1811398422 0 0) 0x7fa32c0b2900 con 0x7fa32c0b11e0 2020-06-12T17:50:16.807 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.794+0000 7fa32b7fe700 1 -- 172.21.15.38:0/1574943665 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa30c003230 con 0x7fa32c0b11e0 2020-06-12T17:50:16.808 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.794+0000 7fa32b7fe700 1 -- 172.21.15.38:0/1574943665 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2742457507 0 0) 0x7fa32c0ae7d0 con 0x7fa32c0afc20 2020-06-12T17:50:16.808 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.794+0000 7fa32b7fe700 1 -- 172.21.15.38:0/1574943665 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa32c0b2900 con 0x7fa32c0afc20 2020-06-12T17:50:16.810 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.794+0000 7fa32bfff700 1 -- 172.21.15.38:0/1574943665 >> v1:172.21.15.150:6789/0 conn(0x7fa32c0afc20 legacy=0x7fa32c0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:16.810 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.794+0000 7fa32b7fe700 1 -- 172.21.15.38:0/1574943665 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1420454938 0 0) 0x7fa30c003230 con 0x7fa32c0b11e0 2020-06-12T17:50:16.810 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.794+0000 7fa32bfff700 1 -- 172.21.15.38:0/1574943665 >> v1:172.21.15.38:6789/0 conn(0x7fa32c0b11e0 legacy=0x7fa32c0ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:16.810 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.794+0000 7fa32bfff700 1 -- 172.21.15.38:0/1574943665 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32c0b1ad0 con 0x7fa32c0b15c0 2020-06-12T17:50:16.811 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.794+0000 7fa32bfff700 1 --2- 172.21.15.38:0/1574943665 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa32c0b15c0 0x7fa32c0b2380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa3140010d0 tx=0x7fa31c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.812 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.794+0000 7fa32bfff700 1 --2- 172.21.15.38:0/1574943665 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa32c0b15c0 0x7fa32c0b2380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa3140010d0 tx=0x7fa31c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.813 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.794+0000 7fa32bfff700 1 --2- 172.21.15.38:0/1574943665 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa32c0b15c0 0x7fa32c0b2380 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7fa3140010d0 tx=0x7fa31c007e60).ready entity=mon.2 client_cookie=59ad434395825e98 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:16.813 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.794+0000 7fa32bfff700 1 --2- 172.21.15.38:0/1574943665 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa32c0b15c0 0x7fa32c0b2380 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fa3140010d0 tx=0x7fa31c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.813 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.794+0000 7fa32b7fe700 1 -- 172.21.15.38:0/1574943665 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3140016d0 con 0x7fa32c0b15c0 2020-06-12T17:50:16.813 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.795+0000 7fa32bfff700 1 --2- 172.21.15.38:0/1574943665 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa32c0b15c0 0x7fa32c0b2380 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fa3140010d0 tx=0x7fa31c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.814 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.795+0000 7fa32bfff700 1 --2- 172.21.15.38:0/1574943665 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa32c0b15c0 0x7fa32c0b2380 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fa3140010d0 tx=0x7fa31c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.814 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.795+0000 7fa32b7fe700 1 -- 172.21.15.38:0/1574943665 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31c008b40 con 0x7fa32c0b15c0 2020-06-12T17:50:16.814 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.795+0000 7fa32b7fe700 1 -- 172.21.15.38:0/1574943665 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa31c008ea0 con 0x7fa32c0b15c0 2020-06-12T17:50:16.814 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.795+0000 7fa3319b0700 1 -- 172.21.15.38:0/1574943665 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa32c0b15c0 msgr2=0x7fa32c0b2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:16.814 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.795+0000 7fa3319b0700 1 --2- 172.21.15.38:0/1574943665 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa32c0b15c0 0x7fa32c0b2380 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7fa3140010d0 tx=0x7fa31c007e60).stop 2020-06-12T17:50:16.815 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.795+0000 7fa3319b0700 1 -- 172.21.15.38:0/1574943665 shutdown_connections 2020-06-12T17:50:16.815 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.795+0000 7fa3319b0700 1 --2- 172.21.15.38:0/1574943665 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa32c0b15c0 0x7fa32c0b2380 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:16.815 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.795+0000 7fa3319b0700 1 -- 172.21.15.38:0/1574943665 >> 172.21.15.38:0/1574943665 conn(0x7fa32c0b4cc0 msgr2=0x7fa32c0b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:16.815 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.795+0000 7fa3319b0700 1 -- 172.21.15.38:0/1574943665 shutdown_connections 2020-06-12T17:50:16.815 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.795+0000 7fa3319b0700 1 -- 172.21.15.38:0/1574943665 wait complete. 2020-06-12T17:50:16.816 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.796+0000 7fa3319b0700 1 Processor -- start 2020-06-12T17:50:16.816 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.796+0000 7fa3319b0700 1 -- start start 2020-06-12T17:50:16.816 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.797+0000 7fa3319b0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa32c0b11e0 0x7fa32c1409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:16.816 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.797+0000 7fa3319b0700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa32c0b15c0 0x7fa32c1446b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:16.816 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.797+0000 7fa3319b0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa32c144e00 con 0x7fa32c0afc20 2020-06-12T17:50:16.817 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.797+0000 7fa3319b0700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa32c1450a0 con 0x7fa32c0b15c0 2020-06-12T17:50:16.817 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.797+0000 7fa3319b0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c145340 con 0x7fa32c0b11e0 2020-06-12T17:50:16.817 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.797+0000 7fa3311af700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa32c0b15c0 0x7fa32c1446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:16.817 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.797+0000 7fa3311af700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa32c0b15c0 0x7fa32c1446b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38602/0 (socket says 172.21.15.38:38602) 2020-06-12T17:50:16.817 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.797+0000 7fa3311af700 1 -- 172.21.15.38:0/2478570947 learned_addr learned my addr 172.21.15.38:0/2478570947 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:16.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.797+0000 7fa32bfff700 1 --2- 172.21.15.38:0/2478570947 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa32c0b11e0 0x7fa32c1409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:16.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.797+0000 7fa3311af700 1 -- 172.21.15.38:0/2478570947 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa32c0b11e0 msgr2=0x7fa32c1409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:16.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.797+0000 7fa3311af700 1 --2- 172.21.15.38:0/2478570947 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa32c0b11e0 0x7fa32c1409d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:16.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.797+0000 7fa3311af700 1 -- 172.21.15.38:0/2478570947 >> v1:172.21.15.150:6789/0 conn(0x7fa32c0afc20 legacy=0x7fa32c0ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:16.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.797+0000 7fa3311af700 1 -- 172.21.15.38:0/2478570947 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32c144b10 con 0x7fa32c0b15c0 2020-06-12T17:50:16.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.797+0000 7fa3311af700 1 --2- 172.21.15.38:0/2478570947 >> v2:172.21.15.38:3300/0 conn(0x7fa32c0b15c0 0x7fa32c1446b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa324001490 tx=0x7fa324002ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.797+0000 7fa3311af700 1 --2- 172.21.15.38:0/2478570947 >> v2:172.21.15.38:3300/0 conn(0x7fa32c0b15c0 0x7fa32c1446b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa324001490 tx=0x7fa324002ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.797+0000 7fa3311af700 1 --2- 172.21.15.38:0/2478570947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa32c0b15c0 0x7fa32c1446b0 secure :-1 s=READY pgs=640 cs=0 l=1 rx=0x7fa324001490 tx=0x7fa324002ba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:16.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.797+0000 7fa3311af700 1 --2- 172.21.15.38:0/2478570947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa32c0b15c0 0x7fa32c1446b0 secure :-1 s=THROTTLE_DONE pgs=640 cs=0 l=1 rx=0x7fa324001490 tx=0x7fa324002ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.798+0000 7fa3311af700 1 --2- 172.21.15.38:0/2478570947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa32c0b15c0 0x7fa32c1446b0 secure :-1 s=THROTTLE_DONE pgs=640 cs=0 l=1 rx=0x7fa324001490 tx=0x7fa324002ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.798+0000 7fa329ffb700 1 -- 172.21.15.38:0/2478570947 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa324012390 con 0x7fa32c0b15c0 2020-06-12T17:50:16.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.798+0000 7fa3311af700 1 --2- 172.21.15.38:0/2478570947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa32c0b15c0 0x7fa32c1446b0 secure :-1 s=THROTTLE_DONE pgs=640 cs=0 l=1 rx=0x7fa324001490 tx=0x7fa324002ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.798+0000 7fa329ffb700 1 -- 172.21.15.38:0/2478570947 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa324012530 con 0x7fa32c0b15c0 2020-06-12T17:50:16.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.798+0000 7fa329ffb700 1 -- 172.21.15.38:0/2478570947 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa324012950 con 0x7fa32c0b15c0 2020-06-12T17:50:16.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.798+0000 7fa3319b0700 1 -- 172.21.15.38:0/2478570947 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa32c0ad9c0 con 0x7fa32c0b15c0 2020-06-12T17:50:16.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.798+0000 7fa3319b0700 1 -- 172.21.15.38:0/2478570947 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32c1313e0 con 0x7fa32c0b15c0 2020-06-12T17:50:16.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.798+0000 7fa3311af700 1 --2- 172.21.15.38:0/2478570947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa32c0b15c0 0x7fa32c1446b0 secure :-1 s=THROTTLE_DONE pgs=640 cs=0 l=1 rx=0x7fa324001490 tx=0x7fa324002ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.799+0000 7fa3319b0700 1 -- 172.21.15.38:0/2478570947 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32c056c30 con 0x7fa32c0b15c0 2020-06-12T17:50:16.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.799+0000 7fa329ffb700 1 -- 172.21.15.38:0/2478570947 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fa324012bc0 con 0x7fa32c0b15c0 2020-06-12T17:50:16.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.799+0000 7fa3311af700 1 --2- 172.21.15.38:0/2478570947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa32c0b15c0 0x7fa32c1446b0 secure :-1 s=THROTTLE_DONE pgs=640 cs=0 l=1 rx=0x7fa324001490 tx=0x7fa324002ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.799+0000 7fa329ffb700 1 --2- 172.21.15.38:0/2478570947 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa31004d610 0x7fa31004fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:16.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.799+0000 7fa329ffb700 1 -- 172.21.15.38:0/2478570947 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa324061350 con 0x7fa32c0b15c0 2020-06-12T17:50:16.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.799+0000 7fa3309ae700 1 --2- 172.21.15.38:0/2478570947 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa31004d610 0x7fa31004fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:16.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.799+0000 7fa3309ae700 1 --2- 172.21.15.38:0/2478570947 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa31004d610 0x7fa31004fad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa32c13fdb0 tx=0x7fa3140011e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.799+0000 7fa3309ae700 1 --2- 172.21.15.38:0/2478570947 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa31004d610 0x7fa31004fad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa32c13fdb0 tx=0x7fa3140011e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.799+0000 7fa3309ae700 1 --2- 172.21.15.38:0/2478570947 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa31004d610 0x7fa31004fad0 secure :-1 s=READY pgs=253 cs=0 l=1 rx=0x7fa32c13fdb0 tx=0x7fa3140011e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:16.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.802+0000 7fa3311af700 1 --2- 172.21.15.38:0/2478570947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa32c0b15c0 0x7fa32c1446b0 secure :-1 s=THROTTLE_DONE pgs=640 cs=0 l=1 rx=0x7fa324001490 tx=0x7fa324002ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:16.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:16.802+0000 7fa329ffb700 1 -- 172.21.15.38:0/2478570947 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fa32403cb30 con 0x7fa32c0b15c0 2020-06-12T17:50:17.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:17.002+0000 7fa3319b0700 1 -- 172.21.15.38:0/2478570947 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_6318", "target": ["mon-mgr", ""]}) v1 -- 0x7fa32c0b8b80 con 0x7fa31004d610 2020-06-12T17:50:17.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:17.005+0000 7fa3309ae700 1 --2- 172.21.15.38:0/2478570947 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa31004d610 0x7fa31004fad0 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7fa32c13fdb0 tx=0x7fa3140011e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:17.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:17.005+0000 7fa329ffb700 1 -- 172.21.15.38:0/2478570947 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7fa32c0b8b80 con 0x7fa31004d610 2020-06-12T17:50:17.009 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_6318/097f1317-ad44-47e8-8315-0cebcd6a2e5b 2020-06-12T17:50:17.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:17.007+0000 7fa3319b0700 1 -- 172.21.15.38:0/2478570947 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa31004d610 msgr2=0x7fa31004fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:17.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:17.007+0000 7fa3319b0700 1 --2- 172.21.15.38:0/2478570947 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa31004d610 0x7fa31004fad0 secure :-1 s=READY pgs=253 cs=0 l=1 rx=0x7fa32c13fdb0 tx=0x7fa3140011e0).stop 2020-06-12T17:50:17.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:17.007+0000 7fa3319b0700 1 -- 172.21.15.38:0/2478570947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa32c0b15c0 msgr2=0x7fa32c1446b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:17.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:17.007+0000 7fa3319b0700 1 --2- 172.21.15.38:0/2478570947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa32c0b15c0 0x7fa32c1446b0 secure :-1 s=READY pgs=640 cs=0 l=1 rx=0x7fa324001490 tx=0x7fa324002ba0).stop 2020-06-12T17:50:17.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:17.007+0000 7fa3319b0700 1 -- 172.21.15.38:0/2478570947 shutdown_connections 2020-06-12T17:50:17.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:17.007+0000 7fa3319b0700 1 --2- 172.21.15.38:0/2478570947 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa31004d610 0x7fa31004fad0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:17.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:17.007+0000 7fa3319b0700 1 --2- 172.21.15.38:0/2478570947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa32c0b15c0 0x7fa32c1446b0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:17.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:17.007+0000 7fa3319b0700 1 --2- 172.21.15.38:0/2478570947 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa32c0b11e0 0x7fa32c1409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:17.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:17.007+0000 7fa3319b0700 1 -- 172.21.15.38:0/2478570947 >> 172.21.15.38:0/2478570947 conn(0x7fa32c0b4cc0 msgr2=0x7fa32c0b8200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:17.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:17.007+0000 7fa3319b0700 1 -- 172.21.15.38:0/2478570947 shutdown_connections 2020-06-12T17:50:17.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:17.007+0000 7fa3319b0700 1 -- 172.21.15.38:0/2478570947 wait complete. 2020-06-12T17:50:17.020 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_6318 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_6318/097f1317-ad44-47e8-8315-0cebcd6a2e5b 2020-06-12T17:50:17.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:17.021 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:17.022 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:17.037 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:17.038 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:17.039 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6318/097f1317-ad44-47e8-8315-0cebcd6a2e5b/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:17.128 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:17.129 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:17.129 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00919078 s, 114 MB/s 2020-06-12T17:50:17.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:17.131 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:17.131 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:17.146 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:17.146 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:17.147 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6318/097f1317-ad44-47e8-8315-0cebcd6a2e5b/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:17.234 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:17.234 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:17.234 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111021 s, 94.4 MB/s 2020-06-12T17:50:17.235 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:17.236 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:17.236 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:17.290 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:17.291 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:17.291 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6318/097f1317-ad44-47e8-8315-0cebcd6a2e5b/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:17.379 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:17.380 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:17.380 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129437 s, 81.0 MB/s 2020-06-12T17:50:17.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:17.382 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:17.382 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:17.397 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:17.398 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:17.398 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6318/097f1317-ad44-47e8-8315-0cebcd6a2e5b/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:17.485 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:17.486 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:17.486 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111645 s, 93.9 MB/s 2020-06-12T17:50:17.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:17.487 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:17.488 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:17.503 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:17.503 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:17.504 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6318/097f1317-ad44-47e8-8315-0cebcd6a2e5b/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:17.592 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:17.593 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:17.593 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123673 s, 84.8 MB/s 2020-06-12T17:50:17.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:17.595 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:17.595 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:17.610 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:17.610 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:17.611 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6318/097f1317-ad44-47e8-8315-0cebcd6a2e5b/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:17.695 INFO:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-06-12T17:50:17.696 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:17.697 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:17.697 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00982993 s, 107 MB/s 2020-06-12T17:50:17.698 INFO:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-06-12T17:50:17.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:17.699 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:17.700 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:17.752 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:17.753 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:17.754 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6318/097f1317-ad44-47e8-8315-0cebcd6a2e5b/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:17.841 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:17.841 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:17.842 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010184 s, 103 MB/s 2020-06-12T17:50:17.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:17.844 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:17.844 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:17.859 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:17.860 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:17.860 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6318/097f1317-ad44-47e8-8315-0cebcd6a2e5b/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:17.948 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:17.948 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:17.949 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110436 s, 94.9 MB/s 2020-06-12T17:50:17.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:17.950 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:17.951 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:18.004 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:18.004 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:18.005 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6318/097f1317-ad44-47e8-8315-0cebcd6a2e5b/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:18.096 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:18.097 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:18.097 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133684 s, 78.4 MB/s 2020-06-12T17:50:18.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:18.099 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:18.099 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:18.114 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:18.114 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:18.115 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6318/097f1317-ad44-47e8-8315-0cebcd6a2e5b/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:18.203 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:18.203 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:18.204 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117907 s, 88.9 MB/s 2020-06-12T17:50:18.205 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_628 2020-06-12T17:50:18.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.318+0000 7f8cb1074700 1 Processor -- start 2020-06-12T17:50:18.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.318+0000 7f8cb1074700 1 -- start start 2020-06-12T17:50:18.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.319+0000 7f8cb1074700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8cac0ad5b0 0x7f8cac0b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:18.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.319+0000 7f8cb1074700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8cac09d8d0 0x7f8cac1421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:18.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.319+0000 7f8cb1074700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cac146d20 con 0x7f8cac146680 2020-06-12T17:50:18.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.319+0000 7f8cb1074700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cac066a80 con 0x7f8cac09d8d0 2020-06-12T17:50:18.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.319+0000 7f8cb1074700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac146f50 con 0x7f8cac0ad5b0 2020-06-12T17:50:18.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.320+0000 7f8cab59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8cac09d8d0 0x7f8cac1421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:18.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.320+0000 7f8cab59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8cac09d8d0 0x7f8cac1421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:48082/0 (socket says 172.21.15.38:48082) 2020-06-12T17:50:18.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.320+0000 7f8caad9d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f8cac146680 0x7f8cac09d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:32922/0 (socket says 172.21.15.38:32922) 2020-06-12T17:50:18.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.320+0000 7f8cab59e700 1 -- 172.21.15.38:0/3567320013 learned_addr learned my addr 172.21.15.38:0/3567320013 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:18.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.320+0000 7f8caa59c700 1 --2- 172.21.15.38:0/3567320013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8cac0ad5b0 0x7f8cac0b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:18.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.320+0000 7f8cab59e700 1 -- 172.21.15.38:0/3567320013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8cac0ad5b0 msgr2=0x7f8cac0b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:18.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.320+0000 7f8cab59e700 1 --2- 172.21.15.38:0/3567320013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8cac0ad5b0 0x7f8cac0b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:18.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.320+0000 7f8cab59e700 1 -- 172.21.15.38:0/3567320013 >> v1:172.21.15.150:6789/0 conn(0x7f8cac146680 legacy=0x7f8cac09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:18.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.320+0000 7f8ca9d9b700 1 -- 172.21.15.38:0/3567320013 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092236374 0 0) 0x7f8cac146d20 con 0x7f8cac146680 2020-06-12T17:50:18.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.320+0000 7f8cab59e700 1 -- 172.21.15.38:0/3567320013 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac146a60 con 0x7f8cac09d8d0 2020-06-12T17:50:18.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.320+0000 7f8cab59e700 1 --2- 172.21.15.38:0/3567320013 >> v2:172.21.15.150:3300/0 conn(0x7f8cac09d8d0 0x7f8cac1421d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8ca4002f30 tx=0x7f8ca4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.320+0000 7f8cab59e700 1 --2- 172.21.15.38:0/3567320013 >> v2:172.21.15.150:3300/0 conn(0x7f8cac09d8d0 0x7f8cac1421d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8ca4002f30 tx=0x7f8ca4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.320+0000 7f8cab59e700 1 --2- 172.21.15.38:0/3567320013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cac09d8d0 0x7f8cac1421d0 secure :-1 s=READY pgs=380 cs=0 l=1 rx=0x7f8ca4002f30 tx=0x7f8ca4007e60).ready entity=mon.1 client_cookie=dff000660b980753 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:18.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.321+0000 7f8cab59e700 1 --2- 172.21.15.38:0/3567320013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cac09d8d0 0x7f8cac1421d0 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f8ca4002f30 tx=0x7f8ca4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.321+0000 7f8ca9d9b700 1 -- 172.21.15.38:0/3567320013 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ca4011630 con 0x7f8cac09d8d0 2020-06-12T17:50:18.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.321+0000 7f8cab59e700 1 --2- 172.21.15.38:0/3567320013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cac09d8d0 0x7f8cac1421d0 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f8ca4002f30 tx=0x7f8ca4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.321+0000 7f8ca9d9b700 1 -- 172.21.15.38:0/3567320013 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca4011790 con 0x7f8cac09d8d0 2020-06-12T17:50:18.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.321+0000 7f8cab59e700 1 --2- 172.21.15.38:0/3567320013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cac09d8d0 0x7f8cac1421d0 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f8ca4002f30 tx=0x7f8ca4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.321+0000 7f8ca9d9b700 1 -- 172.21.15.38:0/3567320013 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ca4011b70 con 0x7f8cac09d8d0 2020-06-12T17:50:18.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.321+0000 7f8cb1074700 1 -- 172.21.15.38:0/3567320013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cac09d8d0 msgr2=0x7f8cac1421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:18.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.321+0000 7f8cb1074700 1 --2- 172.21.15.38:0/3567320013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cac09d8d0 0x7f8cac1421d0 secure :-1 s=READY pgs=380 cs=0 l=1 rx=0x7f8ca4002f30 tx=0x7f8ca4007e60).stop 2020-06-12T17:50:18.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.321+0000 7f8cb1074700 1 -- 172.21.15.38:0/3567320013 shutdown_connections 2020-06-12T17:50:18.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.321+0000 7f8cb1074700 1 --2- 172.21.15.38:0/3567320013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cac09d8d0 0x7f8cac1421d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:18.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.321+0000 7f8cb1074700 1 --2- 172.21.15.38:0/3567320013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8cac0ad5b0 0x7f8cac0b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:18.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.321+0000 7f8cb1074700 1 -- 172.21.15.38:0/3567320013 >> 172.21.15.38:0/3567320013 conn(0x7f8cac0b5a20 msgr2=0x7f8cac05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:18.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.321+0000 7f8cb1074700 1 -- 172.21.15.38:0/3567320013 shutdown_connections 2020-06-12T17:50:18.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.321+0000 7f8cb1074700 1 -- 172.21.15.38:0/3567320013 wait complete. 2020-06-12T17:50:18.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.322+0000 7f8cb1074700 1 Processor -- start 2020-06-12T17:50:18.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.322+0000 7f8cb1074700 1 -- start start 2020-06-12T17:50:18.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.323+0000 7f8cb1074700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8cac09d8d0 0x7f8cac0b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:18.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.323+0000 7f8cb1074700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8cac146680 0x7f8cac0aec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:18.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.323+0000 7f8cb1074700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cac0b3f20 con 0x7f8cac0ad5b0 2020-06-12T17:50:18.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.323+0000 7f8cb1074700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cac0afd70 con 0x7f8cac09d8d0 2020-06-12T17:50:18.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.323+0000 7f8cb1074700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac0af060 con 0x7f8cac146680 2020-06-12T17:50:18.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.323+0000 7f8caa59c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8cac0ad5b0 0x7f8cac154860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40430/0 (socket says 172.21.15.38:40430) 2020-06-12T17:50:18.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.323+0000 7f8caa59c700 1 -- 172.21.15.38:0/1206419662 learned_addr learned my addr 172.21.15.38:0/1206419662 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:18.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.323+0000 7f8cab59e700 1 --2- 172.21.15.38:0/1206419662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8cac146680 0x7f8cac0aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:18.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.323+0000 7f8caad9d700 1 --2- 172.21.15.38:0/1206419662 >> v2:172.21.15.150:3300/0 conn(0x7f8cac09d8d0 0x7f8cac0b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:18.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.323+0000 7f8ca3fff700 1 -- 172.21.15.38:0/1206419662 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607768493 0 0) 0x7f8c9c002240 con 0x7f8cac0ad5b0 2020-06-12T17:50:18.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.323+0000 7f8ca3fff700 1 -- 172.21.15.38:0/1206419662 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c90002fe0 con 0x7f8cac0ad5b0 2020-06-12T17:50:18.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.323+0000 7f8cab59e700 1 -- 172.21.15.38:0/1206419662 >> v2:172.21.15.150:3300/0 conn(0x7f8cac09d8d0 msgr2=0x7f8cac0b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:18.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.323+0000 7f8cab59e700 1 --2- 172.21.15.38:0/1206419662 >> v2:172.21.15.150:3300/0 conn(0x7f8cac09d8d0 0x7f8cac0b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:18.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.323+0000 7f8cab59e700 1 -- 172.21.15.38:0/1206419662 >> v1:172.21.15.38:6789/0 conn(0x7f8cac0ad5b0 legacy=0x7f8cac154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:18.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.323+0000 7f8ca3fff700 1 -- 172.21.15.38:0/1206419662 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2849369041 0 0) 0x7f8c90002fe0 con 0x7f8cac0ad5b0 2020-06-12T17:50:18.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.323+0000 7f8cab59e700 1 -- 172.21.15.38:0/1206419662 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac1556b0 con 0x7f8cac146680 2020-06-12T17:50:18.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.323+0000 7f8caad9d700 1 --2- 172.21.15.38:0/1206419662 >> v2:172.21.15.150:3300/0 conn(0x7f8cac09d8d0 0x7f8cac0b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:50:18.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.324+0000 7f8cab59e700 1 --2- 172.21.15.38:0/1206419662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8cac146680 0x7f8cac0aec00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8c9c002bb0 tx=0x7f8ca4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.324+0000 7f8cab59e700 1 --2- 172.21.15.38:0/1206419662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8cac146680 0x7f8cac0aec00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8c9c002bb0 tx=0x7f8ca4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.324+0000 7f8cab59e700 1 --2- 172.21.15.38:0/1206419662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8cac146680 0x7f8cac0aec00 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f8c9c002bb0 tx=0x7f8ca4007e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:18.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.324+0000 7f8cab59e700 1 --2- 172.21.15.38:0/1206419662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8cac146680 0x7f8cac0aec00 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f8c9c002bb0 tx=0x7f8ca4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.354 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.324+0000 7f8ca3fff700 1 -- 172.21.15.38:0/1206419662 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c9c002a10 con 0x7f8cac146680 2020-06-12T17:50:18.354 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.324+0000 7f8cab59e700 1 --2- 172.21.15.38:0/1206419662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8cac146680 0x7f8cac0aec00 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f8c9c002bb0 tx=0x7f8ca4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.354 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.324+0000 7f8ca3fff700 1 -- 172.21.15.38:0/1206419662 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca4007150 con 0x7f8cac146680 2020-06-12T17:50:18.355 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.324+0000 7f8cab59e700 1 --2- 172.21.15.38:0/1206419662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8cac146680 0x7f8cac0aec00 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f8c9c002bb0 tx=0x7f8ca4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.355 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.324+0000 7f8cb1074700 1 -- 172.21.15.38:0/1206419662 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cac155170 con 0x7f8cac146680 2020-06-12T17:50:18.355 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.324+0000 7f8ca3fff700 1 -- 172.21.15.38:0/1206419662 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ca40074b0 con 0x7f8cac146680 2020-06-12T17:50:18.356 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.324+0000 7f8cb1074700 1 -- 172.21.15.38:0/1206419662 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cac0b03b0 con 0x7f8cac146680 2020-06-12T17:50:18.356 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.325+0000 7f8cab59e700 1 --2- 172.21.15.38:0/1206419662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8cac146680 0x7f8cac0aec00 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f8c9c002bb0 tx=0x7f8ca4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.356 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.325+0000 7f8cb1074700 1 -- 172.21.15.38:0/1206419662 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cac067b20 con 0x7f8cac146680 2020-06-12T17:50:18.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.325+0000 7f8ca3fff700 1 -- 172.21.15.38:0/1206419662 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f8ca4011650 con 0x7f8cac146680 2020-06-12T17:50:18.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.325+0000 7f8cab59e700 1 --2- 172.21.15.38:0/1206419662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8cac146680 0x7f8cac0aec00 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f8c9c002bb0 tx=0x7f8ca4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.325+0000 7f8ca3fff700 1 --2- 172.21.15.38:0/1206419662 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8c9004d850 0x7f8c9004fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:18.358 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.325+0000 7f8ca3fff700 1 -- 172.21.15.38:0/1206419662 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8ca4060d80 con 0x7f8cac146680 2020-06-12T17:50:18.358 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.326+0000 7f8caad9d700 1 --2- 172.21.15.38:0/1206419662 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8c9004d850 0x7f8c9004fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:18.358 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.326+0000 7f8caad9d700 1 --2- 172.21.15.38:0/1206419662 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8c9004d850 0x7f8c9004fd10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8c94000b80 tx=0x7f8c940016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.326+0000 7f8caad9d700 1 --2- 172.21.15.38:0/1206419662 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8c9004d850 0x7f8c9004fd10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8c94000b80 tx=0x7f8c940016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.326+0000 7f8caad9d700 1 --2- 172.21.15.38:0/1206419662 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8c9004d850 0x7f8c9004fd10 secure :-1 s=READY pgs=254 cs=0 l=1 rx=0x7f8c94000b80 tx=0x7f8c940016e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:18.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.329+0000 7f8cab59e700 1 --2- 172.21.15.38:0/1206419662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8cac146680 0x7f8cac0aec00 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f8c9c002bb0 tx=0x7f8ca4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.329+0000 7f8ca3fff700 1 -- 172.21.15.38:0/1206419662 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f8ca403c5a0 con 0x7f8cac146680 2020-06-12T17:50:18.528 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.524+0000 7f8cb1074700 1 -- 172.21.15.38:0/1206419662 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_628", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cac056c30 con 0x7f8c9004d850 2020-06-12T17:50:18.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.543+0000 7f8caad9d700 1 --2- 172.21.15.38:0/1206419662 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8c9004d850 0x7f8c9004fd10 secure :-1 s=THROTTLE_DONE pgs=254 cs=0 l=1 rx=0x7f8c94000b80 tx=0x7f8c940016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.543+0000 7f8ca3fff700 1 -- 172.21.15.38:0/1206419662 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8cac056c30 con 0x7f8c9004d850 2020-06-12T17:50:18.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.545+0000 7f8cb1074700 1 -- 172.21.15.38:0/1206419662 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8c9004d850 msgr2=0x7f8c9004fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:18.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.545+0000 7f8cb1074700 1 --2- 172.21.15.38:0/1206419662 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8c9004d850 0x7f8c9004fd10 secure :-1 s=READY pgs=254 cs=0 l=1 rx=0x7f8c94000b80 tx=0x7f8c940016e0).stop 2020-06-12T17:50:18.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.545+0000 7f8cb1074700 1 -- 172.21.15.38:0/1206419662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8cac146680 msgr2=0x7f8cac0aec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:18.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.545+0000 7f8cb1074700 1 --2- 172.21.15.38:0/1206419662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8cac146680 0x7f8cac0aec00 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f8c9c002bb0 tx=0x7f8ca4007e60).stop 2020-06-12T17:50:18.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.545+0000 7f8cb1074700 1 -- 172.21.15.38:0/1206419662 shutdown_connections 2020-06-12T17:50:18.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.545+0000 7f8cb1074700 1 --2- 172.21.15.38:0/1206419662 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8c9004d850 0x7f8c9004fd10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:18.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.545+0000 7f8cb1074700 1 --2- 172.21.15.38:0/1206419662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8cac146680 0x7f8cac0aec00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:18.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.545+0000 7f8cb1074700 1 --2- 172.21.15.38:0/1206419662 >> v2:172.21.15.150:3300/0 conn(0x7f8cac09d8d0 0x7f8cac0b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:18.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.545+0000 7f8cb1074700 1 -- 172.21.15.38:0/1206419662 >> 172.21.15.38:0/1206419662 conn(0x7f8cac0b5a20 msgr2=0x7f8cac144ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:18.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.545+0000 7f8cb1074700 1 -- 172.21.15.38:0/1206419662 shutdown_connections 2020-06-12T17:50:18.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.545+0000 7f8cb1074700 1 -- 172.21.15.38:0/1206419662 wait complete. 2020-06-12T17:50:18.558 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_628 2020-06-12T17:50:18.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.672+0000 7f0609f47700 1 Processor -- start 2020-06-12T17:50:18.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.672+0000 7f0609f47700 1 -- start start 2020-06-12T17:50:18.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.673+0000 7f0609f47700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0604146680 0x7f06040ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:18.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.673+0000 7f0609f47700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f060409d8d0 0x7f06041421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:18.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.673+0000 7f0609f47700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0604146d20 con 0x7f06040b2eb0 2020-06-12T17:50:18.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.673+0000 7f0609f47700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0604066a80 con 0x7f0604146680 2020-06-12T17:50:18.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.673+0000 7f0609f47700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0604146f50 con 0x7f060409d8d0 2020-06-12T17:50:18.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.673+0000 7f06037fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0604146680 0x7f06040ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:18.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.673+0000 7f0602ffd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f06040b2eb0 0x7f060409d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40440/0 (socket says 172.21.15.38:40440) 2020-06-12T17:50:18.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.673+0000 7f0602ffd700 1 -- 172.21.15.38:0/2409234308 learned_addr learned my addr 172.21.15.38:0/2409234308 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:18.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.674+0000 7f06037fe700 1 -- 172.21.15.38:0/2409234308 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f060409d8d0 msgr2=0x7f06041421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:18.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.674+0000 7f0603fff700 1 --2- 172.21.15.38:0/2409234308 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f060409d8d0 0x7f06041421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:18.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.674+0000 7f06027fc700 1 -- 172.21.15.38:0/2409234308 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3118951805 0 0) 0x7f0604146d20 con 0x7f06040b2eb0 2020-06-12T17:50:18.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.674+0000 7f06037fe700 1 --2- 172.21.15.38:0/2409234308 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f060409d8d0 0x7f06041421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:18.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.674+0000 7f06037fe700 1 -- 172.21.15.38:0/2409234308 >> v1:172.21.15.38:6789/0 conn(0x7f06040b2eb0 legacy=0x7f060409d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:18.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.674+0000 7f06037fe700 1 -- 172.21.15.38:0/2409234308 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0604146a60 con 0x7f0604146680 2020-06-12T17:50:18.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.674+0000 7f06037fe700 1 --2- 172.21.15.38:0/2409234308 >> v2:172.21.15.38:3300/0 conn(0x7f0604146680 0x7f06040ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f05f4002f30 tx=0x7f05f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.674+0000 7f06037fe700 1 --2- 172.21.15.38:0/2409234308 >> v2:172.21.15.38:3300/0 conn(0x7f0604146680 0x7f06040ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f05f4002f30 tx=0x7f05f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.674+0000 7f06037fe700 1 --2- 172.21.15.38:0/2409234308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0604146680 0x7f06040ad5b0 secure :-1 s=READY pgs=643 cs=0 l=1 rx=0x7f05f4002f30 tx=0x7f05f4007e60).ready entity=mon.0 client_cookie=8c0b769459009f9f server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:18.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.674+0000 7f06037fe700 1 --2- 172.21.15.38:0/2409234308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0604146680 0x7f06040ad5b0 secure :-1 s=THROTTLE_DONE pgs=643 cs=0 l=1 rx=0x7f05f4002f30 tx=0x7f05f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.674+0000 7f06037fe700 1 --2- 172.21.15.38:0/2409234308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0604146680 0x7f06040ad5b0 secure :-1 s=THROTTLE_DONE pgs=643 cs=0 l=1 rx=0x7f05f4002f30 tx=0x7f05f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.674+0000 7f06027fc700 1 -- 172.21.15.38:0/2409234308 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05f4011430 con 0x7f0604146680 2020-06-12T17:50:18.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.674+0000 7f06037fe700 1 --2- 172.21.15.38:0/2409234308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0604146680 0x7f06040ad5b0 secure :-1 s=THROTTLE_DONE pgs=643 cs=0 l=1 rx=0x7f05f4002f30 tx=0x7f05f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.674+0000 7f06027fc700 1 -- 172.21.15.38:0/2409234308 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f4011590 con 0x7f0604146680 2020-06-12T17:50:18.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.674+0000 7f06027fc700 1 -- 172.21.15.38:0/2409234308 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05f4011970 con 0x7f0604146680 2020-06-12T17:50:18.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.674+0000 7f0609f47700 1 -- 172.21.15.38:0/2409234308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0604146680 msgr2=0x7f06040ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:18.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.674+0000 7f0609f47700 1 --2- 172.21.15.38:0/2409234308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0604146680 0x7f06040ad5b0 secure :-1 s=READY pgs=643 cs=0 l=1 rx=0x7f05f4002f30 tx=0x7f05f4007e60).stop 2020-06-12T17:50:18.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.674+0000 7f0609f47700 1 -- 172.21.15.38:0/2409234308 shutdown_connections 2020-06-12T17:50:18.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.674+0000 7f0609f47700 1 --2- 172.21.15.38:0/2409234308 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f060409d8d0 0x7f06041421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:18.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.674+0000 7f0609f47700 1 --2- 172.21.15.38:0/2409234308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0604146680 0x7f06040ad5b0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:18.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.674+0000 7f0609f47700 1 -- 172.21.15.38:0/2409234308 >> 172.21.15.38:0/2409234308 conn(0x7f06040b5a20 msgr2=0x7f060405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:18.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.675+0000 7f0609f47700 1 -- 172.21.15.38:0/2409234308 shutdown_connections 2020-06-12T17:50:18.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.675+0000 7f0609f47700 1 -- 172.21.15.38:0/2409234308 wait complete. 2020-06-12T17:50:18.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.676+0000 7f0609f47700 1 Processor -- start 2020-06-12T17:50:18.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.676+0000 7f0609f47700 1 -- start start 2020-06-12T17:50:18.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.676+0000 7f0609f47700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f060409d8d0 0x7f0604063810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:18.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.676+0000 7f0609f47700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f06040b2eb0 0x7f0604063ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:18.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.676+0000 7f0609f47700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06040b1110 con 0x7f0604146680 2020-06-12T17:50:18.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.676+0000 7f0609f47700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06040b13b0 con 0x7f06040b2eb0 2020-06-12T17:50:18.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.676+0000 7f0609f47700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06040b1650 con 0x7f060409d8d0 2020-06-12T17:50:18.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.676+0000 7f0602ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f06040b2eb0 0x7f0604063ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:18.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.677+0000 7f0602ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f06040b2eb0 0x7f0604063ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38628/0 (socket says 172.21.15.38:38628) 2020-06-12T17:50:18.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.677+0000 7f0602ffd700 1 -- 172.21.15.38:0/2208595183 learned_addr learned my addr 172.21.15.38:0/2208595183 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:18.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.677+0000 7f06037fe700 1 --2- 172.21.15.38:0/2208595183 >> v2:172.21.15.150:3300/0 conn(0x7f060409d8d0 0x7f0604063810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:18.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.677+0000 7f0602ffd700 1 -- 172.21.15.38:0/2208595183 >> v2:172.21.15.150:3300/0 conn(0x7f060409d8d0 msgr2=0x7f0604063810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:18.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.677+0000 7f0602ffd700 1 --2- 172.21.15.38:0/2208595183 >> v2:172.21.15.150:3300/0 conn(0x7f060409d8d0 0x7f0604063810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:18.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.677+0000 7f0602ffd700 1 -- 172.21.15.38:0/2208595183 >> v1:172.21.15.150:6789/0 conn(0x7f0604146680 legacy=0x7f060413a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:18.692 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.677+0000 7f0602ffd700 1 -- 172.21.15.38:0/2208595183 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0604064790 con 0x7f06040b2eb0 2020-06-12T17:50:18.692 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.677+0000 7f0602ffd700 1 --2- 172.21.15.38:0/2208595183 >> v2:172.21.15.38:3300/0 conn(0x7f06040b2eb0 0x7f0604063ec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0604063330 tx=0x7f05f80017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.692 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.677+0000 7f0602ffd700 1 --2- 172.21.15.38:0/2208595183 >> v2:172.21.15.38:3300/0 conn(0x7f06040b2eb0 0x7f0604063ec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0604063330 tx=0x7f05f80017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.692 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.677+0000 7f0602ffd700 1 --2- 172.21.15.38:0/2208595183 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06040b2eb0 0x7f0604063ec0 secure :-1 s=READY pgs=644 cs=0 l=1 rx=0x7f0604063330 tx=0x7f05f80017a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:18.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.677+0000 7f0602ffd700 1 --2- 172.21.15.38:0/2208595183 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06040b2eb0 0x7f0604063ec0 secure :-1 s=THROTTLE_DONE pgs=644 cs=0 l=1 rx=0x7f0604063330 tx=0x7f05f80017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.677+0000 7f0600ff9700 1 -- 172.21.15.38:0/2208595183 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05f800ca40 con 0x7f06040b2eb0 2020-06-12T17:50:18.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.677+0000 7f0602ffd700 1 --2- 172.21.15.38:0/2208595183 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06040b2eb0 0x7f0604063ec0 secure :-1 s=THROTTLE_DONE pgs=644 cs=0 l=1 rx=0x7f0604063330 tx=0x7f05f80017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.677+0000 7f0602ffd700 1 --2- 172.21.15.38:0/2208595183 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06040b2eb0 0x7f0604063ec0 secure :-1 s=THROTTLE_DONE pgs=644 cs=0 l=1 rx=0x7f0604063330 tx=0x7f05f80017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.677+0000 7f0600ff9700 1 -- 172.21.15.38:0/2208595183 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f800cba0 con 0x7f06040b2eb0 2020-06-12T17:50:18.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.677+0000 7f0609f47700 1 -- 172.21.15.38:0/2208595183 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0604061a70 con 0x7f06040b2eb0 2020-06-12T17:50:18.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.677+0000 7f0600ff9700 1 -- 172.21.15.38:0/2208595183 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05f800d0c0 con 0x7f06040b2eb0 2020-06-12T17:50:18.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.677+0000 7f0609f47700 1 -- 172.21.15.38:0/2208595183 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0604064560 con 0x7f06040b2eb0 2020-06-12T17:50:18.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.678+0000 7f0602ffd700 1 --2- 172.21.15.38:0/2208595183 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06040b2eb0 0x7f0604063ec0 secure :-1 s=THROTTLE_DONE pgs=644 cs=0 l=1 rx=0x7f0604063330 tx=0x7f05f80017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.678+0000 7f0609f47700 1 -- 172.21.15.38:0/2208595183 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0604056c30 con 0x7f06040b2eb0 2020-06-12T17:50:18.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.678+0000 7f0600ff9700 1 -- 172.21.15.38:0/2208595183 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f05f80055c0 con 0x7f06040b2eb0 2020-06-12T17:50:18.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.678+0000 7f0602ffd700 1 --2- 172.21.15.38:0/2208595183 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06040b2eb0 0x7f0604063ec0 secure :-1 s=THROTTLE_DONE pgs=644 cs=0 l=1 rx=0x7f0604063330 tx=0x7f05f80017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.679+0000 7f0600ff9700 1 --2- 172.21.15.38:0/2208595183 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f05e404d5b0 0x7f05e404fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:18.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.679+0000 7f0600ff9700 1 -- 172.21.15.38:0/2208595183 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f05f8060980 con 0x7f06040b2eb0 2020-06-12T17:50:18.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.679+0000 7f06037fe700 1 --2- 172.21.15.38:0/2208595183 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f05e404d5b0 0x7f05e404fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:18.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.679+0000 7f06037fe700 1 --2- 172.21.15.38:0/2208595183 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f05e404d5b0 0x7f05e404fa70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f05f4002f30 tx=0x7f05f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.679+0000 7f06037fe700 1 --2- 172.21.15.38:0/2208595183 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f05e404d5b0 0x7f05e404fa70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f05f4002f30 tx=0x7f05f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.679+0000 7f06037fe700 1 --2- 172.21.15.38:0/2208595183 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f05e404d5b0 0x7f05e404fa70 secure :-1 s=READY pgs=255 cs=0 l=1 rx=0x7f05f4002f30 tx=0x7f05f4007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:18.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.682+0000 7f0602ffd700 1 --2- 172.21.15.38:0/2208595183 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06040b2eb0 0x7f0604063ec0 secure :-1 s=THROTTLE_DONE pgs=644 cs=0 l=1 rx=0x7f0604063330 tx=0x7f05f80017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.682+0000 7f0600ff9700 1 -- 172.21.15.38:0/2208595183 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f05f803c100 con 0x7f06040b2eb0 2020-06-12T17:50:18.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.878+0000 7f0609f47700 1 -- 172.21.15.38:0/2208595183 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_628", "target": ["mon-mgr", ""]}) v1 -- 0x7f060413aee0 con 0x7f05e404d5b0 2020-06-12T17:50:18.884 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.881+0000 7f06037fe700 1 --2- 172.21.15.38:0/2208595183 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f05e404d5b0 0x7f05e404fa70 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7f05f4002f30 tx=0x7f05f4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:18.884 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.881+0000 7f0600ff9700 1 -- 172.21.15.38:0/2208595183 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+69 (secure 0 0 0) 0x7f05f4008660 con 0x7f05e404d5b0 2020-06-12T17:50:18.885 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_628/760ebccd-ccdb-4928-a7be-6650c4215abc 2020-06-12T17:50:18.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.882+0000 7f0609f47700 1 -- 172.21.15.38:0/2208595183 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f05e404d5b0 msgr2=0x7f05e404fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:18.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.882+0000 7f0609f47700 1 --2- 172.21.15.38:0/2208595183 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f05e404d5b0 0x7f05e404fa70 secure :-1 s=READY pgs=255 cs=0 l=1 rx=0x7f05f4002f30 tx=0x7f05f4007e60).stop 2020-06-12T17:50:18.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.882+0000 7f0609f47700 1 -- 172.21.15.38:0/2208595183 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06040b2eb0 msgr2=0x7f0604063ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:18.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.882+0000 7f0609f47700 1 --2- 172.21.15.38:0/2208595183 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06040b2eb0 0x7f0604063ec0 secure :-1 s=READY pgs=644 cs=0 l=1 rx=0x7f0604063330 tx=0x7f05f80017a0).stop 2020-06-12T17:50:18.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.882+0000 7f0609f47700 1 -- 172.21.15.38:0/2208595183 shutdown_connections 2020-06-12T17:50:18.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.882+0000 7f0609f47700 1 --2- 172.21.15.38:0/2208595183 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f05e404d5b0 0x7f05e404fa70 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:18.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.882+0000 7f0609f47700 1 --2- 172.21.15.38:0/2208595183 >> v2:172.21.15.150:3300/0 conn(0x7f060409d8d0 0x7f0604063810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:18.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.882+0000 7f0609f47700 1 --2- 172.21.15.38:0/2208595183 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06040b2eb0 0x7f0604063ec0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:18.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.882+0000 7f0609f47700 1 -- 172.21.15.38:0/2208595183 >> 172.21.15.38:0/2208595183 conn(0x7f06040b5a20 msgr2=0x7f06040b7210 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:18.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.882+0000 7f0609f47700 1 -- 172.21.15.38:0/2208595183 shutdown_connections 2020-06-12T17:50:18.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:18.882+0000 7f0609f47700 1 -- 172.21.15.38:0/2208595183 wait complete. 2020-06-12T17:50:18.896 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_628 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_628/760ebccd-ccdb-4928-a7be-6650c4215abc 2020-06-12T17:50:18.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:18.897 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:18.897 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:18.920 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:18.920 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:18.921 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_628/760ebccd-ccdb-4928-a7be-6650c4215abc/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:19.029 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:19.029 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:19.029 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144136 s, 72.7 MB/s 2020-06-12T17:50:19.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:19.031 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:19.031 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:19.064 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:19.064 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:19.065 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_628/760ebccd-ccdb-4928-a7be-6650c4215abc/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:19.183 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:19.184 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:19.184 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128308 s, 81.7 MB/s 2020-06-12T17:50:19.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:19.186 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:19.186 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:19.256 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:19.256 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:19.257 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_628/760ebccd-ccdb-4928-a7be-6650c4215abc/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:19.360 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:19.360 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:19.360 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103155 s, 102 MB/s 2020-06-12T17:50:19.361 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:19.362 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:19.362 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:19.426 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:19.427 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:19.427 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_628/760ebccd-ccdb-4928-a7be-6650c4215abc/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:19.523 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:19.523 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:19.523 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106757 s, 98.2 MB/s 2020-06-12T17:50:19.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:19.524 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:19.525 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:19.543 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:19.544 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:19.544 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_628/760ebccd-ccdb-4928-a7be-6650c4215abc/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:19.632 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:19.632 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:19.632 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927398 s, 113 MB/s 2020-06-12T17:50:19.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:19.635 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:19.635 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:19.652 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:19.652 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:19.653 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_628/760ebccd-ccdb-4928-a7be-6650c4215abc/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:19.744 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:19.744 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:19.745 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139057 s, 75.4 MB/s 2020-06-12T17:50:19.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:19.746 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:19.747 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:19.763 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:19.764 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:19.764 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_628/760ebccd-ccdb-4928-a7be-6650c4215abc/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:19.850 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:19.852 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:19.852 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100254 s, 105 MB/s 2020-06-12T17:50:19.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:19.854 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:19.854 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:19.870 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:19.870 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:19.871 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_628/760ebccd-ccdb-4928-a7be-6650c4215abc/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:19.964 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:19.965 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:19.965 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120095 s, 87.3 MB/s 2020-06-12T17:50:19.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:19.967 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:19.967 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:19.982 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:19.983 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:19.984 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_628/760ebccd-ccdb-4928-a7be-6650c4215abc/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:20.079 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:20.079 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:20.080 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113286 s, 92.6 MB/s 2020-06-12T17:50:20.081 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:20.081 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:20.082 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:20.098 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:20.099 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:20.099 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_628/760ebccd-ccdb-4928-a7be-6650c4215abc/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:20.186 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:20.187 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:20.187 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108662 s, 96.5 MB/s 2020-06-12T17:50:20.188 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_1769 2020-06-12T17:50:20.305 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.301+0000 7f7fed2fb700 1 Processor -- start 2020-06-12T17:50:20.305 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.301+0000 7f7fed2fb700 1 -- start start 2020-06-12T17:50:20.312 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.302+0000 7f7fed2fb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7fe8146680 0x7f7fe80ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:20.312 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.302+0000 7f7fed2fb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fe809d8d0 0x7f7fe81421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:20.312 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.302+0000 7f7fed2fb700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe8146d20 con 0x7f7fe80b2eb0 2020-06-12T17:50:20.312 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.302+0000 7f7fed2fb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe8066a80 con 0x7f7fe8146680 2020-06-12T17:50:20.313 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.302+0000 7f7fed2fb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe8146f50 con 0x7f7fe809d8d0 2020-06-12T17:50:20.316 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.302+0000 7f7fe67fc700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7fe80b2eb0 0x7f7fe809d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40450/0 (socket says 172.21.15.38:40450) 2020-06-12T17:50:20.316 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.302+0000 7f7fe67fc700 1 -- 172.21.15.38:0/2929291382 learned_addr learned my addr 172.21.15.38:0/2929291382 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:20.317 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe77fe700 1 --2- 172.21.15.38:0/2929291382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fe809d8d0 0x7f7fe81421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:20.317 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe6ffd700 1 --2- 172.21.15.38:0/2929291382 >> v2:172.21.15.150:3300/0 conn(0x7f7fe8146680 0x7f7fe80ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:20.317 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe5ffb700 1 -- 172.21.15.38:0/2929291382 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3473611798 0 0) 0x7f7fe8146d20 con 0x7f7fe80b2eb0 2020-06-12T17:50:20.317 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe5ffb700 1 -- 172.21.15.38:0/2929291382 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fcc003230 con 0x7f7fe80b2eb0 2020-06-12T17:50:20.318 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe5ffb700 1 -- 172.21.15.38:0/2929291382 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2771882984 0 0) 0x7f7fcc003230 con 0x7f7fe80b2eb0 2020-06-12T17:50:20.318 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe5ffb700 1 -- 172.21.15.38:0/2929291382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fe809d8d0 msgr2=0x7f7fe81421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:20.318 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe5ffb700 1 --2- 172.21.15.38:0/2929291382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fe809d8d0 0x7f7fe81421d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:20.318 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe5ffb700 1 -- 172.21.15.38:0/2929291382 >> v2:172.21.15.150:3300/0 conn(0x7f7fe8146680 msgr2=0x7f7fe80ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:20.318 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe5ffb700 1 --2- 172.21.15.38:0/2929291382 >> v2:172.21.15.150:3300/0 conn(0x7f7fe8146680 0x7f7fe80ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:20.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe5ffb700 1 -- 172.21.15.38:0/2929291382 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe8146a60 con 0x7f7fe80b2eb0 2020-06-12T17:50:20.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe5ffb700 1 -- 172.21.15.38:0/2929291382 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f7fd80016d0 con 0x7f7fe80b2eb0 2020-06-12T17:50:20.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe5ffb700 1 -- 172.21.15.38:0/2929291382 >> v1:172.21.15.38:6789/0 conn(0x7f7fe80b2eb0 legacy=0x7f7fe809d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:20.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe5ffb700 1 --2- 172.21.15.38:0/2929291382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fcc003720 0x7f7fcc003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:20.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe5ffb700 1 --2- 172.21.15.38:0/2929291382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fcc004060 0x7f7fcc004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:20.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe5ffb700 1 --2- 172.21.15.38:0/2929291382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fe809d8d0 0x7f7fcc004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:20.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe5ffb700 1 -- 172.21.15.38:0/2929291382 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe8066a80 con 0x7f7fcc004060 2020-06-12T17:50:20.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe5ffb700 1 -- 172.21.15.38:0/2929291382 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe8146f50 con 0x7f7fcc003720 2020-06-12T17:50:20.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe5ffb700 1 -- 172.21.15.38:0/2929291382 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc004ff0 con 0x7f7fe809d8d0 2020-06-12T17:50:20.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe67fc700 1 --2- 172.21.15.38:0/2929291382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fcc004060 0x7f7fcc004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:20.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe6ffd700 1 --2- 172.21.15.38:0/2929291382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fcc003720 0x7f7fcc003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:20.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe77fe700 1 --2- 172.21.15.38:0/2929291382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fe809d8d0 0x7f7fcc004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:20.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe67fc700 1 -- 172.21.15.38:0/2929291382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fe809d8d0 msgr2=0x7f7fcc004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:20.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe67fc700 1 --2- 172.21.15.38:0/2929291382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fe809d8d0 0x7f7fcc004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:20.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe67fc700 1 -- 172.21.15.38:0/2929291382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fcc003720 msgr2=0x7f7fcc003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:20.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe67fc700 1 --2- 172.21.15.38:0/2929291382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fcc003720 0x7f7fcc003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:20.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe67fc700 1 -- 172.21.15.38:0/2929291382 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc003230 con 0x7f7fcc004060 2020-06-12T17:50:20.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.303+0000 7f7fe67fc700 1 --2- 172.21.15.38:0/2929291382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fcc004060 0x7f7fcc004530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7fd80013e0 tx=0x7f7fd800e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.304+0000 7f7fe67fc700 1 --2- 172.21.15.38:0/2929291382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fcc004060 0x7f7fcc004530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7fd80013e0 tx=0x7f7fd800e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.323 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.304+0000 7f7fe67fc700 1 --2- 172.21.15.38:0/2929291382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fcc004060 0x7f7fcc004530 secure :-1 s=READY pgs=646 cs=0 l=1 rx=0x7f7fd80013e0 tx=0x7f7fd800e960).ready entity=mon.0 client_cookie=bdf7962f1b6e8848 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:20.323 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.304+0000 7f7fe67fc700 1 --2- 172.21.15.38:0/2929291382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fcc004060 0x7f7fcc004530 secure :-1 s=THROTTLE_DONE pgs=646 cs=0 l=1 rx=0x7f7fd80013e0 tx=0x7f7fd800e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.304+0000 7f7fe67fc700 1 --2- 172.21.15.38:0/2929291382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fcc004060 0x7f7fcc004530 secure :-1 s=THROTTLE_DONE pgs=646 cs=0 l=1 rx=0x7f7fd80013e0 tx=0x7f7fd800e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.304+0000 7f7fe5ffb700 1 -- 172.21.15.38:0/2929291382 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fd800ce70 con 0x7f7fcc004060 2020-06-12T17:50:20.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.304+0000 7f7fe67fc700 1 --2- 172.21.15.38:0/2929291382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fcc004060 0x7f7fcc004530 secure :-1 s=THROTTLE_DONE pgs=646 cs=0 l=1 rx=0x7f7fd80013e0 tx=0x7f7fd800e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.304+0000 7f7fe5ffb700 1 -- 172.21.15.38:0/2929291382 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd800e350 con 0x7f7fcc004060 2020-06-12T17:50:20.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.304+0000 7f7fe5ffb700 1 -- 172.21.15.38:0/2929291382 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fd800e770 con 0x7f7fcc004060 2020-06-12T17:50:20.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.304+0000 7f7fed2fb700 1 -- 172.21.15.38:0/2929291382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fcc004060 msgr2=0x7f7fcc004530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:20.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.304+0000 7f7fed2fb700 1 --2- 172.21.15.38:0/2929291382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fcc004060 0x7f7fcc004530 secure :-1 s=READY pgs=646 cs=0 l=1 rx=0x7f7fd80013e0 tx=0x7f7fd800e960).stop 2020-06-12T17:50:20.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.304+0000 7f7fe77fe700 1 -- 172.21.15.38:0/2929291382 reap_dead start 2020-06-12T17:50:20.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.304+0000 7f7fed2fb700 1 -- 172.21.15.38:0/2929291382 shutdown_connections 2020-06-12T17:50:20.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.304+0000 7f7fed2fb700 1 -- 172.21.15.38:0/2929291382 >> 172.21.15.38:0/2929291382 conn(0x7f7fe80b5a20 msgr2=0x7f7fe805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:20.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.304+0000 7f7fed2fb700 1 -- 172.21.15.38:0/2929291382 shutdown_connections 2020-06-12T17:50:20.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.304+0000 7f7fed2fb700 1 -- 172.21.15.38:0/2929291382 wait complete. 2020-06-12T17:50:20.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.305+0000 7f7fed2fb700 1 Processor -- start 2020-06-12T17:50:20.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.305+0000 7f7fed2fb700 1 -- start start 2020-06-12T17:50:20.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.306+0000 7f7fed2fb700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7fe813ff90 0x7f7fe813b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:20.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.306+0000 7f7fed2fb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7fe813b930 0x7f7fe813e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:20.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.306+0000 7f7fed2fb700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe813bd90 con 0x7f7fe8152660 2020-06-12T17:50:20.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.306+0000 7f7fed2fb700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe81421f0 con 0x7f7fe813ff90 2020-06-12T17:50:20.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.306+0000 7f7fed2fb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe8142490 con 0x7f7fe813b930 2020-06-12T17:50:20.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.306+0000 7f7fe6ffd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7fe8152660 0x7f7fe80af0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40460/0 (socket says 172.21.15.38:40460) 2020-06-12T17:50:20.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.306+0000 7f7fe6ffd700 1 -- 172.21.15.38:0/2646619385 learned_addr learned my addr 172.21.15.38:0/2646619385 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:20.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.306+0000 7f7fe67fc700 1 --2- 172.21.15.38:0/2646619385 >> v2:172.21.15.38:3300/0 conn(0x7f7fe813ff90 0x7f7fe813b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:20.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.306+0000 7f7fe77fe700 1 --2- 172.21.15.38:0/2646619385 >> v2:172.21.15.150:3300/0 conn(0x7f7fe813b930 0x7f7fe813e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:20.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.306+0000 7f7fd7fff700 1 -- 172.21.15.38:0/2646619385 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3977857966 0 0) 0x7f7fe813bd90 con 0x7f7fe8152660 2020-06-12T17:50:20.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.306+0000 7f7fd7fff700 1 -- 172.21.15.38:0/2646619385 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fc4002fe0 con 0x7f7fe8152660 2020-06-12T17:50:20.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.306+0000 7f7fe67fc700 1 -- 172.21.15.38:0/2646619385 >> v2:172.21.15.150:3300/0 conn(0x7f7fe813b930 msgr2=0x7f7fe813e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:20.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.306+0000 7f7fe67fc700 1 --2- 172.21.15.38:0/2646619385 >> v2:172.21.15.150:3300/0 conn(0x7f7fe813b930 0x7f7fe813e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:20.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.306+0000 7f7fe67fc700 1 -- 172.21.15.38:0/2646619385 >> v1:172.21.15.38:6789/0 conn(0x7f7fe8152660 legacy=0x7f7fe80af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:20.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.306+0000 7f7fe67fc700 1 -- 172.21.15.38:0/2646619385 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe813e4d0 con 0x7f7fe813ff90 2020-06-12T17:50:20.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.306+0000 7f7fe67fc700 1 --2- 172.21.15.38:0/2646619385 >> v2:172.21.15.38:3300/0 conn(0x7f7fe813ff90 0x7f7fe813b4d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7fd80013e0 tx=0x7f7fd800e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.306+0000 7f7fe67fc700 1 --2- 172.21.15.38:0/2646619385 >> v2:172.21.15.38:3300/0 conn(0x7f7fe813ff90 0x7f7fe813b4d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7fd80013e0 tx=0x7f7fd800e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.307+0000 7f7fe67fc700 1 --2- 172.21.15.38:0/2646619385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fe813ff90 0x7f7fe813b4d0 secure :-1 s=READY pgs=648 cs=0 l=1 rx=0x7f7fd80013e0 tx=0x7f7fd800e960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:20.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.307+0000 7f7fe67fc700 1 --2- 172.21.15.38:0/2646619385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fe813ff90 0x7f7fe813b4d0 secure :-1 s=THROTTLE_DONE pgs=648 cs=0 l=1 rx=0x7f7fd80013e0 tx=0x7f7fd800e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.307+0000 7f7fd7fff700 1 -- 172.21.15.38:0/2646619385 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fd800fe40 con 0x7f7fe813ff90 2020-06-12T17:50:20.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.307+0000 7f7fe67fc700 1 --2- 172.21.15.38:0/2646619385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fe813ff90 0x7f7fe813b4d0 secure :-1 s=THROTTLE_DONE pgs=648 cs=0 l=1 rx=0x7f7fd80013e0 tx=0x7f7fd800e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.307+0000 7f7fe67fc700 1 --2- 172.21.15.38:0/2646619385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fe813ff90 0x7f7fe813b4d0 secure :-1 s=THROTTLE_DONE pgs=648 cs=0 l=1 rx=0x7f7fd80013e0 tx=0x7f7fd800e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.307+0000 7f7fd7fff700 1 -- 172.21.15.38:0/2646619385 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd80102c0 con 0x7f7fe813ff90 2020-06-12T17:50:20.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.307+0000 7f7fed2fb700 1 -- 172.21.15.38:0/2646619385 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe813e720 con 0x7f7fe813ff90 2020-06-12T17:50:20.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.307+0000 7f7fd7fff700 1 -- 172.21.15.38:0/2646619385 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fd80106a0 con 0x7f7fe813ff90 2020-06-12T17:50:20.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.307+0000 7f7fed2fb700 1 -- 172.21.15.38:0/2646619385 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe8158a70 con 0x7f7fe813ff90 2020-06-12T17:50:20.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.307+0000 7f7fe67fc700 1 --2- 172.21.15.38:0/2646619385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fe813ff90 0x7f7fe813b4d0 secure :-1 s=THROTTLE_DONE pgs=648 cs=0 l=1 rx=0x7f7fd80013e0 tx=0x7f7fd800e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.308+0000 7f7fed2fb700 1 -- 172.21.15.38:0/2646619385 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe8142690 con 0x7f7fe813ff90 2020-06-12T17:50:20.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.308+0000 7f7fd7fff700 1 -- 172.21.15.38:0/2646619385 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f7fd8010910 con 0x7f7fe813ff90 2020-06-12T17:50:20.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.308+0000 7f7fe67fc700 1 --2- 172.21.15.38:0/2646619385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fe813ff90 0x7f7fe813b4d0 secure :-1 s=THROTTLE_DONE pgs=648 cs=0 l=1 rx=0x7f7fd80013e0 tx=0x7f7fd800e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.308+0000 7f7fd7fff700 1 --2- 172.21.15.38:0/2646619385 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7fc404d8e0 0x7f7fc404fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:20.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.308+0000 7f7fd7fff700 1 -- 172.21.15.38:0/2646619385 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7fd80613b0 con 0x7f7fe813ff90 2020-06-12T17:50:20.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.308+0000 7f7fe6ffd700 1 --2- 172.21.15.38:0/2646619385 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7fc404d8e0 0x7f7fc404fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:20.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.308+0000 7f7fe6ffd700 1 --2- 172.21.15.38:0/2646619385 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7fc404d8e0 0x7f7fc404fda0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7fdc002f30 tx=0x7f7fdc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.309+0000 7f7fe6ffd700 1 --2- 172.21.15.38:0/2646619385 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7fc404d8e0 0x7f7fc404fda0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7fdc002f30 tx=0x7f7fdc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.309+0000 7f7fe6ffd700 1 --2- 172.21.15.38:0/2646619385 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7fc404d8e0 0x7f7fc404fda0 secure :-1 s=READY pgs=256 cs=0 l=1 rx=0x7f7fdc002f30 tx=0x7f7fdc007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:20.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.311+0000 7f7fe67fc700 1 --2- 172.21.15.38:0/2646619385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fe813ff90 0x7f7fe813b4d0 secure :-1 s=THROTTLE_DONE pgs=648 cs=0 l=1 rx=0x7f7fd80013e0 tx=0x7f7fd800e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.311+0000 7f7fd7fff700 1 -- 172.21.15.38:0/2646619385 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f7fd803cbf0 con 0x7f7fe813ff90 2020-06-12T17:50:20.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.506+0000 7f7fed2fb700 1 -- 172.21.15.38:0/2646619385 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_1769", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fe813ddd0 con 0x7f7fc404d8e0 2020-06-12T17:50:20.532 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.529+0000 7f7fe6ffd700 1 --2- 172.21.15.38:0/2646619385 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7fc404d8e0 0x7f7fc404fda0 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f7fdc002f30 tx=0x7f7fdc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.533 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.529+0000 7f7fd7fff700 1 -- 172.21.15.38:0/2646619385 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f7fdc007290 con 0x7f7fc404d8e0 2020-06-12T17:50:20.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.530+0000 7f7fed2fb700 1 -- 172.21.15.38:0/2646619385 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7fc404d8e0 msgr2=0x7f7fc404fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:20.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.530+0000 7f7fed2fb700 1 --2- 172.21.15.38:0/2646619385 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7fc404d8e0 0x7f7fc404fda0 secure :-1 s=READY pgs=256 cs=0 l=1 rx=0x7f7fdc002f30 tx=0x7f7fdc007e60).stop 2020-06-12T17:50:20.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.530+0000 7f7fed2fb700 1 -- 172.21.15.38:0/2646619385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fe813ff90 msgr2=0x7f7fe813b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:20.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.530+0000 7f7fed2fb700 1 --2- 172.21.15.38:0/2646619385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fe813ff90 0x7f7fe813b4d0 secure :-1 s=READY pgs=648 cs=0 l=1 rx=0x7f7fd80013e0 tx=0x7f7fd800e960).stop 2020-06-12T17:50:20.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.530+0000 7f7fed2fb700 1 -- 172.21.15.38:0/2646619385 shutdown_connections 2020-06-12T17:50:20.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.530+0000 7f7fed2fb700 1 --2- 172.21.15.38:0/2646619385 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7fc404d8e0 0x7f7fc404fda0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:20.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.530+0000 7f7fed2fb700 1 --2- 172.21.15.38:0/2646619385 >> v2:172.21.15.150:3300/0 conn(0x7f7fe813b930 0x7f7fe813e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:20.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.530+0000 7f7fed2fb700 1 --2- 172.21.15.38:0/2646619385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fe813ff90 0x7f7fe813b4d0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:20.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.530+0000 7f7fed2fb700 1 -- 172.21.15.38:0/2646619385 >> 172.21.15.38:0/2646619385 conn(0x7f7fe80b5a20 msgr2=0x7f7fe8143900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:20.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.531+0000 7f7fed2fb700 1 -- 172.21.15.38:0/2646619385 shutdown_connections 2020-06-12T17:50:20.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.531+0000 7f7fed2fb700 1 -- 172.21.15.38:0/2646619385 wait complete. 2020-06-12T17:50:20.551 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_1769 2020-06-12T17:50:20.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.666+0000 7fcd67340700 1 Processor -- start 2020-06-12T17:50:20.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.666+0000 7fcd67340700 1 -- start start 2020-06-12T17:50:20.673 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.667+0000 7fcd67340700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcd60146680 0x7fcd600ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:20.673 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.667+0000 7fcd67340700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd60146d20 con 0x7fcd600b2eb0 2020-06-12T17:50:20.673 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.667+0000 7fcd67340700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd60066a80 con 0x7fcd6009d8d0 2020-06-12T17:50:20.673 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.667+0000 7fcd67340700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd60146f50 con 0x7fcd60146680 2020-06-12T17:50:20.674 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.667+0000 7fcd650dc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcd60146680 0x7fcd600ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:20.674 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.667+0000 7fcd650dc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcd60146680 0x7fcd600ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38652/0 (socket says 172.21.15.38:38652) 2020-06-12T17:50:20.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.667+0000 7fcd650dc700 1 -- 172.21.15.38:0/1554774078 learned_addr learned my addr 172.21.15.38:0/1554774078 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:20.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.667+0000 7fcd648db700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fcd600b2eb0 0x7fcd6009d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40468/0 (socket says 172.21.15.38:40468) 2020-06-12T17:50:20.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.667+0000 7fcd650dc700 1 -- 172.21.15.38:0/1554774078 >> v1:172.21.15.150:6789/0 conn(0x7fcd6009d8d0 legacy=0x7fcd601421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:20.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.667+0000 7fcd650dc700 1 -- 172.21.15.38:0/1554774078 >> v1:172.21.15.38:6789/0 conn(0x7fcd600b2eb0 legacy=0x7fcd6009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:20.675 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.667+0000 7fcd650dc700 1 -- 172.21.15.38:0/1554774078 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd60146a60 con 0x7fcd60146680 2020-06-12T17:50:20.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.667+0000 7fcd4ffff700 1 -- 172.21.15.38:0/1554774078 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3465746062 0 0) 0x7fcd60146d20 con 0x7fcd600b2eb0 2020-06-12T17:50:20.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.668+0000 7fcd650dc700 1 --2- 172.21.15.38:0/1554774078 >> v2:172.21.15.38:3300/0 conn(0x7fcd60146680 0x7fcd600ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcd50002f30 tx=0x7fcd50007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.668+0000 7fcd650dc700 1 --2- 172.21.15.38:0/1554774078 >> v2:172.21.15.38:3300/0 conn(0x7fcd60146680 0x7fcd600ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcd50002f30 tx=0x7fcd50007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.668+0000 7fcd650dc700 1 --2- 172.21.15.38:0/1554774078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd60146680 0x7fcd600ad5b0 secure :-1 s=READY pgs=650 cs=0 l=1 rx=0x7fcd50002f30 tx=0x7fcd50007e60).ready entity=mon.0 client_cookie=f8c8e43db6e18540 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:20.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.668+0000 7fcd650dc700 1 --2- 172.21.15.38:0/1554774078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd60146680 0x7fcd600ad5b0 secure :-1 s=THROTTLE_DONE pgs=650 cs=0 l=1 rx=0x7fcd50002f30 tx=0x7fcd50007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.668+0000 7fcd4ffff700 1 -- 172.21.15.38:0/1554774078 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd500116e0 con 0x7fcd60146680 2020-06-12T17:50:20.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.668+0000 7fcd650dc700 1 --2- 172.21.15.38:0/1554774078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd60146680 0x7fcd600ad5b0 secure :-1 s=THROTTLE_DONE pgs=650 cs=0 l=1 rx=0x7fcd50002f30 tx=0x7fcd50007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.668+0000 7fcd650dc700 1 --2- 172.21.15.38:0/1554774078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd60146680 0x7fcd600ad5b0 secure :-1 s=THROTTLE_DONE pgs=650 cs=0 l=1 rx=0x7fcd50002f30 tx=0x7fcd50007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.668+0000 7fcd4ffff700 1 -- 172.21.15.38:0/1554774078 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd50011840 con 0x7fcd60146680 2020-06-12T17:50:20.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.668+0000 7fcd4ffff700 1 -- 172.21.15.38:0/1554774078 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd50011c20 con 0x7fcd60146680 2020-06-12T17:50:20.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.668+0000 7fcd67340700 1 -- 172.21.15.38:0/1554774078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd60146680 msgr2=0x7fcd600ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:20.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.668+0000 7fcd67340700 1 --2- 172.21.15.38:0/1554774078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd60146680 0x7fcd600ad5b0 secure :-1 s=READY pgs=650 cs=0 l=1 rx=0x7fcd50002f30 tx=0x7fcd50007e60).stop 2020-06-12T17:50:20.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.668+0000 7fcd67340700 1 -- 172.21.15.38:0/1554774078 shutdown_connections 2020-06-12T17:50:20.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.668+0000 7fcd67340700 1 --2- 172.21.15.38:0/1554774078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd60146680 0x7fcd600ad5b0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:20.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.668+0000 7fcd67340700 1 -- 172.21.15.38:0/1554774078 >> 172.21.15.38:0/1554774078 conn(0x7fcd600b5a20 msgr2=0x7fcd6005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:20.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.668+0000 7fcd67340700 1 -- 172.21.15.38:0/1554774078 shutdown_connections 2020-06-12T17:50:20.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.668+0000 7fcd67340700 1 -- 172.21.15.38:0/1554774078 wait complete. 2020-06-12T17:50:20.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.669+0000 7fcd67340700 1 Processor -- start 2020-06-12T17:50:20.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.669+0000 7fcd67340700 1 -- start start 2020-06-12T17:50:20.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.670+0000 7fcd67340700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd6009d8d0 0x7fcd600616d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:20.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.670+0000 7fcd67340700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcd60146680 0x7fcd600afef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:20.686 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.670+0000 7fcd67340700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd600af510 con 0x7fcd600b2eb0 2020-06-12T17:50:20.686 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.670+0000 7fcd67340700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd600af7b0 con 0x7fcd60146680 2020-06-12T17:50:20.686 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.670+0000 7fcd67340700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd600afa50 con 0x7fcd6009d8d0 2020-06-12T17:50:20.686 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.670+0000 7fcd648db700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fcd600b2eb0 0x7fcd600aec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40472/0 (socket says 172.21.15.38:40472) 2020-06-12T17:50:20.687 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.670+0000 7fcd648db700 1 -- 172.21.15.38:0/1222350303 learned_addr learned my addr 172.21.15.38:0/1222350303 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:20.687 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.670+0000 7fcd4e7fc700 1 -- 172.21.15.38:0/1222350303 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2148474202 0 0) 0x7fcd600af510 con 0x7fcd600b2eb0 2020-06-12T17:50:20.687 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.670+0000 7fcd4e7fc700 1 -- 172.21.15.38:0/1222350303 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd40002fe0 con 0x7fcd600b2eb0 2020-06-12T17:50:20.687 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.670+0000 7fcd658dd700 1 --2- 172.21.15.38:0/1222350303 >> v2:172.21.15.150:3300/0 conn(0x7fcd60146680 0x7fcd600afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:20.687 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.670+0000 7fcd650dc700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd6009d8d0 0x7fcd600616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:20.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd4e7fc700 1 -- 172.21.15.38:0/1222350303 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2986588745 0 0) 0x7fcd40002fe0 con 0x7fcd600b2eb0 2020-06-12T17:50:20.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd4e7fc700 1 -- 172.21.15.38:0/1222350303 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcd600af510 con 0x7fcd600b2eb0 2020-06-12T17:50:20.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd4e7fc700 1 -- 172.21.15.38:0/1222350303 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fcd5c001960 con 0x7fcd600b2eb0 2020-06-12T17:50:20.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd4e7fc700 1 -- 172.21.15.38:0/1222350303 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd6009d8d0 msgr2=0x7fcd600616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:20.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd4e7fc700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd6009d8d0 0x7fcd600616d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:20.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd4e7fc700 1 -- 172.21.15.38:0/1222350303 >> v2:172.21.15.150:3300/0 conn(0x7fcd60146680 msgr2=0x7fcd600afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:20.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd4e7fc700 1 --2- 172.21.15.38:0/1222350303 >> v2:172.21.15.150:3300/0 conn(0x7fcd60146680 0x7fcd600afef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:20.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd4e7fc700 1 -- 172.21.15.38:0/1222350303 >> v1:172.21.15.38:6789/0 conn(0x7fcd600b2eb0 legacy=0x7fcd600aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:20.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd4e7fc700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd6009d8d0 0x7fcd400049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:20.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd4e7fc700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd40004e10 0x7fcd40005230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:20.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd4e7fc700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd40003a30 0x7fcd40003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:20.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd4e7fc700 1 -- 172.21.15.38:0/1222350303 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd600af7b0 con 0x7fcd40004e10 2020-06-12T17:50:20.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd4e7fc700 1 -- 172.21.15.38:0/1222350303 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd600afa50 con 0x7fcd40003a30 2020-06-12T17:50:20.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd4e7fc700 1 -- 172.21.15.38:0/1222350303 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd400044e0 con 0x7fcd6009d8d0 2020-06-12T17:50:20.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd648db700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd40004e10 0x7fcd40005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:20.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd658dd700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd40003a30 0x7fcd40003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:20.692 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd650dc700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd6009d8d0 0x7fcd400049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:20.692 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd648db700 1 -- 172.21.15.38:0/1222350303 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd6009d8d0 msgr2=0x7fcd400049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:20.692 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd648db700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd6009d8d0 0x7fcd400049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:20.692 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd648db700 1 -- 172.21.15.38:0/1222350303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd40003a30 msgr2=0x7fcd40003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:20.692 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd648db700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd40003a30 0x7fcd40003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:20.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd648db700 1 -- 172.21.15.38:0/1222350303 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd60063700 con 0x7fcd40004e10 2020-06-12T17:50:20.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd67340700 1 -- 172.21.15.38:0/1222350303 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd600b0350 con 0x7fcd40004e10 2020-06-12T17:50:20.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd648db700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd40004e10 0x7fcd40005230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcd5c001670 tx=0x7fcd5c00eb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd648db700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd40004e10 0x7fcd40005230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcd5c001670 tx=0x7fcd5c00eb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd648db700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd40004e10 0x7fcd40005230 secure :-1 s=READY pgs=652 cs=0 l=1 rx=0x7fcd5c001670 tx=0x7fcd5c00eb10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:20.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd67340700 1 -- 172.21.15.38:0/1222350303 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd60061890 con 0x7fcd40004e10 2020-06-12T17:50:20.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd648db700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd40004e10 0x7fcd40005230 secure :-1 s=THROTTLE_DONE pgs=652 cs=0 l=1 rx=0x7fcd5c001670 tx=0x7fcd5c00eb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd648db700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd40004e10 0x7fcd40005230 secure :-1 s=THROTTLE_DONE pgs=652 cs=0 l=1 rx=0x7fcd5c001670 tx=0x7fcd5c00eb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd4e7fc700 1 -- 172.21.15.38:0/1222350303 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd5c00b450 con 0x7fcd40004e10 2020-06-12T17:50:20.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd648db700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd40004e10 0x7fcd40005230 secure :-1 s=THROTTLE_DONE pgs=652 cs=0 l=1 rx=0x7fcd5c001670 tx=0x7fcd5c00eb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd4e7fc700 1 -- 172.21.15.38:0/1222350303 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5c00b5b0 con 0x7fcd40004e10 2020-06-12T17:50:20.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.671+0000 7fcd4e7fc700 1 -- 172.21.15.38:0/1222350303 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd5c00a8e0 con 0x7fcd40004e10 2020-06-12T17:50:20.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.672+0000 7fcd648db700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd40004e10 0x7fcd40005230 secure :-1 s=THROTTLE_DONE pgs=652 cs=0 l=1 rx=0x7fcd5c001670 tx=0x7fcd5c00eb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.672+0000 7fcd4e7fc700 1 -- 172.21.15.38:0/1222350303 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fcd5c00aa40 con 0x7fcd40004e10 2020-06-12T17:50:20.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.672+0000 7fcd648db700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd40004e10 0x7fcd40005230 secure :-1 s=THROTTLE_DONE pgs=652 cs=0 l=1 rx=0x7fcd5c001670 tx=0x7fcd5c00eb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.672+0000 7fcd67340700 1 -- 172.21.15.38:0/1222350303 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd3c003340 con 0x7fcd40004e10 2020-06-12T17:50:20.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.673+0000 7fcd4e7fc700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcd40055660 0x7fcd40057b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:20.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.673+0000 7fcd4e7fc700 1 -- 172.21.15.38:0/1222350303 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcd5c0614f0 con 0x7fcd40004e10 2020-06-12T17:50:20.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.673+0000 7fcd650dc700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcd40055660 0x7fcd40057b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:20.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.673+0000 7fcd650dc700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcd40055660 0x7fcd40057b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcd50002f30 tx=0x7fcd50007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.673+0000 7fcd650dc700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcd40055660 0x7fcd40057b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcd50002f30 tx=0x7fcd50007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.673+0000 7fcd650dc700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcd40055660 0x7fcd40057b20 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7fcd50002f30 tx=0x7fcd50007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:20.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.676+0000 7fcd648db700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd40004e10 0x7fcd40005230 secure :-1 s=THROTTLE_DONE pgs=652 cs=0 l=1 rx=0x7fcd5c001670 tx=0x7fcd5c00eb10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.676+0000 7fcd4e7fc700 1 -- 172.21.15.38:0/1222350303 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fcd5c03ccd0 con 0x7fcd40004e10 2020-06-12T17:50:20.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.870+0000 7fcd67340700 1 -- 172.21.15.38:0/1222350303 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_1769", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd3c002200 con 0x7fcd40055660 2020-06-12T17:50:20.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.873+0000 7fcd650dc700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcd40055660 0x7fcd40057b20 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fcd50002f30 tx=0x7fcd50007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:20.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.873+0000 7fcd4e7fc700 1 -- 172.21.15.38:0/1222350303 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7fcd3c002200 con 0x7fcd40055660 2020-06-12T17:50:20.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.874+0000 7fcd67340700 1 -- 172.21.15.38:0/1222350303 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcd40055660 msgr2=0x7fcd40057b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:20.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.874+0000 7fcd67340700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcd40055660 0x7fcd40057b20 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7fcd50002f30 tx=0x7fcd50007e60).stop 2020-06-12T17:50:20.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.874+0000 7fcd67340700 1 -- 172.21.15.38:0/1222350303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd40004e10 msgr2=0x7fcd40005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:20.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.874+0000 7fcd67340700 1 --2- 172.21.15.38:0/1222350303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd40004e10 0x7fcd40005230 secure :-1 s=READY pgs=652 cs=0 l=1 rx=0x7fcd5c001670 tx=0x7fcd5c00eb10).stop 2020-06-12T17:50:20.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.875+0000 7fcd658dd700 1 -- 172.21.15.38:0/1222350303 reap_dead start 2020-06-12T17:50:20.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.875+0000 7fcd67340700 1 -- 172.21.15.38:0/1222350303 shutdown_connections 2020-06-12T17:50:20.884 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.875+0000 7fcd67340700 1 -- 172.21.15.38:0/1222350303 >> 172.21.15.38:0/1222350303 conn(0x7fcd600b5a20 msgr2=0x7fcd6009b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:20.884 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.875+0000 7fcd67340700 1 -- 172.21.15.38:0/1222350303 shutdown_connections 2020-06-12T17:50:20.893 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:20.875+0000 7fcd67340700 1 -- 172.21.15.38:0/1222350303 wait complete. 2020-06-12T17:50:20.893 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_1769/9451d976-de71-4088-8fe2-2278cbfc3fea 2020-06-12T17:50:20.894 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_1769 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_1769/9451d976-de71-4088-8fe2-2278cbfc3fea 2020-06-12T17:50:20.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:20.895 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:20.895 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:20.916 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:20.917 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:20.918 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1769/9451d976-de71-4088-8fe2-2278cbfc3fea/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:21.010 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:21.011 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:21.011 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104652 s, 100 MB/s 2020-06-12T17:50:21.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:21.012 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:21.012 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:21.032 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:21.032 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:21.033 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1769/9451d976-de71-4088-8fe2-2278cbfc3fea/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:21.121 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:21.122 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:21.122 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123809 s, 84.7 MB/s 2020-06-12T17:50:21.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:21.123 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:21.124 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:21.140 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:21.140 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:21.141 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1769/9451d976-de71-4088-8fe2-2278cbfc3fea/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:21.229 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:21.229 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:21.229 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118326 s, 88.6 MB/s 2020-06-12T17:50:21.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:21.231 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:21.232 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:21.249 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:21.249 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:21.250 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1769/9451d976-de71-4088-8fe2-2278cbfc3fea/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:21.334 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:21.335 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:21.335 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985448 s, 106 MB/s 2020-06-12T17:50:21.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:21.337 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:21.338 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:21.353 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:21.353 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:21.354 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1769/9451d976-de71-4088-8fe2-2278cbfc3fea/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:21.442 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:21.442 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:21.443 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116142 s, 90.3 MB/s 2020-06-12T17:50:21.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:21.444 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:21.445 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:21.464 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:21.465 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:21.465 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1769/9451d976-de71-4088-8fe2-2278cbfc3fea/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:21.553 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:21.553 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:21.554 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111283 s, 94.2 MB/s 2020-06-12T17:50:21.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:21.555 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:21.556 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:21.571 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:21.572 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:21.572 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1769/9451d976-de71-4088-8fe2-2278cbfc3fea/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:21.661 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:21.661 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:21.662 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107414 s, 97.6 MB/s 2020-06-12T17:50:21.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:21.663 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:21.663 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:21.679 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:21.679 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:21.680 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1769/9451d976-de71-4088-8fe2-2278cbfc3fea/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:21.766 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:21.766 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:21.766 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929714 s, 113 MB/s 2020-06-12T17:50:21.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:21.768 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:21.768 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:21.784 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:21.785 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:21.785 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1769/9451d976-de71-4088-8fe2-2278cbfc3fea/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:21.871 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:21.872 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:21.872 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100643 s, 104 MB/s 2020-06-12T17:50:21.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:21.874 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:21.875 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:21.890 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:21.891 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:21.892 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1769/9451d976-de71-4088-8fe2-2278cbfc3fea/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:21.985 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:21.986 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:21.986 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149398 s, 70.2 MB/s 2020-06-12T17:50:21.987 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_6428 2020-06-12T17:50:22.105 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.102+0000 7f2441960700 1 Processor -- start 2020-06-12T17:50:22.106 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.102+0000 7f2441960700 1 -- start start 2020-06-12T17:50:22.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.103+0000 7f2441960700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f243c146680 0x7f243c0ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:22.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.103+0000 7f2441960700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f243c09d8d0 0x7f243c1421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:22.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.103+0000 7f2441960700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f243c146d20 con 0x7f243c0b2eb0 2020-06-12T17:50:22.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.103+0000 7f2441960700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f243c066a80 con 0x7f243c09d8d0 2020-06-12T17:50:22.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.103+0000 7f2441960700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243c146f50 con 0x7f243c146680 2020-06-12T17:50:22.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.103+0000 7f243b7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f243c09d8d0 0x7f243c1421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:22.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.103+0000 7f243b7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f243c09d8d0 0x7f243c1421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38672/0 (socket says 172.21.15.38:38672) 2020-06-12T17:50:22.111 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.103+0000 7f243b7fe700 1 -- 172.21.15.38:0/412155213 learned_addr learned my addr 172.21.15.38:0/412155213 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:22.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.103+0000 7f243b7fe700 1 -- 172.21.15.38:0/412155213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f243c146680 msgr2=0x7f243c0ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:22.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.103+0000 7f243b7fe700 1 --2- 172.21.15.38:0/412155213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f243c146680 0x7f243c0ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:22.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.103+0000 7f243b7fe700 1 -- 172.21.15.38:0/412155213 >> v1:172.21.15.150:6789/0 conn(0x7f243c0b2eb0 legacy=0x7f243c09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:22.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.103+0000 7f243b7fe700 1 -- 172.21.15.38:0/412155213 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243c146a60 con 0x7f243c09d8d0 2020-06-12T17:50:22.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.103+0000 7f243b7fe700 1 --2- 172.21.15.38:0/412155213 >> v2:172.21.15.38:3300/0 conn(0x7f243c09d8d0 0x7f243c1421d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f243c0ada10 tx=0x7f24340081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.103+0000 7f243b7fe700 1 --2- 172.21.15.38:0/412155213 >> v2:172.21.15.38:3300/0 conn(0x7f243c09d8d0 0x7f243c1421d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f243c0ada10 tx=0x7f24340081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.103+0000 7f243b7fe700 1 --2- 172.21.15.38:0/412155213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f243c09d8d0 0x7f243c1421d0 secure :-1 s=READY pgs=653 cs=0 l=1 rx=0x7f243c0ada10 tx=0x7f24340081e0).ready entity=mon.0 client_cookie=7e7e8dec5336d5dc server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:22.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.103+0000 7f243b7fe700 1 --2- 172.21.15.38:0/412155213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f243c09d8d0 0x7f243c1421d0 secure :-1 s=THROTTLE_DONE pgs=653 cs=0 l=1 rx=0x7f243c0ada10 tx=0x7f24340081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.104+0000 7f243b7fe700 1 --2- 172.21.15.38:0/412155213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f243c09d8d0 0x7f243c1421d0 secure :-1 s=THROTTLE_DONE pgs=653 cs=0 l=1 rx=0x7f243c0ada10 tx=0x7f24340081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.103+0000 7f243a7fc700 1 -- 172.21.15.38:0/412155213 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f243400a160 con 0x7f243c09d8d0 2020-06-12T17:50:22.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.104+0000 7f243b7fe700 1 --2- 172.21.15.38:0/412155213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f243c09d8d0 0x7f243c1421d0 secure :-1 s=THROTTLE_DONE pgs=653 cs=0 l=1 rx=0x7f243c0ada10 tx=0x7f24340081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.104+0000 7f243a7fc700 1 -- 172.21.15.38:0/412155213 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243400a2c0 con 0x7f243c09d8d0 2020-06-12T17:50:22.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.104+0000 7f243a7fc700 1 -- 172.21.15.38:0/412155213 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f243400a6e0 con 0x7f243c09d8d0 2020-06-12T17:50:22.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.104+0000 7f2441960700 1 -- 172.21.15.38:0/412155213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f243c09d8d0 msgr2=0x7f243c1421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:22.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.104+0000 7f2441960700 1 --2- 172.21.15.38:0/412155213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f243c09d8d0 0x7f243c1421d0 secure :-1 s=READY pgs=653 cs=0 l=1 rx=0x7f243c0ada10 tx=0x7f24340081e0).stop 2020-06-12T17:50:22.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.104+0000 7f2441960700 1 -- 172.21.15.38:0/412155213 shutdown_connections 2020-06-12T17:50:22.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.104+0000 7f2441960700 1 --2- 172.21.15.38:0/412155213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f243c146680 0x7f243c0ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:22.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.104+0000 7f2441960700 1 --2- 172.21.15.38:0/412155213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f243c09d8d0 0x7f243c1421d0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:22.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.104+0000 7f2441960700 1 -- 172.21.15.38:0/412155213 >> 172.21.15.38:0/412155213 conn(0x7f243c0b5a20 msgr2=0x7f243c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:22.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.104+0000 7f2441960700 1 -- 172.21.15.38:0/412155213 shutdown_connections 2020-06-12T17:50:22.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.104+0000 7f2441960700 1 -- 172.21.15.38:0/412155213 wait complete. 2020-06-12T17:50:22.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.105+0000 7f2441960700 1 Processor -- start 2020-06-12T17:50:22.118 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.105+0000 7f2441960700 1 -- start start 2020-06-12T17:50:22.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.106+0000 7f2441960700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f243c0b2eb0 0x7f243c141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:22.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.106+0000 7f2441960700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f243c0b0c80 con 0x7f243c09d8d0 2020-06-12T17:50:22.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.106+0000 7f2441960700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f243c0b0eb0 con 0x7f243c146680 2020-06-12T17:50:22.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.106+0000 7f2441960700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243c0b2600 con 0x7f243c0b2eb0 2020-06-12T17:50:22.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.106+0000 7f243affd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f243c09d8d0 0x7f243c091920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40490/0 (socket says 172.21.15.38:40490) 2020-06-12T17:50:22.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.106+0000 7f243affd700 1 -- 172.21.15.38:0/3678166296 learned_addr learned my addr 172.21.15.38:0/3678166296 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:22.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.106+0000 7f2433fff700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f243c0b2eb0 0x7f243c141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:22.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.106+0000 7f2438ff9700 1 -- 172.21.15.38:0/3678166296 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500788899 0 0) 0x7f243c0b0c80 con 0x7f243c09d8d0 2020-06-12T17:50:22.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.106+0000 7f2438ff9700 1 -- 172.21.15.38:0/3678166296 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2420002fe0 con 0x7f243c09d8d0 2020-06-12T17:50:22.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.106+0000 7f2438ff9700 1 -- 172.21.15.38:0/3678166296 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3341139695 0 0) 0x7f2420002fe0 con 0x7f243c09d8d0 2020-06-12T17:50:22.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.106+0000 7f2438ff9700 1 -- 172.21.15.38:0/3678166296 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f243c0b0c80 con 0x7f243c09d8d0 2020-06-12T17:50:22.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.106+0000 7f2438ff9700 1 -- 172.21.15.38:0/3678166296 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f242c002860 con 0x7f243c09d8d0 2020-06-12T17:50:22.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.106+0000 7f2438ff9700 1 -- 172.21.15.38:0/3678166296 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f243c0b2eb0 msgr2=0x7f243c141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:22.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.106+0000 7f2438ff9700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f243c0b2eb0 0x7f243c141fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:22.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.106+0000 7f2438ff9700 1 -- 172.21.15.38:0/3678166296 >> v1:172.21.15.150:6789/0 conn(0x7f243c146680 legacy=0x7f243c065940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:22.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.106+0000 7f2438ff9700 1 -- 172.21.15.38:0/3678166296 >> v1:172.21.15.38:6789/0 conn(0x7f243c09d8d0 legacy=0x7f243c091920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:22.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.106+0000 7f2438ff9700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f243c0b2eb0 0x7f24200049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:22.129 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.106+0000 7f2438ff9700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2420004e60 0x7f2420003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:22.129 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.106+0000 7f2438ff9700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2420003d80 0x7f2420004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:22.129 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.107+0000 7f2438ff9700 1 -- 172.21.15.38:0/3678166296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243c0b2600 con 0x7f2420003d80 2020-06-12T17:50:22.130 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.107+0000 7f2438ff9700 1 -- 172.21.15.38:0/3678166296 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2420005390 con 0x7f2420004e60 2020-06-12T17:50:22.130 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.107+0000 7f2438ff9700 1 -- 172.21.15.38:0/3678166296 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2420005550 con 0x7f243c0b2eb0 2020-06-12T17:50:22.130 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.107+0000 7f243b7fe700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2420003d80 0x7f2420004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:22.130 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.107+0000 7f243affd700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f243c0b2eb0 0x7f24200049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:22.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.107+0000 7f2433fff700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2420004e60 0x7f2420003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:22.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.107+0000 7f243b7fe700 1 -- 172.21.15.38:0/3678166296 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f243c0b2eb0 msgr2=0x7f24200049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:22.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.107+0000 7f243b7fe700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f243c0b2eb0 0x7f24200049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:22.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.107+0000 7f243b7fe700 1 -- 172.21.15.38:0/3678166296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2420004e60 msgr2=0x7f2420003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:22.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.107+0000 7f243b7fe700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2420004e60 0x7f2420003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:22.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.107+0000 7f243b7fe700 1 -- 172.21.15.38:0/3678166296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243c0b1150 con 0x7f2420003d80 2020-06-12T17:50:22.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.107+0000 7f2441960700 1 -- 172.21.15.38:0/3678166296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f243c066050 con 0x7f2420003d80 2020-06-12T17:50:22.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.107+0000 7f243b7fe700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2420003d80 0x7f2420004200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f243c08ffd0 tx=0x7f24340081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.107+0000 7f2433fff700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2420004e60 0x7f2420003920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:50:22.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.107+0000 7f2441960700 1 -- 172.21.15.38:0/3678166296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f243c153cf0 con 0x7f2420003d80 2020-06-12T17:50:22.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.107+0000 7f243b7fe700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2420003d80 0x7f2420004200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f243c08ffd0 tx=0x7f24340081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.107+0000 7f243b7fe700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2420003d80 0x7f2420004200 secure :-1 s=READY pgs=655 cs=0 l=1 rx=0x7f243c08ffd0 tx=0x7f24340081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:22.135 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.107+0000 7f243b7fe700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2420003d80 0x7f2420004200 secure :-1 s=THROTTLE_DONE pgs=655 cs=0 l=1 rx=0x7f243c08ffd0 tx=0x7f24340081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.135 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.107+0000 7f243b7fe700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2420003d80 0x7f2420004200 secure :-1 s=THROTTLE_DONE pgs=655 cs=0 l=1 rx=0x7f243c08ffd0 tx=0x7f24340081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.135 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.107+0000 7f243b7fe700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2420003d80 0x7f2420004200 secure :-1 s=THROTTLE_DONE pgs=655 cs=0 l=1 rx=0x7f243c08ffd0 tx=0x7f24340081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.107+0000 7f2438ff9700 1 -- 172.21.15.38:0/3678166296 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2434007ce0 con 0x7f2420003d80 2020-06-12T17:50:22.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.107+0000 7f2438ff9700 1 -- 172.21.15.38:0/3678166296 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2434005c30 con 0x7f2420003d80 2020-06-12T17:50:22.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.107+0000 7f2438ff9700 1 -- 172.21.15.38:0/3678166296 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2434005e20 con 0x7f2420003d80 2020-06-12T17:50:22.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.108+0000 7f243b7fe700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2420003d80 0x7f2420004200 secure :-1 s=THROTTLE_DONE pgs=655 cs=0 l=1 rx=0x7f243c08ffd0 tx=0x7f24340081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.108+0000 7f2441960700 1 -- 172.21.15.38:0/3678166296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2414003340 con 0x7f2420003d80 2020-06-12T17:50:22.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.108+0000 7f2438ff9700 1 -- 172.21.15.38:0/3678166296 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f2434007340 con 0x7f2420003d80 2020-06-12T17:50:22.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.108+0000 7f243b7fe700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2420003d80 0x7f2420004200 secure :-1 s=THROTTLE_DONE pgs=655 cs=0 l=1 rx=0x7f243c08ffd0 tx=0x7f24340081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.108+0000 7f2438ff9700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2420055970 0x7f2420057e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:22.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.109+0000 7f2438ff9700 1 -- 172.21.15.38:0/3678166296 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2434061880 con 0x7f2420003d80 2020-06-12T17:50:22.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.109+0000 7f243affd700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2420055970 0x7f2420057e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:22.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.109+0000 7f243affd700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2420055970 0x7f2420057e30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f242c002570 tx=0x7f242c00e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.109+0000 7f243affd700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2420055970 0x7f2420057e30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f242c002570 tx=0x7f242c00e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.109+0000 7f243affd700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2420055970 0x7f2420057e30 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7f242c002570 tx=0x7f242c00e960).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:22.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.112+0000 7f243b7fe700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2420003d80 0x7f2420004200 secure :-1 s=THROTTLE_DONE pgs=655 cs=0 l=1 rx=0x7f243c08ffd0 tx=0x7f24340081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.112+0000 7f2438ff9700 1 -- 172.21.15.38:0/3678166296 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f243403d0c0 con 0x7f2420003d80 2020-06-12T17:50:22.312 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.309+0000 7f2441960700 1 -- 172.21.15.38:0/3678166296 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_6428", "target": ["mon-mgr", ""]}) v1 -- 0x7f2414002040 con 0x7f2420055970 2020-06-12T17:50:22.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.327+0000 7f243affd700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2420055970 0x7f2420057e30 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7f242c002570 tx=0x7f242c00e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.327+0000 7f2438ff9700 1 -- 172.21.15.38:0/3678166296 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2414002040 con 0x7f2420055970 2020-06-12T17:50:22.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.328+0000 7f2441960700 1 -- 172.21.15.38:0/3678166296 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2420055970 msgr2=0x7f2420057e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:22.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.328+0000 7f2441960700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2420055970 0x7f2420057e30 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7f242c002570 tx=0x7f242c00e960).stop 2020-06-12T17:50:22.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.328+0000 7f2441960700 1 -- 172.21.15.38:0/3678166296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2420003d80 msgr2=0x7f2420004200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:22.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.328+0000 7f2441960700 1 --2- 172.21.15.38:0/3678166296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2420003d80 0x7f2420004200 secure :-1 s=READY pgs=655 cs=0 l=1 rx=0x7f243c08ffd0 tx=0x7f24340081e0).stop 2020-06-12T17:50:22.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.328+0000 7f243b7fe700 1 -- 172.21.15.38:0/3678166296 reap_dead start 2020-06-12T17:50:22.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.328+0000 7f243b7fe700 1 -- 172.21.15.38:0/3678166296 reap_dead start 2020-06-12T17:50:22.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.328+0000 7f2441960700 1 -- 172.21.15.38:0/3678166296 shutdown_connections 2020-06-12T17:50:22.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.328+0000 7f2441960700 1 -- 172.21.15.38:0/3678166296 >> 172.21.15.38:0/3678166296 conn(0x7f243c0b5a20 msgr2=0x7f243c0b64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:22.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.328+0000 7f2441960700 1 -- 172.21.15.38:0/3678166296 shutdown_connections 2020-06-12T17:50:22.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.328+0000 7f2441960700 1 -- 172.21.15.38:0/3678166296 wait complete. 2020-06-12T17:50:22.342 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_6428 2020-06-12T17:50:22.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.456+0000 7fb303476700 1 Processor -- start 2020-06-12T17:50:22.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.456+0000 7fb303476700 1 -- start start 2020-06-12T17:50:22.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.457+0000 7fb303476700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb2fc146680 0x7fb2fc0ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:22.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.457+0000 7fb303476700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb2fc09d8d0 0x7fb2fc1421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:22.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.457+0000 7fb303476700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2fc146d20 con 0x7fb2fc0b2eb0 2020-06-12T17:50:22.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.457+0000 7fb303476700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2fc066a80 con 0x7fb2fc09d8d0 2020-06-12T17:50:22.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.457+0000 7fb303476700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2fc146f50 con 0x7fb2fc146680 2020-06-12T17:50:22.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.457+0000 7fb301a13700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb2fc09d8d0 0x7fb2fc1421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:22.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.457+0000 7fb301a13700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb2fc09d8d0 0x7fb2fc1421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38692/0 (socket says 172.21.15.38:38692) 2020-06-12T17:50:22.470 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.457+0000 7fb301a13700 1 -- 172.21.15.38:0/2310002311 learned_addr learned my addr 172.21.15.38:0/2310002311 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:22.470 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.457+0000 7fb301212700 1 --2- 172.21.15.38:0/2310002311 >> v2:172.21.15.150:3300/0 conn(0x7fb2fc146680 0x7fb2fc0ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:22.470 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.457+0000 7fb301a13700 1 -- 172.21.15.38:0/2310002311 >> v2:172.21.15.150:3300/0 conn(0x7fb2fc146680 msgr2=0x7fb2fc0ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:22.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.457+0000 7fb301a13700 1 --2- 172.21.15.38:0/2310002311 >> v2:172.21.15.150:3300/0 conn(0x7fb2fc146680 0x7fb2fc0ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:22.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.457+0000 7fb301a13700 1 -- 172.21.15.38:0/2310002311 >> v1:172.21.15.150:6789/0 conn(0x7fb2fc0b2eb0 legacy=0x7fb2fc09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:22.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.457+0000 7fb301a13700 1 -- 172.21.15.38:0/2310002311 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc146a60 con 0x7fb2fc09d8d0 2020-06-12T17:50:22.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.457+0000 7fb301212700 1 --2- 172.21.15.38:0/2310002311 >> v2:172.21.15.150:3300/0 conn(0x7fb2fc146680 0x7fb2fc0ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:50:22.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.457+0000 7fb301a13700 1 --2- 172.21.15.38:0/2310002311 >> v2:172.21.15.38:3300/0 conn(0x7fb2fc09d8d0 0x7fb2fc1421d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb2fc061380 tx=0x7fb2ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.457+0000 7fb301a13700 1 --2- 172.21.15.38:0/2310002311 >> v2:172.21.15.38:3300/0 conn(0x7fb2fc09d8d0 0x7fb2fc1421d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb2fc061380 tx=0x7fb2ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.457+0000 7fb301a13700 1 --2- 172.21.15.38:0/2310002311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2fc09d8d0 0x7fb2fc1421d0 secure :-1 s=READY pgs=656 cs=0 l=1 rx=0x7fb2fc061380 tx=0x7fb2ec007e60).ready entity=mon.0 client_cookie=2e7460f37b4153d6 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:22.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.457+0000 7fb301a13700 1 --2- 172.21.15.38:0/2310002311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2fc09d8d0 0x7fb2fc1421d0 secure :-1 s=THROTTLE_DONE pgs=656 cs=0 l=1 rx=0x7fb2fc061380 tx=0x7fb2ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.457+0000 7fb301a13700 1 --2- 172.21.15.38:0/2310002311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2fc09d8d0 0x7fb2fc1421d0 secure :-1 s=THROTTLE_DONE pgs=656 cs=0 l=1 rx=0x7fb2fc061380 tx=0x7fb2ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.457+0000 7fb2fbfff700 1 -- 172.21.15.38:0/2310002311 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2ec0116a0 con 0x7fb2fc09d8d0 2020-06-12T17:50:22.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.457+0000 7fb301a13700 1 --2- 172.21.15.38:0/2310002311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2fc09d8d0 0x7fb2fc1421d0 secure :-1 s=THROTTLE_DONE pgs=656 cs=0 l=1 rx=0x7fb2fc061380 tx=0x7fb2ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.457+0000 7fb2fbfff700 1 -- 172.21.15.38:0/2310002311 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ec011800 con 0x7fb2fc09d8d0 2020-06-12T17:50:22.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.457+0000 7fb2fbfff700 1 -- 172.21.15.38:0/2310002311 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2ec011be0 con 0x7fb2fc09d8d0 2020-06-12T17:50:22.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.458+0000 7fb303476700 1 -- 172.21.15.38:0/2310002311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2fc09d8d0 msgr2=0x7fb2fc1421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:22.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.458+0000 7fb303476700 1 --2- 172.21.15.38:0/2310002311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2fc09d8d0 0x7fb2fc1421d0 secure :-1 s=READY pgs=656 cs=0 l=1 rx=0x7fb2fc061380 tx=0x7fb2ec007e60).stop 2020-06-12T17:50:22.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.458+0000 7fb303476700 1 -- 172.21.15.38:0/2310002311 shutdown_connections 2020-06-12T17:50:22.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.458+0000 7fb303476700 1 --2- 172.21.15.38:0/2310002311 >> v2:172.21.15.150:3300/0 conn(0x7fb2fc146680 0x7fb2fc0ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:22.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.458+0000 7fb303476700 1 --2- 172.21.15.38:0/2310002311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2fc09d8d0 0x7fb2fc1421d0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:22.506 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.458+0000 7fb303476700 1 -- 172.21.15.38:0/2310002311 >> 172.21.15.38:0/2310002311 conn(0x7fb2fc0b5a20 msgr2=0x7fb2fc05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:22.512 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.458+0000 7fb303476700 1 -- 172.21.15.38:0/2310002311 shutdown_connections 2020-06-12T17:50:22.512 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.458+0000 7fb303476700 1 -- 172.21.15.38:0/2310002311 wait complete. 2020-06-12T17:50:22.512 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.459+0000 7fb303476700 1 Processor -- start 2020-06-12T17:50:22.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.459+0000 7fb303476700 1 -- start start 2020-06-12T17:50:22.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.460+0000 7fb303476700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb2fc0b2eb0 0x7fb2fc1533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:22.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.460+0000 7fb303476700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb2fc146680 0x7fb2fc156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:22.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.460+0000 7fb303476700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2fc1542b0 con 0x7fb2fc09d8d0 2020-06-12T17:50:22.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.460+0000 7fb303476700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2fc1538d0 con 0x7fb2fc0b2eb0 2020-06-12T17:50:22.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.460+0000 7fb303476700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2fc153b70 con 0x7fb2fc146680 2020-06-12T17:50:22.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.460+0000 7fb300a11700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb2fc0b2eb0 0x7fb2fc1533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:22.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.460+0000 7fb300a11700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb2fc0b2eb0 0x7fb2fc1533c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38696/0 (socket says 172.21.15.38:38696) 2020-06-12T17:50:22.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.460+0000 7fb300a11700 1 -- 172.21.15.38:0/4167824270 learned_addr learned my addr 172.21.15.38:0/4167824270 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:22.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.460+0000 7fb301a13700 1 --2- 172.21.15.38:0/4167824270 >> v2:172.21.15.150:3300/0 conn(0x7fb2fc146680 0x7fb2fc156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:22.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.460+0000 7fb300a11700 1 -- 172.21.15.38:0/4167824270 >> v2:172.21.15.150:3300/0 conn(0x7fb2fc146680 msgr2=0x7fb2fc156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:22.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.460+0000 7fb300a11700 1 --2- 172.21.15.38:0/4167824270 >> v2:172.21.15.150:3300/0 conn(0x7fb2fc146680 0x7fb2fc156990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:22.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.460+0000 7fb300a11700 1 -- 172.21.15.38:0/4167824270 >> v1:172.21.15.150:6789/0 conn(0x7fb2fc09d8d0 legacy=0x7fb2fc1570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:22.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.460+0000 7fb300a11700 1 -- 172.21.15.38:0/4167824270 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc153e10 con 0x7fb2fc0b2eb0 2020-06-12T17:50:22.515 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.460+0000 7fb300a11700 1 --2- 172.21.15.38:0/4167824270 >> v2:172.21.15.38:3300/0 conn(0x7fb2fc0b2eb0 0x7fb2fc1533c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb2f0001f50 tx=0x7fb2f0002860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.460+0000 7fb300a11700 1 --2- 172.21.15.38:0/4167824270 >> v2:172.21.15.38:3300/0 conn(0x7fb2fc0b2eb0 0x7fb2fc1533c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb2f0001f50 tx=0x7fb2f0002860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.460+0000 7fb300a11700 1 --2- 172.21.15.38:0/4167824270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2fc0b2eb0 0x7fb2fc1533c0 secure :-1 s=READY pgs=657 cs=0 l=1 rx=0x7fb2f0001f50 tx=0x7fb2f0002860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:22.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.460+0000 7fb300a11700 1 --2- 172.21.15.38:0/4167824270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2fc0b2eb0 0x7fb2fc1533c0 secure :-1 s=THROTTLE_DONE pgs=657 cs=0 l=1 rx=0x7fb2f0001f50 tx=0x7fb2f0002860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.460+0000 7fb300a11700 1 --2- 172.21.15.38:0/4167824270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2fc0b2eb0 0x7fb2fc1533c0 secure :-1 s=THROTTLE_DONE pgs=657 cs=0 l=1 rx=0x7fb2f0001f50 tx=0x7fb2f0002860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.460+0000 7fb2fa7fc700 1 -- 172.21.15.38:0/4167824270 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2f000cbf0 con 0x7fb2fc0b2eb0 2020-06-12T17:50:22.517 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.460+0000 7fb300a11700 1 --2- 172.21.15.38:0/4167824270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2fc0b2eb0 0x7fb2fc1533c0 secure :-1 s=THROTTLE_DONE pgs=657 cs=0 l=1 rx=0x7fb2f0001f50 tx=0x7fb2f0002860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.517 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.460+0000 7fb2fa7fc700 1 -- 172.21.15.38:0/4167824270 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f000cd50 con 0x7fb2fc0b2eb0 2020-06-12T17:50:22.517 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.460+0000 7fb2fa7fc700 1 -- 172.21.15.38:0/4167824270 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2f000e350 con 0x7fb2fc0b2eb0 2020-06-12T17:50:22.517 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.460+0000 7fb303476700 1 -- 172.21.15.38:0/4167824270 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2fc1577b0 con 0x7fb2fc0b2eb0 2020-06-12T17:50:22.517 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.461+0000 7fb303476700 1 -- 172.21.15.38:0/4167824270 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2fc145400 con 0x7fb2fc0b2eb0 2020-06-12T17:50:22.518 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.461+0000 7fb300a11700 1 --2- 172.21.15.38:0/4167824270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2fc0b2eb0 0x7fb2fc1533c0 secure :-1 s=THROTTLE_DONE pgs=657 cs=0 l=1 rx=0x7fb2f0001f50 tx=0x7fb2f0002860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.518 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.461+0000 7fb2fa7fc700 1 -- 172.21.15.38:0/4167824270 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fb2f000e5c0 con 0x7fb2fc0b2eb0 2020-06-12T17:50:22.518 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.461+0000 7fb300a11700 1 --2- 172.21.15.38:0/4167824270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2fc0b2eb0 0x7fb2fc1533c0 secure :-1 s=THROTTLE_DONE pgs=657 cs=0 l=1 rx=0x7fb2f0001f50 tx=0x7fb2f0002860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.518 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.461+0000 7fb303476700 1 -- 172.21.15.38:0/4167824270 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2fc153fa0 con 0x7fb2fc0b2eb0 2020-06-12T17:50:22.518 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.462+0000 7fb2fa7fc700 1 --2- 172.21.15.38:0/4167824270 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb2dc04d6a0 0x7fb2dc04fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:22.518 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.462+0000 7fb2fa7fc700 1 -- 172.21.15.38:0/4167824270 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb2f0060bf0 con 0x7fb2fc0b2eb0 2020-06-12T17:50:22.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.462+0000 7fb301212700 1 --2- 172.21.15.38:0/4167824270 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb2dc04d6a0 0x7fb2dc04fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:22.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.462+0000 7fb301212700 1 --2- 172.21.15.38:0/4167824270 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb2dc04d6a0 0x7fb2dc04fb60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb2fc145c50 tx=0x7fb2f40013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.462+0000 7fb301212700 1 --2- 172.21.15.38:0/4167824270 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb2dc04d6a0 0x7fb2dc04fb60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb2fc145c50 tx=0x7fb2f40013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.462+0000 7fb301212700 1 --2- 172.21.15.38:0/4167824270 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb2dc04d6a0 0x7fb2dc04fb60 secure :-1 s=READY pgs=259 cs=0 l=1 rx=0x7fb2fc145c50 tx=0x7fb2f40013f0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:22.520 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.465+0000 7fb300a11700 1 --2- 172.21.15.38:0/4167824270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2fc0b2eb0 0x7fb2fc1533c0 secure :-1 s=THROTTLE_DONE pgs=657 cs=0 l=1 rx=0x7fb2f0001f50 tx=0x7fb2f0002860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.465+0000 7fb2fa7fc700 1 -- 172.21.15.38:0/4167824270 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fb2f003c370 con 0x7fb2fc0b2eb0 2020-06-12T17:50:22.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.661+0000 7fb303476700 1 -- 172.21.15.38:0/4167824270 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_6428", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2fc056c30 con 0x7fb2dc04d6a0 2020-06-12T17:50:22.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.664+0000 7fb301212700 1 --2- 172.21.15.38:0/4167824270 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb2dc04d6a0 0x7fb2dc04fb60 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7fb2fc145c50 tx=0x7fb2f40013f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:22.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.665+0000 7fb2fa7fc700 1 -- 172.21.15.38:0/4167824270 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7fb2fc056c30 con 0x7fb2dc04d6a0 2020-06-12T17:50:22.668 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_6428/50f45b2d-ec75-4b6d-baa2-ba14c9dac175 2020-06-12T17:50:22.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.666+0000 7fb303476700 1 -- 172.21.15.38:0/4167824270 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb2dc04d6a0 msgr2=0x7fb2dc04fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:22.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.666+0000 7fb303476700 1 --2- 172.21.15.38:0/4167824270 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb2dc04d6a0 0x7fb2dc04fb60 secure :-1 s=READY pgs=259 cs=0 l=1 rx=0x7fb2fc145c50 tx=0x7fb2f40013f0).stop 2020-06-12T17:50:22.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.666+0000 7fb303476700 1 -- 172.21.15.38:0/4167824270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2fc0b2eb0 msgr2=0x7fb2fc1533c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:22.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.666+0000 7fb303476700 1 --2- 172.21.15.38:0/4167824270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2fc0b2eb0 0x7fb2fc1533c0 secure :-1 s=READY pgs=657 cs=0 l=1 rx=0x7fb2f0001f50 tx=0x7fb2f0002860).stop 2020-06-12T17:50:22.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.666+0000 7fb303476700 1 -- 172.21.15.38:0/4167824270 shutdown_connections 2020-06-12T17:50:22.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.666+0000 7fb303476700 1 --2- 172.21.15.38:0/4167824270 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb2dc04d6a0 0x7fb2dc04fb60 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:22.673 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.666+0000 7fb303476700 1 --2- 172.21.15.38:0/4167824270 >> v2:172.21.15.150:3300/0 conn(0x7fb2fc146680 0x7fb2fc156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:22.673 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.666+0000 7fb303476700 1 --2- 172.21.15.38:0/4167824270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2fc0b2eb0 0x7fb2fc1533c0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:22.673 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.666+0000 7fb303476700 1 -- 172.21.15.38:0/4167824270 >> 172.21.15.38:0/4167824270 conn(0x7fb2fc0b5a20 msgr2=0x7fb2fc144300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:22.673 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.666+0000 7fb303476700 1 -- 172.21.15.38:0/4167824270 shutdown_connections 2020-06-12T17:50:22.673 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:22.666+0000 7fb303476700 1 -- 172.21.15.38:0/4167824270 wait complete. 2020-06-12T17:50:22.679 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_6428 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_6428/50f45b2d-ec75-4b6d-baa2-ba14c9dac175 2020-06-12T17:50:22.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:22.680 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:22.681 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:22.696 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:22.696 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:22.697 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6428/50f45b2d-ec75-4b6d-baa2-ba14c9dac175/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:22.787 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:22.788 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:22.788 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110703 s, 94.7 MB/s 2020-06-12T17:50:22.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:22.790 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:22.790 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:22.805 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:22.806 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:22.806 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6428/50f45b2d-ec75-4b6d-baa2-ba14c9dac175/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:22.894 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:22.894 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:22.894 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110105 s, 95.2 MB/s 2020-06-12T17:50:22.895 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:22.898 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:22.899 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:22.916 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:22.917 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:22.919 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6428/50f45b2d-ec75-4b6d-baa2-ba14c9dac175/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:23.017 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:23.017 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:23.018 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130795 s, 80.2 MB/s 2020-06-12T17:50:23.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:23.019 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:23.019 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:23.035 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:23.035 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:23.036 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6428/50f45b2d-ec75-4b6d-baa2-ba14c9dac175/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:23.122 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:23.123 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:23.123 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104375 s, 100 MB/s 2020-06-12T17:50:23.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:23.124 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:23.125 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:23.139 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:23.141 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:23.141 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6428/50f45b2d-ec75-4b6d-baa2-ba14c9dac175/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:23.231 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:23.231 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:23.231 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121861 s, 86.0 MB/s 2020-06-12T17:50:23.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:23.233 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:23.233 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:23.248 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:23.249 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:23.250 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6428/50f45b2d-ec75-4b6d-baa2-ba14c9dac175/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:23.338 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:23.338 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:23.339 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127433 s, 82.3 MB/s 2020-06-12T17:50:23.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:23.342 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:23.342 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:23.358 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:23.358 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:23.359 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6428/50f45b2d-ec75-4b6d-baa2-ba14c9dac175/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:23.448 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:23.448 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:23.449 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108615 s, 96.5 MB/s 2020-06-12T17:50:23.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:23.450 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:23.451 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:23.468 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:23.468 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:23.469 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6428/50f45b2d-ec75-4b6d-baa2-ba14c9dac175/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:23.557 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:23.558 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:23.558 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117631 s, 89.1 MB/s 2020-06-12T17:50:23.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:23.560 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:23.560 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:23.585 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:23.586 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:23.586 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6428/50f45b2d-ec75-4b6d-baa2-ba14c9dac175/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:23.674 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:23.674 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:23.674 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110243 s, 95.1 MB/s 2020-06-12T17:50:23.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:23.676 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:23.676 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:23.696 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:23.696 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:23.697 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6428/50f45b2d-ec75-4b6d-baa2-ba14c9dac175/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:23.782 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:23.783 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:23.783 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00919668 s, 114 MB/s 2020-06-12T17:50:23.784 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_7105 2020-06-12T17:50:23.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.937+0000 7efd77811700 1 Processor -- start 2020-06-12T17:50:23.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.938+0000 7efd77811700 1 -- start start 2020-06-12T17:50:23.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.938+0000 7efd77811700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd7009df00 0x7efd7013c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:23.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.938+0000 7efd77811700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efd70142e90 0x7efd70066790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:23.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.938+0000 7efd77811700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7009b960 con 0x7efd700b3ac0 2020-06-12T17:50:23.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.938+0000 7efd77811700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd7009bc00 con 0x7efd70142e90 2020-06-12T17:50:23.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.938+0000 7efd77811700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd700b48f0 con 0x7efd7009df00 2020-06-12T17:50:23.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.938+0000 7efd75dae700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efd70142e90 0x7efd70066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:23.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.938+0000 7efd75dae700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efd70142e90 0x7efd70066790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38702/0 (socket says 172.21.15.38:38702) 2020-06-12T17:50:23.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.938+0000 7efd75dae700 1 -- 172.21.15.38:0/3810327835 learned_addr learned my addr 172.21.15.38:0/3810327835 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:23.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.939+0000 7efd74dac700 1 --2- 172.21.15.38:0/3810327835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd7009df00 0x7efd7013c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:23.946 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.939+0000 7efd75dae700 1 -- 172.21.15.38:0/3810327835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd7009df00 msgr2=0x7efd7013c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:23.946 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.939+0000 7efd75dae700 1 --2- 172.21.15.38:0/3810327835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd7009df00 0x7efd7013c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:23.946 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.939+0000 7efd75dae700 1 -- 172.21.15.38:0/3810327835 >> v1:172.21.15.150:6789/0 conn(0x7efd700b3ac0 legacy=0x7efd7013bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:23.946 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.939+0000 7efd75dae700 1 -- 172.21.15.38:0/3810327835 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd700b3ea0 con 0x7efd70142e90 2020-06-12T17:50:23.946 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.939+0000 7efd75dae700 1 --2- 172.21.15.38:0/3810327835 >> v2:172.21.15.38:3300/0 conn(0x7efd70142e90 0x7efd70066790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efd70061380 tx=0x7efd680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:23.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.939+0000 7efd75dae700 1 --2- 172.21.15.38:0/3810327835 >> v2:172.21.15.38:3300/0 conn(0x7efd70142e90 0x7efd70066790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efd70061380 tx=0x7efd680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:23.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.939+0000 7efd75dae700 1 --2- 172.21.15.38:0/3810327835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd70142e90 0x7efd70066790 secure :-1 s=READY pgs=658 cs=0 l=1 rx=0x7efd70061380 tx=0x7efd680081e0).ready entity=mon.0 client_cookie=8c4f03387d7f334c server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:23.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.939+0000 7efd75dae700 1 --2- 172.21.15.38:0/3810327835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd70142e90 0x7efd70066790 secure :-1 s=THROTTLE_DONE pgs=658 cs=0 l=1 rx=0x7efd70061380 tx=0x7efd680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:23.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.939+0000 7efd5ffff700 1 -- 172.21.15.38:0/3810327835 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd6800a160 con 0x7efd70142e90 2020-06-12T17:50:23.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.939+0000 7efd75dae700 1 --2- 172.21.15.38:0/3810327835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd70142e90 0x7efd70066790 secure :-1 s=THROTTLE_DONE pgs=658 cs=0 l=1 rx=0x7efd70061380 tx=0x7efd680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:23.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.939+0000 7efd75dae700 1 --2- 172.21.15.38:0/3810327835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd70142e90 0x7efd70066790 secure :-1 s=THROTTLE_DONE pgs=658 cs=0 l=1 rx=0x7efd70061380 tx=0x7efd680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:23.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.939+0000 7efd5ffff700 1 -- 172.21.15.38:0/3810327835 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6800a2c0 con 0x7efd70142e90 2020-06-12T17:50:23.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.939+0000 7efd5ffff700 1 -- 172.21.15.38:0/3810327835 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd6800a660 con 0x7efd70142e90 2020-06-12T17:50:23.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.939+0000 7efd77811700 1 -- 172.21.15.38:0/3810327835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd70142e90 msgr2=0x7efd70066790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:23.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.939+0000 7efd77811700 1 --2- 172.21.15.38:0/3810327835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd70142e90 0x7efd70066790 secure :-1 s=READY pgs=658 cs=0 l=1 rx=0x7efd70061380 tx=0x7efd680081e0).stop 2020-06-12T17:50:23.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.940+0000 7efd77811700 1 -- 172.21.15.38:0/3810327835 shutdown_connections 2020-06-12T17:50:23.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.940+0000 7efd77811700 1 --2- 172.21.15.38:0/3810327835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd70142e90 0x7efd70066790 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:23.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.940+0000 7efd77811700 1 --2- 172.21.15.38:0/3810327835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd7009df00 0x7efd7013c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:23.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.940+0000 7efd77811700 1 -- 172.21.15.38:0/3810327835 >> 172.21.15.38:0/3810327835 conn(0x7efd700b5a20 msgr2=0x7efd7005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:23.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.940+0000 7efd77811700 1 -- 172.21.15.38:0/3810327835 shutdown_connections 2020-06-12T17:50:23.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.940+0000 7efd77811700 1 -- 172.21.15.38:0/3810327835 wait complete. 2020-06-12T17:50:23.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.941+0000 7efd77811700 1 Processor -- start 2020-06-12T17:50:23.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.941+0000 7efd77811700 1 -- start start 2020-06-12T17:50:23.953 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.942+0000 7efd77811700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd7009df00 0x7efd7013c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:23.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.942+0000 7efd77811700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efd700b3ac0 0x7efd70061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:23.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.942+0000 7efd77811700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd70062080 con 0x7efd70142e90 2020-06-12T17:50:23.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.942+0000 7efd77811700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd7013c950 con 0x7efd700b3ac0 2020-06-12T17:50:23.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.942+0000 7efd77811700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd70151000 con 0x7efd7009df00 2020-06-12T17:50:23.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.942+0000 7efd755ad700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd7009df00 0x7efd7013c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:23.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.942+0000 7efd74dac700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efd700b3ac0 0x7efd70061510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:23.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.942+0000 7efd75dae700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7efd70142e90 0x7efd70061970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:33026/0 (socket says 172.21.15.38:33026) 2020-06-12T17:50:23.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.942+0000 7efd755ad700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd7009df00 0x7efd7013c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:58164/0 (socket says 172.21.15.38:58164) 2020-06-12T17:50:23.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.942+0000 7efd75dae700 1 -- 172.21.15.38:0/2506247507 learned_addr learned my addr 172.21.15.38:0/2506247507 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:23.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.942+0000 7efd74dac700 1 -- 172.21.15.38:0/2506247507 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd7009df00 msgr2=0x7efd7013c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:23.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.942+0000 7efd74dac700 1 --2- 172.21.15.38:0/2506247507 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd7009df00 0x7efd7013c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:23.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.942+0000 7efd74dac700 1 -- 172.21.15.38:0/2506247507 >> v1:172.21.15.150:6789/0 conn(0x7efd70142e90 legacy=0x7efd70061970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:23.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.942+0000 7efd74dac700 1 -- 172.21.15.38:0/2506247507 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd700b20f0 con 0x7efd700b3ac0 2020-06-12T17:50:23.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.942+0000 7efd5e7fc700 1 -- 172.21.15.38:0/2506247507 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 901057025 0 0) 0x7efd70062080 con 0x7efd70142e90 2020-06-12T17:50:23.956 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.942+0000 7efd755ad700 1 --2- 172.21.15.38:0/2506247507 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd7009df00 0x7efd7013c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:50:23.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.942+0000 7efd74dac700 1 --2- 172.21.15.38:0/2506247507 >> v2:172.21.15.150:3300/0 conn(0x7efd700b3ac0 0x7efd70061510 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efd6c002f30 tx=0x7efd6c007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:23.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.942+0000 7efd74dac700 1 --2- 172.21.15.38:0/2506247507 >> v2:172.21.15.150:3300/0 conn(0x7efd700b3ac0 0x7efd70061510 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efd6c002f30 tx=0x7efd6c007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:23.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.942+0000 7efd74dac700 1 --2- 172.21.15.38:0/2506247507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd700b3ac0 0x7efd70061510 secure :-1 s=READY pgs=387 cs=0 l=1 rx=0x7efd6c002f30 tx=0x7efd6c007ee0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:23.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.943+0000 7efd74dac700 1 --2- 172.21.15.38:0/2506247507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd700b3ac0 0x7efd70061510 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7efd6c002f30 tx=0x7efd6c007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:23.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.943+0000 7efd5e7fc700 1 -- 172.21.15.38:0/2506247507 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd6c00a350 con 0x7efd700b3ac0 2020-06-12T17:50:23.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.943+0000 7efd74dac700 1 --2- 172.21.15.38:0/2506247507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd700b3ac0 0x7efd70061510 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7efd6c002f30 tx=0x7efd6c007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:23.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.943+0000 7efd77811700 1 -- 172.21.15.38:0/2506247507 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd70151260 con 0x7efd700b3ac0 2020-06-12T17:50:23.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.943+0000 7efd5e7fc700 1 -- 172.21.15.38:0/2506247507 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6c00a4b0 con 0x7efd700b3ac0 2020-06-12T17:50:23.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.943+0000 7efd74dac700 1 --2- 172.21.15.38:0/2506247507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd700b3ac0 0x7efd70061510 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7efd6c002f30 tx=0x7efd6c007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:23.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.943+0000 7efd5e7fc700 1 -- 172.21.15.38:0/2506247507 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd6c00a890 con 0x7efd700b3ac0 2020-06-12T17:50:23.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.943+0000 7efd77811700 1 -- 172.21.15.38:0/2506247507 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd700b0810 con 0x7efd700b3ac0 2020-06-12T17:50:23.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.944+0000 7efd74dac700 1 --2- 172.21.15.38:0/2506247507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd700b3ac0 0x7efd70061510 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7efd6c002f30 tx=0x7efd6c007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:23.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.944+0000 7efd77811700 1 -- 172.21.15.38:0/2506247507 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd700ae6d0 con 0x7efd700b3ac0 2020-06-12T17:50:23.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.944+0000 7efd5e7fc700 1 -- 172.21.15.38:0/2506247507 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7efd6c00ab10 con 0x7efd700b3ac0 2020-06-12T17:50:23.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.944+0000 7efd74dac700 1 --2- 172.21.15.38:0/2506247507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd700b3ac0 0x7efd70061510 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7efd6c002f30 tx=0x7efd6c007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:23.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.944+0000 7efd5e7fc700 1 --2- 172.21.15.38:0/2506247507 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efd5004d430 0x7efd5004f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:23.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.944+0000 7efd5e7fc700 1 -- 172.21.15.38:0/2506247507 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7efd6c060ae0 con 0x7efd700b3ac0 2020-06-12T17:50:23.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.944+0000 7efd755ad700 1 --2- 172.21.15.38:0/2506247507 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efd5004d430 0x7efd5004f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:23.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.945+0000 7efd755ad700 1 --2- 172.21.15.38:0/2506247507 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efd5004d430 0x7efd5004f8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efd60002f40 tx=0x7efd60007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:23.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.945+0000 7efd755ad700 1 --2- 172.21.15.38:0/2506247507 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efd5004d430 0x7efd5004f8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efd60002f40 tx=0x7efd60007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:23.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.945+0000 7efd755ad700 1 --2- 172.21.15.38:0/2506247507 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efd5004d430 0x7efd5004f8f0 secure :-1 s=READY pgs=260 cs=0 l=1 rx=0x7efd60002f40 tx=0x7efd60007d00).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:23.962 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.948+0000 7efd74dac700 1 --2- 172.21.15.38:0/2506247507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd700b3ac0 0x7efd70061510 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7efd6c002f30 tx=0x7efd6c007ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:23.962 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:23.948+0000 7efd5e7fc700 1 -- 172.21.15.38:0/2506247507 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7efd6c03c1e0 con 0x7efd700b3ac0 2020-06-12T17:50:24.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.143+0000 7efd77811700 1 -- 172.21.15.38:0/2506247507 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_7105", "target": ["mon-mgr", ""]}) v1 -- 0x7efd700b8230 con 0x7efd5004d430 2020-06-12T17:50:24.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.162+0000 7efd755ad700 1 --2- 172.21.15.38:0/2506247507 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efd5004d430 0x7efd5004f8f0 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7efd60002f40 tx=0x7efd60007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:24.166 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.162+0000 7efd5e7fc700 1 -- 172.21.15.38:0/2506247507 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7efd700b8230 con 0x7efd5004d430 2020-06-12T17:50:24.167 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.163+0000 7efd77811700 1 -- 172.21.15.38:0/2506247507 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efd5004d430 msgr2=0x7efd5004f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:24.168 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.163+0000 7efd77811700 1 --2- 172.21.15.38:0/2506247507 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efd5004d430 0x7efd5004f8f0 secure :-1 s=READY pgs=260 cs=0 l=1 rx=0x7efd60002f40 tx=0x7efd60007d00).stop 2020-06-12T17:50:24.168 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.163+0000 7efd77811700 1 -- 172.21.15.38:0/2506247507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd700b3ac0 msgr2=0x7efd70061510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:24.168 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.163+0000 7efd77811700 1 --2- 172.21.15.38:0/2506247507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd700b3ac0 0x7efd70061510 secure :-1 s=READY pgs=387 cs=0 l=1 rx=0x7efd6c002f30 tx=0x7efd6c007ee0).stop 2020-06-12T17:50:24.168 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.164+0000 7efd77811700 1 -- 172.21.15.38:0/2506247507 shutdown_connections 2020-06-12T17:50:24.169 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.164+0000 7efd77811700 1 --2- 172.21.15.38:0/2506247507 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efd5004d430 0x7efd5004f8f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:24.169 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.164+0000 7efd77811700 1 --2- 172.21.15.38:0/2506247507 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd7009df00 0x7efd7013c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:24.169 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.164+0000 7efd77811700 1 --2- 172.21.15.38:0/2506247507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd700b3ac0 0x7efd70061510 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:24.170 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.164+0000 7efd77811700 1 -- 172.21.15.38:0/2506247507 >> 172.21.15.38:0/2506247507 conn(0x7efd700b5a20 msgr2=0x7efd7013eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:24.170 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.164+0000 7efd77811700 1 -- 172.21.15.38:0/2506247507 shutdown_connections 2020-06-12T17:50:24.170 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.164+0000 7efd77811700 1 -- 172.21.15.38:0/2506247507 wait complete. 2020-06-12T17:50:24.177 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_7105 2020-06-12T17:50:24.296 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.292+0000 7f3e1cbbf700 1 Processor -- start 2020-06-12T17:50:24.296 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.292+0000 7f3e1cbbf700 1 -- start start 2020-06-12T17:50:24.301 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.293+0000 7f3e1cbbf700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3e18146680 0x7f3e180ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:24.302 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.293+0000 7f3e1cbbf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e180b2eb0 0x7f3e1809d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:24.302 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.293+0000 7f3e1cbbf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3e1809d620 0x7f3e1809da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:24.302 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.293+0000 7f3e1cbbf700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e18146d20 con 0x7f3e18146680 2020-06-12T17:50:24.302 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.293+0000 7f3e1cbbf700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e18066a80 con 0x7f3e1809d620 2020-06-12T17:50:24.303 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.293+0000 7f3e1cbbf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e18146f50 con 0x7f3e180b2eb0 2020-06-12T17:50:24.303 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.293+0000 7f3e1659c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3e18146680 0x7f3e180ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:24.303 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.293+0000 7f3e1659c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3e18146680 0x7f3e180ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38714/0 (socket says 172.21.15.38:38714) 2020-06-12T17:50:24.303 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.293+0000 7f3e1659c700 1 -- 172.21.15.38:0/2212051912 learned_addr learned my addr 172.21.15.38:0/2212051912 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:24.303 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.293+0000 7f3e15d9b700 1 --2- 172.21.15.38:0/2212051912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e180b2eb0 0x7f3e1809d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:24.304 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.293+0000 7f3e16d9d700 1 --2- 172.21.15.38:0/2212051912 >> v2:172.21.15.150:3300/0 conn(0x7f3e1809d620 0x7f3e1809da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:24.304 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.293+0000 7f3e1659c700 1 -- 172.21.15.38:0/2212051912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e180b2eb0 msgr2=0x7f3e1809d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:24.304 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.293+0000 7f3e1659c700 1 --2- 172.21.15.38:0/2212051912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e180b2eb0 0x7f3e1809d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:24.305 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.293+0000 7f3e1659c700 1 -- 172.21.15.38:0/2212051912 >> v2:172.21.15.150:3300/0 conn(0x7f3e1809d620 msgr2=0x7f3e1809da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:24.305 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.293+0000 7f3e1659c700 1 --2- 172.21.15.38:0/2212051912 >> v2:172.21.15.150:3300/0 conn(0x7f3e1809d620 0x7f3e1809da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:24.305 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.293+0000 7f3e1659c700 1 -- 172.21.15.38:0/2212051912 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e18146a60 con 0x7f3e18146680 2020-06-12T17:50:24.305 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.293+0000 7f3e16d9d700 1 --2- 172.21.15.38:0/2212051912 >> v2:172.21.15.150:3300/0 conn(0x7f3e1809d620 0x7f3e1809da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:50:24.306 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.294+0000 7f3e1659c700 1 --2- 172.21.15.38:0/2212051912 >> v2:172.21.15.38:3300/0 conn(0x7f3e18146680 0x7f3e180ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3e0c002f30 tx=0x7f3e0c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:24.306 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.294+0000 7f3e1659c700 1 --2- 172.21.15.38:0/2212051912 >> v2:172.21.15.38:3300/0 conn(0x7f3e18146680 0x7f3e180ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3e0c002f30 tx=0x7f3e0c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:24.306 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.294+0000 7f3e1659c700 1 --2- 172.21.15.38:0/2212051912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e18146680 0x7f3e180ad5b0 secure :-1 s=READY pgs=659 cs=0 l=1 rx=0x7f3e0c002f30 tx=0x7f3e0c007e60).ready entity=mon.0 client_cookie=4d5086360df5c383 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:24.306 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.294+0000 7f3e1659c700 1 --2- 172.21.15.38:0/2212051912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e18146680 0x7f3e180ad5b0 secure :-1 s=THROTTLE_DONE pgs=659 cs=0 l=1 rx=0x7f3e0c002f30 tx=0x7f3e0c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:24.306 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.294+0000 7f3e1559a700 1 -- 172.21.15.38:0/2212051912 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e0c0116e0 con 0x7f3e18146680 2020-06-12T17:50:24.307 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.294+0000 7f3e1659c700 1 --2- 172.21.15.38:0/2212051912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e18146680 0x7f3e180ad5b0 secure :-1 s=THROTTLE_DONE pgs=659 cs=0 l=1 rx=0x7f3e0c002f30 tx=0x7f3e0c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:24.307 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.294+0000 7f3e1659c700 1 --2- 172.21.15.38:0/2212051912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e18146680 0x7f3e180ad5b0 secure :-1 s=THROTTLE_DONE pgs=659 cs=0 l=1 rx=0x7f3e0c002f30 tx=0x7f3e0c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:24.307 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.294+0000 7f3e1559a700 1 -- 172.21.15.38:0/2212051912 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c011840 con 0x7f3e18146680 2020-06-12T17:50:24.307 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.294+0000 7f3e1559a700 1 -- 172.21.15.38:0/2212051912 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e0c011be0 con 0x7f3e18146680 2020-06-12T17:50:24.307 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.294+0000 7f3e1cbbf700 1 -- 172.21.15.38:0/2212051912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e18146680 msgr2=0x7f3e180ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:24.308 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.294+0000 7f3e1cbbf700 1 --2- 172.21.15.38:0/2212051912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e18146680 0x7f3e180ad5b0 secure :-1 s=READY pgs=659 cs=0 l=1 rx=0x7f3e0c002f30 tx=0x7f3e0c007e60).stop 2020-06-12T17:50:24.308 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.294+0000 7f3e1cbbf700 1 -- 172.21.15.38:0/2212051912 shutdown_connections 2020-06-12T17:50:24.308 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.294+0000 7f3e1cbbf700 1 --2- 172.21.15.38:0/2212051912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e18146680 0x7f3e180ad5b0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:24.308 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.294+0000 7f3e1cbbf700 1 --2- 172.21.15.38:0/2212051912 >> v2:172.21.15.150:3300/0 conn(0x7f3e1809d620 0x7f3e1809da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:24.308 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.294+0000 7f3e1cbbf700 1 --2- 172.21.15.38:0/2212051912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e180b2eb0 0x7f3e1809d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:24.309 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.294+0000 7f3e1cbbf700 1 -- 172.21.15.38:0/2212051912 >> 172.21.15.38:0/2212051912 conn(0x7f3e180b5a20 msgr2=0x7f3e1805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:24.309 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.294+0000 7f3e1cbbf700 1 -- 172.21.15.38:0/2212051912 shutdown_connections 2020-06-12T17:50:24.309 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.294+0000 7f3e1cbbf700 1 -- 172.21.15.38:0/2212051912 wait complete. 2020-06-12T17:50:24.309 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.295+0000 7f3e1cbbf700 1 Processor -- start 2020-06-12T17:50:24.310 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.295+0000 7f3e1cbbf700 1 -- start start 2020-06-12T17:50:24.310 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.296+0000 7f3e1cbbf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3e180b2eb0 0x7f3e1813d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:24.310 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.296+0000 7f3e1cbbf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e18146680 0x7f3e180b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:24.310 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.296+0000 7f3e1cbbf700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e1813d5c0 con 0x7f3e1809d620 2020-06-12T17:50:24.311 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.296+0000 7f3e1cbbf700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e180afd10 con 0x7f3e180b2eb0 2020-06-12T17:50:24.311 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.296+0000 7f3e1cbbf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e180affb0 con 0x7f3e18146680 2020-06-12T17:50:24.311 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.296+0000 7f3e16d9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e18146680 0x7f3e180b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:24.311 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.296+0000 7f3e15d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3e180b2eb0 0x7f3e1813d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:24.311 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.296+0000 7f3e1659c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f3e1809d620 0x7f3e181399f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:33036/0 (socket says 172.21.15.38:33036) 2020-06-12T17:50:24.312 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.296+0000 7f3e1659c700 1 -- 172.21.15.38:0/215660575 learned_addr learned my addr 172.21.15.38:0/215660575 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:24.312 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.296+0000 7f3e16d9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e18146680 0x7f3e180b0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:58182/0 (socket says 172.21.15.38:58182) 2020-06-12T17:50:24.312 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.297+0000 7f3e16d9d700 1 -- 172.21.15.38:0/215660575 >> v2:172.21.15.150:3300/0 conn(0x7f3e180b2eb0 msgr2=0x7f3e1813d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:24.313 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.297+0000 7f3e16d9d700 1 --2- 172.21.15.38:0/215660575 >> v2:172.21.15.150:3300/0 conn(0x7f3e180b2eb0 0x7f3e1813d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:24.313 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.297+0000 7f3e16d9d700 1 -- 172.21.15.38:0/215660575 >> v1:172.21.15.150:6789/0 conn(0x7f3e1809d620 legacy=0x7f3e181399f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:24.313 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.297+0000 7f3e077fe700 1 -- 172.21.15.38:0/215660575 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 255968070 0 0) 0x7f3e18146a60 con 0x7f3e1809d620 2020-06-12T17:50:24.313 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.297+0000 7f3e16d9d700 1 -- 172.21.15.38:0/215660575 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e180b7d30 con 0x7f3e18146680 2020-06-12T17:50:24.313 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.297+0000 7f3e15d9b700 1 --2- 172.21.15.38:0/215660575 >> v2:172.21.15.150:3300/0 conn(0x7f3e180b2eb0 0x7f3e1813d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:50:24.314 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.297+0000 7f3e16d9d700 1 --2- 172.21.15.38:0/215660575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e18146680 0x7f3e180b0450 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3e100032b0 tx=0x7f3e1000e190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:24.314 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.297+0000 7f3e16d9d700 1 --2- 172.21.15.38:0/215660575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e18146680 0x7f3e180b0450 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3e100032b0 tx=0x7f3e1000e190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:24.314 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.297+0000 7f3e16d9d700 1 --2- 172.21.15.38:0/215660575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e18146680 0x7f3e180b0450 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f3e100032b0 tx=0x7f3e1000e190).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:24.315 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.297+0000 7f3e16d9d700 1 --2- 172.21.15.38:0/215660575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e18146680 0x7f3e180b0450 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f3e100032b0 tx=0x7f3e1000e190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:24.315 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.297+0000 7f3e077fe700 1 -- 172.21.15.38:0/215660575 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e10005e30 con 0x7f3e18146680 2020-06-12T17:50:24.315 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.297+0000 7f3e16d9d700 1 --2- 172.21.15.38:0/215660575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e18146680 0x7f3e180b0450 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f3e100032b0 tx=0x7f3e1000e190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:24.315 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.297+0000 7f3e1cbbf700 1 -- 172.21.15.38:0/215660575 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e1813a100 con 0x7f3e18146680 2020-06-12T17:50:24.316 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.297+0000 7f3e077fe700 1 -- 172.21.15.38:0/215660575 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e10007540 con 0x7f3e18146680 2020-06-12T17:50:24.316 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.297+0000 7f3e16d9d700 1 --2- 172.21.15.38:0/215660575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e18146680 0x7f3e180b0450 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f3e100032b0 tx=0x7f3e1000e190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:24.316 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.297+0000 7f3e077fe700 1 -- 172.21.15.38:0/215660575 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e10007920 con 0x7f3e18146680 2020-06-12T17:50:24.316 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.297+0000 7f3e1cbbf700 1 -- 172.21.15.38:0/215660575 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e1814ce50 con 0x7f3e18146680 2020-06-12T17:50:24.317 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.298+0000 7f3e16d9d700 1 --2- 172.21.15.38:0/215660575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e18146680 0x7f3e180b0450 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f3e100032b0 tx=0x7f3e1000e190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:24.317 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.298+0000 7f3e077fe700 1 -- 172.21.15.38:0/215660575 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f3e1000e320 con 0x7f3e18146680 2020-06-12T17:50:24.317 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.298+0000 7f3e16d9d700 1 --2- 172.21.15.38:0/215660575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e18146680 0x7f3e180b0450 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f3e100032b0 tx=0x7f3e1000e190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:24.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.299+0000 7f3e077fe700 1 --2- 172.21.15.38:0/215660575 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3df404d430 0x7f3df404f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:24.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.299+0000 7f3e077fe700 1 -- 172.21.15.38:0/215660575 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3e10061300 con 0x7f3e18146680 2020-06-12T17:50:24.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.299+0000 7f3e1cbbf700 1 -- 172.21.15.38:0/215660575 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e180b2bd0 con 0x7f3e18146680 2020-06-12T17:50:24.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.299+0000 7f3e1659c700 1 --2- 172.21.15.38:0/215660575 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3df404d430 0x7f3df404f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:24.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.299+0000 7f3e1659c700 1 --2- 172.21.15.38:0/215660575 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3df404d430 0x7f3df404f8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3e0c0082e0 tx=0x7f3e0c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:24.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.299+0000 7f3e1659c700 1 --2- 172.21.15.38:0/215660575 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3df404d430 0x7f3df404f8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3e0c0082e0 tx=0x7f3e0c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:24.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.299+0000 7f3e1659c700 1 --2- 172.21.15.38:0/215660575 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3df404d430 0x7f3df404f8f0 secure :-1 s=READY pgs=261 cs=0 l=1 rx=0x7f3e0c0082e0 tx=0x7f3e0c007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:24.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.303+0000 7f3e16d9d700 1 --2- 172.21.15.38:0/215660575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e18146680 0x7f3e180b0450 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f3e100032b0 tx=0x7f3e1000e190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:24.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.303+0000 7f3e077fe700 1 -- 172.21.15.38:0/215660575 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f3e1003ca60 con 0x7f3e18146680 2020-06-12T17:50:24.503 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.499+0000 7f3e1cbbf700 1 -- 172.21.15.38:0/215660575 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_7105", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e180afb90 con 0x7f3df404d430 2020-06-12T17:50:24.506 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.503+0000 7f3e1659c700 1 --2- 172.21.15.38:0/215660575 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3df404d430 0x7f3df404f8f0 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7f3e0c0082e0 tx=0x7f3e0c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:24.506 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.503+0000 7f3e077fe700 1 -- 172.21.15.38:0/215660575 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f3e0c0085c0 con 0x7f3df404d430 2020-06-12T17:50:24.507 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_7105/3c644a63-9147-418b-9a85-020e8f8c8652 2020-06-12T17:50:24.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.504+0000 7f3e1cbbf700 1 -- 172.21.15.38:0/215660575 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3df404d430 msgr2=0x7f3df404f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:24.508 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.504+0000 7f3e1cbbf700 1 --2- 172.21.15.38:0/215660575 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3df404d430 0x7f3df404f8f0 secure :-1 s=READY pgs=261 cs=0 l=1 rx=0x7f3e0c0082e0 tx=0x7f3e0c007e60).stop 2020-06-12T17:50:24.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.504+0000 7f3e1cbbf700 1 -- 172.21.15.38:0/215660575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e18146680 msgr2=0x7f3e180b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:24.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.504+0000 7f3e1cbbf700 1 --2- 172.21.15.38:0/215660575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e18146680 0x7f3e180b0450 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f3e100032b0 tx=0x7f3e1000e190).stop 2020-06-12T17:50:24.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.504+0000 7f3e1cbbf700 1 -- 172.21.15.38:0/215660575 shutdown_connections 2020-06-12T17:50:24.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.504+0000 7f3e1cbbf700 1 --2- 172.21.15.38:0/215660575 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f3df404d430 0x7f3df404f8f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:24.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.504+0000 7f3e1cbbf700 1 --2- 172.21.15.38:0/215660575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e18146680 0x7f3e180b0450 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:24.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.504+0000 7f3e1cbbf700 1 --2- 172.21.15.38:0/215660575 >> v2:172.21.15.150:3300/0 conn(0x7f3e180b2eb0 0x7f3e1813d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:24.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.504+0000 7f3e1cbbf700 1 -- 172.21.15.38:0/215660575 >> 172.21.15.38:0/215660575 conn(0x7f3e180b5a20 msgr2=0x7f3e1809b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:24.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.504+0000 7f3e1cbbf700 1 -- 172.21.15.38:0/215660575 shutdown_connections 2020-06-12T17:50:24.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:24.504+0000 7f3e1cbbf700 1 -- 172.21.15.38:0/215660575 wait complete. 2020-06-12T17:50:24.518 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_7105 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_7105/3c644a63-9147-418b-9a85-020e8f8c8652 2020-06-12T17:50:24.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:24.520 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:24.520 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:24.536 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:24.540 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:24.541 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7105/3c644a63-9147-418b-9a85-020e8f8c8652/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:24.628 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:24.629 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:24.629 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123989 s, 84.6 MB/s 2020-06-12T17:50:24.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:24.631 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:24.631 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:24.646 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:24.647 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:24.647 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7105/3c644a63-9147-418b-9a85-020e8f8c8652/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:24.739 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:24.740 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:24.740 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123277 s, 85.1 MB/s 2020-06-12T17:50:24.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:24.742 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:24.748 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:24.764 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:24.765 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:24.765 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7105/3c644a63-9147-418b-9a85-020e8f8c8652/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:24.853 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:24.854 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:24.854 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012717 s, 82.5 MB/s 2020-06-12T17:50:24.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:24.856 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:24.856 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:24.880 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:24.881 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:24.881 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7105/3c644a63-9147-418b-9a85-020e8f8c8652/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:24.972 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:24.973 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:24.973 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108905 s, 96.3 MB/s 2020-06-12T17:50:24.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:24.974 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:24.974 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:24.990 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:24.990 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:24.991 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7105/3c644a63-9147-418b-9a85-020e8f8c8652/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:25.080 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:25.080 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:25.081 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133948 s, 78.3 MB/s 2020-06-12T17:50:25.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:25.082 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:25.083 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:25.098 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:25.099 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:25.099 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7105/3c644a63-9147-418b-9a85-020e8f8c8652/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:25.186 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:25.186 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:25.187 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112248 s, 93.4 MB/s 2020-06-12T17:50:25.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:25.188 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:25.189 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:25.212 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:25.213 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:25.213 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7105/3c644a63-9147-418b-9a85-020e8f8c8652/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:25.301 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:25.301 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:25.301 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121972 s, 86.0 MB/s 2020-06-12T17:50:25.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:25.303 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:25.303 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:25.319 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:25.320 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:25.320 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7105/3c644a63-9147-418b-9a85-020e8f8c8652/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:25.409 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:25.410 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:25.410 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124522 s, 84.2 MB/s 2020-06-12T17:50:25.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:25.412 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:25.412 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:25.427 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:25.427 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:25.428 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7105/3c644a63-9147-418b-9a85-020e8f8c8652/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:25.516 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:25.517 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:25.517 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115075 s, 91.1 MB/s 2020-06-12T17:50:25.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:25.519 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:25.519 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:25.539 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:25.540 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:25.540 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7105/3c644a63-9147-418b-9a85-020e8f8c8652/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:25.623 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:25.623 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:25.623 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108762 s, 96.4 MB/s 2020-06-12T17:50:25.624 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_6181 2020-06-12T17:50:25.754 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.738+0000 7fdd45911700 1 Processor -- start 2020-06-12T17:50:25.755 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.738+0000 7fdd45911700 1 -- start start 2020-06-12T17:50:25.755 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.739+0000 7fdd45911700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd40146680 0x7fdd400ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:25.755 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.739+0000 7fdd45911700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdd400b2eb0 0x7fdd4009d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:25.755 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.739+0000 7fdd45911700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd40146d20 con 0x7fdd4009d620 2020-06-12T17:50:25.755 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.739+0000 7fdd45911700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd40066a80 con 0x7fdd400b2eb0 2020-06-12T17:50:25.756 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.739+0000 7fdd45911700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd40146f50 con 0x7fdd40146680 2020-06-12T17:50:25.756 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.740+0000 7fdd3e7fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdd400b2eb0 0x7fdd4009d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:25.756 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.740+0000 7fdd3f7fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fdd4009d620 0x7fdd4009b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40548/0 (socket says 172.21.15.38:40548) 2020-06-12T17:50:25.756 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.740+0000 7fdd3e7fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdd400b2eb0 0x7fdd4009d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38730/0 (socket says 172.21.15.38:38730) 2020-06-12T17:50:25.756 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.740+0000 7fdd3f7fe700 1 -- 172.21.15.38:0/3093331510 learned_addr learned my addr 172.21.15.38:0/3093331510 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:25.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.740+0000 7fdd3effd700 1 --2- 172.21.15.38:0/3093331510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd40146680 0x7fdd400ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:25.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.740+0000 7fdd3e7fc700 1 -- 172.21.15.38:0/3093331510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd40146680 msgr2=0x7fdd400ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:25.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.740+0000 7fdd3e7fc700 1 --2- 172.21.15.38:0/3093331510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd40146680 0x7fdd400ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:25.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.740+0000 7fdd3e7fc700 1 -- 172.21.15.38:0/3093331510 >> v1:172.21.15.38:6789/0 conn(0x7fdd4009d620 legacy=0x7fdd4009b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:25.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.740+0000 7fdd3dffb700 1 -- 172.21.15.38:0/3093331510 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201963965 0 0) 0x7fdd40146d20 con 0x7fdd4009d620 2020-06-12T17:50:25.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.740+0000 7fdd3e7fc700 1 -- 172.21.15.38:0/3093331510 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd40146a60 con 0x7fdd400b2eb0 2020-06-12T17:50:25.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.740+0000 7fdd3e7fc700 1 --2- 172.21.15.38:0/3093331510 >> v2:172.21.15.38:3300/0 conn(0x7fdd400b2eb0 0x7fdd4009d1c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdd30002f30 tx=0x7fdd30007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:25.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.740+0000 7fdd3e7fc700 1 --2- 172.21.15.38:0/3093331510 >> v2:172.21.15.38:3300/0 conn(0x7fdd400b2eb0 0x7fdd4009d1c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdd30002f30 tx=0x7fdd30007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:25.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.740+0000 7fdd3e7fc700 1 --2- 172.21.15.38:0/3093331510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd400b2eb0 0x7fdd4009d1c0 secure :-1 s=READY pgs=661 cs=0 l=1 rx=0x7fdd30002f30 tx=0x7fdd30007e60).ready entity=mon.0 client_cookie=4cdbfc00498c2d6f server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:25.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.740+0000 7fdd3e7fc700 1 --2- 172.21.15.38:0/3093331510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd400b2eb0 0x7fdd4009d1c0 secure :-1 s=THROTTLE_DONE pgs=661 cs=0 l=1 rx=0x7fdd30002f30 tx=0x7fdd30007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:25.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.740+0000 7fdd3dffb700 1 -- 172.21.15.38:0/3093331510 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd30011430 con 0x7fdd400b2eb0 2020-06-12T17:50:25.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.740+0000 7fdd3e7fc700 1 --2- 172.21.15.38:0/3093331510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd400b2eb0 0x7fdd4009d1c0 secure :-1 s=THROTTLE_DONE pgs=661 cs=0 l=1 rx=0x7fdd30002f30 tx=0x7fdd30007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:25.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.740+0000 7fdd3e7fc700 1 --2- 172.21.15.38:0/3093331510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd400b2eb0 0x7fdd4009d1c0 secure :-1 s=THROTTLE_DONE pgs=661 cs=0 l=1 rx=0x7fdd30002f30 tx=0x7fdd30007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:25.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.740+0000 7fdd3dffb700 1 -- 172.21.15.38:0/3093331510 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd30011590 con 0x7fdd400b2eb0 2020-06-12T17:50:25.760 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.740+0000 7fdd3dffb700 1 -- 172.21.15.38:0/3093331510 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd30011970 con 0x7fdd400b2eb0 2020-06-12T17:50:25.760 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.740+0000 7fdd45911700 1 -- 172.21.15.38:0/3093331510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd400b2eb0 msgr2=0x7fdd4009d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:25.760 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.740+0000 7fdd45911700 1 --2- 172.21.15.38:0/3093331510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd400b2eb0 0x7fdd4009d1c0 secure :-1 s=READY pgs=661 cs=0 l=1 rx=0x7fdd30002f30 tx=0x7fdd30007e60).stop 2020-06-12T17:50:25.760 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.741+0000 7fdd45911700 1 -- 172.21.15.38:0/3093331510 shutdown_connections 2020-06-12T17:50:25.760 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.741+0000 7fdd45911700 1 --2- 172.21.15.38:0/3093331510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd40146680 0x7fdd400ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:25.760 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.741+0000 7fdd45911700 1 --2- 172.21.15.38:0/3093331510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd400b2eb0 0x7fdd4009d1c0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:25.761 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.741+0000 7fdd45911700 1 -- 172.21.15.38:0/3093331510 >> 172.21.15.38:0/3093331510 conn(0x7fdd400b5a20 msgr2=0x7fdd4005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:25.761 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.741+0000 7fdd45911700 1 -- 172.21.15.38:0/3093331510 shutdown_connections 2020-06-12T17:50:25.761 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.741+0000 7fdd45911700 1 -- 172.21.15.38:0/3093331510 wait complete. 2020-06-12T17:50:25.761 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.742+0000 7fdd45911700 1 Processor -- start 2020-06-12T17:50:25.761 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.742+0000 7fdd45911700 1 -- start start 2020-06-12T17:50:25.762 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd45911700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd4009d620 0x7fdd40143670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:25.762 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd45911700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd40157a10 con 0x7fdd400b2eb0 2020-06-12T17:50:25.762 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd45911700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd40144950 con 0x7fdd40146680 2020-06-12T17:50:25.762 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd45911700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd40157770 con 0x7fdd4009d620 2020-06-12T17:50:25.763 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd3e7fc700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fdd400b2eb0 0x7fdd4013df60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40552/0 (socket says 172.21.15.38:40552) 2020-06-12T17:50:25.767 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd3e7fc700 1 -- 172.21.15.38:0/2105310071 learned_addr learned my addr 172.21.15.38:0/2105310071 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:25.767 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd3effd700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd4009d620 0x7fdd40143670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:25.768 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd2ffff700 1 -- 172.21.15.38:0/2105310071 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497931729 0 0) 0x7fdd40157a10 con 0x7fdd400b2eb0 2020-06-12T17:50:25.768 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd2ffff700 1 -- 172.21.15.38:0/2105310071 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd1c002fe0 con 0x7fdd400b2eb0 2020-06-12T17:50:25.768 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd2ffff700 1 -- 172.21.15.38:0/2105310071 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511881975 0 0) 0x7fdd40144950 con 0x7fdd40146680 2020-06-12T17:50:25.768 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd2ffff700 1 -- 172.21.15.38:0/2105310071 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd40157a10 con 0x7fdd40146680 2020-06-12T17:50:25.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd2ffff700 1 -- 172.21.15.38:0/2105310071 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1032932936 0 0) 0x7fdd1c002fe0 con 0x7fdd400b2eb0 2020-06-12T17:50:25.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd2ffff700 1 -- 172.21.15.38:0/2105310071 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdd40144950 con 0x7fdd400b2eb0 2020-06-12T17:50:25.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd2ffff700 1 -- 172.21.15.38:0/2105310071 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fdd30008e10 con 0x7fdd400b2eb0 2020-06-12T17:50:25.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd2ffff700 1 -- 172.21.15.38:0/2105310071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd4009d620 msgr2=0x7fdd40143670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:25.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd2ffff700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd4009d620 0x7fdd40143670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:25.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd2ffff700 1 -- 172.21.15.38:0/2105310071 >> v1:172.21.15.150:6789/0 conn(0x7fdd40146680 legacy=0x7fdd400aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:25.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd2ffff700 1 -- 172.21.15.38:0/2105310071 >> v1:172.21.15.38:6789/0 conn(0x7fdd400b2eb0 legacy=0x7fdd4013df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:25.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd2ffff700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd1c004b20 0x7fdd1c004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:25.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd2ffff700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd1c003ab0 0x7fdd1c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:25.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd2ffff700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd1c004390 0x7fdd1c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:25.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd2ffff700 1 -- 172.21.15.38:0/2105310071 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd40157770 con 0x7fdd1c004390 2020-06-12T17:50:25.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd2ffff700 1 -- 172.21.15.38:0/2105310071 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c004810 con 0x7fdd1c004b20 2020-06-12T17:50:25.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd2ffff700 1 -- 172.21.15.38:0/2105310071 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c00bbb0 con 0x7fdd1c003ab0 2020-06-12T17:50:25.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd3effd700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd4009d620 0x7fdd40143670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:50:25.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd3f7fe700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd1c004390 0x7fdd1c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:25.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.743+0000 7fdd3e7fc700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd1c003ab0 0x7fdd1c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:25.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.744+0000 7fdd3effd700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd1c004b20 0x7fdd1c004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:25.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.744+0000 7fdd3f7fe700 1 -- 172.21.15.38:0/2105310071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd1c003ab0 msgr2=0x7fdd1c003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:25.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.744+0000 7fdd3f7fe700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd1c003ab0 0x7fdd1c003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:25.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.744+0000 7fdd3f7fe700 1 -- 172.21.15.38:0/2105310071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd1c004b20 msgr2=0x7fdd1c004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:25.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.744+0000 7fdd3f7fe700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd1c004b20 0x7fdd1c004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:25.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.744+0000 7fdd3f7fe700 1 -- 172.21.15.38:0/2105310071 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd401444b0 con 0x7fdd1c004390 2020-06-12T17:50:25.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.744+0000 7fdd3effd700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd1c004b20 0x7fdd1c004f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:50:25.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.744+0000 7fdd45911700 1 -- 172.21.15.38:0/2105310071 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd401574a0 con 0x7fdd1c004390 2020-06-12T17:50:25.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.744+0000 7fdd45911700 1 -- 172.21.15.38:0/2105310071 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd4013e830 con 0x7fdd1c004390 2020-06-12T17:50:25.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.744+0000 7fdd3f7fe700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd1c004390 0x7fdd1c00b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd38001320 tx=0x7fdd38001b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:25.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.744+0000 7fdd3f7fe700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd1c004390 0x7fdd1c00b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd38001320 tx=0x7fdd38001b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:25.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.744+0000 7fdd3f7fe700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd1c004390 0x7fdd1c00b750 secure :-1 s=READY pgs=663 cs=0 l=1 rx=0x7fdd38001320 tx=0x7fdd38001b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:25.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.744+0000 7fdd3f7fe700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd1c004390 0x7fdd1c00b750 secure :-1 s=THROTTLE_DONE pgs=663 cs=0 l=1 rx=0x7fdd38001320 tx=0x7fdd38001b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:25.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.744+0000 7fdd2ffff700 1 -- 172.21.15.38:0/2105310071 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd3800cdb0 con 0x7fdd1c004390 2020-06-12T17:50:25.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.744+0000 7fdd3f7fe700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd1c004390 0x7fdd1c00b750 secure :-1 s=THROTTLE_DONE pgs=663 cs=0 l=1 rx=0x7fdd38001320 tx=0x7fdd38001b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:25.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.744+0000 7fdd3f7fe700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd1c004390 0x7fdd1c00b750 secure :-1 s=THROTTLE_DONE pgs=663 cs=0 l=1 rx=0x7fdd38001320 tx=0x7fdd38001b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:25.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.744+0000 7fdd2ffff700 1 -- 172.21.15.38:0/2105310071 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd38005940 con 0x7fdd1c004390 2020-06-12T17:50:25.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.744+0000 7fdd2ffff700 1 -- 172.21.15.38:0/2105310071 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd38005ca0 con 0x7fdd1c004390 2020-06-12T17:50:25.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.745+0000 7fdd3f7fe700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd1c004390 0x7fdd1c00b750 secure :-1 s=THROTTLE_DONE pgs=663 cs=0 l=1 rx=0x7fdd38001320 tx=0x7fdd38001b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:25.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.745+0000 7fdd45911700 1 -- 172.21.15.38:0/2105310071 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd20003340 con 0x7fdd1c004390 2020-06-12T17:50:25.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.745+0000 7fdd2ffff700 1 -- 172.21.15.38:0/2105310071 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fdd38012770 con 0x7fdd1c004390 2020-06-12T17:50:25.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.745+0000 7fdd3f7fe700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd1c004390 0x7fdd1c00b750 secure :-1 s=THROTTLE_DONE pgs=663 cs=0 l=1 rx=0x7fdd38001320 tx=0x7fdd38001b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:25.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.745+0000 7fdd2ffff700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdd1c055db0 0x7fdd1c058270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:25.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.745+0000 7fdd2ffff700 1 -- 172.21.15.38:0/2105310071 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fdd380612f0 con 0x7fdd1c004390 2020-06-12T17:50:25.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.746+0000 7fdd3effd700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdd1c055db0 0x7fdd1c058270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:25.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.746+0000 7fdd3effd700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdd1c055db0 0x7fdd1c058270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd34002f30 tx=0x7fdd3400e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:25.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.746+0000 7fdd3effd700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdd1c055db0 0x7fdd1c058270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd34002f30 tx=0x7fdd3400e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:25.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.746+0000 7fdd3effd700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdd1c055db0 0x7fdd1c058270 secure :-1 s=READY pgs=262 cs=0 l=1 rx=0x7fdd34002f30 tx=0x7fdd3400e0c0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:25.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.749+0000 7fdd3f7fe700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd1c004390 0x7fdd1c00b750 secure :-1 s=THROTTLE_DONE pgs=663 cs=0 l=1 rx=0x7fdd38001320 tx=0x7fdd38001b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:25.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.749+0000 7fdd2ffff700 1 -- 172.21.15.38:0/2105310071 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fdd3803cad0 con 0x7fdd1c004390 2020-06-12T17:50:25.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.944+0000 7fdd45911700 1 -- 172.21.15.38:0/2105310071 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_6181", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd20002200 con 0x7fdd1c055db0 2020-06-12T17:50:25.967 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.964+0000 7fdd3effd700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdd1c055db0 0x7fdd1c058270 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7fdd34002f30 tx=0x7fdd3400e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:25.968 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.964+0000 7fdd2ffff700 1 -- 172.21.15.38:0/2105310071 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fdd20002200 con 0x7fdd1c055db0 2020-06-12T17:50:25.969 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.965+0000 7fdd45911700 1 -- 172.21.15.38:0/2105310071 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdd1c055db0 msgr2=0x7fdd1c058270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:25.969 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.965+0000 7fdd45911700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fdd1c055db0 0x7fdd1c058270 secure :-1 s=READY pgs=262 cs=0 l=1 rx=0x7fdd34002f30 tx=0x7fdd3400e0c0).stop 2020-06-12T17:50:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.965+0000 7fdd45911700 1 -- 172.21.15.38:0/2105310071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd1c004390 msgr2=0x7fdd1c00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.965+0000 7fdd45911700 1 --2- 172.21.15.38:0/2105310071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd1c004390 0x7fdd1c00b750 secure :-1 s=READY pgs=663 cs=0 l=1 rx=0x7fdd38001320 tx=0x7fdd38001b80).stop 2020-06-12T17:50:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.965+0000 7fdd3f7fe700 1 -- 172.21.15.38:0/2105310071 reap_dead start 2020-06-12T17:50:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.965+0000 7fdd3f7fe700 1 -- 172.21.15.38:0/2105310071 reap_dead start 2020-06-12T17:50:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.965+0000 7fdd45911700 1 -- 172.21.15.38:0/2105310071 shutdown_connections 2020-06-12T17:50:25.971 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.965+0000 7fdd45911700 1 -- 172.21.15.38:0/2105310071 >> 172.21.15.38:0/2105310071 conn(0x7fdd400b5a20 msgr2=0x7fdd40144d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:25.971 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.965+0000 7fdd45911700 1 -- 172.21.15.38:0/2105310071 shutdown_connections 2020-06-12T17:50:25.971 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:25.965+0000 7fdd45911700 1 -- 172.21.15.38:0/2105310071 wait complete. 2020-06-12T17:50:25.979 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_6181 2020-06-12T17:50:26.098 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.094+0000 7f4be0f24700 1 Processor -- start 2020-06-12T17:50:26.098 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.094+0000 7f4be0f24700 1 -- start start 2020-06-12T17:50:26.100 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.095+0000 7f4be0f24700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4bdc146680 0x7f4bdc0ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:26.100 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.095+0000 7f4be0f24700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bdc146d20 con 0x7f4bdc0b2eb0 2020-06-12T17:50:26.101 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.095+0000 7f4be0f24700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bdc066a80 con 0x7f4bdc09d8d0 2020-06-12T17:50:26.101 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.095+0000 7f4be0f24700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bdc146f50 con 0x7f4bdc146680 2020-06-12T17:50:26.101 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.095+0000 7f4bda59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4bdc146680 0x7f4bdc0ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:26.101 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.095+0000 7f4bda59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4bdc146680 0x7f4bdc0ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38748/0 (socket says 172.21.15.38:38748) 2020-06-12T17:50:26.103 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.095+0000 7f4bd9d9b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4bdc0b2eb0 0x7f4bdc09d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40564/0 (socket says 172.21.15.38:40564) 2020-06-12T17:50:26.103 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.095+0000 7f4bda59c700 1 -- 172.21.15.38:0/1953053095 learned_addr learned my addr 172.21.15.38:0/1953053095 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:26.103 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.096+0000 7f4bda59c700 1 -- 172.21.15.38:0/1953053095 >> v1:172.21.15.150:6789/0 conn(0x7f4bdc09d8d0 legacy=0x7f4bdc1421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:26.104 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.096+0000 7f4bda59c700 1 -- 172.21.15.38:0/1953053095 >> v1:172.21.15.38:6789/0 conn(0x7f4bdc0b2eb0 legacy=0x7f4bdc09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:26.104 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.096+0000 7f4bd959a700 1 -- 172.21.15.38:0/1953053095 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320199386 0 0) 0x7f4bdc146d20 con 0x7f4bdc0b2eb0 2020-06-12T17:50:26.104 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.096+0000 7f4bda59c700 1 -- 172.21.15.38:0/1953053095 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bdc146a60 con 0x7f4bdc146680 2020-06-12T17:50:26.104 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.096+0000 7f4bda59c700 1 --2- 172.21.15.38:0/1953053095 >> v2:172.21.15.38:3300/0 conn(0x7f4bdc146680 0x7f4bdc0ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4bd0002f30 tx=0x7f4bd0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:26.104 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.096+0000 7f4bda59c700 1 --2- 172.21.15.38:0/1953053095 >> v2:172.21.15.38:3300/0 conn(0x7f4bdc146680 0x7f4bdc0ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4bd0002f30 tx=0x7f4bd0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:26.105 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.096+0000 7f4bda59c700 1 --2- 172.21.15.38:0/1953053095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bdc146680 0x7f4bdc0ad5b0 secure :-1 s=READY pgs=665 cs=0 l=1 rx=0x7f4bd0002f30 tx=0x7f4bd0007e60).ready entity=mon.0 client_cookie=5dace4a18cfa6384 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:26.105 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.096+0000 7f4bda59c700 1 --2- 172.21.15.38:0/1953053095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bdc146680 0x7f4bdc0ad5b0 secure :-1 s=THROTTLE_DONE pgs=665 cs=0 l=1 rx=0x7f4bd0002f30 tx=0x7f4bd0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:26.106 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.096+0000 7f4bd959a700 1 -- 172.21.15.38:0/1953053095 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bd00116e0 con 0x7f4bdc146680 2020-06-12T17:50:26.106 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.096+0000 7f4bda59c700 1 --2- 172.21.15.38:0/1953053095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bdc146680 0x7f4bdc0ad5b0 secure :-1 s=THROTTLE_DONE pgs=665 cs=0 l=1 rx=0x7f4bd0002f30 tx=0x7f4bd0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:26.106 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.096+0000 7f4bda59c700 1 --2- 172.21.15.38:0/1953053095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bdc146680 0x7f4bdc0ad5b0 secure :-1 s=THROTTLE_DONE pgs=665 cs=0 l=1 rx=0x7f4bd0002f30 tx=0x7f4bd0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:26.107 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.096+0000 7f4bd959a700 1 -- 172.21.15.38:0/1953053095 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd0011840 con 0x7f4bdc146680 2020-06-12T17:50:26.107 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.096+0000 7f4bd959a700 1 -- 172.21.15.38:0/1953053095 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bd0011c20 con 0x7f4bdc146680 2020-06-12T17:50:26.107 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.096+0000 7f4be0f24700 1 -- 172.21.15.38:0/1953053095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bdc146680 msgr2=0x7f4bdc0ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:26.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.096+0000 7f4be0f24700 1 --2- 172.21.15.38:0/1953053095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bdc146680 0x7f4bdc0ad5b0 secure :-1 s=READY pgs=665 cs=0 l=1 rx=0x7f4bd0002f30 tx=0x7f4bd0007e60).stop 2020-06-12T17:50:26.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.096+0000 7f4be0f24700 1 -- 172.21.15.38:0/1953053095 shutdown_connections 2020-06-12T17:50:26.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.096+0000 7f4be0f24700 1 --2- 172.21.15.38:0/1953053095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bdc146680 0x7f4bdc0ad5b0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:26.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.097+0000 7f4be0f24700 1 -- 172.21.15.38:0/1953053095 >> 172.21.15.38:0/1953053095 conn(0x7f4bdc0b5a20 msgr2=0x7f4bdc05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:26.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.097+0000 7f4be0f24700 1 -- 172.21.15.38:0/1953053095 shutdown_connections 2020-06-12T17:50:26.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.097+0000 7f4be0f24700 1 -- 172.21.15.38:0/1953053095 wait complete. 2020-06-12T17:50:26.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.097+0000 7f4be0f24700 1 Processor -- start 2020-06-12T17:50:26.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.098+0000 7f4be0f24700 1 -- start start 2020-06-12T17:50:26.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.098+0000 7f4be0f24700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4bdc09d8d0 0x7f4bdc0629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:26.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.098+0000 7f4be0f24700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bdc0b2eb0 0x7f4bdc0b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:26.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.098+0000 7f4be0f24700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bdc062f50 con 0x7f4bdc146680 2020-06-12T17:50:26.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.098+0000 7f4be0f24700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bdc1503b0 con 0x7f4bdc09d8d0 2020-06-12T17:50:26.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.098+0000 7f4be0f24700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc1500e0 con 0x7f4bdc0b2eb0 2020-06-12T17:50:26.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.098+0000 7f4bda59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4bdc09d8d0 0x7f4bdc0629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:26.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.098+0000 7f4bda59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4bdc09d8d0 0x7f4bdc0629d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38752/0 (socket says 172.21.15.38:38752) 2020-06-12T17:50:26.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.098+0000 7f4bda59c700 1 -- 172.21.15.38:0/1717607458 learned_addr learned my addr 172.21.15.38:0/1717607458 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:26.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.098+0000 7f4bdad9d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4bdc146680 0x7f4bdc150850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40572/0 (socket says 172.21.15.38:40572) 2020-06-12T17:50:26.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.098+0000 7f4bd9d9b700 1 --2- 172.21.15.38:0/1717607458 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bdc0b2eb0 0x7f4bdc0b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:26.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.099+0000 7f4bda59c700 1 -- 172.21.15.38:0/1717607458 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bdc0b2eb0 msgr2=0x7f4bdc0b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:26.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.099+0000 7f4bda59c700 1 --2- 172.21.15.38:0/1717607458 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bdc0b2eb0 0x7f4bdc0b0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:26.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.099+0000 7f4bda59c700 1 -- 172.21.15.38:0/1717607458 >> v1:172.21.15.38:6789/0 conn(0x7f4bdc146680 legacy=0x7f4bdc150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:26.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.099+0000 7f4bcb7fe700 1 -- 172.21.15.38:0/1717607458 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2726520229 0 0) 0x7f4bdc062f50 con 0x7f4bdc146680 2020-06-12T17:50:26.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.099+0000 7f4bda59c700 1 -- 172.21.15.38:0/1717607458 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bdc150f60 con 0x7f4bdc09d8d0 2020-06-12T17:50:26.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.099+0000 7f4bd9d9b700 1 --2- 172.21.15.38:0/1717607458 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bdc0b2eb0 0x7f4bdc0b0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:50:26.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.099+0000 7f4bda59c700 1 --2- 172.21.15.38:0/1717607458 >> v2:172.21.15.38:3300/0 conn(0x7f4bdc09d8d0 0x7f4bdc0629d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4bd0002f30 tx=0x7f4bd0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:26.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.099+0000 7f4bda59c700 1 --2- 172.21.15.38:0/1717607458 >> v2:172.21.15.38:3300/0 conn(0x7f4bdc09d8d0 0x7f4bdc0629d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4bd0002f30 tx=0x7f4bd0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:26.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.099+0000 7f4bda59c700 1 --2- 172.21.15.38:0/1717607458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bdc09d8d0 0x7f4bdc0629d0 secure :-1 s=READY pgs=667 cs=0 l=1 rx=0x7f4bd0002f30 tx=0x7f4bd0007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:26.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.099+0000 7f4bda59c700 1 --2- 172.21.15.38:0/1717607458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bdc09d8d0 0x7f4bdc0629d0 secure :-1 s=THROTTLE_DONE pgs=667 cs=0 l=1 rx=0x7f4bd0002f30 tx=0x7f4bd0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:26.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.099+0000 7f4bcb7fe700 1 -- 172.21.15.38:0/1717607458 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bd0011e90 con 0x7f4bdc09d8d0 2020-06-12T17:50:26.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.099+0000 7f4bda59c700 1 --2- 172.21.15.38:0/1717607458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bdc09d8d0 0x7f4bdc0629d0 secure :-1 s=THROTTLE_DONE pgs=667 cs=0 l=1 rx=0x7f4bd0002f30 tx=0x7f4bd0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:26.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.099+0000 7f4bda59c700 1 --2- 172.21.15.38:0/1717607458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bdc09d8d0 0x7f4bdc0629d0 secure :-1 s=THROTTLE_DONE pgs=667 cs=0 l=1 rx=0x7f4bd0002f30 tx=0x7f4bd0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:26.118 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.099+0000 7f4bcb7fe700 1 -- 172.21.15.38:0/1717607458 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd0007340 con 0x7f4bdc09d8d0 2020-06-12T17:50:26.118 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.099+0000 7f4be0f24700 1 -- 172.21.15.38:0/1717607458 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bdc0b1450 con 0x7f4bdc09d8d0 2020-06-12T17:50:26.118 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.099+0000 7f4bcb7fe700 1 -- 172.21.15.38:0/1717607458 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bd00056c0 con 0x7f4bdc09d8d0 2020-06-12T17:50:26.118 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.099+0000 7f4be0f24700 1 -- 172.21.15.38:0/1717607458 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bdc0632c0 con 0x7f4bdc09d8d0 2020-06-12T17:50:26.118 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.100+0000 7f4bda59c700 1 --2- 172.21.15.38:0/1717607458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bdc09d8d0 0x7f4bdc0629d0 secure :-1 s=THROTTLE_DONE pgs=667 cs=0 l=1 rx=0x7f4bd0002f30 tx=0x7f4bd0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:26.119 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.100+0000 7f4bcb7fe700 1 -- 172.21.15.38:0/1717607458 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f4bd00058f0 con 0x7f4bdc09d8d0 2020-06-12T17:50:26.119 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.100+0000 7f4bda59c700 1 --2- 172.21.15.38:0/1717607458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bdc09d8d0 0x7f4bdc0629d0 secure :-1 s=THROTTLE_DONE pgs=667 cs=0 l=1 rx=0x7f4bd0002f30 tx=0x7f4bd0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:26.119 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.100+0000 7f4be0f24700 1 -- 172.21.15.38:0/1717607458 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bdc1510f0 con 0x7f4bdc09d8d0 2020-06-12T17:50:26.119 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.100+0000 7f4bcb7fe700 1 --2- 172.21.15.38:0/1717607458 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4bb804d550 0x7f4bb804fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:26.119 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.100+0000 7f4bcb7fe700 1 -- 172.21.15.38:0/1717607458 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f4bd00615b0 con 0x7f4bdc09d8d0 2020-06-12T17:50:26.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.101+0000 7f4bd9d9b700 1 --2- 172.21.15.38:0/1717607458 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4bb804d550 0x7f4bb804fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:26.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.101+0000 7f4bd9d9b700 1 --2- 172.21.15.38:0/1717607458 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4bb804d550 0x7f4bb804fa10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4bcc000f00 tx=0x7f4bcc001a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:26.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.101+0000 7f4bd9d9b700 1 --2- 172.21.15.38:0/1717607458 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4bb804d550 0x7f4bb804fa10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4bcc000f00 tx=0x7f4bcc001a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:26.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.101+0000 7f4bd9d9b700 1 --2- 172.21.15.38:0/1717607458 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4bb804d550 0x7f4bb804fa10 secure :-1 s=READY pgs=263 cs=0 l=1 rx=0x7f4bcc000f00 tx=0x7f4bcc001a40).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:26.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.104+0000 7f4bda59c700 1 --2- 172.21.15.38:0/1717607458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bdc09d8d0 0x7f4bdc0629d0 secure :-1 s=THROTTLE_DONE pgs=667 cs=0 l=1 rx=0x7f4bd0002f30 tx=0x7f4bd0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:26.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.104+0000 7f4bcb7fe700 1 -- 172.21.15.38:0/1717607458 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f4bdc1510f0 con 0x7f4bdc09d8d0 2020-06-12T17:50:26.303 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.300+0000 7f4be0f24700 1 -- 172.21.15.38:0/1717607458 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_6181", "target": ["mon-mgr", ""]}) v1 -- 0x7f4bdc1510f0 con 0x7f4bb804d550 2020-06-12T17:50:26.309 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.303+0000 7f4bd9d9b700 1 --2- 172.21.15.38:0/1717607458 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4bb804d550 0x7f4bb804fa10 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f4bcc000f00 tx=0x7f4bcc001a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:26.309 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.303+0000 7f4bcb7fe700 1 -- 172.21.15.38:0/1717607458 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f4bdc1510f0 con 0x7f4bb804d550 2020-06-12T17:50:26.309 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.304+0000 7f4be0f24700 1 -- 172.21.15.38:0/1717607458 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4bb804d550 msgr2=0x7f4bb804fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:26.310 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.304+0000 7f4be0f24700 1 --2- 172.21.15.38:0/1717607458 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4bb804d550 0x7f4bb804fa10 secure :-1 s=READY pgs=263 cs=0 l=1 rx=0x7f4bcc000f00 tx=0x7f4bcc001a40).stop 2020-06-12T17:50:26.310 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.304+0000 7f4be0f24700 1 -- 172.21.15.38:0/1717607458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bdc09d8d0 msgr2=0x7f4bdc0629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:26.310 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.304+0000 7f4be0f24700 1 --2- 172.21.15.38:0/1717607458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bdc09d8d0 0x7f4bdc0629d0 secure :-1 s=READY pgs=667 cs=0 l=1 rx=0x7f4bd0002f30 tx=0x7f4bd0007e60).stop 2020-06-12T17:50:26.310 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.304+0000 7f4be0f24700 1 -- 172.21.15.38:0/1717607458 shutdown_connections 2020-06-12T17:50:26.310 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.304+0000 7f4be0f24700 1 --2- 172.21.15.38:0/1717607458 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4bb804d550 0x7f4bb804fa10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:26.311 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.304+0000 7f4be0f24700 1 --2- 172.21.15.38:0/1717607458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bdc09d8d0 0x7f4bdc0629d0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:26.311 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.304+0000 7f4be0f24700 1 --2- 172.21.15.38:0/1717607458 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bdc0b2eb0 0x7f4bdc0b0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:26.311 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.304+0000 7f4be0f24700 1 -- 172.21.15.38:0/1717607458 >> 172.21.15.38:0/1717607458 conn(0x7f4bdc0b5a20 msgr2=0x7f4bdc0b7700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:26.311 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.304+0000 7f4be0f24700 1 -- 172.21.15.38:0/1717607458 shutdown_connections 2020-06-12T17:50:26.311 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:26.305+0000 7f4be0f24700 1 -- 172.21.15.38:0/1717607458 wait complete. 2020-06-12T17:50:26.312 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_6181/7eb070da-0093-4225-83be-dc4f70db53eb 2020-06-12T17:50:26.320 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_6181 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_6181/7eb070da-0093-4225-83be-dc4f70db53eb 2020-06-12T17:50:26.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:26.321 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:26.321 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:26.339 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:26.339 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:26.340 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6181/7eb070da-0093-4225-83be-dc4f70db53eb/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:26.434 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:26.435 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:26.435 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012703 s, 82.5 MB/s 2020-06-12T17:50:26.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:26.436 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:26.437 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:26.460 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:26.460 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:26.461 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6181/7eb070da-0093-4225-83be-dc4f70db53eb/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:26.549 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:26.550 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:26.550 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124305 s, 84.4 MB/s 2020-06-12T17:50:26.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:26.552 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:26.553 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:26.568 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:26.568 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:26.569 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6181/7eb070da-0093-4225-83be-dc4f70db53eb/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:26.656 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:26.657 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:26.657 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103551 s, 101 MB/s 2020-06-12T17:50:26.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:26.658 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:26.659 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:26.674 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:26.674 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:26.675 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6181/7eb070da-0093-4225-83be-dc4f70db53eb/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:26.762 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:26.762 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:26.762 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00913754 s, 115 MB/s 2020-06-12T17:50:26.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:26.763 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:26.764 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:26.783 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:26.784 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:26.784 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6181/7eb070da-0093-4225-83be-dc4f70db53eb/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:26.871 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:26.872 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:26.872 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120007 s, 87.4 MB/s 2020-06-12T17:50:26.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:26.873 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:26.874 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:26.889 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:26.890 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:26.892 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6181/7eb070da-0093-4225-83be-dc4f70db53eb/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:26.983 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:26.984 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:26.984 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013692 s, 76.6 MB/s 2020-06-12T17:50:26.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:26.986 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:26.986 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:27.002 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:27.002 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:27.004 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6181/7eb070da-0093-4225-83be-dc4f70db53eb/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:27.094 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:27.094 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:27.094 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112746 s, 93.0 MB/s 2020-06-12T17:50:27.096 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:27.097 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:27.097 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:27.113 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:27.113 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:27.114 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6181/7eb070da-0093-4225-83be-dc4f70db53eb/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:27.201 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:27.201 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:27.202 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115633 s, 90.7 MB/s 2020-06-12T17:50:27.203 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:27.203 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:27.204 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:27.221 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:27.222 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:27.223 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6181/7eb070da-0093-4225-83be-dc4f70db53eb/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:27.314 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:27.315 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:27.315 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154993 s, 67.7 MB/s 2020-06-12T17:50:27.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:27.317 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:27.317 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:27.333 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:27.333 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:27.334 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6181/7eb070da-0093-4225-83be-dc4f70db53eb/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:27.422 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:27.423 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:27.424 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113214 s, 92.6 MB/s 2020-06-12T17:50:27.425 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_4667 2020-06-12T17:50:27.545 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.541+0000 7f7c933b5700 1 Processor -- start 2020-06-12T17:50:27.545 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.542+0000 7f7c933b5700 1 -- start start 2020-06-12T17:50:27.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.542+0000 7f7c933b5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c8c0b3ac0 0x7f7c8c09df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:27.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.542+0000 7f7c933b5700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7c8c142e90 0x7f7c8c13bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:27.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.542+0000 7f7c933b5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7c8c13c3a0 0x7f7c8c0b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:27.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.542+0000 7f7c933b5700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c8c09b960 con 0x7f7c8c142e90 2020-06-12T17:50:27.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.542+0000 7f7c933b5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c8c09bc00 con 0x7f7c8c13c3a0 2020-06-12T17:50:27.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.542+0000 7f7c933b5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c0b48f0 con 0x7f7c8c0b3ac0 2020-06-12T17:50:27.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.543+0000 7f7c90950700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7c8c142e90 0x7f7c8c13bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:27.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.543+0000 7f7c90950700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7c8c142e90 0x7f7c8c13bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38764/0 (socket says 172.21.15.38:38764) 2020-06-12T17:50:27.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.543+0000 7f7c90950700 1 -- 172.21.15.38:0/160823512 learned_addr learned my addr 172.21.15.38:0/160823512 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:27.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.543+0000 7f7c91151700 1 --2- 172.21.15.38:0/160823512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c8c0b3ac0 0x7f7c8c09df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:27.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.543+0000 7f7c91952700 1 --2- 172.21.15.38:0/160823512 >> v2:172.21.15.150:3300/0 conn(0x7f7c8c13c3a0 0x7f7c8c0b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:27.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.543+0000 7f7c90950700 1 -- 172.21.15.38:0/160823512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c8c0b3ac0 msgr2=0x7f7c8c09df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:27.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.543+0000 7f7c90950700 1 --2- 172.21.15.38:0/160823512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c8c0b3ac0 0x7f7c8c09df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:27.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.543+0000 7f7c90950700 1 -- 172.21.15.38:0/160823512 >> v2:172.21.15.150:3300/0 conn(0x7f7c8c13c3a0 msgr2=0x7f7c8c0b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:27.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.543+0000 7f7c90950700 1 --2- 172.21.15.38:0/160823512 >> v2:172.21.15.150:3300/0 conn(0x7f7c8c13c3a0 0x7f7c8c0b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:27.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.543+0000 7f7c90950700 1 -- 172.21.15.38:0/160823512 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8c0b3ea0 con 0x7f7c8c142e90 2020-06-12T17:50:27.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.543+0000 7f7c91151700 1 --2- 172.21.15.38:0/160823512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c8c0b3ac0 0x7f7c8c09df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:50:27.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.543+0000 7f7c90950700 1 --2- 172.21.15.38:0/160823512 >> v2:172.21.15.38:3300/0 conn(0x7f7c8c142e90 0x7f7c8c13bf40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7c88002f30 tx=0x7f7c88007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.543+0000 7f7c90950700 1 --2- 172.21.15.38:0/160823512 >> v2:172.21.15.38:3300/0 conn(0x7f7c8c142e90 0x7f7c8c13bf40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7c88002f30 tx=0x7f7c88007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.543+0000 7f7c90950700 1 --2- 172.21.15.38:0/160823512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c8c142e90 0x7f7c8c13bf40 secure :-1 s=READY pgs=668 cs=0 l=1 rx=0x7f7c88002f30 tx=0x7f7c88007e60).ready entity=mon.0 client_cookie=3559ced160cbb715 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:27.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.543+0000 7f7c90950700 1 --2- 172.21.15.38:0/160823512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c8c142e90 0x7f7c8c13bf40 secure :-1 s=THROTTLE_DONE pgs=668 cs=0 l=1 rx=0x7f7c88002f30 tx=0x7f7c88007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.543+0000 7f7c7ffff700 1 -- 172.21.15.38:0/160823512 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c880116e0 con 0x7f7c8c142e90 2020-06-12T17:50:27.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.543+0000 7f7c90950700 1 --2- 172.21.15.38:0/160823512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c8c142e90 0x7f7c8c13bf40 secure :-1 s=THROTTLE_DONE pgs=668 cs=0 l=1 rx=0x7f7c88002f30 tx=0x7f7c88007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.543+0000 7f7c90950700 1 --2- 172.21.15.38:0/160823512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c8c142e90 0x7f7c8c13bf40 secure :-1 s=THROTTLE_DONE pgs=668 cs=0 l=1 rx=0x7f7c88002f30 tx=0x7f7c88007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.543+0000 7f7c7ffff700 1 -- 172.21.15.38:0/160823512 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c88011840 con 0x7f7c8c142e90 2020-06-12T17:50:27.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.543+0000 7f7c7ffff700 1 -- 172.21.15.38:0/160823512 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c88011c60 con 0x7f7c8c142e90 2020-06-12T17:50:27.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.543+0000 7f7c933b5700 1 -- 172.21.15.38:0/160823512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c8c142e90 msgr2=0x7f7c8c13bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:27.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.543+0000 7f7c933b5700 1 --2- 172.21.15.38:0/160823512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c8c142e90 0x7f7c8c13bf40 secure :-1 s=READY pgs=668 cs=0 l=1 rx=0x7f7c88002f30 tx=0x7f7c88007e60).stop 2020-06-12T17:50:27.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.544+0000 7f7c933b5700 1 -- 172.21.15.38:0/160823512 shutdown_connections 2020-06-12T17:50:27.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.544+0000 7f7c933b5700 1 --2- 172.21.15.38:0/160823512 >> v2:172.21.15.150:3300/0 conn(0x7f7c8c13c3a0 0x7f7c8c0b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:27.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.544+0000 7f7c933b5700 1 --2- 172.21.15.38:0/160823512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c8c0b3ac0 0x7f7c8c09df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:27.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.544+0000 7f7c933b5700 1 --2- 172.21.15.38:0/160823512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c8c142e90 0x7f7c8c13bf40 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:27.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.544+0000 7f7c933b5700 1 -- 172.21.15.38:0/160823512 >> 172.21.15.38:0/160823512 conn(0x7f7c8c0b5a20 msgr2=0x7f7c8c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:27.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.544+0000 7f7c933b5700 1 -- 172.21.15.38:0/160823512 shutdown_connections 2020-06-12T17:50:27.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.544+0000 7f7c933b5700 1 -- 172.21.15.38:0/160823512 wait complete. 2020-06-12T17:50:27.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.545+0000 7f7c933b5700 1 Processor -- start 2020-06-12T17:50:27.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.545+0000 7f7c933b5700 1 -- start start 2020-06-12T17:50:27.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.545+0000 7f7c933b5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7c8c0b3ac0 0x7f7c8c13faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:27.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.545+0000 7f7c933b5700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7c8c13c3a0 0x7f7c8c156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:27.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.546+0000 7f7c933b5700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c8c157770 con 0x7f7c8c142e90 2020-06-12T17:50:27.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.546+0000 7f7c933b5700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c8c062ba0 con 0x7f7c8c13c3a0 2020-06-12T17:50:27.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.546+0000 7f7c933b5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c8c156690 con 0x7f7c8c0b3ac0 2020-06-12T17:50:27.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.546+0000 7f7c90950700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7c8c13c3a0 0x7f7c8c156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:27.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.546+0000 7f7c90950700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7c8c13c3a0 0x7f7c8c156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38768/0 (socket says 172.21.15.38:38768) 2020-06-12T17:50:27.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.546+0000 7f7c90950700 1 -- 172.21.15.38:0/3867293551 learned_addr learned my addr 172.21.15.38:0/3867293551 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:27.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.546+0000 7f7c91952700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7c8c142e90 0x7f7c8c154500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40586/0 (socket says 172.21.15.38:40586) 2020-06-12T17:50:27.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.546+0000 7f7c91151700 1 --2- 172.21.15.38:0/3867293551 >> v2:172.21.15.150:3300/0 conn(0x7f7c8c0b3ac0 0x7f7c8c13faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:27.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.546+0000 7f7c90950700 1 -- 172.21.15.38:0/3867293551 >> v2:172.21.15.150:3300/0 conn(0x7f7c8c0b3ac0 msgr2=0x7f7c8c13faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:27.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.546+0000 7f7c90950700 1 --2- 172.21.15.38:0/3867293551 >> v2:172.21.15.150:3300/0 conn(0x7f7c8c0b3ac0 0x7f7c8c13faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:27.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.546+0000 7f7c90950700 1 -- 172.21.15.38:0/3867293551 >> v1:172.21.15.38:6789/0 conn(0x7f7c8c142e90 legacy=0x7f7c8c154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:27.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.546+0000 7f7c90950700 1 -- 172.21.15.38:0/3867293551 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8c154c10 con 0x7f7c8c13c3a0 2020-06-12T17:50:27.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.546+0000 7f7c7e7fc700 1 -- 172.21.15.38:0/3867293551 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721413663 0 0) 0x7f7c8c157770 con 0x7f7c8c142e90 2020-06-12T17:50:27.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.546+0000 7f7c90950700 1 --2- 172.21.15.38:0/3867293551 >> v2:172.21.15.38:3300/0 conn(0x7f7c8c13c3a0 0x7f7c8c156230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7c88002f30 tx=0x7f7c88007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.546+0000 7f7c90950700 1 --2- 172.21.15.38:0/3867293551 >> v2:172.21.15.38:3300/0 conn(0x7f7c8c13c3a0 0x7f7c8c156230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7c88002f30 tx=0x7f7c88007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.546+0000 7f7c90950700 1 --2- 172.21.15.38:0/3867293551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c8c13c3a0 0x7f7c8c156230 secure :-1 s=READY pgs=670 cs=0 l=1 rx=0x7f7c88002f30 tx=0x7f7c88007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:27.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.546+0000 7f7c90950700 1 --2- 172.21.15.38:0/3867293551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c8c13c3a0 0x7f7c8c156230 secure :-1 s=THROTTLE_DONE pgs=670 cs=0 l=1 rx=0x7f7c88002f30 tx=0x7f7c88007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.546+0000 7f7c7e7fc700 1 -- 172.21.15.38:0/3867293551 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c88007150 con 0x7f7c8c13c3a0 2020-06-12T17:50:27.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.546+0000 7f7c90950700 1 --2- 172.21.15.38:0/3867293551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c8c13c3a0 0x7f7c8c156230 secure :-1 s=THROTTLE_DONE pgs=670 cs=0 l=1 rx=0x7f7c88002f30 tx=0x7f7c88007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.546+0000 7f7c7e7fc700 1 -- 172.21.15.38:0/3867293551 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c880072b0 con 0x7f7c8c13c3a0 2020-06-12T17:50:27.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.546+0000 7f7c90950700 1 --2- 172.21.15.38:0/3867293551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c8c13c3a0 0x7f7c8c156230 secure :-1 s=THROTTLE_DONE pgs=670 cs=0 l=1 rx=0x7f7c88002f30 tx=0x7f7c88007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.546+0000 7f7c7e7fc700 1 -- 172.21.15.38:0/3867293551 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c880056c0 con 0x7f7c8c13c3a0 2020-06-12T17:50:27.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.546+0000 7f7c933b5700 1 -- 172.21.15.38:0/3867293551 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c8c062890 con 0x7f7c8c13c3a0 2020-06-12T17:50:27.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.546+0000 7f7c933b5700 1 -- 172.21.15.38:0/3867293551 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c8c1572d0 con 0x7f7c8c13c3a0 2020-06-12T17:50:27.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.547+0000 7f7c90950700 1 --2- 172.21.15.38:0/3867293551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c8c13c3a0 0x7f7c8c156230 secure :-1 s=THROTTLE_DONE pgs=670 cs=0 l=1 rx=0x7f7c88002f30 tx=0x7f7c88007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.547+0000 7f7c7e7fc700 1 -- 172.21.15.38:0/3867293551 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f7c880058c0 con 0x7f7c8c13c3a0 2020-06-12T17:50:27.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.547+0000 7f7c90950700 1 --2- 172.21.15.38:0/3867293551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c8c13c3a0 0x7f7c8c156230 secure :-1 s=THROTTLE_DONE pgs=670 cs=0 l=1 rx=0x7f7c88002f30 tx=0x7f7c88007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.547+0000 7f7c933b5700 1 -- 172.21.15.38:0/3867293551 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c8c157580 con 0x7f7c8c13c3a0 2020-06-12T17:50:27.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.548+0000 7f7c7e7fc700 1 --2- 172.21.15.38:0/3867293551 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7c6c04d460 0x7f7c6c04f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:27.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.548+0000 7f7c7e7fc700 1 -- 172.21.15.38:0/3867293551 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7c88061450 con 0x7f7c8c13c3a0 2020-06-12T17:50:27.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.548+0000 7f7c91151700 1 --2- 172.21.15.38:0/3867293551 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7c6c04d460 0x7f7c6c04f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:27.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.548+0000 7f7c91151700 1 --2- 172.21.15.38:0/3867293551 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7c6c04d460 0x7f7c6c04f920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7c80002f30 tx=0x7f7c8000dfa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.548+0000 7f7c91151700 1 --2- 172.21.15.38:0/3867293551 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7c6c04d460 0x7f7c6c04f920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7c80002f30 tx=0x7f7c8000dfa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.548+0000 7f7c91151700 1 --2- 172.21.15.38:0/3867293551 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7c6c04d460 0x7f7c6c04f920 secure :-1 s=READY pgs=264 cs=0 l=1 rx=0x7f7c80002f30 tx=0x7f7c8000dfa0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:27.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.551+0000 7f7c90950700 1 --2- 172.21.15.38:0/3867293551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c8c13c3a0 0x7f7c8c156230 secure :-1 s=THROTTLE_DONE pgs=670 cs=0 l=1 rx=0x7f7c88002f30 tx=0x7f7c88007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.551+0000 7f7c7e7fc700 1 -- 172.21.15.38:0/3867293551 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f7c8803cc70 con 0x7f7c8c13c3a0 2020-06-12T17:50:27.755 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.752+0000 7f7c933b5700 1 -- 172.21.15.38:0/3867293551 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_4667", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c8c142230 con 0x7f7c6c04d460 2020-06-12T17:50:27.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.770+0000 7f7c91151700 1 --2- 172.21.15.38:0/3867293551 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7c6c04d460 0x7f7c6c04f920 secure :-1 s=THROTTLE_DONE pgs=264 cs=0 l=1 rx=0x7f7c80002f30 tx=0x7f7c8000dfa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.771+0000 7f7c7e7fc700 1 -- 172.21.15.38:0/3867293551 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f7c8c142230 con 0x7f7c6c04d460 2020-06-12T17:50:27.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.772+0000 7f7c933b5700 1 -- 172.21.15.38:0/3867293551 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7c6c04d460 msgr2=0x7f7c6c04f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:27.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.772+0000 7f7c933b5700 1 --2- 172.21.15.38:0/3867293551 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7c6c04d460 0x7f7c6c04f920 secure :-1 s=READY pgs=264 cs=0 l=1 rx=0x7f7c80002f30 tx=0x7f7c8000dfa0).stop 2020-06-12T17:50:27.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.772+0000 7f7c933b5700 1 -- 172.21.15.38:0/3867293551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c8c13c3a0 msgr2=0x7f7c8c156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:27.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.772+0000 7f7c933b5700 1 --2- 172.21.15.38:0/3867293551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c8c13c3a0 0x7f7c8c156230 secure :-1 s=READY pgs=670 cs=0 l=1 rx=0x7f7c88002f30 tx=0x7f7c88007e60).stop 2020-06-12T17:50:27.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.772+0000 7f7c933b5700 1 -- 172.21.15.38:0/3867293551 shutdown_connections 2020-06-12T17:50:27.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.772+0000 7f7c933b5700 1 --2- 172.21.15.38:0/3867293551 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7c6c04d460 0x7f7c6c04f920 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:27.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.772+0000 7f7c933b5700 1 --2- 172.21.15.38:0/3867293551 >> v2:172.21.15.150:3300/0 conn(0x7f7c8c0b3ac0 0x7f7c8c13faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:27.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.772+0000 7f7c933b5700 1 --2- 172.21.15.38:0/3867293551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c8c13c3a0 0x7f7c8c156230 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:27.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.772+0000 7f7c933b5700 1 -- 172.21.15.38:0/3867293551 >> 172.21.15.38:0/3867293551 conn(0x7f7c8c0b5a20 msgr2=0x7f7c8c06a440 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:27.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.772+0000 7f7c933b5700 1 -- 172.21.15.38:0/3867293551 shutdown_connections 2020-06-12T17:50:27.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.772+0000 7f7c933b5700 1 -- 172.21.15.38:0/3867293551 wait complete. 2020-06-12T17:50:27.786 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_4667 2020-06-12T17:50:27.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.900+0000 7f9850a11700 1 Processor -- start 2020-06-12T17:50:27.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.900+0000 7f9850a11700 1 -- start start 2020-06-12T17:50:27.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.901+0000 7f9850a11700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f984c146680 0x7f984c0ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:27.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.901+0000 7f9850a11700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f984c0b2eb0 0x7f984c09d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:27.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.901+0000 7f9850a11700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f984c09d620 0x7f984c09da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:27.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.901+0000 7f9850a11700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f984c146d20 con 0x7f984c0b2eb0 2020-06-12T17:50:27.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.901+0000 7f9850a11700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f984c066a80 con 0x7f984c09d620 2020-06-12T17:50:27.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.901+0000 7f9850a11700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984c146f50 con 0x7f984c146680 2020-06-12T17:50:27.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.901+0000 7f9849d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f984c0b2eb0 0x7f984c09d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:27.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.901+0000 7f9849d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f984c0b2eb0 0x7f984c09d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38774/0 (socket says 172.21.15.38:38774) 2020-06-12T17:50:27.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.901+0000 7f9849d9b700 1 -- 172.21.15.38:0/906262999 learned_addr learned my addr 172.21.15.38:0/906262999 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:27.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.901+0000 7f984a59c700 1 --2- 172.21.15.38:0/906262999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f984c146680 0x7f984c0ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:27.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.901+0000 7f984ad9d700 1 --2- 172.21.15.38:0/906262999 >> v2:172.21.15.150:3300/0 conn(0x7f984c09d620 0x7f984c09da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:27.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.901+0000 7f9849d9b700 1 -- 172.21.15.38:0/906262999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f984c146680 msgr2=0x7f984c0ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:27.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.901+0000 7f9849d9b700 1 --2- 172.21.15.38:0/906262999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f984c146680 0x7f984c0ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:27.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.901+0000 7f9849d9b700 1 -- 172.21.15.38:0/906262999 >> v2:172.21.15.150:3300/0 conn(0x7f984c09d620 msgr2=0x7f984c09da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:27.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.901+0000 7f9849d9b700 1 --2- 172.21.15.38:0/906262999 >> v2:172.21.15.150:3300/0 conn(0x7f984c09d620 0x7f984c09da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:27.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.901+0000 7f9849d9b700 1 -- 172.21.15.38:0/906262999 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984c146a60 con 0x7f984c0b2eb0 2020-06-12T17:50:27.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.901+0000 7f984a59c700 1 --2- 172.21.15.38:0/906262999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f984c146680 0x7f984c0ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:50:27.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.901+0000 7f9849d9b700 1 --2- 172.21.15.38:0/906262999 >> v2:172.21.15.38:3300/0 conn(0x7f984c0b2eb0 0x7f984c09d1c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f983c002f30 tx=0x7f983c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.901+0000 7f9849d9b700 1 --2- 172.21.15.38:0/906262999 >> v2:172.21.15.38:3300/0 conn(0x7f984c0b2eb0 0x7f984c09d1c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f983c002f30 tx=0x7f983c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.901+0000 7f9849d9b700 1 --2- 172.21.15.38:0/906262999 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f984c0b2eb0 0x7f984c09d1c0 secure :-1 s=READY pgs=671 cs=0 l=1 rx=0x7f983c002f30 tx=0x7f983c007e60).ready entity=mon.0 client_cookie=4846b1911185c0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:27.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.901+0000 7f9849d9b700 1 --2- 172.21.15.38:0/906262999 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f984c0b2eb0 0x7f984c09d1c0 secure :-1 s=THROTTLE_DONE pgs=671 cs=0 l=1 rx=0x7f983c002f30 tx=0x7f983c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.902+0000 7f984959a700 1 -- 172.21.15.38:0/906262999 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f983c0116e0 con 0x7f984c0b2eb0 2020-06-12T17:50:27.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.902+0000 7f9849d9b700 1 --2- 172.21.15.38:0/906262999 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f984c0b2eb0 0x7f984c09d1c0 secure :-1 s=THROTTLE_DONE pgs=671 cs=0 l=1 rx=0x7f983c002f30 tx=0x7f983c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.902+0000 7f9849d9b700 1 --2- 172.21.15.38:0/906262999 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f984c0b2eb0 0x7f984c09d1c0 secure :-1 s=THROTTLE_DONE pgs=671 cs=0 l=1 rx=0x7f983c002f30 tx=0x7f983c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.921 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.902+0000 7f984959a700 1 -- 172.21.15.38:0/906262999 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983c011840 con 0x7f984c0b2eb0 2020-06-12T17:50:27.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.902+0000 7f984959a700 1 -- 172.21.15.38:0/906262999 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f983c011be0 con 0x7f984c0b2eb0 2020-06-12T17:50:27.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.902+0000 7f9850a11700 1 -- 172.21.15.38:0/906262999 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f984c0b2eb0 msgr2=0x7f984c09d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:27.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.902+0000 7f9850a11700 1 --2- 172.21.15.38:0/906262999 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f984c0b2eb0 0x7f984c09d1c0 secure :-1 s=READY pgs=671 cs=0 l=1 rx=0x7f983c002f30 tx=0x7f983c007e60).stop 2020-06-12T17:50:27.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.902+0000 7f9850a11700 1 -- 172.21.15.38:0/906262999 shutdown_connections 2020-06-12T17:50:27.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.902+0000 7f9850a11700 1 --2- 172.21.15.38:0/906262999 >> v2:172.21.15.150:3300/0 conn(0x7f984c09d620 0x7f984c09da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:27.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.902+0000 7f9850a11700 1 --2- 172.21.15.38:0/906262999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f984c146680 0x7f984c0ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:27.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.902+0000 7f9850a11700 1 --2- 172.21.15.38:0/906262999 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f984c0b2eb0 0x7f984c09d1c0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:27.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.902+0000 7f9850a11700 1 -- 172.21.15.38:0/906262999 >> 172.21.15.38:0/906262999 conn(0x7f984c0b5a20 msgr2=0x7f984c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:27.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.902+0000 7f9850a11700 1 -- 172.21.15.38:0/906262999 shutdown_connections 2020-06-12T17:50:27.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.902+0000 7f9850a11700 1 -- 172.21.15.38:0/906262999 wait complete. 2020-06-12T17:50:27.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.903+0000 7f9850a11700 1 Processor -- start 2020-06-12T17:50:27.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.903+0000 7f9850a11700 1 -- start start 2020-06-12T17:50:27.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.904+0000 7f9850a11700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f984c09d620 0x7f984c0b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:27.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.904+0000 7f9850a11700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f984c0b2eb0 0x7f984c09cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:27.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.904+0000 7f9850a11700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f984c0b0570 con 0x7f984c146680 2020-06-12T17:50:27.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.904+0000 7f9850a11700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f984c157540 con 0x7f984c0b2eb0 2020-06-12T17:50:27.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.904+0000 7f9850a11700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f984c08f8d0 con 0x7f984c09d620 2020-06-12T17:50:27.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.904+0000 7f9849d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f984c0b2eb0 0x7f984c09cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:27.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.904+0000 7f9849d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f984c0b2eb0 0x7f984c09cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38782/0 (socket says 172.21.15.38:38782) 2020-06-12T17:50:27.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.904+0000 7f9849d9b700 1 -- 172.21.15.38:0/3612628625 learned_addr learned my addr 172.21.15.38:0/3612628625 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:27.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.904+0000 7f984ad9d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f984c146680 0x7f984c0afe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40600/0 (socket says 172.21.15.38:40600) 2020-06-12T17:50:27.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.904+0000 7f984a59c700 1 --2- 172.21.15.38:0/3612628625 >> v2:172.21.15.150:3300/0 conn(0x7f984c09d620 0x7f984c0b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:27.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.904+0000 7f9849d9b700 1 -- 172.21.15.38:0/3612628625 >> v2:172.21.15.150:3300/0 conn(0x7f984c09d620 msgr2=0x7f984c0b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:27.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.904+0000 7f9849d9b700 1 --2- 172.21.15.38:0/3612628625 >> v2:172.21.15.150:3300/0 conn(0x7f984c09d620 0x7f984c0b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:27.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.904+0000 7f9849d9b700 1 -- 172.21.15.38:0/3612628625 >> v1:172.21.15.38:6789/0 conn(0x7f984c146680 legacy=0x7f984c0afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:27.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.904+0000 7f983b7fe700 1 -- 172.21.15.38:0/3612628625 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736484877 0 0) 0x7f984c0b0570 con 0x7f984c146680 2020-06-12T17:50:27.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.904+0000 7f9849d9b700 1 -- 172.21.15.38:0/3612628625 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984c08fb70 con 0x7f984c0b2eb0 2020-06-12T17:50:27.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.904+0000 7f9849d9b700 1 --2- 172.21.15.38:0/3612628625 >> v2:172.21.15.38:3300/0 conn(0x7f984c0b2eb0 0x7f984c09cf60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f984c0b2860 tx=0x7f983c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.904+0000 7f9849d9b700 1 --2- 172.21.15.38:0/3612628625 >> v2:172.21.15.38:3300/0 conn(0x7f984c0b2eb0 0x7f984c09cf60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f984c0b2860 tx=0x7f983c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.904+0000 7f9849d9b700 1 --2- 172.21.15.38:0/3612628625 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f984c0b2eb0 0x7f984c09cf60 secure :-1 s=READY pgs=673 cs=0 l=1 rx=0x7f984c0b2860 tx=0x7f983c007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:27.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.905+0000 7f9849d9b700 1 --2- 172.21.15.38:0/3612628625 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f984c0b2eb0 0x7f984c09cf60 secure :-1 s=THROTTLE_DONE pgs=673 cs=0 l=1 rx=0x7f984c0b2860 tx=0x7f983c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.905+0000 7f9849d9b700 1 --2- 172.21.15.38:0/3612628625 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f984c0b2eb0 0x7f984c09cf60 secure :-1 s=THROTTLE_DONE pgs=673 cs=0 l=1 rx=0x7f984c0b2860 tx=0x7f983c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.905+0000 7f983b7fe700 1 -- 172.21.15.38:0/3612628625 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f983c011e50 con 0x7f984c0b2eb0 2020-06-12T17:50:27.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.905+0000 7f9849d9b700 1 --2- 172.21.15.38:0/3612628625 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f984c0b2eb0 0x7f984c09cf60 secure :-1 s=THROTTLE_DONE pgs=673 cs=0 l=1 rx=0x7f984c0b2860 tx=0x7f983c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.905+0000 7f983b7fe700 1 -- 172.21.15.38:0/3612628625 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983c011c30 con 0x7f984c0b2eb0 2020-06-12T17:50:27.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.905+0000 7f983b7fe700 1 -- 172.21.15.38:0/3612628625 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f983c007530 con 0x7f984c0b2eb0 2020-06-12T17:50:27.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.905+0000 7f9850a11700 1 -- 172.21.15.38:0/3612628625 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f984c1571c0 con 0x7f984c0b2eb0 2020-06-12T17:50:27.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.905+0000 7f9850a11700 1 -- 172.21.15.38:0/3612628625 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984c090010 con 0x7f984c0b2eb0 2020-06-12T17:50:27.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.905+0000 7f9849d9b700 1 --2- 172.21.15.38:0/3612628625 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f984c0b2eb0 0x7f984c09cf60 secure :-1 s=THROTTLE_DONE pgs=673 cs=0 l=1 rx=0x7f984c0b2860 tx=0x7f983c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.906+0000 7f983b7fe700 1 -- 172.21.15.38:0/3612628625 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f983c0056c0 con 0x7f984c0b2eb0 2020-06-12T17:50:27.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.906+0000 7f9849d9b700 1 --2- 172.21.15.38:0/3612628625 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f984c0b2eb0 0x7f984c09cf60 secure :-1 s=THROTTLE_DONE pgs=673 cs=0 l=1 rx=0x7f984c0b2860 tx=0x7f983c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.906+0000 7f9850a11700 1 -- 172.21.15.38:0/3612628625 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f984c056c30 con 0x7f984c0b2eb0 2020-06-12T17:50:27.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.906+0000 7f983b7fe700 1 --2- 172.21.15.38:0/3612628625 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f982804d420 0x7f982804f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:27.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.906+0000 7f983b7fe700 1 -- 172.21.15.38:0/3612628625 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f983c061420 con 0x7f984c0b2eb0 2020-06-12T17:50:27.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.906+0000 7f984a59c700 1 --2- 172.21.15.38:0/3612628625 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f982804d420 0x7f982804f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:27.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.906+0000 7f984a59c700 1 --2- 172.21.15.38:0/3612628625 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f982804d420 0x7f982804f8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9840002f30 tx=0x7f984000df20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.932 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.907+0000 7f984a59c700 1 --2- 172.21.15.38:0/3612628625 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f982804d420 0x7f982804f8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9840002f30 tx=0x7f984000df20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.932 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.907+0000 7f984a59c700 1 --2- 172.21.15.38:0/3612628625 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f982804d420 0x7f982804f8e0 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7f9840002f30 tx=0x7f984000df20).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:27.932 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.909+0000 7f9849d9b700 1 --2- 172.21.15.38:0/3612628625 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f984c0b2eb0 0x7f984c09cf60 secure :-1 s=THROTTLE_DONE pgs=673 cs=0 l=1 rx=0x7f984c0b2860 tx=0x7f983c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:27.932 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:27.909+0000 7f983b7fe700 1 -- 172.21.15.38:0/3612628625 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f983c03cc60 con 0x7f984c0b2eb0 2020-06-12T17:50:28.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:28.105+0000 7f9850a11700 1 -- 172.21.15.38:0/3612628625 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_4667", "target": ["mon-mgr", ""]}) v1 -- 0x7f984c08fd70 con 0x7f982804d420 2020-06-12T17:50:28.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:28.109+0000 7f984a59c700 1 --2- 172.21.15.38:0/3612628625 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f982804d420 0x7f982804f8e0 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7f9840002f30 tx=0x7f984000df20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:28.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:28.109+0000 7f983b7fe700 1 -- 172.21.15.38:0/3612628625 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f9840006060 con 0x7f982804d420 2020-06-12T17:50:28.112 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_4667/68bb5dcb-c9d7-430f-8a15-a9f1a25687cb 2020-06-12T17:50:28.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:28.109+0000 7f9850a11700 1 -- 172.21.15.38:0/3612628625 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f982804d420 msgr2=0x7f982804f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:28.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:28.109+0000 7f9850a11700 1 --2- 172.21.15.38:0/3612628625 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f982804d420 0x7f982804f8e0 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7f9840002f30 tx=0x7f984000df20).stop 2020-06-12T17:50:28.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:28.110+0000 7f9850a11700 1 -- 172.21.15.38:0/3612628625 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f984c0b2eb0 msgr2=0x7f984c09cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:28.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:28.110+0000 7f9850a11700 1 --2- 172.21.15.38:0/3612628625 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f984c0b2eb0 0x7f984c09cf60 secure :-1 s=READY pgs=673 cs=0 l=1 rx=0x7f984c0b2860 tx=0x7f983c007e60).stop 2020-06-12T17:50:28.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:28.110+0000 7f9850a11700 1 -- 172.21.15.38:0/3612628625 shutdown_connections 2020-06-12T17:50:28.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:28.110+0000 7f9850a11700 1 --2- 172.21.15.38:0/3612628625 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f982804d420 0x7f982804f8e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:28.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:28.110+0000 7f9850a11700 1 --2- 172.21.15.38:0/3612628625 >> v2:172.21.15.150:3300/0 conn(0x7f984c09d620 0x7f984c0b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:28.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:28.110+0000 7f9850a11700 1 --2- 172.21.15.38:0/3612628625 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f984c0b2eb0 0x7f984c09cf60 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:28.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:28.110+0000 7f9850a11700 1 -- 172.21.15.38:0/3612628625 >> 172.21.15.38:0/3612628625 conn(0x7f984c0b5a20 msgr2=0x7f984c144ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:28.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:28.110+0000 7f9850a11700 1 -- 172.21.15.38:0/3612628625 shutdown_connections 2020-06-12T17:50:28.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:28.110+0000 7f9850a11700 1 -- 172.21.15.38:0/3612628625 wait complete. 2020-06-12T17:50:28.123 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_4667 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_4667/68bb5dcb-c9d7-430f-8a15-a9f1a25687cb 2020-06-12T17:50:28.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:28.125 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:28.125 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:28.141 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:28.142 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:28.142 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4667/68bb5dcb-c9d7-430f-8a15-a9f1a25687cb/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:28.231 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:28.232 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:28.232 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929894 s, 113 MB/s 2020-06-12T17:50:28.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:28.235 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:28.235 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:28.250 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:28.251 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:28.251 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4667/68bb5dcb-c9d7-430f-8a15-a9f1a25687cb/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:28.339 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:28.340 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:28.340 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121337 s, 86.4 MB/s 2020-06-12T17:50:28.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:28.342 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:28.343 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:28.359 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:28.359 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:28.360 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4667/68bb5dcb-c9d7-430f-8a15-a9f1a25687cb/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:28.468 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:28.468 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:28.469 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104465 s, 100 MB/s 2020-06-12T17:50:28.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:28.470 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:28.471 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:28.486 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:28.486 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:28.487 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4667/68bb5dcb-c9d7-430f-8a15-a9f1a25687cb/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:28.574 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:28.575 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:28.575 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104147 s, 101 MB/s 2020-06-12T17:50:28.576 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:28.576 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:28.577 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:28.592 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:28.592 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:28.593 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4667/68bb5dcb-c9d7-430f-8a15-a9f1a25687cb/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:28.680 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:28.680 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:28.681 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108598 s, 96.6 MB/s 2020-06-12T17:50:28.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:28.682 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:28.683 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:28.702 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:28.703 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:28.704 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4667/68bb5dcb-c9d7-430f-8a15-a9f1a25687cb/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:28.792 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:28.792 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:28.792 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118863 s, 88.2 MB/s 2020-06-12T17:50:28.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:28.794 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:28.795 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:28.820 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:28.821 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:28.822 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4667/68bb5dcb-c9d7-430f-8a15-a9f1a25687cb/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:28.909 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:28.910 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:28.910 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126697 s, 82.8 MB/s 2020-06-12T17:50:28.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:28.912 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:28.912 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:28.930 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:28.931 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:28.932 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4667/68bb5dcb-c9d7-430f-8a15-a9f1a25687cb/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:29.022 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:29.022 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:29.023 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118476 s, 88.5 MB/s 2020-06-12T17:50:29.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:29.024 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:29.025 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:29.043 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:29.043 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:29.044 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4667/68bb5dcb-c9d7-430f-8a15-a9f1a25687cb/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:29.130 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:29.131 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:29.131 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110023 s, 95.3 MB/s 2020-06-12T17:50:29.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:29.133 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:29.133 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:29.148 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:29.149 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:29.149 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4667/68bb5dcb-c9d7-430f-8a15-a9f1a25687cb/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:29.238 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:29.238 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:29.238 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107825 s, 97.2 MB/s 2020-06-12T17:50:29.239 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_8989 2020-06-12T17:50:29.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.353+0000 7fbc606b7700 1 Processor -- start 2020-06-12T17:50:29.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.353+0000 7fbc606b7700 1 -- start start 2020-06-12T17:50:29.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.354+0000 7fbc606b7700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbc58144440 0x7fbc581448f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:29.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.354+0000 7fbc606b7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbc58147380 0x7fbc58147810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:29.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.354+0000 7fbc606b7700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc580b90c0 con 0x7fbc5809ed40 2020-06-12T17:50:29.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.354+0000 7fbc606b7700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc58143db0 con 0x7fbc58144440 2020-06-12T17:50:29.361 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.354+0000 7fbc606b7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc58143fa0 con 0x7fbc58147380 2020-06-12T17:50:29.361 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.354+0000 7fbc5dc52700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbc58144440 0x7fbc581448f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:29.361 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.354+0000 7fbc5e453700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fbc5809ed40 0x7fbc58066110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40604/0 (socket says 172.21.15.38:40604) 2020-06-12T17:50:29.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.354+0000 7fbc5e453700 1 -- 172.21.15.38:0/1160678962 learned_addr learned my addr 172.21.15.38:0/1160678962 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:29.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.355+0000 7fbc5ec54700 1 --2- 172.21.15.38:0/1160678962 >> v2:172.21.15.150:3300/0 conn(0x7fbc58147380 0x7fbc58147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:29.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.355+0000 7fbc5dc52700 1 -- 172.21.15.38:0/1160678962 >> v2:172.21.15.150:3300/0 conn(0x7fbc58147380 msgr2=0x7fbc58147810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:29.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.355+0000 7fbc5dc52700 1 --2- 172.21.15.38:0/1160678962 >> v2:172.21.15.150:3300/0 conn(0x7fbc58147380 0x7fbc58147810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:29.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.355+0000 7fbc5dc52700 1 -- 172.21.15.38:0/1160678962 >> v1:172.21.15.38:6789/0 conn(0x7fbc5809ed40 legacy=0x7fbc58066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:29.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.355+0000 7fbc5d451700 1 -- 172.21.15.38:0/1160678962 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951323563 0 0) 0x7fbc580b90c0 con 0x7fbc5809ed40 2020-06-12T17:50:29.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.355+0000 7fbc5dc52700 1 -- 172.21.15.38:0/1160678962 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc58144d50 con 0x7fbc58144440 2020-06-12T17:50:29.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.355+0000 7fbc5dc52700 1 --2- 172.21.15.38:0/1160678962 >> v2:172.21.15.38:3300/0 conn(0x7fbc58144440 0x7fbc581448f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbc54002f30 tx=0x7fbc54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.355+0000 7fbc5dc52700 1 --2- 172.21.15.38:0/1160678962 >> v2:172.21.15.38:3300/0 conn(0x7fbc58144440 0x7fbc581448f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbc54002f30 tx=0x7fbc54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.355+0000 7fbc5dc52700 1 --2- 172.21.15.38:0/1160678962 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc58144440 0x7fbc581448f0 secure :-1 s=READY pgs=675 cs=0 l=1 rx=0x7fbc54002f30 tx=0x7fbc54007e60).ready entity=mon.0 client_cookie=14e2c79d95b3a31a server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:29.376 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.355+0000 7fbc5dc52700 1 --2- 172.21.15.38:0/1160678962 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc58144440 0x7fbc581448f0 secure :-1 s=THROTTLE_DONE pgs=675 cs=0 l=1 rx=0x7fbc54002f30 tx=0x7fbc54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.377 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.355+0000 7fbc5d451700 1 -- 172.21.15.38:0/1160678962 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc54011430 con 0x7fbc58144440 2020-06-12T17:50:29.377 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.355+0000 7fbc5dc52700 1 --2- 172.21.15.38:0/1160678962 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc58144440 0x7fbc581448f0 secure :-1 s=THROTTLE_DONE pgs=675 cs=0 l=1 rx=0x7fbc54002f30 tx=0x7fbc54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.377 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.355+0000 7fbc5dc52700 1 --2- 172.21.15.38:0/1160678962 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc58144440 0x7fbc581448f0 secure :-1 s=THROTTLE_DONE pgs=675 cs=0 l=1 rx=0x7fbc54002f30 tx=0x7fbc54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.377 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.355+0000 7fbc5d451700 1 -- 172.21.15.38:0/1160678962 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc54011590 con 0x7fbc58144440 2020-06-12T17:50:29.377 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.355+0000 7fbc5d451700 1 -- 172.21.15.38:0/1160678962 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc54011930 con 0x7fbc58144440 2020-06-12T17:50:29.378 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.355+0000 7fbc606b7700 1 -- 172.21.15.38:0/1160678962 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc58144440 msgr2=0x7fbc581448f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:29.378 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.355+0000 7fbc606b7700 1 --2- 172.21.15.38:0/1160678962 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc58144440 0x7fbc581448f0 secure :-1 s=READY pgs=675 cs=0 l=1 rx=0x7fbc54002f30 tx=0x7fbc54007e60).stop 2020-06-12T17:50:29.378 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.355+0000 7fbc606b7700 1 -- 172.21.15.38:0/1160678962 shutdown_connections 2020-06-12T17:50:29.378 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.355+0000 7fbc606b7700 1 --2- 172.21.15.38:0/1160678962 >> v2:172.21.15.150:3300/0 conn(0x7fbc58147380 0x7fbc58147810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:29.378 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.355+0000 7fbc606b7700 1 --2- 172.21.15.38:0/1160678962 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc58144440 0x7fbc581448f0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:29.379 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.355+0000 7fbc606b7700 1 -- 172.21.15.38:0/1160678962 >> 172.21.15.38:0/1160678962 conn(0x7fbc580b94a0 msgr2=0x7fbc580b98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:29.379 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.356+0000 7fbc606b7700 1 -- 172.21.15.38:0/1160678962 shutdown_connections 2020-06-12T17:50:29.379 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.356+0000 7fbc606b7700 1 -- 172.21.15.38:0/1160678962 wait complete. 2020-06-12T17:50:29.379 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.356+0000 7fbc606b7700 1 Processor -- start 2020-06-12T17:50:29.379 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.356+0000 7fbc606b7700 1 -- start start 2020-06-12T17:50:29.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.357+0000 7fbc606b7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc5809ed40 0x7fbc58143510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:29.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.357+0000 7fbc606b7700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbc58144440 0x7fbc580628f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:29.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.357+0000 7fbc606b7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc58142ba0 con 0x7fbc58147380 2020-06-12T17:50:29.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.357+0000 7fbc606b7700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc58143970 con 0x7fbc58144440 2020-06-12T17:50:29.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.357+0000 7fbc606b7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc58062d50 con 0x7fbc5809ed40 2020-06-12T17:50:29.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.357+0000 7fbc5dc52700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbc58144440 0x7fbc580628f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:29.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.357+0000 7fbc5dc52700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbc58144440 0x7fbc580628f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38794/0 (socket says 172.21.15.38:38794) 2020-06-12T17:50:29.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.357+0000 7fbc5dc52700 1 -- 172.21.15.38:0/2725114051 learned_addr learned my addr 172.21.15.38:0/2725114051 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:29.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.358+0000 7fbc5e453700 1 --2- 172.21.15.38:0/2725114051 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc5809ed40 0x7fbc58143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:29.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.358+0000 7fbc5dc52700 1 -- 172.21.15.38:0/2725114051 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc5809ed40 msgr2=0x7fbc58143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:29.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.358+0000 7fbc5dc52700 1 --2- 172.21.15.38:0/2725114051 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc5809ed40 0x7fbc58143510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:29.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.358+0000 7fbc5dc52700 1 -- 172.21.15.38:0/2725114051 >> v1:172.21.15.150:6789/0 conn(0x7fbc58147380 legacy=0x7fbc58141a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:29.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.358+0000 7fbc5dc52700 1 -- 172.21.15.38:0/2725114051 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc58155890 con 0x7fbc58144440 2020-06-12T17:50:29.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.358+0000 7fbc5dc52700 1 --2- 172.21.15.38:0/2725114051 >> v2:172.21.15.38:3300/0 conn(0x7fbc58144440 0x7fbc580628f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbc5813f280 tx=0x7fbc54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.358+0000 7fbc5dc52700 1 --2- 172.21.15.38:0/2725114051 >> v2:172.21.15.38:3300/0 conn(0x7fbc58144440 0x7fbc580628f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbc5813f280 tx=0x7fbc54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.358+0000 7fbc5dc52700 1 --2- 172.21.15.38:0/2725114051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc58144440 0x7fbc580628f0 secure :-1 s=READY pgs=676 cs=0 l=1 rx=0x7fbc5813f280 tx=0x7fbc54007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:29.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.358+0000 7fbc5dc52700 1 --2- 172.21.15.38:0/2725114051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc58144440 0x7fbc580628f0 secure :-1 s=THROTTLE_DONE pgs=676 cs=0 l=1 rx=0x7fbc5813f280 tx=0x7fbc54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.358+0000 7fbc477fe700 1 -- 172.21.15.38:0/2725114051 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc54007150 con 0x7fbc58144440 2020-06-12T17:50:29.397 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.358+0000 7fbc5dc52700 1 --2- 172.21.15.38:0/2725114051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc58144440 0x7fbc580628f0 secure :-1 s=THROTTLE_DONE pgs=676 cs=0 l=1 rx=0x7fbc5813f280 tx=0x7fbc54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.397 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.358+0000 7fbc5dc52700 1 --2- 172.21.15.38:0/2725114051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc58144440 0x7fbc580628f0 secure :-1 s=THROTTLE_DONE pgs=676 cs=0 l=1 rx=0x7fbc5813f280 tx=0x7fbc54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.398 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.358+0000 7fbc477fe700 1 -- 172.21.15.38:0/2725114051 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc540072b0 con 0x7fbc58144440 2020-06-12T17:50:29.398 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.358+0000 7fbc477fe700 1 -- 172.21.15.38:0/2725114051 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc540056c0 con 0x7fbc58144440 2020-06-12T17:50:29.398 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.358+0000 7fbc606b7700 1 -- 172.21.15.38:0/2725114051 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc58151790 con 0x7fbc58144440 2020-06-12T17:50:29.398 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.358+0000 7fbc606b7700 1 -- 172.21.15.38:0/2725114051 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc58146630 con 0x7fbc58144440 2020-06-12T17:50:29.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.359+0000 7fbc5dc52700 1 --2- 172.21.15.38:0/2725114051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc58144440 0x7fbc580628f0 secure :-1 s=THROTTLE_DONE pgs=676 cs=0 l=1 rx=0x7fbc5813f280 tx=0x7fbc54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.359+0000 7fbc606b7700 1 -- 172.21.15.38:0/2725114051 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc58056c30 con 0x7fbc58144440 2020-06-12T17:50:29.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.359+0000 7fbc477fe700 1 -- 172.21.15.38:0/2725114051 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fbc54005930 con 0x7fbc58144440 2020-06-12T17:50:29.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.359+0000 7fbc5dc52700 1 --2- 172.21.15.38:0/2725114051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc58144440 0x7fbc580628f0 secure :-1 s=THROTTLE_DONE pgs=676 cs=0 l=1 rx=0x7fbc5813f280 tx=0x7fbc54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.360+0000 7fbc477fe700 1 --2- 172.21.15.38:0/2725114051 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbc3804d600 0x7fbc3804fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:29.400 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.360+0000 7fbc477fe700 1 -- 172.21.15.38:0/2725114051 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fbc540616d0 con 0x7fbc58144440 2020-06-12T17:50:29.400 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.360+0000 7fbc5e453700 1 --2- 172.21.15.38:0/2725114051 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbc3804d600 0x7fbc3804fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:29.400 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.360+0000 7fbc5e453700 1 --2- 172.21.15.38:0/2725114051 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbc3804d600 0x7fbc3804fac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbc48000b80 tx=0x7fbc48001330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.400 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.360+0000 7fbc5e453700 1 --2- 172.21.15.38:0/2725114051 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbc3804d600 0x7fbc3804fac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbc48000b80 tx=0x7fbc48001330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.400 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.360+0000 7fbc5e453700 1 --2- 172.21.15.38:0/2725114051 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbc3804d600 0x7fbc3804fac0 secure :-1 s=READY pgs=266 cs=0 l=1 rx=0x7fbc48000b80 tx=0x7fbc48001330).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:29.401 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.363+0000 7fbc5dc52700 1 --2- 172.21.15.38:0/2725114051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc58144440 0x7fbc580628f0 secure :-1 s=THROTTLE_DONE pgs=676 cs=0 l=1 rx=0x7fbc5813f280 tx=0x7fbc54007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.401 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.363+0000 7fbc477fe700 1 -- 172.21.15.38:0/2725114051 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fbc5403ceb0 con 0x7fbc58144440 2020-06-12T17:50:29.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.555+0000 7fbc606b7700 1 -- 172.21.15.38:0/2725114051 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_8989", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc58151990 con 0x7fbc3804d600 2020-06-12T17:50:29.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.572+0000 7fbc5e453700 1 --2- 172.21.15.38:0/2725114051 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbc3804d600 0x7fbc3804fac0 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7fbc48000b80 tx=0x7fbc48001330).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.572+0000 7fbc477fe700 1 -- 172.21.15.38:0/2725114051 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fbc4800dda0 con 0x7fbc3804d600 2020-06-12T17:50:29.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.574+0000 7fbc606b7700 1 -- 172.21.15.38:0/2725114051 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbc3804d600 msgr2=0x7fbc3804fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:29.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.574+0000 7fbc606b7700 1 --2- 172.21.15.38:0/2725114051 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbc3804d600 0x7fbc3804fac0 secure :-1 s=READY pgs=266 cs=0 l=1 rx=0x7fbc48000b80 tx=0x7fbc48001330).stop 2020-06-12T17:50:29.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.574+0000 7fbc606b7700 1 -- 172.21.15.38:0/2725114051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc58144440 msgr2=0x7fbc580628f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:29.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.574+0000 7fbc606b7700 1 --2- 172.21.15.38:0/2725114051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc58144440 0x7fbc580628f0 secure :-1 s=READY pgs=676 cs=0 l=1 rx=0x7fbc5813f280 tx=0x7fbc54007e60).stop 2020-06-12T17:50:29.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.574+0000 7fbc606b7700 1 -- 172.21.15.38:0/2725114051 shutdown_connections 2020-06-12T17:50:29.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.574+0000 7fbc606b7700 1 --2- 172.21.15.38:0/2725114051 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fbc3804d600 0x7fbc3804fac0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:29.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.574+0000 7fbc606b7700 1 --2- 172.21.15.38:0/2725114051 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc5809ed40 0x7fbc58143510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:29.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.574+0000 7fbc606b7700 1 --2- 172.21.15.38:0/2725114051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc58144440 0x7fbc580628f0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:29.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.574+0000 7fbc606b7700 1 -- 172.21.15.38:0/2725114051 >> 172.21.15.38:0/2725114051 conn(0x7fbc580b94a0 msgr2=0x7fbc5813b840 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:29.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.574+0000 7fbc606b7700 1 -- 172.21.15.38:0/2725114051 shutdown_connections 2020-06-12T17:50:29.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.574+0000 7fbc606b7700 1 -- 172.21.15.38:0/2725114051 wait complete. 2020-06-12T17:50:29.587 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_8989 2020-06-12T17:50:29.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.700+0000 7f2ef9d8d700 1 Processor -- start 2020-06-12T17:50:29.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.700+0000 7f2ef9d8d700 1 -- start start 2020-06-12T17:50:29.711 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.701+0000 7f2ef9d8d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ef40ad5b0 0x7f2ef40b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:29.711 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.701+0000 7f2ef9d8d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2ef409d8d0 0x7f2ef41421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:29.712 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.701+0000 7f2ef9d8d700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef4146d20 con 0x7f2ef4146680 2020-06-12T17:50:29.712 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.701+0000 7f2ef9d8d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef4066a80 con 0x7f2ef409d8d0 2020-06-12T17:50:29.712 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.701+0000 7f2ef9d8d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef4146f50 con 0x7f2ef40ad5b0 2020-06-12T17:50:29.712 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.701+0000 7f2ef37fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f2ef4146680 0x7f2ef409d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40616/0 (socket says 172.21.15.38:40616) 2020-06-12T17:50:29.713 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.701+0000 7f2ef37fe700 1 -- 172.21.15.38:0/2005468092 learned_addr learned my addr 172.21.15.38:0/2005468092 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:29.713 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.702+0000 7f2ef2ffd700 1 --2- 172.21.15.38:0/2005468092 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ef40ad5b0 0x7f2ef40b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:29.713 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.702+0000 7f2ef3fff700 1 --2- 172.21.15.38:0/2005468092 >> v2:172.21.15.150:3300/0 conn(0x7f2ef409d8d0 0x7f2ef41421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:29.713 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.702+0000 7f2ef27fc700 1 -- 172.21.15.38:0/2005468092 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1708729728 0 0) 0x7f2ef4146d20 con 0x7f2ef4146680 2020-06-12T17:50:29.713 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.702+0000 7f2ef27fc700 1 -- 172.21.15.38:0/2005468092 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ee0003230 con 0x7f2ef4146680 2020-06-12T17:50:29.714 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.702+0000 7f2ef27fc700 1 -- 172.21.15.38:0/2005468092 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4036426537 0 0) 0x7f2ee0003230 con 0x7f2ef4146680 2020-06-12T17:50:29.714 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.702+0000 7f2ef27fc700 1 -- 172.21.15.38:0/2005468092 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ef40ad5b0 msgr2=0x7f2ef40b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:29.714 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.702+0000 7f2ef27fc700 1 --2- 172.21.15.38:0/2005468092 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ef40ad5b0 0x7f2ef40b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:29.714 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.702+0000 7f2ef27fc700 1 -- 172.21.15.38:0/2005468092 >> v2:172.21.15.150:3300/0 conn(0x7f2ef409d8d0 msgr2=0x7f2ef41421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:29.714 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.702+0000 7f2ef27fc700 1 --2- 172.21.15.38:0/2005468092 >> v2:172.21.15.150:3300/0 conn(0x7f2ef409d8d0 0x7f2ef41421d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:29.715 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.702+0000 7f2ef27fc700 1 -- 172.21.15.38:0/2005468092 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef4146a60 con 0x7f2ef4146680 2020-06-12T17:50:29.715 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.702+0000 7f2ef27fc700 1 -- 172.21.15.38:0/2005468092 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f2ee40016d0 con 0x7f2ef4146680 2020-06-12T17:50:29.715 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.702+0000 7f2ef27fc700 1 -- 172.21.15.38:0/2005468092 >> v1:172.21.15.38:6789/0 conn(0x7f2ef4146680 legacy=0x7f2ef409d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:29.715 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.702+0000 7f2ef27fc700 1 --2- 172.21.15.38:0/2005468092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ee0003720 0x7f2ee0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:29.715 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.702+0000 7f2ef27fc700 1 --2- 172.21.15.38:0/2005468092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ee0004060 0x7f2ee0004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:29.716 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.702+0000 7f2ef27fc700 1 --2- 172.21.15.38:0/2005468092 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ef40ad5b0 0x7f2ee0004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:29.716 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.702+0000 7f2ef27fc700 1 -- 172.21.15.38:0/2005468092 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef4066a80 con 0x7f2ee0003720 2020-06-12T17:50:29.716 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.702+0000 7f2ef27fc700 1 -- 172.21.15.38:0/2005468092 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef4146f50 con 0x7f2ee0004060 2020-06-12T17:50:29.716 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.702+0000 7f2ef27fc700 1 -- 172.21.15.38:0/2005468092 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee0004ff0 con 0x7f2ef40ad5b0 2020-06-12T17:50:29.716 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.702+0000 7f2ef37fe700 1 --2- 172.21.15.38:0/2005468092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ee0003720 0x7f2ee0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:29.717 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.702+0000 7f2ef2ffd700 1 --2- 172.21.15.38:0/2005468092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ee0004060 0x7f2ee0004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:29.717 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.702+0000 7f2ef3fff700 1 --2- 172.21.15.38:0/2005468092 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ef40ad5b0 0x7f2ee0004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:29.717 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.702+0000 7f2ef37fe700 1 -- 172.21.15.38:0/2005468092 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ef40ad5b0 msgr2=0x7f2ee0004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:29.717 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.702+0000 7f2ef37fe700 1 --2- 172.21.15.38:0/2005468092 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ef40ad5b0 0x7f2ee0004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:29.718 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.702+0000 7f2ef37fe700 1 -- 172.21.15.38:0/2005468092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ee0004060 msgr2=0x7f2ee0004530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:29.718 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.702+0000 7f2ef37fe700 1 --2- 172.21.15.38:0/2005468092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ee0004060 0x7f2ee0004530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:29.718 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.702+0000 7f2ef37fe700 1 -- 172.21.15.38:0/2005468092 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee0003230 con 0x7f2ee0003720 2020-06-12T17:50:29.718 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.703+0000 7f2ef37fe700 1 --2- 172.21.15.38:0/2005468092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ee0003720 0x7f2ee0003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2ee40013e0 tx=0x7f2ef4146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.719 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.703+0000 7f2ef37fe700 1 --2- 172.21.15.38:0/2005468092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ee0003720 0x7f2ee0003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2ee40013e0 tx=0x7f2ef4146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.719 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.703+0000 7f2ef37fe700 1 --2- 172.21.15.38:0/2005468092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ee0003720 0x7f2ee0003b40 secure :-1 s=READY pgs=678 cs=0 l=1 rx=0x7f2ee40013e0 tx=0x7f2ef4146220).ready entity=mon.0 client_cookie=792c5d8fbab5802a server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:29.719 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.703+0000 7f2ef37fe700 1 --2- 172.21.15.38:0/2005468092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ee0003720 0x7f2ee0003b40 secure :-1 s=THROTTLE_DONE pgs=678 cs=0 l=1 rx=0x7f2ee40013e0 tx=0x7f2ef4146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.719 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.703+0000 7f2ef37fe700 1 --2- 172.21.15.38:0/2005468092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ee0003720 0x7f2ee0003b40 secure :-1 s=THROTTLE_DONE pgs=678 cs=0 l=1 rx=0x7f2ee40013e0 tx=0x7f2ef4146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.720 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.703+0000 7f2ef27fc700 1 -- 172.21.15.38:0/2005468092 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ee400e160 con 0x7f2ee0003720 2020-06-12T17:50:29.720 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.703+0000 7f2ef37fe700 1 --2- 172.21.15.38:0/2005468092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ee0003720 0x7f2ee0003b40 secure :-1 s=THROTTLE_DONE pgs=678 cs=0 l=1 rx=0x7f2ee40013e0 tx=0x7f2ef4146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.720 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.703+0000 7f2ef27fc700 1 -- 172.21.15.38:0/2005468092 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee400e2c0 con 0x7f2ee0003720 2020-06-12T17:50:29.720 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.703+0000 7f2ef27fc700 1 -- 172.21.15.38:0/2005468092 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ee400e6e0 con 0x7f2ee0003720 2020-06-12T17:50:29.720 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.703+0000 7f2ef9d8d700 1 -- 172.21.15.38:0/2005468092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ee0003720 msgr2=0x7f2ee0003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:29.721 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.703+0000 7f2ef9d8d700 1 --2- 172.21.15.38:0/2005468092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ee0003720 0x7f2ee0003b40 secure :-1 s=READY pgs=678 cs=0 l=1 rx=0x7f2ee40013e0 tx=0x7f2ef4146220).stop 2020-06-12T17:50:29.721 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.703+0000 7f2ef3fff700 1 -- 172.21.15.38:0/2005468092 reap_dead start 2020-06-12T17:50:29.721 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.703+0000 7f2ef9d8d700 1 -- 172.21.15.38:0/2005468092 shutdown_connections 2020-06-12T17:50:29.721 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.703+0000 7f2ef9d8d700 1 -- 172.21.15.38:0/2005468092 >> 172.21.15.38:0/2005468092 conn(0x7f2ef40b5a20 msgr2=0x7f2ef405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:29.721 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.703+0000 7f2ef9d8d700 1 -- 172.21.15.38:0/2005468092 shutdown_connections 2020-06-12T17:50:29.722 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.703+0000 7f2ef9d8d700 1 -- 172.21.15.38:0/2005468092 wait complete. 2020-06-12T17:50:29.722 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.704+0000 7f2ef9d8d700 1 Processor -- start 2020-06-12T17:50:29.722 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.704+0000 7f2ef9d8d700 1 -- start start 2020-06-12T17:50:29.722 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.705+0000 7f2ef9d8d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2ef4142fb0 0x7f2ef4143460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:29.722 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.705+0000 7f2ef9d8d700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef409ad70 con 0x7f2ef40b0c10 2020-06-12T17:50:29.723 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.705+0000 7f2ef9d8d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef41438c0 con 0x7f2ef4065ca0 2020-06-12T17:50:29.723 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.705+0000 7f2ef9d8d700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef4153760 con 0x7f2ef4142fb0 2020-06-12T17:50:29.723 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.705+0000 7f2ef2ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2ef4142fb0 0x7f2ef4143460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:29.723 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.705+0000 7f2ef2ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2ef4142fb0 0x7f2ef4143460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38812/0 (socket says 172.21.15.38:38812) 2020-06-12T17:50:29.723 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.705+0000 7f2ef2ffd700 1 -- 172.21.15.38:0/1016701883 learned_addr learned my addr 172.21.15.38:0/1016701883 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:29.724 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.705+0000 7f2ef3fff700 1 --1- 172.21.15.38:0/1016701883 >> v1:172.21.15.38:6789/0 conn(0x7f2ef40b0c10 0x7f2ef40b1080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40630/0 (socket says 172.21.15.38:40630) 2020-06-12T17:50:29.724 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.705+0000 7f2ef2ffd700 1 -- 172.21.15.38:0/1016701883 >> v1:172.21.15.150:6789/0 conn(0x7f2ef4065ca0 legacy=0x7f2ef409a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:29.724 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.705+0000 7f2ef2ffd700 1 -- 172.21.15.38:0/1016701883 >> v1:172.21.15.38:6789/0 conn(0x7f2ef40b0c10 legacy=0x7f2ef40b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:29.724 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.705+0000 7f2ef0ff9700 1 -- 172.21.15.38:0/1016701883 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3897265818 0 0) 0x7f2eec001210 con 0x7f2ef40b0c10 2020-06-12T17:50:29.724 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.705+0000 7f2ef2ffd700 1 -- 172.21.15.38:0/1016701883 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef4153a00 con 0x7f2ef4142fb0 2020-06-12T17:50:29.725 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.706+0000 7f2ef2ffd700 1 --2- 172.21.15.38:0/1016701883 >> v2:172.21.15.38:3300/0 conn(0x7f2ef4142fb0 0x7f2ef4143460 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2ee8007ed0 tx=0x7f2ee8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.725 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.706+0000 7f2ef2ffd700 1 --2- 172.21.15.38:0/1016701883 >> v2:172.21.15.38:3300/0 conn(0x7f2ef4142fb0 0x7f2ef4143460 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2ee8007ed0 tx=0x7f2ee8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.725 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.706+0000 7f2ef2ffd700 1 --2- 172.21.15.38:0/1016701883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ef4142fb0 0x7f2ef4143460 secure :-1 s=READY pgs=680 cs=0 l=1 rx=0x7f2ee8007ed0 tx=0x7f2ee8007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:29.725 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.706+0000 7f2ef2ffd700 1 --2- 172.21.15.38:0/1016701883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ef4142fb0 0x7f2ef4143460 secure :-1 s=THROTTLE_DONE pgs=680 cs=0 l=1 rx=0x7f2ee8007ed0 tx=0x7f2ee8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.725 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.706+0000 7f2ef0ff9700 1 -- 172.21.15.38:0/1016701883 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ee8005e90 con 0x7f2ef4142fb0 2020-06-12T17:50:29.726 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.706+0000 7f2ef2ffd700 1 --2- 172.21.15.38:0/1016701883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ef4142fb0 0x7f2ef4143460 secure :-1 s=THROTTLE_DONE pgs=680 cs=0 l=1 rx=0x7f2ee8007ed0 tx=0x7f2ee8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.726 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.706+0000 7f2ef2ffd700 1 --2- 172.21.15.38:0/1016701883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ef4142fb0 0x7f2ef4143460 secure :-1 s=THROTTLE_DONE pgs=680 cs=0 l=1 rx=0x7f2ee8007ed0 tx=0x7f2ee8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.726 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.706+0000 7f2ef0ff9700 1 -- 172.21.15.38:0/1016701883 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee8007160 con 0x7f2ef4142fb0 2020-06-12T17:50:29.726 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.706+0000 7f2ef9d8d700 1 -- 172.21.15.38:0/1016701883 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef4153ca0 con 0x7f2ef4142fb0 2020-06-12T17:50:29.726 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.706+0000 7f2ef0ff9700 1 -- 172.21.15.38:0/1016701883 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ee8007540 con 0x7f2ef4142fb0 2020-06-12T17:50:29.727 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.706+0000 7f2ef9d8d700 1 -- 172.21.15.38:0/1016701883 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef4154140 con 0x7f2ef4142fb0 2020-06-12T17:50:29.727 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.706+0000 7f2ef2ffd700 1 --2- 172.21.15.38:0/1016701883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ef4142fb0 0x7f2ef4143460 secure :-1 s=THROTTLE_DONE pgs=680 cs=0 l=1 rx=0x7f2ee8007ed0 tx=0x7f2ee8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.727 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.707+0000 7f2ef9d8d700 1 -- 172.21.15.38:0/1016701883 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef4153e30 con 0x7f2ef4142fb0 2020-06-12T17:50:29.727 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.707+0000 7f2ef0ff9700 1 -- 172.21.15.38:0/1016701883 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f2ee8008410 con 0x7f2ef4142fb0 2020-06-12T17:50:29.727 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.707+0000 7f2ef2ffd700 1 --2- 172.21.15.38:0/1016701883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ef4142fb0 0x7f2ef4143460 secure :-1 s=THROTTLE_DONE pgs=680 cs=0 l=1 rx=0x7f2ee8007ed0 tx=0x7f2ee8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.728 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.707+0000 7f2ef0ff9700 1 --2- 172.21.15.38:0/1016701883 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2ed404d410 0x7f2ed404f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:29.728 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.707+0000 7f2ef0ff9700 1 -- 172.21.15.38:0/1016701883 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2ee8061120 con 0x7f2ef4142fb0 2020-06-12T17:50:29.728 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.708+0000 7f2ef37fe700 1 --2- 172.21.15.38:0/1016701883 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2ed404d410 0x7f2ed404f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:29.728 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.708+0000 7f2ef37fe700 1 --2- 172.21.15.38:0/1016701883 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2ed404d410 0x7f2ed404f8d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2ef40665a0 tx=0x7f2ef4146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.728 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.708+0000 7f2ef37fe700 1 --2- 172.21.15.38:0/1016701883 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2ed404d410 0x7f2ed404f8d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2ef40665a0 tx=0x7f2ef4146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.728 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.708+0000 7f2ef37fe700 1 --2- 172.21.15.38:0/1016701883 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2ed404d410 0x7f2ed404f8d0 secure :-1 s=READY pgs=267 cs=0 l=1 rx=0x7f2ef40665a0 tx=0x7f2ef4146220).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:29.729 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.711+0000 7f2ef2ffd700 1 --2- 172.21.15.38:0/1016701883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ef4142fb0 0x7f2ef4143460 secure :-1 s=THROTTLE_DONE pgs=680 cs=0 l=1 rx=0x7f2ee8007ed0 tx=0x7f2ee8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.729 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.711+0000 7f2ef0ff9700 1 -- 172.21.15.38:0/1016701883 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f2ee803c7e0 con 0x7f2ef4142fb0 2020-06-12T17:50:29.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.905+0000 7f2ef9d8d700 1 -- 172.21.15.38:0/1016701883 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_8989", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ef4056c30 con 0x7f2ed404d410 2020-06-12T17:50:29.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.909+0000 7f2ef37fe700 1 --2- 172.21.15.38:0/1016701883 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2ed404d410 0x7f2ed404f8d0 secure :-1 s=THROTTLE_DONE pgs=267 cs=0 l=1 rx=0x7f2ef40665a0 tx=0x7f2ef4146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:29.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.909+0000 7f2ef0ff9700 1 -- 172.21.15.38:0/1016701883 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f2ef4056c30 con 0x7f2ed404d410 2020-06-12T17:50:29.913 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_8989/792706b8-377b-4a5d-8ff8-71da1845ca9f 2020-06-12T17:50:29.914 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.910+0000 7f2ef9d8d700 1 -- 172.21.15.38:0/1016701883 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2ed404d410 msgr2=0x7f2ed404f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:29.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.910+0000 7f2ef9d8d700 1 --2- 172.21.15.38:0/1016701883 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2ed404d410 0x7f2ed404f8d0 secure :-1 s=READY pgs=267 cs=0 l=1 rx=0x7f2ef40665a0 tx=0x7f2ef4146220).stop 2020-06-12T17:50:29.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.910+0000 7f2ef9d8d700 1 -- 172.21.15.38:0/1016701883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ef4142fb0 msgr2=0x7f2ef4143460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:29.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.910+0000 7f2ef9d8d700 1 --2- 172.21.15.38:0/1016701883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ef4142fb0 0x7f2ef4143460 secure :-1 s=READY pgs=680 cs=0 l=1 rx=0x7f2ee8007ed0 tx=0x7f2ee8007e60).stop 2020-06-12T17:50:29.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.910+0000 7f2ef9d8d700 1 -- 172.21.15.38:0/1016701883 shutdown_connections 2020-06-12T17:50:29.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.910+0000 7f2ef9d8d700 1 --2- 172.21.15.38:0/1016701883 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2ed404d410 0x7f2ed404f8d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:29.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.910+0000 7f2ef9d8d700 1 --2- 172.21.15.38:0/1016701883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ef4142fb0 0x7f2ef4143460 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:29.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.910+0000 7f2ef9d8d700 1 -- 172.21.15.38:0/1016701883 >> 172.21.15.38:0/1016701883 conn(0x7f2ef40b5a20 msgr2=0x7f2ef40b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:29.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.910+0000 7f2ef9d8d700 1 -- 172.21.15.38:0/1016701883 shutdown_connections 2020-06-12T17:50:29.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:29.910+0000 7f2ef9d8d700 1 -- 172.21.15.38:0/1016701883 wait complete. 2020-06-12T17:50:29.924 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_8989 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_8989/792706b8-377b-4a5d-8ff8-71da1845ca9f 2020-06-12T17:50:29.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:29.925 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:29.926 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:29.942 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:29.942 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:29.943 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8989/792706b8-377b-4a5d-8ff8-71da1845ca9f/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:30.035 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:30.035 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:30.036 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119387 s, 87.8 MB/s 2020-06-12T17:50:30.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:30.037 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:30.038 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:30.053 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:30.054 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:30.054 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8989/792706b8-377b-4a5d-8ff8-71da1845ca9f/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:30.144 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:30.145 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:30.145 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133185 s, 78.7 MB/s 2020-06-12T17:50:30.146 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:30.147 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:30.147 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:30.162 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:30.163 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:30.163 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8989/792706b8-377b-4a5d-8ff8-71da1845ca9f/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:30.268 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:30.269 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:30.269 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127539 s, 82.2 MB/s 2020-06-12T17:50:30.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:30.271 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:30.271 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:30.296 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:30.297 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:30.298 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8989/792706b8-377b-4a5d-8ff8-71da1845ca9f/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:30.384 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:30.384 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:30.385 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109754 s, 95.5 MB/s 2020-06-12T17:50:30.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:30.386 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:30.387 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:30.402 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:30.402 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:30.403 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8989/792706b8-377b-4a5d-8ff8-71da1845ca9f/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:30.490 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:30.491 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:30.491 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118023 s, 88.8 MB/s 2020-06-12T17:50:30.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:30.492 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:30.493 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:30.509 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:30.510 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:30.510 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8989/792706b8-377b-4a5d-8ff8-71da1845ca9f/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:30.595 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:30.595 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:30.595 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115584 s, 90.7 MB/s 2020-06-12T17:50:30.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:30.597 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:30.597 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:30.613 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:30.613 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:30.614 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8989/792706b8-377b-4a5d-8ff8-71da1845ca9f/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:30.704 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:30.707 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:30.707 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132066 s, 79.4 MB/s 2020-06-12T17:50:30.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:30.709 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:30.710 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:30.725 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:30.725 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:30.726 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8989/792706b8-377b-4a5d-8ff8-71da1845ca9f/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:30.814 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:30.814 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:30.815 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121002 s, 86.7 MB/s 2020-06-12T17:50:30.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:30.817 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:30.817 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:30.832 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:30.832 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:30.833 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8989/792706b8-377b-4a5d-8ff8-71da1845ca9f/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:30.919 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:30.920 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:30.920 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106209 s, 98.7 MB/s 2020-06-12T17:50:30.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:30.922 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:30.924 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:30.976 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:30.977 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:30.977 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8989/792706b8-377b-4a5d-8ff8-71da1845ca9f/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:31.068 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:31.068 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:31.068 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012508 s, 83.8 MB/s 2020-06-12T17:50:31.069 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_1755 2020-06-12T17:50:31.193 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.189+0000 7f7de7ff8700 1 Processor -- start 2020-06-12T17:50:31.193 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.190+0000 7f7de7ff8700 1 -- start start 2020-06-12T17:50:31.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.190+0000 7f7de7ff8700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7de009d0b0 0x7f7de013c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:31.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.190+0000 7f7de7ff8700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de009b960 con 0x7f7de00b3ac0 2020-06-12T17:50:31.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.190+0000 7f7de7ff8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de009bc00 con 0x7f7de009df00 2020-06-12T17:50:31.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.190+0000 7f7de7ff8700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de00b48f0 con 0x7f7de009d0b0 2020-06-12T17:50:31.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.190+0000 7f7de6595700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7de009d0b0 0x7f7de013c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:31.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.190+0000 7f7de6595700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7de009d0b0 0x7f7de013c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38822/0 (socket says 172.21.15.38:38822) 2020-06-12T17:50:31.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.190+0000 7f7de6595700 1 -- 172.21.15.38:0/4102663830 learned_addr learned my addr 172.21.15.38:0/4102663830 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:31.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.190+0000 7f7de5d94700 1 --1- 172.21.15.38:0/4102663830 >> v1:172.21.15.38:6789/0 conn(0x7f7de00b3ac0 0x7f7de013bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40634/0 (socket says 172.21.15.38:40634) 2020-06-12T17:50:31.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.191+0000 7f7de6595700 1 -- 172.21.15.38:0/4102663830 >> v1:172.21.15.150:6789/0 conn(0x7f7de009df00 legacy=0x7f7de0066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:31.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.191+0000 7f7de6595700 1 -- 172.21.15.38:0/4102663830 >> v1:172.21.15.38:6789/0 conn(0x7f7de00b3ac0 legacy=0x7f7de013bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:31.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.191+0000 7f7de4d92700 1 -- 172.21.15.38:0/4102663830 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3410616353 0 0) 0x7f7de009b960 con 0x7f7de00b3ac0 2020-06-12T17:50:31.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.191+0000 7f7de6595700 1 -- 172.21.15.38:0/4102663830 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de00b3ea0 con 0x7f7de009d0b0 2020-06-12T17:50:31.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.191+0000 7f7de6595700 1 --2- 172.21.15.38:0/4102663830 >> v2:172.21.15.38:3300/0 conn(0x7f7de009d0b0 0x7f7de013c650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7de00ae340 tx=0x7f7dd8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.191+0000 7f7de6595700 1 --2- 172.21.15.38:0/4102663830 >> v2:172.21.15.38:3300/0 conn(0x7f7de009d0b0 0x7f7de013c650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7de00ae340 tx=0x7f7dd8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.191+0000 7f7de6595700 1 --2- 172.21.15.38:0/4102663830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de009d0b0 0x7f7de013c650 secure :-1 s=READY pgs=682 cs=0 l=1 rx=0x7f7de00ae340 tx=0x7f7dd8007e60).ready entity=mon.0 client_cookie=2b7856a4a51fe8f0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:31.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.191+0000 7f7de6595700 1 --2- 172.21.15.38:0/4102663830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de009d0b0 0x7f7de013c650 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7f7de00ae340 tx=0x7f7dd8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.191+0000 7f7de4d92700 1 -- 172.21.15.38:0/4102663830 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7dd80116a0 con 0x7f7de009d0b0 2020-06-12T17:50:31.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.191+0000 7f7de6595700 1 --2- 172.21.15.38:0/4102663830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de009d0b0 0x7f7de013c650 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7f7de00ae340 tx=0x7f7dd8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.191+0000 7f7de6595700 1 --2- 172.21.15.38:0/4102663830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de009d0b0 0x7f7de013c650 secure :-1 s=THROTTLE_DONE pgs=682 cs=0 l=1 rx=0x7f7de00ae340 tx=0x7f7dd8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.191+0000 7f7de4d92700 1 -- 172.21.15.38:0/4102663830 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd8011800 con 0x7f7de009d0b0 2020-06-12T17:50:31.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.191+0000 7f7de4d92700 1 -- 172.21.15.38:0/4102663830 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7dd8011be0 con 0x7f7de009d0b0 2020-06-12T17:50:31.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.191+0000 7f7de7ff8700 1 -- 172.21.15.38:0/4102663830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de009d0b0 msgr2=0x7f7de013c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:31.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.191+0000 7f7de7ff8700 1 --2- 172.21.15.38:0/4102663830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de009d0b0 0x7f7de013c650 secure :-1 s=READY pgs=682 cs=0 l=1 rx=0x7f7de00ae340 tx=0x7f7dd8007e60).stop 2020-06-12T17:50:31.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.192+0000 7f7de7ff8700 1 -- 172.21.15.38:0/4102663830 shutdown_connections 2020-06-12T17:50:31.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.192+0000 7f7de7ff8700 1 --2- 172.21.15.38:0/4102663830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de009d0b0 0x7f7de013c650 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:31.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.192+0000 7f7de7ff8700 1 -- 172.21.15.38:0/4102663830 >> 172.21.15.38:0/4102663830 conn(0x7f7de00b5a20 msgr2=0x7f7de005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:31.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.192+0000 7f7de7ff8700 1 -- 172.21.15.38:0/4102663830 shutdown_connections 2020-06-12T17:50:31.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.192+0000 7f7de7ff8700 1 -- 172.21.15.38:0/4102663830 wait complete. 2020-06-12T17:50:31.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.193+0000 7f7de7ff8700 1 Processor -- start 2020-06-12T17:50:31.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.193+0000 7f7de7ff8700 1 -- start start 2020-06-12T17:50:31.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.193+0000 7f7de7ff8700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7de009d0b0 0x7f7de0064010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:31.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.193+0000 7f7de7ff8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7de009df00 0x7f7de0147600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:31.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.193+0000 7f7de7ff8700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de0150180 con 0x7f7de00b3ac0 2020-06-12T17:50:31.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.193+0000 7f7de7ff8700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de0150420 con 0x7f7de009d0b0 2020-06-12T17:50:31.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.193+0000 7f7de7ff8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de0147a60 con 0x7f7de009df00 2020-06-12T17:50:31.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.193+0000 7f7de5d94700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7de009d0b0 0x7f7de0064010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:31.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.193+0000 7f7de5d94700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7de009d0b0 0x7f7de0064010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38824/0 (socket says 172.21.15.38:38824) 2020-06-12T17:50:31.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.193+0000 7f7de5d94700 1 -- 172.21.15.38:0/1698614895 learned_addr learned my addr 172.21.15.38:0/1698614895 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:31.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.193+0000 7f7de6595700 1 --1- 172.21.15.38:0/1698614895 >> v1:172.21.15.38:6789/0 conn(0x7f7de00b3ac0 0x7f7de0156d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40644/0 (socket says 172.21.15.38:40644) 2020-06-12T17:50:31.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.194+0000 7f7de5593700 1 --2- 172.21.15.38:0/1698614895 >> v2:172.21.15.150:3300/0 conn(0x7f7de009df00 0x7f7de0147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:31.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.194+0000 7f7de5d94700 1 -- 172.21.15.38:0/1698614895 >> v2:172.21.15.150:3300/0 conn(0x7f7de009df00 msgr2=0x7f7de0147600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:31.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.194+0000 7f7de5d94700 1 --2- 172.21.15.38:0/1698614895 >> v2:172.21.15.150:3300/0 conn(0x7f7de009df00 0x7f7de0147600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:31.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.194+0000 7f7dceffd700 1 -- 172.21.15.38:0/1698614895 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4139106852 0 0) 0x7f7de0150180 con 0x7f7de00b3ac0 2020-06-12T17:50:31.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.194+0000 7f7de5d94700 1 -- 172.21.15.38:0/1698614895 >> v1:172.21.15.38:6789/0 conn(0x7f7de00b3ac0 legacy=0x7f7de0156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:31.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.194+0000 7f7de5d94700 1 -- 172.21.15.38:0/1698614895 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de00b4540 con 0x7f7de009d0b0 2020-06-12T17:50:31.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.194+0000 7f7de5593700 1 --2- 172.21.15.38:0/1698614895 >> v2:172.21.15.150:3300/0 conn(0x7f7de009df00 0x7f7de0147600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:50:31.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.194+0000 7f7de5d94700 1 --2- 172.21.15.38:0/1698614895 >> v2:172.21.15.38:3300/0 conn(0x7f7de009d0b0 0x7f7de0064010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7dd0001390 tx=0x7f7dd0001790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.194+0000 7f7de5d94700 1 --2- 172.21.15.38:0/1698614895 >> v2:172.21.15.38:3300/0 conn(0x7f7de009d0b0 0x7f7de0064010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7dd0001390 tx=0x7f7dd0001790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.194+0000 7f7de5d94700 1 --2- 172.21.15.38:0/1698614895 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de009d0b0 0x7f7de0064010 secure :-1 s=READY pgs=684 cs=0 l=1 rx=0x7f7dd0001390 tx=0x7f7dd0001790).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:31.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.194+0000 7f7de5d94700 1 --2- 172.21.15.38:0/1698614895 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de009d0b0 0x7f7de0064010 secure :-1 s=THROTTLE_DONE pgs=684 cs=0 l=1 rx=0x7f7dd0001390 tx=0x7f7dd0001790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.194+0000 7f7dceffd700 1 -- 172.21.15.38:0/1698614895 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7dd000c970 con 0x7f7de009d0b0 2020-06-12T17:50:31.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.194+0000 7f7de5d94700 1 --2- 172.21.15.38:0/1698614895 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de009d0b0 0x7f7de0064010 secure :-1 s=THROTTLE_DONE pgs=684 cs=0 l=1 rx=0x7f7dd0001390 tx=0x7f7dd0001790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.194+0000 7f7de5d94700 1 --2- 172.21.15.38:0/1698614895 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de009d0b0 0x7f7de0064010 secure :-1 s=THROTTLE_DONE pgs=684 cs=0 l=1 rx=0x7f7dd0001390 tx=0x7f7dd0001790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.194+0000 7f7dceffd700 1 -- 172.21.15.38:0/1698614895 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd000cad0 con 0x7f7de009d0b0 2020-06-12T17:50:31.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.194+0000 7f7de7ff8700 1 -- 172.21.15.38:0/1698614895 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de0065bf0 con 0x7f7de009d0b0 2020-06-12T17:50:31.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.194+0000 7f7dceffd700 1 -- 172.21.15.38:0/1698614895 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7dd000ce70 con 0x7f7de009d0b0 2020-06-12T17:50:31.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.194+0000 7f7de7ff8700 1 -- 172.21.15.38:0/1698614895 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de013f790 con 0x7f7de009d0b0 2020-06-12T17:50:31.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.195+0000 7f7de5d94700 1 --2- 172.21.15.38:0/1698614895 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de009d0b0 0x7f7de0064010 secure :-1 s=THROTTLE_DONE pgs=684 cs=0 l=1 rx=0x7f7dd0001390 tx=0x7f7dd0001790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.195+0000 7f7dceffd700 1 -- 172.21.15.38:0/1698614895 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f7dd00045c0 con 0x7f7de009d0b0 2020-06-12T17:50:31.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.195+0000 7f7de5d94700 1 --2- 172.21.15.38:0/1698614895 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de009d0b0 0x7f7de0064010 secure :-1 s=THROTTLE_DONE pgs=684 cs=0 l=1 rx=0x7f7dd0001390 tx=0x7f7dd0001790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.195+0000 7f7de7ff8700 1 -- 172.21.15.38:0/1698614895 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de0056c30 con 0x7f7de009d0b0 2020-06-12T17:50:31.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.196+0000 7f7dceffd700 1 --2- 172.21.15.38:0/1698614895 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7dc004d3e0 0x7f7dc004f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:31.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.196+0000 7f7dceffd700 1 -- 172.21.15.38:0/1698614895 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7dd0060b00 con 0x7f7de009d0b0 2020-06-12T17:50:31.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.196+0000 7f7de5593700 1 --2- 172.21.15.38:0/1698614895 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7dc004d3e0 0x7f7dc004f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:31.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.196+0000 7f7de5593700 1 --2- 172.21.15.38:0/1698614895 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7dc004d3e0 0x7f7dc004f8a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7ddc0022d0 tx=0x7f7ddc0028d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.196+0000 7f7de5593700 1 --2- 172.21.15.38:0/1698614895 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7dc004d3e0 0x7f7dc004f8a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7ddc0022d0 tx=0x7f7ddc0028d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.196+0000 7f7de5593700 1 --2- 172.21.15.38:0/1698614895 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7dc004d3e0 0x7f7dc004f8a0 secure :-1 s=READY pgs=268 cs=0 l=1 rx=0x7f7ddc0022d0 tx=0x7f7ddc0028d0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:31.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.199+0000 7f7de5d94700 1 --2- 172.21.15.38:0/1698614895 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de009d0b0 0x7f7de0064010 secure :-1 s=THROTTLE_DONE pgs=684 cs=0 l=1 rx=0x7f7dd0001390 tx=0x7f7dd0001790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.199+0000 7f7dceffd700 1 -- 172.21.15.38:0/1698614895 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f7dd003c220 con 0x7f7de009d0b0 2020-06-12T17:50:31.400 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.397+0000 7f7de7ff8700 1 -- 172.21.15.38:0/1698614895 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_1755", "target": ["mon-mgr", ""]}) v1 -- 0x7f7de005a5e0 con 0x7f7dc004d3e0 2020-06-12T17:50:31.419 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.415+0000 7f7de5593700 1 --2- 172.21.15.38:0/1698614895 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7dc004d3e0 0x7f7dc004f8a0 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7f7ddc0022d0 tx=0x7f7ddc0028d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.419 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.415+0000 7f7dceffd700 1 -- 172.21.15.38:0/1698614895 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f7de005a5e0 con 0x7f7dc004d3e0 2020-06-12T17:50:31.420 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.417+0000 7f7de7ff8700 1 -- 172.21.15.38:0/1698614895 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7dc004d3e0 msgr2=0x7f7dc004f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:31.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.417+0000 7f7de7ff8700 1 --2- 172.21.15.38:0/1698614895 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7dc004d3e0 0x7f7dc004f8a0 secure :-1 s=READY pgs=268 cs=0 l=1 rx=0x7f7ddc0022d0 tx=0x7f7ddc0028d0).stop 2020-06-12T17:50:31.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.417+0000 7f7de7ff8700 1 -- 172.21.15.38:0/1698614895 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de009d0b0 msgr2=0x7f7de0064010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:31.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.417+0000 7f7de7ff8700 1 --2- 172.21.15.38:0/1698614895 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de009d0b0 0x7f7de0064010 secure :-1 s=READY pgs=684 cs=0 l=1 rx=0x7f7dd0001390 tx=0x7f7dd0001790).stop 2020-06-12T17:50:31.421 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.417+0000 7f7de7ff8700 1 -- 172.21.15.38:0/1698614895 shutdown_connections 2020-06-12T17:50:31.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.417+0000 7f7de7ff8700 1 --2- 172.21.15.38:0/1698614895 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7dc004d3e0 0x7f7dc004f8a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:31.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.417+0000 7f7de7ff8700 1 --2- 172.21.15.38:0/1698614895 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de009d0b0 0x7f7de0064010 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:31.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.417+0000 7f7de7ff8700 1 --2- 172.21.15.38:0/1698614895 >> v2:172.21.15.150:3300/0 conn(0x7f7de009df00 0x7f7de0147600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:31.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.417+0000 7f7de7ff8700 1 -- 172.21.15.38:0/1698614895 >> 172.21.15.38:0/1698614895 conn(0x7f7de00b5a20 msgr2=0x7f7de00b7910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:31.422 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.417+0000 7f7de7ff8700 1 -- 172.21.15.38:0/1698614895 shutdown_connections 2020-06-12T17:50:31.423 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.417+0000 7f7de7ff8700 1 -- 172.21.15.38:0/1698614895 wait complete. 2020-06-12T17:50:31.430 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_1755 2020-06-12T17:50:31.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.544+0000 7f06dc118700 1 Processor -- start 2020-06-12T17:50:31.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.544+0000 7f06dc118700 1 -- start start 2020-06-12T17:50:31.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.545+0000 7f06dc118700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f06d4146680 0x7f06d40ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:31.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.545+0000 7f06dc118700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06d40b2eb0 0x7f06d409d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:31.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.545+0000 7f06dc118700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d4146d20 con 0x7f06d409d620 2020-06-12T17:50:31.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.545+0000 7f06dc118700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d4066a80 con 0x7f06d4146680 2020-06-12T17:50:31.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.545+0000 7f06dc118700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d4146f50 con 0x7f06d40b2eb0 2020-06-12T17:50:31.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.545+0000 7f06d9eb4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f06d4146680 0x7f06d40ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:31.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.545+0000 7f06d9eb4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f06d4146680 0x7f06d40ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38832/0 (socket says 172.21.15.38:38832) 2020-06-12T17:50:31.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.545+0000 7f06d9eb4700 1 -- 172.21.15.38:0/3154939766 learned_addr learned my addr 172.21.15.38:0/3154939766 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:31.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.545+0000 7f06d96b3700 1 --2- 172.21.15.38:0/3154939766 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06d40b2eb0 0x7f06d409d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:31.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.545+0000 7f06d9eb4700 1 -- 172.21.15.38:0/3154939766 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06d40b2eb0 msgr2=0x7f06d409d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:31.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.545+0000 7f06d9eb4700 1 --2- 172.21.15.38:0/3154939766 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06d40b2eb0 0x7f06d409d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:31.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.545+0000 7f06d9eb4700 1 -- 172.21.15.38:0/3154939766 >> v1:172.21.15.150:6789/0 conn(0x7f06d409d620 legacy=0x7f06d409b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:31.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.545+0000 7f06d9eb4700 1 -- 172.21.15.38:0/3154939766 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d4146a60 con 0x7f06d4146680 2020-06-12T17:50:31.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.545+0000 7f06d9eb4700 1 --2- 172.21.15.38:0/3154939766 >> v2:172.21.15.38:3300/0 conn(0x7f06d4146680 0x7f06d40ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f06cc0032b0 tx=0x7f06cc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.545+0000 7f06d9eb4700 1 --2- 172.21.15.38:0/3154939766 >> v2:172.21.15.38:3300/0 conn(0x7f06d4146680 0x7f06d40ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f06cc0032b0 tx=0x7f06cc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.545+0000 7f06d9eb4700 1 --2- 172.21.15.38:0/3154939766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06d4146680 0x7f06d40ad5b0 secure :-1 s=READY pgs=685 cs=0 l=1 rx=0x7f06cc0032b0 tx=0x7f06cc0081e0).ready entity=mon.0 client_cookie=ec19ca2971eb70d0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:31.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.545+0000 7f06d9eb4700 1 --2- 172.21.15.38:0/3154939766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06d4146680 0x7f06d40ad5b0 secure :-1 s=THROTTLE_DONE pgs=685 cs=0 l=1 rx=0x7f06cc0032b0 tx=0x7f06cc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.545+0000 7f06d9eb4700 1 --2- 172.21.15.38:0/3154939766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06d4146680 0x7f06d40ad5b0 secure :-1 s=THROTTLE_DONE pgs=685 cs=0 l=1 rx=0x7f06cc0032b0 tx=0x7f06cc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.545+0000 7f06d8eb2700 1 -- 172.21.15.38:0/3154939766 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06cc011ea0 con 0x7f06d4146680 2020-06-12T17:50:31.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.545+0000 7f06d9eb4700 1 --2- 172.21.15.38:0/3154939766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06d4146680 0x7f06d40ad5b0 secure :-1 s=THROTTLE_DONE pgs=685 cs=0 l=1 rx=0x7f06cc0032b0 tx=0x7f06cc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.545+0000 7f06d8eb2700 1 -- 172.21.15.38:0/3154939766 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06cc00a160 con 0x7f06d4146680 2020-06-12T17:50:31.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.545+0000 7f06d8eb2700 1 -- 172.21.15.38:0/3154939766 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06cc00a580 con 0x7f06d4146680 2020-06-12T17:50:31.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.545+0000 7f06dc118700 1 -- 172.21.15.38:0/3154939766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06d4146680 msgr2=0x7f06d40ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:31.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.545+0000 7f06dc118700 1 --2- 172.21.15.38:0/3154939766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06d4146680 0x7f06d40ad5b0 secure :-1 s=READY pgs=685 cs=0 l=1 rx=0x7f06cc0032b0 tx=0x7f06cc0081e0).stop 2020-06-12T17:50:31.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.546+0000 7f06dc118700 1 -- 172.21.15.38:0/3154939766 shutdown_connections 2020-06-12T17:50:31.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.546+0000 7f06dc118700 1 --2- 172.21.15.38:0/3154939766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06d4146680 0x7f06d40ad5b0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:31.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.546+0000 7f06dc118700 1 --2- 172.21.15.38:0/3154939766 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06d40b2eb0 0x7f06d409d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:31.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.546+0000 7f06dc118700 1 -- 172.21.15.38:0/3154939766 >> 172.21.15.38:0/3154939766 conn(0x7f06d40b5a20 msgr2=0x7f06d405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:31.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.546+0000 7f06dc118700 1 -- 172.21.15.38:0/3154939766 shutdown_connections 2020-06-12T17:50:31.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.546+0000 7f06dc118700 1 -- 172.21.15.38:0/3154939766 wait complete. 2020-06-12T17:50:31.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.547+0000 7f06dc118700 1 Processor -- start 2020-06-12T17:50:31.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.547+0000 7f06dc118700 1 -- start start 2020-06-12T17:50:31.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.548+0000 7f06dc118700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f06d409d620 0x7f06d4142c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:31.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.548+0000 7f06dc118700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f06d40b2eb0 0x7f06d40b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:31.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.548+0000 7f06dc118700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06d4146680 0x7f06d4147310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:31.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.548+0000 7f06dc118700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d40b1420 con 0x7f06d40b2eb0 2020-06-12T17:50:31.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.548+0000 7f06dc118700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d40b16c0 con 0x7f06d409d620 2020-06-12T17:50:31.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.548+0000 7f06dc118700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d40b1960 con 0x7f06d4146680 2020-06-12T17:50:31.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.548+0000 7f06d96b3700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f06d40b2eb0 0x7f06d40b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:31.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.548+0000 7f06d96b3700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f06d40b2eb0 0x7f06d40b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38840/0 (socket says 172.21.15.38:38840) 2020-06-12T17:50:31.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.548+0000 7f06d96b3700 1 -- 172.21.15.38:0/2421366784 learned_addr learned my addr 172.21.15.38:0/2421366784 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:31.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.548+0000 7f06d9eb4700 1 --2- 172.21.15.38:0/2421366784 >> v2:172.21.15.150:3300/0 conn(0x7f06d409d620 0x7f06d4142c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:31.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.548+0000 7f06da6b5700 1 --2- 172.21.15.38:0/2421366784 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06d4146680 0x7f06d4147310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:31.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.548+0000 7f06d96b3700 1 -- 172.21.15.38:0/2421366784 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06d4146680 msgr2=0x7f06d4147310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:31.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.548+0000 7f06d96b3700 1 --2- 172.21.15.38:0/2421366784 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06d4146680 0x7f06d4147310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:31.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.548+0000 7f06d96b3700 1 -- 172.21.15.38:0/2421366784 >> v2:172.21.15.150:3300/0 conn(0x7f06d409d620 msgr2=0x7f06d4142c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:31.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.548+0000 7f06d96b3700 1 --2- 172.21.15.38:0/2421366784 >> v2:172.21.15.150:3300/0 conn(0x7f06d409d620 0x7f06d4142c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:31.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.548+0000 7f06d96b3700 1 -- 172.21.15.38:0/2421366784 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d40b1170 con 0x7f06d40b2eb0 2020-06-12T17:50:31.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.548+0000 7f06da6b5700 1 --2- 172.21.15.38:0/2421366784 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06d4146680 0x7f06d4147310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:50:31.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.548+0000 7f06d96b3700 1 --2- 172.21.15.38:0/2421366784 >> v2:172.21.15.38:3300/0 conn(0x7f06d40b2eb0 0x7f06d40b0d10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f06c8003070 tx=0x7f06c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.548+0000 7f06d96b3700 1 --2- 172.21.15.38:0/2421366784 >> v2:172.21.15.38:3300/0 conn(0x7f06d40b2eb0 0x7f06d40b0d10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f06c8003070 tx=0x7f06c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.548+0000 7f06d96b3700 1 --2- 172.21.15.38:0/2421366784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06d40b2eb0 0x7f06d40b0d10 secure :-1 s=READY pgs=686 cs=0 l=1 rx=0x7f06c8003070 tx=0x7f06c8007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:31.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.548+0000 7f06d96b3700 1 --2- 172.21.15.38:0/2421366784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06d40b2eb0 0x7f06d40b0d10 secure :-1 s=THROTTLE_DONE pgs=686 cs=0 l=1 rx=0x7f06c8003070 tx=0x7f06c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.548+0000 7f06d96b3700 1 --2- 172.21.15.38:0/2421366784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06d40b2eb0 0x7f06d40b0d10 secure :-1 s=THROTTLE_DONE pgs=686 cs=0 l=1 rx=0x7f06c8003070 tx=0x7f06c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.548+0000 7f06d2ffd700 1 -- 172.21.15.38:0/2421366784 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06c8005e90 con 0x7f06d40b2eb0 2020-06-12T17:50:31.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.548+0000 7f06d96b3700 1 --2- 172.21.15.38:0/2421366784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06d40b2eb0 0x7f06d40b0d10 secure :-1 s=THROTTLE_DONE pgs=686 cs=0 l=1 rx=0x7f06c8003070 tx=0x7f06c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.548+0000 7f06d2ffd700 1 -- 172.21.15.38:0/2421366784 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c8007160 con 0x7f06d40b2eb0 2020-06-12T17:50:31.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.548+0000 7f06dc118700 1 -- 172.21.15.38:0/2421366784 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d4147770 con 0x7f06d40b2eb0 2020-06-12T17:50:31.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.549+0000 7f06d2ffd700 1 -- 172.21.15.38:0/2421366784 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06c8007540 con 0x7f06d40b2eb0 2020-06-12T17:50:31.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.549+0000 7f06dc118700 1 -- 172.21.15.38:0/2421366784 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d40b1e00 con 0x7f06d40b2eb0 2020-06-12T17:50:31.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.549+0000 7f06d96b3700 1 --2- 172.21.15.38:0/2421366784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06d40b2eb0 0x7f06d40b0d10 secure :-1 s=THROTTLE_DONE pgs=686 cs=0 l=1 rx=0x7f06c8003070 tx=0x7f06c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.550+0000 7f06d2ffd700 1 -- 172.21.15.38:0/2421366784 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f06c800e3b0 con 0x7f06d40b2eb0 2020-06-12T17:50:31.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.550+0000 7f06d96b3700 1 --2- 172.21.15.38:0/2421366784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06d40b2eb0 0x7f06d40b0d10 secure :-1 s=THROTTLE_DONE pgs=686 cs=0 l=1 rx=0x7f06c8003070 tx=0x7f06c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.550+0000 7f06dc118700 1 -- 172.21.15.38:0/2421366784 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d4056c30 con 0x7f06d40b2eb0 2020-06-12T17:50:31.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.550+0000 7f06d2ffd700 1 --2- 172.21.15.38:0/2421366784 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06b404d650 0x7f06b404fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:31.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.550+0000 7f06d2ffd700 1 -- 172.21.15.38:0/2421366784 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f06c8061310 con 0x7f06d40b2eb0 2020-06-12T17:50:31.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.550+0000 7f06d9eb4700 1 --2- 172.21.15.38:0/2421366784 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06b404d650 0x7f06b404fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:31.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.550+0000 7f06d9eb4700 1 --2- 172.21.15.38:0/2421366784 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06b404d650 0x7f06b404fb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f06cc0032b0 tx=0x7f06cc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.550+0000 7f06d9eb4700 1 --2- 172.21.15.38:0/2421366784 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06b404d650 0x7f06b404fb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f06cc0032b0 tx=0x7f06cc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.550+0000 7f06d9eb4700 1 --2- 172.21.15.38:0/2421366784 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06b404d650 0x7f06b404fb10 secure :-1 s=READY pgs=269 cs=0 l=1 rx=0x7f06cc0032b0 tx=0x7f06cc0081e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:31.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.553+0000 7f06d96b3700 1 --2- 172.21.15.38:0/2421366784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06d40b2eb0 0x7f06d40b0d10 secure :-1 s=THROTTLE_DONE pgs=686 cs=0 l=1 rx=0x7f06c8003070 tx=0x7f06c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.553+0000 7f06d2ffd700 1 -- 172.21.15.38:0/2421366784 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f06c803ca90 con 0x7f06d40b2eb0 2020-06-12T17:50:31.754 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.750+0000 7f06dc118700 1 -- 172.21.15.38:0/2421366784 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_1755", "target": ["mon-mgr", ""]}) v1 -- 0x7f06d40b1b60 con 0x7f06b404d650 2020-06-12T17:50:31.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.754+0000 7f06d9eb4700 1 --2- 172.21.15.38:0/2421366784 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06b404d650 0x7f06b404fb10 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7f06cc0032b0 tx=0x7f06cc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:31.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.754+0000 7f06d2ffd700 1 -- 172.21.15.38:0/2421366784 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f06cc008940 con 0x7f06b404d650 2020-06-12T17:50:31.758 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_1755/69f15ea6-1af7-4b47-85a6-8504f2e00cc4 2020-06-12T17:50:31.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.755+0000 7f06dc118700 1 -- 172.21.15.38:0/2421366784 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06b404d650 msgr2=0x7f06b404fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:31.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.755+0000 7f06dc118700 1 --2- 172.21.15.38:0/2421366784 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06b404d650 0x7f06b404fb10 secure :-1 s=READY pgs=269 cs=0 l=1 rx=0x7f06cc0032b0 tx=0x7f06cc0081e0).stop 2020-06-12T17:50:31.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.755+0000 7f06dc118700 1 -- 172.21.15.38:0/2421366784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06d40b2eb0 msgr2=0x7f06d40b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:31.760 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.755+0000 7f06dc118700 1 --2- 172.21.15.38:0/2421366784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06d40b2eb0 0x7f06d40b0d10 secure :-1 s=READY pgs=686 cs=0 l=1 rx=0x7f06c8003070 tx=0x7f06c8007e60).stop 2020-06-12T17:50:31.760 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.755+0000 7f06dc118700 1 -- 172.21.15.38:0/2421366784 shutdown_connections 2020-06-12T17:50:31.760 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.755+0000 7f06dc118700 1 --2- 172.21.15.38:0/2421366784 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f06b404d650 0x7f06b404fb10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:31.760 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.755+0000 7f06dc118700 1 --2- 172.21.15.38:0/2421366784 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06d4146680 0x7f06d4147310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:31.760 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.755+0000 7f06dc118700 1 --2- 172.21.15.38:0/2421366784 >> v2:172.21.15.150:3300/0 conn(0x7f06d409d620 0x7f06d4142c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:31.761 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.755+0000 7f06dc118700 1 --2- 172.21.15.38:0/2421366784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f06d40b2eb0 0x7f06d40b0d10 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:31.761 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.755+0000 7f06dc118700 1 -- 172.21.15.38:0/2421366784 >> 172.21.15.38:0/2421366784 conn(0x7f06d40b5a20 msgr2=0x7f06d4145880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:31.761 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.755+0000 7f06dc118700 1 -- 172.21.15.38:0/2421366784 shutdown_connections 2020-06-12T17:50:31.761 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:31.755+0000 7f06dc118700 1 -- 172.21.15.38:0/2421366784 wait complete. 2020-06-12T17:50:31.769 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_1755 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_1755/69f15ea6-1af7-4b47-85a6-8504f2e00cc4 2020-06-12T17:50:31.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:31.770 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:31.770 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:31.785 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:31.786 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:31.786 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1755/69f15ea6-1af7-4b47-85a6-8504f2e00cc4/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:31.876 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:31.876 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:31.877 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011619 s, 90.2 MB/s 2020-06-12T17:50:31.878 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:31.878 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:31.879 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:31.893 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:31.901 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:31.902 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1755/69f15ea6-1af7-4b47-85a6-8504f2e00cc4/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:31.988 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:31.989 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:31.989 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142339 s, 73.7 MB/s 2020-06-12T17:50:31.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:31.990 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:31.991 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:32.006 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:32.006 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:32.007 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1755/69f15ea6-1af7-4b47-85a6-8504f2e00cc4/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:32.096 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:32.096 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:32.096 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00969358 s, 108 MB/s 2020-06-12T17:50:32.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:32.098 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:32.105 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:32.121 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:32.122 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:32.122 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1755/69f15ea6-1af7-4b47-85a6-8504f2e00cc4/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:32.211 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:32.211 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:32.211 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122148 s, 85.8 MB/s 2020-06-12T17:50:32.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:32.213 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:32.213 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:32.228 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:32.229 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:32.229 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1755/69f15ea6-1af7-4b47-85a6-8504f2e00cc4/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:32.318 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:32.318 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:32.318 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122982 s, 85.3 MB/s 2020-06-12T17:50:32.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:32.320 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:32.320 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:32.336 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:32.337 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:32.337 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1755/69f15ea6-1af7-4b47-85a6-8504f2e00cc4/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:32.424 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:32.425 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:32.425 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113695 s, 92.2 MB/s 2020-06-12T17:50:32.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:32.426 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:32.427 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:32.443 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:32.443 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:32.444 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1755/69f15ea6-1af7-4b47-85a6-8504f2e00cc4/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:32.532 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:32.533 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:32.533 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123643 s, 84.8 MB/s 2020-06-12T17:50:32.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:32.537 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:32.538 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:32.554 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:32.554 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:32.555 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1755/69f15ea6-1af7-4b47-85a6-8504f2e00cc4/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:32.641 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:32.642 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:32.642 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105678 s, 99.2 MB/s 2020-06-12T17:50:32.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:32.644 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:32.644 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:32.660 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:32.661 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:32.662 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1755/69f15ea6-1af7-4b47-85a6-8504f2e00cc4/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:32.751 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:32.752 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:32.752 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112426 s, 93.3 MB/s 2020-06-12T17:50:32.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:32.753 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:32.754 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:32.769 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:32.770 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:32.771 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1755/69f15ea6-1af7-4b47-85a6-8504f2e00cc4/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:32.860 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:32.861 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:32.861 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147256 s, 71.2 MB/s 2020-06-12T17:50:32.862 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_985 2020-06-12T17:50:32.994 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.982+0000 7fd610147700 1 Processor -- start 2020-06-12T17:50:32.994 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.982+0000 7fd610147700 1 -- start start 2020-06-12T17:50:32.995 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.983+0000 7fd610147700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd608146680 0x7fd6080ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:32.995 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.983+0000 7fd610147700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd6080b2eb0 0x7fd60809d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:32.995 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.983+0000 7fd610147700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd608146d20 con 0x7fd60809d620 2020-06-12T17:50:32.995 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.983+0000 7fd610147700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd608066a80 con 0x7fd608146680 2020-06-12T17:50:32.995 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.983+0000 7fd610147700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd608146f50 con 0x7fd6080b2eb0 2020-06-12T17:50:32.996 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.983+0000 7fd60dee3700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd608146680 0x7fd6080ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:32.996 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.983+0000 7fd60dee3700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd608146680 0x7fd6080ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38846/0 (socket says 172.21.15.38:38846) 2020-06-12T17:50:32.996 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.983+0000 7fd60dee3700 1 -- 172.21.15.38:0/1383670769 learned_addr learned my addr 172.21.15.38:0/1383670769 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:32.996 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.983+0000 7fd60d6e2700 1 --2- 172.21.15.38:0/1383670769 >> v2:172.21.15.150:3300/0 conn(0x7fd6080b2eb0 0x7fd60809d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:32.996 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.983+0000 7fd60dee3700 1 -- 172.21.15.38:0/1383670769 >> v2:172.21.15.150:3300/0 conn(0x7fd6080b2eb0 msgr2=0x7fd60809d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:32.997 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.983+0000 7fd60dee3700 1 --2- 172.21.15.38:0/1383670769 >> v2:172.21.15.150:3300/0 conn(0x7fd6080b2eb0 0x7fd60809d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:32.997 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.983+0000 7fd60dee3700 1 -- 172.21.15.38:0/1383670769 >> v1:172.21.15.150:6789/0 conn(0x7fd60809d620 legacy=0x7fd60809b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:32.997 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.983+0000 7fd60dee3700 1 -- 172.21.15.38:0/1383670769 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd608146a60 con 0x7fd608146680 2020-06-12T17:50:32.997 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.983+0000 7fd60dee3700 1 --2- 172.21.15.38:0/1383670769 >> v2:172.21.15.38:3300/0 conn(0x7fd608146680 0x7fd6080ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd5f8002f30 tx=0x7fd5f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:32.997 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.984+0000 7fd60dee3700 1 --2- 172.21.15.38:0/1383670769 >> v2:172.21.15.38:3300/0 conn(0x7fd608146680 0x7fd6080ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd5f8002f30 tx=0x7fd5f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:32.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.984+0000 7fd60dee3700 1 --2- 172.21.15.38:0/1383670769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd608146680 0x7fd6080ad5b0 secure :-1 s=READY pgs=687 cs=0 l=1 rx=0x7fd5f8002f30 tx=0x7fd5f8007e60).ready entity=mon.0 client_cookie=15c8c8640a9570e7 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:32.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.984+0000 7fd60dee3700 1 --2- 172.21.15.38:0/1383670769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd608146680 0x7fd6080ad5b0 secure :-1 s=THROTTLE_DONE pgs=687 cs=0 l=1 rx=0x7fd5f8002f30 tx=0x7fd5f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:32.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.984+0000 7fd60cee1700 1 -- 172.21.15.38:0/1383670769 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5f8011630 con 0x7fd608146680 2020-06-12T17:50:32.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.984+0000 7fd60dee3700 1 --2- 172.21.15.38:0/1383670769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd608146680 0x7fd6080ad5b0 secure :-1 s=THROTTLE_DONE pgs=687 cs=0 l=1 rx=0x7fd5f8002f30 tx=0x7fd5f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:32.998 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.984+0000 7fd60cee1700 1 -- 172.21.15.38:0/1383670769 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f8011790 con 0x7fd608146680 2020-06-12T17:50:32.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.984+0000 7fd60dee3700 1 --2- 172.21.15.38:0/1383670769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd608146680 0x7fd6080ad5b0 secure :-1 s=THROTTLE_DONE pgs=687 cs=0 l=1 rx=0x7fd5f8002f30 tx=0x7fd5f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:32.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.984+0000 7fd60cee1700 1 -- 172.21.15.38:0/1383670769 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5f8011b70 con 0x7fd608146680 2020-06-12T17:50:32.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.984+0000 7fd610147700 1 -- 172.21.15.38:0/1383670769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd608146680 msgr2=0x7fd6080ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:32.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.984+0000 7fd610147700 1 --2- 172.21.15.38:0/1383670769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd608146680 0x7fd6080ad5b0 secure :-1 s=READY pgs=687 cs=0 l=1 rx=0x7fd5f8002f30 tx=0x7fd5f8007e60).stop 2020-06-12T17:50:32.999 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.984+0000 7fd610147700 1 -- 172.21.15.38:0/1383670769 shutdown_connections 2020-06-12T17:50:33.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.984+0000 7fd610147700 1 --2- 172.21.15.38:0/1383670769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd608146680 0x7fd6080ad5b0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:33.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.984+0000 7fd610147700 1 --2- 172.21.15.38:0/1383670769 >> v2:172.21.15.150:3300/0 conn(0x7fd6080b2eb0 0x7fd60809d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:33.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.984+0000 7fd610147700 1 -- 172.21.15.38:0/1383670769 >> 172.21.15.38:0/1383670769 conn(0x7fd6080b5a20 msgr2=0x7fd60805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:33.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.984+0000 7fd610147700 1 -- 172.21.15.38:0/1383670769 shutdown_connections 2020-06-12T17:50:33.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.984+0000 7fd610147700 1 -- 172.21.15.38:0/1383670769 wait complete. 2020-06-12T17:50:33.000 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.985+0000 7fd610147700 1 Processor -- start 2020-06-12T17:50:33.001 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.985+0000 7fd610147700 1 -- start start 2020-06-12T17:50:33.001 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.986+0000 7fd610147700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd6080b2eb0 0x7fd608142040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:33.001 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.986+0000 7fd610147700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6080b2500 con 0x7fd60809d620 2020-06-12T17:50:33.001 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.986+0000 7fd610147700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6080b1fc0 con 0x7fd608146680 2020-06-12T17:50:33.001 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.986+0000 7fd610147700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6080b2260 con 0x7fd6080b2eb0 2020-06-12T17:50:33.002 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.986+0000 7fd60d6e2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd6080b2eb0 0x7fd608142040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:33.002 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.986+0000 7fd60dee3700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd60809d620 0x7fd60809a800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40668/0 (socket says 172.21.15.38:40668) 2020-06-12T17:50:33.002 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.986+0000 7fd60d6e2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd6080b2eb0 0x7fd608142040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38854/0 (socket says 172.21.15.38:38854) 2020-06-12T17:50:33.002 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.986+0000 7fd60dee3700 1 -- 172.21.15.38:0/2003295452 learned_addr learned my addr 172.21.15.38:0/2003295452 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:33.002 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.986+0000 7fd60d6e2700 1 -- 172.21.15.38:0/2003295452 >> v1:172.21.15.150:6789/0 conn(0x7fd608146680 legacy=0x7fd608062020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:33.003 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.986+0000 7fd60d6e2700 1 -- 172.21.15.38:0/2003295452 >> v1:172.21.15.38:6789/0 conn(0x7fd60809d620 legacy=0x7fd60809a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:33.003 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.986+0000 7fd5f6ffd700 1 -- 172.21.15.38:0/2003295452 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3620402174 0 0) 0x7fd6080b2500 con 0x7fd60809d620 2020-06-12T17:50:33.003 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.986+0000 7fd60d6e2700 1 -- 172.21.15.38:0/2003295452 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6080b1d20 con 0x7fd6080b2eb0 2020-06-12T17:50:33.003 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.986+0000 7fd60d6e2700 1 --2- 172.21.15.38:0/2003295452 >> v2:172.21.15.38:3300/0 conn(0x7fd6080b2eb0 0x7fd608142040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd604002f30 tx=0x7fd604007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.003 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.987+0000 7fd60d6e2700 1 --2- 172.21.15.38:0/2003295452 >> v2:172.21.15.38:3300/0 conn(0x7fd6080b2eb0 0x7fd608142040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd604002f30 tx=0x7fd604007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.987+0000 7fd60d6e2700 1 --2- 172.21.15.38:0/2003295452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6080b2eb0 0x7fd608142040 secure :-1 s=READY pgs=689 cs=0 l=1 rx=0x7fd604002f30 tx=0x7fd604007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:33.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.987+0000 7fd60d6e2700 1 --2- 172.21.15.38:0/2003295452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6080b2eb0 0x7fd608142040 secure :-1 s=THROTTLE_DONE pgs=689 cs=0 l=1 rx=0x7fd604002f30 tx=0x7fd604007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.987+0000 7fd60d6e2700 1 --2- 172.21.15.38:0/2003295452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6080b2eb0 0x7fd608142040 secure :-1 s=THROTTLE_DONE pgs=689 cs=0 l=1 rx=0x7fd604002f30 tx=0x7fd604007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.987+0000 7fd5f6ffd700 1 -- 172.21.15.38:0/2003295452 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd604007530 con 0x7fd6080b2eb0 2020-06-12T17:50:33.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.987+0000 7fd5f6ffd700 1 -- 172.21.15.38:0/2003295452 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6040056c0 con 0x7fd6080b2eb0 2020-06-12T17:50:33.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.987+0000 7fd60d6e2700 1 --2- 172.21.15.38:0/2003295452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6080b2eb0 0x7fd608142040 secure :-1 s=THROTTLE_DONE pgs=689 cs=0 l=1 rx=0x7fd604002f30 tx=0x7fd604007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.987+0000 7fd610147700 1 -- 172.21.15.38:0/2003295452 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd60808ee50 con 0x7fd6080b2eb0 2020-06-12T17:50:33.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.987+0000 7fd5f6ffd700 1 -- 172.21.15.38:0/2003295452 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd604005aa0 con 0x7fd6080b2eb0 2020-06-12T17:50:33.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.987+0000 7fd610147700 1 -- 172.21.15.38:0/2003295452 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60809af10 con 0x7fd6080b2eb0 2020-06-12T17:50:33.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.987+0000 7fd60d6e2700 1 --2- 172.21.15.38:0/2003295452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6080b2eb0 0x7fd608142040 secure :-1 s=THROTTLE_DONE pgs=689 cs=0 l=1 rx=0x7fd604002f30 tx=0x7fd604007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.988+0000 7fd610147700 1 -- 172.21.15.38:0/2003295452 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd608061d10 con 0x7fd6080b2eb0 2020-06-12T17:50:33.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.988+0000 7fd5f6ffd700 1 -- 172.21.15.38:0/2003295452 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fd604005d20 con 0x7fd6080b2eb0 2020-06-12T17:50:33.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.988+0000 7fd60d6e2700 1 --2- 172.21.15.38:0/2003295452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6080b2eb0 0x7fd608142040 secure :-1 s=THROTTLE_DONE pgs=689 cs=0 l=1 rx=0x7fd604002f30 tx=0x7fd604007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.988+0000 7fd5f6ffd700 1 --2- 172.21.15.38:0/2003295452 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd5e804d4b0 0x7fd5e804f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:33.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.989+0000 7fd5f6ffd700 1 -- 172.21.15.38:0/2003295452 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd60400d0c0 con 0x7fd6080b2eb0 2020-06-12T17:50:33.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.989+0000 7fd60dee3700 1 --2- 172.21.15.38:0/2003295452 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd5e804d4b0 0x7fd5e804f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:33.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.989+0000 7fd60dee3700 1 --2- 172.21.15.38:0/2003295452 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd5e804d4b0 0x7fd5e804f970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd5f8002ed0 tx=0x7fd5f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.989+0000 7fd60dee3700 1 --2- 172.21.15.38:0/2003295452 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd5e804d4b0 0x7fd5e804f970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd5f8002ed0 tx=0x7fd5f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.989+0000 7fd60dee3700 1 --2- 172.21.15.38:0/2003295452 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd5e804d4b0 0x7fd5e804f970 secure :-1 s=READY pgs=270 cs=0 l=1 rx=0x7fd5f8002ed0 tx=0x7fd5f8007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:33.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.992+0000 7fd60d6e2700 1 --2- 172.21.15.38:0/2003295452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6080b2eb0 0x7fd608142040 secure :-1 s=THROTTLE_DONE pgs=689 cs=0 l=1 rx=0x7fd604002f30 tx=0x7fd604007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:32.992+0000 7fd5f6ffd700 1 -- 172.21.15.38:0/2003295452 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fd60403c9f0 con 0x7fd6080b2eb0 2020-06-12T17:50:33.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.185+0000 7fd610147700 1 -- 172.21.15.38:0/2003295452 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_985", "target": ["mon-mgr", ""]}) v1 -- 0x7fd608056c30 con 0x7fd5e804d4b0 2020-06-12T17:50:33.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.206+0000 7fd60dee3700 1 --2- 172.21.15.38:0/2003295452 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd5e804d4b0 0x7fd5e804f970 secure :-1 s=THROTTLE_DONE pgs=270 cs=0 l=1 rx=0x7fd5f8002ed0 tx=0x7fd5f8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.206+0000 7fd5f6ffd700 1 -- 172.21.15.38:0/2003295452 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd608056c30 con 0x7fd5e804d4b0 2020-06-12T17:50:33.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.208+0000 7fd610147700 1 -- 172.21.15.38:0/2003295452 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd5e804d4b0 msgr2=0x7fd5e804f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:33.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.208+0000 7fd610147700 1 --2- 172.21.15.38:0/2003295452 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd5e804d4b0 0x7fd5e804f970 secure :-1 s=READY pgs=270 cs=0 l=1 rx=0x7fd5f8002ed0 tx=0x7fd5f8007e60).stop 2020-06-12T17:50:33.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.208+0000 7fd610147700 1 -- 172.21.15.38:0/2003295452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6080b2eb0 msgr2=0x7fd608142040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:33.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.208+0000 7fd610147700 1 --2- 172.21.15.38:0/2003295452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6080b2eb0 0x7fd608142040 secure :-1 s=READY pgs=689 cs=0 l=1 rx=0x7fd604002f30 tx=0x7fd604007e60).stop 2020-06-12T17:50:33.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.208+0000 7fd610147700 1 -- 172.21.15.38:0/2003295452 shutdown_connections 2020-06-12T17:50:33.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.208+0000 7fd610147700 1 --2- 172.21.15.38:0/2003295452 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd5e804d4b0 0x7fd5e804f970 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:33.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.208+0000 7fd610147700 1 --2- 172.21.15.38:0/2003295452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6080b2eb0 0x7fd608142040 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:33.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.208+0000 7fd610147700 1 -- 172.21.15.38:0/2003295452 >> 172.21.15.38:0/2003295452 conn(0x7fd6080b5a20 msgr2=0x7fd60809b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:33.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.208+0000 7fd610147700 1 -- 172.21.15.38:0/2003295452 shutdown_connections 2020-06-12T17:50:33.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.208+0000 7fd610147700 1 -- 172.21.15.38:0/2003295452 wait complete. 2020-06-12T17:50:33.221 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_985 2020-06-12T17:50:33.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.337+0000 7fef9126b700 1 Processor -- start 2020-06-12T17:50:33.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.337+0000 7fef9126b700 1 -- start start 2020-06-12T17:50:33.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.338+0000 7fef9126b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef8c146680 0x7fef8c0ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:33.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.338+0000 7fef9126b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fef8c0b2eb0 0x7fef8c09d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:33.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.338+0000 7fef9126b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fef8c09d620 0x7fef8c09da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:33.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.338+0000 7fef9126b700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef8c146d20 con 0x7fef8c0b2eb0 2020-06-12T17:50:33.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.338+0000 7fef9126b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef8c066a80 con 0x7fef8c09d620 2020-06-12T17:50:33.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.338+0000 7fef9126b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c146f50 con 0x7fef8c146680 2020-06-12T17:50:33.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.338+0000 7fef8a7fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fef8c0b2eb0 0x7fef8c09d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:33.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.338+0000 7fef8a7fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fef8c0b2eb0 0x7fef8c09d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38862/0 (socket says 172.21.15.38:38862) 2020-06-12T17:50:33.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.338+0000 7fef8a7fc700 1 -- 172.21.15.38:0/3726801595 learned_addr learned my addr 172.21.15.38:0/3726801595 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:33.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.338+0000 7fef8affd700 1 --2- 172.21.15.38:0/3726801595 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef8c146680 0x7fef8c0ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:33.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.338+0000 7fef8b7fe700 1 --2- 172.21.15.38:0/3726801595 >> v2:172.21.15.150:3300/0 conn(0x7fef8c09d620 0x7fef8c09da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:33.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.338+0000 7fef8a7fc700 1 -- 172.21.15.38:0/3726801595 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef8c146680 msgr2=0x7fef8c0ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:33.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.338+0000 7fef8a7fc700 1 --2- 172.21.15.38:0/3726801595 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef8c146680 0x7fef8c0ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:33.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.338+0000 7fef8a7fc700 1 -- 172.21.15.38:0/3726801595 >> v2:172.21.15.150:3300/0 conn(0x7fef8c09d620 msgr2=0x7fef8c09da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:33.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.338+0000 7fef8a7fc700 1 --2- 172.21.15.38:0/3726801595 >> v2:172.21.15.150:3300/0 conn(0x7fef8c09d620 0x7fef8c09da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:33.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.338+0000 7fef8a7fc700 1 -- 172.21.15.38:0/3726801595 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8c146a60 con 0x7fef8c0b2eb0 2020-06-12T17:50:33.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.338+0000 7fef8a7fc700 1 --2- 172.21.15.38:0/3726801595 >> v2:172.21.15.38:3300/0 conn(0x7fef8c0b2eb0 0x7fef8c09d1c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fef7c002f30 tx=0x7fef7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.349 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.338+0000 7fef8a7fc700 1 --2- 172.21.15.38:0/3726801595 >> v2:172.21.15.38:3300/0 conn(0x7fef8c0b2eb0 0x7fef8c09d1c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fef7c002f30 tx=0x7fef7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.338+0000 7fef8a7fc700 1 --2- 172.21.15.38:0/3726801595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef8c0b2eb0 0x7fef8c09d1c0 secure :-1 s=READY pgs=690 cs=0 l=1 rx=0x7fef7c002f30 tx=0x7fef7c007e60).ready entity=mon.0 client_cookie=840cdae23fbb3e52 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:33.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.338+0000 7fef8a7fc700 1 --2- 172.21.15.38:0/3726801595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef8c0b2eb0 0x7fef8c09d1c0 secure :-1 s=THROTTLE_DONE pgs=690 cs=0 l=1 rx=0x7fef7c002f30 tx=0x7fef7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.338+0000 7fef89ffb700 1 -- 172.21.15.38:0/3726801595 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef7c013de0 con 0x7fef8c0b2eb0 2020-06-12T17:50:33.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.339+0000 7fef8a7fc700 1 --2- 172.21.15.38:0/3726801595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef8c0b2eb0 0x7fef8c09d1c0 secure :-1 s=THROTTLE_DONE pgs=690 cs=0 l=1 rx=0x7fef7c002f30 tx=0x7fef7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.339+0000 7fef89ffb700 1 -- 172.21.15.38:0/3726801595 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7c00c160 con 0x7fef8c0b2eb0 2020-06-12T17:50:33.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.339+0000 7fef8a7fc700 1 --2- 172.21.15.38:0/3726801595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef8c0b2eb0 0x7fef8c09d1c0 secure :-1 s=THROTTLE_DONE pgs=690 cs=0 l=1 rx=0x7fef7c002f30 tx=0x7fef7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.339+0000 7fef89ffb700 1 -- 172.21.15.38:0/3726801595 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef7c00c540 con 0x7fef8c0b2eb0 2020-06-12T17:50:33.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.339+0000 7fef9126b700 1 -- 172.21.15.38:0/3726801595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef8c0b2eb0 msgr2=0x7fef8c09d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:33.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.339+0000 7fef9126b700 1 --2- 172.21.15.38:0/3726801595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef8c0b2eb0 0x7fef8c09d1c0 secure :-1 s=READY pgs=690 cs=0 l=1 rx=0x7fef7c002f30 tx=0x7fef7c007e60).stop 2020-06-12T17:50:33.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.339+0000 7fef9126b700 1 -- 172.21.15.38:0/3726801595 shutdown_connections 2020-06-12T17:50:33.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.339+0000 7fef9126b700 1 --2- 172.21.15.38:0/3726801595 >> v2:172.21.15.150:3300/0 conn(0x7fef8c09d620 0x7fef8c09da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:33.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.339+0000 7fef9126b700 1 --2- 172.21.15.38:0/3726801595 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef8c146680 0x7fef8c0ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:33.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.339+0000 7fef9126b700 1 --2- 172.21.15.38:0/3726801595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef8c0b2eb0 0x7fef8c09d1c0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:33.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.339+0000 7fef9126b700 1 -- 172.21.15.38:0/3726801595 >> 172.21.15.38:0/3726801595 conn(0x7fef8c0b5a20 msgr2=0x7fef8c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:33.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.339+0000 7fef9126b700 1 -- 172.21.15.38:0/3726801595 shutdown_connections 2020-06-12T17:50:33.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.339+0000 7fef9126b700 1 -- 172.21.15.38:0/3726801595 wait complete. 2020-06-12T17:50:33.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.340+0000 7fef9126b700 1 Processor -- start 2020-06-12T17:50:33.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.340+0000 7fef9126b700 1 -- start start 2020-06-12T17:50:33.356 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.341+0000 7fef9126b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef8c09d620 0x7fef8c0616a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:33.356 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.341+0000 7fef9126b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fef8c0b2eb0 0x7fef8c142890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:33.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.341+0000 7fef9126b700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef8c061d60 con 0x7fef8c146680 2020-06-12T17:50:33.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.341+0000 7fef9126b700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef8c062c80 con 0x7fef8c0b2eb0 2020-06-12T17:50:33.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.341+0000 7fef9126b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c063120 con 0x7fef8c09d620 2020-06-12T17:50:33.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.341+0000 7fef8a7fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fef8c0b2eb0 0x7fef8c142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:33.358 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.341+0000 7fef8a7fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fef8c0b2eb0 0x7fef8c142890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38868/0 (socket says 172.21.15.38:38868) 2020-06-12T17:50:33.358 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.341+0000 7fef8a7fc700 1 -- 172.21.15.38:0/3775725248 learned_addr learned my addr 172.21.15.38:0/3775725248 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:33.358 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.341+0000 7fef8b7fe700 1 --1- 172.21.15.38:0/3775725248 >> v1:172.21.15.38:6789/0 conn(0x7fef8c146680 0x7fef8c1525e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40686/0 (socket says 172.21.15.38:40686) 2020-06-12T17:50:33.358 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.341+0000 7fef8affd700 1 --2- 172.21.15.38:0/3775725248 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef8c09d620 0x7fef8c0616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:33.358 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.341+0000 7fef8a7fc700 1 -- 172.21.15.38:0/3775725248 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef8c09d620 msgr2=0x7fef8c0616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:33.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.341+0000 7fef8a7fc700 1 --2- 172.21.15.38:0/3775725248 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef8c09d620 0x7fef8c0616a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:33.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.341+0000 7fef7bfff700 1 -- 172.21.15.38:0/3775725248 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604095649 0 0) 0x7fef8c061d60 con 0x7fef8c146680 2020-06-12T17:50:33.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.341+0000 7fef8a7fc700 1 -- 172.21.15.38:0/3775725248 >> v1:172.21.15.38:6789/0 conn(0x7fef8c146680 legacy=0x7fef8c1525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:33.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.341+0000 7fef8a7fc700 1 -- 172.21.15.38:0/3775725248 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8c063290 con 0x7fef8c0b2eb0 2020-06-12T17:50:33.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.341+0000 7fef8a7fc700 1 --2- 172.21.15.38:0/3775725248 >> v2:172.21.15.38:3300/0 conn(0x7fef8c0b2eb0 0x7fef8c142890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fef7c002f30 tx=0x7fef7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.341+0000 7fef8a7fc700 1 --2- 172.21.15.38:0/3775725248 >> v2:172.21.15.38:3300/0 conn(0x7fef8c0b2eb0 0x7fef8c142890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fef7c002f30 tx=0x7fef7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.341+0000 7fef8a7fc700 1 --2- 172.21.15.38:0/3775725248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef8c0b2eb0 0x7fef8c142890 secure :-1 s=READY pgs=692 cs=0 l=1 rx=0x7fef7c002f30 tx=0x7fef7c007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:33.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.342+0000 7fef8a7fc700 1 --2- 172.21.15.38:0/3775725248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef8c0b2eb0 0x7fef8c142890 secure :-1 s=THROTTLE_DONE pgs=692 cs=0 l=1 rx=0x7fef7c002f30 tx=0x7fef7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.342+0000 7fef7bfff700 1 -- 172.21.15.38:0/3775725248 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef7c013ea0 con 0x7fef8c0b2eb0 2020-06-12T17:50:33.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.342+0000 7fef8a7fc700 1 --2- 172.21.15.38:0/3775725248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef8c0b2eb0 0x7fef8c142890 secure :-1 s=THROTTLE_DONE pgs=692 cs=0 l=1 rx=0x7fef7c002f30 tx=0x7fef7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.361 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.342+0000 7fef7bfff700 1 -- 172.21.15.38:0/3775725248 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7c00c5c0 con 0x7fef8c0b2eb0 2020-06-12T17:50:33.361 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.342+0000 7fef8a7fc700 1 --2- 172.21.15.38:0/3775725248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef8c0b2eb0 0x7fef8c142890 secure :-1 s=THROTTLE_DONE pgs=692 cs=0 l=1 rx=0x7fef7c002f30 tx=0x7fef7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.361 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.342+0000 7fef9126b700 1 -- 172.21.15.38:0/3775725248 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef8c142cf0 con 0x7fef8c0b2eb0 2020-06-12T17:50:33.361 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.342+0000 7fef7bfff700 1 -- 172.21.15.38:0/3775725248 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef7c007530 con 0x7fef8c0b2eb0 2020-06-12T17:50:33.361 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.342+0000 7fef9126b700 1 -- 172.21.15.38:0/3775725248 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef8c1431c0 con 0x7fef8c0b2eb0 2020-06-12T17:50:33.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.342+0000 7fef8a7fc700 1 --2- 172.21.15.38:0/3775725248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef8c0b2eb0 0x7fef8c142890 secure :-1 s=THROTTLE_DONE pgs=692 cs=0 l=1 rx=0x7fef7c002f30 tx=0x7fef7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.343+0000 7fef9126b700 1 -- 172.21.15.38:0/3775725248 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef8c056c30 con 0x7fef8c0b2eb0 2020-06-12T17:50:33.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.343+0000 7fef7bfff700 1 -- 172.21.15.38:0/3775725248 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fef7c0056c0 con 0x7fef8c0b2eb0 2020-06-12T17:50:33.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.343+0000 7fef8a7fc700 1 --2- 172.21.15.38:0/3775725248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef8c0b2eb0 0x7fef8c142890 secure :-1 s=THROTTLE_DONE pgs=692 cs=0 l=1 rx=0x7fef7c002f30 tx=0x7fef7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.343+0000 7fef7bfff700 1 --2- 172.21.15.38:0/3775725248 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fef6804d4f0 0x7fef6804f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:33.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.343+0000 7fef7bfff700 1 -- 172.21.15.38:0/3775725248 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fef7c063b40 con 0x7fef8c0b2eb0 2020-06-12T17:50:33.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.343+0000 7fef8affd700 1 --2- 172.21.15.38:0/3775725248 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fef6804d4f0 0x7fef6804f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:33.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.343+0000 7fef8affd700 1 --2- 172.21.15.38:0/3775725248 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fef6804d4f0 0x7fef6804f9b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fef80002f30 tx=0x7fef8000e040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.344+0000 7fef8affd700 1 --2- 172.21.15.38:0/3775725248 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fef6804d4f0 0x7fef6804f9b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fef80002f30 tx=0x7fef8000e040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.344+0000 7fef8affd700 1 --2- 172.21.15.38:0/3775725248 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fef6804d4f0 0x7fef6804f9b0 secure :-1 s=READY pgs=271 cs=0 l=1 rx=0x7fef80002f30 tx=0x7fef8000e040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:33.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.346+0000 7fef8a7fc700 1 --2- 172.21.15.38:0/3775725248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef8c0b2eb0 0x7fef8c142890 secure :-1 s=THROTTLE_DONE pgs=692 cs=0 l=1 rx=0x7fef7c002f30 tx=0x7fef7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.346+0000 7fef7bfff700 1 -- 172.21.15.38:0/3775725248 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fef7c03f360 con 0x7fef8c0b2eb0 2020-06-12T17:50:33.546 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.543+0000 7fef9126b700 1 -- 172.21.15.38:0/3775725248 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_985", "target": ["mon-mgr", ""]}) v1 -- 0x7fef8c062e80 con 0x7fef6804d4f0 2020-06-12T17:50:33.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.546+0000 7fef8affd700 1 --2- 172.21.15.38:0/3775725248 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fef6804d4f0 0x7fef6804f9b0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7fef80002f30 tx=0x7fef8000e040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:33.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.546+0000 7fef7bfff700 1 -- 172.21.15.38:0/3775725248 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+69 (secure 0 0 0) 0x7fef80007300 con 0x7fef6804d4f0 2020-06-12T17:50:33.551 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_985/5f2eb4ef-e666-4dd5-9518-b3481f047488 2020-06-12T17:50:33.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.548+0000 7fef9126b700 1 -- 172.21.15.38:0/3775725248 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fef6804d4f0 msgr2=0x7fef6804f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:33.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.548+0000 7fef9126b700 1 --2- 172.21.15.38:0/3775725248 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fef6804d4f0 0x7fef6804f9b0 secure :-1 s=READY pgs=271 cs=0 l=1 rx=0x7fef80002f30 tx=0x7fef8000e040).stop 2020-06-12T17:50:33.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.548+0000 7fef9126b700 1 -- 172.21.15.38:0/3775725248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef8c0b2eb0 msgr2=0x7fef8c142890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:33.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.548+0000 7fef9126b700 1 --2- 172.21.15.38:0/3775725248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef8c0b2eb0 0x7fef8c142890 secure :-1 s=READY pgs=692 cs=0 l=1 rx=0x7fef7c002f30 tx=0x7fef7c007e60).stop 2020-06-12T17:50:33.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.548+0000 7fef9126b700 1 -- 172.21.15.38:0/3775725248 shutdown_connections 2020-06-12T17:50:33.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.548+0000 7fef9126b700 1 --2- 172.21.15.38:0/3775725248 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fef6804d4f0 0x7fef6804f9b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:33.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.548+0000 7fef9126b700 1 --2- 172.21.15.38:0/3775725248 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef8c09d620 0x7fef8c0616a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:33.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.548+0000 7fef9126b700 1 --2- 172.21.15.38:0/3775725248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef8c0b2eb0 0x7fef8c142890 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:33.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.548+0000 7fef9126b700 1 -- 172.21.15.38:0/3775725248 >> 172.21.15.38:0/3775725248 conn(0x7fef8c0b5a20 msgr2=0x7fef8c09c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:33.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.548+0000 7fef9126b700 1 -- 172.21.15.38:0/3775725248 shutdown_connections 2020-06-12T17:50:33.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:33.548+0000 7fef9126b700 1 -- 172.21.15.38:0/3775725248 wait complete. 2020-06-12T17:50:33.561 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_985 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_985/5f2eb4ef-e666-4dd5-9518-b3481f047488 2020-06-12T17:50:33.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:33.562 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:33.563 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:33.578 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:33.579 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:33.579 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_985/5f2eb4ef-e666-4dd5-9518-b3481f047488/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:33.667 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:33.668 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:33.668 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010456 s, 100 MB/s 2020-06-12T17:50:33.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:33.670 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:33.670 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:33.686 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:33.687 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:33.687 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_985/5f2eb4ef-e666-4dd5-9518-b3481f047488/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:33.772 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:33.773 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:33.773 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00968172 s, 108 MB/s 2020-06-12T17:50:33.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:33.776 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:33.776 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:33.794 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:33.795 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:33.796 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_985/5f2eb4ef-e666-4dd5-9518-b3481f047488/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:33.887 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:33.887 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:33.887 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127273 s, 82.4 MB/s 2020-06-12T17:50:33.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:33.889 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:33.889 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:33.904 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:33.905 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:33.905 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_985/5f2eb4ef-e666-4dd5-9518-b3481f047488/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:33.996 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:33.996 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:33.997 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126436 s, 82.9 MB/s 2020-06-12T17:50:33.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:33.998 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:33.999 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:34.013 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:34.014 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:34.014 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_985/5f2eb4ef-e666-4dd5-9518-b3481f047488/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:34.105 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:34.105 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:34.106 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111454 s, 94.1 MB/s 2020-06-12T17:50:34.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:34.107 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:34.107 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:34.121 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:34.123 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:34.124 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_985/5f2eb4ef-e666-4dd5-9518-b3481f047488/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:34.210 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:34.211 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:34.211 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105522 s, 99.4 MB/s 2020-06-12T17:50:34.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:34.213 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:34.213 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:34.228 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:34.229 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:34.229 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_985/5f2eb4ef-e666-4dd5-9518-b3481f047488/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:34.317 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:34.318 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:34.318 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114637 s, 91.5 MB/s 2020-06-12T17:50:34.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:34.320 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:34.321 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:34.336 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:34.336 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:34.337 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_985/5f2eb4ef-e666-4dd5-9518-b3481f047488/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:34.424 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:34.425 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:34.425 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105571 s, 99.3 MB/s 2020-06-12T17:50:34.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:34.427 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:34.428 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:34.442 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:34.444 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:34.445 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_985/5f2eb4ef-e666-4dd5-9518-b3481f047488/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:34.534 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:34.534 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:34.534 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115529 s, 90.8 MB/s 2020-06-12T17:50:34.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:34.536 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:34.537 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:34.558 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:34.559 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:34.559 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_985/5f2eb4ef-e666-4dd5-9518-b3481f047488/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:34.646 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:34.647 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:34.648 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957602 s, 110 MB/s 2020-06-12T17:50:34.649 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_1674 2020-06-12T17:50:34.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.763+0000 7fcb2bdad700 1 Processor -- start 2020-06-12T17:50:34.816 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.763+0000 7fcb2bdad700 1 -- start start 2020-06-12T17:50:34.817 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.764+0000 7fcb2bdad700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb24065420 0x7fcb2405b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:34.817 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.764+0000 7fcb2bdad700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcb24146090 0x7fcb24146510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:34.817 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.764+0000 7fcb2bdad700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb2405c8e0 con 0x7fcb240b7070 2020-06-12T17:50:34.818 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.764+0000 7fcb2bdad700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb24149700 con 0x7fcb24146090 2020-06-12T17:50:34.818 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.764+0000 7fcb2bdad700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2405cb80 con 0x7fcb24065420 2020-06-12T17:50:34.818 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.764+0000 7fcb29348700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcb24146090 0x7fcb24146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:34.818 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.764+0000 7fcb29348700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcb24146090 0x7fcb24146510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38876/0 (socket says 172.21.15.38:38876) 2020-06-12T17:50:34.818 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.764+0000 7fcb29348700 1 -- 172.21.15.38:0/221088626 learned_addr learned my addr 172.21.15.38:0/221088626 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:34.819 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.764+0000 7fcb29b49700 1 --2- 172.21.15.38:0/221088626 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb24065420 0x7fcb2405b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:34.819 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.764+0000 7fcb29348700 1 -- 172.21.15.38:0/221088626 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb24065420 msgr2=0x7fcb2405b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:34.819 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.764+0000 7fcb29348700 1 --2- 172.21.15.38:0/221088626 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb24065420 0x7fcb2405b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:34.819 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.764+0000 7fcb29348700 1 -- 172.21.15.38:0/221088626 >> v1:172.21.15.150:6789/0 conn(0x7fcb240b7070 legacy=0x7fcb24149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:34.819 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.764+0000 7fcb29348700 1 -- 172.21.15.38:0/221088626 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2405c560 con 0x7fcb24146090 2020-06-12T17:50:34.820 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.764+0000 7fcb29b49700 1 --2- 172.21.15.38:0/221088626 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb24065420 0x7fcb2405b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:50:34.820 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.764+0000 7fcb29348700 1 --2- 172.21.15.38:0/221088626 >> v2:172.21.15.38:3300/0 conn(0x7fcb24146090 0x7fcb24146510 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcb240b4de0 tx=0x7fcb14007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:34.820 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.764+0000 7fcb29348700 1 --2- 172.21.15.38:0/221088626 >> v2:172.21.15.38:3300/0 conn(0x7fcb24146090 0x7fcb24146510 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcb240b4de0 tx=0x7fcb14007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:34.820 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.764+0000 7fcb29348700 1 --2- 172.21.15.38:0/221088626 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb24146090 0x7fcb24146510 secure :-1 s=READY pgs=693 cs=0 l=1 rx=0x7fcb240b4de0 tx=0x7fcb14007e60).ready entity=mon.0 client_cookie=cd0ceaf6e1fbb338 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:34.820 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.764+0000 7fcb29348700 1 --2- 172.21.15.38:0/221088626 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb24146090 0x7fcb24146510 secure :-1 s=THROTTLE_DONE pgs=693 cs=0 l=1 rx=0x7fcb240b4de0 tx=0x7fcb14007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:34.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.764+0000 7fcb28b47700 1 -- 172.21.15.38:0/221088626 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb140116a0 con 0x7fcb24146090 2020-06-12T17:50:34.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.764+0000 7fcb29348700 1 --2- 172.21.15.38:0/221088626 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb24146090 0x7fcb24146510 secure :-1 s=THROTTLE_DONE pgs=693 cs=0 l=1 rx=0x7fcb240b4de0 tx=0x7fcb14007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:34.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.764+0000 7fcb29348700 1 --2- 172.21.15.38:0/221088626 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb24146090 0x7fcb24146510 secure :-1 s=THROTTLE_DONE pgs=693 cs=0 l=1 rx=0x7fcb240b4de0 tx=0x7fcb14007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:34.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.764+0000 7fcb28b47700 1 -- 172.21.15.38:0/221088626 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb14011800 con 0x7fcb24146090 2020-06-12T17:50:34.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.764+0000 7fcb28b47700 1 -- 172.21.15.38:0/221088626 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb14011c20 con 0x7fcb24146090 2020-06-12T17:50:34.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.764+0000 7fcb2bdad700 1 -- 172.21.15.38:0/221088626 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb24146090 msgr2=0x7fcb24146510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:34.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.764+0000 7fcb2bdad700 1 --2- 172.21.15.38:0/221088626 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb24146090 0x7fcb24146510 secure :-1 s=READY pgs=693 cs=0 l=1 rx=0x7fcb240b4de0 tx=0x7fcb14007e60).stop 2020-06-12T17:50:34.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.765+0000 7fcb2bdad700 1 -- 172.21.15.38:0/221088626 shutdown_connections 2020-06-12T17:50:34.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.765+0000 7fcb2bdad700 1 --2- 172.21.15.38:0/221088626 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb24065420 0x7fcb2405b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:34.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.765+0000 7fcb2bdad700 1 --2- 172.21.15.38:0/221088626 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb24146090 0x7fcb24146510 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:34.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.765+0000 7fcb2bdad700 1 -- 172.21.15.38:0/221088626 >> 172.21.15.38:0/221088626 conn(0x7fcb240ba610 msgr2=0x7fcb240baa20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:34.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.765+0000 7fcb2bdad700 1 -- 172.21.15.38:0/221088626 shutdown_connections 2020-06-12T17:50:34.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.765+0000 7fcb2bdad700 1 -- 172.21.15.38:0/221088626 wait complete. 2020-06-12T17:50:34.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.766+0000 7fcb2bdad700 1 Processor -- start 2020-06-12T17:50:34.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.766+0000 7fcb2bdad700 1 -- start start 2020-06-12T17:50:34.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.767+0000 7fcb2bdad700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb24065420 0x7fcb24149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:34.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.767+0000 7fcb2bdad700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcb24146090 0x7fcb2413f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:34.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.767+0000 7fcb2bdad700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb24060350 con 0x7fcb240b7070 2020-06-12T17:50:34.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.767+0000 7fcb2bdad700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb2414a300 con 0x7fcb24146090 2020-06-12T17:50:34.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.767+0000 7fcb2bdad700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb24060580 con 0x7fcb24065420 2020-06-12T17:50:34.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.767+0000 7fcb2a34a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcb24146090 0x7fcb2413f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:34.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.767+0000 7fcb2a34a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcb24146090 0x7fcb2413f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38884/0 (socket says 172.21.15.38:38884) 2020-06-12T17:50:34.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.767+0000 7fcb2a34a700 1 -- 172.21.15.38:0/1560752204 learned_addr learned my addr 172.21.15.38:0/1560752204 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:34.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.767+0000 7fcb29b49700 1 --2- 172.21.15.38:0/1560752204 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb24065420 0x7fcb24149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:34.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.767+0000 7fcb2a34a700 1 -- 172.21.15.38:0/1560752204 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb24065420 msgr2=0x7fcb24149ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:34.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.767+0000 7fcb2a34a700 1 --2- 172.21.15.38:0/1560752204 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb24065420 0x7fcb24149ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.767+0000 7fcb2a34a700 1 -- 172.21.15.38:0/1560752204 >> v1:172.21.15.150:6789/0 conn(0x7fcb240b7070 legacy=0x7fcb2409fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.767+0000 7fcb2a34a700 1 -- 172.21.15.38:0/1560752204 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb24060820 con 0x7fcb24146090 2020-06-12T17:50:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.767+0000 7fcb2a34a700 1 --2- 172.21.15.38:0/1560752204 >> v2:172.21.15.38:3300/0 conn(0x7fcb24146090 0x7fcb2413f450 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcb1c002360 tx=0x7fcb1c002b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.767+0000 7fcb2a34a700 1 --2- 172.21.15.38:0/1560752204 >> v2:172.21.15.38:3300/0 conn(0x7fcb24146090 0x7fcb2413f450 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcb1c002360 tx=0x7fcb1c002b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:34.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.767+0000 7fcb2a34a700 1 --2- 172.21.15.38:0/1560752204 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb24146090 0x7fcb2413f450 secure :-1 s=READY pgs=694 cs=0 l=1 rx=0x7fcb1c002360 tx=0x7fcb1c002b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:34.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.767+0000 7fcb2a34a700 1 --2- 172.21.15.38:0/1560752204 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb24146090 0x7fcb2413f450 secure :-1 s=THROTTLE_DONE pgs=694 cs=0 l=1 rx=0x7fcb1c002360 tx=0x7fcb1c002b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:34.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.767+0000 7fcb12ffd700 1 -- 172.21.15.38:0/1560752204 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb1c00cea0 con 0x7fcb24146090 2020-06-12T17:50:34.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.767+0000 7fcb2a34a700 1 --2- 172.21.15.38:0/1560752204 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb24146090 0x7fcb2413f450 secure :-1 s=THROTTLE_DONE pgs=694 cs=0 l=1 rx=0x7fcb1c002360 tx=0x7fcb1c002b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:34.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.767+0000 7fcb2a34a700 1 --2- 172.21.15.38:0/1560752204 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb24146090 0x7fcb2413f450 secure :-1 s=THROTTLE_DONE pgs=694 cs=0 l=1 rx=0x7fcb1c002360 tx=0x7fcb1c002b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:34.829 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.767+0000 7fcb12ffd700 1 -- 172.21.15.38:0/1560752204 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1c012490 con 0x7fcb24146090 2020-06-12T17:50:34.829 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.767+0000 7fcb12ffd700 1 -- 172.21.15.38:0/1560752204 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb1c012830 con 0x7fcb24146090 2020-06-12T17:50:34.829 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.767+0000 7fcb2bdad700 1 -- 172.21.15.38:0/1560752204 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb24060b20 con 0x7fcb24146090 2020-06-12T17:50:34.829 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.767+0000 7fcb2bdad700 1 -- 172.21.15.38:0/1560752204 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb2413fa70 con 0x7fcb24146090 2020-06-12T17:50:34.829 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.768+0000 7fcb2a34a700 1 --2- 172.21.15.38:0/1560752204 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb24146090 0x7fcb2413f450 secure :-1 s=THROTTLE_DONE pgs=694 cs=0 l=1 rx=0x7fcb1c002360 tx=0x7fcb1c002b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:34.830 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.768+0000 7fcb2bdad700 1 -- 172.21.15.38:0/1560752204 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb24056c30 con 0x7fcb24146090 2020-06-12T17:50:34.830 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.768+0000 7fcb12ffd700 1 -- 172.21.15.38:0/1560752204 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fcb1c012aa0 con 0x7fcb24146090 2020-06-12T17:50:34.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.768+0000 7fcb2a34a700 1 --2- 172.21.15.38:0/1560752204 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb24146090 0x7fcb2413f450 secure :-1 s=THROTTLE_DONE pgs=694 cs=0 l=1 rx=0x7fcb1c002360 tx=0x7fcb1c002b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:34.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.769+0000 7fcb12ffd700 1 --2- 172.21.15.38:0/1560752204 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcb0404d5e0 0x7fcb0404faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:34.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.769+0000 7fcb12ffd700 1 -- 172.21.15.38:0/1560752204 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcb1c0610b0 con 0x7fcb24146090 2020-06-12T17:50:34.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.769+0000 7fcb29b49700 1 --2- 172.21.15.38:0/1560752204 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcb0404d5e0 0x7fcb0404faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:34.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.769+0000 7fcb29b49700 1 --2- 172.21.15.38:0/1560752204 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcb0404d5e0 0x7fcb0404faa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcb20002f30 tx=0x7fcb2000df50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:34.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.769+0000 7fcb29b49700 1 --2- 172.21.15.38:0/1560752204 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcb0404d5e0 0x7fcb0404faa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcb20002f30 tx=0x7fcb2000df50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:34.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.769+0000 7fcb29b49700 1 --2- 172.21.15.38:0/1560752204 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcb0404d5e0 0x7fcb0404faa0 secure :-1 s=READY pgs=272 cs=0 l=1 rx=0x7fcb20002f30 tx=0x7fcb2000df50).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:34.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.772+0000 7fcb2a34a700 1 --2- 172.21.15.38:0/1560752204 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb24146090 0x7fcb2413f450 secure :-1 s=THROTTLE_DONE pgs=694 cs=0 l=1 rx=0x7fcb1c002360 tx=0x7fcb1c002b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:34.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.772+0000 7fcb12ffd700 1 -- 172.21.15.38:0/1560752204 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fcb1c03c830 con 0x7fcb24146090 2020-06-12T17:50:34.970 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.965+0000 7fcb2bdad700 1 -- 172.21.15.38:0/1560752204 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_1674", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb241439e0 con 0x7fcb0404d5e0 2020-06-12T17:50:34.987 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.984+0000 7fcb29b49700 1 --2- 172.21.15.38:0/1560752204 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcb0404d5e0 0x7fcb0404faa0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7fcb20002f30 tx=0x7fcb2000df50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:34.988 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.984+0000 7fcb12ffd700 1 -- 172.21.15.38:0/1560752204 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcb241439e0 con 0x7fcb0404d5e0 2020-06-12T17:50:34.989 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.985+0000 7fcb2bdad700 1 -- 172.21.15.38:0/1560752204 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcb0404d5e0 msgr2=0x7fcb0404faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:34.989 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.985+0000 7fcb2bdad700 1 --2- 172.21.15.38:0/1560752204 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcb0404d5e0 0x7fcb0404faa0 secure :-1 s=READY pgs=272 cs=0 l=1 rx=0x7fcb20002f30 tx=0x7fcb2000df50).stop 2020-06-12T17:50:34.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.985+0000 7fcb2bdad700 1 -- 172.21.15.38:0/1560752204 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb24146090 msgr2=0x7fcb2413f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:34.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.985+0000 7fcb2bdad700 1 --2- 172.21.15.38:0/1560752204 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb24146090 0x7fcb2413f450 secure :-1 s=READY pgs=694 cs=0 l=1 rx=0x7fcb1c002360 tx=0x7fcb1c002b60).stop 2020-06-12T17:50:34.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.986+0000 7fcb2bdad700 1 -- 172.21.15.38:0/1560752204 shutdown_connections 2020-06-12T17:50:34.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.986+0000 7fcb2bdad700 1 --2- 172.21.15.38:0/1560752204 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fcb0404d5e0 0x7fcb0404faa0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:34.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.986+0000 7fcb2bdad700 1 --2- 172.21.15.38:0/1560752204 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb24065420 0x7fcb24149ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:34.991 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.986+0000 7fcb2bdad700 1 --2- 172.21.15.38:0/1560752204 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb24146090 0x7fcb2413f450 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:34.991 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.986+0000 7fcb2bdad700 1 -- 172.21.15.38:0/1560752204 >> 172.21.15.38:0/1560752204 conn(0x7fcb240ba610 msgr2=0x7fcb240b8510 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:34.991 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.986+0000 7fcb2bdad700 1 -- 172.21.15.38:0/1560752204 shutdown_connections 2020-06-12T17:50:34.991 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:34.986+0000 7fcb2bdad700 1 -- 172.21.15.38:0/1560752204 wait complete. 2020-06-12T17:50:34.999 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_1674 2020-06-12T17:50:35.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.113+0000 7f4fbe474700 1 Processor -- start 2020-06-12T17:50:35.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.113+0000 7f4fbe474700 1 -- start start 2020-06-12T17:50:35.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.114+0000 7f4fbe474700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4fb8146680 0x7f4fb80ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:35.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.114+0000 7f4fbe474700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4fb809d8d0 0x7f4fb81421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:35.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.114+0000 7f4fbe474700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb8146d20 con 0x7f4fb80b2eb0 2020-06-12T17:50:35.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.114+0000 7f4fbe474700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb8066a80 con 0x7f4fb8146680 2020-06-12T17:50:35.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.114+0000 7f4fbe474700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb8146f50 con 0x7f4fb809d8d0 2020-06-12T17:50:35.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.114+0000 7f4fb7fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4fb8146680 0x7f4fb80ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:35.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.114+0000 7f4fb7fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4fb8146680 0x7f4fb80ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38888/0 (socket says 172.21.15.38:38888) 2020-06-12T17:50:35.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.114+0000 7f4fb7fff700 1 -- 172.21.15.38:0/1083010702 learned_addr learned my addr 172.21.15.38:0/1083010702 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:35.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.114+0000 7f4fb77fe700 1 --1- 172.21.15.38:0/1083010702 >> v1:172.21.15.38:6789/0 conn(0x7f4fb80b2eb0 0x7f4fb809d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40706/0 (socket says 172.21.15.38:40706) 2020-06-12T17:50:35.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.114+0000 7f4fb7fff700 1 -- 172.21.15.38:0/1083010702 >> v2:172.21.15.150:3300/0 conn(0x7f4fb809d8d0 msgr2=0x7f4fb81421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:35.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.114+0000 7f4fbca11700 1 --2- 172.21.15.38:0/1083010702 >> v2:172.21.15.150:3300/0 conn(0x7f4fb809d8d0 0x7f4fb81421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:35.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.114+0000 7f4fb6ffd700 1 -- 172.21.15.38:0/1083010702 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532815778 0 0) 0x7f4fb8146d20 con 0x7f4fb80b2eb0 2020-06-12T17:50:35.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.114+0000 7f4fb7fff700 1 --2- 172.21.15.38:0/1083010702 >> v2:172.21.15.150:3300/0 conn(0x7f4fb809d8d0 0x7f4fb81421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:35.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.114+0000 7f4fb7fff700 1 -- 172.21.15.38:0/1083010702 >> v1:172.21.15.38:6789/0 conn(0x7f4fb80b2eb0 legacy=0x7f4fb809d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:35.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.114+0000 7f4fb7fff700 1 -- 172.21.15.38:0/1083010702 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb8146a60 con 0x7f4fb8146680 2020-06-12T17:50:35.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.115+0000 7f4fb7fff700 1 --2- 172.21.15.38:0/1083010702 >> v2:172.21.15.38:3300/0 conn(0x7f4fb8146680 0x7f4fb80ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4fa8002f30 tx=0x7f4fa8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:35.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.115+0000 7f4fb7fff700 1 --2- 172.21.15.38:0/1083010702 >> v2:172.21.15.38:3300/0 conn(0x7f4fb8146680 0x7f4fb80ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4fa8002f30 tx=0x7f4fa8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:35.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.115+0000 7f4fb7fff700 1 --2- 172.21.15.38:0/1083010702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb8146680 0x7f4fb80ad5b0 secure :-1 s=READY pgs=696 cs=0 l=1 rx=0x7f4fa8002f30 tx=0x7f4fa8007e60).ready entity=mon.0 client_cookie=9e3ee26eec0eaef3 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:35.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.115+0000 7f4fb7fff700 1 --2- 172.21.15.38:0/1083010702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb8146680 0x7f4fb80ad5b0 secure :-1 s=THROTTLE_DONE pgs=696 cs=0 l=1 rx=0x7f4fa8002f30 tx=0x7f4fa8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:35.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.115+0000 7f4fb6ffd700 1 -- 172.21.15.38:0/1083010702 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fa80116e0 con 0x7f4fb8146680 2020-06-12T17:50:35.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.115+0000 7f4fb7fff700 1 --2- 172.21.15.38:0/1083010702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb8146680 0x7f4fb80ad5b0 secure :-1 s=THROTTLE_DONE pgs=696 cs=0 l=1 rx=0x7f4fa8002f30 tx=0x7f4fa8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:35.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.115+0000 7f4fb7fff700 1 --2- 172.21.15.38:0/1083010702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb8146680 0x7f4fb80ad5b0 secure :-1 s=THROTTLE_DONE pgs=696 cs=0 l=1 rx=0x7f4fa8002f30 tx=0x7f4fa8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:35.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.115+0000 7f4fb6ffd700 1 -- 172.21.15.38:0/1083010702 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa8011840 con 0x7f4fb8146680 2020-06-12T17:50:35.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.115+0000 7f4fb6ffd700 1 -- 172.21.15.38:0/1083010702 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fa8011be0 con 0x7f4fb8146680 2020-06-12T17:50:35.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.115+0000 7f4fbe474700 1 -- 172.21.15.38:0/1083010702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb8146680 msgr2=0x7f4fb80ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:35.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.115+0000 7f4fbe474700 1 --2- 172.21.15.38:0/1083010702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb8146680 0x7f4fb80ad5b0 secure :-1 s=READY pgs=696 cs=0 l=1 rx=0x7f4fa8002f30 tx=0x7f4fa8007e60).stop 2020-06-12T17:50:35.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.115+0000 7f4fbe474700 1 -- 172.21.15.38:0/1083010702 shutdown_connections 2020-06-12T17:50:35.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.115+0000 7f4fbe474700 1 --2- 172.21.15.38:0/1083010702 >> v2:172.21.15.150:3300/0 conn(0x7f4fb809d8d0 0x7f4fb81421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:35.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.115+0000 7f4fbe474700 1 --2- 172.21.15.38:0/1083010702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb8146680 0x7f4fb80ad5b0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:35.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.115+0000 7f4fbe474700 1 -- 172.21.15.38:0/1083010702 >> 172.21.15.38:0/1083010702 conn(0x7f4fb80b5a20 msgr2=0x7f4fb805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:35.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.115+0000 7f4fbe474700 1 -- 172.21.15.38:0/1083010702 shutdown_connections 2020-06-12T17:50:35.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.115+0000 7f4fbe474700 1 -- 172.21.15.38:0/1083010702 wait complete. 2020-06-12T17:50:35.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.116+0000 7f4fbe474700 1 Processor -- start 2020-06-12T17:50:35.130 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.116+0000 7f4fbe474700 1 -- start start 2020-06-12T17:50:35.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.117+0000 7f4fbe474700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4fb809d8d0 0x7f4fb8142890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:35.135 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.117+0000 7f4fbe474700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4fb8146680 0x7f4fb8066170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:35.135 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.117+0000 7f4fbe474700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb80665d0 con 0x7f4fb80b2eb0 2020-06-12T17:50:35.135 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.117+0000 7f4fbe474700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb8142da0 con 0x7f4fb809d8d0 2020-06-12T17:50:35.135 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.117+0000 7f4fbe474700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb8143040 con 0x7f4fb8146680 2020-06-12T17:50:35.135 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.117+0000 7f4fb7fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4fb809d8d0 0x7f4fb8142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:35.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.117+0000 7f4fb7fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4fb809d8d0 0x7f4fb8142890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38894/0 (socket says 172.21.15.38:38894) 2020-06-12T17:50:35.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.117+0000 7f4fb77fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4fb80b2eb0 0x7f4fb8153fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40714/0 (socket says 172.21.15.38:40714) 2020-06-12T17:50:35.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.117+0000 7f4fb7fff700 1 -- 172.21.15.38:0/3966197446 learned_addr learned my addr 172.21.15.38:0/3966197446 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:35.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.117+0000 7f4fbca11700 1 --2- 172.21.15.38:0/3966197446 >> v2:172.21.15.150:3300/0 conn(0x7f4fb8146680 0x7f4fb8066170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:35.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.118+0000 7f4fb7fff700 1 -- 172.21.15.38:0/3966197446 >> v2:172.21.15.150:3300/0 conn(0x7f4fb8146680 msgr2=0x7f4fb8066170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:35.144 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.118+0000 7f4fb7fff700 1 --2- 172.21.15.38:0/3966197446 >> v2:172.21.15.150:3300/0 conn(0x7f4fb8146680 0x7f4fb8066170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:35.144 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.118+0000 7f4fb7fff700 1 -- 172.21.15.38:0/3966197446 >> v1:172.21.15.38:6789/0 conn(0x7f4fb80b2eb0 legacy=0x7f4fb8153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:35.144 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.118+0000 7f4fb7fff700 1 -- 172.21.15.38:0/3966197446 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb8150150 con 0x7f4fb809d8d0 2020-06-12T17:50:35.144 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.118+0000 7f4fbca11700 1 --2- 172.21.15.38:0/3966197446 >> v2:172.21.15.150:3300/0 conn(0x7f4fb8146680 0x7f4fb8066170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:50:35.144 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.118+0000 7f4fb57fa700 1 -- 172.21.15.38:0/3966197446 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279432967 0 0) 0x7f4fac001030 con 0x7f4fb80b2eb0 2020-06-12T17:50:35.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.118+0000 7f4fb7fff700 1 --2- 172.21.15.38:0/3966197446 >> v2:172.21.15.38:3300/0 conn(0x7f4fb809d8d0 0x7f4fb8142890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4fb8143ad0 tx=0x7f4fa8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:35.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.118+0000 7f4fb7fff700 1 --2- 172.21.15.38:0/3966197446 >> v2:172.21.15.38:3300/0 conn(0x7f4fb809d8d0 0x7f4fb8142890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4fb8143ad0 tx=0x7f4fa8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:35.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.118+0000 7f4fb7fff700 1 --2- 172.21.15.38:0/3966197446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb809d8d0 0x7f4fb8142890 secure :-1 s=READY pgs=698 cs=0 l=1 rx=0x7f4fb8143ad0 tx=0x7f4fa8007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:35.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.118+0000 7f4fb7fff700 1 --2- 172.21.15.38:0/3966197446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb809d8d0 0x7f4fb8142890 secure :-1 s=THROTTLE_DONE pgs=698 cs=0 l=1 rx=0x7f4fb8143ad0 tx=0x7f4fa8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:35.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.118+0000 7f4fb7fff700 1 --2- 172.21.15.38:0/3966197446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb809d8d0 0x7f4fb8142890 secure :-1 s=THROTTLE_DONE pgs=698 cs=0 l=1 rx=0x7f4fb8143ad0 tx=0x7f4fa8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:35.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.118+0000 7f4fb7fff700 1 --2- 172.21.15.38:0/3966197446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb809d8d0 0x7f4fb8142890 secure :-1 s=THROTTLE_DONE pgs=698 cs=0 l=1 rx=0x7f4fb8143ad0 tx=0x7f4fa8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:35.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.118+0000 7f4fb57fa700 1 -- 172.21.15.38:0/3966197446 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fa8007340 con 0x7f4fb809d8d0 2020-06-12T17:50:35.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.118+0000 7f4fb57fa700 1 -- 172.21.15.38:0/3966197446 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa80074a0 con 0x7f4fb809d8d0 2020-06-12T17:50:35.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.118+0000 7f4fb57fa700 1 -- 172.21.15.38:0/3966197446 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fa80058b0 con 0x7f4fb809d8d0 2020-06-12T17:50:35.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.118+0000 7f4fbe474700 1 -- 172.21.15.38:0/3966197446 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb80af660 con 0x7f4fb809d8d0 2020-06-12T17:50:35.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.118+0000 7f4fbe474700 1 -- 172.21.15.38:0/3966197446 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb80afb50 con 0x7f4fb809d8d0 2020-06-12T17:50:35.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.119+0000 7f4fb7fff700 1 --2- 172.21.15.38:0/3966197446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb809d8d0 0x7f4fb8142890 secure :-1 s=THROTTLE_DONE pgs=698 cs=0 l=1 rx=0x7f4fb8143ad0 tx=0x7f4fa8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:35.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.119+0000 7f4fbe474700 1 -- 172.21.15.38:0/3966197446 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb814ffb0 con 0x7f4fb809d8d0 2020-06-12T17:50:35.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.119+0000 7f4fb57fa700 1 -- 172.21.15.38:0/3966197446 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f4fa8005a10 con 0x7f4fb809d8d0 2020-06-12T17:50:35.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.119+0000 7f4fb7fff700 1 --2- 172.21.15.38:0/3966197446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb809d8d0 0x7f4fb8142890 secure :-1 s=THROTTLE_DONE pgs=698 cs=0 l=1 rx=0x7f4fb8143ad0 tx=0x7f4fa8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:35.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.119+0000 7f4fb57fa700 1 --2- 172.21.15.38:0/3966197446 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4f9804d2b0 0x7f4f9804f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:35.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.119+0000 7f4fb57fa700 1 -- 172.21.15.38:0/3966197446 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f4fa80616f0 con 0x7f4fb809d8d0 2020-06-12T17:50:35.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.120+0000 7f4fb77fe700 1 --2- 172.21.15.38:0/3966197446 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4f9804d2b0 0x7f4f9804f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:35.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.120+0000 7f4fb77fe700 1 --2- 172.21.15.38:0/3966197446 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4f9804d2b0 0x7f4f9804f770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4fac0013b0 tx=0x7f4fac0017e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:35.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.120+0000 7f4fb77fe700 1 --2- 172.21.15.38:0/3966197446 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4f9804d2b0 0x7f4f9804f770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4fac0013b0 tx=0x7f4fac0017e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:35.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.120+0000 7f4fb77fe700 1 --2- 172.21.15.38:0/3966197446 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4f9804d2b0 0x7f4f9804f770 secure :-1 s=READY pgs=273 cs=0 l=1 rx=0x7f4fac0013b0 tx=0x7f4fac0017e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:35.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.123+0000 7f4fb7fff700 1 --2- 172.21.15.38:0/3966197446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb809d8d0 0x7f4fb8142890 secure :-1 s=THROTTLE_DONE pgs=698 cs=0 l=1 rx=0x7f4fb8143ad0 tx=0x7f4fa8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:35.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.123+0000 7f4fb57fa700 1 -- 172.21.15.38:0/3966197446 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f4fb814ffb0 con 0x7f4fb809d8d0 2020-06-12T17:50:35.327 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.324+0000 7f4fbe474700 1 -- 172.21.15.38:0/3966197446 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_1674", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fb814ffb0 con 0x7f4f9804d2b0 2020-06-12T17:50:35.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.328+0000 7f4fb77fe700 1 --2- 172.21.15.38:0/3966197446 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4f9804d2b0 0x7f4f9804f770 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f4fac0013b0 tx=0x7f4fac0017e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:35.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.328+0000 7f4fb57fa700 1 -- 172.21.15.38:0/3966197446 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f4fb814ffb0 con 0x7f4f9804d2b0 2020-06-12T17:50:35.331 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_1674/aa5bb1bb-2830-4f03-bd3d-51e673044f9d 2020-06-12T17:50:35.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.329+0000 7f4fbe474700 1 -- 172.21.15.38:0/3966197446 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4f9804d2b0 msgr2=0x7f4f9804f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:35.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.329+0000 7f4fbe474700 1 --2- 172.21.15.38:0/3966197446 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4f9804d2b0 0x7f4f9804f770 secure :-1 s=READY pgs=273 cs=0 l=1 rx=0x7f4fac0013b0 tx=0x7f4fac0017e0).stop 2020-06-12T17:50:35.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.329+0000 7f4fbe474700 1 -- 172.21.15.38:0/3966197446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb809d8d0 msgr2=0x7f4fb8142890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:35.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.329+0000 7f4fbe474700 1 --2- 172.21.15.38:0/3966197446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb809d8d0 0x7f4fb8142890 secure :-1 s=READY pgs=698 cs=0 l=1 rx=0x7f4fb8143ad0 tx=0x7f4fa8007e60).stop 2020-06-12T17:50:35.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.329+0000 7f4fbe474700 1 -- 172.21.15.38:0/3966197446 shutdown_connections 2020-06-12T17:50:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.329+0000 7f4fbe474700 1 --2- 172.21.15.38:0/3966197446 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4f9804d2b0 0x7f4f9804f770 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.329+0000 7f4fbe474700 1 --2- 172.21.15.38:0/3966197446 >> v2:172.21.15.150:3300/0 conn(0x7f4fb8146680 0x7f4fb8066170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.329+0000 7f4fbe474700 1 --2- 172.21.15.38:0/3966197446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fb809d8d0 0x7f4fb8142890 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.329+0000 7f4fbe474700 1 -- 172.21.15.38:0/3966197446 >> 172.21.15.38:0/3966197446 conn(0x7f4fb80b5a20 msgr2=0x7f4fb80b7680 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.329+0000 7f4fbe474700 1 -- 172.21.15.38:0/3966197446 shutdown_connections 2020-06-12T17:50:35.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:35.329+0000 7f4fbe474700 1 -- 172.21.15.38:0/3966197446 wait complete. 2020-06-12T17:50:35.342 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_1674 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_1674/aa5bb1bb-2830-4f03-bd3d-51e673044f9d 2020-06-12T17:50:35.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:35.343 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:35.344 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:35.361 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:35.362 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:35.362 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1674/aa5bb1bb-2830-4f03-bd3d-51e673044f9d/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:35.452 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:35.453 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:35.453 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010978 s, 95.5 MB/s 2020-06-12T17:50:35.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:35.455 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:35.455 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:35.472 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:35.472 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:35.473 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1674/aa5bb1bb-2830-4f03-bd3d-51e673044f9d/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:35.558 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:35.559 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:35.559 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113835 s, 92.1 MB/s 2020-06-12T17:50:35.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:35.560 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:35.561 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:35.615 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:35.616 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:35.616 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1674/aa5bb1bb-2830-4f03-bd3d-51e673044f9d/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:35.706 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:35.706 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:35.706 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138431 s, 75.7 MB/s 2020-06-12T17:50:35.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:35.708 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:35.708 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:35.723 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:35.723 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:35.724 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1674/aa5bb1bb-2830-4f03-bd3d-51e673044f9d/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:35.811 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:35.811 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:35.812 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011165 s, 93.9 MB/s 2020-06-12T17:50:35.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:35.813 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:35.814 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:35.829 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:35.830 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:35.830 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1674/aa5bb1bb-2830-4f03-bd3d-51e673044f9d/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:35.919 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:35.920 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:35.920 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133538 s, 78.5 MB/s 2020-06-12T17:50:35.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:35.921 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:35.922 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:35.937 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:35.938 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:35.939 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1674/aa5bb1bb-2830-4f03-bd3d-51e673044f9d/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:36.026 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:36.027 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:36.027 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104611 s, 100 MB/s 2020-06-12T17:50:36.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:36.029 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:36.029 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:36.044 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:36.045 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:36.045 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1674/aa5bb1bb-2830-4f03-bd3d-51e673044f9d/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:36.131 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:36.132 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:36.132 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010783 s, 97.2 MB/s 2020-06-12T17:50:36.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:36.134 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:36.134 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:36.149 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:36.150 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:36.151 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1674/aa5bb1bb-2830-4f03-bd3d-51e673044f9d/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:36.239 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:36.239 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:36.239 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101246 s, 104 MB/s 2020-06-12T17:50:36.240 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:36.241 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:36.241 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:36.256 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:36.256 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:36.257 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1674/aa5bb1bb-2830-4f03-bd3d-51e673044f9d/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:36.342 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:36.343 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:36.343 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936633 s, 112 MB/s 2020-06-12T17:50:36.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:36.345 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:36.345 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:36.360 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:36.360 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:36.361 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1674/aa5bb1bb-2830-4f03-bd3d-51e673044f9d/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:36.449 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:36.449 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:36.450 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117767 s, 89.0 MB/s 2020-06-12T17:50:36.451 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_1550 2020-06-12T17:50:36.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.565+0000 7fba1d085700 1 Processor -- start 2020-06-12T17:50:36.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.565+0000 7fba1d085700 1 -- start start 2020-06-12T17:50:36.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.566+0000 7fba1d085700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fba1805b5e0 0x7fba180b9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:36.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.566+0000 7fba1d085700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fba1805b9c0 0x7fba180b73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:36.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.566+0000 7fba1d085700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba180b7cf0 0x7fba180b8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:36.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.566+0000 7fba1d085700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1814a100 con 0x7fba1805b5e0 2020-06-12T17:50:36.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.566+0000 7fba1d085700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1814a3a0 con 0x7fba1805b9c0 2020-06-12T17:50:36.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.566+0000 7fba1d085700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1809db70 con 0x7fba180b7cf0 2020-06-12T17:50:36.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.566+0000 7fba16d9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fba1805b5e0 0x7fba180b9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:36.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.566+0000 7fba16d9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fba1805b5e0 0x7fba180b9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38902/0 (socket says 172.21.15.38:38902) 2020-06-12T17:50:36.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.566+0000 7fba16d9d700 1 -- 172.21.15.38:0/3245089762 learned_addr learned my addr 172.21.15.38:0/3245089762 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:36.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.566+0000 7fba1759e700 1 --2- 172.21.15.38:0/3245089762 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba180b7cf0 0x7fba180b8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:36.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.566+0000 7fba1659c700 1 --2- 172.21.15.38:0/3245089762 >> v2:172.21.15.150:3300/0 conn(0x7fba1805b9c0 0x7fba180b73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:36.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.566+0000 7fba16d9d700 1 -- 172.21.15.38:0/3245089762 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba180b7cf0 msgr2=0x7fba180b8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:36.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.566+0000 7fba16d9d700 1 --2- 172.21.15.38:0/3245089762 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba180b7cf0 0x7fba180b8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:36.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.566+0000 7fba16d9d700 1 -- 172.21.15.38:0/3245089762 >> v2:172.21.15.150:3300/0 conn(0x7fba1805b9c0 msgr2=0x7fba180b73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:36.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.566+0000 7fba16d9d700 1 --2- 172.21.15.38:0/3245089762 >> v2:172.21.15.150:3300/0 conn(0x7fba1805b9c0 0x7fba180b73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:36.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.566+0000 7fba16d9d700 1 -- 172.21.15.38:0/3245089762 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1809dce0 con 0x7fba1805b5e0 2020-06-12T17:50:36.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.566+0000 7fba1759e700 1 --2- 172.21.15.38:0/3245089762 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba180b7cf0 0x7fba180b8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:50:36.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.566+0000 7fba1659c700 1 --2- 172.21.15.38:0/3245089762 >> v2:172.21.15.150:3300/0 conn(0x7fba1805b9c0 0x7fba180b73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:50:36.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.566+0000 7fba16d9d700 1 --2- 172.21.15.38:0/3245089762 >> v2:172.21.15.38:3300/0 conn(0x7fba1805b5e0 0x7fba180b9030 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fba0c002f30 tx=0x7fba0c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.566+0000 7fba16d9d700 1 --2- 172.21.15.38:0/3245089762 >> v2:172.21.15.38:3300/0 conn(0x7fba1805b5e0 0x7fba180b9030 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fba0c002f30 tx=0x7fba0c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.566+0000 7fba16d9d700 1 --2- 172.21.15.38:0/3245089762 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba1805b5e0 0x7fba180b9030 secure :-1 s=READY pgs=699 cs=0 l=1 rx=0x7fba0c002f30 tx=0x7fba0c007e60).ready entity=mon.0 client_cookie=b4fae25f325f14f0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:36.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.567+0000 7fba16d9d700 1 --2- 172.21.15.38:0/3245089762 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba1805b5e0 0x7fba180b9030 secure :-1 s=THROTTLE_DONE pgs=699 cs=0 l=1 rx=0x7fba0c002f30 tx=0x7fba0c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.567+0000 7fba15d9b700 1 -- 172.21.15.38:0/3245089762 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba0c0116e0 con 0x7fba1805b5e0 2020-06-12T17:50:36.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.567+0000 7fba16d9d700 1 --2- 172.21.15.38:0/3245089762 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba1805b5e0 0x7fba180b9030 secure :-1 s=THROTTLE_DONE pgs=699 cs=0 l=1 rx=0x7fba0c002f30 tx=0x7fba0c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.567+0000 7fba16d9d700 1 --2- 172.21.15.38:0/3245089762 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba1805b5e0 0x7fba180b9030 secure :-1 s=THROTTLE_DONE pgs=699 cs=0 l=1 rx=0x7fba0c002f30 tx=0x7fba0c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.567+0000 7fba15d9b700 1 -- 172.21.15.38:0/3245089762 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0c011840 con 0x7fba1805b5e0 2020-06-12T17:50:36.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.567+0000 7fba15d9b700 1 -- 172.21.15.38:0/3245089762 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba0c011be0 con 0x7fba1805b5e0 2020-06-12T17:50:36.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.567+0000 7fba1d085700 1 -- 172.21.15.38:0/3245089762 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba1805b5e0 msgr2=0x7fba180b9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:36.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.567+0000 7fba1d085700 1 --2- 172.21.15.38:0/3245089762 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba1805b5e0 0x7fba180b9030 secure :-1 s=READY pgs=699 cs=0 l=1 rx=0x7fba0c002f30 tx=0x7fba0c007e60).stop 2020-06-12T17:50:36.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.567+0000 7fba1d085700 1 -- 172.21.15.38:0/3245089762 shutdown_connections 2020-06-12T17:50:36.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.567+0000 7fba1d085700 1 --2- 172.21.15.38:0/3245089762 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba1805b5e0 0x7fba180b9030 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:36.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.567+0000 7fba1d085700 1 --2- 172.21.15.38:0/3245089762 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba180b7cf0 0x7fba180b8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:36.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.567+0000 7fba1d085700 1 --2- 172.21.15.38:0/3245089762 >> v2:172.21.15.150:3300/0 conn(0x7fba1805b9c0 0x7fba180b73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:36.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.567+0000 7fba1d085700 1 -- 172.21.15.38:0/3245089762 >> 172.21.15.38:0/3245089762 conn(0x7fba180b94a0 msgr2=0x7fba180b98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:36.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.567+0000 7fba1d085700 1 -- 172.21.15.38:0/3245089762 shutdown_connections 2020-06-12T17:50:36.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.567+0000 7fba1d085700 1 -- 172.21.15.38:0/3245089762 wait complete. 2020-06-12T17:50:36.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.568+0000 7fba1d085700 1 Processor -- start 2020-06-12T17:50:36.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.568+0000 7fba1d085700 1 -- start start 2020-06-12T17:50:36.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.569+0000 7fba1d085700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fba1805b9c0 0x7fba1813ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:36.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.569+0000 7fba1d085700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba180b7cf0 0x7fba180ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:36.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.569+0000 7fba1d085700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1813f060 con 0x7fba1805b5e0 2020-06-12T17:50:36.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.569+0000 7fba1d085700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba18142700 con 0x7fba1805b9c0 2020-06-12T17:50:36.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.569+0000 7fba1d085700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba181429a0 con 0x7fba180b7cf0 2020-06-12T17:50:36.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.569+0000 7fba16d9d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fba1805b5e0 0x7fba18141130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:33224/0 (socket says 172.21.15.38:33224) 2020-06-12T17:50:36.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.569+0000 7fba16d9d700 1 -- 172.21.15.38:0/1934877885 learned_addr learned my addr 172.21.15.38:0/1934877885 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:36.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.569+0000 7fba1759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba180b7cf0 0x7fba180ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:36.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.569+0000 7fba1659c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fba1805b9c0 0x7fba1813ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:36.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.569+0000 7fba1759e700 1 -- 172.21.15.38:0/1934877885 >> v2:172.21.15.150:3300/0 conn(0x7fba1805b9c0 msgr2=0x7fba1813ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:36.585 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.569+0000 7fba1759e700 1 --2- 172.21.15.38:0/1934877885 >> v2:172.21.15.150:3300/0 conn(0x7fba1805b9c0 0x7fba1813ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:36.585 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.569+0000 7fba1759e700 1 -- 172.21.15.38:0/1934877885 >> v1:172.21.15.150:6789/0 conn(0x7fba1805b5e0 legacy=0x7fba18141130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:36.585 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.569+0000 7fba1759e700 1 -- 172.21.15.38:0/1934877885 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba18142c40 con 0x7fba180b7cf0 2020-06-12T17:50:36.585 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.569+0000 7fba07fff700 1 -- 172.21.15.38:0/1934877885 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3757194796 0 0) 0x7fba1809dce0 con 0x7fba1805b5e0 2020-06-12T17:50:36.585 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.569+0000 7fba1659c700 1 --2- 172.21.15.38:0/1934877885 >> v2:172.21.15.150:3300/0 conn(0x7fba1805b9c0 0x7fba1813ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:50:36.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.570+0000 7fba1759e700 1 --2- 172.21.15.38:0/1934877885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba180b7cf0 0x7fba180ae5c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fba100032b0 tx=0x7fba1000e230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.570+0000 7fba1759e700 1 --2- 172.21.15.38:0/1934877885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba180b7cf0 0x7fba180ae5c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fba100032b0 tx=0x7fba1000e230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.570+0000 7fba1759e700 1 --2- 172.21.15.38:0/1934877885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba180b7cf0 0x7fba180ae5c0 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7fba100032b0 tx=0x7fba1000e230).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:36.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.570+0000 7fba1759e700 1 --2- 172.21.15.38:0/1934877885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba180b7cf0 0x7fba180ae5c0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fba100032b0 tx=0x7fba1000e230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.570+0000 7fba07fff700 1 -- 172.21.15.38:0/1934877885 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba10012a60 con 0x7fba180b7cf0 2020-06-12T17:50:36.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.570+0000 7fba1759e700 1 --2- 172.21.15.38:0/1934877885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba180b7cf0 0x7fba180ae5c0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fba100032b0 tx=0x7fba1000e230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.570+0000 7fba1759e700 1 --2- 172.21.15.38:0/1934877885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba180b7cf0 0x7fba180ae5c0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fba100032b0 tx=0x7fba1000e230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.570+0000 7fba07fff700 1 -- 172.21.15.38:0/1934877885 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba10012bc0 con 0x7fba180b7cf0 2020-06-12T17:50:36.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.570+0000 7fba1d085700 1 -- 172.21.15.38:0/1934877885 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba18144740 con 0x7fba180b7cf0 2020-06-12T17:50:36.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.570+0000 7fba07fff700 1 -- 172.21.15.38:0/1934877885 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba100091a0 con 0x7fba180b7cf0 2020-06-12T17:50:36.588 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.570+0000 7fba1d085700 1 -- 172.21.15.38:0/1934877885 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba180aec60 con 0x7fba180b7cf0 2020-06-12T17:50:36.588 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.571+0000 7fba1759e700 1 --2- 172.21.15.38:0/1934877885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba180b7cf0 0x7fba180ae5c0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fba100032b0 tx=0x7fba1000e230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.588 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.571+0000 7fba1d085700 1 -- 172.21.15.38:0/1934877885 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1809c3e0 con 0x7fba180b7cf0 2020-06-12T17:50:36.588 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.571+0000 7fba07fff700 1 -- 172.21.15.38:0/1934877885 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fba10005a40 con 0x7fba180b7cf0 2020-06-12T17:50:36.588 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.571+0000 7fba1759e700 1 --2- 172.21.15.38:0/1934877885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba180b7cf0 0x7fba180ae5c0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fba100032b0 tx=0x7fba1000e230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.571+0000 7fba07fff700 1 --2- 172.21.15.38:0/1934877885 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb9f404d4c0 0x7fb9f404f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:36.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.571+0000 7fba07fff700 1 -- 172.21.15.38:0/1934877885 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fba100611f0 con 0x7fba180b7cf0 2020-06-12T17:50:36.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.572+0000 7fba16d9d700 1 --2- 172.21.15.38:0/1934877885 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb9f404d4c0 0x7fb9f404f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:36.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.572+0000 7fba16d9d700 1 --2- 172.21.15.38:0/1934877885 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb9f404d4c0 0x7fb9f404f980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fba0c000b80 tx=0x7fba0c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.572+0000 7fba16d9d700 1 --2- 172.21.15.38:0/1934877885 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb9f404d4c0 0x7fb9f404f980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fba0c000b80 tx=0x7fba0c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.590 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.572+0000 7fba16d9d700 1 --2- 172.21.15.38:0/1934877885 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb9f404d4c0 0x7fb9f404f980 secure :-1 s=READY pgs=274 cs=0 l=1 rx=0x7fba0c000b80 tx=0x7fba0c007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:36.590 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.575+0000 7fba1759e700 1 --2- 172.21.15.38:0/1934877885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba180b7cf0 0x7fba180ae5c0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7fba100032b0 tx=0x7fba1000e230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.590 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.575+0000 7fba07fff700 1 -- 172.21.15.38:0/1934877885 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fba1003c970 con 0x7fba180b7cf0 2020-06-12T17:50:36.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.770+0000 7fba1d085700 1 -- 172.21.15.38:0/1934877885 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_1550", "target": ["mon-mgr", ""]}) v1 -- 0x7fba181448d0 con 0x7fb9f404d4c0 2020-06-12T17:50:36.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.789+0000 7fba16d9d700 1 --2- 172.21.15.38:0/1934877885 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb9f404d4c0 0x7fb9f404f980 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7fba0c000b80 tx=0x7fba0c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.789+0000 7fba07fff700 1 -- 172.21.15.38:0/1934877885 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fba181448d0 con 0x7fb9f404d4c0 2020-06-12T17:50:36.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.791+0000 7fba1d085700 1 -- 172.21.15.38:0/1934877885 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb9f404d4c0 msgr2=0x7fb9f404f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:36.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.791+0000 7fba1d085700 1 --2- 172.21.15.38:0/1934877885 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb9f404d4c0 0x7fb9f404f980 secure :-1 s=READY pgs=274 cs=0 l=1 rx=0x7fba0c000b80 tx=0x7fba0c007e60).stop 2020-06-12T17:50:36.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.791+0000 7fba1d085700 1 -- 172.21.15.38:0/1934877885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba180b7cf0 msgr2=0x7fba180ae5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:36.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.791+0000 7fba1d085700 1 --2- 172.21.15.38:0/1934877885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba180b7cf0 0x7fba180ae5c0 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7fba100032b0 tx=0x7fba1000e230).stop 2020-06-12T17:50:36.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.791+0000 7fba1d085700 1 -- 172.21.15.38:0/1934877885 shutdown_connections 2020-06-12T17:50:36.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.791+0000 7fba1d085700 1 --2- 172.21.15.38:0/1934877885 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fb9f404d4c0 0x7fb9f404f980 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:36.804 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.791+0000 7fba1d085700 1 --2- 172.21.15.38:0/1934877885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba180b7cf0 0x7fba180ae5c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:36.805 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.791+0000 7fba1d085700 1 --2- 172.21.15.38:0/1934877885 >> v2:172.21.15.150:3300/0 conn(0x7fba1805b9c0 0x7fba1813ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:36.805 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.791+0000 7fba1d085700 1 -- 172.21.15.38:0/1934877885 >> 172.21.15.38:0/1934877885 conn(0x7fba180b94a0 msgr2=0x7fba1809cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:36.805 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.791+0000 7fba1d085700 1 -- 172.21.15.38:0/1934877885 shutdown_connections 2020-06-12T17:50:36.805 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.791+0000 7fba1d085700 1 -- 172.21.15.38:0/1934877885 wait complete. 2020-06-12T17:50:36.806 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_1550 2020-06-12T17:50:36.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.920+0000 7f4b35a99700 1 Processor -- start 2020-06-12T17:50:36.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.920+0000 7f4b35a99700 1 -- start start 2020-06-12T17:50:36.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.920+0000 7f4b35a99700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4b30146680 0x7f4b300ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:36.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.921+0000 7f4b35a99700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b300b2eb0 0x7f4b3009d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:36.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.921+0000 7f4b35a99700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4b3009d620 0x7f4b3009da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:36.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.921+0000 7f4b35a99700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b30146d20 con 0x7f4b3009d620 2020-06-12T17:50:36.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.921+0000 7f4b35a99700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b30066a80 con 0x7f4b30146680 2020-06-12T17:50:36.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.921+0000 7f4b35a99700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b30146f50 con 0x7f4b300b2eb0 2020-06-12T17:50:36.932 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.921+0000 7f4b2ffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4b3009d620 0x7f4b3009da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:36.932 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.921+0000 7f4b2ffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4b3009d620 0x7f4b3009da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38916/0 (socket says 172.21.15.38:38916) 2020-06-12T17:50:36.932 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.921+0000 7f4b2ffff700 1 -- 172.21.15.38:0/429687182 learned_addr learned my addr 172.21.15.38:0/429687182 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:36.932 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.921+0000 7f4b2f7fe700 1 --2- 172.21.15.38:0/429687182 >> v2:172.21.15.150:3300/0 conn(0x7f4b30146680 0x7f4b300ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:36.932 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.921+0000 7f4b2effd700 1 --2- 172.21.15.38:0/429687182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b300b2eb0 0x7f4b3009d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:36.933 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.921+0000 7f4b2ffff700 1 -- 172.21.15.38:0/429687182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b300b2eb0 msgr2=0x7f4b3009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:36.933 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.921+0000 7f4b2ffff700 1 --2- 172.21.15.38:0/429687182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b300b2eb0 0x7f4b3009d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:36.933 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.921+0000 7f4b2ffff700 1 -- 172.21.15.38:0/429687182 >> v2:172.21.15.150:3300/0 conn(0x7f4b30146680 msgr2=0x7f4b300ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:36.933 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.921+0000 7f4b2ffff700 1 --2- 172.21.15.38:0/429687182 >> v2:172.21.15.150:3300/0 conn(0x7f4b30146680 0x7f4b300ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:36.933 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.921+0000 7f4b2ffff700 1 -- 172.21.15.38:0/429687182 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b30146a60 con 0x7f4b3009d620 2020-06-12T17:50:36.934 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.921+0000 7f4b2ffff700 1 --2- 172.21.15.38:0/429687182 >> v2:172.21.15.38:3300/0 conn(0x7f4b3009d620 0x7f4b3009da90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4b280032b0 tx=0x7f4b280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.934 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.921+0000 7f4b2ffff700 1 --2- 172.21.15.38:0/429687182 >> v2:172.21.15.38:3300/0 conn(0x7f4b3009d620 0x7f4b3009da90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4b280032b0 tx=0x7f4b280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.934 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.921+0000 7f4b2ffff700 1 --2- 172.21.15.38:0/429687182 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b3009d620 0x7f4b3009da90 secure :-1 s=READY pgs=700 cs=0 l=1 rx=0x7f4b280032b0 tx=0x7f4b280081e0).ready entity=mon.0 client_cookie=263f3c33ea16ad90 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:36.934 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.921+0000 7f4b2ffff700 1 --2- 172.21.15.38:0/429687182 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b3009d620 0x7f4b3009da90 secure :-1 s=THROTTLE_DONE pgs=700 cs=0 l=1 rx=0x7f4b280032b0 tx=0x7f4b280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.934 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.921+0000 7f4b2e7fc700 1 -- 172.21.15.38:0/429687182 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b2800a160 con 0x7f4b3009d620 2020-06-12T17:50:36.935 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.921+0000 7f4b2ffff700 1 --2- 172.21.15.38:0/429687182 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b3009d620 0x7f4b3009da90 secure :-1 s=THROTTLE_DONE pgs=700 cs=0 l=1 rx=0x7f4b280032b0 tx=0x7f4b280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.935 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.921+0000 7f4b2ffff700 1 --2- 172.21.15.38:0/429687182 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b3009d620 0x7f4b3009da90 secure :-1 s=THROTTLE_DONE pgs=700 cs=0 l=1 rx=0x7f4b280032b0 tx=0x7f4b280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.935 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.921+0000 7f4b2e7fc700 1 -- 172.21.15.38:0/429687182 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2800a2c0 con 0x7f4b3009d620 2020-06-12T17:50:36.935 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.921+0000 7f4b2e7fc700 1 -- 172.21.15.38:0/429687182 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b2800a660 con 0x7f4b3009d620 2020-06-12T17:50:36.935 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.921+0000 7f4b35a99700 1 -- 172.21.15.38:0/429687182 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b3009d620 msgr2=0x7f4b3009da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:36.936 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.921+0000 7f4b35a99700 1 --2- 172.21.15.38:0/429687182 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b3009d620 0x7f4b3009da90 secure :-1 s=READY pgs=700 cs=0 l=1 rx=0x7f4b280032b0 tx=0x7f4b280081e0).stop 2020-06-12T17:50:36.936 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.922+0000 7f4b35a99700 1 -- 172.21.15.38:0/429687182 shutdown_connections 2020-06-12T17:50:36.936 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.922+0000 7f4b35a99700 1 --2- 172.21.15.38:0/429687182 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b3009d620 0x7f4b3009da90 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:36.936 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.922+0000 7f4b35a99700 1 --2- 172.21.15.38:0/429687182 >> v2:172.21.15.150:3300/0 conn(0x7f4b30146680 0x7f4b300ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:36.936 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.922+0000 7f4b35a99700 1 --2- 172.21.15.38:0/429687182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b300b2eb0 0x7f4b3009d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:36.937 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.922+0000 7f4b35a99700 1 -- 172.21.15.38:0/429687182 >> 172.21.15.38:0/429687182 conn(0x7f4b300b5a20 msgr2=0x7f4b3005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:36.937 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.922+0000 7f4b35a99700 1 -- 172.21.15.38:0/429687182 shutdown_connections 2020-06-12T17:50:36.937 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.922+0000 7f4b35a99700 1 -- 172.21.15.38:0/429687182 wait complete. 2020-06-12T17:50:36.937 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.923+0000 7f4b35a99700 1 Processor -- start 2020-06-12T17:50:36.937 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.923+0000 7f4b35a99700 1 -- start start 2020-06-12T17:50:36.937 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.924+0000 7f4b35a99700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b3009d620 0x7f4b30065ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:36.938 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.924+0000 7f4b35a99700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4b300b2eb0 0x7f4b300af700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:36.938 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.924+0000 7f4b35a99700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b30066100 con 0x7f4b30146680 2020-06-12T17:50:36.938 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.924+0000 7f4b35a99700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b300afb60 con 0x7f4b300b2eb0 2020-06-12T17:50:36.938 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.924+0000 7f4b35a99700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b300b1cc0 con 0x7f4b3009d620 2020-06-12T17:50:36.938 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.924+0000 7f4b2ffff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4b30146680 0x7f4b3013e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40742/0 (socket says 172.21.15.38:40742) 2020-06-12T17:50:36.939 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.924+0000 7f4b2ffff700 1 -- 172.21.15.38:0/3908762281 learned_addr learned my addr 172.21.15.38:0/3908762281 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:36.939 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.924+0000 7f4b2f7fe700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b3009d620 0x7f4b30065ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:36.939 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.924+0000 7f4b2cff9700 1 -- 172.21.15.38:0/3908762281 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3086694683 0 0) 0x7f4b30146a60 con 0x7f4b30146680 2020-06-12T17:50:36.939 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.924+0000 7f4b2effd700 1 --2- 172.21.15.38:0/3908762281 >> v2:172.21.15.150:3300/0 conn(0x7f4b300b2eb0 0x7f4b300af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:36.939 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.924+0000 7f4b2cff9700 1 -- 172.21.15.38:0/3908762281 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b10002fe0 con 0x7f4b30146680 2020-06-12T17:50:36.940 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.924+0000 7f4b2cff9700 1 -- 172.21.15.38:0/3908762281 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 864372061 0 0) 0x7f4b10002fe0 con 0x7f4b30146680 2020-06-12T17:50:36.940 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.924+0000 7f4b2cff9700 1 -- 172.21.15.38:0/3908762281 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4b30146a60 con 0x7f4b30146680 2020-06-12T17:50:36.940 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.924+0000 7f4b2cff9700 1 -- 172.21.15.38:0/3908762281 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f4b28007b70 con 0x7f4b30146680 2020-06-12T17:50:36.940 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.924+0000 7f4b2cff9700 1 -- 172.21.15.38:0/3908762281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b3009d620 msgr2=0x7f4b30065ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:36.940 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.924+0000 7f4b2cff9700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b3009d620 0x7f4b30065ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:36.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.924+0000 7f4b2cff9700 1 -- 172.21.15.38:0/3908762281 >> v2:172.21.15.150:3300/0 conn(0x7f4b300b2eb0 msgr2=0x7f4b300af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:36.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.924+0000 7f4b2cff9700 1 --2- 172.21.15.38:0/3908762281 >> v2:172.21.15.150:3300/0 conn(0x7f4b300b2eb0 0x7f4b300af700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:36.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.924+0000 7f4b2cff9700 1 -- 172.21.15.38:0/3908762281 >> v1:172.21.15.38:6789/0 conn(0x7f4b30146680 legacy=0x7f4b3013e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:36.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.924+0000 7f4b2cff9700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b3009d620 0x7f4b100049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:36.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.924+0000 7f4b2cff9700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b10004e10 0x7f4b10005230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:36.942 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.924+0000 7f4b2cff9700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b10003a30 0x7f4b10003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:36.942 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.924+0000 7f4b2cff9700 1 -- 172.21.15.38:0/3908762281 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b300afb60 con 0x7f4b10003a30 2020-06-12T17:50:36.942 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.924+0000 7f4b2cff9700 1 -- 172.21.15.38:0/3908762281 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b300b1cc0 con 0x7f4b10004e10 2020-06-12T17:50:36.942 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.924+0000 7f4b2cff9700 1 -- 172.21.15.38:0/3908762281 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b10004570 con 0x7f4b3009d620 2020-06-12T17:50:36.942 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.924+0000 7f4b2ffff700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b10003a30 0x7f4b10003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:36.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.925+0000 7f4b2f7fe700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b3009d620 0x7f4b100049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:36.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.925+0000 7f4b2effd700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b10004e10 0x7f4b10005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:36.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.925+0000 7f4b2ffff700 1 -- 172.21.15.38:0/3908762281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b3009d620 msgr2=0x7f4b100049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:36.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.925+0000 7f4b2ffff700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b3009d620 0x7f4b100049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:36.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.925+0000 7f4b2ffff700 1 -- 172.21.15.38:0/3908762281 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b10004e10 msgr2=0x7f4b10005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:36.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.925+0000 7f4b2ffff700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b10004e10 0x7f4b10005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:36.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.925+0000 7f4b2ffff700 1 -- 172.21.15.38:0/3908762281 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b300b1f60 con 0x7f4b10003a30 2020-06-12T17:50:36.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.925+0000 7f4b35a99700 1 -- 172.21.15.38:0/3908762281 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b300b19c0 con 0x7f4b10003a30 2020-06-12T17:50:36.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.925+0000 7f4b2ffff700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b10003a30 0x7f4b10003eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4b28007dc0 tx=0x7f4b280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.925+0000 7f4b35a99700 1 -- 172.21.15.38:0/3908762281 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b3013e820 con 0x7f4b10003a30 2020-06-12T17:50:36.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.925+0000 7f4b2ffff700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b10003a30 0x7f4b10003eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4b28007dc0 tx=0x7f4b280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.925+0000 7f4b2ffff700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b10003a30 0x7f4b10003eb0 secure :-1 s=READY pgs=702 cs=0 l=1 rx=0x7f4b28007dc0 tx=0x7f4b280081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:36.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.925+0000 7f4b2ffff700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b10003a30 0x7f4b10003eb0 secure :-1 s=THROTTLE_DONE pgs=702 cs=0 l=1 rx=0x7f4b28007dc0 tx=0x7f4b280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.925+0000 7f4b2cff9700 1 -- 172.21.15.38:0/3908762281 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b2800a6c0 con 0x7f4b10003a30 2020-06-12T17:50:36.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.925+0000 7f4b2ffff700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b10003a30 0x7f4b10003eb0 secure :-1 s=THROTTLE_DONE pgs=702 cs=0 l=1 rx=0x7f4b28007dc0 tx=0x7f4b280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.945 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.925+0000 7f4b2ffff700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b10003a30 0x7f4b10003eb0 secure :-1 s=THROTTLE_DONE pgs=702 cs=0 l=1 rx=0x7f4b28007dc0 tx=0x7f4b280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.946 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.925+0000 7f4b2cff9700 1 -- 172.21.15.38:0/3908762281 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b28005a40 con 0x7f4b10003a30 2020-06-12T17:50:36.946 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.925+0000 7f4b2cff9700 1 -- 172.21.15.38:0/3908762281 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b28005e20 con 0x7f4b10003a30 2020-06-12T17:50:36.946 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.926+0000 7f4b35a99700 1 -- 172.21.15.38:0/3908762281 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b0c003340 con 0x7f4b10003a30 2020-06-12T17:50:36.946 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.926+0000 7f4b2ffff700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b10003a30 0x7f4b10003eb0 secure :-1 s=THROTTLE_DONE pgs=702 cs=0 l=1 rx=0x7f4b28007dc0 tx=0x7f4b280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.946 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.926+0000 7f4b2cff9700 1 -- 172.21.15.38:0/3908762281 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f4b28007150 con 0x7f4b10003a30 2020-06-12T17:50:36.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.926+0000 7f4b2ffff700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b10003a30 0x7f4b10003eb0 secure :-1 s=THROTTLE_DONE pgs=702 cs=0 l=1 rx=0x7f4b28007dc0 tx=0x7f4b280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.926+0000 7f4b2cff9700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4b10055720 0x7f4b10057be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:36.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.926+0000 7f4b2cff9700 1 -- 172.21.15.38:0/3908762281 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f4b280620c0 con 0x7f4b10003a30 2020-06-12T17:50:36.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.927+0000 7f4b2f7fe700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4b10055720 0x7f4b10057be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:36.947 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.927+0000 7f4b2f7fe700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4b10055720 0x7f4b10057be0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4b20002f30 tx=0x7f4b2000e040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.927+0000 7f4b2f7fe700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4b10055720 0x7f4b10057be0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4b20002f30 tx=0x7f4b2000e040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.948 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.927+0000 7f4b2f7fe700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4b10055720 0x7f4b10057be0 secure :-1 s=READY pgs=275 cs=0 l=1 rx=0x7f4b20002f30 tx=0x7f4b2000e040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:36.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.930+0000 7f4b2ffff700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b10003a30 0x7f4b10003eb0 secure :-1 s=THROTTLE_DONE pgs=702 cs=0 l=1 rx=0x7f4b28007dc0 tx=0x7f4b280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:36.949 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:36.930+0000 7f4b2cff9700 1 -- 172.21.15.38:0/3908762281 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f4b2803d8a0 con 0x7f4b10003a30 2020-06-12T17:50:37.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:37.123+0000 7f4b35a99700 1 -- 172.21.15.38:0/3908762281 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_1550", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b0c002200 con 0x7f4b10055720 2020-06-12T17:50:37.129 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:37.126+0000 7f4b2f7fe700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4b10055720 0x7f4b10057be0 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7f4b20002f30 tx=0x7f4b2000e040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:37.129 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:37.126+0000 7f4b2cff9700 1 -- 172.21.15.38:0/3908762281 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f4b0c002200 con 0x7f4b10055720 2020-06-12T17:50:37.130 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_1550/ecf37d43-8deb-4f0d-848d-403c2728b6a3 2020-06-12T17:50:37.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:37.127+0000 7f4b35a99700 1 -- 172.21.15.38:0/3908762281 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4b10055720 msgr2=0x7f4b10057be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:37.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:37.127+0000 7f4b35a99700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4b10055720 0x7f4b10057be0 secure :-1 s=READY pgs=275 cs=0 l=1 rx=0x7f4b20002f30 tx=0x7f4b2000e040).stop 2020-06-12T17:50:37.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:37.127+0000 7f4b35a99700 1 -- 172.21.15.38:0/3908762281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b10003a30 msgr2=0x7f4b10003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:37.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:37.127+0000 7f4b35a99700 1 --2- 172.21.15.38:0/3908762281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b10003a30 0x7f4b10003eb0 secure :-1 s=READY pgs=702 cs=0 l=1 rx=0x7f4b28007dc0 tx=0x7f4b280081e0).stop 2020-06-12T17:50:37.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:37.127+0000 7f4b2ffff700 1 -- 172.21.15.38:0/3908762281 reap_dead start 2020-06-12T17:50:37.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:37.127+0000 7f4b2ffff700 1 -- 172.21.15.38:0/3908762281 reap_dead start 2020-06-12T17:50:37.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:37.127+0000 7f4b35a99700 1 -- 172.21.15.38:0/3908762281 shutdown_connections 2020-06-12T17:50:37.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:37.127+0000 7f4b35a99700 1 -- 172.21.15.38:0/3908762281 >> 172.21.15.38:0/3908762281 conn(0x7f4b300b5a20 msgr2=0x7f4b3009e040 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:37.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:37.127+0000 7f4b35a99700 1 -- 172.21.15.38:0/3908762281 shutdown_connections 2020-06-12T17:50:37.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:37.127+0000 7f4b35a99700 1 -- 172.21.15.38:0/3908762281 wait complete. 2020-06-12T17:50:37.141 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_1550 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_1550/ecf37d43-8deb-4f0d-848d-403c2728b6a3 2020-06-12T17:50:37.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:37.142 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:37.142 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:37.157 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:37.158 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:37.158 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1550/ecf37d43-8deb-4f0d-848d-403c2728b6a3/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:37.248 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:37.248 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:37.248 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107544 s, 97.5 MB/s 2020-06-12T17:50:37.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:37.250 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:37.251 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:37.266 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:37.266 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:37.267 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1550/ecf37d43-8deb-4f0d-848d-403c2728b6a3/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:37.357 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:37.357 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:37.358 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121555 s, 86.3 MB/s 2020-06-12T17:50:37.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:37.359 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:37.359 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:37.374 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:37.375 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:37.375 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1550/ecf37d43-8deb-4f0d-848d-403c2728b6a3/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:37.464 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:37.464 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:37.465 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126253 s, 83.1 MB/s 2020-06-12T17:50:37.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:37.467 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:37.468 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:37.483 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:37.484 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:37.484 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1550/ecf37d43-8deb-4f0d-848d-403c2728b6a3/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:37.571 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:37.571 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:37.572 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111321 s, 94.2 MB/s 2020-06-12T17:50:37.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:37.574 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:37.574 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:37.589 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:37.590 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:37.590 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1550/ecf37d43-8deb-4f0d-848d-403c2728b6a3/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:37.676 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:37.677 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:37.677 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108596 s, 96.6 MB/s 2020-06-12T17:50:37.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:37.679 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:37.679 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:37.695 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:37.695 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:37.696 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1550/ecf37d43-8deb-4f0d-848d-403c2728b6a3/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:37.782 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:37.783 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:37.783 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110056 s, 95.3 MB/s 2020-06-12T17:50:37.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:37.785 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:37.785 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:37.801 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:37.802 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:37.802 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1550/ecf37d43-8deb-4f0d-848d-403c2728b6a3/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:37.889 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:37.889 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:37.890 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113883 s, 92.1 MB/s 2020-06-12T17:50:37.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:37.891 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:37.892 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:37.907 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:37.908 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:37.908 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1550/ecf37d43-8deb-4f0d-848d-403c2728b6a3/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:37.996 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:37.996 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:37.996 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00995233 s, 105 MB/s 2020-06-12T17:50:37.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:37.998 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:37.998 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:38.013 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:38.014 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:38.014 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1550/ecf37d43-8deb-4f0d-848d-403c2728b6a3/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:38.100 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:38.101 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:38.101 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102163 s, 103 MB/s 2020-06-12T17:50:38.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:38.103 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:38.104 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:38.118 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:38.119 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:38.120 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1550/ecf37d43-8deb-4f0d-848d-403c2728b6a3/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:38.204 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:38.204 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:38.205 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00892338 s, 118 MB/s 2020-06-12T17:50:38.206 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_5152 2020-06-12T17:50:38.323 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.320+0000 7f5cba5a1700 1 Processor -- start 2020-06-12T17:50:38.324 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.320+0000 7f5cba5a1700 1 -- start start 2020-06-12T17:50:38.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.321+0000 7f5cba5a1700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5cb40b4130 0x7f5cb4142420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:38.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.321+0000 7f5cba5a1700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb4066da0 con 0x7f5cb40afb40 2020-06-12T17:50:38.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.321+0000 7f5cba5a1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb40b0270 con 0x7f5cb4142880 2020-06-12T17:50:38.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.321+0000 7f5cba5a1700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb4142ca0 con 0x7f5cb40b4130 2020-06-12T17:50:38.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.321+0000 7f5cb8d9e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5cb40b4130 0x7f5cb4142420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:38.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.321+0000 7f5cb8d9e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5cb40b4130 0x7f5cb4142420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38938/0 (socket says 172.21.15.38:38938) 2020-06-12T17:50:38.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.321+0000 7f5cb959f700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f5cb40afb40 0x7f5cb405b420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40752/0 (socket says 172.21.15.38:40752) 2020-06-12T17:50:38.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.321+0000 7f5cb8d9e700 1 -- 172.21.15.38:0/361388129 learned_addr learned my addr 172.21.15.38:0/361388129 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:38.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.321+0000 7f5cb8d9e700 1 -- 172.21.15.38:0/361388129 >> v1:172.21.15.150:6789/0 conn(0x7f5cb4142880 legacy=0x7f5cb414c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:38.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.321+0000 7f5cb8d9e700 1 -- 172.21.15.38:0/361388129 >> v1:172.21.15.38:6789/0 conn(0x7f5cb40afb40 legacy=0x7f5cb405b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:38.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.321+0000 7f5ca3fff700 1 -- 172.21.15.38:0/361388129 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1316005195 0 0) 0x7f5cb4066da0 con 0x7f5cb40afb40 2020-06-12T17:50:38.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.321+0000 7f5cb8d9e700 1 -- 172.21.15.38:0/361388129 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb4145b70 con 0x7f5cb40b4130 2020-06-12T17:50:38.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.321+0000 7f5cb8d9e700 1 --2- 172.21.15.38:0/361388129 >> v2:172.21.15.38:3300/0 conn(0x7f5cb40b4130 0x7f5cb4142420 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5cb4061300 tx=0x7f5ca4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.321+0000 7f5cb8d9e700 1 --2- 172.21.15.38:0/361388129 >> v2:172.21.15.38:3300/0 conn(0x7f5cb40b4130 0x7f5cb4142420 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5cb4061300 tx=0x7f5ca4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.321+0000 7f5cb8d9e700 1 --2- 172.21.15.38:0/361388129 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5cb40b4130 0x7f5cb4142420 secure :-1 s=READY pgs=704 cs=0 l=1 rx=0x7f5cb4061300 tx=0x7f5ca4007e60).ready entity=mon.0 client_cookie=81da74e1d2f77e6c server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:38.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.321+0000 7f5cb8d9e700 1 --2- 172.21.15.38:0/361388129 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5cb40b4130 0x7f5cb4142420 secure :-1 s=THROTTLE_DONE pgs=704 cs=0 l=1 rx=0x7f5cb4061300 tx=0x7f5ca4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.321+0000 7f5cb8d9e700 1 --2- 172.21.15.38:0/361388129 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5cb40b4130 0x7f5cb4142420 secure :-1 s=THROTTLE_DONE pgs=704 cs=0 l=1 rx=0x7f5cb4061300 tx=0x7f5ca4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.321+0000 7f5ca3fff700 1 -- 172.21.15.38:0/361388129 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ca4009e40 con 0x7f5cb40b4130 2020-06-12T17:50:38.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.321+0000 7f5cb8d9e700 1 --2- 172.21.15.38:0/361388129 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5cb40b4130 0x7f5cb4142420 secure :-1 s=THROTTLE_DONE pgs=704 cs=0 l=1 rx=0x7f5cb4061300 tx=0x7f5ca4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.321+0000 7f5ca3fff700 1 -- 172.21.15.38:0/361388129 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca40129a0 con 0x7f5cb40b4130 2020-06-12T17:50:38.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.321+0000 7f5ca3fff700 1 -- 172.21.15.38:0/361388129 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ca4012d80 con 0x7f5cb40b4130 2020-06-12T17:50:38.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.321+0000 7f5cba5a1700 1 -- 172.21.15.38:0/361388129 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5cb40b4130 msgr2=0x7f5cb4142420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:38.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.321+0000 7f5cba5a1700 1 --2- 172.21.15.38:0/361388129 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5cb40b4130 0x7f5cb4142420 secure :-1 s=READY pgs=704 cs=0 l=1 rx=0x7f5cb4061300 tx=0x7f5ca4007e60).stop 2020-06-12T17:50:38.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.322+0000 7f5cba5a1700 1 -- 172.21.15.38:0/361388129 shutdown_connections 2020-06-12T17:50:38.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.322+0000 7f5cba5a1700 1 --2- 172.21.15.38:0/361388129 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5cb40b4130 0x7f5cb4142420 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:38.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.322+0000 7f5cba5a1700 1 -- 172.21.15.38:0/361388129 >> 172.21.15.38:0/361388129 conn(0x7f5cb40b4cc0 msgr2=0x7f5cb40b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:38.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.322+0000 7f5cba5a1700 1 -- 172.21.15.38:0/361388129 shutdown_connections 2020-06-12T17:50:38.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.322+0000 7f5cba5a1700 1 -- 172.21.15.38:0/361388129 wait complete. 2020-06-12T17:50:38.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.323+0000 7f5cba5a1700 1 Processor -- start 2020-06-12T17:50:38.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.323+0000 7f5cba5a1700 1 -- start start 2020-06-12T17:50:38.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.324+0000 7f5cba5a1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5cb40b4130 0x7f5cb41314d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:38.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.324+0000 7f5cba5a1700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb413e620 con 0x7f5cb40afb40 2020-06-12T17:50:38.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.324+0000 7f5cba5a1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb413e8c0 con 0x7f5cb4142880 2020-06-12T17:50:38.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.324+0000 7f5cba5a1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb413eb60 con 0x7f5cb40b4130 2020-06-12T17:50:38.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.324+0000 7f5cb959f700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f5cb40afb40 0x7f5cb4130dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40758/0 (socket says 172.21.15.38:40758) 2020-06-12T17:50:38.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.324+0000 7f5cb959f700 1 -- 172.21.15.38:0/2446616496 learned_addr learned my addr 172.21.15.38:0/2446616496 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:38.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.324+0000 7f5ca27fc700 1 -- 172.21.15.38:0/2446616496 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 337723659 0 0) 0x7f5cb413e620 con 0x7f5cb40afb40 2020-06-12T17:50:38.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.324+0000 7f5ca27fc700 1 -- 172.21.15.38:0/2446616496 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c94002fe0 con 0x7f5cb40afb40 2020-06-12T17:50:38.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.324+0000 7f5cb8d9e700 1 --2- 172.21.15.38:0/2446616496 >> v2:172.21.15.150:3300/0 conn(0x7f5cb40b4130 0x7f5cb41314d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:38.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.324+0000 7f5ca27fc700 1 -- 172.21.15.38:0/2446616496 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2556131029 0 0) 0x7f5c94002fe0 con 0x7f5cb40afb40 2020-06-12T17:50:38.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.324+0000 7f5ca27fc700 1 -- 172.21.15.38:0/2446616496 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5cb413e620 con 0x7f5cb40afb40 2020-06-12T17:50:38.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.324+0000 7f5ca27fc700 1 -- 172.21.15.38:0/2446616496 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f5cb0001920 con 0x7f5cb40afb40 2020-06-12T17:50:38.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.324+0000 7f5ca27fc700 1 -- 172.21.15.38:0/2446616496 >> v2:172.21.15.150:3300/0 conn(0x7f5cb40b4130 msgr2=0x7f5cb41314d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:38.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.324+0000 7f5ca27fc700 1 --2- 172.21.15.38:0/2446616496 >> v2:172.21.15.150:3300/0 conn(0x7f5cb40b4130 0x7f5cb41314d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:38.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.324+0000 7f5ca27fc700 1 -- 172.21.15.38:0/2446616496 >> v1:172.21.15.150:6789/0 conn(0x7f5cb4142880 legacy=0x7f5cb413f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:38.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.324+0000 7f5ca27fc700 1 -- 172.21.15.38:0/2446616496 >> v1:172.21.15.38:6789/0 conn(0x7f5cb40afb40 legacy=0x7f5cb4130dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:38.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.324+0000 7f5ca27fc700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c940049b0 0x7f5c94004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:38.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.324+0000 7f5ca27fc700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c94003920 0x7f5c94003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:38.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.324+0000 7f5ca27fc700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c940041c0 0x7f5c9400b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:38.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.324+0000 7f5ca27fc700 1 -- 172.21.15.38:0/2446616496 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb413eb60 con 0x7f5c940049b0 2020-06-12T17:50:38.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.324+0000 7f5ca27fc700 1 -- 172.21.15.38:0/2446616496 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9400bbb0 con 0x7f5c94003920 2020-06-12T17:50:38.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.324+0000 7f5ca27fc700 1 -- 172.21.15.38:0/2446616496 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9400bcf0 con 0x7f5c940041c0 2020-06-12T17:50:38.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.324+0000 7f5cb959f700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c940049b0 0x7f5c94004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:38.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.324+0000 7f5cb8d9e700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c94003920 0x7f5c94003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:38.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.325+0000 7f5cb9da0700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c940041c0 0x7f5c9400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:38.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.325+0000 7f5cb959f700 1 -- 172.21.15.38:0/2446616496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c940041c0 msgr2=0x7f5c9400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:38.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.325+0000 7f5cb959f700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c940041c0 0x7f5c9400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:38.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.325+0000 7f5cb959f700 1 -- 172.21.15.38:0/2446616496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c94003920 msgr2=0x7f5c94003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:38.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.325+0000 7f5cb959f700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c94003920 0x7f5c94003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:38.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.325+0000 7f5cb959f700 1 -- 172.21.15.38:0/2446616496 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb4140b10 con 0x7f5c940049b0 2020-06-12T17:50:38.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.325+0000 7f5cb9da0700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c940041c0 0x7f5c9400b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:50:38.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.325+0000 7f5cba5a1700 1 -- 172.21.15.38:0/2446616496 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb412f5d0 con 0x7f5c940049b0 2020-06-12T17:50:38.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.325+0000 7f5cb959f700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c940049b0 0x7f5c94004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5cb0001130 tx=0x7f5cb000e990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.325+0000 7f5cb9da0700 1 -- 172.21.15.38:0/2446616496 reap_dead start 2020-06-12T17:50:38.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.325+0000 7f5cb959f700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c940049b0 0x7f5c94004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5cb0001130 tx=0x7f5cb000e990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.325+0000 7f5cb959f700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c940049b0 0x7f5c94004dd0 secure :-1 s=READY pgs=706 cs=0 l=1 rx=0x7f5cb0001130 tx=0x7f5cb000e990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:38.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.325+0000 7f5cb959f700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c940049b0 0x7f5c94004dd0 secure :-1 s=THROTTLE_DONE pgs=706 cs=0 l=1 rx=0x7f5cb0001130 tx=0x7f5cb000e990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.325+0000 7f5cba5a1700 1 -- 172.21.15.38:0/2446616496 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb40b1060 con 0x7f5c940049b0 2020-06-12T17:50:38.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.325+0000 7f5ca27fc700 1 -- 172.21.15.38:0/2446616496 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cb0011bb0 con 0x7f5c940049b0 2020-06-12T17:50:38.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.325+0000 7f5cb959f700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c940049b0 0x7f5c94004dd0 secure :-1 s=THROTTLE_DONE pgs=706 cs=0 l=1 rx=0x7f5cb0001130 tx=0x7f5cb000e990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.325+0000 7f5cb959f700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c940049b0 0x7f5c94004dd0 secure :-1 s=THROTTLE_DONE pgs=706 cs=0 l=1 rx=0x7f5cb0001130 tx=0x7f5cb000e990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.325+0000 7f5ca27fc700 1 -- 172.21.15.38:0/2446616496 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb0011d10 con 0x7f5c940049b0 2020-06-12T17:50:38.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.325+0000 7f5ca27fc700 1 -- 172.21.15.38:0/2446616496 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cb00046e0 con 0x7f5c940049b0 2020-06-12T17:50:38.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.326+0000 7f5cb959f700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c940049b0 0x7f5c94004dd0 secure :-1 s=THROTTLE_DONE pgs=706 cs=0 l=1 rx=0x7f5cb0001130 tx=0x7f5cb000e990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.326+0000 7f5cba5a1700 1 -- 172.21.15.38:0/2446616496 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb40b14d0 con 0x7f5c940049b0 2020-06-12T17:50:38.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.326+0000 7f5ca27fc700 1 -- 172.21.15.38:0/2446616496 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f5cb0004840 con 0x7f5c940049b0 2020-06-12T17:50:38.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.326+0000 7f5cb959f700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c940049b0 0x7f5c94004dd0 secure :-1 s=THROTTLE_DONE pgs=706 cs=0 l=1 rx=0x7f5cb0001130 tx=0x7f5cb000e990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.326+0000 7f5ca27fc700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5c94051630 0x7f5c94053af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:38.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.326+0000 7f5ca27fc700 1 -- 172.21.15.38:0/2446616496 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5cb0061240 con 0x7f5c940049b0 2020-06-12T17:50:38.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.327+0000 7f5cb8d9e700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5c94051630 0x7f5c94053af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:38.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.327+0000 7f5cb8d9e700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5c94051630 0x7f5c94053af0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5cb4061300 tx=0x7f5ca4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.327+0000 7f5cb8d9e700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5c94051630 0x7f5c94053af0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5cb4061300 tx=0x7f5ca4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.327+0000 7f5cb8d9e700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5c94051630 0x7f5c94053af0 secure :-1 s=READY pgs=276 cs=0 l=1 rx=0x7f5cb4061300 tx=0x7f5ca4007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:38.354 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.330+0000 7f5cb959f700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c940049b0 0x7f5c94004dd0 secure :-1 s=THROTTLE_DONE pgs=706 cs=0 l=1 rx=0x7f5cb0001130 tx=0x7f5cb000e990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.354 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.330+0000 7f5ca27fc700 1 -- 172.21.15.38:0/2446616496 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f5cb003ca20 con 0x7f5c940049b0 2020-06-12T17:50:38.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.526+0000 7f5cba5a1700 1 -- 172.21.15.38:0/2446616496 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_5152", "target": ["mon-mgr", ""]}) v1 -- 0x7f5cb4140d60 con 0x7f5c94051630 2020-06-12T17:50:38.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.544+0000 7f5cb8d9e700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5c94051630 0x7f5c94053af0 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7f5cb4061300 tx=0x7f5ca4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.544+0000 7f5ca27fc700 1 -- 172.21.15.38:0/2446616496 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f5cb4140d60 con 0x7f5c94051630 2020-06-12T17:50:38.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.545+0000 7f5cba5a1700 1 -- 172.21.15.38:0/2446616496 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5c94051630 msgr2=0x7f5c94053af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:38.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.545+0000 7f5cba5a1700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5c94051630 0x7f5c94053af0 secure :-1 s=READY pgs=276 cs=0 l=1 rx=0x7f5cb4061300 tx=0x7f5ca4007e60).stop 2020-06-12T17:50:38.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.545+0000 7f5cba5a1700 1 -- 172.21.15.38:0/2446616496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c940049b0 msgr2=0x7f5c94004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:38.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.545+0000 7f5cba5a1700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c940049b0 0x7f5c94004dd0 secure :-1 s=READY pgs=706 cs=0 l=1 rx=0x7f5cb0001130 tx=0x7f5cb000e990).stop 2020-06-12T17:50:38.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.546+0000 7f5cba5a1700 1 -- 172.21.15.38:0/2446616496 shutdown_connections 2020-06-12T17:50:38.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.546+0000 7f5cba5a1700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5c94051630 0x7f5c94053af0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:38.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.546+0000 7f5cba5a1700 1 --2- 172.21.15.38:0/2446616496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c940049b0 0x7f5c94004dd0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:38.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.546+0000 7f5cba5a1700 1 -- 172.21.15.38:0/2446616496 >> 172.21.15.38:0/2446616496 conn(0x7f5cb40b4cc0 msgr2=0x7f5cb405b080 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:38.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.546+0000 7f5cba5a1700 1 -- 172.21.15.38:0/2446616496 shutdown_connections 2020-06-12T17:50:38.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.546+0000 7f5cba5a1700 1 -- 172.21.15.38:0/2446616496 wait complete. 2020-06-12T17:50:38.559 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_5152 2020-06-12T17:50:38.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.672+0000 7f785f798700 1 Processor -- start 2020-06-12T17:50:38.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.673+0000 7f785f798700 1 -- start start 2020-06-12T17:50:38.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.673+0000 7f785f798700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f785809df00 0x7f785813c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:38.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.673+0000 7f785f798700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7858142e90 0x7f7858066790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:38.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.673+0000 7f785f798700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f785809b960 con 0x7f78580b3ac0 2020-06-12T17:50:38.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.673+0000 7f785f798700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f785809bc00 con 0x7f785809df00 2020-06-12T17:50:38.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.673+0000 7f785f798700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78580b48f0 con 0x7f7858142e90 2020-06-12T17:50:38.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.673+0000 7f785d534700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f78580b3ac0 0x7f785813bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40772/0 (socket says 172.21.15.38:40772) 2020-06-12T17:50:38.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.673+0000 7f785d534700 1 -- 172.21.15.38:0/3147933046 learned_addr learned my addr 172.21.15.38:0/3147933046 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:38.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.674+0000 7f785cd33700 1 --2- 172.21.15.38:0/3147933046 >> v2:172.21.15.150:3300/0 conn(0x7f785809df00 0x7f785813c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:38.686 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.674+0000 7f785dd35700 1 --2- 172.21.15.38:0/3147933046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7858142e90 0x7f7858066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:38.686 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.674+0000 7f7847fff700 1 -- 172.21.15.38:0/3147933046 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3352450279 0 0) 0x7f785809b960 con 0x7f78580b3ac0 2020-06-12T17:50:38.686 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.674+0000 7f7847fff700 1 -- 172.21.15.38:0/3147933046 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7840003230 con 0x7f78580b3ac0 2020-06-12T17:50:38.686 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.674+0000 7f7847fff700 1 -- 172.21.15.38:0/3147933046 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4267533506 0 0) 0x7f7840003230 con 0x7f78580b3ac0 2020-06-12T17:50:38.686 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.674+0000 7f7847fff700 1 -- 172.21.15.38:0/3147933046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7858142e90 msgr2=0x7f7858066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:38.687 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.674+0000 7f7847fff700 1 --2- 172.21.15.38:0/3147933046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7858142e90 0x7f7858066790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:38.687 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.674+0000 7f7847fff700 1 -- 172.21.15.38:0/3147933046 >> v2:172.21.15.150:3300/0 conn(0x7f785809df00 msgr2=0x7f785813c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:38.687 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.674+0000 7f7847fff700 1 --2- 172.21.15.38:0/3147933046 >> v2:172.21.15.150:3300/0 conn(0x7f785809df00 0x7f785813c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:38.687 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.674+0000 7f7847fff700 1 -- 172.21.15.38:0/3147933046 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78580b3ea0 con 0x7f78580b3ac0 2020-06-12T17:50:38.687 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.674+0000 7f7847fff700 1 -- 172.21.15.38:0/3147933046 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f78480016d0 con 0x7f78580b3ac0 2020-06-12T17:50:38.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.674+0000 7f7847fff700 1 -- 172.21.15.38:0/3147933046 >> v1:172.21.15.38:6789/0 conn(0x7f78580b3ac0 legacy=0x7f785813bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:38.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.674+0000 7f7847fff700 1 --2- 172.21.15.38:0/3147933046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7858142e90 0x7f7840003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:38.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.674+0000 7f7847fff700 1 --2- 172.21.15.38:0/3147933046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7840003b80 0x7f7840003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:38.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.674+0000 7f7847fff700 1 --2- 172.21.15.38:0/3147933046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78400045c0 0x7f7840004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:38.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.674+0000 7f7847fff700 1 -- 172.21.15.38:0/3147933046 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785809bc00 con 0x7f78400045c0 2020-06-12T17:50:38.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.674+0000 7f7847fff700 1 -- 172.21.15.38:0/3147933046 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78580b48f0 con 0x7f7840003b80 2020-06-12T17:50:38.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.674+0000 7f7847fff700 1 -- 172.21.15.38:0/3147933046 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7840005050 con 0x7f7858142e90 2020-06-12T17:50:38.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.674+0000 7f785dd35700 1 --2- 172.21.15.38:0/3147933046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78400045c0 0x7f7840004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:38.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.674+0000 7f785cd33700 1 --2- 172.21.15.38:0/3147933046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7840003b80 0x7f7840003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:38.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.674+0000 7f785d534700 1 --2- 172.21.15.38:0/3147933046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7858142e90 0x7f7840003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:38.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.674+0000 7f785dd35700 1 -- 172.21.15.38:0/3147933046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7858142e90 msgr2=0x7f7840003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:38.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.674+0000 7f785dd35700 1 --2- 172.21.15.38:0/3147933046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7858142e90 0x7f7840003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:38.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.675+0000 7f785dd35700 1 -- 172.21.15.38:0/3147933046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7840003b80 msgr2=0x7f7840003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:38.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.675+0000 7f785dd35700 1 --2- 172.21.15.38:0/3147933046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7840003b80 0x7f7840003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:38.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.675+0000 7f785dd35700 1 -- 172.21.15.38:0/3147933046 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7840003230 con 0x7f78400045c0 2020-06-12T17:50:38.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.675+0000 7f785dd35700 1 --2- 172.21.15.38:0/3147933046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78400045c0 0x7f7840004a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f78500032b0 tx=0x7f78500081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.675+0000 7f785dd35700 1 --2- 172.21.15.38:0/3147933046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78400045c0 0x7f7840004a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f78500032b0 tx=0x7f78500081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.692 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.675+0000 7f785dd35700 1 --2- 172.21.15.38:0/3147933046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78400045c0 0x7f7840004a20 secure :-1 s=READY pgs=708 cs=0 l=1 rx=0x7f78500032b0 tx=0x7f78500081e0).ready entity=mon.0 client_cookie=f35ec4a9d80ba2ea server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:38.692 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.675+0000 7f785dd35700 1 --2- 172.21.15.38:0/3147933046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78400045c0 0x7f7840004a20 secure :-1 s=THROTTLE_DONE pgs=708 cs=0 l=1 rx=0x7f78500032b0 tx=0x7f78500081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.692 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.675+0000 7f7847fff700 1 -- 172.21.15.38:0/3147933046 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7850005a40 con 0x7f78400045c0 2020-06-12T17:50:38.692 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.675+0000 7f785dd35700 1 --2- 172.21.15.38:0/3147933046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78400045c0 0x7f7840004a20 secure :-1 s=THROTTLE_DONE pgs=708 cs=0 l=1 rx=0x7f78500032b0 tx=0x7f78500081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.692 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.675+0000 7f785dd35700 1 --2- 172.21.15.38:0/3147933046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78400045c0 0x7f7840004a20 secure :-1 s=THROTTLE_DONE pgs=708 cs=0 l=1 rx=0x7f78500032b0 tx=0x7f78500081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.675+0000 7f7847fff700 1 -- 172.21.15.38:0/3147933046 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7850005ba0 con 0x7f78400045c0 2020-06-12T17:50:38.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.675+0000 7f7847fff700 1 -- 172.21.15.38:0/3147933046 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78500110c0 con 0x7f78400045c0 2020-06-12T17:50:38.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.675+0000 7f785f798700 1 -- 172.21.15.38:0/3147933046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78400045c0 msgr2=0x7f7840004a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:38.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.675+0000 7f785f798700 1 --2- 172.21.15.38:0/3147933046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78400045c0 0x7f7840004a20 secure :-1 s=READY pgs=708 cs=0 l=1 rx=0x7f78500032b0 tx=0x7f78500081e0).stop 2020-06-12T17:50:38.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.675+0000 7f785dd35700 1 -- 172.21.15.38:0/3147933046 reap_dead start 2020-06-12T17:50:38.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.675+0000 7f785f798700 1 -- 172.21.15.38:0/3147933046 shutdown_connections 2020-06-12T17:50:38.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.675+0000 7f785f798700 1 -- 172.21.15.38:0/3147933046 >> 172.21.15.38:0/3147933046 conn(0x7f78580b5a20 msgr2=0x7f785805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:38.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.675+0000 7f785f798700 1 -- 172.21.15.38:0/3147933046 shutdown_connections 2020-06-12T17:50:38.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.675+0000 7f785f798700 1 -- 172.21.15.38:0/3147933046 wait complete. 2020-06-12T17:50:38.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.676+0000 7f785f798700 1 Processor -- start 2020-06-12T17:50:38.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.676+0000 7f785f798700 1 -- start start 2020-06-12T17:50:38.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.677+0000 7f785f798700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f785813c4f0 0x7f78580ae730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:38.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.677+0000 7f785f798700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78581433f0 0x7f7858143860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:38.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.677+0000 7f785f798700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f785813c8d0 con 0x7f7858152720 2020-06-12T17:50:38.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.677+0000 7f785f798700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7858152d50 con 0x7f785813c4f0 2020-06-12T17:50:38.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.677+0000 7f785f798700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7858152ff0 con 0x7f78581433f0 2020-06-12T17:50:38.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.677+0000 7f785d534700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f785813c4f0 0x7f78580ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:38.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.677+0000 7f785d534700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f785813c4f0 0x7f78580ae730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38968/0 (socket says 172.21.15.38:38968) 2020-06-12T17:50:38.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.677+0000 7f785d534700 1 -- 172.21.15.38:0/2013460101 learned_addr learned my addr 172.21.15.38:0/2013460101 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:38.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.677+0000 7f785dd35700 1 --2- 172.21.15.38:0/2013460101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78581433f0 0x7f7858143860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:38.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.677+0000 7f785d534700 1 -- 172.21.15.38:0/2013460101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78581433f0 msgr2=0x7f7858143860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:38.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.677+0000 7f785d534700 1 --2- 172.21.15.38:0/2013460101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78581433f0 0x7f7858143860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:38.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.677+0000 7f78467fc700 1 -- 172.21.15.38:0/2013460101 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3132621778 0 0) 0x7f7854007bd0 con 0x7f7858152720 2020-06-12T17:50:38.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.677+0000 7f785d534700 1 -- 172.21.15.38:0/2013460101 >> v1:172.21.15.38:6789/0 conn(0x7f7858152720 legacy=0x7f7858140ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:38.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.677+0000 7f785d534700 1 -- 172.21.15.38:0/2013460101 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7858153290 con 0x7f785813c4f0 2020-06-12T17:50:38.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.677+0000 7f785dd35700 1 --2- 172.21.15.38:0/2013460101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78581433f0 0x7f7858143860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:50:38.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.677+0000 7f785d534700 1 --2- 172.21.15.38:0/2013460101 >> v2:172.21.15.38:3300/0 conn(0x7f785813c4f0 0x7f78580ae730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f78480013e0 tx=0x7f784800e8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.677+0000 7f785d534700 1 --2- 172.21.15.38:0/2013460101 >> v2:172.21.15.38:3300/0 conn(0x7f785813c4f0 0x7f78580ae730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f78480013e0 tx=0x7f784800e8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.678+0000 7f785d534700 1 --2- 172.21.15.38:0/2013460101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f785813c4f0 0x7f78580ae730 secure :-1 s=READY pgs=710 cs=0 l=1 rx=0x7f78480013e0 tx=0x7f784800e8d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:38.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.678+0000 7f785d534700 1 --2- 172.21.15.38:0/2013460101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f785813c4f0 0x7f78580ae730 secure :-1 s=THROTTLE_DONE pgs=710 cs=0 l=1 rx=0x7f78480013e0 tx=0x7f784800e8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.678+0000 7f78467fc700 1 -- 172.21.15.38:0/2013460101 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7848011dc0 con 0x7f785813c4f0 2020-06-12T17:50:38.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.678+0000 7f785d534700 1 --2- 172.21.15.38:0/2013460101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f785813c4f0 0x7f78580ae730 secure :-1 s=THROTTLE_DONE pgs=710 cs=0 l=1 rx=0x7f78480013e0 tx=0x7f784800e8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.678+0000 7f785d534700 1 --2- 172.21.15.38:0/2013460101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f785813c4f0 0x7f78580ae730 secure :-1 s=THROTTLE_DONE pgs=710 cs=0 l=1 rx=0x7f78480013e0 tx=0x7f784800e8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.678+0000 7f78467fc700 1 -- 172.21.15.38:0/2013460101 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784800e150 con 0x7f785813c4f0 2020-06-12T17:50:38.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.678+0000 7f785f798700 1 -- 172.21.15.38:0/2013460101 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7858141700 con 0x7f785813c4f0 2020-06-12T17:50:38.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.678+0000 7f78467fc700 1 -- 172.21.15.38:0/2013460101 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f784800e530 con 0x7f785813c4f0 2020-06-12T17:50:38.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.678+0000 7f785f798700 1 -- 172.21.15.38:0/2013460101 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7858143cc0 con 0x7f785813c4f0 2020-06-12T17:50:38.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.678+0000 7f785d534700 1 --2- 172.21.15.38:0/2013460101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f785813c4f0 0x7f78580ae730 secure :-1 s=THROTTLE_DONE pgs=710 cs=0 l=1 rx=0x7f78480013e0 tx=0x7f784800e8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.679+0000 7f785f798700 1 -- 172.21.15.38:0/2013460101 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7858144320 con 0x7f785813c4f0 2020-06-12T17:50:38.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.679+0000 7f78467fc700 1 -- 172.21.15.38:0/2013460101 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f784800c800 con 0x7f785813c4f0 2020-06-12T17:50:38.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.679+0000 7f785d534700 1 --2- 172.21.15.38:0/2013460101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f785813c4f0 0x7f78580ae730 secure :-1 s=THROTTLE_DONE pgs=710 cs=0 l=1 rx=0x7f78480013e0 tx=0x7f784800e8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.679+0000 7f78467fc700 1 --2- 172.21.15.38:0/2013460101 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f783804d550 0x7f783804fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:38.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.679+0000 7f78467fc700 1 -- 172.21.15.38:0/2013460101 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7848060c60 con 0x7f785813c4f0 2020-06-12T17:50:38.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.679+0000 7f785cd33700 1 --2- 172.21.15.38:0/2013460101 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f783804d550 0x7f783804fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:38.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.680+0000 7f785cd33700 1 --2- 172.21.15.38:0/2013460101 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f783804d550 0x7f783804fa10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f78540080e0 tx=0x7f7854007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.680+0000 7f785cd33700 1 --2- 172.21.15.38:0/2013460101 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f783804d550 0x7f783804fa10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f78540080e0 tx=0x7f7854007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.680+0000 7f785cd33700 1 --2- 172.21.15.38:0/2013460101 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f783804d550 0x7f783804fa10 secure :-1 s=READY pgs=277 cs=0 l=1 rx=0x7f78540080e0 tx=0x7f7854007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:38.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.682+0000 7f785d534700 1 --2- 172.21.15.38:0/2013460101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f785813c4f0 0x7f78580ae730 secure :-1 s=THROTTLE_DONE pgs=710 cs=0 l=1 rx=0x7f78480013e0 tx=0x7f784800e8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.682+0000 7f78467fc700 1 -- 172.21.15.38:0/2013460101 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f784803c440 con 0x7f785813c4f0 2020-06-12T17:50:38.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.878+0000 7f785f798700 1 -- 172.21.15.38:0/2013460101 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_5152", "target": ["mon-mgr", ""]}) v1 -- 0x7f7858153490 con 0x7f783804d550 2020-06-12T17:50:38.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.881+0000 7f785cd33700 1 --2- 172.21.15.38:0/2013460101 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f783804d550 0x7f783804fa10 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7f78540080e0 tx=0x7f7854007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:38.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.881+0000 7f78467fc700 1 -- 172.21.15.38:0/2013460101 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f7854007300 con 0x7f783804d550 2020-06-12T17:50:38.886 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_5152/ff5a9884-ae88-45c7-8121-65dfe9e46dc2 2020-06-12T17:50:38.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.882+0000 7f785f798700 1 -- 172.21.15.38:0/2013460101 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f783804d550 msgr2=0x7f783804fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:38.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.882+0000 7f785f798700 1 --2- 172.21.15.38:0/2013460101 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f783804d550 0x7f783804fa10 secure :-1 s=READY pgs=277 cs=0 l=1 rx=0x7f78540080e0 tx=0x7f7854007e60).stop 2020-06-12T17:50:38.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.882+0000 7f785f798700 1 -- 172.21.15.38:0/2013460101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f785813c4f0 msgr2=0x7f78580ae730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:38.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.883+0000 7f785f798700 1 --2- 172.21.15.38:0/2013460101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f785813c4f0 0x7f78580ae730 secure :-1 s=READY pgs=710 cs=0 l=1 rx=0x7f78480013e0 tx=0x7f784800e8d0).stop 2020-06-12T17:50:38.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.883+0000 7f785f798700 1 -- 172.21.15.38:0/2013460101 shutdown_connections 2020-06-12T17:50:38.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.883+0000 7f785f798700 1 --2- 172.21.15.38:0/2013460101 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f783804d550 0x7f783804fa10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:38.891 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.883+0000 7f785f798700 1 --2- 172.21.15.38:0/2013460101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78581433f0 0x7f7858143860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:38.891 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.883+0000 7f785f798700 1 --2- 172.21.15.38:0/2013460101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f785813c4f0 0x7f78580ae730 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:38.891 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.883+0000 7f785f798700 1 -- 172.21.15.38:0/2013460101 >> 172.21.15.38:0/2013460101 conn(0x7f78580b5a20 msgr2=0x7f78580b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:38.892 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.883+0000 7f785f798700 1 -- 172.21.15.38:0/2013460101 shutdown_connections 2020-06-12T17:50:38.892 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:38.883+0000 7f785f798700 1 -- 172.21.15.38:0/2013460101 wait complete. 2020-06-12T17:50:38.896 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_5152 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_5152/ff5a9884-ae88-45c7-8121-65dfe9e46dc2 2020-06-12T17:50:38.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:38.898 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:38.899 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:38.914 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:38.915 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:38.916 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5152/ff5a9884-ae88-45c7-8121-65dfe9e46dc2/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:39.009 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:39.010 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:39.011 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126828 s, 82.7 MB/s 2020-06-12T17:50:39.012 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:39.013 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:39.014 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:39.030 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:39.030 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:39.031 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5152/ff5a9884-ae88-45c7-8121-65dfe9e46dc2/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:39.117 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:39.118 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:39.118 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106485 s, 98.5 MB/s 2020-06-12T17:50:39.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:39.121 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:39.122 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:39.142 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:39.143 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:39.144 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5152/ff5a9884-ae88-45c7-8121-65dfe9e46dc2/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:39.230 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:39.231 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:39.231 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117431 s, 89.3 MB/s 2020-06-12T17:50:39.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:39.234 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:39.234 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:39.250 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:39.250 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:39.252 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5152/ff5a9884-ae88-45c7-8121-65dfe9e46dc2/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:39.338 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:39.338 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:39.339 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108262 s, 96.9 MB/s 2020-06-12T17:50:39.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:39.341 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:39.342 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:39.358 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:39.358 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:39.359 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5152/ff5a9884-ae88-45c7-8121-65dfe9e46dc2/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:39.454 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:39.454 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:39.455 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117738 s, 89.1 MB/s 2020-06-12T17:50:39.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:39.456 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:39.457 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:39.473 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:39.473 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:39.474 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5152/ff5a9884-ae88-45c7-8121-65dfe9e46dc2/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:39.561 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:39.562 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:39.562 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119741 s, 87.6 MB/s 2020-06-12T17:50:39.563 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:39.564 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:39.564 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:39.579 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:39.579 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:39.580 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5152/ff5a9884-ae88-45c7-8121-65dfe9e46dc2/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:39.668 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:39.669 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:39.669 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125296 s, 83.7 MB/s 2020-06-12T17:50:39.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:39.671 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:39.671 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:39.687 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:39.688 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:39.689 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5152/ff5a9884-ae88-45c7-8121-65dfe9e46dc2/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:39.779 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:39.779 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:39.780 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130992 s, 80.0 MB/s 2020-06-12T17:50:39.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:39.783 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:39.783 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:39.799 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:39.800 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:39.801 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5152/ff5a9884-ae88-45c7-8121-65dfe9e46dc2/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:39.885 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:39.886 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:39.887 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929347 s, 113 MB/s 2020-06-12T17:50:39.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:39.889 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:39.889 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:39.906 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:39.907 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:39.908 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5152/ff5a9884-ae88-45c7-8121-65dfe9e46dc2/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:40.009 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:40.009 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:40.010 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135985 s, 77.1 MB/s 2020-06-12T17:50:40.011 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_8031 2020-06-12T17:50:40.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.129+0000 7f1b0ffef700 1 Processor -- start 2020-06-12T17:50:40.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.130+0000 7f1b0ffef700 1 -- start start 2020-06-12T17:50:40.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.130+0000 7f1b0ffef700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b08062570 0x7f1b080980f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:40.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.130+0000 7f1b0ffef700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1b08149f20 0x7f1b08146380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:40.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.130+0000 7f1b0ffef700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b080b4c30 con 0x7f1b08061ec0 2020-06-12T17:50:40.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.130+0000 7f1b0ffef700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b08145f90 con 0x7f1b08149f20 2020-06-12T17:50:40.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.130+0000 7f1b0ffef700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b080b4ed0 con 0x7f1b08062570 2020-06-12T17:50:40.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.131+0000 7f1b0d58a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b08062570 0x7f1b080980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:40.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.131+0000 7f1b0e58c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1b08149f20 0x7f1b08146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:40.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.131+0000 7f1b0dd8b700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f1b08061ec0 0x7f1b081431b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:33290/0 (socket says 172.21.15.38:33290) 2020-06-12T17:50:40.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.131+0000 7f1b0dd8b700 1 -- 172.21.15.38:0/122056172 learned_addr learned my addr 172.21.15.38:0/122056172 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:40.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.131+0000 7f1b0d58a700 1 -- 172.21.15.38:0/122056172 >> v2:172.21.15.150:3300/0 conn(0x7f1b08149f20 msgr2=0x7f1b08146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:40.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.131+0000 7f1b0d58a700 1 --2- 172.21.15.38:0/122056172 >> v2:172.21.15.150:3300/0 conn(0x7f1b08149f20 0x7f1b08146380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:40.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.131+0000 7f1b0d58a700 1 -- 172.21.15.38:0/122056172 >> v1:172.21.15.150:6789/0 conn(0x7f1b08061ec0 legacy=0x7f1b081431b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:40.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.131+0000 7f1b0d58a700 1 -- 172.21.15.38:0/122056172 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b080622a0 con 0x7f1b08062570 2020-06-12T17:50:40.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.131+0000 7f1b0e58c700 1 --2- 172.21.15.38:0/122056172 >> v2:172.21.15.150:3300/0 conn(0x7f1b08149f20 0x7f1b08146380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:50:40.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.131+0000 7f1b0d58a700 1 --2- 172.21.15.38:0/122056172 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b08062570 0x7f1b080980f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1b040032b0 tx=0x7f1b040081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.131+0000 7f1b0d58a700 1 --2- 172.21.15.38:0/122056172 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b08062570 0x7f1b080980f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1b040032b0 tx=0x7f1b040081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.131+0000 7f1b0d58a700 1 --2- 172.21.15.38:0/122056172 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b08062570 0x7f1b080980f0 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f1b040032b0 tx=0x7f1b040081e0).ready entity=mon.2 client_cookie=32acc79b1016bb15 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:40.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.131+0000 7f1b0d58a700 1 --2- 172.21.15.38:0/122056172 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b08062570 0x7f1b080980f0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f1b040032b0 tx=0x7f1b040081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.131+0000 7f1b0cd89700 1 -- 172.21.15.38:0/122056172 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b04010d70 con 0x7f1b08062570 2020-06-12T17:50:40.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.131+0000 7f1b0d58a700 1 --2- 172.21.15.38:0/122056172 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b08062570 0x7f1b080980f0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f1b040032b0 tx=0x7f1b040081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.131+0000 7f1b0d58a700 1 --2- 172.21.15.38:0/122056172 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b08062570 0x7f1b080980f0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f1b040032b0 tx=0x7f1b040081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.131+0000 7f1b0cd89700 1 -- 172.21.15.38:0/122056172 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b040110c0 con 0x7f1b08062570 2020-06-12T17:50:40.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.131+0000 7f1b0cd89700 1 -- 172.21.15.38:0/122056172 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b040114e0 con 0x7f1b08062570 2020-06-12T17:50:40.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.131+0000 7f1b0ffef700 1 -- 172.21.15.38:0/122056172 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b08062570 msgr2=0x7f1b080980f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:40.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.131+0000 7f1b0ffef700 1 --2- 172.21.15.38:0/122056172 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b08062570 0x7f1b080980f0 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f1b040032b0 tx=0x7f1b040081e0).stop 2020-06-12T17:50:40.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.132+0000 7f1b0ffef700 1 -- 172.21.15.38:0/122056172 shutdown_connections 2020-06-12T17:50:40.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.132+0000 7f1b0ffef700 1 --2- 172.21.15.38:0/122056172 >> v2:172.21.15.150:3300/0 conn(0x7f1b08149f20 0x7f1b08146380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:40.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.132+0000 7f1b0ffef700 1 --2- 172.21.15.38:0/122056172 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b08062570 0x7f1b080980f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:40.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.132+0000 7f1b0ffef700 1 -- 172.21.15.38:0/122056172 >> 172.21.15.38:0/122056172 conn(0x7f1b080b8820 msgr2=0x7f1b080b8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:40.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.132+0000 7f1b0ffef700 1 -- 172.21.15.38:0/122056172 shutdown_connections 2020-06-12T17:50:40.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.132+0000 7f1b0ffef700 1 -- 172.21.15.38:0/122056172 wait complete. 2020-06-12T17:50:40.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.133+0000 7f1b0ffef700 1 Processor -- start 2020-06-12T17:50:40.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.133+0000 7f1b0ffef700 1 -- start start 2020-06-12T17:50:40.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1b0ffef700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b08062570 0x7f1b08142640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:40.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1b0ffef700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1b08149f20 0x7f1b0813aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:40.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1b0ffef700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b08149150 con 0x7f1b08061ec0 2020-06-12T17:50:40.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1b0ffef700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b08156620 con 0x7f1b08149f20 2020-06-12T17:50:40.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1b0ffef700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b08156820 con 0x7f1b08062570 2020-06-12T17:50:40.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1b0dd8b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f1b08061ec0 0x7f1b08155f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40796/0 (socket says 172.21.15.38:40796) 2020-06-12T17:50:40.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1b0dd8b700 1 -- 172.21.15.38:0/1366487788 learned_addr learned my addr 172.21.15.38:0/1366487788 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:40.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1b0d58a700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b08062570 0x7f1b08142640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:40.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1b0e58c700 1 --2- 172.21.15.38:0/1366487788 >> v2:172.21.15.150:3300/0 conn(0x7f1b08149f20 0x7f1b0813aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:40.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1afaffd700 1 -- 172.21.15.38:0/1366487788 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3861953920 0 0) 0x7f1b08149150 con 0x7f1b08061ec0 2020-06-12T17:50:40.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1afaffd700 1 -- 172.21.15.38:0/1366487788 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ae8002fe0 con 0x7f1b08061ec0 2020-06-12T17:50:40.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1afaffd700 1 -- 172.21.15.38:0/1366487788 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3135328362 0 0) 0x7f1ae8002fe0 con 0x7f1b08061ec0 2020-06-12T17:50:40.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1afaffd700 1 -- 172.21.15.38:0/1366487788 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1b08149150 con 0x7f1b08061ec0 2020-06-12T17:50:40.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1afaffd700 1 -- 172.21.15.38:0/1366487788 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f1afc001890 con 0x7f1b08061ec0 2020-06-12T17:50:40.156 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1afaffd700 1 -- 172.21.15.38:0/1366487788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b08062570 msgr2=0x7f1b08142640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:40.156 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1afaffd700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b08062570 0x7f1b08142640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:40.156 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1afaffd700 1 -- 172.21.15.38:0/1366487788 >> v2:172.21.15.150:3300/0 conn(0x7f1b08149f20 msgr2=0x7f1b0813aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:40.156 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1afaffd700 1 --2- 172.21.15.38:0/1366487788 >> v2:172.21.15.150:3300/0 conn(0x7f1b08149f20 0x7f1b0813aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:40.156 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1afaffd700 1 -- 172.21.15.38:0/1366487788 >> v1:172.21.15.38:6789/0 conn(0x7f1b08061ec0 legacy=0x7f1b08155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:40.157 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1afaffd700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ae80049b0 0x7f1ae8004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:40.157 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1afaffd700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ae80052a0 0x7f1ae8003980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:40.157 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1afaffd700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ae8003ef0 0x7f1ae8004370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:40.157 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1afaffd700 1 -- 172.21.15.38:0/1366487788 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b08156620 con 0x7f1ae80052a0 2020-06-12T17:50:40.157 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1afaffd700 1 -- 172.21.15.38:0/1366487788 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b08156820 con 0x7f1ae8003ef0 2020-06-12T17:50:40.158 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1afaffd700 1 -- 172.21.15.38:0/1366487788 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae800b8e0 con 0x7f1ae80049b0 2020-06-12T17:50:40.158 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1b0d58a700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ae80052a0 0x7f1ae8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:40.158 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.134+0000 7f1b0dd8b700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ae80049b0 0x7f1ae8004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:40.158 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.135+0000 7f1b0e58c700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ae8003ef0 0x7f1ae8004370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:40.158 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.135+0000 7f1b0d58a700 1 -- 172.21.15.38:0/1366487788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ae80049b0 msgr2=0x7f1ae8004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:40.158 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.135+0000 7f1b0d58a700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ae80049b0 0x7f1ae8004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:40.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.135+0000 7f1b0d58a700 1 -- 172.21.15.38:0/1366487788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ae8003ef0 msgr2=0x7f1ae8004370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:40.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.135+0000 7f1b0d58a700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ae8003ef0 0x7f1ae8004370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:40.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.135+0000 7f1b0d58a700 1 -- 172.21.15.38:0/1366487788 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b08148cb0 con 0x7f1ae80052a0 2020-06-12T17:50:40.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.135+0000 7f1b0ffef700 1 -- 172.21.15.38:0/1366487788 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b0813c580 con 0x7f1ae80052a0 2020-06-12T17:50:40.159 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.135+0000 7f1b0d58a700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ae80052a0 0x7f1ae8003980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1b040032b0 tx=0x7f1b040081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.160 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.135+0000 7f1b0ffef700 1 -- 172.21.15.38:0/1366487788 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b0813c2d0 con 0x7f1ae80052a0 2020-06-12T17:50:40.160 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.135+0000 7f1b0d58a700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ae80052a0 0x7f1ae8003980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1b040032b0 tx=0x7f1b040081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.160 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.135+0000 7f1b0d58a700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ae80052a0 0x7f1ae8003980 secure :-1 s=READY pgs=712 cs=0 l=1 rx=0x7f1b040032b0 tx=0x7f1b040081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:40.160 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.135+0000 7f1b0d58a700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ae80052a0 0x7f1ae8003980 secure :-1 s=THROTTLE_DONE pgs=712 cs=0 l=1 rx=0x7f1b040032b0 tx=0x7f1b040081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.160 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.135+0000 7f1afaffd700 1 -- 172.21.15.38:0/1366487788 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b04011e20 con 0x7f1ae80052a0 2020-06-12T17:50:40.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.135+0000 7f1b0d58a700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ae80052a0 0x7f1ae8003980 secure :-1 s=THROTTLE_DONE pgs=712 cs=0 l=1 rx=0x7f1b040032b0 tx=0x7f1b040081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.135+0000 7f1afaffd700 1 -- 172.21.15.38:0/1366487788 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b040140a0 con 0x7f1ae80052a0 2020-06-12T17:50:40.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.135+0000 7f1b0d58a700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ae80052a0 0x7f1ae8003980 secure :-1 s=THROTTLE_DONE pgs=712 cs=0 l=1 rx=0x7f1b040032b0 tx=0x7f1b040081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.135+0000 7f1afaffd700 1 -- 172.21.15.38:0/1366487788 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b04007c40 con 0x7f1ae80052a0 2020-06-12T17:50:40.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.136+0000 7f1b0d58a700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ae80052a0 0x7f1ae8003980 secure :-1 s=THROTTLE_DONE pgs=712 cs=0 l=1 rx=0x7f1b040032b0 tx=0x7f1b040081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.136+0000 7f1b0ffef700 1 -- 172.21.15.38:0/1366487788 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae4003340 con 0x7f1ae80052a0 2020-06-12T17:50:40.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.136+0000 7f1afaffd700 1 -- 172.21.15.38:0/1366487788 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f1b040083c0 con 0x7f1ae80052a0 2020-06-12T17:50:40.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.136+0000 7f1b0d58a700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ae80052a0 0x7f1ae8003980 secure :-1 s=THROTTLE_DONE pgs=712 cs=0 l=1 rx=0x7f1b040032b0 tx=0x7f1b040081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.136+0000 7f1afaffd700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1ae8055c00 0x7f1ae80580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:40.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.136+0000 7f1afaffd700 1 -- 172.21.15.38:0/1366487788 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1b0400f0c0 con 0x7f1ae80052a0 2020-06-12T17:50:40.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.137+0000 7f1b0dd8b700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1ae8055c00 0x7f1ae80580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:40.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.137+0000 7f1b0dd8b700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1ae8055c00 0x7f1ae80580c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1afc0015a0 tx=0x7f1afc00e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.137+0000 7f1b0dd8b700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1ae8055c00 0x7f1ae80580c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1afc0015a0 tx=0x7f1afc00e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.137+0000 7f1b0dd8b700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1ae8055c00 0x7f1ae80580c0 secure :-1 s=READY pgs=278 cs=0 l=1 rx=0x7f1afc0015a0 tx=0x7f1afc00e960).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:40.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.140+0000 7f1b0d58a700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ae80052a0 0x7f1ae8003980 secure :-1 s=THROTTLE_DONE pgs=712 cs=0 l=1 rx=0x7f1b040032b0 tx=0x7f1b040081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.140+0000 7f1afaffd700 1 -- 172.21.15.38:0/1366487788 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f1b0403ca90 con 0x7f1ae80052a0 2020-06-12T17:50:40.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.335+0000 7f1b0ffef700 1 -- 172.21.15.38:0/1366487788 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_8031", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ae4002200 con 0x7f1ae8055c00 2020-06-12T17:50:40.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.353+0000 7f1b0dd8b700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1ae8055c00 0x7f1ae80580c0 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f1afc0015a0 tx=0x7f1afc00e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.353+0000 7f1afaffd700 1 -- 172.21.15.38:0/1366487788 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1ae4002200 con 0x7f1ae8055c00 2020-06-12T17:50:40.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.355+0000 7f1b0ffef700 1 -- 172.21.15.38:0/1366487788 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1ae8055c00 msgr2=0x7f1ae80580c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:40.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.355+0000 7f1b0ffef700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1ae8055c00 0x7f1ae80580c0 secure :-1 s=READY pgs=278 cs=0 l=1 rx=0x7f1afc0015a0 tx=0x7f1afc00e960).stop 2020-06-12T17:50:40.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.355+0000 7f1b0ffef700 1 -- 172.21.15.38:0/1366487788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ae80052a0 msgr2=0x7f1ae8003980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:40.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.355+0000 7f1b0ffef700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ae80052a0 0x7f1ae8003980 secure :-1 s=READY pgs=712 cs=0 l=1 rx=0x7f1b040032b0 tx=0x7f1b040081e0).stop 2020-06-12T17:50:40.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.355+0000 7f1b0e58c700 1 -- 172.21.15.38:0/1366487788 reap_dead start 2020-06-12T17:50:40.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.355+0000 7f1b0ffef700 1 -- 172.21.15.38:0/1366487788 shutdown_connections 2020-06-12T17:50:40.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.355+0000 7f1b0ffef700 1 --2- 172.21.15.38:0/1366487788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ae80052a0 0x7f1ae8003980 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:40.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.355+0000 7f1b0ffef700 1 -- 172.21.15.38:0/1366487788 >> 172.21.15.38:0/1366487788 conn(0x7f1b080b8820 msgr2=0x7f1b080b6720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:40.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.355+0000 7f1b0ffef700 1 -- 172.21.15.38:0/1366487788 shutdown_connections 2020-06-12T17:50:40.360 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.355+0000 7f1b0ffef700 1 -- 172.21.15.38:0/1366487788 wait complete. 2020-06-12T17:50:40.368 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_8031 2020-06-12T17:50:40.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.483+0000 7f3783e47700 1 Processor -- start 2020-06-12T17:50:40.496 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.483+0000 7f3783e47700 1 -- start start 2020-06-12T17:50:40.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.484+0000 7f3783e47700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f377c065420 0x7f377c05b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:40.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.484+0000 7f3783e47700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f377c146510 0x7f377c149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:40.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.484+0000 7f3783e47700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377c05c8e0 con 0x7f377c146090 2020-06-12T17:50:40.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.484+0000 7f3783e47700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c149700 con 0x7f377c146510 2020-06-12T17:50:40.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.484+0000 7f3783e47700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377c05cb80 con 0x7f377c065420 2020-06-12T17:50:40.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.484+0000 7f37813e2700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f377c146090 0x7f377c0b7070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40812/0 (socket says 172.21.15.38:40812) 2020-06-12T17:50:40.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.484+0000 7f37813e2700 1 -- 172.21.15.38:0/2802693525 learned_addr learned my addr 172.21.15.38:0/2802693525 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:40.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f3780be1700 1 -- 172.21.15.38:0/2802693525 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202535798 0 0) 0x7f377c05c8e0 con 0x7f377c146090 2020-06-12T17:50:40.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f37823e4700 1 --2- 172.21.15.38:0/2802693525 >> v2:172.21.15.150:3300/0 conn(0x7f377c146510 0x7f377c149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:40.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f3781be3700 1 --2- 172.21.15.38:0/2802693525 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f377c065420 0x7f377c05b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:40.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f3780be1700 1 -- 172.21.15.38:0/2802693525 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3764003230 con 0x7f377c146090 2020-06-12T17:50:40.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f3780be1700 1 -- 172.21.15.38:0/2802693525 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1969264393 0 0) 0x7f3764003230 con 0x7f377c146090 2020-06-12T17:50:40.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f3780be1700 1 -- 172.21.15.38:0/2802693525 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f377c065420 msgr2=0x7f377c05b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:40.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f3780be1700 1 --2- 172.21.15.38:0/2802693525 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f377c065420 0x7f377c05b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:40.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f3780be1700 1 -- 172.21.15.38:0/2802693525 >> v2:172.21.15.150:3300/0 conn(0x7f377c146510 msgr2=0x7f377c149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:40.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f3780be1700 1 --2- 172.21.15.38:0/2802693525 >> v2:172.21.15.150:3300/0 conn(0x7f377c146510 0x7f377c149ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:40.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f3780be1700 1 -- 172.21.15.38:0/2802693525 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c0b7780 con 0x7f377c146090 2020-06-12T17:50:40.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f3780be1700 1 -- 172.21.15.38:0/2802693525 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f3778001a50 con 0x7f377c146090 2020-06-12T17:50:40.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f3780be1700 1 -- 172.21.15.38:0/2802693525 >> v1:172.21.15.38:6789/0 conn(0x7f377c146090 legacy=0x7f377c0b7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:40.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f3780be1700 1 --2- 172.21.15.38:0/2802693525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3764003720 0x7f3764003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:40.502 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f3780be1700 1 --2- 172.21.15.38:0/2802693525 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f377c065420 0x7f37640044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:40.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f3780be1700 1 --2- 172.21.15.38:0/2802693525 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3764004930 0x7f3764004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:40.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f3780be1700 1 -- 172.21.15.38:0/2802693525 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c149700 con 0x7f3764003720 2020-06-12T17:50:40.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f3780be1700 1 -- 172.21.15.38:0/2802693525 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c05cb80 con 0x7f3764004930 2020-06-12T17:50:40.513 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f3780be1700 1 -- 172.21.15.38:0/2802693525 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3764005380 con 0x7f377c065420 2020-06-12T17:50:40.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f3781be3700 1 --2- 172.21.15.38:0/2802693525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3764003720 0x7f3764003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:40.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f37813e2700 1 --2- 172.21.15.38:0/2802693525 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f377c065420 0x7f37640044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:40.514 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f37823e4700 1 --2- 172.21.15.38:0/2802693525 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3764004930 0x7f3764004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:40.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f3781be3700 1 -- 172.21.15.38:0/2802693525 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f377c065420 msgr2=0x7f37640044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:40.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f3781be3700 1 --2- 172.21.15.38:0/2802693525 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f377c065420 0x7f37640044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:40.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f3781be3700 1 -- 172.21.15.38:0/2802693525 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3764004930 msgr2=0x7f3764004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:40.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f3781be3700 1 --2- 172.21.15.38:0/2802693525 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3764004930 0x7f3764004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:40.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f3781be3700 1 -- 172.21.15.38:0/2802693525 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3764003230 con 0x7f3764003720 2020-06-12T17:50:40.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f37813e2700 1 --2- 172.21.15.38:0/2802693525 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f377c065420 0x7f37640044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:50:40.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.485+0000 7f3781be3700 1 --2- 172.21.15.38:0/2802693525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3764003720 0x7f3764003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f376c002f30 tx=0x7f376c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.486+0000 7f3781be3700 1 --2- 172.21.15.38:0/2802693525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3764003720 0x7f3764003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f376c002f30 tx=0x7f376c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.486+0000 7f3781be3700 1 --2- 172.21.15.38:0/2802693525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3764003720 0x7f3764003b40 secure :-1 s=READY pgs=714 cs=0 l=1 rx=0x7f376c002f30 tx=0x7f376c007e60).ready entity=mon.0 client_cookie=ecb61c1d9d0d8e8 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:40.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.486+0000 7f3781be3700 1 --2- 172.21.15.38:0/2802693525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3764003720 0x7f3764003b40 secure :-1 s=THROTTLE_DONE pgs=714 cs=0 l=1 rx=0x7f376c002f30 tx=0x7f376c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.486+0000 7f3780be1700 1 -- 172.21.15.38:0/2802693525 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f376c008d30 con 0x7f3764003720 2020-06-12T17:50:40.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.486+0000 7f3781be3700 1 --2- 172.21.15.38:0/2802693525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3764003720 0x7f3764003b40 secure :-1 s=THROTTLE_DONE pgs=714 cs=0 l=1 rx=0x7f376c002f30 tx=0x7f376c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.486+0000 7f3781be3700 1 --2- 172.21.15.38:0/2802693525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3764003720 0x7f3764003b40 secure :-1 s=THROTTLE_DONE pgs=714 cs=0 l=1 rx=0x7f376c002f30 tx=0x7f376c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.486+0000 7f3780be1700 1 -- 172.21.15.38:0/2802693525 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376c008e90 con 0x7f3764003720 2020-06-12T17:50:40.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.486+0000 7f3780be1700 1 -- 172.21.15.38:0/2802693525 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f376c010ae0 con 0x7f3764003720 2020-06-12T17:50:40.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.486+0000 7f3783e47700 1 -- 172.21.15.38:0/2802693525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3764003720 msgr2=0x7f3764003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:40.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.486+0000 7f3783e47700 1 --2- 172.21.15.38:0/2802693525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3764003720 0x7f3764003b40 secure :-1 s=READY pgs=714 cs=0 l=1 rx=0x7f376c002f30 tx=0x7f376c007e60).stop 2020-06-12T17:50:40.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.486+0000 7f37823e4700 1 -- 172.21.15.38:0/2802693525 reap_dead start 2020-06-12T17:50:40.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.486+0000 7f3783e47700 1 -- 172.21.15.38:0/2802693525 shutdown_connections 2020-06-12T17:50:40.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.486+0000 7f3783e47700 1 -- 172.21.15.38:0/2802693525 >> 172.21.15.38:0/2802693525 conn(0x7f377c0ba610 msgr2=0x7f377c0baa20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:40.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.486+0000 7f3783e47700 1 -- 172.21.15.38:0/2802693525 shutdown_connections 2020-06-12T17:50:40.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.486+0000 7f3783e47700 1 -- 172.21.15.38:0/2802693525 wait complete. 2020-06-12T17:50:40.531 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.487+0000 7f3783e47700 1 Processor -- start 2020-06-12T17:50:40.532 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.487+0000 7f3783e47700 1 -- start start 2020-06-12T17:50:40.532 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.488+0000 7f3783e47700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f377c149110 0x7f377c060b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:40.532 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.488+0000 7f3783e47700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f377c05fd90 0x7f377c153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:40.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.488+0000 7f3783e47700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377c060230 con 0x7f377c141400 2020-06-12T17:50:40.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.488+0000 7f3783e47700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c156c70 con 0x7f377c05fd90 2020-06-12T17:50:40.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.488+0000 7f3783e47700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0b6130 con 0x7f377c149110 2020-06-12T17:50:40.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.488+0000 7f3781be3700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f377c141400 0x7f377c0b5a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40822/0 (socket says 172.21.15.38:40822) 2020-06-12T17:50:40.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.488+0000 7f3781be3700 1 -- 172.21.15.38:0/3660906540 learned_addr learned my addr 172.21.15.38:0/3660906540 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:40.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.488+0000 7f37823e4700 1 --2- 172.21.15.38:0/3660906540 >> v2:172.21.15.150:3300/0 conn(0x7f377c05fd90 0x7f377c153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:40.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.488+0000 7f37813e2700 1 --2- 172.21.15.38:0/3660906540 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f377c149110 0x7f377c060b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:40.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.488+0000 7f376affd700 1 -- 172.21.15.38:0/3660906540 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3175040997 0 0) 0x7f377c060230 con 0x7f377c141400 2020-06-12T17:50:40.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.488+0000 7f376affd700 1 -- 172.21.15.38:0/3660906540 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f375c002fe0 con 0x7f377c141400 2020-06-12T17:50:40.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.489+0000 7f376affd700 1 -- 172.21.15.38:0/3660906540 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3773839251 0 0) 0x7f375c002fe0 con 0x7f377c141400 2020-06-12T17:50:40.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.489+0000 7f376affd700 1 -- 172.21.15.38:0/3660906540 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f377c060230 con 0x7f377c141400 2020-06-12T17:50:40.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.489+0000 7f376affd700 1 -- 172.21.15.38:0/3660906540 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f376c0077f0 con 0x7f377c141400 2020-06-12T17:50:40.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.489+0000 7f37823e4700 1 -- 172.21.15.38:0/3660906540 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f377c149110 msgr2=0x7f377c060b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:40.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.489+0000 7f37823e4700 1 --2- 172.21.15.38:0/3660906540 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f377c149110 0x7f377c060b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:40.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.489+0000 7f37823e4700 1 -- 172.21.15.38:0/3660906540 >> v1:172.21.15.38:6789/0 conn(0x7f377c141400 legacy=0x7f377c0b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:40.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.489+0000 7f37823e4700 1 -- 172.21.15.38:0/3660906540 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c1417e0 con 0x7f377c05fd90 2020-06-12T17:50:40.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.489+0000 7f37823e4700 1 --2- 172.21.15.38:0/3660906540 >> v2:172.21.15.150:3300/0 conn(0x7f377c05fd90 0x7f377c153520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3778001cb0 tx=0x7f3774007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.489+0000 7f37823e4700 1 --2- 172.21.15.38:0/3660906540 >> v2:172.21.15.150:3300/0 conn(0x7f377c05fd90 0x7f377c153520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3778001cb0 tx=0x7f3774007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.489+0000 7f37823e4700 1 --2- 172.21.15.38:0/3660906540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f377c05fd90 0x7f377c153520 secure :-1 s=READY pgs=403 cs=0 l=1 rx=0x7f3778001cb0 tx=0x7f3774007e60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:40.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.489+0000 7f37823e4700 1 --2- 172.21.15.38:0/3660906540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f377c05fd90 0x7f377c153520 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7f3778001cb0 tx=0x7f3774007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.489+0000 7f376affd700 1 -- 172.21.15.38:0/3660906540 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3774007540 con 0x7f377c05fd90 2020-06-12T17:50:40.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.489+0000 7f37823e4700 1 --2- 172.21.15.38:0/3660906540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f377c05fd90 0x7f377c153520 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7f3778001cb0 tx=0x7f3774007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.489+0000 7f37823e4700 1 --2- 172.21.15.38:0/3660906540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f377c05fd90 0x7f377c153520 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7f3778001cb0 tx=0x7f3774007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.545 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.489+0000 7f376affd700 1 -- 172.21.15.38:0/3660906540 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37740056c0 con 0x7f377c05fd90 2020-06-12T17:50:40.546 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.489+0000 7f3783e47700 1 -- 172.21.15.38:0/3660906540 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377c153980 con 0x7f377c05fd90 2020-06-12T17:50:40.546 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.489+0000 7f376affd700 1 -- 172.21.15.38:0/3660906540 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3774005a20 con 0x7f377c05fd90 2020-06-12T17:50:40.546 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.489+0000 7f3783e47700 1 -- 172.21.15.38:0/3660906540 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377c15d140 con 0x7f377c05fd90 2020-06-12T17:50:40.546 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.490+0000 7f37823e4700 1 --2- 172.21.15.38:0/3660906540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f377c05fd90 0x7f377c153520 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7f3778001cb0 tx=0x7f3774007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.546 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.490+0000 7f3783e47700 1 -- 172.21.15.38:0/3660906540 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f377c056c30 con 0x7f377c05fd90 2020-06-12T17:50:40.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.490+0000 7f376affd700 1 -- 172.21.15.38:0/3660906540 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f3774005b80 con 0x7f377c05fd90 2020-06-12T17:50:40.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.490+0000 7f37823e4700 1 --2- 172.21.15.38:0/3660906540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f377c05fd90 0x7f377c153520 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7f3778001cb0 tx=0x7f3774007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.491+0000 7f376affd700 1 --2- 172.21.15.38:0/3660906540 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f375c04daf0 0x7f375c04ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:40.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.491+0000 7f376affd700 1 -- 172.21.15.38:0/3660906540 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f37740603d0 con 0x7f377c05fd90 2020-06-12T17:50:40.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.491+0000 7f3781be3700 1 --2- 172.21.15.38:0/3660906540 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f375c04daf0 0x7f375c04ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:40.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.491+0000 7f3781be3700 1 --2- 172.21.15.38:0/3660906540 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f375c04daf0 0x7f375c04ffb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f376c0085e0 tx=0x7f376c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.491+0000 7f3781be3700 1 --2- 172.21.15.38:0/3660906540 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f375c04daf0 0x7f375c04ffb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f376c0085e0 tx=0x7f376c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.491+0000 7f3781be3700 1 --2- 172.21.15.38:0/3660906540 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f375c04daf0 0x7f375c04ffb0 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7f376c0085e0 tx=0x7f376c007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:40.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.494+0000 7f37823e4700 1 --2- 172.21.15.38:0/3660906540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f377c05fd90 0x7f377c153520 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7f3778001cb0 tx=0x7f3774007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.549 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.494+0000 7f376affd700 1 -- 172.21.15.38:0/3660906540 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f377403bb90 con 0x7f377c05fd90 2020-06-12T17:50:40.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.692+0000 7f3783e47700 1 -- 172.21.15.38:0/3660906540 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_8031", "target": ["mon-mgr", ""]}) v1 -- 0x7f377c060430 con 0x7f375c04daf0 2020-06-12T17:50:40.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.695+0000 7f3781be3700 1 --2- 172.21.15.38:0/3660906540 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f375c04daf0 0x7f375c04ffb0 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f376c0085e0 tx=0x7f376c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:40.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.695+0000 7f376affd700 1 -- 172.21.15.38:0/3660906540 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f376c007160 con 0x7f375c04daf0 2020-06-12T17:50:40.700 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_8031/c5c906f2-e1b8-4434-84a8-87706dbeb785 2020-06-12T17:50:40.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.697+0000 7f3783e47700 1 -- 172.21.15.38:0/3660906540 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f375c04daf0 msgr2=0x7f375c04ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:40.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.697+0000 7f3783e47700 1 --2- 172.21.15.38:0/3660906540 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f375c04daf0 0x7f375c04ffb0 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7f376c0085e0 tx=0x7f376c007e60).stop 2020-06-12T17:50:40.708 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.697+0000 7f3783e47700 1 -- 172.21.15.38:0/3660906540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f377c05fd90 msgr2=0x7f377c153520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:40.708 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.697+0000 7f3783e47700 1 --2- 172.21.15.38:0/3660906540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f377c05fd90 0x7f377c153520 secure :-1 s=READY pgs=403 cs=0 l=1 rx=0x7f3778001cb0 tx=0x7f3774007e60).stop 2020-06-12T17:50:40.708 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.697+0000 7f3783e47700 1 -- 172.21.15.38:0/3660906540 shutdown_connections 2020-06-12T17:50:40.708 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.697+0000 7f3783e47700 1 --2- 172.21.15.38:0/3660906540 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f375c04daf0 0x7f375c04ffb0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:40.708 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.697+0000 7f3783e47700 1 --2- 172.21.15.38:0/3660906540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f377c05fd90 0x7f377c153520 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:40.709 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.697+0000 7f3783e47700 1 --2- 172.21.15.38:0/3660906540 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f377c149110 0x7f377c060b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:40.709 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.697+0000 7f3783e47700 1 -- 172.21.15.38:0/3660906540 >> 172.21.15.38:0/3660906540 conn(0x7f377c0ba610 msgr2=0x7f377c065800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:40.709 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.697+0000 7f3783e47700 1 -- 172.21.15.38:0/3660906540 shutdown_connections 2020-06-12T17:50:40.709 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:40.697+0000 7f3783e47700 1 -- 172.21.15.38:0/3660906540 wait complete. 2020-06-12T17:50:40.710 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_8031 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_8031/c5c906f2-e1b8-4434-84a8-87706dbeb785 2020-06-12T17:50:40.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:40.711 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:40.712 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:40.729 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:40.730 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:40.730 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8031/c5c906f2-e1b8-4434-84a8-87706dbeb785/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:40.821 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:40.821 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:40.822 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111966 s, 93.7 MB/s 2020-06-12T17:50:40.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:40.823 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:40.824 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:40.842 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:40.843 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:40.844 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8031/c5c906f2-e1b8-4434-84a8-87706dbeb785/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:40.931 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:40.932 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:40.932 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109406 s, 95.8 MB/s 2020-06-12T17:50:40.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:40.933 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:40.934 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:40.950 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:40.951 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:40.952 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8031/c5c906f2-e1b8-4434-84a8-87706dbeb785/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:41.041 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:41.042 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:41.042 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110457 s, 94.9 MB/s 2020-06-12T17:50:41.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:41.044 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:41.044 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:41.061 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:41.065 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:41.065 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8031/c5c906f2-e1b8-4434-84a8-87706dbeb785/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:41.148 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:41.149 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:41.149 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104654 s, 100 MB/s 2020-06-12T17:50:41.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:41.160 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:41.161 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:41.176 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:41.177 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:41.178 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8031/c5c906f2-e1b8-4434-84a8-87706dbeb785/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:41.265 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:41.265 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:41.265 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110699 s, 94.7 MB/s 2020-06-12T17:50:41.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:41.267 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:41.267 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:41.286 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:41.287 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:41.287 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8031/c5c906f2-e1b8-4434-84a8-87706dbeb785/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:41.376 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:41.376 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:41.377 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118255 s, 88.7 MB/s 2020-06-12T17:50:41.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:41.378 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:41.379 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:41.394 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:41.395 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:41.395 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8031/c5c906f2-e1b8-4434-84a8-87706dbeb785/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:41.487 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:41.487 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143482 s, 73.1 MB/s 2020-06-12T17:50:41.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:41.488 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:41.489 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:41.505 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:41.505 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:41.506 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8031/c5c906f2-e1b8-4434-84a8-87706dbeb785/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:41.595 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:41.596 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:41.596 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126283 s, 83.0 MB/s 2020-06-12T17:50:41.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:41.598 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:41.598 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:41.613 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:41.614 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:41.615 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8031/c5c906f2-e1b8-4434-84a8-87706dbeb785/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:41.699 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:41.699 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:41.699 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00878929 s, 119 MB/s 2020-06-12T17:50:41.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:41.701 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:41.701 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:41.757 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:41.758 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:41.758 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_8031/c5c906f2-e1b8-4434-84a8-87706dbeb785/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:41.844 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:41.845 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:41.845 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100558 s, 104 MB/s 2020-06-12T17:50:41.846 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_6221 2020-06-12T17:50:41.963 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.959+0000 7f301fe7d700 1 Processor -- start 2020-06-12T17:50:41.963 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.959+0000 7f301fe7d700 1 -- start start 2020-06-12T17:50:41.971 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.960+0000 7f301fe7d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30180ad5b0 0x7f30180b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:41.971 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.960+0000 7f301fe7d700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3018146d20 con 0x7f301809d8d0 2020-06-12T17:50:41.971 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.960+0000 7f301fe7d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3018066a80 con 0x7f3018146680 2020-06-12T17:50:41.971 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.960+0000 7f301fe7d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3018146f50 con 0x7f30180ad5b0 2020-06-12T17:50:41.972 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.960+0000 7f301e41a700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f301809d8d0 0x7f30181421d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40830/0 (socket says 172.21.15.38:40830) 2020-06-12T17:50:41.972 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.960+0000 7f301e41a700 1 -- 172.21.15.38:0/249682455 learned_addr learned my addr 172.21.15.38:0/249682455 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:41.972 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.961+0000 7f301cc17700 1 -- 172.21.15.38:0/249682455 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900347154 0 0) 0x7f3018146d20 con 0x7f301809d8d0 2020-06-12T17:50:41.972 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.961+0000 7f301d418700 1 --2- 172.21.15.38:0/249682455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30180ad5b0 0x7f30180b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:41.972 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.961+0000 7f301cc17700 1 -- 172.21.15.38:0/249682455 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3000003230 con 0x7f301809d8d0 2020-06-12T17:50:41.973 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.961+0000 7f301cc17700 1 -- 172.21.15.38:0/249682455 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1979531439 0 0) 0x7f3000003230 con 0x7f301809d8d0 2020-06-12T17:50:41.973 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.961+0000 7f301cc17700 1 -- 172.21.15.38:0/249682455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30180ad5b0 msgr2=0x7f30180b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:41.973 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.961+0000 7f301cc17700 1 --2- 172.21.15.38:0/249682455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30180ad5b0 0x7f30180b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:41.973 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.961+0000 7f301cc17700 1 -- 172.21.15.38:0/249682455 >> v1:172.21.15.150:6789/0 conn(0x7f3018146680 legacy=0x7f301809d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:41.973 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.961+0000 7f301cc17700 1 -- 172.21.15.38:0/249682455 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3018146a60 con 0x7f301809d8d0 2020-06-12T17:50:41.974 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.961+0000 7f301cc17700 1 -- 172.21.15.38:0/249682455 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f3010001a50 con 0x7f301809d8d0 2020-06-12T17:50:41.974 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.961+0000 7f301cc17700 1 -- 172.21.15.38:0/249682455 >> v1:172.21.15.38:6789/0 conn(0x7f301809d8d0 legacy=0x7f30181421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:41.974 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.961+0000 7f301cc17700 1 --2- 172.21.15.38:0/249682455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3000003750 0x7f3000003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:41.974 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.961+0000 7f301cc17700 1 --2- 172.21.15.38:0/249682455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3000004090 0x7f3000004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:41.974 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.961+0000 7f301cc17700 1 --2- 172.21.15.38:0/249682455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30180ad5b0 0x7f3000004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:41.975 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.961+0000 7f301cc17700 1 -- 172.21.15.38:0/249682455 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3018146f50 con 0x7f3000004090 2020-06-12T17:50:41.975 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.961+0000 7f301cc17700 1 -- 172.21.15.38:0/249682455 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3000004fb0 con 0x7f3000003750 2020-06-12T17:50:41.975 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.961+0000 7f301cc17700 1 -- 172.21.15.38:0/249682455 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3000005170 con 0x7f30180ad5b0 2020-06-12T17:50:41.975 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.961+0000 7f301d418700 1 --2- 172.21.15.38:0/249682455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3000004090 0x7f3000004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:41.975 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.961+0000 7f301dc19700 1 --2- 172.21.15.38:0/249682455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3000003750 0x7f3000003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:41.976 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.961+0000 7f301e41a700 1 --2- 172.21.15.38:0/249682455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30180ad5b0 0x7f3000004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:41.976 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.961+0000 7f301d418700 1 -- 172.21.15.38:0/249682455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30180ad5b0 msgr2=0x7f3000004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:41.976 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.961+0000 7f301d418700 1 --2- 172.21.15.38:0/249682455 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30180ad5b0 0x7f3000004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:41.976 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.961+0000 7f301d418700 1 -- 172.21.15.38:0/249682455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3000003750 msgr2=0x7f3000003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:41.976 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.961+0000 7f301d418700 1 --2- 172.21.15.38:0/249682455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3000003750 0x7f3000003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:41.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.961+0000 7f301d418700 1 -- 172.21.15.38:0/249682455 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3000003230 con 0x7f3000004090 2020-06-12T17:50:41.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.961+0000 7f301d418700 1 --2- 172.21.15.38:0/249682455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3000004090 0x7f3000004570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3014008910 tx=0x7f3014007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:41.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.961+0000 7f301d418700 1 --2- 172.21.15.38:0/249682455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3000004090 0x7f3000004570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3014008910 tx=0x7f3014007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:41.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.962+0000 7f301d418700 1 --2- 172.21.15.38:0/249682455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3000004090 0x7f3000004570 secure :-1 s=READY pgs=717 cs=0 l=1 rx=0x7f3014008910 tx=0x7f3014007e60).ready entity=mon.0 client_cookie=3fb032f49302de73 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:41.977 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.962+0000 7f301d418700 1 --2- 172.21.15.38:0/249682455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3000004090 0x7f3000004570 secure :-1 s=THROTTLE_DONE pgs=717 cs=0 l=1 rx=0x7f3014008910 tx=0x7f3014007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:41.978 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.962+0000 7f301cc17700 1 -- 172.21.15.38:0/249682455 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3014008d30 con 0x7f3000004090 2020-06-12T17:50:41.978 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.962+0000 7f301d418700 1 --2- 172.21.15.38:0/249682455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3000004090 0x7f3000004570 secure :-1 s=THROTTLE_DONE pgs=717 cs=0 l=1 rx=0x7f3014008910 tx=0x7f3014007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:41.978 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.962+0000 7f301d418700 1 --2- 172.21.15.38:0/249682455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3000004090 0x7f3000004570 secure :-1 s=THROTTLE_DONE pgs=717 cs=0 l=1 rx=0x7f3014008910 tx=0x7f3014007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:41.978 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.962+0000 7f301cc17700 1 -- 172.21.15.38:0/249682455 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3014008e90 con 0x7f3000004090 2020-06-12T17:50:41.979 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.962+0000 7f301cc17700 1 -- 172.21.15.38:0/249682455 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3014010a20 con 0x7f3000004090 2020-06-12T17:50:41.979 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.962+0000 7f301fe7d700 1 -- 172.21.15.38:0/249682455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3000004090 msgr2=0x7f3000004570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:41.980 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.962+0000 7f301fe7d700 1 --2- 172.21.15.38:0/249682455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3000004090 0x7f3000004570 secure :-1 s=READY pgs=717 cs=0 l=1 rx=0x7f3014008910 tx=0x7f3014007e60).stop 2020-06-12T17:50:41.980 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.962+0000 7f301e41a700 1 -- 172.21.15.38:0/249682455 reap_dead start 2020-06-12T17:50:41.980 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.962+0000 7f301fe7d700 1 -- 172.21.15.38:0/249682455 shutdown_connections 2020-06-12T17:50:41.981 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.962+0000 7f301fe7d700 1 -- 172.21.15.38:0/249682455 >> 172.21.15.38:0/249682455 conn(0x7f30180b5a20 msgr2=0x7f301805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:41.981 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.962+0000 7f301fe7d700 1 -- 172.21.15.38:0/249682455 shutdown_connections 2020-06-12T17:50:41.981 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.962+0000 7f301fe7d700 1 -- 172.21.15.38:0/249682455 wait complete. 2020-06-12T17:50:41.981 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.963+0000 7f301fe7d700 1 Processor -- start 2020-06-12T17:50:41.981 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.963+0000 7f301fe7d700 1 -- start start 2020-06-12T17:50:41.982 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.964+0000 7f301fe7d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f30180b3ac0 0x7f30180634d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:41.982 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.964+0000 7f301fe7d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3018155390 0x7f301813e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:41.982 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.964+0000 7f301fe7d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f301813e5f0 0x7f30180b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:41.982 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.964+0000 7f301fe7d700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3018155820 con 0x7f30180b3ac0 2020-06-12T17:50:41.982 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.964+0000 7f301fe7d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f301813ea40 con 0x7f3018155390 2020-06-12T17:50:41.983 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.964+0000 7f301fe7d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3018062af0 con 0x7f301813e5f0 2020-06-12T17:50:41.983 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.964+0000 7f301dc19700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f30180b3ac0 0x7f30180634d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:41.983 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.964+0000 7f301dc19700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f30180b3ac0 0x7f30180634d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39028/0 (socket says 172.21.15.38:39028) 2020-06-12T17:50:41.983 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.964+0000 7f301dc19700 1 -- 172.21.15.38:0/2268331124 learned_addr learned my addr 172.21.15.38:0/2268331124 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:41.983 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.964+0000 7f301e41a700 1 --2- 172.21.15.38:0/2268331124 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f301813e5f0 0x7f30180b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:41.984 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.964+0000 7f301d418700 1 --2- 172.21.15.38:0/2268331124 >> v2:172.21.15.150:3300/0 conn(0x7f3018155390 0x7f301813e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:41.984 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.964+0000 7f301dc19700 1 -- 172.21.15.38:0/2268331124 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f301813e5f0 msgr2=0x7f30180b03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:41.984 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.964+0000 7f301dc19700 1 --2- 172.21.15.38:0/2268331124 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f301813e5f0 0x7f30180b03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:41.984 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.964+0000 7f301dc19700 1 -- 172.21.15.38:0/2268331124 >> v2:172.21.15.150:3300/0 conn(0x7f3018155390 msgr2=0x7f301813e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:41.985 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.964+0000 7f301dc19700 1 --2- 172.21.15.38:0/2268331124 >> v2:172.21.15.150:3300/0 conn(0x7f3018155390 0x7f301813e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:41.985 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.964+0000 7f301dc19700 1 -- 172.21.15.38:0/2268331124 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3018062d90 con 0x7f30180b3ac0 2020-06-12T17:50:41.985 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.964+0000 7f301dc19700 1 --2- 172.21.15.38:0/2268331124 >> v2:172.21.15.38:3300/0 conn(0x7f30180b3ac0 0x7f30180634d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3018155960 tx=0x7f300c001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:41.985 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.964+0000 7f301dc19700 1 --2- 172.21.15.38:0/2268331124 >> v2:172.21.15.38:3300/0 conn(0x7f30180b3ac0 0x7f30180634d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3018155960 tx=0x7f300c001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:41.985 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.964+0000 7f301dc19700 1 --2- 172.21.15.38:0/2268331124 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30180b3ac0 0x7f30180634d0 secure :-1 s=READY pgs=718 cs=0 l=1 rx=0x7f3018155960 tx=0x7f300c001840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:41.985 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.964+0000 7f301dc19700 1 --2- 172.21.15.38:0/2268331124 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30180b3ac0 0x7f30180634d0 secure :-1 s=THROTTLE_DONE pgs=718 cs=0 l=1 rx=0x7f3018155960 tx=0x7f300c001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:41.986 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.965+0000 7f300affd700 1 -- 172.21.15.38:0/2268331124 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f300c001e60 con 0x7f30180b3ac0 2020-06-12T17:50:41.986 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.965+0000 7f301dc19700 1 --2- 172.21.15.38:0/2268331124 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30180b3ac0 0x7f30180634d0 secure :-1 s=THROTTLE_DONE pgs=718 cs=0 l=1 rx=0x7f3018155960 tx=0x7f300c001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:41.986 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.965+0000 7f301dc19700 1 --2- 172.21.15.38:0/2268331124 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30180b3ac0 0x7f30180634d0 secure :-1 s=THROTTLE_DONE pgs=718 cs=0 l=1 rx=0x7f3018155960 tx=0x7f300c001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:41.986 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.965+0000 7f300affd700 1 -- 172.21.15.38:0/2268331124 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300c00c810 con 0x7f30180b3ac0 2020-06-12T17:50:41.986 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.965+0000 7f301fe7d700 1 -- 172.21.15.38:0/2268331124 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3018063030 con 0x7f30180b3ac0 2020-06-12T17:50:41.987 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.965+0000 7f300affd700 1 -- 172.21.15.38:0/2268331124 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f300c00cbb0 con 0x7f30180b3ac0 2020-06-12T17:50:41.987 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.965+0000 7f301fe7d700 1 -- 172.21.15.38:0/2268331124 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3018062700 con 0x7f30180b3ac0 2020-06-12T17:50:41.987 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.965+0000 7f301dc19700 1 --2- 172.21.15.38:0/2268331124 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30180b3ac0 0x7f30180634d0 secure :-1 s=THROTTLE_DONE pgs=718 cs=0 l=1 rx=0x7f3018155960 tx=0x7f300c001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:41.989 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.966+0000 7f301fe7d700 1 -- 172.21.15.38:0/2268331124 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30180b27b0 con 0x7f30180b3ac0 2020-06-12T17:50:41.989 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.966+0000 7f300affd700 1 -- 172.21.15.38:0/2268331124 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f300c0064e0 con 0x7f30180b3ac0 2020-06-12T17:50:41.989 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.966+0000 7f301dc19700 1 --2- 172.21.15.38:0/2268331124 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30180b3ac0 0x7f30180634d0 secure :-1 s=THROTTLE_DONE pgs=718 cs=0 l=1 rx=0x7f3018155960 tx=0x7f300c001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:41.989 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.966+0000 7f300affd700 1 --2- 172.21.15.38:0/2268331124 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2ff804d5e0 0x7f2ff804faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:41.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.966+0000 7f300affd700 1 -- 172.21.15.38:0/2268331124 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f300c060b20 con 0x7f30180b3ac0 2020-06-12T17:50:41.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.966+0000 7f301d418700 1 --2- 172.21.15.38:0/2268331124 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2ff804d5e0 0x7f2ff804faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:41.991 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.966+0000 7f301d418700 1 --2- 172.21.15.38:0/2268331124 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2ff804d5e0 0x7f2ff804faa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3014008910 tx=0x7f3014007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:41.992 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.966+0000 7f301d418700 1 --2- 172.21.15.38:0/2268331124 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2ff804d5e0 0x7f2ff804faa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3014008910 tx=0x7f3014007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:41.992 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.966+0000 7f301d418700 1 --2- 172.21.15.38:0/2268331124 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2ff804d5e0 0x7f2ff804faa0 secure :-1 s=READY pgs=280 cs=0 l=1 rx=0x7f3014008910 tx=0x7f3014007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:41.992 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.969+0000 7f301dc19700 1 --2- 172.21.15.38:0/2268331124 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30180b3ac0 0x7f30180634d0 secure :-1 s=THROTTLE_DONE pgs=718 cs=0 l=1 rx=0x7f3018155960 tx=0x7f300c001840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:41.992 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:41.969+0000 7f300affd700 1 -- 172.21.15.38:0/2268331124 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f300c03c280 con 0x7f30180b3ac0 2020-06-12T17:50:42.168 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.165+0000 7f301fe7d700 1 -- 172.21.15.38:0/2268331124 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_6221", "target": ["mon-mgr", ""]}) v1 -- 0x7f30180631c0 con 0x7f2ff804d5e0 2020-06-12T17:50:42.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.184+0000 7f301d418700 1 --2- 172.21.15.38:0/2268331124 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2ff804d5e0 0x7f2ff804faa0 secure :-1 s=THROTTLE_DONE pgs=280 cs=0 l=1 rx=0x7f3014008910 tx=0x7f3014007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:42.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.184+0000 7f300affd700 1 -- 172.21.15.38:0/2268331124 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f30180631c0 con 0x7f2ff804d5e0 2020-06-12T17:50:42.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.185+0000 7f301fe7d700 1 -- 172.21.15.38:0/2268331124 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2ff804d5e0 msgr2=0x7f2ff804faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:42.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.185+0000 7f301fe7d700 1 --2- 172.21.15.38:0/2268331124 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2ff804d5e0 0x7f2ff804faa0 secure :-1 s=READY pgs=280 cs=0 l=1 rx=0x7f3014008910 tx=0x7f3014007e60).stop 2020-06-12T17:50:42.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.185+0000 7f301fe7d700 1 -- 172.21.15.38:0/2268331124 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30180b3ac0 msgr2=0x7f30180634d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:42.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.185+0000 7f301fe7d700 1 --2- 172.21.15.38:0/2268331124 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30180b3ac0 0x7f30180634d0 secure :-1 s=READY pgs=718 cs=0 l=1 rx=0x7f3018155960 tx=0x7f300c001840).stop 2020-06-12T17:50:42.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.185+0000 7f301fe7d700 1 -- 172.21.15.38:0/2268331124 shutdown_connections 2020-06-12T17:50:42.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.185+0000 7f301fe7d700 1 --2- 172.21.15.38:0/2268331124 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2ff804d5e0 0x7f2ff804faa0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:42.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.185+0000 7f301fe7d700 1 --2- 172.21.15.38:0/2268331124 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30180b3ac0 0x7f30180634d0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:42.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.185+0000 7f301fe7d700 1 --2- 172.21.15.38:0/2268331124 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f301813e5f0 0x7f30180b03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:42.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.185+0000 7f301fe7d700 1 --2- 172.21.15.38:0/2268331124 >> v2:172.21.15.150:3300/0 conn(0x7f3018155390 0x7f301813e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:42.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.185+0000 7f301fe7d700 1 -- 172.21.15.38:0/2268331124 >> 172.21.15.38:0/2268331124 conn(0x7f30180b5a20 msgr2=0x7f301805b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:42.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.185+0000 7f301fe7d700 1 -- 172.21.15.38:0/2268331124 shutdown_connections 2020-06-12T17:50:42.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.185+0000 7f301fe7d700 1 -- 172.21.15.38:0/2268331124 wait complete. 2020-06-12T17:50:42.199 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_6221 2020-06-12T17:50:42.350 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.313+0000 7fd07011c700 1 Processor -- start 2020-06-12T17:50:42.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.313+0000 7fd07011c700 1 -- start start 2020-06-12T17:50:42.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.313+0000 7fd07011c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0680b3ac0 0x7fd06809df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:42.351 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd07011c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd068142e90 0x7fd06813bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:42.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd07011c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd06813c3a0 0x7fd0680b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:42.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd07011c700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06809b960 con 0x7fd06813c3a0 2020-06-12T17:50:42.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd07011c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06809bc00 con 0x7fd068142e90 2020-06-12T17:50:42.352 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd07011c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0680b48f0 con 0x7fd0680b3ac0 2020-06-12T17:50:42.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd06e6b9700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd06813c3a0 0x7fd0680b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:42.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd06e6b9700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd06813c3a0 0x7fd0680b2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39032/0 (socket says 172.21.15.38:39032) 2020-06-12T17:50:42.353 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd06e6b9700 1 -- 172.21.15.38:0/800069936 learned_addr learned my addr 172.21.15.38:0/800069936 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:42.354 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd06deb8700 1 --2- 172.21.15.38:0/800069936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0680b3ac0 0x7fd06809df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:42.354 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd06d6b7700 1 --2- 172.21.15.38:0/800069936 >> v2:172.21.15.150:3300/0 conn(0x7fd068142e90 0x7fd06813bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:42.354 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd06e6b9700 1 -- 172.21.15.38:0/800069936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0680b3ac0 msgr2=0x7fd06809df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:42.355 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd06e6b9700 1 --2- 172.21.15.38:0/800069936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0680b3ac0 0x7fd06809df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:42.355 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd06e6b9700 1 -- 172.21.15.38:0/800069936 >> v2:172.21.15.150:3300/0 conn(0x7fd068142e90 msgr2=0x7fd06813bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:42.355 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd06e6b9700 1 --2- 172.21.15.38:0/800069936 >> v2:172.21.15.150:3300/0 conn(0x7fd068142e90 0x7fd06813bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:42.355 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd06e6b9700 1 -- 172.21.15.38:0/800069936 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0680b3ea0 con 0x7fd06813c3a0 2020-06-12T17:50:42.356 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd06d6b7700 1 --2- 172.21.15.38:0/800069936 >> v2:172.21.15.150:3300/0 conn(0x7fd068142e90 0x7fd06813bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:50:42.356 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd06e6b9700 1 --2- 172.21.15.38:0/800069936 >> v2:172.21.15.38:3300/0 conn(0x7fd06813c3a0 0x7fd0680b2eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd060002f30 tx=0x7fd060007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:42.356 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd06e6b9700 1 --2- 172.21.15.38:0/800069936 >> v2:172.21.15.38:3300/0 conn(0x7fd06813c3a0 0x7fd0680b2eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd060002f30 tx=0x7fd060007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:42.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd06e6b9700 1 --2- 172.21.15.38:0/800069936 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd06813c3a0 0x7fd0680b2eb0 secure :-1 s=READY pgs=719 cs=0 l=1 rx=0x7fd060002f30 tx=0x7fd060007e60).ready entity=mon.0 client_cookie=ac7c0875d431923a server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:42.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd06e6b9700 1 --2- 172.21.15.38:0/800069936 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd06813c3a0 0x7fd0680b2eb0 secure :-1 s=THROTTLE_DONE pgs=719 cs=0 l=1 rx=0x7fd060002f30 tx=0x7fd060007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:42.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd06ceb6700 1 -- 172.21.15.38:0/800069936 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd060011630 con 0x7fd06813c3a0 2020-06-12T17:50:42.357 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd06e6b9700 1 --2- 172.21.15.38:0/800069936 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd06813c3a0 0x7fd0680b2eb0 secure :-1 s=THROTTLE_DONE pgs=719 cs=0 l=1 rx=0x7fd060002f30 tx=0x7fd060007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:42.361 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd06e6b9700 1 --2- 172.21.15.38:0/800069936 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd06813c3a0 0x7fd0680b2eb0 secure :-1 s=THROTTLE_DONE pgs=719 cs=0 l=1 rx=0x7fd060002f30 tx=0x7fd060007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:42.361 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd06ceb6700 1 -- 172.21.15.38:0/800069936 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd060011790 con 0x7fd06813c3a0 2020-06-12T17:50:42.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd06ceb6700 1 -- 172.21.15.38:0/800069936 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd060011bb0 con 0x7fd06813c3a0 2020-06-12T17:50:42.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd07011c700 1 -- 172.21.15.38:0/800069936 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd06813c3a0 msgr2=0x7fd0680b2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:42.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.314+0000 7fd07011c700 1 --2- 172.21.15.38:0/800069936 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd06813c3a0 0x7fd0680b2eb0 secure :-1 s=READY pgs=719 cs=0 l=1 rx=0x7fd060002f30 tx=0x7fd060007e60).stop 2020-06-12T17:50:42.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.315+0000 7fd07011c700 1 -- 172.21.15.38:0/800069936 shutdown_connections 2020-06-12T17:50:42.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.315+0000 7fd07011c700 1 --2- 172.21.15.38:0/800069936 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd06813c3a0 0x7fd0680b2eb0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:42.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.315+0000 7fd07011c700 1 --2- 172.21.15.38:0/800069936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0680b3ac0 0x7fd06809df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:42.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.315+0000 7fd07011c700 1 --2- 172.21.15.38:0/800069936 >> v2:172.21.15.150:3300/0 conn(0x7fd068142e90 0x7fd06813bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:42.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.315+0000 7fd07011c700 1 -- 172.21.15.38:0/800069936 >> 172.21.15.38:0/800069936 conn(0x7fd0680b5a20 msgr2=0x7fd06805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:42.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.315+0000 7fd07011c700 1 -- 172.21.15.38:0/800069936 shutdown_connections 2020-06-12T17:50:42.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.315+0000 7fd07011c700 1 -- 172.21.15.38:0/800069936 wait complete. 2020-06-12T17:50:42.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.316+0000 7fd07011c700 1 Processor -- start 2020-06-12T17:50:42.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.316+0000 7fd07011c700 1 -- start start 2020-06-12T17:50:42.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.317+0000 7fd07011c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd068142e90 0x7fd0680ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:42.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.317+0000 7fd07011c700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0680b2250 con 0x7fd06813c3a0 2020-06-12T17:50:42.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.317+0000 7fd07011c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0680b11a0 con 0x7fd0680b3ac0 2020-06-12T17:50:42.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.317+0000 7fd07011c700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06813d5d0 con 0x7fd068142e90 2020-06-12T17:50:42.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.317+0000 7fd06d6b7700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd06813c3a0 0x7fd06813cec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40856/0 (socket says 172.21.15.38:40856) 2020-06-12T17:50:42.367 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.317+0000 7fd06d6b7700 1 -- 172.21.15.38:0/410953439 learned_addr learned my addr 172.21.15.38:0/410953439 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:42.368 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.317+0000 7fd06e6b9700 1 --2- 172.21.15.38:0/410953439 >> v2:172.21.15.38:3300/0 conn(0x7fd068142e90 0x7fd0680ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:42.368 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.317+0000 7fd06e6b9700 1 -- 172.21.15.38:0/410953439 >> v1:172.21.15.150:6789/0 conn(0x7fd0680b3ac0 legacy=0x7fd06813c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:42.368 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.317+0000 7fd06e6b9700 1 -- 172.21.15.38:0/410953439 >> v1:172.21.15.38:6789/0 conn(0x7fd06813c3a0 legacy=0x7fd06813cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:42.369 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.317+0000 7fd056ffd700 1 -- 172.21.15.38:0/410953439 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2267186389 0 0) 0x7fd064002240 con 0x7fd06813c3a0 2020-06-12T17:50:42.369 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.317+0000 7fd06e6b9700 1 -- 172.21.15.38:0/410953439 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0680aeb70 con 0x7fd068142e90 2020-06-12T17:50:42.369 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.317+0000 7fd06e6b9700 1 --2- 172.21.15.38:0/410953439 >> v2:172.21.15.38:3300/0 conn(0x7fd068142e90 0x7fd0680ae3f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd060002f30 tx=0x7fd060007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:42.369 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.317+0000 7fd06e6b9700 1 --2- 172.21.15.38:0/410953439 >> v2:172.21.15.38:3300/0 conn(0x7fd068142e90 0x7fd0680ae3f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd060002f30 tx=0x7fd060007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:42.370 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.317+0000 7fd06e6b9700 1 --2- 172.21.15.38:0/410953439 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd068142e90 0x7fd0680ae3f0 secure :-1 s=READY pgs=721 cs=0 l=1 rx=0x7fd060002f30 tx=0x7fd060007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:42.370 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.317+0000 7fd06e6b9700 1 --2- 172.21.15.38:0/410953439 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd068142e90 0x7fd0680ae3f0 secure :-1 s=THROTTLE_DONE pgs=721 cs=0 l=1 rx=0x7fd060002f30 tx=0x7fd060007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:42.370 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.317+0000 7fd056ffd700 1 -- 172.21.15.38:0/410953439 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd06000f910 con 0x7fd068142e90 2020-06-12T17:50:42.371 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.317+0000 7fd06e6b9700 1 --2- 172.21.15.38:0/410953439 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd068142e90 0x7fd0680ae3f0 secure :-1 s=THROTTLE_DONE pgs=721 cs=0 l=1 rx=0x7fd060002f30 tx=0x7fd060007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:42.371 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.317+0000 7fd07011c700 1 -- 172.21.15.38:0/410953439 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0680b0e40 con 0x7fd068142e90 2020-06-12T17:50:42.371 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.317+0000 7fd056ffd700 1 -- 172.21.15.38:0/410953439 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd060007150 con 0x7fd068142e90 2020-06-12T17:50:42.371 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.317+0000 7fd06e6b9700 1 --2- 172.21.15.38:0/410953439 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd068142e90 0x7fd0680ae3f0 secure :-1 s=THROTTLE_DONE pgs=721 cs=0 l=1 rx=0x7fd060002f30 tx=0x7fd060007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:42.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.317+0000 7fd056ffd700 1 -- 172.21.15.38:0/410953439 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0600074f0 con 0x7fd068142e90 2020-06-12T17:50:42.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.317+0000 7fd07011c700 1 -- 172.21.15.38:0/410953439 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06813ba10 con 0x7fd068142e90 2020-06-12T17:50:42.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.318+0000 7fd06e6b9700 1 --2- 172.21.15.38:0/410953439 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd068142e90 0x7fd0680ae3f0 secure :-1 s=THROTTLE_DONE pgs=721 cs=0 l=1 rx=0x7fd060002f30 tx=0x7fd060007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:42.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.319+0000 7fd07011c700 1 -- 172.21.15.38:0/410953439 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0680b1330 con 0x7fd068142e90 2020-06-12T17:50:42.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.319+0000 7fd056ffd700 1 -- 172.21.15.38:0/410953439 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fd0600056c0 con 0x7fd068142e90 2020-06-12T17:50:42.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.319+0000 7fd06e6b9700 1 --2- 172.21.15.38:0/410953439 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd068142e90 0x7fd0680ae3f0 secure :-1 s=THROTTLE_DONE pgs=721 cs=0 l=1 rx=0x7fd060002f30 tx=0x7fd060007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:42.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.319+0000 7fd056ffd700 1 --2- 172.21.15.38:0/410953439 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd04804d350 0x7fd04804f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:42.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.319+0000 7fd056ffd700 1 -- 172.21.15.38:0/410953439 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd060061360 con 0x7fd068142e90 2020-06-12T17:50:42.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.319+0000 7fd06deb8700 1 --2- 172.21.15.38:0/410953439 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd04804d350 0x7fd04804f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:42.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.320+0000 7fd06deb8700 1 --2- 172.21.15.38:0/410953439 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd04804d350 0x7fd04804f810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd068067430 tx=0x7fd058007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:42.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.320+0000 7fd06deb8700 1 --2- 172.21.15.38:0/410953439 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd04804d350 0x7fd04804f810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd068067430 tx=0x7fd058007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:42.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.320+0000 7fd06deb8700 1 --2- 172.21.15.38:0/410953439 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd04804d350 0x7fd04804f810 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7fd068067430 tx=0x7fd058007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:42.377 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.322+0000 7fd06e6b9700 1 --2- 172.21.15.38:0/410953439 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd068142e90 0x7fd0680ae3f0 secure :-1 s=THROTTLE_DONE pgs=721 cs=0 l=1 rx=0x7fd060002f30 tx=0x7fd060007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:42.380 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.322+0000 7fd056ffd700 1 -- 172.21.15.38:0/410953439 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fd0680b1330 con 0x7fd068142e90 2020-06-12T17:50:42.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.520+0000 7fd07011c700 1 -- 172.21.15.38:0/410953439 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_6221", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0680b1330 con 0x7fd04804d350 2020-06-12T17:50:42.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.524+0000 7fd06deb8700 1 --2- 172.21.15.38:0/410953439 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd04804d350 0x7fd04804f810 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7fd068067430 tx=0x7fd058007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:42.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.524+0000 7fd056ffd700 1 -- 172.21.15.38:0/410953439 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7fd0680b1330 con 0x7fd04804d350 2020-06-12T17:50:42.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.525+0000 7fd07011c700 1 -- 172.21.15.38:0/410953439 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd04804d350 msgr2=0x7fd04804f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:42.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.525+0000 7fd07011c700 1 --2- 172.21.15.38:0/410953439 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd04804d350 0x7fd04804f810 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7fd068067430 tx=0x7fd058007e60).stop 2020-06-12T17:50:42.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.525+0000 7fd07011c700 1 -- 172.21.15.38:0/410953439 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd068142e90 msgr2=0x7fd0680ae3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:42.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.525+0000 7fd07011c700 1 --2- 172.21.15.38:0/410953439 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd068142e90 0x7fd0680ae3f0 secure :-1 s=READY pgs=721 cs=0 l=1 rx=0x7fd060002f30 tx=0x7fd060007e60).stop 2020-06-12T17:50:42.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.525+0000 7fd07011c700 1 -- 172.21.15.38:0/410953439 shutdown_connections 2020-06-12T17:50:42.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.525+0000 7fd07011c700 1 --2- 172.21.15.38:0/410953439 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd04804d350 0x7fd04804f810 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:42.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.525+0000 7fd07011c700 1 --2- 172.21.15.38:0/410953439 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd068142e90 0x7fd0680ae3f0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:42.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.525+0000 7fd07011c700 1 -- 172.21.15.38:0/410953439 >> 172.21.15.38:0/410953439 conn(0x7fd0680b5a20 msgr2=0x7fd0680b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:42.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.525+0000 7fd07011c700 1 -- 172.21.15.38:0/410953439 shutdown_connections 2020-06-12T17:50:42.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:42.525+0000 7fd07011c700 1 -- 172.21.15.38:0/410953439 wait complete. 2020-06-12T17:50:42.571 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_6221/41e27661-5e24-4185-9485-397fbc7217ca 2020-06-12T17:50:42.572 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_6221 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_6221/41e27661-5e24-4185-9485-397fbc7217ca 2020-06-12T17:50:42.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:42.573 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:42.574 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:42.590 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:42.591 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:42.591 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6221/41e27661-5e24-4185-9485-397fbc7217ca/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:42.681 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:42.682 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:42.682 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114372 s, 91.7 MB/s 2020-06-12T17:50:42.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:42.684 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:42.685 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:42.701 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:42.702 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:42.702 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6221/41e27661-5e24-4185-9485-397fbc7217ca/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:42.797 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:42.797 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115219 s, 91.0 MB/s 2020-06-12T17:50:42.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:42.798 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:42.799 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:42.815 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:42.816 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:42.817 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6221/41e27661-5e24-4185-9485-397fbc7217ca/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:42.906 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:42.907 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:42.907 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111864 s, 93.7 MB/s 2020-06-12T17:50:42.909 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:42.910 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:42.911 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:42.934 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:42.934 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:42.935 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6221/41e27661-5e24-4185-9485-397fbc7217ca/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:43.024 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:43.025 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:43.025 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112387 s, 93.3 MB/s 2020-06-12T17:50:43.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:43.027 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:43.028 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:43.043 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:43.044 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:43.044 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6221/41e27661-5e24-4185-9485-397fbc7217ca/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:43.133 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:43.133 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:43.134 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129596 s, 80.9 MB/s 2020-06-12T17:50:43.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:43.135 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:43.135 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:43.152 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:43.152 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:43.153 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6221/41e27661-5e24-4185-9485-397fbc7217ca/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:43.243 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:43.243 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:43.243 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092795 s, 113 MB/s 2020-06-12T17:50:43.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:43.245 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:43.245 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:43.260 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:43.260 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:43.261 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6221/41e27661-5e24-4185-9485-397fbc7217ca/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:43.346 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:43.346 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:43.347 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941803 s, 111 MB/s 2020-06-12T17:50:43.348 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:43.348 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:43.349 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:43.364 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:43.365 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:43.365 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6221/41e27661-5e24-4185-9485-397fbc7217ca/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:43.452 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:43.452 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:43.452 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104064 s, 101 MB/s 2020-06-12T17:50:43.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:43.454 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:43.454 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:43.470 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:43.471 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:43.471 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6221/41e27661-5e24-4185-9485-397fbc7217ca/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:43.559 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:43.559 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:43.559 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119733 s, 87.6 MB/s 2020-06-12T17:50:43.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:43.561 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:43.561 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:43.576 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:43.577 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:43.577 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6221/41e27661-5e24-4185-9485-397fbc7217ca/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:43.663 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:43.664 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:43.664 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100451 s, 104 MB/s 2020-06-12T17:50:43.665 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_6540 2020-06-12T17:50:43.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.779+0000 7f5287c89700 1 Processor -- start 2020-06-12T17:50:43.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.779+0000 7f5287c89700 1 -- start start 2020-06-12T17:50:43.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.779+0000 7f5287c89700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5280146680 0x7f52800ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:43.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.779+0000 7f5287c89700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f52800b2eb0 0x7f528009d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:43.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.779+0000 7f5287c89700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f528009d620 0x7f528009dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:43.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.779+0000 7f5287c89700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5280146d20 con 0x7f5280146680 2020-06-12T17:50:43.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.779+0000 7f5287c89700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f528009df30 con 0x7f52800b2eb0 2020-06-12T17:50:43.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.779+0000 7f5287c89700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5280066a80 con 0x7f528009d620 2020-06-12T17:50:43.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.780+0000 7f5285a25700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5280146680 0x7f52800ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:43.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.780+0000 7f5285a25700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5280146680 0x7f52800ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39046/0 (socket says 172.21.15.38:39046) 2020-06-12T17:50:43.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.780+0000 7f5285a25700 1 -- 172.21.15.38:0/2716185264 learned_addr learned my addr 172.21.15.38:0/2716185264 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:43.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.780+0000 7f5285224700 1 --2- 172.21.15.38:0/2716185264 >> v2:172.21.15.150:3300/0 conn(0x7f52800b2eb0 0x7f528009d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:43.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.780+0000 7f5286226700 1 --2- 172.21.15.38:0/2716185264 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f528009d620 0x7f528009dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:43.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.780+0000 7f5285a25700 1 -- 172.21.15.38:0/2716185264 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f528009d620 msgr2=0x7f528009dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:43.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.780+0000 7f5285a25700 1 --2- 172.21.15.38:0/2716185264 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f528009d620 0x7f528009dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:43.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.780+0000 7f5285a25700 1 -- 172.21.15.38:0/2716185264 >> v2:172.21.15.150:3300/0 conn(0x7f52800b2eb0 msgr2=0x7f528009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:43.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.780+0000 7f5285a25700 1 --2- 172.21.15.38:0/2716185264 >> v2:172.21.15.150:3300/0 conn(0x7f52800b2eb0 0x7f528009d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:43.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.780+0000 7f5285a25700 1 -- 172.21.15.38:0/2716185264 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5280146f50 con 0x7f5280146680 2020-06-12T17:50:43.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.780+0000 7f5285224700 1 --2- 172.21.15.38:0/2716185264 >> v2:172.21.15.150:3300/0 conn(0x7f52800b2eb0 0x7f528009d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:50:43.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.780+0000 7f5286226700 1 --2- 172.21.15.38:0/2716185264 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f528009d620 0x7f528009dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:50:43.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.780+0000 7f5285a25700 1 --2- 172.21.15.38:0/2716185264 >> v2:172.21.15.38:3300/0 conn(0x7f5280146680 0x7f52800ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f527c002f30 tx=0x7f527c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:43.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.780+0000 7f5285a25700 1 --2- 172.21.15.38:0/2716185264 >> v2:172.21.15.38:3300/0 conn(0x7f5280146680 0x7f52800ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f527c002f30 tx=0x7f527c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:43.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.780+0000 7f5285a25700 1 --2- 172.21.15.38:0/2716185264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5280146680 0x7f52800ad5b0 secure :-1 s=READY pgs=722 cs=0 l=1 rx=0x7f527c002f30 tx=0x7f527c007e60).ready entity=mon.0 client_cookie=c72f038f226c9123 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:43.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.780+0000 7f5285a25700 1 --2- 172.21.15.38:0/2716185264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5280146680 0x7f52800ad5b0 secure :-1 s=THROTTLE_DONE pgs=722 cs=0 l=1 rx=0x7f527c002f30 tx=0x7f527c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:43.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.780+0000 7f5285a25700 1 --2- 172.21.15.38:0/2716185264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5280146680 0x7f52800ad5b0 secure :-1 s=THROTTLE_DONE pgs=722 cs=0 l=1 rx=0x7f527c002f30 tx=0x7f527c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:43.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.780+0000 7f5284a23700 1 -- 172.21.15.38:0/2716185264 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f527c0116e0 con 0x7f5280146680 2020-06-12T17:50:43.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.780+0000 7f5285a25700 1 --2- 172.21.15.38:0/2716185264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5280146680 0x7f52800ad5b0 secure :-1 s=THROTTLE_DONE pgs=722 cs=0 l=1 rx=0x7f527c002f30 tx=0x7f527c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:43.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.780+0000 7f5284a23700 1 -- 172.21.15.38:0/2716185264 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527c011840 con 0x7f5280146680 2020-06-12T17:50:43.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.780+0000 7f5284a23700 1 -- 172.21.15.38:0/2716185264 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f527c011be0 con 0x7f5280146680 2020-06-12T17:50:43.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.780+0000 7f5287c89700 1 -- 172.21.15.38:0/2716185264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5280146680 msgr2=0x7f52800ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:43.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.780+0000 7f5287c89700 1 --2- 172.21.15.38:0/2716185264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5280146680 0x7f52800ad5b0 secure :-1 s=READY pgs=722 cs=0 l=1 rx=0x7f527c002f30 tx=0x7f527c007e60).stop 2020-06-12T17:50:43.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.781+0000 7f5287c89700 1 -- 172.21.15.38:0/2716185264 shutdown_connections 2020-06-12T17:50:43.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.781+0000 7f5287c89700 1 --2- 172.21.15.38:0/2716185264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5280146680 0x7f52800ad5b0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:43.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.781+0000 7f5287c89700 1 --2- 172.21.15.38:0/2716185264 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f528009d620 0x7f528009dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:43.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.781+0000 7f5287c89700 1 --2- 172.21.15.38:0/2716185264 >> v2:172.21.15.150:3300/0 conn(0x7f52800b2eb0 0x7f528009d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:43.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.781+0000 7f5287c89700 1 -- 172.21.15.38:0/2716185264 >> 172.21.15.38:0/2716185264 conn(0x7f52800b5a20 msgr2=0x7f528005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:43.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.781+0000 7f5287c89700 1 -- 172.21.15.38:0/2716185264 shutdown_connections 2020-06-12T17:50:43.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.781+0000 7f5287c89700 1 -- 172.21.15.38:0/2716185264 wait complete. 2020-06-12T17:50:43.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.782+0000 7f5287c89700 1 Processor -- start 2020-06-12T17:50:43.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.782+0000 7f5287c89700 1 -- start start 2020-06-12T17:50:43.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.782+0000 7f5287c89700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f528009d620 0x7f528009a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:43.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.782+0000 7f5287c89700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52800b2eb0 0x7f5280093910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:43.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.782+0000 7f5287c89700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f528009ad20 con 0x7f5280146680 2020-06-12T17:50:43.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.782+0000 7f5287c89700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5280066610 con 0x7f528009d620 2020-06-12T17:50:43.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.782+0000 7f5287c89700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5280092f30 con 0x7f52800b2eb0 2020-06-12T17:50:43.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.783+0000 7f5285a25700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f528009d620 0x7f528009a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:43.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.783+0000 7f5285a25700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f528009d620 0x7f528009a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39052/0 (socket says 172.21.15.38:39052) 2020-06-12T17:50:43.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.783+0000 7f5285a25700 1 -- 172.21.15.38:0/2222453909 learned_addr learned my addr 172.21.15.38:0/2222453909 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:43.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.783+0000 7f5285224700 1 --2- 172.21.15.38:0/2222453909 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52800b2eb0 0x7f5280093910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:43.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.783+0000 7f5285a25700 1 -- 172.21.15.38:0/2222453909 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52800b2eb0 msgr2=0x7f5280093910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:43.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.783+0000 7f5285a25700 1 --2- 172.21.15.38:0/2222453909 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52800b2eb0 0x7f5280093910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:43.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.783+0000 7f5285a25700 1 -- 172.21.15.38:0/2222453909 >> v1:172.21.15.150:6789/0 conn(0x7f5280146680 legacy=0x7f5280065f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:43.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.783+0000 7f5285a25700 1 -- 172.21.15.38:0/2222453909 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52800931d0 con 0x7f528009d620 2020-06-12T17:50:43.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.783+0000 7f5285a25700 1 --2- 172.21.15.38:0/2222453909 >> v2:172.21.15.38:3300/0 conn(0x7f528009d620 0x7f528009a8c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f528009cdb0 tx=0x7f527c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:43.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.783+0000 7f5285a25700 1 --2- 172.21.15.38:0/2222453909 >> v2:172.21.15.38:3300/0 conn(0x7f528009d620 0x7f528009a8c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f528009cdb0 tx=0x7f527c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:43.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.783+0000 7f5285a25700 1 --2- 172.21.15.38:0/2222453909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f528009d620 0x7f528009a8c0 secure :-1 s=READY pgs=723 cs=0 l=1 rx=0x7f528009cdb0 tx=0x7f527c007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:43.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.783+0000 7f5285a25700 1 --2- 172.21.15.38:0/2222453909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f528009d620 0x7f528009a8c0 secure :-1 s=THROTTLE_DONE pgs=723 cs=0 l=1 rx=0x7f528009cdb0 tx=0x7f527c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:43.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.783+0000 7f5285a25700 1 --2- 172.21.15.38:0/2222453909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f528009d620 0x7f528009a8c0 secure :-1 s=THROTTLE_DONE pgs=723 cs=0 l=1 rx=0x7f528009cdb0 tx=0x7f527c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:43.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.783+0000 7f5285a25700 1 --2- 172.21.15.38:0/2222453909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f528009d620 0x7f528009a8c0 secure :-1 s=THROTTLE_DONE pgs=723 cs=0 l=1 rx=0x7f528009cdb0 tx=0x7f527c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:43.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.783+0000 7f526effd700 1 -- 172.21.15.38:0/2222453909 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f527c007150 con 0x7f528009d620 2020-06-12T17:50:43.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.783+0000 7f526effd700 1 -- 172.21.15.38:0/2222453909 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527c0072b0 con 0x7f528009d620 2020-06-12T17:50:43.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.783+0000 7f5287c89700 1 -- 172.21.15.38:0/2222453909 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5280093470 con 0x7f528009d620 2020-06-12T17:50:43.800 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.783+0000 7f526effd700 1 -- 172.21.15.38:0/2222453909 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f527c0056c0 con 0x7f528009d620 2020-06-12T17:50:43.800 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.783+0000 7f5287c89700 1 -- 172.21.15.38:0/2222453909 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5280093d70 con 0x7f528009d620 2020-06-12T17:50:43.800 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.784+0000 7f5285a25700 1 --2- 172.21.15.38:0/2222453909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f528009d620 0x7f528009a8c0 secure :-1 s=THROTTLE_DONE pgs=723 cs=0 l=1 rx=0x7f528009cdb0 tx=0x7f527c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:43.800 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.784+0000 7f526effd700 1 -- 172.21.15.38:0/2222453909 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f527c005930 con 0x7f528009d620 2020-06-12T17:50:43.800 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.784+0000 7f5285a25700 1 --2- 172.21.15.38:0/2222453909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f528009d620 0x7f528009a8c0 secure :-1 s=THROTTLE_DONE pgs=723 cs=0 l=1 rx=0x7f528009cdb0 tx=0x7f527c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:43.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.784+0000 7f5287c89700 1 -- 172.21.15.38:0/2222453909 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5280056c30 con 0x7f528009d620 2020-06-12T17:50:43.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.784+0000 7f526effd700 1 --2- 172.21.15.38:0/2222453909 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f526004d650 0x7f526004fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:43.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.785+0000 7f526effd700 1 -- 172.21.15.38:0/2222453909 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f527c0613b0 con 0x7f528009d620 2020-06-12T17:50:43.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.785+0000 7f5285224700 1 --2- 172.21.15.38:0/2222453909 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f526004d650 0x7f526004fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:43.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.785+0000 7f5285224700 1 --2- 172.21.15.38:0/2222453909 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f526004d650 0x7f526004fb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5270002f30 tx=0x7f5270009f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:43.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.785+0000 7f5285224700 1 --2- 172.21.15.38:0/2222453909 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f526004d650 0x7f526004fb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5270002f30 tx=0x7f5270009f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:43.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.785+0000 7f5285224700 1 --2- 172.21.15.38:0/2222453909 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f526004d650 0x7f526004fb10 secure :-1 s=READY pgs=282 cs=0 l=1 rx=0x7f5270002f30 tx=0x7f5270009f10).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:43.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.788+0000 7f5285a25700 1 --2- 172.21.15.38:0/2222453909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f528009d620 0x7f528009a8c0 secure :-1 s=THROTTLE_DONE pgs=723 cs=0 l=1 rx=0x7f528009cdb0 tx=0x7f527c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:43.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.788+0000 7f526effd700 1 -- 172.21.15.38:0/2222453909 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f527c03cb90 con 0x7f528009d620 2020-06-12T17:50:43.985 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:43.981+0000 7f5287c89700 1 -- 172.21.15.38:0/2222453909 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_6540", "target": ["mon-mgr", ""]}) v1 -- 0x7f5280093670 con 0x7f526004d650 2020-06-12T17:50:44.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.001+0000 7f5285224700 1 --2- 172.21.15.38:0/2222453909 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f526004d650 0x7f526004fb10 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x7f5270002f30 tx=0x7f5270009f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:44.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.001+0000 7f526effd700 1 -- 172.21.15.38:0/2222453909 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f527000c1f0 con 0x7f526004d650 2020-06-12T17:50:44.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.002+0000 7f5287c89700 1 -- 172.21.15.38:0/2222453909 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f526004d650 msgr2=0x7f526004fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:44.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.002+0000 7f5287c89700 1 --2- 172.21.15.38:0/2222453909 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f526004d650 0x7f526004fb10 secure :-1 s=READY pgs=282 cs=0 l=1 rx=0x7f5270002f30 tx=0x7f5270009f10).stop 2020-06-12T17:50:44.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.002+0000 7f5287c89700 1 -- 172.21.15.38:0/2222453909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f528009d620 msgr2=0x7f528009a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:44.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.002+0000 7f5287c89700 1 --2- 172.21.15.38:0/2222453909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f528009d620 0x7f528009a8c0 secure :-1 s=READY pgs=723 cs=0 l=1 rx=0x7f528009cdb0 tx=0x7f527c007e60).stop 2020-06-12T17:50:44.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.002+0000 7f5287c89700 1 -- 172.21.15.38:0/2222453909 shutdown_connections 2020-06-12T17:50:44.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.002+0000 7f5287c89700 1 --2- 172.21.15.38:0/2222453909 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f526004d650 0x7f526004fb10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:44.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.002+0000 7f5287c89700 1 --2- 172.21.15.38:0/2222453909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f528009d620 0x7f528009a8c0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:44.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.002+0000 7f5287c89700 1 --2- 172.21.15.38:0/2222453909 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52800b2eb0 0x7f5280093910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:44.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.002+0000 7f5287c89700 1 -- 172.21.15.38:0/2222453909 >> 172.21.15.38:0/2222453909 conn(0x7f52800b5a20 msgr2=0x7f5280145190 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:44.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.002+0000 7f5287c89700 1 -- 172.21.15.38:0/2222453909 shutdown_connections 2020-06-12T17:50:44.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.002+0000 7f5287c89700 1 -- 172.21.15.38:0/2222453909 wait complete. 2020-06-12T17:50:44.016 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_6540 2020-06-12T17:50:44.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.129+0000 7ff4f8dc6700 1 Processor -- start 2020-06-12T17:50:44.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.130+0000 7ff4f8dc6700 1 -- start start 2020-06-12T17:50:44.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.130+0000 7ff4f8dc6700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff4f409d0b0 0x7ff4f413c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:44.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.130+0000 7ff4f8dc6700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f409b960 con 0x7ff4f409df00 2020-06-12T17:50:44.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.130+0000 7ff4f8dc6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f409bc00 con 0x7ff4f40b3ac0 2020-06-12T17:50:44.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.130+0000 7ff4f8dc6700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f40b48f0 con 0x7ff4f409d0b0 2020-06-12T17:50:44.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.131+0000 7ff4f2d9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff4f409d0b0 0x7ff4f413c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:44.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.131+0000 7ff4f2d9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff4f409d0b0 0x7ff4f413c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39064/0 (socket says 172.21.15.38:39064) 2020-06-12T17:50:44.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.131+0000 7ff4f2d9d700 1 -- 172.21.15.38:0/360059546 learned_addr learned my addr 172.21.15.38:0/360059546 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:44.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.131+0000 7ff4f1d9b700 1 --1- 172.21.15.38:0/360059546 >> v1:172.21.15.38:6789/0 conn(0x7ff4f409df00 0x7ff4f4066790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40876/0 (socket says 172.21.15.38:40876) 2020-06-12T17:50:44.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.131+0000 7ff4f2d9d700 1 -- 172.21.15.38:0/360059546 >> v1:172.21.15.150:6789/0 conn(0x7ff4f40b3ac0 legacy=0x7ff4f413bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:44.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.131+0000 7ff4f2d9d700 1 -- 172.21.15.38:0/360059546 >> v1:172.21.15.38:6789/0 conn(0x7ff4f409df00 legacy=0x7ff4f4066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:44.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.131+0000 7ff4f2d9d700 1 -- 172.21.15.38:0/360059546 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f40b3ea0 con 0x7ff4f409d0b0 2020-06-12T17:50:44.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.131+0000 7ff4f2d9d700 1 --2- 172.21.15.38:0/360059546 >> v2:172.21.15.38:3300/0 conn(0x7ff4f409d0b0 0x7ff4f413c650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff4e40010d0 tx=0x7ff4ec0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:44.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.131+0000 7ff4f2d9d700 1 --2- 172.21.15.38:0/360059546 >> v2:172.21.15.38:3300/0 conn(0x7ff4f409d0b0 0x7ff4f413c650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff4e40010d0 tx=0x7ff4ec0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:44.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.131+0000 7ff4f2d9d700 1 --2- 172.21.15.38:0/360059546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f409d0b0 0x7ff4f413c650 secure :-1 s=READY pgs=725 cs=0 l=1 rx=0x7ff4e40010d0 tx=0x7ff4ec0081e0).ready entity=mon.0 client_cookie=b65f6b740b9433ca server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:44.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.131+0000 7ff4f2d9d700 1 --2- 172.21.15.38:0/360059546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f409d0b0 0x7ff4f413c650 secure :-1 s=THROTTLE_DONE pgs=725 cs=0 l=1 rx=0x7ff4e40010d0 tx=0x7ff4ec0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:44.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.131+0000 7ff4f159a700 1 -- 172.21.15.38:0/360059546 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4ec010e20 con 0x7ff4f409d0b0 2020-06-12T17:50:44.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.131+0000 7ff4f2d9d700 1 --2- 172.21.15.38:0/360059546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f409d0b0 0x7ff4f413c650 secure :-1 s=THROTTLE_DONE pgs=725 cs=0 l=1 rx=0x7ff4e40010d0 tx=0x7ff4ec0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:44.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.131+0000 7ff4f2d9d700 1 --2- 172.21.15.38:0/360059546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f409d0b0 0x7ff4f413c650 secure :-1 s=THROTTLE_DONE pgs=725 cs=0 l=1 rx=0x7ff4e40010d0 tx=0x7ff4ec0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:44.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.131+0000 7ff4f159a700 1 -- 172.21.15.38:0/360059546 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ec0110c0 con 0x7ff4f409d0b0 2020-06-12T17:50:44.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.131+0000 7ff4f159a700 1 -- 172.21.15.38:0/360059546 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4ec0114a0 con 0x7ff4f409d0b0 2020-06-12T17:50:44.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.131+0000 7ff4f8dc6700 1 -- 172.21.15.38:0/360059546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f409d0b0 msgr2=0x7ff4f413c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:44.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.131+0000 7ff4f8dc6700 1 --2- 172.21.15.38:0/360059546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f409d0b0 0x7ff4f413c650 secure :-1 s=READY pgs=725 cs=0 l=1 rx=0x7ff4e40010d0 tx=0x7ff4ec0081e0).stop 2020-06-12T17:50:44.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.132+0000 7ff4f8dc6700 1 -- 172.21.15.38:0/360059546 shutdown_connections 2020-06-12T17:50:44.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.132+0000 7ff4f8dc6700 1 --2- 172.21.15.38:0/360059546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f409d0b0 0x7ff4f413c650 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:44.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.132+0000 7ff4f8dc6700 1 -- 172.21.15.38:0/360059546 >> 172.21.15.38:0/360059546 conn(0x7ff4f40b5a20 msgr2=0x7ff4f405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:44.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.132+0000 7ff4f8dc6700 1 -- 172.21.15.38:0/360059546 shutdown_connections 2020-06-12T17:50:44.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.132+0000 7ff4f8dc6700 1 -- 172.21.15.38:0/360059546 wait complete. 2020-06-12T17:50:44.144 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.133+0000 7ff4f8dc6700 1 Processor -- start 2020-06-12T17:50:44.144 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.133+0000 7ff4f8dc6700 1 -- start start 2020-06-12T17:50:44.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.134+0000 7ff4f8dc6700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff4f409df00 0x7ff4f4065ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:44.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.134+0000 7ff4f8dc6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff4f40b3ac0 0x7ff4f4066170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:44.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.134+0000 7ff4f8dc6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f40af010 con 0x7ff4f409d0b0 2020-06-12T17:50:44.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.134+0000 7ff4f8dc6700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f40665d0 con 0x7ff4f409df00 2020-06-12T17:50:44.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.134+0000 7ff4f8dc6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f40af2b0 con 0x7ff4f40b3ac0 2020-06-12T17:50:44.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.134+0000 7ff4f1d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff4f409df00 0x7ff4f4065ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:44.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.134+0000 7ff4f1d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff4f409df00 0x7ff4f4065ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39068/0 (socket says 172.21.15.38:39068) 2020-06-12T17:50:44.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.134+0000 7ff4f1d9b700 1 -- 172.21.15.38:0/1067959696 learned_addr learned my addr 172.21.15.38:0/1067959696 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:44.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.134+0000 7ff4f2d9d700 1 --2- 172.21.15.38:0/1067959696 >> v2:172.21.15.150:3300/0 conn(0x7ff4f40b3ac0 0x7ff4f4066170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:44.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.134+0000 7ff4f1d9b700 1 -- 172.21.15.38:0/1067959696 >> v2:172.21.15.150:3300/0 conn(0x7ff4f40b3ac0 msgr2=0x7ff4f4066170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:44.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.134+0000 7ff4f1d9b700 1 --2- 172.21.15.38:0/1067959696 >> v2:172.21.15.150:3300/0 conn(0x7ff4f40b3ac0 0x7ff4f4066170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:44.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.134+0000 7ff4f1d9b700 1 -- 172.21.15.38:0/1067959696 >> v1:172.21.15.150:6789/0 conn(0x7ff4f409d0b0 legacy=0x7ff4f4154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:44.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.134+0000 7ff4f1d9b700 1 -- 172.21.15.38:0/1067959696 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f40af550 con 0x7ff4f409df00 2020-06-12T17:50:44.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.134+0000 7ff4f1d9b700 1 --2- 172.21.15.38:0/1067959696 >> v2:172.21.15.38:3300/0 conn(0x7ff4f409df00 0x7ff4f4065ad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff4e4001190 tx=0x7ff4e4001980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:44.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.134+0000 7ff4f1d9b700 1 --2- 172.21.15.38:0/1067959696 >> v2:172.21.15.38:3300/0 conn(0x7ff4f409df00 0x7ff4f4065ad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff4e4001190 tx=0x7ff4e4001980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:44.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.134+0000 7ff4f1d9b700 1 --2- 172.21.15.38:0/1067959696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f409df00 0x7ff4f4065ad0 secure :-1 s=READY pgs=726 cs=0 l=1 rx=0x7ff4e4001190 tx=0x7ff4e4001980).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:44.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.134+0000 7ff4f1d9b700 1 --2- 172.21.15.38:0/1067959696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f409df00 0x7ff4f4065ad0 secure :-1 s=THROTTLE_DONE pgs=726 cs=0 l=1 rx=0x7ff4e4001190 tx=0x7ff4e4001980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:44.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.134+0000 7ff4f1d9b700 1 --2- 172.21.15.38:0/1067959696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f409df00 0x7ff4f4065ad0 secure :-1 s=THROTTLE_DONE pgs=726 cs=0 l=1 rx=0x7ff4e4001190 tx=0x7ff4e4001980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:44.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.134+0000 7ff4eb7fe700 1 -- 172.21.15.38:0/1067959696 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4e400c940 con 0x7ff4f409df00 2020-06-12T17:50:44.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.134+0000 7ff4f1d9b700 1 --2- 172.21.15.38:0/1067959696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f409df00 0x7ff4f4065ad0 secure :-1 s=THROTTLE_DONE pgs=726 cs=0 l=1 rx=0x7ff4e4001190 tx=0x7ff4e4001980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:44.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.134+0000 7ff4eb7fe700 1 -- 172.21.15.38:0/1067959696 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e400caa0 con 0x7ff4f409df00 2020-06-12T17:50:44.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.134+0000 7ff4f8dc6700 1 -- 172.21.15.38:0/1067959696 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f40affe0 con 0x7ff4f409df00 2020-06-12T17:50:44.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.134+0000 7ff4eb7fe700 1 -- 172.21.15.38:0/1067959696 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4e400ce80 con 0x7ff4f409df00 2020-06-12T17:50:44.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.134+0000 7ff4f8dc6700 1 -- 172.21.15.38:0/1067959696 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f41417a0 con 0x7ff4f409df00 2020-06-12T17:50:44.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.135+0000 7ff4f1d9b700 1 --2- 172.21.15.38:0/1067959696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f409df00 0x7ff4f4065ad0 secure :-1 s=THROTTLE_DONE pgs=726 cs=0 l=1 rx=0x7ff4e4001190 tx=0x7ff4e4001980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:44.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.135+0000 7ff4eb7fe700 1 -- 172.21.15.38:0/1067959696 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7ff4e40044f0 con 0x7ff4f409df00 2020-06-12T17:50:44.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.135+0000 7ff4f1d9b700 1 --2- 172.21.15.38:0/1067959696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f409df00 0x7ff4f4065ad0 secure :-1 s=THROTTLE_DONE pgs=726 cs=0 l=1 rx=0x7ff4e4001190 tx=0x7ff4e4001980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:44.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.135+0000 7ff4f8dc6700 1 -- 172.21.15.38:0/1067959696 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f413e790 con 0x7ff4f409df00 2020-06-12T17:50:44.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.136+0000 7ff4eb7fe700 1 --2- 172.21.15.38:0/1067959696 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff4d804d550 0x7ff4d804fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:44.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.136+0000 7ff4eb7fe700 1 -- 172.21.15.38:0/1067959696 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff4e4060e20 con 0x7ff4f409df00 2020-06-12T17:50:44.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.136+0000 7ff4f259c700 1 --2- 172.21.15.38:0/1067959696 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff4d804d550 0x7ff4d804fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:44.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.136+0000 7ff4f259c700 1 --2- 172.21.15.38:0/1067959696 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff4d804d550 0x7ff4d804fa10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff4f40af8f0 tx=0x7ff4dc002400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:44.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.136+0000 7ff4f259c700 1 --2- 172.21.15.38:0/1067959696 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff4d804d550 0x7ff4d804fa10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff4f40af8f0 tx=0x7ff4dc002400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:44.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.136+0000 7ff4f259c700 1 --2- 172.21.15.38:0/1067959696 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff4d804d550 0x7ff4d804fa10 secure :-1 s=READY pgs=283 cs=0 l=1 rx=0x7ff4f40af8f0 tx=0x7ff4dc002400).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:44.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.139+0000 7ff4f1d9b700 1 --2- 172.21.15.38:0/1067959696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f409df00 0x7ff4f4065ad0 secure :-1 s=THROTTLE_DONE pgs=726 cs=0 l=1 rx=0x7ff4e4001190 tx=0x7ff4e4001980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:44.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.139+0000 7ff4eb7fe700 1 -- 172.21.15.38:0/1067959696 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7ff4e403c540 con 0x7ff4f409df00 2020-06-12T17:50:44.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.335+0000 7ff4f8dc6700 1 -- 172.21.15.38:0/1067959696 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_6540", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4f4056c30 con 0x7ff4d804d550 2020-06-12T17:50:44.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.339+0000 7ff4f259c700 1 --2- 172.21.15.38:0/1067959696 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff4d804d550 0x7ff4d804fa10 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7ff4f40af8f0 tx=0x7ff4dc002400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:44.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.339+0000 7ff4eb7fe700 1 -- 172.21.15.38:0/1067959696 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7ff4f4056c30 con 0x7ff4d804d550 2020-06-12T17:50:44.343 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_6540/a1fb6606-f332-4a89-8e25-1dafc7065c00 2020-06-12T17:50:44.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.340+0000 7ff4f8dc6700 1 -- 172.21.15.38:0/1067959696 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff4d804d550 msgr2=0x7ff4d804fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:44.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.340+0000 7ff4f8dc6700 1 --2- 172.21.15.38:0/1067959696 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff4d804d550 0x7ff4d804fa10 secure :-1 s=READY pgs=283 cs=0 l=1 rx=0x7ff4f40af8f0 tx=0x7ff4dc002400).stop 2020-06-12T17:50:44.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.340+0000 7ff4f8dc6700 1 -- 172.21.15.38:0/1067959696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f409df00 msgr2=0x7ff4f4065ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:44.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.340+0000 7ff4f8dc6700 1 --2- 172.21.15.38:0/1067959696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f409df00 0x7ff4f4065ad0 secure :-1 s=READY pgs=726 cs=0 l=1 rx=0x7ff4e4001190 tx=0x7ff4e4001980).stop 2020-06-12T17:50:44.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.340+0000 7ff4f8dc6700 1 -- 172.21.15.38:0/1067959696 shutdown_connections 2020-06-12T17:50:44.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.340+0000 7ff4f8dc6700 1 --2- 172.21.15.38:0/1067959696 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff4d804d550 0x7ff4d804fa10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:44.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.340+0000 7ff4f8dc6700 1 --2- 172.21.15.38:0/1067959696 >> v2:172.21.15.150:3300/0 conn(0x7ff4f40b3ac0 0x7ff4f4066170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:44.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.340+0000 7ff4f8dc6700 1 --2- 172.21.15.38:0/1067959696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff4f409df00 0x7ff4f4065ad0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:44.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.340+0000 7ff4f8dc6700 1 -- 172.21.15.38:0/1067959696 >> 172.21.15.38:0/1067959696 conn(0x7ff4f40b5a20 msgr2=0x7ff4f4066860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:44.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.341+0000 7ff4f8dc6700 1 -- 172.21.15.38:0/1067959696 shutdown_connections 2020-06-12T17:50:44.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:44.341+0000 7ff4f8dc6700 1 -- 172.21.15.38:0/1067959696 wait complete. 2020-06-12T17:50:44.354 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_6540 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_6540/a1fb6606-f332-4a89-8e25-1dafc7065c00 2020-06-12T17:50:44.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:44.355 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:44.355 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:44.371 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:44.372 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:44.372 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6540/a1fb6606-f332-4a89-8e25-1dafc7065c00/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:44.461 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:44.462 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:44.462 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115167 s, 91.0 MB/s 2020-06-12T17:50:44.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:44.464 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:44.464 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:44.479 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:44.479 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:44.480 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6540/a1fb6606-f332-4a89-8e25-1dafc7065c00/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:44.569 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:44.570 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:44.570 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128707 s, 81.5 MB/s 2020-06-12T17:50:44.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:44.571 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:44.572 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:44.587 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:44.587 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:44.588 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6540/a1fb6606-f332-4a89-8e25-1dafc7065c00/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:44.676 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:44.676 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:44.676 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125096 s, 83.8 MB/s 2020-06-12T17:50:44.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:44.678 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:44.678 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:44.693 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:44.694 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:44.695 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6540/a1fb6606-f332-4a89-8e25-1dafc7065c00/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:44.781 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:44.782 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:44.782 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106444 s, 98.5 MB/s 2020-06-12T17:50:44.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:44.784 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:44.784 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:44.799 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:44.799 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:44.800 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6540/a1fb6606-f332-4a89-8e25-1dafc7065c00/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:44.890 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:44.890 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:44.891 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119767 s, 87.6 MB/s 2020-06-12T17:50:44.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:44.892 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:44.892 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:44.907 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:44.908 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:44.908 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6540/a1fb6606-f332-4a89-8e25-1dafc7065c00/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:44.997 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:44.997 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:44.998 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01059 s, 99.0 MB/s 2020-06-12T17:50:44.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:44.999 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:45.000 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:45.014 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:45.015 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:45.015 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6540/a1fb6606-f332-4a89-8e25-1dafc7065c00/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:45.109 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:45.109 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:45.109 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112008 s, 93.6 MB/s 2020-06-12T17:50:45.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:45.111 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:45.111 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:45.126 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:45.127 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:45.127 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6540/a1fb6606-f332-4a89-8e25-1dafc7065c00/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:45.215 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:45.215 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:45.216 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119388 s, 87.8 MB/s 2020-06-12T17:50:45.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:45.217 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:45.218 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:45.232 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:45.233 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:45.233 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6540/a1fb6606-f332-4a89-8e25-1dafc7065c00/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:45.329 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:45.329 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:45.329 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109172 s, 96.0 MB/s 2020-06-12T17:50:45.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:45.331 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:45.331 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:45.347 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:45.347 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:45.348 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_6540/a1fb6606-f332-4a89-8e25-1dafc7065c00/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:45.437 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:45.437 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:45.438 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122497 s, 85.6 MB/s 2020-06-12T17:50:45.439 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_2088 2020-06-12T17:50:45.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.553+0000 7f0c2db8f700 1 Processor -- start 2020-06-12T17:50:45.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.553+0000 7f0c2db8f700 1 -- start start 2020-06-12T17:50:45.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.554+0000 7f0c2db8f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c2809df00 0x7f0c2813c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:45.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.554+0000 7f0c2db8f700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c2809b960 con 0x7f0c280b3ac0 2020-06-12T17:50:45.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.554+0000 7f0c2db8f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c2809bc00 con 0x7f0c28142e90 2020-06-12T17:50:45.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.554+0000 7f0c2db8f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c280b48f0 con 0x7f0c2809df00 2020-06-12T17:50:45.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.554+0000 7f0c277fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f0c280b3ac0 0x7f0c2813bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40890/0 (socket says 172.21.15.38:40890) 2020-06-12T17:50:45.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.554+0000 7f0c277fe700 1 -- 172.21.15.38:0/1114155987 learned_addr learned my addr 172.21.15.38:0/1114155987 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:45.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.554+0000 7f0c26ffd700 1 --2- 172.21.15.38:0/1114155987 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c2809df00 0x7f0c2813c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:45.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.554+0000 7f0c267fc700 1 -- 172.21.15.38:0/1114155987 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1096753714 0 0) 0x7f0c2809b960 con 0x7f0c280b3ac0 2020-06-12T17:50:45.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.555+0000 7f0c267fc700 1 -- 172.21.15.38:0/1114155987 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c14003230 con 0x7f0c280b3ac0 2020-06-12T17:50:45.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.555+0000 7f0c267fc700 1 -- 172.21.15.38:0/1114155987 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1009888855 0 0) 0x7f0c14003230 con 0x7f0c280b3ac0 2020-06-12T17:50:45.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.555+0000 7f0c267fc700 1 -- 172.21.15.38:0/1114155987 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c2809df00 msgr2=0x7f0c2813c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:45.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.555+0000 7f0c267fc700 1 --2- 172.21.15.38:0/1114155987 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c2809df00 0x7f0c2813c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:45.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.555+0000 7f0c267fc700 1 -- 172.21.15.38:0/1114155987 >> v1:172.21.15.150:6789/0 conn(0x7f0c28142e90 legacy=0x7f0c28066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:45.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.555+0000 7f0c267fc700 1 -- 172.21.15.38:0/1114155987 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c280b3ea0 con 0x7f0c280b3ac0 2020-06-12T17:50:45.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.555+0000 7f0c267fc700 1 -- 172.21.15.38:0/1114155987 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f0c180016d0 con 0x7f0c280b3ac0 2020-06-12T17:50:45.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.555+0000 7f0c267fc700 1 -- 172.21.15.38:0/1114155987 >> v1:172.21.15.38:6789/0 conn(0x7f0c280b3ac0 legacy=0x7f0c2813bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:45.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.555+0000 7f0c267fc700 1 --2- 172.21.15.38:0/1114155987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c14003750 0x7f0c14003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:45.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.555+0000 7f0c267fc700 1 --2- 172.21.15.38:0/1114155987 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c2809df00 0x7f0c14004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:45.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.555+0000 7f0c267fc700 1 --2- 172.21.15.38:0/1114155987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c14004540 0x7f0c140049c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:45.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.555+0000 7f0c267fc700 1 -- 172.21.15.38:0/1114155987 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c280b48f0 con 0x7f0c14003750 2020-06-12T17:50:45.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.555+0000 7f0c267fc700 1 -- 172.21.15.38:0/1114155987 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c14004f10 con 0x7f0c14004540 2020-06-12T17:50:45.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.555+0000 7f0c267fc700 1 -- 172.21.15.38:0/1114155987 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c140050d0 con 0x7f0c2809df00 2020-06-12T17:50:45.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.555+0000 7f0c277fe700 1 --2- 172.21.15.38:0/1114155987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c14003750 0x7f0c14003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:45.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.555+0000 7f0c27fff700 1 --2- 172.21.15.38:0/1114155987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c14004540 0x7f0c140049c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:45.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.555+0000 7f0c26ffd700 1 --2- 172.21.15.38:0/1114155987 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c2809df00 0x7f0c14004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:45.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.555+0000 7f0c277fe700 1 -- 172.21.15.38:0/1114155987 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c2809df00 msgr2=0x7f0c14004020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:45.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.555+0000 7f0c277fe700 1 --2- 172.21.15.38:0/1114155987 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c2809df00 0x7f0c14004020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:45.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.555+0000 7f0c277fe700 1 -- 172.21.15.38:0/1114155987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c14004540 msgr2=0x7f0c140049c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:45.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.555+0000 7f0c277fe700 1 --2- 172.21.15.38:0/1114155987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c14004540 0x7f0c140049c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:45.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.555+0000 7f0c277fe700 1 -- 172.21.15.38:0/1114155987 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c14003230 con 0x7f0c14003750 2020-06-12T17:50:45.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.555+0000 7f0c27fff700 1 --2- 172.21.15.38:0/1114155987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c14004540 0x7f0c140049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:50:45.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.555+0000 7f0c277fe700 1 --2- 172.21.15.38:0/1114155987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c14003750 0x7f0c14003b30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0c180013e0 tx=0x7f0c280ae460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.555+0000 7f0c277fe700 1 --2- 172.21.15.38:0/1114155987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c14003750 0x7f0c14003b30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0c180013e0 tx=0x7f0c280ae460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.555+0000 7f0c277fe700 1 --2- 172.21.15.38:0/1114155987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c14003750 0x7f0c14003b30 secure :-1 s=READY pgs=728 cs=0 l=1 rx=0x7f0c180013e0 tx=0x7f0c280ae460).ready entity=mon.0 client_cookie=adff7299837e6c8a server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:45.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.556+0000 7f0c277fe700 1 --2- 172.21.15.38:0/1114155987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c14003750 0x7f0c14003b30 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7f0c180013e0 tx=0x7f0c280ae460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.556+0000 7f0c277fe700 1 --2- 172.21.15.38:0/1114155987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c14003750 0x7f0c14003b30 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7f0c180013e0 tx=0x7f0c280ae460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.556+0000 7f0c267fc700 1 -- 172.21.15.38:0/1114155987 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c1800e160 con 0x7f0c14003750 2020-06-12T17:50:45.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.556+0000 7f0c277fe700 1 --2- 172.21.15.38:0/1114155987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c14003750 0x7f0c14003b30 secure :-1 s=THROTTLE_DONE pgs=728 cs=0 l=1 rx=0x7f0c180013e0 tx=0x7f0c280ae460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.556+0000 7f0c267fc700 1 -- 172.21.15.38:0/1114155987 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1800e2c0 con 0x7f0c14003750 2020-06-12T17:50:45.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.556+0000 7f0c267fc700 1 -- 172.21.15.38:0/1114155987 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c1800e660 con 0x7f0c14003750 2020-06-12T17:50:45.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.556+0000 7f0c2db8f700 1 -- 172.21.15.38:0/1114155987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c14003750 msgr2=0x7f0c14003b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:45.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.556+0000 7f0c2db8f700 1 --2- 172.21.15.38:0/1114155987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c14003750 0x7f0c14003b30 secure :-1 s=READY pgs=728 cs=0 l=1 rx=0x7f0c180013e0 tx=0x7f0c280ae460).stop 2020-06-12T17:50:45.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.556+0000 7f0c27fff700 1 -- 172.21.15.38:0/1114155987 reap_dead start 2020-06-12T17:50:45.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.556+0000 7f0c2db8f700 1 -- 172.21.15.38:0/1114155987 shutdown_connections 2020-06-12T17:50:45.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.556+0000 7f0c2db8f700 1 -- 172.21.15.38:0/1114155987 >> 172.21.15.38:0/1114155987 conn(0x7f0c280b5a20 msgr2=0x7f0c2805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:45.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.556+0000 7f0c2db8f700 1 -- 172.21.15.38:0/1114155987 shutdown_connections 2020-06-12T17:50:45.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.556+0000 7f0c2db8f700 1 -- 172.21.15.38:0/1114155987 wait complete. 2020-06-12T17:50:45.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.557+0000 7f0c2db8f700 1 Processor -- start 2020-06-12T17:50:45.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.557+0000 7f0c2db8f700 1 -- start start 2020-06-12T17:50:45.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.558+0000 7f0c2db8f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c2805ab40 0x7f0c2805afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:45.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.558+0000 7f0c2db8f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0c281435f0 0x7f0c28143a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:45.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.558+0000 7f0c2db8f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c28063740 con 0x7f0c2813c4f0 2020-06-12T17:50:45.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.558+0000 7f0c2db8f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c2813c8d0 con 0x7f0c281435f0 2020-06-12T17:50:45.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.558+0000 7f0c2db8f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c280639b0 con 0x7f0c2805ab40 2020-06-12T17:50:45.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.558+0000 7f0c26ffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c2805ab40 0x7f0c2805afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:45.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.558+0000 7f0c27fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0c281435f0 0x7f0c28143a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:45.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.558+0000 7f0c27fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0c281435f0 0x7f0c28143a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:48566/0 (socket says 172.21.15.38:48566) 2020-06-12T17:50:45.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.558+0000 7f0c27fff700 1 -- 172.21.15.38:0/2193546339 learned_addr learned my addr 172.21.15.38:0/2193546339 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:45.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.558+0000 7f0c26ffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c2805ab40 0x7f0c2805afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.38:58546/0 (socket says 172.21.15.38:58546) 2020-06-12T17:50:45.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.559+0000 7f0c26ffd700 1 -- 172.21.15.38:0/2193546339 >> v2:172.21.15.150:3300/0 conn(0x7f0c281435f0 msgr2=0x7f0c28143a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:45.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.559+0000 7f0c26ffd700 1 --2- 172.21.15.38:0/2193546339 >> v2:172.21.15.150:3300/0 conn(0x7f0c281435f0 0x7f0c28143a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:45.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.559+0000 7f0c26ffd700 1 -- 172.21.15.38:0/2193546339 >> v1:172.21.15.150:6789/0 conn(0x7f0c2813c4f0 legacy=0x7f0c28063030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:45.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.559+0000 7f0c24ff9700 1 -- 172.21.15.38:0/2193546339 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2870952571 0 0) 0x7f0c28063740 con 0x7f0c2813c4f0 2020-06-12T17:50:45.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.559+0000 7f0c26ffd700 1 -- 172.21.15.38:0/2193546339 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c28063c50 con 0x7f0c2805ab40 2020-06-12T17:50:45.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.559+0000 7f0c27fff700 1 --2- 172.21.15.38:0/2193546339 >> v2:172.21.15.150:3300/0 conn(0x7f0c281435f0 0x7f0c28143a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:50:45.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.559+0000 7f0c26ffd700 1 --2- 172.21.15.38:0/2193546339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c2805ab40 0x7f0c2805afa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0c1c002f30 tx=0x7f0c1c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.559+0000 7f0c26ffd700 1 --2- 172.21.15.38:0/2193546339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c2805ab40 0x7f0c2805afa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0c1c002f30 tx=0x7f0c1c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.559+0000 7f0c26ffd700 1 --2- 172.21.15.38:0/2193546339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c2805ab40 0x7f0c2805afa0 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f0c1c002f30 tx=0x7f0c1c007e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:45.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.559+0000 7f0c26ffd700 1 --2- 172.21.15.38:0/2193546339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c2805ab40 0x7f0c2805afa0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f0c1c002f30 tx=0x7f0c1c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.559+0000 7f0c24ff9700 1 -- 172.21.15.38:0/2193546339 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c1c005e90 con 0x7f0c2805ab40 2020-06-12T17:50:45.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.559+0000 7f0c26ffd700 1 --2- 172.21.15.38:0/2193546339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c2805ab40 0x7f0c2805afa0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f0c1c002f30 tx=0x7f0c1c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.559+0000 7f0c24ff9700 1 -- 172.21.15.38:0/2193546339 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1c007160 con 0x7f0c2805ab40 2020-06-12T17:50:45.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.559+0000 7f0c2db8f700 1 -- 172.21.15.38:0/2193546339 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c28063ef0 con 0x7f0c2805ab40 2020-06-12T17:50:45.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.559+0000 7f0c26ffd700 1 --2- 172.21.15.38:0/2193546339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c2805ab40 0x7f0c2805afa0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f0c1c002f30 tx=0x7f0c1c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.559+0000 7f0c24ff9700 1 -- 172.21.15.38:0/2193546339 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c1c007540 con 0x7f0c2805ab40 2020-06-12T17:50:45.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.559+0000 7f0c2db8f700 1 -- 172.21.15.38:0/2193546339 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c281448a0 con 0x7f0c2805ab40 2020-06-12T17:50:45.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.560+0000 7f0c26ffd700 1 --2- 172.21.15.38:0/2193546339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c2805ab40 0x7f0c2805afa0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f0c1c002f30 tx=0x7f0c1c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.560+0000 7f0c2db8f700 1 -- 172.21.15.38:0/2193546339 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c28056c30 con 0x7f0c2805ab40 2020-06-12T17:50:45.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.560+0000 7f0c24ff9700 1 -- 172.21.15.38:0/2193546339 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f0c1c008410 con 0x7f0c2805ab40 2020-06-12T17:50:45.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.560+0000 7f0c26ffd700 1 --2- 172.21.15.38:0/2193546339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c2805ab40 0x7f0c2805afa0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f0c1c002f30 tx=0x7f0c1c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.561+0000 7f0c24ff9700 1 --2- 172.21.15.38:0/2193546339 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0c0804d430 0x7f0c0804f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:45.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.561+0000 7f0c24ff9700 1 -- 172.21.15.38:0/2193546339 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0c1c061210 con 0x7f0c2805ab40 2020-06-12T17:50:45.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.561+0000 7f0c277fe700 1 --2- 172.21.15.38:0/2193546339 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0c0804d430 0x7f0c0804f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:45.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.561+0000 7f0c277fe700 1 --2- 172.21.15.38:0/2193546339 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0c0804d430 0x7f0c0804f8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0c18001000 tx=0x7f0c280ae460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.561+0000 7f0c277fe700 1 --2- 172.21.15.38:0/2193546339 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0c0804d430 0x7f0c0804f8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0c18001000 tx=0x7f0c280ae460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.561+0000 7f0c277fe700 1 --2- 172.21.15.38:0/2193546339 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0c0804d430 0x7f0c0804f8f0 secure :-1 s=READY pgs=284 cs=0 l=1 rx=0x7f0c18001000 tx=0x7f0c280ae460).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:45.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.564+0000 7f0c26ffd700 1 --2- 172.21.15.38:0/2193546339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c2805ab40 0x7f0c2805afa0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f0c1c002f30 tx=0x7f0c1c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.564+0000 7f0c24ff9700 1 -- 172.21.15.38:0/2193546339 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f0c1c03c8b0 con 0x7f0c2805ab40 2020-06-12T17:50:45.763 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.759+0000 7f0c2db8f700 1 -- 172.21.15.38:0/2193546339 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_2088", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c2805a5e0 con 0x7f0c0804d430 2020-06-12T17:50:45.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.779+0000 7f0c277fe700 1 --2- 172.21.15.38:0/2193546339 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0c0804d430 0x7f0c0804f8f0 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7f0c18001000 tx=0x7f0c280ae460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.779+0000 7f0c24ff9700 1 -- 172.21.15.38:0/2193546339 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0c2805a5e0 con 0x7f0c0804d430 2020-06-12T17:50:45.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.781+0000 7f0c2db8f700 1 -- 172.21.15.38:0/2193546339 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0c0804d430 msgr2=0x7f0c0804f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:45.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.781+0000 7f0c2db8f700 1 --2- 172.21.15.38:0/2193546339 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0c0804d430 0x7f0c0804f8f0 secure :-1 s=READY pgs=284 cs=0 l=1 rx=0x7f0c18001000 tx=0x7f0c280ae460).stop 2020-06-12T17:50:45.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.781+0000 7f0c2db8f700 1 -- 172.21.15.38:0/2193546339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c2805ab40 msgr2=0x7f0c2805afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:45.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.781+0000 7f0c2db8f700 1 --2- 172.21.15.38:0/2193546339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c2805ab40 0x7f0c2805afa0 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f0c1c002f30 tx=0x7f0c1c007e60).stop 2020-06-12T17:50:45.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.781+0000 7f0c2db8f700 1 -- 172.21.15.38:0/2193546339 shutdown_connections 2020-06-12T17:50:45.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.781+0000 7f0c2db8f700 1 --2- 172.21.15.38:0/2193546339 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0c0804d430 0x7f0c0804f8f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:45.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.781+0000 7f0c2db8f700 1 --2- 172.21.15.38:0/2193546339 >> v2:172.21.15.150:3300/0 conn(0x7f0c281435f0 0x7f0c28143a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:45.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.781+0000 7f0c2db8f700 1 --2- 172.21.15.38:0/2193546339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c2805ab40 0x7f0c2805afa0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:45.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.781+0000 7f0c2db8f700 1 -- 172.21.15.38:0/2193546339 >> 172.21.15.38:0/2193546339 conn(0x7f0c280b5a20 msgr2=0x7f0c280b7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:45.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.781+0000 7f0c2db8f700 1 -- 172.21.15.38:0/2193546339 shutdown_connections 2020-06-12T17:50:45.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.781+0000 7f0c2db8f700 1 -- 172.21.15.38:0/2193546339 wait complete. 2020-06-12T17:50:45.795 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_2088 2020-06-12T17:50:45.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.907+0000 7f76cf325700 1 Processor -- start 2020-06-12T17:50:45.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.907+0000 7f76cf325700 1 -- start start 2020-06-12T17:50:45.914 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.908+0000 7f76cf325700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f76c80ad5b0 0x7f76c80b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:45.914 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.908+0000 7f76cf325700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f76c809d8d0 0x7f76c81421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:45.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.908+0000 7f76cf325700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c8146d20 con 0x7f76c8146680 2020-06-12T17:50:45.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.908+0000 7f76cf325700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c8066a80 con 0x7f76c809d8d0 2020-06-12T17:50:45.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.908+0000 7f76cf325700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c8146f50 con 0x7f76c80ad5b0 2020-06-12T17:50:45.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.908+0000 7f76cd8c2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f76c809d8d0 0x7f76c81421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:45.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.908+0000 7f76cd0c1700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f76c8146680 0x7f76c809d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40910/0 (socket says 172.21.15.38:40910) 2020-06-12T17:50:45.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.908+0000 7f76cd8c2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f76c809d8d0 0x7f76c81421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39098/0 (socket says 172.21.15.38:39098) 2020-06-12T17:50:45.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.908+0000 7f76cd8c2700 1 -- 172.21.15.38:0/1288674670 learned_addr learned my addr 172.21.15.38:0/1288674670 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:45.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.908+0000 7f76cc8c0700 1 --2- 172.21.15.38:0/1288674670 >> v2:172.21.15.150:3300/0 conn(0x7f76c80ad5b0 0x7f76c80b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:45.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.909+0000 7f76cd8c2700 1 -- 172.21.15.38:0/1288674670 >> v2:172.21.15.150:3300/0 conn(0x7f76c80ad5b0 msgr2=0x7f76c80b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:45.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.909+0000 7f76cd8c2700 1 --2- 172.21.15.38:0/1288674670 >> v2:172.21.15.150:3300/0 conn(0x7f76c80ad5b0 0x7f76c80b2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:45.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.909+0000 7f76cd8c2700 1 -- 172.21.15.38:0/1288674670 >> v1:172.21.15.38:6789/0 conn(0x7f76c8146680 legacy=0x7f76c809d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:45.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.909+0000 7f76bbfff700 1 -- 172.21.15.38:0/1288674670 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3807122855 0 0) 0x7f76c8146d20 con 0x7f76c8146680 2020-06-12T17:50:45.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.909+0000 7f76cd8c2700 1 -- 172.21.15.38:0/1288674670 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c8146a60 con 0x7f76c809d8d0 2020-06-12T17:50:45.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.909+0000 7f76cd8c2700 1 --2- 172.21.15.38:0/1288674670 >> v2:172.21.15.38:3300/0 conn(0x7f76c809d8d0 0x7f76c81421d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f76c00032b0 tx=0x7f76c00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.909+0000 7f76cd8c2700 1 --2- 172.21.15.38:0/1288674670 >> v2:172.21.15.38:3300/0 conn(0x7f76c809d8d0 0x7f76c81421d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f76c00032b0 tx=0x7f76c00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.909+0000 7f76cd8c2700 1 --2- 172.21.15.38:0/1288674670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76c809d8d0 0x7f76c81421d0 secure :-1 s=READY pgs=730 cs=0 l=1 rx=0x7f76c00032b0 tx=0x7f76c00081e0).ready entity=mon.0 client_cookie=d779633166dc6e52 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:45.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.909+0000 7f76cd8c2700 1 --2- 172.21.15.38:0/1288674670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76c809d8d0 0x7f76c81421d0 secure :-1 s=THROTTLE_DONE pgs=730 cs=0 l=1 rx=0x7f76c00032b0 tx=0x7f76c00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.909+0000 7f76bbfff700 1 -- 172.21.15.38:0/1288674670 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76c000a160 con 0x7f76c809d8d0 2020-06-12T17:50:45.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.909+0000 7f76cd8c2700 1 --2- 172.21.15.38:0/1288674670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76c809d8d0 0x7f76c81421d0 secure :-1 s=THROTTLE_DONE pgs=730 cs=0 l=1 rx=0x7f76c00032b0 tx=0x7f76c00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.909+0000 7f76cd8c2700 1 --2- 172.21.15.38:0/1288674670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76c809d8d0 0x7f76c81421d0 secure :-1 s=THROTTLE_DONE pgs=730 cs=0 l=1 rx=0x7f76c00032b0 tx=0x7f76c00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.909+0000 7f76bbfff700 1 -- 172.21.15.38:0/1288674670 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c000a2c0 con 0x7f76c809d8d0 2020-06-12T17:50:45.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.909+0000 7f76bbfff700 1 -- 172.21.15.38:0/1288674670 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76c000a660 con 0x7f76c809d8d0 2020-06-12T17:50:45.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.909+0000 7f76cf325700 1 -- 172.21.15.38:0/1288674670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76c809d8d0 msgr2=0x7f76c81421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:45.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.909+0000 7f76cf325700 1 --2- 172.21.15.38:0/1288674670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76c809d8d0 0x7f76c81421d0 secure :-1 s=READY pgs=730 cs=0 l=1 rx=0x7f76c00032b0 tx=0x7f76c00081e0).stop 2020-06-12T17:50:45.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.909+0000 7f76cf325700 1 -- 172.21.15.38:0/1288674670 shutdown_connections 2020-06-12T17:50:45.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.909+0000 7f76cf325700 1 --2- 172.21.15.38:0/1288674670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76c809d8d0 0x7f76c81421d0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:45.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.909+0000 7f76cf325700 1 --2- 172.21.15.38:0/1288674670 >> v2:172.21.15.150:3300/0 conn(0x7f76c80ad5b0 0x7f76c80b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:45.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.909+0000 7f76cf325700 1 -- 172.21.15.38:0/1288674670 >> 172.21.15.38:0/1288674670 conn(0x7f76c80b5a20 msgr2=0x7f76c805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:45.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.909+0000 7f76cf325700 1 -- 172.21.15.38:0/1288674670 shutdown_connections 2020-06-12T17:50:45.920 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.909+0000 7f76cf325700 1 -- 172.21.15.38:0/1288674670 wait complete. 2020-06-12T17:50:45.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.910+0000 7f76cf325700 1 Processor -- start 2020-06-12T17:50:45.923 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.910+0000 7f76cf325700 1 -- start start 2020-06-12T17:50:45.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.911+0000 7f76cf325700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f76c809d8d0 0x7f76c80afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:45.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.911+0000 7f76cf325700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76c8146680 0x7f76c8138ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:45.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.911+0000 7f76cf325700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c80b0a90 con 0x7f76c80ad5b0 2020-06-12T17:50:45.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.911+0000 7f76cf325700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c8063960 con 0x7f76c809d8d0 2020-06-12T17:50:45.924 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.911+0000 7f76cf325700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c8063c00 con 0x7f76c8146680 2020-06-12T17:50:45.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.911+0000 7f76cd0c1700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f76c809d8d0 0x7f76c80afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:45.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.911+0000 7f76cd0c1700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f76c809d8d0 0x7f76c80afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39100/0 (socket says 172.21.15.38:39100) 2020-06-12T17:50:45.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.911+0000 7f76cd0c1700 1 -- 172.21.15.38:0/3594618981 learned_addr learned my addr 172.21.15.38:0/3594618981 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:45.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.911+0000 7f76cd0c1700 1 -- 172.21.15.38:0/3594618981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76c8146680 msgr2=0x7f76c8138ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:45.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.911+0000 7f76cd0c1700 1 --2- 172.21.15.38:0/3594618981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76c8146680 0x7f76c8138ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:45.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.911+0000 7f76cd0c1700 1 -- 172.21.15.38:0/3594618981 >> v1:172.21.15.150:6789/0 conn(0x7f76c80ad5b0 legacy=0x7f76c813b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:45.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.911+0000 7f76cd0c1700 1 -- 172.21.15.38:0/3594618981 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c8061510 con 0x7f76c809d8d0 2020-06-12T17:50:45.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.911+0000 7f76cd0c1700 1 --2- 172.21.15.38:0/3594618981 >> v2:172.21.15.38:3300/0 conn(0x7f76c809d8d0 0x7f76c80afd80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f76c813c470 tx=0x7f76bc001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.912+0000 7f76cd0c1700 1 --2- 172.21.15.38:0/3594618981 >> v2:172.21.15.38:3300/0 conn(0x7f76c809d8d0 0x7f76c80afd80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f76c813c470 tx=0x7f76bc001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.912+0000 7f76cd0c1700 1 --2- 172.21.15.38:0/3594618981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76c809d8d0 0x7f76c80afd80 secure :-1 s=READY pgs=731 cs=0 l=1 rx=0x7f76c813c470 tx=0x7f76bc001780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:45.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.912+0000 7f76cd0c1700 1 --2- 172.21.15.38:0/3594618981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76c809d8d0 0x7f76c80afd80 secure :-1 s=THROTTLE_DONE pgs=731 cs=0 l=1 rx=0x7f76c813c470 tx=0x7f76bc001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.912+0000 7f76cd0c1700 1 --2- 172.21.15.38:0/3594618981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76c809d8d0 0x7f76c80afd80 secure :-1 s=THROTTLE_DONE pgs=731 cs=0 l=1 rx=0x7f76c813c470 tx=0x7f76bc001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.912+0000 7f76ba7fc700 1 -- 172.21.15.38:0/3594618981 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76bc011660 con 0x7f76c809d8d0 2020-06-12T17:50:45.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.912+0000 7f76cd0c1700 1 --2- 172.21.15.38:0/3594618981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76c809d8d0 0x7f76c80afd80 secure :-1 s=THROTTLE_DONE pgs=731 cs=0 l=1 rx=0x7f76c813c470 tx=0x7f76bc001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.912+0000 7f76ba7fc700 1 -- 172.21.15.38:0/3594618981 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76bc0117c0 con 0x7f76c809d8d0 2020-06-12T17:50:45.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.912+0000 7f76cf325700 1 -- 172.21.15.38:0/3594618981 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c813bd80 con 0x7f76c809d8d0 2020-06-12T17:50:45.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.912+0000 7f76ba7fc700 1 -- 172.21.15.38:0/3594618981 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76bc011be0 con 0x7f76c809d8d0 2020-06-12T17:50:45.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.912+0000 7f76cf325700 1 -- 172.21.15.38:0/3594618981 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c8144ea0 con 0x7f76c809d8d0 2020-06-12T17:50:45.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.912+0000 7f76cd0c1700 1 --2- 172.21.15.38:0/3594618981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76c809d8d0 0x7f76c80afd80 secure :-1 s=THROTTLE_DONE pgs=731 cs=0 l=1 rx=0x7f76c813c470 tx=0x7f76bc001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.913+0000 7f76cf325700 1 -- 172.21.15.38:0/3594618981 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c8056c30 con 0x7f76c809d8d0 2020-06-12T17:50:45.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.913+0000 7f76ba7fc700 1 -- 172.21.15.38:0/3594618981 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f76bc00b0a0 con 0x7f76c809d8d0 2020-06-12T17:50:45.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.913+0000 7f76cd0c1700 1 --2- 172.21.15.38:0/3594618981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76c809d8d0 0x7f76c80afd80 secure :-1 s=THROTTLE_DONE pgs=731 cs=0 l=1 rx=0x7f76c813c470 tx=0x7f76bc001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.913+0000 7f76ba7fc700 1 --2- 172.21.15.38:0/3594618981 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f76a804d680 0x7f76a804fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:45.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.913+0000 7f76ba7fc700 1 -- 172.21.15.38:0/3594618981 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f76bc060e80 con 0x7f76c809d8d0 2020-06-12T17:50:45.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.913+0000 7f76cc8c0700 1 --2- 172.21.15.38:0/3594618981 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f76a804d680 0x7f76a804fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:45.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.914+0000 7f76cc8c0700 1 --2- 172.21.15.38:0/3594618981 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f76a804d680 0x7f76a804fb40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f76c4002f30 tx=0x7f76c4005910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.914+0000 7f76cc8c0700 1 --2- 172.21.15.38:0/3594618981 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f76a804d680 0x7f76a804fb40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f76c4002f30 tx=0x7f76c4005910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.914+0000 7f76cc8c0700 1 --2- 172.21.15.38:0/3594618981 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f76a804d680 0x7f76a804fb40 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7f76c4002f30 tx=0x7f76c4005910).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:45.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.916+0000 7f76cd0c1700 1 --2- 172.21.15.38:0/3594618981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76c809d8d0 0x7f76c80afd80 secure :-1 s=THROTTLE_DONE pgs=731 cs=0 l=1 rx=0x7f76c813c470 tx=0x7f76bc001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:45.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:45.917+0000 7f76ba7fc700 1 -- 172.21.15.38:0/3594618981 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f76bc03c540 con 0x7f76c809d8d0 2020-06-12T17:50:46.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:46.110+0000 7f76cf325700 1 -- 172.21.15.38:0/3594618981 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_2088", "target": ["mon-mgr", ""]}) v1 -- 0x7f76c80616a0 con 0x7f76a804d680 2020-06-12T17:50:46.118 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:46.114+0000 7f76cc8c0700 1 --2- 172.21.15.38:0/3594618981 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f76a804d680 0x7f76a804fb40 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7f76c4002f30 tx=0x7f76c4005910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:46.119 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:46.114+0000 7f76ba7fc700 1 -- 172.21.15.38:0/3594618981 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f76c400ddb0 con 0x7f76a804d680 2020-06-12T17:50:46.119 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_2088/6a415631-db2a-40fd-8b50-88403ff972d1 2020-06-12T17:50:46.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:46.115+0000 7f76cf325700 1 -- 172.21.15.38:0/3594618981 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f76a804d680 msgr2=0x7f76a804fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:46.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:46.115+0000 7f76cf325700 1 --2- 172.21.15.38:0/3594618981 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f76a804d680 0x7f76a804fb40 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7f76c4002f30 tx=0x7f76c4005910).stop 2020-06-12T17:50:46.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:46.115+0000 7f76cf325700 1 -- 172.21.15.38:0/3594618981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76c809d8d0 msgr2=0x7f76c80afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:46.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:46.115+0000 7f76cf325700 1 --2- 172.21.15.38:0/3594618981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76c809d8d0 0x7f76c80afd80 secure :-1 s=READY pgs=731 cs=0 l=1 rx=0x7f76c813c470 tx=0x7f76bc001780).stop 2020-06-12T17:50:46.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:46.115+0000 7f76cf325700 1 -- 172.21.15.38:0/3594618981 shutdown_connections 2020-06-12T17:50:46.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:46.115+0000 7f76cf325700 1 --2- 172.21.15.38:0/3594618981 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f76a804d680 0x7f76a804fb40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:46.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:46.115+0000 7f76cf325700 1 --2- 172.21.15.38:0/3594618981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76c8146680 0x7f76c8138ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:46.121 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:46.115+0000 7f76cf325700 1 --2- 172.21.15.38:0/3594618981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76c809d8d0 0x7f76c80afd80 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:46.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:46.115+0000 7f76cf325700 1 -- 172.21.15.38:0/3594618981 >> 172.21.15.38:0/3594618981 conn(0x7f76c80b5a20 msgr2=0x7f76c80b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:46.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:46.116+0000 7f76cf325700 1 -- 172.21.15.38:0/3594618981 shutdown_connections 2020-06-12T17:50:46.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:46.116+0000 7f76cf325700 1 -- 172.21.15.38:0/3594618981 wait complete. 2020-06-12T17:50:46.130 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_2088 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_2088/6a415631-db2a-40fd-8b50-88403ff972d1 2020-06-12T17:50:46.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:46.131 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:46.131 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:46.146 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:46.146 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:46.147 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2088/6a415631-db2a-40fd-8b50-88403ff972d1/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:46.239 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:46.239 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:46.239 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127893 s, 82.0 MB/s 2020-06-12T17:50:46.240 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:46.241 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:46.241 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:46.256 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:46.257 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:46.257 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2088/6a415631-db2a-40fd-8b50-88403ff972d1/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:46.353 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:46.353 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:46.354 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111454 s, 94.1 MB/s 2020-06-12T17:50:46.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:46.355 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:46.355 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:46.369 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:46.370 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:46.371 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2088/6a415631-db2a-40fd-8b50-88403ff972d1/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:46.459 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:46.459 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:46.460 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113005 s, 92.8 MB/s 2020-06-12T17:50:46.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:46.461 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:46.462 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:46.476 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:46.477 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:46.477 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2088/6a415631-db2a-40fd-8b50-88403ff972d1/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:46.566 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:46.566 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:46.567 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116026 s, 90.4 MB/s 2020-06-12T17:50:46.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:46.568 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:46.568 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:46.583 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:46.584 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:46.584 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2088/6a415631-db2a-40fd-8b50-88403ff972d1/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:46.672 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:46.673 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:46.673 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948989 s, 110 MB/s 2020-06-12T17:50:46.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:46.674 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:46.675 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:46.689 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:46.690 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:46.691 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2088/6a415631-db2a-40fd-8b50-88403ff972d1/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:46.776 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:46.777 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:46.777 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0091916 s, 114 MB/s 2020-06-12T17:50:46.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:46.778 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:46.779 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:46.793 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:46.794 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:46.795 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2088/6a415631-db2a-40fd-8b50-88403ff972d1/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:46.880 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:46.881 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:46.881 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939227 s, 112 MB/s 2020-06-12T17:50:46.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:46.883 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:46.883 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:46.897 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:46.898 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:46.899 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2088/6a415631-db2a-40fd-8b50-88403ff972d1/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:46.988 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:46.989 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:46.989 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109722 s, 95.6 MB/s 2020-06-12T17:50:46.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:46.990 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:46.991 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:47.006 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:47.006 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:47.006 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2088/6a415631-db2a-40fd-8b50-88403ff972d1/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:47.098 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:47.098 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:47.099 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112658 s, 93.1 MB/s 2020-06-12T17:50:47.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:47.100 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:47.100 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:47.115 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:47.116 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:47.116 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2088/6a415631-db2a-40fd-8b50-88403ff972d1/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:47.205 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:47.206 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:47.206 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922469 s, 114 MB/s 2020-06-12T17:50:47.206 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_5498 2020-06-12T17:50:47.324 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.320+0000 7fa33521c700 1 Processor -- start 2020-06-12T17:50:47.325 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.320+0000 7fa33521c700 1 -- start start 2020-06-12T17:50:47.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.321+0000 7fa33521c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa330146680 0x7fa3300ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:47.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.321+0000 7fa33521c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa3300b2eb0 0x7fa33009d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:47.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.321+0000 7fa33521c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa330146d20 con 0x7fa33009d620 2020-06-12T17:50:47.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.321+0000 7fa33521c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa330066a80 con 0x7fa3300b2eb0 2020-06-12T17:50:47.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.321+0000 7fa33521c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa330146f50 con 0x7fa330146680 2020-06-12T17:50:47.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.321+0000 7fa32e59c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa3300b2eb0 0x7fa33009d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:47.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.321+0000 7fa32f59e700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fa33009d620 0x7fa33009b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:33424/0 (socket says 172.21.15.38:33424) 2020-06-12T17:50:47.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.321+0000 7fa32ed9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa330146680 0x7fa3300ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:47.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.321+0000 7fa32f59e700 1 -- 172.21.15.38:0/4227030769 learned_addr learned my addr 172.21.15.38:0/4227030769 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:47.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.322+0000 7fa32ed9d700 1 -- 172.21.15.38:0/4227030769 >> v2:172.21.15.150:3300/0 conn(0x7fa3300b2eb0 msgr2=0x7fa33009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:47.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.322+0000 7fa32ed9d700 1 --2- 172.21.15.38:0/4227030769 >> v2:172.21.15.150:3300/0 conn(0x7fa3300b2eb0 0x7fa33009d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:47.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.322+0000 7fa32ed9d700 1 -- 172.21.15.38:0/4227030769 >> v1:172.21.15.150:6789/0 conn(0x7fa33009d620 legacy=0x7fa33009b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:47.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.322+0000 7fa32ed9d700 1 -- 172.21.15.38:0/4227030769 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa330146a60 con 0x7fa330146680 2020-06-12T17:50:47.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.322+0000 7fa32e59c700 1 --2- 172.21.15.38:0/4227030769 >> v2:172.21.15.150:3300/0 conn(0x7fa3300b2eb0 0x7fa33009d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:50:47.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.322+0000 7fa32ed9d700 1 --2- 172.21.15.38:0/4227030769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa330146680 0x7fa3300ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa324002f30 tx=0x7fa324007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.322+0000 7fa32ed9d700 1 --2- 172.21.15.38:0/4227030769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa330146680 0x7fa3300ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa324002f30 tx=0x7fa324007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.322+0000 7fa32ed9d700 1 --2- 172.21.15.38:0/4227030769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa330146680 0x7fa3300ad5b0 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7fa324002f30 tx=0x7fa324007e60).ready entity=mon.2 client_cookie=db5439737fc2275a server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:47.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.322+0000 7fa32ed9d700 1 --2- 172.21.15.38:0/4227030769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa330146680 0x7fa3300ad5b0 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7fa324002f30 tx=0x7fa324007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.322+0000 7fa32dd9b700 1 -- 172.21.15.38:0/4227030769 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa324011380 con 0x7fa330146680 2020-06-12T17:50:47.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.322+0000 7fa32ed9d700 1 --2- 172.21.15.38:0/4227030769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa330146680 0x7fa3300ad5b0 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7fa324002f30 tx=0x7fa324007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.322+0000 7fa32ed9d700 1 --2- 172.21.15.38:0/4227030769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa330146680 0x7fa3300ad5b0 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7fa324002f30 tx=0x7fa324007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.322+0000 7fa32dd9b700 1 -- 172.21.15.38:0/4227030769 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3240114e0 con 0x7fa330146680 2020-06-12T17:50:47.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.322+0000 7fa32dd9b700 1 -- 172.21.15.38:0/4227030769 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa324011900 con 0x7fa330146680 2020-06-12T17:50:47.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.322+0000 7fa33521c700 1 -- 172.21.15.38:0/4227030769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa330146680 msgr2=0x7fa3300ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:47.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.322+0000 7fa33521c700 1 --2- 172.21.15.38:0/4227030769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa330146680 0x7fa3300ad5b0 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7fa324002f30 tx=0x7fa324007e60).stop 2020-06-12T17:50:47.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.323+0000 7fa33521c700 1 -- 172.21.15.38:0/4227030769 shutdown_connections 2020-06-12T17:50:47.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.323+0000 7fa33521c700 1 --2- 172.21.15.38:0/4227030769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa330146680 0x7fa3300ad5b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:47.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.323+0000 7fa33521c700 1 --2- 172.21.15.38:0/4227030769 >> v2:172.21.15.150:3300/0 conn(0x7fa3300b2eb0 0x7fa33009d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:47.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.323+0000 7fa33521c700 1 -- 172.21.15.38:0/4227030769 >> 172.21.15.38:0/4227030769 conn(0x7fa3300b5a20 msgr2=0x7fa33005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:47.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.323+0000 7fa33521c700 1 -- 172.21.15.38:0/4227030769 shutdown_connections 2020-06-12T17:50:47.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.323+0000 7fa33521c700 1 -- 172.21.15.38:0/4227030769 wait complete. 2020-06-12T17:50:47.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.324+0000 7fa33521c700 1 Processor -- start 2020-06-12T17:50:47.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.324+0000 7fa33521c700 1 -- start start 2020-06-12T17:50:47.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.324+0000 7fa33521c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa3300b2eb0 0x7fa33009aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:47.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.324+0000 7fa33521c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa330146680 0x7fa3300b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:47.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.324+0000 7fa33521c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33009b3a0 con 0x7fa33009d620 2020-06-12T17:50:47.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.324+0000 7fa33521c700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3300b2100 con 0x7fa3300b2eb0 2020-06-12T17:50:47.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.324+0000 7fa33521c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33009b100 con 0x7fa330146680 2020-06-12T17:50:47.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.324+0000 7fa32e59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa3300b2eb0 0x7fa33009aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:47.341 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.324+0000 7fa32e59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa3300b2eb0 0x7fa33009aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39114/0 (socket says 172.21.15.38:39114) 2020-06-12T17:50:47.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.324+0000 7fa32e59c700 1 -- 172.21.15.38:0/201265379 learned_addr learned my addr 172.21.15.38:0/201265379 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:47.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.324+0000 7fa32f59e700 1 --2- 172.21.15.38:0/201265379 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa330146680 0x7fa3300b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:47.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.325+0000 7fa32e59c700 1 -- 172.21.15.38:0/201265379 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa330146680 msgr2=0x7fa3300b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:47.342 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.325+0000 7fa32e59c700 1 --2- 172.21.15.38:0/201265379 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa330146680 0x7fa3300b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:47.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.325+0000 7fa31ffff700 1 -- 172.21.15.38:0/201265379 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2116298668 0 0) 0x7fa33009b3a0 con 0x7fa33009d620 2020-06-12T17:50:47.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.325+0000 7fa32e59c700 1 -- 172.21.15.38:0/201265379 >> v1:172.21.15.150:6789/0 conn(0x7fa33009d620 legacy=0x7fa33009c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:47.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.325+0000 7fa32e59c700 1 -- 172.21.15.38:0/201265379 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3301556a0 con 0x7fa3300b2eb0 2020-06-12T17:50:47.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.325+0000 7fa32e59c700 1 --2- 172.21.15.38:0/201265379 >> v2:172.21.15.38:3300/0 conn(0x7fa3300b2eb0 0x7fa33009aa10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa320003270 tx=0x7fa3200081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.325+0000 7fa32e59c700 1 --2- 172.21.15.38:0/201265379 >> v2:172.21.15.38:3300/0 conn(0x7fa3300b2eb0 0x7fa33009aa10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa320003270 tx=0x7fa3200081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.325+0000 7fa32e59c700 1 --2- 172.21.15.38:0/201265379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3300b2eb0 0x7fa33009aa10 secure :-1 s=READY pgs=732 cs=0 l=1 rx=0x7fa320003270 tx=0x7fa3200081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:47.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.325+0000 7fa32e59c700 1 --2- 172.21.15.38:0/201265379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3300b2eb0 0x7fa33009aa10 secure :-1 s=THROTTLE_DONE pgs=732 cs=0 l=1 rx=0x7fa320003270 tx=0x7fa3200081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.325+0000 7fa31ffff700 1 -- 172.21.15.38:0/201265379 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa32000eb90 con 0x7fa3300b2eb0 2020-06-12T17:50:47.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.325+0000 7fa32e59c700 1 --2- 172.21.15.38:0/201265379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3300b2eb0 0x7fa33009aa10 secure :-1 s=THROTTLE_DONE pgs=732 cs=0 l=1 rx=0x7fa320003270 tx=0x7fa3200081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.325+0000 7fa31ffff700 1 -- 172.21.15.38:0/201265379 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32000ed30 con 0x7fa3300b2eb0 2020-06-12T17:50:47.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.325+0000 7fa32e59c700 1 --2- 172.21.15.38:0/201265379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3300b2eb0 0x7fa33009aa10 secure :-1 s=THROTTLE_DONE pgs=732 cs=0 l=1 rx=0x7fa320003270 tx=0x7fa3200081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.325+0000 7fa33521c700 1 -- 172.21.15.38:0/201265379 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa33009ce30 con 0x7fa3300b2eb0 2020-06-12T17:50:47.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.325+0000 7fa31ffff700 1 -- 172.21.15.38:0/201265379 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa32000eea0 con 0x7fa3300b2eb0 2020-06-12T17:50:47.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.325+0000 7fa33521c700 1 -- 172.21.15.38:0/201265379 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa330142280 con 0x7fa3300b2eb0 2020-06-12T17:50:47.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.326+0000 7fa32e59c700 1 --2- 172.21.15.38:0/201265379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3300b2eb0 0x7fa33009aa10 secure :-1 s=THROTTLE_DONE pgs=732 cs=0 l=1 rx=0x7fa320003270 tx=0x7fa3200081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.326+0000 7fa33521c700 1 -- 172.21.15.38:0/201265379 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33009af60 con 0x7fa3300b2eb0 2020-06-12T17:50:47.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.326+0000 7fa31ffff700 1 -- 172.21.15.38:0/201265379 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fa320012a40 con 0x7fa3300b2eb0 2020-06-12T17:50:47.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.326+0000 7fa32e59c700 1 --2- 172.21.15.38:0/201265379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3300b2eb0 0x7fa33009aa10 secure :-1 s=THROTTLE_DONE pgs=732 cs=0 l=1 rx=0x7fa320003270 tx=0x7fa3200081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.327+0000 7fa31ffff700 1 --2- 172.21.15.38:0/201265379 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa30c04d500 0x7fa30c04f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:47.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.327+0000 7fa31ffff700 1 -- 172.21.15.38:0/201265379 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa320061150 con 0x7fa3300b2eb0 2020-06-12T17:50:47.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.327+0000 7fa32ed9d700 1 --2- 172.21.15.38:0/201265379 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa30c04d500 0x7fa30c04f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:47.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.327+0000 7fa32ed9d700 1 --2- 172.21.15.38:0/201265379 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa30c04d500 0x7fa30c04f9c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa3240088e0 tx=0x7fa324007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.327+0000 7fa32ed9d700 1 --2- 172.21.15.38:0/201265379 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa30c04d500 0x7fa30c04f9c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa3240088e0 tx=0x7fa324007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.327+0000 7fa32ed9d700 1 --2- 172.21.15.38:0/201265379 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa30c04d500 0x7fa30c04f9c0 secure :-1 s=READY pgs=286 cs=0 l=1 rx=0x7fa3240088e0 tx=0x7fa324007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:47.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.330+0000 7fa32e59c700 1 --2- 172.21.15.38:0/201265379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3300b2eb0 0x7fa33009aa10 secure :-1 s=THROTTLE_DONE pgs=732 cs=0 l=1 rx=0x7fa320003270 tx=0x7fa3200081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.330+0000 7fa31ffff700 1 -- 172.21.15.38:0/201265379 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fa33009af60 con 0x7fa3300b2eb0 2020-06-12T17:50:47.530 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.525+0000 7fa33521c700 1 -- 172.21.15.38:0/201265379 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_5498", "target": ["mon-mgr", ""]}) v1 -- 0x7fa33009af60 con 0x7fa30c04d500 2020-06-12T17:50:47.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.543+0000 7fa32ed9d700 1 --2- 172.21.15.38:0/201265379 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa30c04d500 0x7fa30c04f9c0 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7fa3240088e0 tx=0x7fa324007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.543+0000 7fa31ffff700 1 -- 172.21.15.38:0/201265379 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa33009af60 con 0x7fa30c04d500 2020-06-12T17:50:47.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.545+0000 7fa33521c700 1 -- 172.21.15.38:0/201265379 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa30c04d500 msgr2=0x7fa30c04f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:47.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.545+0000 7fa33521c700 1 --2- 172.21.15.38:0/201265379 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa30c04d500 0x7fa30c04f9c0 secure :-1 s=READY pgs=286 cs=0 l=1 rx=0x7fa3240088e0 tx=0x7fa324007e60).stop 2020-06-12T17:50:47.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.545+0000 7fa33521c700 1 -- 172.21.15.38:0/201265379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3300b2eb0 msgr2=0x7fa33009aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:47.550 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.545+0000 7fa33521c700 1 --2- 172.21.15.38:0/201265379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3300b2eb0 0x7fa33009aa10 secure :-1 s=READY pgs=732 cs=0 l=1 rx=0x7fa320003270 tx=0x7fa3200081e0).stop 2020-06-12T17:50:47.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.545+0000 7fa33521c700 1 -- 172.21.15.38:0/201265379 shutdown_connections 2020-06-12T17:50:47.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.545+0000 7fa33521c700 1 --2- 172.21.15.38:0/201265379 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fa30c04d500 0x7fa30c04f9c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:47.551 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.545+0000 7fa33521c700 1 --2- 172.21.15.38:0/201265379 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa330146680 0x7fa3300b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:47.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.545+0000 7fa33521c700 1 --2- 172.21.15.38:0/201265379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3300b2eb0 0x7fa33009aa10 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:47.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.545+0000 7fa33521c700 1 -- 172.21.15.38:0/201265379 >> 172.21.15.38:0/201265379 conn(0x7fa3300b5a20 msgr2=0x7fa330145070 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:47.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.545+0000 7fa33521c700 1 -- 172.21.15.38:0/201265379 shutdown_connections 2020-06-12T17:50:47.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.545+0000 7fa33521c700 1 -- 172.21.15.38:0/201265379 wait complete. 2020-06-12T17:50:47.560 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_5498 2020-06-12T17:50:47.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.673+0000 7f57fe27e700 1 Processor -- start 2020-06-12T17:50:47.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.673+0000 7f57fe27e700 1 -- start start 2020-06-12T17:50:47.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.673+0000 7f57fe27e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57f8146680 0x7f57f80ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:47.686 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.673+0000 7f57fe27e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f8146d20 con 0x7f57f809d8d0 2020-06-12T17:50:47.686 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.673+0000 7f57fe27e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f8066a80 con 0x7f57f80b2eb0 2020-06-12T17:50:47.687 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.673+0000 7f57fe27e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f8146f50 con 0x7f57f8146680 2020-06-12T17:50:47.687 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.673+0000 7f57fc81b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f57f809d8d0 0x7f57f81421d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40936/0 (socket says 172.21.15.38:40936) 2020-06-12T17:50:47.687 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.673+0000 7f57fc81b700 1 -- 172.21.15.38:0/1860104225 learned_addr learned my addr 172.21.15.38:0/1860104225 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:47.687 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57f7fff700 1 --2- 172.21.15.38:0/1860104225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57f8146680 0x7f57f80ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:47.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57f6ffd700 1 -- 172.21.15.38:0/1860104225 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 673044365 0 0) 0x7f57f8146d20 con 0x7f57f809d8d0 2020-06-12T17:50:47.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57f6ffd700 1 -- 172.21.15.38:0/1860104225 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57e4003230 con 0x7f57f809d8d0 2020-06-12T17:50:47.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57f6ffd700 1 -- 172.21.15.38:0/1860104225 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3535730193 0 0) 0x7f57f8066a80 con 0x7f57f80b2eb0 2020-06-12T17:50:47.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57f6ffd700 1 -- 172.21.15.38:0/1860104225 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57f8146d20 con 0x7f57f80b2eb0 2020-06-12T17:50:47.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57f6ffd700 1 -- 172.21.15.38:0/1860104225 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3757829498 0 0) 0x7f57e4003230 con 0x7f57f809d8d0 2020-06-12T17:50:47.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57f6ffd700 1 -- 172.21.15.38:0/1860104225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57f8146680 msgr2=0x7f57f80ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:47.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57f6ffd700 1 --2- 172.21.15.38:0/1860104225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57f8146680 0x7f57f80ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:47.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57f6ffd700 1 -- 172.21.15.38:0/1860104225 >> v1:172.21.15.150:6789/0 conn(0x7f57f80b2eb0 legacy=0x7f57f809d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:47.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57f6ffd700 1 -- 172.21.15.38:0/1860104225 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f8146a60 con 0x7f57f809d8d0 2020-06-12T17:50:47.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57f6ffd700 1 -- 172.21.15.38:0/1860104225 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f57f0001a50 con 0x7f57f809d8d0 2020-06-12T17:50:47.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57f7fff700 1 --2- 172.21.15.38:0/1860104225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57f8146680 0x7f57f80ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:50:47.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57f6ffd700 1 -- 172.21.15.38:0/1860104225 >> v1:172.21.15.38:6789/0 conn(0x7f57f809d8d0 legacy=0x7f57f81421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:47.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57f6ffd700 1 --2- 172.21.15.38:0/1860104225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57e40038e0 0x7f57e4003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:47.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57f6ffd700 1 --2- 172.21.15.38:0/1860104225 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57e40044d0 0x7f57e4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:47.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57f6ffd700 1 --2- 172.21.15.38:0/1860104225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57f8146680 0x7f57e4004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:47.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57f6ffd700 1 -- 172.21.15.38:0/1860104225 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f8146f50 con 0x7f57e40044d0 2020-06-12T17:50:47.692 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57f6ffd700 1 -- 172.21.15.38:0/1860104225 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e4005210 con 0x7f57e40038e0 2020-06-12T17:50:47.692 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57f6ffd700 1 -- 172.21.15.38:0/1860104225 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e4005380 con 0x7f57f8146680 2020-06-12T17:50:47.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57f77fe700 1 --2- 172.21.15.38:0/1860104225 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57e40044d0 0x7f57e4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:47.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57f7fff700 1 --2- 172.21.15.38:0/1860104225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57e40038e0 0x7f57e4003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:47.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57fc81b700 1 --2- 172.21.15.38:0/1860104225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57f8146680 0x7f57e4004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:47.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57f77fe700 1 -- 172.21.15.38:0/1860104225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57f8146680 msgr2=0x7f57e4004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:47.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57f77fe700 1 --2- 172.21.15.38:0/1860104225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57f8146680 0x7f57e4004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:47.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57f77fe700 1 -- 172.21.15.38:0/1860104225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57e40038e0 msgr2=0x7f57e4003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:47.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57f77fe700 1 --2- 172.21.15.38:0/1860104225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57e40038e0 0x7f57e4003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:47.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.674+0000 7f57f77fe700 1 -- 172.21.15.38:0/1860104225 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e4003230 con 0x7f57e40044d0 2020-06-12T17:50:47.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.675+0000 7f57f77fe700 1 --2- 172.21.15.38:0/1860104225 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57e40044d0 0x7f57e4004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f57ec0010d0 tx=0x7f57ec001a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.675+0000 7f57f77fe700 1 --2- 172.21.15.38:0/1860104225 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57e40044d0 0x7f57e4004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f57ec0010d0 tx=0x7f57ec001a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.675+0000 7f57f77fe700 1 --2- 172.21.15.38:0/1860104225 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57e40044d0 0x7f57e4004950 secure :-1 s=READY pgs=734 cs=0 l=1 rx=0x7f57ec0010d0 tx=0x7f57ec001a30).ready entity=mon.0 client_cookie=f6ed8028693f94a1 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:47.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.675+0000 7f57f77fe700 1 --2- 172.21.15.38:0/1860104225 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57e40044d0 0x7f57e4004950 secure :-1 s=THROTTLE_DONE pgs=734 cs=0 l=1 rx=0x7f57ec0010d0 tx=0x7f57ec001a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.675+0000 7f57f6ffd700 1 -- 172.21.15.38:0/1860104225 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57ec001ac0 con 0x7f57e40044d0 2020-06-12T17:50:47.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.675+0000 7f57f77fe700 1 --2- 172.21.15.38:0/1860104225 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57e40044d0 0x7f57e4004950 secure :-1 s=THROTTLE_DONE pgs=734 cs=0 l=1 rx=0x7f57ec0010d0 tx=0x7f57ec001a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.675+0000 7f57f77fe700 1 --2- 172.21.15.38:0/1860104225 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57e40044d0 0x7f57e4004950 secure :-1 s=THROTTLE_DONE pgs=734 cs=0 l=1 rx=0x7f57ec0010d0 tx=0x7f57ec001a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.675+0000 7f57f6ffd700 1 -- 172.21.15.38:0/1860104225 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ec00c950 con 0x7f57e40044d0 2020-06-12T17:50:47.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.675+0000 7f57f6ffd700 1 -- 172.21.15.38:0/1860104225 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57ec00cd30 con 0x7f57e40044d0 2020-06-12T17:50:47.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.675+0000 7f57fe27e700 1 -- 172.21.15.38:0/1860104225 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57e40044d0 msgr2=0x7f57e4004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:47.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.675+0000 7f57fe27e700 1 --2- 172.21.15.38:0/1860104225 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57e40044d0 0x7f57e4004950 secure :-1 s=READY pgs=734 cs=0 l=1 rx=0x7f57ec0010d0 tx=0x7f57ec001a30).stop 2020-06-12T17:50:47.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.675+0000 7f57fc81b700 1 -- 172.21.15.38:0/1860104225 reap_dead start 2020-06-12T17:50:47.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.675+0000 7f57fe27e700 1 -- 172.21.15.38:0/1860104225 shutdown_connections 2020-06-12T17:50:47.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.675+0000 7f57fe27e700 1 -- 172.21.15.38:0/1860104225 >> 172.21.15.38:0/1860104225 conn(0x7f57f80b5a20 msgr2=0x7f57f805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:47.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.675+0000 7f57fe27e700 1 -- 172.21.15.38:0/1860104225 shutdown_connections 2020-06-12T17:50:47.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.675+0000 7f57fe27e700 1 -- 172.21.15.38:0/1860104225 wait complete. 2020-06-12T17:50:47.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.676+0000 7f57fe27e700 1 Processor -- start 2020-06-12T17:50:47.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.676+0000 7f57fe27e700 1 -- start start 2020-06-12T17:50:47.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.677+0000 7f57fe27e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57f80659b0 0x7f57f80b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:47.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.677+0000 7f57fe27e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f57f8140bf0 0x7f57f8141060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:47.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.677+0000 7f57fe27e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f80afa20 con 0x7f57f8065d90 2020-06-12T17:50:47.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.677+0000 7f57fe27e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57f80b24b0 con 0x7f57f8140bf0 2020-06-12T17:50:47.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.677+0000 7f57fe27e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f80b2750 con 0x7f57f80659b0 2020-06-12T17:50:47.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.677+0000 7f57f77fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f57f8065d90 0x7f57f80aea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40948/0 (socket says 172.21.15.38:40948) 2020-06-12T17:50:47.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.677+0000 7f57f77fe700 1 -- 172.21.15.38:0/1436651681 learned_addr learned my addr 172.21.15.38:0/1436651681 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:47.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.677+0000 7f57fc81b700 1 --2- 172.21.15.38:0/1436651681 >> v2:172.21.15.150:3300/0 conn(0x7f57f8140bf0 0x7f57f8141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:47.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.677+0000 7f57f7fff700 1 --2- 172.21.15.38:0/1436651681 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57f80659b0 0x7f57f80b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:47.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.677+0000 7f57f57fa700 1 -- 172.21.15.38:0/1436651681 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 220001282 0 0) 0x7f57f80afa20 con 0x7f57f8065d90 2020-06-12T17:50:47.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.677+0000 7f57f57fa700 1 -- 172.21.15.38:0/1436651681 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57d8002fe0 con 0x7f57f8065d90 2020-06-12T17:50:47.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.678+0000 7f57f57fa700 1 -- 172.21.15.38:0/1436651681 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3788780549 0 0) 0x7f57d8002fe0 con 0x7f57f8065d90 2020-06-12T17:50:47.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.678+0000 7f57f57fa700 1 -- 172.21.15.38:0/1436651681 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f57f80afa20 con 0x7f57f8065d90 2020-06-12T17:50:47.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.678+0000 7f57f57fa700 1 -- 172.21.15.38:0/1436651681 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f57ec001aa0 con 0x7f57f8065d90 2020-06-12T17:50:47.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.678+0000 7f57fc81b700 1 -- 172.21.15.38:0/1436651681 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57f80659b0 msgr2=0x7f57f80b1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:47.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.678+0000 7f57fc81b700 1 --2- 172.21.15.38:0/1436651681 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57f80659b0 0x7f57f80b1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:47.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.678+0000 7f57fc81b700 1 -- 172.21.15.38:0/1436651681 >> v1:172.21.15.38:6789/0 conn(0x7f57f8065d90 legacy=0x7f57f80aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:47.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.678+0000 7f57fc81b700 1 -- 172.21.15.38:0/1436651681 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f8153510 con 0x7f57f8140bf0 2020-06-12T17:50:47.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.678+0000 7f57f7fff700 1 --2- 172.21.15.38:0/1436651681 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57f80659b0 0x7f57f80b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:50:47.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.678+0000 7f57fc81b700 1 --2- 172.21.15.38:0/1436651681 >> v2:172.21.15.150:3300/0 conn(0x7f57f8140bf0 0x7f57f8141060 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f57f8061380 tx=0x7f57f8146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.678+0000 7f57fc81b700 1 --2- 172.21.15.38:0/1436651681 >> v2:172.21.15.150:3300/0 conn(0x7f57f8140bf0 0x7f57f8141060 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f57f8061380 tx=0x7f57f8146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.678+0000 7f57fc81b700 1 --2- 172.21.15.38:0/1436651681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57f8140bf0 0x7f57f8141060 secure :-1 s=READY pgs=414 cs=0 l=1 rx=0x7f57f8061380 tx=0x7f57f8146220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:47.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.678+0000 7f57fc81b700 1 --2- 172.21.15.38:0/1436651681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57f8140bf0 0x7f57f8141060 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f57f8061380 tx=0x7f57f8146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.705 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.678+0000 7f57f57fa700 1 -- 172.21.15.38:0/1436651681 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57f0004d10 con 0x7f57f8140bf0 2020-06-12T17:50:47.705 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.678+0000 7f57fc81b700 1 --2- 172.21.15.38:0/1436651681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57f8140bf0 0x7f57f8141060 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f57f8061380 tx=0x7f57f8146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.705 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.678+0000 7f57f57fa700 1 -- 172.21.15.38:0/1436651681 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f0004e70 con 0x7f57f8140bf0 2020-06-12T17:50:47.705 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.678+0000 7f57fe27e700 1 -- 172.21.15.38:0/1436651681 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f81414c0 con 0x7f57f8140bf0 2020-06-12T17:50:47.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.678+0000 7f57fc81b700 1 --2- 172.21.15.38:0/1436651681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57f8140bf0 0x7f57f8141060 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f57f8061380 tx=0x7f57f8146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.678+0000 7f57f57fa700 1 -- 172.21.15.38:0/1436651681 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57f0007350 con 0x7f57f8140bf0 2020-06-12T17:50:47.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.678+0000 7f57fe27e700 1 -- 172.21.15.38:0/1436651681 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f8153bf0 con 0x7f57f8140bf0 2020-06-12T17:50:47.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.679+0000 7f57fc81b700 1 --2- 172.21.15.38:0/1436651681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57f8140bf0 0x7f57f8141060 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f57f8061380 tx=0x7f57f8146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.707 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.679+0000 7f57fe27e700 1 -- 172.21.15.38:0/1436651681 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f8066190 con 0x7f57f8140bf0 2020-06-12T17:50:47.707 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.679+0000 7f57f57fa700 1 -- 172.21.15.38:0/1436651681 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f57f00074b0 con 0x7f57f8140bf0 2020-06-12T17:50:47.707 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.679+0000 7f57fc81b700 1 --2- 172.21.15.38:0/1436651681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57f8140bf0 0x7f57f8141060 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f57f8061380 tx=0x7f57f8146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.707 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.680+0000 7f57f57fa700 1 --2- 172.21.15.38:0/1436651681 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f57d804dc00 0x7f57d80500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:47.707 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.680+0000 7f57f57fa700 1 -- 172.21.15.38:0/1436651681 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f57f0060470 con 0x7f57f8140bf0 2020-06-12T17:50:47.708 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.680+0000 7f57f7fff700 1 --2- 172.21.15.38:0/1436651681 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f57d804dc00 0x7f57d80500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:47.708 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.680+0000 7f57f7fff700 1 --2- 172.21.15.38:0/1436651681 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f57d804dc00 0x7f57d80500c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f57e8002f30 tx=0x7f57e8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.708 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.680+0000 7f57f7fff700 1 --2- 172.21.15.38:0/1436651681 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f57d804dc00 0x7f57d80500c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f57e8002f30 tx=0x7f57e8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.708 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.680+0000 7f57f7fff700 1 --2- 172.21.15.38:0/1436651681 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f57d804dc00 0x7f57d80500c0 secure :-1 s=READY pgs=287 cs=0 l=1 rx=0x7f57e8002f30 tx=0x7f57e8007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:47.709 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.684+0000 7f57fc81b700 1 --2- 172.21.15.38:0/1436651681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57f8140bf0 0x7f57f8141060 secure :-1 s=THROTTLE_DONE pgs=414 cs=0 l=1 rx=0x7f57f8061380 tx=0x7f57f8146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.709 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.684+0000 7f57f57fa700 1 -- 172.21.15.38:0/1436651681 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f57f8066190 con 0x7f57f8140bf0 2020-06-12T17:50:47.883 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.878+0000 7f57fe27e700 1 -- 172.21.15.38:0/1436651681 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_5498", "target": ["mon-mgr", ""]}) v1 -- 0x7f57f8066190 con 0x7f57d804dc00 2020-06-12T17:50:47.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.882+0000 7f57f7fff700 1 --2- 172.21.15.38:0/1436651681 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f57d804dc00 0x7f57d80500c0 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f57e8002f30 tx=0x7f57e8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:47.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.882+0000 7f57f57fa700 1 -- 172.21.15.38:0/1436651681 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f57f8066190 con 0x7f57d804dc00 2020-06-12T17:50:47.887 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_5498/59af33a0-230d-4517-85bf-0a9a11cd2be7 2020-06-12T17:50:47.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.883+0000 7f57fe27e700 1 -- 172.21.15.38:0/1436651681 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f57d804dc00 msgr2=0x7f57d80500c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:47.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.883+0000 7f57fe27e700 1 --2- 172.21.15.38:0/1436651681 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f57d804dc00 0x7f57d80500c0 secure :-1 s=READY pgs=287 cs=0 l=1 rx=0x7f57e8002f30 tx=0x7f57e8007e60).stop 2020-06-12T17:50:47.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.883+0000 7f57fe27e700 1 -- 172.21.15.38:0/1436651681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57f8140bf0 msgr2=0x7f57f8141060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:47.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.883+0000 7f57fe27e700 1 --2- 172.21.15.38:0/1436651681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57f8140bf0 0x7f57f8141060 secure :-1 s=READY pgs=414 cs=0 l=1 rx=0x7f57f8061380 tx=0x7f57f8146220).stop 2020-06-12T17:50:47.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.883+0000 7f57fe27e700 1 -- 172.21.15.38:0/1436651681 shutdown_connections 2020-06-12T17:50:47.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.883+0000 7f57fe27e700 1 --2- 172.21.15.38:0/1436651681 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f57d804dc00 0x7f57d80500c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:47.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.883+0000 7f57fe27e700 1 --2- 172.21.15.38:0/1436651681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57f8140bf0 0x7f57f8141060 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:47.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.883+0000 7f57fe27e700 1 --2- 172.21.15.38:0/1436651681 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57f80659b0 0x7f57f80b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:47.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.883+0000 7f57fe27e700 1 -- 172.21.15.38:0/1436651681 >> 172.21.15.38:0/1436651681 conn(0x7f57f80b5a20 msgr2=0x7f57f805ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:47.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.883+0000 7f57fe27e700 1 -- 172.21.15.38:0/1436651681 shutdown_connections 2020-06-12T17:50:47.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:47.883+0000 7f57fe27e700 1 -- 172.21.15.38:0/1436651681 wait complete. 2020-06-12T17:50:47.898 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_5498 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_5498/59af33a0-230d-4517-85bf-0a9a11cd2be7 2020-06-12T17:50:47.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:47.899 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:47.899 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:47.914 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:47.915 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:47.916 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5498/59af33a0-230d-4517-85bf-0a9a11cd2be7/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:47.943 INFO:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-06-12T17:50:47.958 INFO:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-06-12T17:50:48.008 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:48.008 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:48.008 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100714 s, 104 MB/s 2020-06-12T17:50:48.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:48.010 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:48.011 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:48.086 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:48.087 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:48.088 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5498/59af33a0-230d-4517-85bf-0a9a11cd2be7/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:48.176 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:48.176 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:48.177 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113715 s, 92.2 MB/s 2020-06-12T17:50:48.178 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:48.179 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:48.180 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:48.196 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:48.197 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:48.197 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5498/59af33a0-230d-4517-85bf-0a9a11cd2be7/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:48.284 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:48.285 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:48.285 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105073 s, 99.8 MB/s 2020-06-12T17:50:48.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:48.287 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:48.287 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:48.302 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:48.303 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:48.303 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5498/59af33a0-230d-4517-85bf-0a9a11cd2be7/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:48.390 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:48.391 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:48.391 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00993502 s, 106 MB/s 2020-06-12T17:50:48.392 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:48.393 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:48.394 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:48.409 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:48.410 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:48.410 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5498/59af33a0-230d-4517-85bf-0a9a11cd2be7/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:48.497 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:48.497 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:48.498 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104504 s, 100 MB/s 2020-06-12T17:50:48.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:48.500 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:48.500 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:48.515 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:48.516 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:48.516 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5498/59af33a0-230d-4517-85bf-0a9a11cd2be7/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:48.605 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:48.605 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:48.605 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126731 s, 82.7 MB/s 2020-06-12T17:50:48.606 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:48.607 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:48.608 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:48.623 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:48.623 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:48.624 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5498/59af33a0-230d-4517-85bf-0a9a11cd2be7/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:48.710 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:48.710 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:48.710 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938672 s, 112 MB/s 2020-06-12T17:50:48.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:48.712 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:48.713 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:48.730 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:48.730 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:48.731 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5498/59af33a0-230d-4517-85bf-0a9a11cd2be7/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:48.818 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:48.819 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:48.819 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111202 s, 94.3 MB/s 2020-06-12T17:50:48.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:48.821 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:48.821 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:48.841 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:48.842 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:48.843 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5498/59af33a0-230d-4517-85bf-0a9a11cd2be7/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:48.929 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:48.930 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:48.930 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102704 s, 102 MB/s 2020-06-12T17:50:48.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:48.932 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:48.932 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:48.948 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:48.948 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:48.950 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5498/59af33a0-230d-4517-85bf-0a9a11cd2be7/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:49.038 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:49.039 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:49.039 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010112 s, 104 MB/s 2020-06-12T17:50:49.040 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_7782 2020-06-12T17:50:49.157 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.153+0000 7eff0759e700 1 Processor -- start 2020-06-12T17:50:49.158 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.153+0000 7eff0759e700 1 -- start start 2020-06-12T17:50:49.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.154+0000 7eff0759e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7eff080b15c0 0x7eff080b2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:49.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.154+0000 7eff0759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff080afc20 0x7eff080b0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:49.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.154+0000 7eff0759e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff080b2900 con 0x7eff080b11e0 2020-06-12T17:50:49.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.154+0000 7eff0759e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff080ae7d0 con 0x7eff080b15c0 2020-06-12T17:50:49.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.154+0000 7eff0759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff080b1ad0 con 0x7eff080afc20 2020-06-12T17:50:49.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.154+0000 7eff05d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7eff080b15c0 0x7eff080b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:49.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.154+0000 7eff06d9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff080afc20 0x7eff080b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:49.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.154+0000 7eff0659c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7eff080b11e0 0x7eff080ae0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:33454/0 (socket says 172.21.15.38:33454) 2020-06-12T17:50:49.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.154+0000 7eff05d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7eff080b15c0 0x7eff080b2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:48618/0 (socket says 172.21.15.38:48618) 2020-06-12T17:50:49.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.154+0000 7eff0659c700 1 -- 172.21.15.38:0/3231101247 learned_addr learned my addr 172.21.15.38:0/3231101247 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:49.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.154+0000 7eff06d9d700 1 -- 172.21.15.38:0/3231101247 >> v2:172.21.15.150:3300/0 conn(0x7eff080b15c0 msgr2=0x7eff080b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:49.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.154+0000 7eff06d9d700 1 --2- 172.21.15.38:0/3231101247 >> v2:172.21.15.150:3300/0 conn(0x7eff080b15c0 0x7eff080b2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:49.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.154+0000 7eff06d9d700 1 -- 172.21.15.38:0/3231101247 >> v1:172.21.15.150:6789/0 conn(0x7eff080b11e0 legacy=0x7eff080ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:49.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.155+0000 7eff06d9d700 1 -- 172.21.15.38:0/3231101247 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff080b1d70 con 0x7eff080afc20 2020-06-12T17:50:49.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.155+0000 7eff05d9b700 1 --2- 172.21.15.38:0/3231101247 >> v2:172.21.15.150:3300/0 conn(0x7eff080b15c0 0x7eff080b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:50:49.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.155+0000 7eff06d9d700 1 --2- 172.21.15.38:0/3231101247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff080afc20 0x7eff080b0090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efef8002f30 tx=0x7efef8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.155+0000 7eff06d9d700 1 --2- 172.21.15.38:0/3231101247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff080afc20 0x7eff080b0090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efef8002f30 tx=0x7efef8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.155+0000 7eff06d9d700 1 --2- 172.21.15.38:0/3231101247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff080afc20 0x7eff080b0090 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7efef8002f30 tx=0x7efef8007e60).ready entity=mon.2 client_cookie=cbad59b595073060 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:49.166 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.155+0000 7eff06d9d700 1 --2- 172.21.15.38:0/3231101247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff080afc20 0x7eff080b0090 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7efef8002f30 tx=0x7efef8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.166 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.155+0000 7eff0559a700 1 -- 172.21.15.38:0/3231101247 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efef8011380 con 0x7eff080afc20 2020-06-12T17:50:49.166 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.155+0000 7eff06d9d700 1 --2- 172.21.15.38:0/3231101247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff080afc20 0x7eff080b0090 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7efef8002f30 tx=0x7efef8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.166 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.155+0000 7eff06d9d700 1 --2- 172.21.15.38:0/3231101247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff080afc20 0x7eff080b0090 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7efef8002f30 tx=0x7efef8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.167 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.155+0000 7eff0559a700 1 -- 172.21.15.38:0/3231101247 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef80114e0 con 0x7eff080afc20 2020-06-12T17:50:49.167 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.155+0000 7eff0559a700 1 -- 172.21.15.38:0/3231101247 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efef8011900 con 0x7eff080afc20 2020-06-12T17:50:49.167 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.155+0000 7eff0759e700 1 -- 172.21.15.38:0/3231101247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff080afc20 msgr2=0x7eff080b0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:49.167 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.155+0000 7eff0759e700 1 --2- 172.21.15.38:0/3231101247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff080afc20 0x7eff080b0090 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7efef8002f30 tx=0x7efef8007e60).stop 2020-06-12T17:50:49.168 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.155+0000 7eff0759e700 1 -- 172.21.15.38:0/3231101247 shutdown_connections 2020-06-12T17:50:49.168 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.155+0000 7eff0759e700 1 --2- 172.21.15.38:0/3231101247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff080afc20 0x7eff080b0090 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:49.168 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.155+0000 7eff0759e700 1 --2- 172.21.15.38:0/3231101247 >> v2:172.21.15.150:3300/0 conn(0x7eff080b15c0 0x7eff080b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:49.168 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.155+0000 7eff0759e700 1 -- 172.21.15.38:0/3231101247 >> 172.21.15.38:0/3231101247 conn(0x7eff080b4cc0 msgr2=0x7eff080b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:49.169 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.155+0000 7eff0759e700 1 -- 172.21.15.38:0/3231101247 shutdown_connections 2020-06-12T17:50:49.169 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.155+0000 7eff0759e700 1 -- 172.21.15.38:0/3231101247 wait complete. 2020-06-12T17:50:49.169 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.156+0000 7eff0759e700 1 Processor -- start 2020-06-12T17:50:49.169 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.156+0000 7eff0759e700 1 -- start start 2020-06-12T17:50:49.173 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.157+0000 7eff0759e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7eff080b11e0 0x7eff08147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:49.173 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.157+0000 7eff0759e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff08147ad0 con 0x7eff080afc20 2020-06-12T17:50:49.173 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.157+0000 7eff0759e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff080635b0 con 0x7eff080b15c0 2020-06-12T17:50:49.173 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.157+0000 7eff0759e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff08065c90 con 0x7eff080b11e0 2020-06-12T17:50:49.174 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.157+0000 7eff0659c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7eff080afc20 0x7eff081507f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40960/0 (socket says 172.21.15.38:40960) 2020-06-12T17:50:49.174 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.157+0000 7eff0659c700 1 -- 172.21.15.38:0/3114127904 learned_addr learned my addr 172.21.15.38:0/3114127904 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:49.174 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.157+0000 7eff05d9b700 1 --2- 172.21.15.38:0/3114127904 >> v2:172.21.15.150:3300/0 conn(0x7eff080b11e0 0x7eff08147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:49.174 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.157+0000 7efeff7fe700 1 -- 172.21.15.38:0/3114127904 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 248579615 0 0) 0x7eff080b2900 con 0x7eff080afc20 2020-06-12T17:50:49.175 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.157+0000 7efeff7fe700 1 -- 172.21.15.38:0/3114127904 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efeec002fe0 con 0x7eff080afc20 2020-06-12T17:50:49.175 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.158+0000 7eff05d9b700 1 -- 172.21.15.38:0/3114127904 >> v1:172.21.15.150:6789/0 conn(0x7eff080b15c0 legacy=0x7eff08062ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:49.175 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.158+0000 7eff05d9b700 1 -- 172.21.15.38:0/3114127904 >> v1:172.21.15.38:6789/0 conn(0x7eff080afc20 legacy=0x7eff081507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:49.176 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.158+0000 7efeff7fe700 1 -- 172.21.15.38:0/3114127904 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 650295148 0 0) 0x7eff080b1d70 con 0x7eff080b15c0 2020-06-12T17:50:49.176 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.158+0000 7eff05d9b700 1 -- 172.21.15.38:0/3114127904 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff08065ef0 con 0x7eff080b11e0 2020-06-12T17:50:49.176 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.158+0000 7eff05d9b700 1 --2- 172.21.15.38:0/3114127904 >> v2:172.21.15.150:3300/0 conn(0x7eff080b11e0 0x7eff08147670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efef0002f30 tx=0x7efef0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.176 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.158+0000 7eff05d9b700 1 --2- 172.21.15.38:0/3114127904 >> v2:172.21.15.150:3300/0 conn(0x7eff080b11e0 0x7eff08147670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efef0002f30 tx=0x7efef0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.176 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.158+0000 7eff05d9b700 1 --2- 172.21.15.38:0/3114127904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff080b11e0 0x7eff08147670 secure :-1 s=READY pgs=417 cs=0 l=1 rx=0x7efef0002f30 tx=0x7efef0007e60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:49.177 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.158+0000 7eff05d9b700 1 --2- 172.21.15.38:0/3114127904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff080b11e0 0x7eff08147670 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7efef0002f30 tx=0x7efef0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.177 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.158+0000 7efeff7fe700 1 -- 172.21.15.38:0/3114127904 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efef00075e0 con 0x7eff080b11e0 2020-06-12T17:50:49.177 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.158+0000 7eff05d9b700 1 --2- 172.21.15.38:0/3114127904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff080b11e0 0x7eff08147670 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7efef0002f30 tx=0x7efef0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.177 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.158+0000 7efeff7fe700 1 -- 172.21.15.38:0/3114127904 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef0005a10 con 0x7eff080b11e0 2020-06-12T17:50:49.177 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.158+0000 7eff05d9b700 1 --2- 172.21.15.38:0/3114127904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff080b11e0 0x7eff08147670 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7efef0002f30 tx=0x7efef0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.178 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.158+0000 7eff0759e700 1 -- 172.21.15.38:0/3114127904 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff08066190 con 0x7eff080b11e0 2020-06-12T17:50:49.178 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.158+0000 7efeff7fe700 1 -- 172.21.15.38:0/3114127904 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efef0005df0 con 0x7eff080b11e0 2020-06-12T17:50:49.178 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.158+0000 7eff0759e700 1 -- 172.21.15.38:0/3114127904 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff08141b00 con 0x7eff080b11e0 2020-06-12T17:50:49.179 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.159+0000 7eff05d9b700 1 --2- 172.21.15.38:0/3114127904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff080b11e0 0x7eff08147670 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7efef0002f30 tx=0x7efef0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.179 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.159+0000 7eff0759e700 1 -- 172.21.15.38:0/3114127904 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff08056c30 con 0x7eff080b11e0 2020-06-12T17:50:49.179 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.159+0000 7efeff7fe700 1 -- 172.21.15.38:0/3114127904 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7efef0009440 con 0x7eff080b11e0 2020-06-12T17:50:49.179 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.159+0000 7eff05d9b700 1 --2- 172.21.15.38:0/3114127904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff080b11e0 0x7eff08147670 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7efef0002f30 tx=0x7efef0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.160+0000 7efeff7fe700 1 --2- 172.21.15.38:0/3114127904 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efeec04d7f0 0x7efeec04fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.160+0000 7efeff7fe700 1 -- 172.21.15.38:0/3114127904 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7efef00614c0 con 0x7eff080b11e0 2020-06-12T17:50:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.160+0000 7eff0659c700 1 --2- 172.21.15.38:0/3114127904 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efeec04d7f0 0x7efeec04fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.160+0000 7eff0659c700 1 --2- 172.21.15.38:0/3114127904 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efeec04d7f0 0x7efeec04fcb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7eff00001270 tx=0x7eff000018d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.160+0000 7eff0659c700 1 --2- 172.21.15.38:0/3114127904 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efeec04d7f0 0x7efeec04fcb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7eff00001270 tx=0x7eff000018d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.181 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.160+0000 7eff0659c700 1 --2- 172.21.15.38:0/3114127904 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efeec04d7f0 0x7efeec04fcb0 secure :-1 s=READY pgs=288 cs=0 l=1 rx=0x7eff00001270 tx=0x7eff000018d0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:49.181 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.163+0000 7eff05d9b700 1 --2- 172.21.15.38:0/3114127904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff080b11e0 0x7eff08147670 secure :-1 s=THROTTLE_DONE pgs=417 cs=0 l=1 rx=0x7efef0002f30 tx=0x7efef0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.181 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.163+0000 7efeff7fe700 1 -- 172.21.15.38:0/3114127904 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7efef003cb60 con 0x7eff080b11e0 2020-06-12T17:50:49.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.357+0000 7eff0759e700 1 -- 172.21.15.38:0/3114127904 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_7782", "target": ["mon-mgr", ""]}) v1 -- 0x7eff080b0d70 con 0x7efeec04d7f0 2020-06-12T17:50:49.380 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.375+0000 7eff0659c700 1 --2- 172.21.15.38:0/3114127904 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efeec04d7f0 0x7efeec04fcb0 secure :-1 s=THROTTLE_DONE pgs=288 cs=0 l=1 rx=0x7eff00001270 tx=0x7eff000018d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.380 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.375+0000 7efeff7fe700 1 -- 172.21.15.38:0/3114127904 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7eff080b0d70 con 0x7efeec04d7f0 2020-06-12T17:50:49.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.377+0000 7eff0759e700 1 -- 172.21.15.38:0/3114127904 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efeec04d7f0 msgr2=0x7efeec04fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:49.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.377+0000 7eff0759e700 1 --2- 172.21.15.38:0/3114127904 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efeec04d7f0 0x7efeec04fcb0 secure :-1 s=READY pgs=288 cs=0 l=1 rx=0x7eff00001270 tx=0x7eff000018d0).stop 2020-06-12T17:50:49.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.377+0000 7eff0759e700 1 -- 172.21.15.38:0/3114127904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff080b11e0 msgr2=0x7eff08147670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:49.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.377+0000 7eff0759e700 1 --2- 172.21.15.38:0/3114127904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff080b11e0 0x7eff08147670 secure :-1 s=READY pgs=417 cs=0 l=1 rx=0x7efef0002f30 tx=0x7efef0007e60).stop 2020-06-12T17:50:49.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.377+0000 7eff0759e700 1 -- 172.21.15.38:0/3114127904 shutdown_connections 2020-06-12T17:50:49.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.377+0000 7eff0759e700 1 --2- 172.21.15.38:0/3114127904 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7efeec04d7f0 0x7efeec04fcb0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:49.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.377+0000 7eff0759e700 1 --2- 172.21.15.38:0/3114127904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff080b11e0 0x7eff08147670 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:49.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.377+0000 7eff0759e700 1 -- 172.21.15.38:0/3114127904 >> 172.21.15.38:0/3114127904 conn(0x7eff080b4cc0 msgr2=0x7eff081461a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:49.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.377+0000 7eff0759e700 1 -- 172.21.15.38:0/3114127904 shutdown_connections 2020-06-12T17:50:49.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.377+0000 7eff0759e700 1 -- 172.21.15.38:0/3114127904 wait complete. 2020-06-12T17:50:49.391 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_7782 2020-06-12T17:50:49.509 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.504+0000 7f0f2f59e700 1 Processor -- start 2020-06-12T17:50:49.510 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.504+0000 7f0f2f59e700 1 -- start start 2020-06-12T17:50:49.517 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.505+0000 7f0f2f59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0f300b2380 0x7f0f300b0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:49.518 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.505+0000 7f0f2f59e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f300b2900 con 0x7f0f300b15c0 2020-06-12T17:50:49.518 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.505+0000 7f0f2f59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f300ae7d0 con 0x7f0f300b11e0 2020-06-12T17:50:49.518 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.505+0000 7f0f2f59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f300add30 con 0x7f0f300b2380 2020-06-12T17:50:49.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.505+0000 7f0f2dd9b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f0f300b15c0 0x7f0f300afc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40968/0 (socket says 172.21.15.38:40968) 2020-06-12T17:50:49.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.506+0000 7f0f2dd9b700 1 -- 172.21.15.38:0/2417842986 learned_addr learned my addr 172.21.15.38:0/2417842986 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:49.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.506+0000 7f0f2ed9d700 1 --2- 172.21.15.38:0/2417842986 >> v2:172.21.15.150:3300/0 conn(0x7f0f300b2380 0x7f0f300b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:49.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.506+0000 7f0f2d59a700 1 -- 172.21.15.38:0/2417842986 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 860900985 0 0) 0x7f0f300b2900 con 0x7f0f300b15c0 2020-06-12T17:50:49.519 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.506+0000 7f0f2d59a700 1 -- 172.21.15.38:0/2417842986 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f14003230 con 0x7f0f300b15c0 2020-06-12T17:50:49.520 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.506+0000 7f0f2d59a700 1 -- 172.21.15.38:0/2417842986 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55776299 0 0) 0x7f0f300ae7d0 con 0x7f0f300b11e0 2020-06-12T17:50:49.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.506+0000 7f0f2d59a700 1 -- 172.21.15.38:0/2417842986 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f300b2900 con 0x7f0f300b11e0 2020-06-12T17:50:49.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.506+0000 7f0f2d59a700 1 -- 172.21.15.38:0/2417842986 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2721934501 0 0) 0x7f0f14003230 con 0x7f0f300b15c0 2020-06-12T17:50:49.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.506+0000 7f0f2d59a700 1 -- 172.21.15.38:0/2417842986 >> v2:172.21.15.150:3300/0 conn(0x7f0f300b2380 msgr2=0x7f0f300b0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:49.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.506+0000 7f0f2d59a700 1 --2- 172.21.15.38:0/2417842986 >> v2:172.21.15.150:3300/0 conn(0x7f0f300b2380 0x7f0f300b0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:49.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.506+0000 7f0f2d59a700 1 -- 172.21.15.38:0/2417842986 >> v1:172.21.15.150:6789/0 conn(0x7f0f300b11e0 legacy=0x7f0f300ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:49.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.506+0000 7f0f2d59a700 1 -- 172.21.15.38:0/2417842986 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f300b1ad0 con 0x7f0f300b15c0 2020-06-12T17:50:49.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.506+0000 7f0f2d59a700 1 -- 172.21.15.38:0/2417842986 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f0f20001a50 con 0x7f0f300b15c0 2020-06-12T17:50:49.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.506+0000 7f0f2d59a700 1 -- 172.21.15.38:0/2417842986 >> v1:172.21.15.38:6789/0 conn(0x7f0f300b15c0 legacy=0x7f0f300afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:49.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.506+0000 7f0f2d59a700 1 --2- 172.21.15.38:0/2417842986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f14003900 0x7f0f14003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:49.523 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.506+0000 7f0f2d59a700 1 --2- 172.21.15.38:0/2417842986 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f140044d0 0x7f0f14004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:49.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.506+0000 7f0f2d59a700 1 --2- 172.21.15.38:0/2417842986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f14004db0 0x7f0f1400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:49.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.506+0000 7f0f2d59a700 1 -- 172.21.15.38:0/2417842986 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f300add30 con 0x7f0f14003900 2020-06-12T17:50:49.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.506+0000 7f0f2d59a700 1 -- 172.21.15.38:0/2417842986 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1400bb80 con 0x7f0f14004db0 2020-06-12T17:50:49.524 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.506+0000 7f0f2d59a700 1 -- 172.21.15.38:0/2417842986 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1400bcc0 con 0x7f0f140044d0 2020-06-12T17:50:49.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.506+0000 7f0f2e59c700 1 --2- 172.21.15.38:0/2417842986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f14003900 0x7f0f14003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:49.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.506+0000 7f0f2dd9b700 1 --2- 172.21.15.38:0/2417842986 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f140044d0 0x7f0f14004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:49.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.506+0000 7f0f2ed9d700 1 --2- 172.21.15.38:0/2417842986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f14004db0 0x7f0f1400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:49.525 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.506+0000 7f0f2e59c700 1 -- 172.21.15.38:0/2417842986 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f140044d0 msgr2=0x7f0f14004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:49.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.506+0000 7f0f2e59c700 1 --2- 172.21.15.38:0/2417842986 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f140044d0 0x7f0f14004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:49.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.506+0000 7f0f2e59c700 1 -- 172.21.15.38:0/2417842986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f14004db0 msgr2=0x7f0f1400b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:49.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.507+0000 7f0f2e59c700 1 --2- 172.21.15.38:0/2417842986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f14004db0 0x7f0f1400b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:49.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.507+0000 7f0f2ed9d700 1 -- 172.21.15.38:0/2417842986 reap_dead start 2020-06-12T17:50:49.526 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.507+0000 7f0f2e59c700 1 -- 172.21.15.38:0/2417842986 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f14003230 con 0x7f0f14003900 2020-06-12T17:50:49.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.507+0000 7f0f2e59c700 1 --2- 172.21.15.38:0/2417842986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f14003900 0x7f0f14003d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0f240010d0 tx=0x7f0f240019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.507+0000 7f0f2e59c700 1 --2- 172.21.15.38:0/2417842986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f14003900 0x7f0f14003d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0f240010d0 tx=0x7f0f240019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.507+0000 7f0f2e59c700 1 --2- 172.21.15.38:0/2417842986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f14003900 0x7f0f14003d00 secure :-1 s=READY pgs=738 cs=0 l=1 rx=0x7f0f240010d0 tx=0x7f0f240019a0).ready entity=mon.0 client_cookie=3a7841237018be09 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:49.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.507+0000 7f0f2e59c700 1 --2- 172.21.15.38:0/2417842986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f14003900 0x7f0f14003d00 secure :-1 s=THROTTLE_DONE pgs=738 cs=0 l=1 rx=0x7f0f240010d0 tx=0x7f0f240019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.527 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.507+0000 7f0f2d59a700 1 -- 172.21.15.38:0/2417842986 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f24011ac0 con 0x7f0f14003900 2020-06-12T17:50:49.529 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.507+0000 7f0f2e59c700 1 --2- 172.21.15.38:0/2417842986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f14003900 0x7f0f14003d00 secure :-1 s=THROTTLE_DONE pgs=738 cs=0 l=1 rx=0x7f0f240010d0 tx=0x7f0f240019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.529 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.507+0000 7f0f2d59a700 1 -- 172.21.15.38:0/2417842986 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f24011c60 con 0x7f0f14003900 2020-06-12T17:50:49.529 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.507+0000 7f0f2e59c700 1 --2- 172.21.15.38:0/2417842986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f14003900 0x7f0f14003d00 secure :-1 s=THROTTLE_DONE pgs=738 cs=0 l=1 rx=0x7f0f240010d0 tx=0x7f0f240019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.529 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.507+0000 7f0f2d59a700 1 -- 172.21.15.38:0/2417842986 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f24011dd0 con 0x7f0f14003900 2020-06-12T17:50:49.530 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.507+0000 7f0f2f59e700 1 -- 172.21.15.38:0/2417842986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f14003900 msgr2=0x7f0f14003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:49.530 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.507+0000 7f0f2f59e700 1 --2- 172.21.15.38:0/2417842986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f14003900 0x7f0f14003d00 secure :-1 s=READY pgs=738 cs=0 l=1 rx=0x7f0f240010d0 tx=0x7f0f240019a0).stop 2020-06-12T17:50:49.530 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.507+0000 7f0f2f59e700 1 -- 172.21.15.38:0/2417842986 shutdown_connections 2020-06-12T17:50:49.530 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.507+0000 7f0f2f59e700 1 --2- 172.21.15.38:0/2417842986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f14003900 0x7f0f14003d00 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:49.530 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.507+0000 7f0f2f59e700 1 -- 172.21.15.38:0/2417842986 >> 172.21.15.38:0/2417842986 conn(0x7f0f300b4cc0 msgr2=0x7f0f300b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:49.531 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.507+0000 7f0f2f59e700 1 -- 172.21.15.38:0/2417842986 shutdown_connections 2020-06-12T17:50:49.531 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.507+0000 7f0f2f59e700 1 -- 172.21.15.38:0/2417842986 wait complete. 2020-06-12T17:50:49.531 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.508+0000 7f0f2f59e700 1 Processor -- start 2020-06-12T17:50:49.531 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.508+0000 7f0f2f59e700 1 -- start start 2020-06-12T17:50:49.532 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.509+0000 7f0f2f59e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0f14003900 0x7f0f301111e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:49.532 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.509+0000 7f0f2f59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f30141900 0x7f0f30141d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:49.532 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.509+0000 7f0f2f59e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f300b3ba0 con 0x7f0f300b2f40 2020-06-12T17:50:49.532 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.509+0000 7f0f2f59e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f300b33d0 con 0x7f0f14003900 2020-06-12T17:50:49.532 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.509+0000 7f0f2f59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f301421f0 con 0x7f0f30141900 2020-06-12T17:50:49.533 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.509+0000 7f0f2e59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0f14003900 0x7f0f301111e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:49.533 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.509+0000 7f0f2e59c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0f14003900 0x7f0f301111e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39162/0 (socket says 172.21.15.38:39162) 2020-06-12T17:50:49.533 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.509+0000 7f0f2dd9b700 1 --1- 172.21.15.38:0/4026653615 >> v1:172.21.15.38:6789/0 conn(0x7f0f300b2f40 0x7f0f301472f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:40980/0 (socket says 172.21.15.38:40980) 2020-06-12T17:50:49.533 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.509+0000 7f0f2e59c700 1 -- 172.21.15.38:0/4026653615 learned_addr learned my addr 172.21.15.38:0/4026653615 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:49.533 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.509+0000 7f0f2ed9d700 1 --2- 172.21.15.38:0/4026653615 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f30141900 0x7f0f30141d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:49.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.509+0000 7f0f2e59c700 1 -- 172.21.15.38:0/4026653615 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f30141900 msgr2=0x7f0f30141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:49.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.509+0000 7f0f1f7fe700 1 -- 172.21.15.38:0/4026653615 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465855335 0 0) 0x7f0f300b3ba0 con 0x7f0f300b2f40 2020-06-12T17:50:49.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.509+0000 7f0f2e59c700 1 --2- 172.21.15.38:0/4026653615 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f30141900 0x7f0f30141d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:49.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.509+0000 7f0f2e59c700 1 -- 172.21.15.38:0/4026653615 >> v1:172.21.15.38:6789/0 conn(0x7f0f300b2f40 legacy=0x7f0f301472f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:49.534 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.509+0000 7f0f2e59c700 1 -- 172.21.15.38:0/4026653615 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f300b3900 con 0x7f0f14003900 2020-06-12T17:50:49.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.510+0000 7f0f2e59c700 1 --2- 172.21.15.38:0/4026653615 >> v2:172.21.15.38:3300/0 conn(0x7f0f14003900 0x7f0f301111e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0f240010d0 tx=0x7f0f240019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.510+0000 7f0f2e59c700 1 --2- 172.21.15.38:0/4026653615 >> v2:172.21.15.38:3300/0 conn(0x7f0f14003900 0x7f0f301111e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0f240010d0 tx=0x7f0f240019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.510+0000 7f0f2e59c700 1 --2- 172.21.15.38:0/4026653615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f14003900 0x7f0f301111e0 secure :-1 s=READY pgs=740 cs=0 l=1 rx=0x7f0f240010d0 tx=0x7f0f240019a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:49.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.510+0000 7f0f2e59c700 1 --2- 172.21.15.38:0/4026653615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f14003900 0x7f0f301111e0 secure :-1 s=THROTTLE_DONE pgs=740 cs=0 l=1 rx=0x7f0f240010d0 tx=0x7f0f240019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.510+0000 7f0f1f7fe700 1 -- 172.21.15.38:0/4026653615 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f24012390 con 0x7f0f14003900 2020-06-12T17:50:49.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.510+0000 7f0f2e59c700 1 --2- 172.21.15.38:0/4026653615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f14003900 0x7f0f301111e0 secure :-1 s=THROTTLE_DONE pgs=740 cs=0 l=1 rx=0x7f0f240010d0 tx=0x7f0f240019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.510+0000 7f0f2e59c700 1 --2- 172.21.15.38:0/4026653615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f14003900 0x7f0f301111e0 secure :-1 s=THROTTLE_DONE pgs=740 cs=0 l=1 rx=0x7f0f240010d0 tx=0x7f0f240019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.510+0000 7f0f1f7fe700 1 -- 172.21.15.38:0/4026653615 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f240124f0 con 0x7f0f14003900 2020-06-12T17:50:49.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.510+0000 7f0f2f59e700 1 -- 172.21.15.38:0/4026653615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f30062540 con 0x7f0f14003900 2020-06-12T17:50:49.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.510+0000 7f0f1f7fe700 1 -- 172.21.15.38:0/4026653615 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f24012850 con 0x7f0f14003900 2020-06-12T17:50:49.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.510+0000 7f0f2f59e700 1 -- 172.21.15.38:0/4026653615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f300642c0 con 0x7f0f14003900 2020-06-12T17:50:49.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.510+0000 7f0f2e59c700 1 --2- 172.21.15.38:0/4026653615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f14003900 0x7f0f301111e0 secure :-1 s=THROTTLE_DONE pgs=740 cs=0 l=1 rx=0x7f0f240010d0 tx=0x7f0f240019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.511+0000 7f0f1f7fe700 1 -- 172.21.15.38:0/4026653615 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f0f24012a80 con 0x7f0f14003900 2020-06-12T17:50:49.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.511+0000 7f0f2e59c700 1 --2- 172.21.15.38:0/4026653615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f14003900 0x7f0f301111e0 secure :-1 s=THROTTLE_DONE pgs=740 cs=0 l=1 rx=0x7f0f240010d0 tx=0x7f0f240019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.511+0000 7f0f2f59e700 1 -- 172.21.15.38:0/4026653615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f30056c30 con 0x7f0f14003900 2020-06-12T17:50:49.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.511+0000 7f0f1f7fe700 1 --2- 172.21.15.38:0/4026653615 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0f0c04d4f0 0x7f0f0c04f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:49.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.512+0000 7f0f1f7fe700 1 -- 172.21.15.38:0/4026653615 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0f24061f50 con 0x7f0f14003900 2020-06-12T17:50:49.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.512+0000 7f0f2dd9b700 1 --2- 172.21.15.38:0/4026653615 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0f0c04d4f0 0x7f0f0c04f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:49.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.512+0000 7f0f2dd9b700 1 --2- 172.21.15.38:0/4026653615 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0f0c04d4f0 0x7f0f0c04f9b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0f200020c0 tx=0x7f0f300b1c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.540 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.512+0000 7f0f2dd9b700 1 --2- 172.21.15.38:0/4026653615 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0f0c04d4f0 0x7f0f0c04f9b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0f200020c0 tx=0x7f0f300b1c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.540 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.512+0000 7f0f2dd9b700 1 --2- 172.21.15.38:0/4026653615 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0f0c04d4f0 0x7f0f0c04f9b0 secure :-1 s=READY pgs=289 cs=0 l=1 rx=0x7f0f200020c0 tx=0x7f0f300b1c60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:49.541 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.515+0000 7f0f2e59c700 1 --2- 172.21.15.38:0/4026653615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f14003900 0x7f0f301111e0 secure :-1 s=THROTTLE_DONE pgs=740 cs=0 l=1 rx=0x7f0f240010d0 tx=0x7f0f240019a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.541 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.515+0000 7f0f1f7fe700 1 -- 172.21.15.38:0/4026653615 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f0f2403d790 con 0x7f0f14003900 2020-06-12T17:50:49.714 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.710+0000 7f0f2f59e700 1 -- 172.21.15.38:0/4026653615 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_7782", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f30062740 con 0x7f0f0c04d4f0 2020-06-12T17:50:49.718 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.714+0000 7f0f2dd9b700 1 --2- 172.21.15.38:0/4026653615 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0f0c04d4f0 0x7f0f0c04f9b0 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7f0f200020c0 tx=0x7f0f300b1c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:49.718 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.714+0000 7f0f1f7fe700 1 -- 172.21.15.38:0/4026653615 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f0f2000cb20 con 0x7f0f0c04d4f0 2020-06-12T17:50:49.718 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_7782/307da5bb-798a-45f4-bcc2-394ab7370691 2020-06-12T17:50:49.720 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.715+0000 7f0f2f59e700 1 -- 172.21.15.38:0/4026653615 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0f0c04d4f0 msgr2=0x7f0f0c04f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:49.720 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.715+0000 7f0f2f59e700 1 --2- 172.21.15.38:0/4026653615 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0f0c04d4f0 0x7f0f0c04f9b0 secure :-1 s=READY pgs=289 cs=0 l=1 rx=0x7f0f200020c0 tx=0x7f0f300b1c60).stop 2020-06-12T17:50:49.720 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.715+0000 7f0f2f59e700 1 -- 172.21.15.38:0/4026653615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f14003900 msgr2=0x7f0f301111e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:49.720 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.715+0000 7f0f2f59e700 1 --2- 172.21.15.38:0/4026653615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f14003900 0x7f0f301111e0 secure :-1 s=READY pgs=740 cs=0 l=1 rx=0x7f0f240010d0 tx=0x7f0f240019a0).stop 2020-06-12T17:50:49.721 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.715+0000 7f0f2f59e700 1 -- 172.21.15.38:0/4026653615 shutdown_connections 2020-06-12T17:50:49.721 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.715+0000 7f0f2f59e700 1 --2- 172.21.15.38:0/4026653615 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0f0c04d4f0 0x7f0f0c04f9b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:49.721 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.715+0000 7f0f2f59e700 1 --2- 172.21.15.38:0/4026653615 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f30141900 0x7f0f30141d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:49.721 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.715+0000 7f0f2f59e700 1 --2- 172.21.15.38:0/4026653615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f14003900 0x7f0f301111e0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:49.722 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.715+0000 7f0f2f59e700 1 -- 172.21.15.38:0/4026653615 >> 172.21.15.38:0/4026653615 conn(0x7f0f300b4cc0 msgr2=0x7f0f30146770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:49.722 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.715+0000 7f0f2f59e700 1 -- 172.21.15.38:0/4026653615 shutdown_connections 2020-06-12T17:50:49.722 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:49.715+0000 7f0f2f59e700 1 -- 172.21.15.38:0/4026653615 wait complete. 2020-06-12T17:50:49.733 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_7782 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_7782/307da5bb-798a-45f4-bcc2-394ab7370691 2020-06-12T17:50:49.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:49.734 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:49.735 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:49.750 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:49.751 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:49.751 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7782/307da5bb-798a-45f4-bcc2-394ab7370691/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:49.841 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:49.841 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:49.842 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110613 s, 94.8 MB/s 2020-06-12T17:50:49.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:49.843 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:49.844 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:49.860 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:49.861 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:49.862 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7782/307da5bb-798a-45f4-bcc2-394ab7370691/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:49.948 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:49.948 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:49.948 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105487 s, 99.4 MB/s 2020-06-12T17:50:49.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:49.950 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:49.951 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:49.966 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:49.967 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:49.968 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7782/307da5bb-798a-45f4-bcc2-394ab7370691/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:50.055 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:50.056 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:50.056 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094233 s, 111 MB/s 2020-06-12T17:50:50.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:50.058 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:50.063 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:50.078 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:50.079 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:50.080 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7782/307da5bb-798a-45f4-bcc2-394ab7370691/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:50.166 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:50.167 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:50.167 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103258 s, 102 MB/s 2020-06-12T17:50:50.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:50.170 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:50.171 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:50.187 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:50.188 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:50.188 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7782/307da5bb-798a-45f4-bcc2-394ab7370691/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:50.274 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:50.275 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:50.275 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108476 s, 96.7 MB/s 2020-06-12T17:50:50.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:50.277 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:50.277 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:50.292 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:50.293 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:50.293 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7782/307da5bb-798a-45f4-bcc2-394ab7370691/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:50.381 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:50.381 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:50.381 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107613 s, 97.4 MB/s 2020-06-12T17:50:50.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:50.383 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:50.383 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:50.399 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:50.399 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:50.400 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7782/307da5bb-798a-45f4-bcc2-394ab7370691/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:50.487 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:50.488 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:50.488 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114514 s, 91.6 MB/s 2020-06-12T17:50:50.489 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:50.490 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:50.490 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:50.505 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:50.505 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:50.506 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7782/307da5bb-798a-45f4-bcc2-394ab7370691/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:50.589 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:50.590 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:50.590 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010515 s, 99.7 MB/s 2020-06-12T17:50:50.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:50.592 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:50.592 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:50.607 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:50.608 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:50.608 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7782/307da5bb-798a-45f4-bcc2-394ab7370691/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:50.697 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:50.697 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:50.697 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127694 s, 82.1 MB/s 2020-06-12T17:50:50.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:50.699 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:50.699 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:50.714 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:50.715 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:50.715 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7782/307da5bb-798a-45f4-bcc2-394ab7370691/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:50.803 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:50.804 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:50.804 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120798 s, 86.8 MB/s 2020-06-12T17:50:50.805 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_4431 2020-06-12T17:50:50.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.918+0000 7f04015fd700 1 Processor -- start 2020-06-12T17:50:50.922 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.918+0000 7f04015fd700 1 -- start start 2020-06-12T17:50:50.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.919+0000 7f04015fd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f03fc0b11e0 0x7f03fc0b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:50.925 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.919+0000 7f04015fd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03fc0b2380 0x7f03fc0ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:50.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.919+0000 7f04015fd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f03fc0ae520 0x7f03fc0afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:50.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.919+0000 7f04015fd700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03fc0b2900 con 0x7f03fc0b11e0 2020-06-12T17:50:50.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.919+0000 7f04015fd700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03fc0b1ad0 con 0x7f03fc0ae520 2020-06-12T17:50:50.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.919+0000 7f04015fd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc0b1d70 con 0x7f03fc0b2380 2020-06-12T17:50:50.926 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.919+0000 7f03fbfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f03fc0b11e0 0x7f03fc0b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:50.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.919+0000 7f03fbfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f03fc0b11e0 0x7f03fc0b15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39170/0 (socket says 172.21.15.38:39170) 2020-06-12T17:50:50.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.919+0000 7f03fbfff700 1 -- 172.21.15.38:0/1687836475 learned_addr learned my addr 172.21.15.38:0/1687836475 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:50.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.920+0000 7f0400dfc700 1 --2- 172.21.15.38:0/1687836475 >> v2:172.21.15.150:3300/0 conn(0x7f03fc0ae520 0x7f03fc0afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:50.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.920+0000 7f03fb7fe700 1 --2- 172.21.15.38:0/1687836475 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03fc0b2380 0x7f03fc0ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:50.927 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.920+0000 7f03fbfff700 1 -- 172.21.15.38:0/1687836475 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03fc0b2380 msgr2=0x7f03fc0ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:50.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.920+0000 7f03fbfff700 1 --2- 172.21.15.38:0/1687836475 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03fc0b2380 0x7f03fc0ae0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:50.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.920+0000 7f03fbfff700 1 -- 172.21.15.38:0/1687836475 >> v2:172.21.15.150:3300/0 conn(0x7f03fc0ae520 msgr2=0x7f03fc0afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:50.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.920+0000 7f03fbfff700 1 --2- 172.21.15.38:0/1687836475 >> v2:172.21.15.150:3300/0 conn(0x7f03fc0ae520 0x7f03fc0afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:50.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.920+0000 7f03fbfff700 1 -- 172.21.15.38:0/1687836475 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03fc0b0080 con 0x7f03fc0b11e0 2020-06-12T17:50:50.928 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.920+0000 7f03fb7fe700 1 --2- 172.21.15.38:0/1687836475 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03fc0b2380 0x7f03fc0ae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:50:50.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.920+0000 7f0400dfc700 1 --2- 172.21.15.38:0/1687836475 >> v2:172.21.15.150:3300/0 conn(0x7f03fc0ae520 0x7f03fc0afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:50:50.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.920+0000 7f03fbfff700 1 --2- 172.21.15.38:0/1687836475 >> v2:172.21.15.38:3300/0 conn(0x7f03fc0b11e0 0x7f03fc0b15c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f03ec002f30 tx=0x7f03ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:50.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.920+0000 7f03fbfff700 1 --2- 172.21.15.38:0/1687836475 >> v2:172.21.15.38:3300/0 conn(0x7f03fc0b11e0 0x7f03fc0b15c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f03ec002f30 tx=0x7f03ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:50.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.920+0000 7f03fbfff700 1 --2- 172.21.15.38:0/1687836475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03fc0b11e0 0x7f03fc0b15c0 secure :-1 s=READY pgs=741 cs=0 l=1 rx=0x7f03ec002f30 tx=0x7f03ec007e60).ready entity=mon.0 client_cookie=e5bd3218b956c25f server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:50.929 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.920+0000 7f03fbfff700 1 --2- 172.21.15.38:0/1687836475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03fc0b11e0 0x7f03fc0b15c0 secure :-1 s=THROTTLE_DONE pgs=741 cs=0 l=1 rx=0x7f03ec002f30 tx=0x7f03ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:50.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.920+0000 7f03fbfff700 1 --2- 172.21.15.38:0/1687836475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03fc0b11e0 0x7f03fc0b15c0 secure :-1 s=THROTTLE_DONE pgs=741 cs=0 l=1 rx=0x7f03ec002f30 tx=0x7f03ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:50.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.920+0000 7f03faffd700 1 -- 172.21.15.38:0/1687836475 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03ec0116e0 con 0x7f03fc0b11e0 2020-06-12T17:50:50.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.920+0000 7f03fbfff700 1 --2- 172.21.15.38:0/1687836475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03fc0b11e0 0x7f03fc0b15c0 secure :-1 s=THROTTLE_DONE pgs=741 cs=0 l=1 rx=0x7f03ec002f30 tx=0x7f03ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:50.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.920+0000 7f03faffd700 1 -- 172.21.15.38:0/1687836475 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ec011840 con 0x7f03fc0b11e0 2020-06-12T17:50:50.930 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.920+0000 7f03faffd700 1 -- 172.21.15.38:0/1687836475 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03ec011be0 con 0x7f03fc0b11e0 2020-06-12T17:50:50.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.920+0000 7f04015fd700 1 -- 172.21.15.38:0/1687836475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03fc0b11e0 msgr2=0x7f03fc0b15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:50.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.920+0000 7f04015fd700 1 --2- 172.21.15.38:0/1687836475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03fc0b11e0 0x7f03fc0b15c0 secure :-1 s=READY pgs=741 cs=0 l=1 rx=0x7f03ec002f30 tx=0x7f03ec007e60).stop 2020-06-12T17:50:50.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.921+0000 7f04015fd700 1 -- 172.21.15.38:0/1687836475 shutdown_connections 2020-06-12T17:50:50.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.921+0000 7f04015fd700 1 --2- 172.21.15.38:0/1687836475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03fc0b11e0 0x7f03fc0b15c0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:50.931 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.921+0000 7f04015fd700 1 --2- 172.21.15.38:0/1687836475 >> v2:172.21.15.150:3300/0 conn(0x7f03fc0ae520 0x7f03fc0afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:50.932 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.921+0000 7f04015fd700 1 --2- 172.21.15.38:0/1687836475 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03fc0b2380 0x7f03fc0ae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:50.932 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.921+0000 7f04015fd700 1 -- 172.21.15.38:0/1687836475 >> 172.21.15.38:0/1687836475 conn(0x7f03fc0b4cc0 msgr2=0x7f03fc0b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:50.932 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.921+0000 7f04015fd700 1 -- 172.21.15.38:0/1687836475 shutdown_connections 2020-06-12T17:50:50.932 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.921+0000 7f04015fd700 1 -- 172.21.15.38:0/1687836475 wait complete. 2020-06-12T17:50:50.932 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.922+0000 7f04015fd700 1 Processor -- start 2020-06-12T17:50:50.933 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.922+0000 7f04015fd700 1 -- start start 2020-06-12T17:50:50.936 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.922+0000 7f04015fd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03fc0ae520 0x7f03fc144370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:50.936 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.922+0000 7f04015fd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f03fc0b2380 0x7f03fc13c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:50.936 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.922+0000 7f04015fd700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03fc061990 con 0x7f03fc0b11e0 2020-06-12T17:50:50.936 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.922+0000 7f04015fd700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03fc13cab0 con 0x7f03fc0b2380 2020-06-12T17:50:50.936 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.922+0000 7f04015fd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc061c30 con 0x7f03fc0ae520 2020-06-12T17:50:50.937 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.923+0000 7f0400dfc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f03fc0b2380 0x7f03fc13c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:50.937 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.923+0000 7f0400dfc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f03fc0b2380 0x7f03fc13c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39180/0 (socket says 172.21.15.38:39180) 2020-06-12T17:50:50.937 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.923+0000 7f0400dfc700 1 -- 172.21.15.38:0/1464658926 learned_addr learned my addr 172.21.15.38:0/1464658926 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:50.937 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.923+0000 7f03fbfff700 1 --2- 172.21.15.38:0/1464658926 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03fc0ae520 0x7f03fc144370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:50.938 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.923+0000 7f0400dfc700 1 -- 172.21.15.38:0/1464658926 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03fc0ae520 msgr2=0x7f03fc144370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:50.938 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.923+0000 7f0400dfc700 1 --2- 172.21.15.38:0/1464658926 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03fc0ae520 0x7f03fc144370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:50.938 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.923+0000 7f0400dfc700 1 -- 172.21.15.38:0/1464658926 >> v1:172.21.15.150:6789/0 conn(0x7f03fc0b11e0 legacy=0x7f03fc143640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:50.938 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.923+0000 7f0400dfc700 1 -- 172.21.15.38:0/1464658926 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03fc061680 con 0x7f03fc0b2380 2020-06-12T17:50:50.939 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.923+0000 7f0400dfc700 1 --2- 172.21.15.38:0/1464658926 >> v2:172.21.15.38:3300/0 conn(0x7f03fc0b2380 0x7f03fc13c650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f03fc1452a0 tx=0x7f03f40081f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:50.939 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.923+0000 7f0400dfc700 1 --2- 172.21.15.38:0/1464658926 >> v2:172.21.15.38:3300/0 conn(0x7f03fc0b2380 0x7f03fc13c650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f03fc1452a0 tx=0x7f03f40081f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:50.939 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.923+0000 7f0400dfc700 1 --2- 172.21.15.38:0/1464658926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03fc0b2380 0x7f03fc13c650 secure :-1 s=READY pgs=742 cs=0 l=1 rx=0x7f03fc1452a0 tx=0x7f03f40081f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:50.939 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.923+0000 7f0400dfc700 1 --2- 172.21.15.38:0/1464658926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03fc0b2380 0x7f03fc13c650 secure :-1 s=THROTTLE_DONE pgs=742 cs=0 l=1 rx=0x7f03fc1452a0 tx=0x7f03f40081f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:50.939 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.923+0000 7f0400dfc700 1 --2- 172.21.15.38:0/1464658926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03fc0b2380 0x7f03fc13c650 secure :-1 s=THROTTLE_DONE pgs=742 cs=0 l=1 rx=0x7f03fc1452a0 tx=0x7f03f40081f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:50.939 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.923+0000 7f03f97fa700 1 -- 172.21.15.38:0/1464658926 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03f4007350 con 0x7f03fc0b2380 2020-06-12T17:50:50.940 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.923+0000 7f0400dfc700 1 --2- 172.21.15.38:0/1464658926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03fc0b2380 0x7f03fc13c650 secure :-1 s=THROTTLE_DONE pgs=742 cs=0 l=1 rx=0x7f03fc1452a0 tx=0x7f03f40081f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:50.940 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.923+0000 7f03f97fa700 1 -- 172.21.15.38:0/1464658926 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f40074b0 con 0x7f03fc0b2380 2020-06-12T17:50:50.940 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.923+0000 7f03f97fa700 1 -- 172.21.15.38:0/1464658926 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03f40078d0 con 0x7f03fc0b2380 2020-06-12T17:50:50.940 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.923+0000 7f04015fd700 1 -- 172.21.15.38:0/1464658926 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03fc0620d0 con 0x7f03fc0b2380 2020-06-12T17:50:50.940 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.923+0000 7f04015fd700 1 -- 172.21.15.38:0/1464658926 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03fc062570 con 0x7f03fc0b2380 2020-06-12T17:50:50.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.924+0000 7f0400dfc700 1 --2- 172.21.15.38:0/1464658926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03fc0b2380 0x7f03fc13c650 secure :-1 s=THROTTLE_DONE pgs=742 cs=0 l=1 rx=0x7f03fc1452a0 tx=0x7f03f40081f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:50.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.924+0000 7f04015fd700 1 -- 172.21.15.38:0/1464658926 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03fc056c30 con 0x7f03fc0b2380 2020-06-12T17:50:50.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.924+0000 7f03f97fa700 1 -- 172.21.15.38:0/1464658926 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f03f4012410 con 0x7f03fc0b2380 2020-06-12T17:50:50.942 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.924+0000 7f0400dfc700 1 --2- 172.21.15.38:0/1464658926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03fc0b2380 0x7f03fc13c650 secure :-1 s=THROTTLE_DONE pgs=742 cs=0 l=1 rx=0x7f03fc1452a0 tx=0x7f03f40081f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:50.942 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.925+0000 7f03f97fa700 1 --2- 172.21.15.38:0/1464658926 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f03dc04d660 0x7f03dc04fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:50.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.925+0000 7f03f97fa700 1 -- 172.21.15.38:0/1464658926 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f03f4061210 con 0x7f03fc0b2380 2020-06-12T17:50:50.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.925+0000 7f03fbfff700 1 --2- 172.21.15.38:0/1464658926 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f03dc04d660 0x7f03dc04fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:50.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.925+0000 7f03fbfff700 1 --2- 172.21.15.38:0/1464658926 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f03dc04d660 0x7f03dc04fb20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f03ec002f30 tx=0x7f03ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:50.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.925+0000 7f03fbfff700 1 --2- 172.21.15.38:0/1464658926 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f03dc04d660 0x7f03dc04fb20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f03ec002f30 tx=0x7f03ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:50.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.925+0000 7f03fbfff700 1 --2- 172.21.15.38:0/1464658926 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f03dc04d660 0x7f03dc04fb20 secure :-1 s=READY pgs=290 cs=0 l=1 rx=0x7f03ec002f30 tx=0x7f03ec007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:50.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.928+0000 7f0400dfc700 1 --2- 172.21.15.38:0/1464658926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03fc0b2380 0x7f03fc13c650 secure :-1 s=THROTTLE_DONE pgs=742 cs=0 l=1 rx=0x7f03fc1452a0 tx=0x7f03f40081f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:50.944 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:50.928+0000 7f03f97fa700 1 -- 172.21.15.38:0/1464658926 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f03f403c930 con 0x7f03fc0b2380 2020-06-12T17:50:51.130 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.125+0000 7f04015fd700 1 -- 172.21.15.38:0/1464658926 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_4431", "target": ["mon-mgr", ""]}) v1 -- 0x7f03fc066470 con 0x7f03dc04d660 2020-06-12T17:50:51.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.145+0000 7f03fbfff700 1 --2- 172.21.15.38:0/1464658926 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f03dc04d660 0x7f03dc04fb20 secure :-1 s=THROTTLE_DONE pgs=290 cs=0 l=1 rx=0x7f03ec002f30 tx=0x7f03ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:51.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.145+0000 7f03f97fa700 1 -- 172.21.15.38:0/1464658926 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f03fc066470 con 0x7f03dc04d660 2020-06-12T17:50:51.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.147+0000 7f04015fd700 1 -- 172.21.15.38:0/1464658926 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f03dc04d660 msgr2=0x7f03dc04fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:51.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.147+0000 7f04015fd700 1 --2- 172.21.15.38:0/1464658926 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f03dc04d660 0x7f03dc04fb20 secure :-1 s=READY pgs=290 cs=0 l=1 rx=0x7f03ec002f30 tx=0x7f03ec007e60).stop 2020-06-12T17:50:51.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.147+0000 7f04015fd700 1 -- 172.21.15.38:0/1464658926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03fc0b2380 msgr2=0x7f03fc13c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:51.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.147+0000 7f04015fd700 1 --2- 172.21.15.38:0/1464658926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03fc0b2380 0x7f03fc13c650 secure :-1 s=READY pgs=742 cs=0 l=1 rx=0x7f03fc1452a0 tx=0x7f03f40081f0).stop 2020-06-12T17:50:51.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.147+0000 7f04015fd700 1 -- 172.21.15.38:0/1464658926 shutdown_connections 2020-06-12T17:50:51.156 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.147+0000 7f04015fd700 1 --2- 172.21.15.38:0/1464658926 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f03dc04d660 0x7f03dc04fb20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:51.156 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.147+0000 7f04015fd700 1 --2- 172.21.15.38:0/1464658926 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f03fc0ae520 0x7f03fc144370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:51.156 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.147+0000 7f04015fd700 1 --2- 172.21.15.38:0/1464658926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03fc0b2380 0x7f03fc13c650 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:51.156 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.147+0000 7f04015fd700 1 -- 172.21.15.38:0/1464658926 >> 172.21.15.38:0/1464658926 conn(0x7f03fc0b4cc0 msgr2=0x7f03fc141d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:51.156 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.147+0000 7f04015fd700 1 -- 172.21.15.38:0/1464658926 shutdown_connections 2020-06-12T17:50:51.157 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.147+0000 7f04015fd700 1 -- 172.21.15.38:0/1464658926 wait complete. 2020-06-12T17:50:51.160 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_4431 2020-06-12T17:50:51.277 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.274+0000 7f6ee9d80700 1 Processor -- start 2020-06-12T17:50:51.278 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.274+0000 7f6ee9d80700 1 -- start start 2020-06-12T17:50:51.280 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.275+0000 7f6ee9d80700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6ee409df00 0x7f6ee413c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:51.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.275+0000 7f6ee9d80700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6ee4142e90 0x7f6ee4066790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:51.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.275+0000 7f6ee9d80700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee409b960 con 0x7f6ee40b3ac0 2020-06-12T17:50:51.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.275+0000 7f6ee9d80700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee4143270 con 0x7f6ee4142e90 2020-06-12T17:50:51.281 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.275+0000 7f6ee9d80700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee409bc00 con 0x7f6ee409df00 2020-06-12T17:50:51.282 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.275+0000 7f6ee3fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6ee4142e90 0x7f6ee4066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:51.282 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.275+0000 7f6ee3fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6ee4142e90 0x7f6ee4066790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39188/0 (socket says 172.21.15.38:39188) 2020-06-12T17:50:51.282 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.275+0000 7f6ee37fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6ee40b3ac0 0x7f6ee413bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41000/0 (socket says 172.21.15.38:41000) 2020-06-12T17:50:51.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.275+0000 7f6ee3fff700 1 -- 172.21.15.38:0/3728280892 learned_addr learned my addr 172.21.15.38:0/3728280892 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:51.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.275+0000 7f6ee2ffd700 1 --2- 172.21.15.38:0/3728280892 >> v2:172.21.15.150:3300/0 conn(0x7f6ee409df00 0x7f6ee413c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:51.283 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.275+0000 7f6ee3fff700 1 -- 172.21.15.38:0/3728280892 >> v2:172.21.15.150:3300/0 conn(0x7f6ee409df00 msgr2=0x7f6ee413c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:51.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.275+0000 7f6ee3fff700 1 --2- 172.21.15.38:0/3728280892 >> v2:172.21.15.150:3300/0 conn(0x7f6ee409df00 0x7f6ee413c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:51.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.275+0000 7f6ee3fff700 1 -- 172.21.15.38:0/3728280892 >> v1:172.21.15.38:6789/0 conn(0x7f6ee40b3ac0 legacy=0x7f6ee413bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:51.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.275+0000 7f6ee3fff700 1 -- 172.21.15.38:0/3728280892 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee40b48f0 con 0x7f6ee4142e90 2020-06-12T17:50:51.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.275+0000 7f6ee27fc700 1 -- 172.21.15.38:0/3728280892 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 944498614 0 0) 0x7f6ee409b960 con 0x7f6ee40b3ac0 2020-06-12T17:50:51.284 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.275+0000 7f6ee3fff700 1 --2- 172.21.15.38:0/3728280892 >> v2:172.21.15.38:3300/0 conn(0x7f6ee4142e90 0x7f6ee4066790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6edc0032b0 tx=0x7f6edc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:51.285 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.275+0000 7f6ee3fff700 1 --2- 172.21.15.38:0/3728280892 >> v2:172.21.15.38:3300/0 conn(0x7f6ee4142e90 0x7f6ee4066790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6edc0032b0 tx=0x7f6edc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:51.285 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.275+0000 7f6ee3fff700 1 --2- 172.21.15.38:0/3728280892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ee4142e90 0x7f6ee4066790 secure :-1 s=READY pgs=744 cs=0 l=1 rx=0x7f6edc0032b0 tx=0x7f6edc0081e0).ready entity=mon.0 client_cookie=ea5bf6a04dccecc7 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:51.285 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.275+0000 7f6ee3fff700 1 --2- 172.21.15.38:0/3728280892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ee4142e90 0x7f6ee4066790 secure :-1 s=THROTTLE_DONE pgs=744 cs=0 l=1 rx=0x7f6edc0032b0 tx=0x7f6edc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:51.285 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.275+0000 7f6ee27fc700 1 -- 172.21.15.38:0/3728280892 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6edc00a160 con 0x7f6ee4142e90 2020-06-12T17:50:51.288 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.275+0000 7f6ee3fff700 1 --2- 172.21.15.38:0/3728280892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ee4142e90 0x7f6ee4066790 secure :-1 s=THROTTLE_DONE pgs=744 cs=0 l=1 rx=0x7f6edc0032b0 tx=0x7f6edc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:51.288 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.275+0000 7f6ee3fff700 1 --2- 172.21.15.38:0/3728280892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ee4142e90 0x7f6ee4066790 secure :-1 s=THROTTLE_DONE pgs=744 cs=0 l=1 rx=0x7f6edc0032b0 tx=0x7f6edc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:51.288 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.276+0000 7f6ee27fc700 1 -- 172.21.15.38:0/3728280892 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6edc00a2c0 con 0x7f6ee4142e90 2020-06-12T17:50:51.289 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.276+0000 7f6ee27fc700 1 -- 172.21.15.38:0/3728280892 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6edc00a660 con 0x7f6ee4142e90 2020-06-12T17:50:51.289 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.276+0000 7f6ee9d80700 1 -- 172.21.15.38:0/3728280892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ee4142e90 msgr2=0x7f6ee4066790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:51.289 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.276+0000 7f6ee9d80700 1 --2- 172.21.15.38:0/3728280892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ee4142e90 0x7f6ee4066790 secure :-1 s=READY pgs=744 cs=0 l=1 rx=0x7f6edc0032b0 tx=0x7f6edc0081e0).stop 2020-06-12T17:50:51.289 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.276+0000 7f6ee9d80700 1 -- 172.21.15.38:0/3728280892 shutdown_connections 2020-06-12T17:50:51.289 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.276+0000 7f6ee9d80700 1 --2- 172.21.15.38:0/3728280892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ee4142e90 0x7f6ee4066790 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:51.290 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.276+0000 7f6ee9d80700 1 --2- 172.21.15.38:0/3728280892 >> v2:172.21.15.150:3300/0 conn(0x7f6ee409df00 0x7f6ee413c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:51.290 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.276+0000 7f6ee9d80700 1 -- 172.21.15.38:0/3728280892 >> 172.21.15.38:0/3728280892 conn(0x7f6ee40b5a20 msgr2=0x7f6ee405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:51.290 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.276+0000 7f6ee9d80700 1 -- 172.21.15.38:0/3728280892 shutdown_connections 2020-06-12T17:50:51.290 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.276+0000 7f6ee9d80700 1 -- 172.21.15.38:0/3728280892 wait complete. 2020-06-12T17:50:51.291 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.277+0000 7f6ee9d80700 1 Processor -- start 2020-06-12T17:50:51.291 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.277+0000 7f6ee9d80700 1 -- start start 2020-06-12T17:50:51.297 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.278+0000 7f6ee9d80700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6ee409df00 0x7f6ee41461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:51.297 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.278+0000 7f6ee9d80700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee4145810 con 0x7f6ee4142e90 2020-06-12T17:50:51.298 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.278+0000 7f6ee9d80700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee4145ab0 con 0x7f6ee40b3ac0 2020-06-12T17:50:51.298 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.278+0000 7f6ee9d80700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee4145d50 con 0x7f6ee409df00 2020-06-12T17:50:51.298 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.278+0000 7f6ee37fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6ee409df00 0x7f6ee41461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:51.299 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.278+0000 7f6ee37fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6ee409df00 0x7f6ee41461f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39190/0 (socket says 172.21.15.38:39190) 2020-06-12T17:50:51.299 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.278+0000 7f6ee3fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6ee4142e90 0x7f6ee413eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41010/0 (socket says 172.21.15.38:41010) 2020-06-12T17:50:51.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.278+0000 7f6ee37fe700 1 -- 172.21.15.38:0/2789937840 learned_addr learned my addr 172.21.15.38:0/2789937840 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:51.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.278+0000 7f6ee37fe700 1 -- 172.21.15.38:0/2789937840 >> v1:172.21.15.150:6789/0 conn(0x7f6ee40b3ac0 legacy=0x7f6ee4061900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:51.300 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.278+0000 7f6ee37fe700 1 -- 172.21.15.38:0/2789937840 >> v1:172.21.15.38:6789/0 conn(0x7f6ee4142e90 legacy=0x7f6ee413eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:51.301 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.278+0000 7f6ee0ff9700 1 -- 172.21.15.38:0/2789937840 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3387204482 0 0) 0x7f6ee4145810 con 0x7f6ee4142e90 2020-06-12T17:50:51.301 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.278+0000 7f6ee37fe700 1 -- 172.21.15.38:0/2789937840 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee4145500 con 0x7f6ee409df00 2020-06-12T17:50:51.302 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.278+0000 7f6ee37fe700 1 --2- 172.21.15.38:0/2789937840 >> v2:172.21.15.38:3300/0 conn(0x7f6ee409df00 0x7f6ee41461f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ee41459a0 tx=0x7f6ed4001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:51.302 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.278+0000 7f6ee37fe700 1 --2- 172.21.15.38:0/2789937840 >> v2:172.21.15.38:3300/0 conn(0x7f6ee409df00 0x7f6ee41461f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ee41459a0 tx=0x7f6ed4001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:51.302 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.278+0000 7f6ee37fe700 1 --2- 172.21.15.38:0/2789937840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ee409df00 0x7f6ee41461f0 secure :-1 s=READY pgs=746 cs=0 l=1 rx=0x7f6ee41459a0 tx=0x7f6ed4001780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:51.303 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.278+0000 7f6ee37fe700 1 --2- 172.21.15.38:0/2789937840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ee409df00 0x7f6ee41461f0 secure :-1 s=THROTTLE_DONE pgs=746 cs=0 l=1 rx=0x7f6ee41459a0 tx=0x7f6ed4001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:51.303 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.279+0000 7f6ee0ff9700 1 -- 172.21.15.38:0/2789937840 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ed4011660 con 0x7f6ee409df00 2020-06-12T17:50:51.304 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.279+0000 7f6ee37fe700 1 --2- 172.21.15.38:0/2789937840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ee409df00 0x7f6ee41461f0 secure :-1 s=THROTTLE_DONE pgs=746 cs=0 l=1 rx=0x7f6ee41459a0 tx=0x7f6ed4001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:51.304 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.279+0000 7f6ee37fe700 1 --2- 172.21.15.38:0/2789937840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ee409df00 0x7f6ee41461f0 secure :-1 s=THROTTLE_DONE pgs=746 cs=0 l=1 rx=0x7f6ee41459a0 tx=0x7f6ed4001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:51.304 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.279+0000 7f6ee0ff9700 1 -- 172.21.15.38:0/2789937840 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed40117c0 con 0x7f6ee409df00 2020-06-12T17:50:51.305 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.279+0000 7f6ee9d80700 1 -- 172.21.15.38:0/2789937840 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee413f2a0 con 0x7f6ee409df00 2020-06-12T17:50:51.305 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.279+0000 7f6ee0ff9700 1 -- 172.21.15.38:0/2789937840 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ed4011ba0 con 0x7f6ee409df00 2020-06-12T17:50:51.306 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.279+0000 7f6ee9d80700 1 -- 172.21.15.38:0/2789937840 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee40b2770 con 0x7f6ee409df00 2020-06-12T17:50:51.306 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.279+0000 7f6ee37fe700 1 --2- 172.21.15.38:0/2789937840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ee409df00 0x7f6ee41461f0 secure :-1 s=THROTTLE_DONE pgs=746 cs=0 l=1 rx=0x7f6ee41459a0 tx=0x7f6ed4001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:51.306 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.280+0000 7f6ee9d80700 1 -- 172.21.15.38:0/2789937840 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee4056c30 con 0x7f6ee409df00 2020-06-12T17:50:51.307 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.280+0000 7f6ee0ff9700 1 -- 172.21.15.38:0/2789937840 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f6ed400b0a0 con 0x7f6ee409df00 2020-06-12T17:50:51.307 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.280+0000 7f6ee37fe700 1 --2- 172.21.15.38:0/2789937840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ee409df00 0x7f6ee41461f0 secure :-1 s=THROTTLE_DONE pgs=746 cs=0 l=1 rx=0x7f6ee41459a0 tx=0x7f6ed4001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:51.308 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.280+0000 7f6ee0ff9700 1 --2- 172.21.15.38:0/2789937840 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6ec404d480 0x7f6ec404f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:51.308 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.280+0000 7f6ee0ff9700 1 -- 172.21.15.38:0/2789937840 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f6ed4060e30 con 0x7f6ee409df00 2020-06-12T17:50:51.308 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.281+0000 7f6ee2ffd700 1 --2- 172.21.15.38:0/2789937840 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6ec404d480 0x7f6ec404f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:51.309 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.281+0000 7f6ee2ffd700 1 --2- 172.21.15.38:0/2789937840 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6ec404d480 0x7f6ec404f940 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ed8002f30 tx=0x7f6ed80059a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:51.309 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.281+0000 7f6ee2ffd700 1 --2- 172.21.15.38:0/2789937840 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6ec404d480 0x7f6ec404f940 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ed8002f30 tx=0x7f6ed80059a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:51.310 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.281+0000 7f6ee2ffd700 1 --2- 172.21.15.38:0/2789937840 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6ec404d480 0x7f6ec404f940 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7f6ed8002f30 tx=0x7f6ed80059a0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:51.310 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.283+0000 7f6ee37fe700 1 --2- 172.21.15.38:0/2789937840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ee409df00 0x7f6ee41461f0 secure :-1 s=THROTTLE_DONE pgs=746 cs=0 l=1 rx=0x7f6ee41459a0 tx=0x7f6ed4001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:51.311 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.284+0000 7f6ee0ff9700 1 -- 172.21.15.38:0/2789937840 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f6ed403c550 con 0x7f6ee409df00 2020-06-12T17:50:51.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.486+0000 7f6ee9d80700 1 -- 172.21.15.38:0/2789937840 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_4431", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ee4145f50 con 0x7f6ec404d480 2020-06-12T17:50:51.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.489+0000 7f6ee2ffd700 1 --2- 172.21.15.38:0/2789937840 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6ec404d480 0x7f6ec404f940 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f6ed8002f30 tx=0x7f6ed80059a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:51.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.489+0000 7f6ee0ff9700 1 -- 172.21.15.38:0/2789937840 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f6ed800ddd0 con 0x7f6ec404d480 2020-06-12T17:50:51.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.491+0000 7f6ee9d80700 1 -- 172.21.15.38:0/2789937840 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6ec404d480 msgr2=0x7f6ec404f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:51.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.491+0000 7f6ee9d80700 1 --2- 172.21.15.38:0/2789937840 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6ec404d480 0x7f6ec404f940 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7f6ed8002f30 tx=0x7f6ed80059a0).stop 2020-06-12T17:50:51.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.491+0000 7f6ee9d80700 1 -- 172.21.15.38:0/2789937840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ee409df00 msgr2=0x7f6ee41461f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:51.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.491+0000 7f6ee9d80700 1 --2- 172.21.15.38:0/2789937840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ee409df00 0x7f6ee41461f0 secure :-1 s=READY pgs=746 cs=0 l=1 rx=0x7f6ee41459a0 tx=0x7f6ed4001780).stop 2020-06-12T17:50:51.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.491+0000 7f6ee9d80700 1 -- 172.21.15.38:0/2789937840 shutdown_connections 2020-06-12T17:50:51.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.491+0000 7f6ee9d80700 1 --2- 172.21.15.38:0/2789937840 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6ec404d480 0x7f6ec404f940 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:51.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.491+0000 7f6ee9d80700 1 --2- 172.21.15.38:0/2789937840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ee409df00 0x7f6ee41461f0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:51.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.491+0000 7f6ee9d80700 1 -- 172.21.15.38:0/2789937840 >> 172.21.15.38:0/2789937840 conn(0x7f6ee40b5a20 msgr2=0x7f6ee4140ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:51.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.491+0000 7f6ee9d80700 1 -- 172.21.15.38:0/2789937840 shutdown_connections 2020-06-12T17:50:51.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:51.491+0000 7f6ee9d80700 1 -- 172.21.15.38:0/2789937840 wait complete. 2020-06-12T17:50:51.500 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_4431/91b8c767-9f76-413e-a546-0b9d31f83ef7 2020-06-12T17:50:51.504 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_4431 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_4431/91b8c767-9f76-413e-a546-0b9d31f83ef7 2020-06-12T17:50:51.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:51.505 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:51.506 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:51.523 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:51.524 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:51.525 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4431/91b8c767-9f76-413e-a546-0b9d31f83ef7/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:51.614 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:51.614 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:51.615 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108704 s, 96.5 MB/s 2020-06-12T17:50:51.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:51.616 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:51.617 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:51.632 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:51.632 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:51.633 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4431/91b8c767-9f76-413e-a546-0b9d31f83ef7/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:51.726 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:51.727 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:51.727 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118119 s, 88.8 MB/s 2020-06-12T17:50:51.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:51.729 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:51.729 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:51.748 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:51.749 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:51.749 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4431/91b8c767-9f76-413e-a546-0b9d31f83ef7/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:51.835 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:51.835 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:51.835 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101446 s, 103 MB/s 2020-06-12T17:50:51.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:51.837 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:51.838 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:51.853 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:51.853 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:51.854 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4431/91b8c767-9f76-413e-a546-0b9d31f83ef7/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:51.953 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:51.953 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:51.953 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108054 s, 97.0 MB/s 2020-06-12T17:50:51.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:51.958 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:51.959 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:51.973 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:51.974 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:51.975 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4431/91b8c767-9f76-413e-a546-0b9d31f83ef7/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:52.063 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:52.063 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:52.064 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105902 s, 99.0 MB/s 2020-06-12T17:50:52.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:52.065 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:52.066 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:52.081 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:52.082 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:52.083 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4431/91b8c767-9f76-413e-a546-0b9d31f83ef7/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:52.170 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:52.171 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:52.171 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110016 s, 95.3 MB/s 2020-06-12T17:50:52.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:52.174 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:52.175 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:52.212 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:52.213 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:52.214 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4431/91b8c767-9f76-413e-a546-0b9d31f83ef7/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:52.303 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:52.304 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:52.304 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128126 s, 81.8 MB/s 2020-06-12T17:50:52.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:52.305 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:52.306 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:52.321 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:52.321 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:52.322 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4431/91b8c767-9f76-413e-a546-0b9d31f83ef7/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:52.408 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:52.409 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:52.409 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107127 s, 97.9 MB/s 2020-06-12T17:50:52.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:52.411 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:52.411 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:52.426 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:52.427 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:52.427 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4431/91b8c767-9f76-413e-a546-0b9d31f83ef7/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:52.520 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:52.520 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:52.521 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122315 s, 85.7 MB/s 2020-06-12T17:50:52.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:52.522 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:52.523 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:52.538 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:52.538 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:52.539 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4431/91b8c767-9f76-413e-a546-0b9d31f83ef7/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:52.634 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:52.635 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:52.635 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107678 s, 97.4 MB/s 2020-06-12T17:50:52.636 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_2497 2020-06-12T17:50:52.754 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.750+0000 7f16935ee700 1 Processor -- start 2020-06-12T17:50:52.754 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.750+0000 7f16935ee700 1 -- start start 2020-06-12T17:50:52.762 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.751+0000 7f16935ee700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f168c146680 0x7f168c0ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:52.763 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.751+0000 7f16935ee700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f168c0b2eb0 0x7f168c09d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:52.764 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.751+0000 7f16935ee700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f168c146d20 con 0x7f168c09d620 2020-06-12T17:50:52.764 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.751+0000 7f16935ee700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168c066a80 con 0x7f168c0b2eb0 2020-06-12T17:50:52.764 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.751+0000 7f16935ee700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168c146f50 con 0x7f168c146680 2020-06-12T17:50:52.765 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.751+0000 7f1691b8b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f168c09d620 0x7f168c09b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41018/0 (socket says 172.21.15.38:41018) 2020-06-12T17:50:52.765 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.751+0000 7f1691b8b700 1 -- 172.21.15.38:0/3892183235 learned_addr learned my addr 172.21.15.38:0/3892183235 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:52.766 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.751+0000 7f169138a700 1 --2- 172.21.15.38:0/3892183235 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f168c146680 0x7f168c0ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:52.766 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.751+0000 7f1690b89700 1 --2- 172.21.15.38:0/3892183235 >> v2:172.21.15.150:3300/0 conn(0x7f168c0b2eb0 0x7f168c09d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:52.766 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.751+0000 7f167bfff700 1 -- 172.21.15.38:0/3892183235 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1213026875 0 0) 0x7f168c146d20 con 0x7f168c09d620 2020-06-12T17:50:52.766 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.751+0000 7f167bfff700 1 -- 172.21.15.38:0/3892183235 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1674003230 con 0x7f168c09d620 2020-06-12T17:50:52.766 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f167bfff700 1 -- 172.21.15.38:0/3892183235 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2149264195 0 0) 0x7f1674003230 con 0x7f168c09d620 2020-06-12T17:50:52.767 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f167bfff700 1 -- 172.21.15.38:0/3892183235 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f168c146680 msgr2=0x7f168c0ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:52.767 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f167bfff700 1 --2- 172.21.15.38:0/3892183235 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f168c146680 0x7f168c0ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:52.768 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f167bfff700 1 -- 172.21.15.38:0/3892183235 >> v2:172.21.15.150:3300/0 conn(0x7f168c0b2eb0 msgr2=0x7f168c09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:52.768 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f167bfff700 1 --2- 172.21.15.38:0/3892183235 >> v2:172.21.15.150:3300/0 conn(0x7f168c0b2eb0 0x7f168c09d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:52.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f167bfff700 1 -- 172.21.15.38:0/3892183235 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c146a60 con 0x7f168c09d620 2020-06-12T17:50:52.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f167bfff700 1 -- 172.21.15.38:0/3892183235 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f1684001a50 con 0x7f168c09d620 2020-06-12T17:50:52.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f167bfff700 1 -- 172.21.15.38:0/3892183235 >> v1:172.21.15.38:6789/0 conn(0x7f168c09d620 legacy=0x7f168c09b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:52.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f167bfff700 1 --2- 172.21.15.38:0/3892183235 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1674003720 0x7f1674003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:52.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f167bfff700 1 --2- 172.21.15.38:0/3892183235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1674004060 0x7f1674004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:52.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f167bfff700 1 --2- 172.21.15.38:0/3892183235 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f168c146680 0x7f1674004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:52.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f167bfff700 1 -- 172.21.15.38:0/3892183235 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c066a80 con 0x7f1674004060 2020-06-12T17:50:52.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f167bfff700 1 -- 172.21.15.38:0/3892183235 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c146f50 con 0x7f1674003720 2020-06-12T17:50:52.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f167bfff700 1 -- 172.21.15.38:0/3892183235 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1674004ff0 con 0x7f168c146680 2020-06-12T17:50:52.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f1690b89700 1 --2- 172.21.15.38:0/3892183235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1674004060 0x7f1674004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:52.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f169138a700 1 --2- 172.21.15.38:0/3892183235 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1674003720 0x7f1674003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:52.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f1691b8b700 1 --2- 172.21.15.38:0/3892183235 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f168c146680 0x7f1674004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:52.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f1690b89700 1 -- 172.21.15.38:0/3892183235 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f168c146680 msgr2=0x7f1674004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:52.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f1690b89700 1 --2- 172.21.15.38:0/3892183235 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f168c146680 0x7f1674004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:52.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f1690b89700 1 -- 172.21.15.38:0/3892183235 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1674003720 msgr2=0x7f1674003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:52.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f1690b89700 1 --2- 172.21.15.38:0/3892183235 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1674003720 0x7f1674003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:52.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f1690b89700 1 -- 172.21.15.38:0/3892183235 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1674003230 con 0x7f1674004060 2020-06-12T17:50:52.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f1690b89700 1 --2- 172.21.15.38:0/3892183235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1674004060 0x7f1674004530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1688008910 tx=0x7f1688007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:52.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f1690b89700 1 --2- 172.21.15.38:0/3892183235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1674004060 0x7f1674004530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1688008910 tx=0x7f1688007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:52.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f1690b89700 1 --2- 172.21.15.38:0/3892183235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1674004060 0x7f1674004530 secure :-1 s=READY pgs=748 cs=0 l=1 rx=0x7f1688008910 tx=0x7f1688007e60).ready entity=mon.0 client_cookie=95adc4ff300c156f server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:52.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f1690b89700 1 --2- 172.21.15.38:0/3892183235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1674004060 0x7f1674004530 secure :-1 s=THROTTLE_DONE pgs=748 cs=0 l=1 rx=0x7f1688008910 tx=0x7f1688007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:52.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f1690b89700 1 --2- 172.21.15.38:0/3892183235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1674004060 0x7f1674004530 secure :-1 s=THROTTLE_DONE pgs=748 cs=0 l=1 rx=0x7f1688008910 tx=0x7f1688007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:52.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f167bfff700 1 -- 172.21.15.38:0/3892183235 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1688008d50 con 0x7f1674004060 2020-06-12T17:50:52.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f1690b89700 1 --2- 172.21.15.38:0/3892183235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1674004060 0x7f1674004530 secure :-1 s=THROTTLE_DONE pgs=748 cs=0 l=1 rx=0x7f1688008910 tx=0x7f1688007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:52.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f167bfff700 1 -- 172.21.15.38:0/3892183235 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16880108e0 con 0x7f1674004060 2020-06-12T17:50:52.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f167bfff700 1 -- 172.21.15.38:0/3892183235 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1688010cc0 con 0x7f1674004060 2020-06-12T17:50:52.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f16935ee700 1 -- 172.21.15.38:0/3892183235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1674004060 msgr2=0x7f1674004530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:52.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f16935ee700 1 --2- 172.21.15.38:0/3892183235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1674004060 0x7f1674004530 secure :-1 s=READY pgs=748 cs=0 l=1 rx=0x7f1688008910 tx=0x7f1688007e60).stop 2020-06-12T17:50:52.777 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.752+0000 7f1691b8b700 1 -- 172.21.15.38:0/3892183235 reap_dead start 2020-06-12T17:50:52.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.753+0000 7f16935ee700 1 -- 172.21.15.38:0/3892183235 shutdown_connections 2020-06-12T17:50:52.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.753+0000 7f16935ee700 1 -- 172.21.15.38:0/3892183235 >> 172.21.15.38:0/3892183235 conn(0x7f168c0b5a20 msgr2=0x7f168c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:52.778 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.753+0000 7f16935ee700 1 -- 172.21.15.38:0/3892183235 shutdown_connections 2020-06-12T17:50:52.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.753+0000 7f16935ee700 1 -- 172.21.15.38:0/3892183235 wait complete. 2020-06-12T17:50:52.779 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.754+0000 7f16935ee700 1 Processor -- start 2020-06-12T17:50:52.780 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.754+0000 7f16935ee700 1 -- start start 2020-06-12T17:50:52.780 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.755+0000 7f16935ee700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f168c061890 0x7f168c0b2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:52.780 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.755+0000 7f16935ee700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f168c1503a0 0x7f168c1432b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:52.780 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.755+0000 7f16935ee700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f168c1428d0 con 0x7f168c143710 2020-06-12T17:50:52.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.755+0000 7f16935ee700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168c142b70 con 0x7f168c1503a0 2020-06-12T17:50:52.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.755+0000 7f16935ee700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168c061c70 con 0x7f168c061890 2020-06-12T17:50:52.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.755+0000 7f1690b89700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f168c1503a0 0x7f168c1432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:52.781 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.755+0000 7f1690b89700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f168c1503a0 0x7f168c1432b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39212/0 (socket says 172.21.15.38:39212) 2020-06-12T17:50:52.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.755+0000 7f1690b89700 1 -- 172.21.15.38:0/2126442378 learned_addr learned my addr 172.21.15.38:0/2126442378 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:52.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.755+0000 7f169138a700 1 --2- 172.21.15.38:0/2126442378 >> v2:172.21.15.150:3300/0 conn(0x7f168c061890 0x7f168c0b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:52.782 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.755+0000 7f1690b89700 1 -- 172.21.15.38:0/2126442378 >> v2:172.21.15.150:3300/0 conn(0x7f168c061890 msgr2=0x7f168c0b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:52.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.755+0000 7f1690b89700 1 --2- 172.21.15.38:0/2126442378 >> v2:172.21.15.150:3300/0 conn(0x7f168c061890 0x7f168c0b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:52.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.755+0000 7f1690b89700 1 -- 172.21.15.38:0/2126442378 >> v1:172.21.15.150:6789/0 conn(0x7f168c143710 legacy=0x7f168c0aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:52.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.755+0000 7f1690b89700 1 -- 172.21.15.38:0/2126442378 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c061fe0 con 0x7f168c1503a0 2020-06-12T17:50:52.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.755+0000 7f169138a700 1 --2- 172.21.15.38:0/2126442378 >> v2:172.21.15.150:3300/0 conn(0x7f168c061890 0x7f168c0b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:50:52.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.755+0000 7f1690b89700 1 --2- 172.21.15.38:0/2126442378 >> v2:172.21.15.38:3300/0 conn(0x7f168c1503a0 0x7f168c1432b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1688008910 tx=0x7f1688007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:52.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.755+0000 7f1690b89700 1 --2- 172.21.15.38:0/2126442378 >> v2:172.21.15.38:3300/0 conn(0x7f168c1503a0 0x7f168c1432b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1688008910 tx=0x7f1688007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:52.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.755+0000 7f1690b89700 1 --2- 172.21.15.38:0/2126442378 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f168c1503a0 0x7f168c1432b0 secure :-1 s=READY pgs=749 cs=0 l=1 rx=0x7f1688008910 tx=0x7f1688007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:52.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.755+0000 7f1690b89700 1 --2- 172.21.15.38:0/2126442378 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f168c1503a0 0x7f168c1432b0 secure :-1 s=THROTTLE_DONE pgs=749 cs=0 l=1 rx=0x7f1688008910 tx=0x7f1688007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:52.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.755+0000 7f167a7fc700 1 -- 172.21.15.38:0/2126442378 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16880070b0 con 0x7f168c1503a0 2020-06-12T17:50:52.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.755+0000 7f1690b89700 1 --2- 172.21.15.38:0/2126442378 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f168c1503a0 0x7f168c1432b0 secure :-1 s=THROTTLE_DONE pgs=749 cs=0 l=1 rx=0x7f1688008910 tx=0x7f1688007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:52.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.755+0000 7f1690b89700 1 --2- 172.21.15.38:0/2126442378 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f168c1503a0 0x7f168c1432b0 secure :-1 s=THROTTLE_DONE pgs=749 cs=0 l=1 rx=0x7f1688008910 tx=0x7f1688007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:52.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.755+0000 7f167a7fc700 1 -- 172.21.15.38:0/2126442378 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1688007210 con 0x7f168c1503a0 2020-06-12T17:50:52.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.755+0000 7f167a7fc700 1 -- 172.21.15.38:0/2126442378 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1688007570 con 0x7f168c1503a0 2020-06-12T17:50:52.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.755+0000 7f16935ee700 1 -- 172.21.15.38:0/2126442378 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168c1424a0 con 0x7f168c1503a0 2020-06-12T17:50:52.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.756+0000 7f16935ee700 1 -- 172.21.15.38:0/2126442378 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f168c1509c0 con 0x7f168c1503a0 2020-06-12T17:50:52.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.756+0000 7f1690b89700 1 --2- 172.21.15.38:0/2126442378 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f168c1503a0 0x7f168c1432b0 secure :-1 s=THROTTLE_DONE pgs=749 cs=0 l=1 rx=0x7f1688008910 tx=0x7f1688007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:52.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.757+0000 7f167a7fc700 1 -- 172.21.15.38:0/2126442378 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f16880056c0 con 0x7f168c1503a0 2020-06-12T17:50:52.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.757+0000 7f1690b89700 1 --2- 172.21.15.38:0/2126442378 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f168c1503a0 0x7f168c1432b0 secure :-1 s=THROTTLE_DONE pgs=749 cs=0 l=1 rx=0x7f1688008910 tx=0x7f1688007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:52.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.757+0000 7f16935ee700 1 -- 172.21.15.38:0/2126442378 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168c056c30 con 0x7f168c1503a0 2020-06-12T17:50:52.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.757+0000 7f167a7fc700 1 --2- 172.21.15.38:0/2126442378 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f166c04d660 0x7f166c04fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:52.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.757+0000 7f167a7fc700 1 -- 172.21.15.38:0/2126442378 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1688063520 con 0x7f168c1503a0 2020-06-12T17:50:52.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.757+0000 7f169138a700 1 --2- 172.21.15.38:0/2126442378 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f166c04d660 0x7f166c04fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:52.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.757+0000 7f169138a700 1 --2- 172.21.15.38:0/2126442378 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f166c04d660 0x7f166c04fb20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f167c002f30 tx=0x7f167c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:52.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.757+0000 7f169138a700 1 --2- 172.21.15.38:0/2126442378 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f166c04d660 0x7f166c04fb20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f167c002f30 tx=0x7f167c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:52.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.757+0000 7f169138a700 1 --2- 172.21.15.38:0/2126442378 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f166c04d660 0x7f166c04fb20 secure :-1 s=READY pgs=292 cs=0 l=1 rx=0x7f167c002f30 tx=0x7f167c007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:52.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.760+0000 7f1690b89700 1 --2- 172.21.15.38:0/2126442378 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f168c1503a0 0x7f168c1432b0 secure :-1 s=THROTTLE_DONE pgs=749 cs=0 l=1 rx=0x7f1688008910 tx=0x7f1688007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:52.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.760+0000 7f167a7fc700 1 -- 172.21.15.38:0/2126442378 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f168803ed00 con 0x7f168c1503a0 2020-06-12T17:50:52.962 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.959+0000 7f16935ee700 1 -- 172.21.15.38:0/2126442378 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_2497", "target": ["mon-mgr", ""]}) v1 -- 0x7f168c143010 con 0x7f166c04d660 2020-06-12T17:50:52.986 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.982+0000 7f169138a700 1 --2- 172.21.15.38:0/2126442378 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f166c04d660 0x7f166c04fb20 secure :-1 s=THROTTLE_DONE pgs=292 cs=0 l=1 rx=0x7f167c002f30 tx=0x7f167c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:52.986 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.982+0000 7f167a7fc700 1 -- 172.21.15.38:0/2126442378 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f167c005800 con 0x7f166c04d660 2020-06-12T17:50:52.988 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.984+0000 7f16935ee700 1 -- 172.21.15.38:0/2126442378 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f166c04d660 msgr2=0x7f166c04fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:52.988 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.984+0000 7f16935ee700 1 --2- 172.21.15.38:0/2126442378 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f166c04d660 0x7f166c04fb20 secure :-1 s=READY pgs=292 cs=0 l=1 rx=0x7f167c002f30 tx=0x7f167c007e60).stop 2020-06-12T17:50:52.988 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.984+0000 7f16935ee700 1 -- 172.21.15.38:0/2126442378 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f168c1503a0 msgr2=0x7f168c1432b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:52.988 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.984+0000 7f16935ee700 1 --2- 172.21.15.38:0/2126442378 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f168c1503a0 0x7f168c1432b0 secure :-1 s=READY pgs=749 cs=0 l=1 rx=0x7f1688008910 tx=0x7f1688007e60).stop 2020-06-12T17:50:52.989 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.984+0000 7f16935ee700 1 -- 172.21.15.38:0/2126442378 shutdown_connections 2020-06-12T17:50:52.989 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.984+0000 7f16935ee700 1 --2- 172.21.15.38:0/2126442378 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f166c04d660 0x7f166c04fb20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:52.989 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.984+0000 7f16935ee700 1 --2- 172.21.15.38:0/2126442378 >> v2:172.21.15.150:3300/0 conn(0x7f168c061890 0x7f168c0b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:52.989 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.984+0000 7f16935ee700 1 --2- 172.21.15.38:0/2126442378 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f168c1503a0 0x7f168c1432b0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:52.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.984+0000 7f16935ee700 1 -- 172.21.15.38:0/2126442378 >> 172.21.15.38:0/2126442378 conn(0x7f168c0b5a20 msgr2=0x7f168c140bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:52.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.984+0000 7f16935ee700 1 -- 172.21.15.38:0/2126442378 shutdown_connections 2020-06-12T17:50:52.990 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:52.984+0000 7f16935ee700 1 -- 172.21.15.38:0/2126442378 wait complete. 2020-06-12T17:50:53.003 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_2497 2020-06-12T17:50:53.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.116+0000 7f855a7d7700 1 Processor -- start 2020-06-12T17:50:53.120 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.117+0000 7f855a7d7700 1 -- start start 2020-06-12T17:50:53.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.117+0000 7f855a7d7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85540b15c0 0x7f85540b2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:53.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.117+0000 7f855a7d7700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f85540afc20 0x7f85540b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:53.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.117+0000 7f855a7d7700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85540b2900 con 0x7f85540b11e0 2020-06-12T17:50:53.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.117+0000 7f855a7d7700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85540ae7d0 con 0x7f85540afc20 2020-06-12T17:50:53.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.117+0000 7f855a7d7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85540b1ad0 con 0x7f85540b15c0 2020-06-12T17:50:53.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.117+0000 7f8559fd6700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f85540afc20 0x7f85540b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:53.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.117+0000 7f8559fd6700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f85540afc20 0x7f85540b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39222/0 (socket says 172.21.15.38:39222) 2020-06-12T17:50:53.129 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.117+0000 7f8559fd6700 1 -- 172.21.15.38:0/3384998391 learned_addr learned my addr 172.21.15.38:0/3384998391 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:53.129 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.117+0000 7f85597d5700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f85540b11e0 0x7f85540ae0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41034/0 (socket says 172.21.15.38:41034) 2020-06-12T17:50:53.129 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.118+0000 7f8558fd4700 1 --2- 172.21.15.38:0/3384998391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85540b15c0 0x7f85540b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:53.129 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.118+0000 7f8559fd6700 1 -- 172.21.15.38:0/3384998391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85540b15c0 msgr2=0x7f85540b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:53.130 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.118+0000 7f8559fd6700 1 --2- 172.21.15.38:0/3384998391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85540b15c0 0x7f85540b2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:53.130 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.118+0000 7f8559fd6700 1 -- 172.21.15.38:0/3384998391 >> v1:172.21.15.38:6789/0 conn(0x7f85540b11e0 legacy=0x7f85540ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:53.130 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.118+0000 7f8543fff700 1 -- 172.21.15.38:0/3384998391 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607076374 0 0) 0x7f85540b2900 con 0x7f85540b11e0 2020-06-12T17:50:53.130 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.118+0000 7f8559fd6700 1 -- 172.21.15.38:0/3384998391 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85540b1d70 con 0x7f85540afc20 2020-06-12T17:50:53.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.118+0000 7f8558fd4700 1 --2- 172.21.15.38:0/3384998391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85540b15c0 0x7f85540b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:50:53.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.118+0000 7f8559fd6700 1 --2- 172.21.15.38:0/3384998391 >> v2:172.21.15.38:3300/0 conn(0x7f85540afc20 0x7f85540b0070 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f854c0032b0 tx=0x7f854c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:53.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.118+0000 7f8559fd6700 1 --2- 172.21.15.38:0/3384998391 >> v2:172.21.15.38:3300/0 conn(0x7f85540afc20 0x7f85540b0070 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f854c0032b0 tx=0x7f854c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:53.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.118+0000 7f8559fd6700 1 --2- 172.21.15.38:0/3384998391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85540afc20 0x7f85540b0070 secure :-1 s=READY pgs=751 cs=0 l=1 rx=0x7f854c0032b0 tx=0x7f854c0081e0).ready entity=mon.0 client_cookie=f905a46e5ec9e503 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:53.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.118+0000 7f8559fd6700 1 --2- 172.21.15.38:0/3384998391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85540afc20 0x7f85540b0070 secure :-1 s=THROTTLE_DONE pgs=751 cs=0 l=1 rx=0x7f854c0032b0 tx=0x7f854c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:53.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.118+0000 7f8559fd6700 1 --2- 172.21.15.38:0/3384998391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85540afc20 0x7f85540b0070 secure :-1 s=THROTTLE_DONE pgs=751 cs=0 l=1 rx=0x7f854c0032b0 tx=0x7f854c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:53.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.118+0000 7f8543fff700 1 -- 172.21.15.38:0/3384998391 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f854c00a160 con 0x7f85540afc20 2020-06-12T17:50:53.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.118+0000 7f8559fd6700 1 --2- 172.21.15.38:0/3384998391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85540afc20 0x7f85540b0070 secure :-1 s=THROTTLE_DONE pgs=751 cs=0 l=1 rx=0x7f854c0032b0 tx=0x7f854c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:53.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.118+0000 7f8543fff700 1 -- 172.21.15.38:0/3384998391 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c00a2c0 con 0x7f85540afc20 2020-06-12T17:50:53.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.118+0000 7f8543fff700 1 -- 172.21.15.38:0/3384998391 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f854c00a6a0 con 0x7f85540afc20 2020-06-12T17:50:53.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.118+0000 7f855a7d7700 1 -- 172.21.15.38:0/3384998391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85540afc20 msgr2=0x7f85540b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:53.134 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.118+0000 7f855a7d7700 1 --2- 172.21.15.38:0/3384998391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85540afc20 0x7f85540b0070 secure :-1 s=READY pgs=751 cs=0 l=1 rx=0x7f854c0032b0 tx=0x7f854c0081e0).stop 2020-06-12T17:50:53.135 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.119+0000 7f855a7d7700 1 -- 172.21.15.38:0/3384998391 shutdown_connections 2020-06-12T17:50:53.135 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.119+0000 7f855a7d7700 1 --2- 172.21.15.38:0/3384998391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85540afc20 0x7f85540b0070 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:53.135 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.119+0000 7f855a7d7700 1 --2- 172.21.15.38:0/3384998391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85540b15c0 0x7f85540b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:53.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.119+0000 7f855a7d7700 1 -- 172.21.15.38:0/3384998391 >> 172.21.15.38:0/3384998391 conn(0x7f85540b4cc0 msgr2=0x7f85540b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:53.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.119+0000 7f855a7d7700 1 -- 172.21.15.38:0/3384998391 shutdown_connections 2020-06-12T17:50:53.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.119+0000 7f855a7d7700 1 -- 172.21.15.38:0/3384998391 wait complete. 2020-06-12T17:50:53.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.120+0000 7f855a7d7700 1 Processor -- start 2020-06-12T17:50:53.136 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.120+0000 7f855a7d7700 1 -- start start 2020-06-12T17:50:53.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.120+0000 7f855a7d7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f85540b15c0 0x7f8554138f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:53.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.120+0000 7f855a7d7700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85540b61a0 con 0x7f85540b11e0 2020-06-12T17:50:53.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.120+0000 7f855a7d7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85540b7dd0 con 0x7f85540afc20 2020-06-12T17:50:53.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.120+0000 7f855a7d7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85540b63d0 con 0x7f85540b15c0 2020-06-12T17:50:53.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.120+0000 7f8558fd4700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f85540b11e0 0x7f85540b6870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41042/0 (socket says 172.21.15.38:41042) 2020-06-12T17:50:53.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.120+0000 7f8558fd4700 1 -- 172.21.15.38:0/3423965315 learned_addr learned my addr 172.21.15.38:0/3423965315 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:53.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f8559fd6700 1 --2- 172.21.15.38:0/3423965315 >> v2:172.21.15.150:3300/0 conn(0x7f85540b15c0 0x7f8554138f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:53.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f85427fc700 1 -- 172.21.15.38:0/3423965315 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3849863624 0 0) 0x7f85540b61a0 con 0x7f85540b11e0 2020-06-12T17:50:53.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f85427fc700 1 -- 172.21.15.38:0/3423965315 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8534002fe0 con 0x7f85540b11e0 2020-06-12T17:50:53.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f85427fc700 1 -- 172.21.15.38:0/3423965315 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2742858208 0 0) 0x7f8534002fe0 con 0x7f85540b11e0 2020-06-12T17:50:53.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f85427fc700 1 -- 172.21.15.38:0/3423965315 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f85540b61a0 con 0x7f85540b11e0 2020-06-12T17:50:53.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f85427fc700 1 -- 172.21.15.38:0/3423965315 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f85500024c0 con 0x7f85540b11e0 2020-06-12T17:50:53.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f85427fc700 1 -- 172.21.15.38:0/3423965315 >> v2:172.21.15.150:3300/0 conn(0x7f85540b15c0 msgr2=0x7f8554138f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:53.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f85427fc700 1 --2- 172.21.15.38:0/3423965315 >> v2:172.21.15.150:3300/0 conn(0x7f85540b15c0 0x7f8554138f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:53.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f85427fc700 1 -- 172.21.15.38:0/3423965315 >> v1:172.21.15.150:6789/0 conn(0x7f85540afc20 legacy=0x7f85540b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:53.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f85427fc700 1 -- 172.21.15.38:0/3423965315 >> v1:172.21.15.38:6789/0 conn(0x7f85540b11e0 legacy=0x7f85540b6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:53.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f85427fc700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85340049b0 0x7f8534004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:53.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f85427fc700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8534003920 0x7f8534003da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:53.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f85427fc700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8534004200 0x7f853400b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:53.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f85427fc700 1 -- 172.21.15.38:0/3423965315 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85540b63d0 con 0x7f8534004200 2020-06-12T17:50:53.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f85427fc700 1 -- 172.21.15.38:0/3423965315 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8534004680 con 0x7f85340049b0 2020-06-12T17:50:53.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f85427fc700 1 -- 172.21.15.38:0/3423965315 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853400bbb0 con 0x7f8534003920 2020-06-12T17:50:53.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f85597d5700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85340049b0 0x7f8534004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:53.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f8558fd4700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8534003920 0x7f8534003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:53.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f8559fd6700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8534004200 0x7f853400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:53.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f8559fd6700 1 -- 172.21.15.38:0/3423965315 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8534003920 msgr2=0x7f8534003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:53.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f8559fd6700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8534003920 0x7f8534003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:53.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f8559fd6700 1 -- 172.21.15.38:0/3423965315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85340049b0 msgr2=0x7f8534004d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:53.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f8559fd6700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85340049b0 0x7f8534004d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:53.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f8559fd6700 1 -- 172.21.15.38:0/3423965315 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85541386d0 con 0x7f8534004200 2020-06-12T17:50:53.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f855a7d7700 1 -- 172.21.15.38:0/3423965315 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85541394f0 con 0x7f8534004200 2020-06-12T17:50:53.144 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f8559fd6700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8534004200 0x7f853400b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f854c0032b0 tx=0x7f854c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:53.144 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f8559fd6700 1 -- 172.21.15.38:0/3423965315 reap_dead start 2020-06-12T17:50:53.144 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.121+0000 7f8559fd6700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8534004200 0x7f853400b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f854c0032b0 tx=0x7f854c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:53.144 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.122+0000 7f8559fd6700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8534004200 0x7f853400b750 secure :-1 s=READY pgs=753 cs=0 l=1 rx=0x7f854c0032b0 tx=0x7f854c0081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:53.144 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.122+0000 7f8559fd6700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8534004200 0x7f853400b750 secure :-1 s=THROTTLE_DONE pgs=753 cs=0 l=1 rx=0x7f854c0032b0 tx=0x7f854c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:53.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.122+0000 7f855a7d7700 1 -- 172.21.15.38:0/3423965315 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85541391b0 con 0x7f8534004200 2020-06-12T17:50:53.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.122+0000 7f85427fc700 1 -- 172.21.15.38:0/3423965315 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f854c011070 con 0x7f8534004200 2020-06-12T17:50:53.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.122+0000 7f8559fd6700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8534004200 0x7f853400b750 secure :-1 s=THROTTLE_DONE pgs=753 cs=0 l=1 rx=0x7f854c0032b0 tx=0x7f854c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:53.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.122+0000 7f8559fd6700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8534004200 0x7f853400b750 secure :-1 s=THROTTLE_DONE pgs=753 cs=0 l=1 rx=0x7f854c0032b0 tx=0x7f854c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:53.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.122+0000 7f85427fc700 1 -- 172.21.15.38:0/3423965315 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c0111d0 con 0x7f8534004200 2020-06-12T17:50:53.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.122+0000 7f85427fc700 1 -- 172.21.15.38:0/3423965315 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f854c011530 con 0x7f8534004200 2020-06-12T17:50:53.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.122+0000 7f8559fd6700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8534004200 0x7f853400b750 secure :-1 s=THROTTLE_DONE pgs=753 cs=0 l=1 rx=0x7f854c0032b0 tx=0x7f854c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:53.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.123+0000 7f855a7d7700 1 -- 172.21.15.38:0/3423965315 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8554056c30 con 0x7f8534004200 2020-06-12T17:50:53.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.123+0000 7f85427fc700 1 -- 172.21.15.38:0/3423965315 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f854c005a40 con 0x7f8534004200 2020-06-12T17:50:53.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.123+0000 7f8559fd6700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8534004200 0x7f853400b750 secure :-1 s=THROTTLE_DONE pgs=753 cs=0 l=1 rx=0x7f854c0032b0 tx=0x7f854c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:53.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.123+0000 7f85427fc700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8534051380 0x7f8534053840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:53.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.123+0000 7f85427fc700 1 -- 172.21.15.38:0/3423965315 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f854c061850 con 0x7f8534004200 2020-06-12T17:50:53.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.123+0000 7f85597d5700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8534051380 0x7f8534053840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:53.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.123+0000 7f85597d5700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8534051380 0x7f8534053840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8544000ee0 tx=0x7f85440017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:53.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.124+0000 7f85597d5700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8534051380 0x7f8534053840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8544000ee0 tx=0x7f85440017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:53.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.124+0000 7f85597d5700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8534051380 0x7f8534053840 secure :-1 s=READY pgs=293 cs=0 l=1 rx=0x7f8544000ee0 tx=0x7f85440017a0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:53.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.126+0000 7f8559fd6700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8534004200 0x7f853400b750 secure :-1 s=THROTTLE_DONE pgs=753 cs=0 l=1 rx=0x7f854c0032b0 tx=0x7f854c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:53.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.126+0000 7f85427fc700 1 -- 172.21.15.38:0/3423965315 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f854c03d070 con 0x7f8534004200 2020-06-12T17:50:53.323 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.319+0000 7f855a7d7700 1 -- 172.21.15.38:0/3423965315 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_2497", "target": ["mon-mgr", ""]}) v1 -- 0x7f8554062df0 con 0x7f8534051380 2020-06-12T17:50:53.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.323+0000 7f85597d5700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8534051380 0x7f8534053840 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7f8544000ee0 tx=0x7f85440017a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:53.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.323+0000 7f85427fc700 1 -- 172.21.15.38:0/3423965315 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f854400c310 con 0x7f8534051380 2020-06-12T17:50:53.327 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_2497/4063e64c-bb7c-4928-b779-5d1ddcc3bf7f 2020-06-12T17:50:53.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.324+0000 7f855a7d7700 1 -- 172.21.15.38:0/3423965315 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8534051380 msgr2=0x7f8534053840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:53.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.324+0000 7f855a7d7700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8534051380 0x7f8534053840 secure :-1 s=READY pgs=293 cs=0 l=1 rx=0x7f8544000ee0 tx=0x7f85440017a0).stop 2020-06-12T17:50:53.328 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.324+0000 7f855a7d7700 1 -- 172.21.15.38:0/3423965315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8534004200 msgr2=0x7f853400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:53.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.324+0000 7f855a7d7700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8534004200 0x7f853400b750 secure :-1 s=READY pgs=753 cs=0 l=1 rx=0x7f854c0032b0 tx=0x7f854c0081e0).stop 2020-06-12T17:50:53.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.324+0000 7f855a7d7700 1 -- 172.21.15.38:0/3423965315 shutdown_connections 2020-06-12T17:50:53.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.324+0000 7f855a7d7700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8534051380 0x7f8534053840 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:53.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.324+0000 7f855a7d7700 1 --2- 172.21.15.38:0/3423965315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8534004200 0x7f853400b750 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:53.329 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.324+0000 7f855a7d7700 1 -- 172.21.15.38:0/3423965315 >> 172.21.15.38:0/3423965315 conn(0x7f85540b4cc0 msgr2=0x7f85540b8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:53.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.324+0000 7f855a7d7700 1 -- 172.21.15.38:0/3423965315 shutdown_connections 2020-06-12T17:50:53.330 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:53.324+0000 7f855a7d7700 1 -- 172.21.15.38:0/3423965315 wait complete. 2020-06-12T17:50:53.338 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_2497 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_2497/4063e64c-bb7c-4928-b779-5d1ddcc3bf7f 2020-06-12T17:50:53.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:53.339 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:53.340 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:53.357 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:53.365 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:53.366 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2497/4063e64c-bb7c-4928-b779-5d1ddcc3bf7f/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:53.449 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:53.449 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:53.450 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124159 s, 84.5 MB/s 2020-06-12T17:50:53.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:53.451 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:53.452 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:53.467 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:53.468 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:53.469 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2497/4063e64c-bb7c-4928-b779-5d1ddcc3bf7f/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:53.560 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:53.560 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:53.560 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133919 s, 78.3 MB/s 2020-06-12T17:50:53.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:53.567 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:53.568 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:53.583 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:53.584 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:53.584 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2497/4063e64c-bb7c-4928-b779-5d1ddcc3bf7f/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:53.676 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:53.676 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:53.677 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134089 s, 78.2 MB/s 2020-06-12T17:50:53.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:53.678 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:53.679 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:53.694 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:53.694 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:53.695 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2497/4063e64c-bb7c-4928-b779-5d1ddcc3bf7f/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:53.783 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:53.783 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:53.784 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119111 s, 88.0 MB/s 2020-06-12T17:50:53.785 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:53.785 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:53.786 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:53.801 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:53.802 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:53.803 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2497/4063e64c-bb7c-4928-b779-5d1ddcc3bf7f/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:53.890 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:53.890 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:53.891 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112052 s, 93.6 MB/s 2020-06-12T17:50:53.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:53.892 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:53.893 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:53.947 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:53.948 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:53.949 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2497/4063e64c-bb7c-4928-b779-5d1ddcc3bf7f/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:54.040 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:54.041 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:54.041 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107749 s, 97.3 MB/s 2020-06-12T17:50:54.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:54.042 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:54.043 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:54.062 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:54.063 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:54.064 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2497/4063e64c-bb7c-4928-b779-5d1ddcc3bf7f/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:54.152 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:54.152 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:54.153 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955068 s, 110 MB/s 2020-06-12T17:50:54.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:54.155 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:54.155 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:54.171 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:54.171 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:54.172 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2497/4063e64c-bb7c-4928-b779-5d1ddcc3bf7f/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:54.259 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:54.259 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:54.259 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102808 s, 102 MB/s 2020-06-12T17:50:54.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:54.261 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:54.262 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:54.277 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:54.278 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:54.279 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2497/4063e64c-bb7c-4928-b779-5d1ddcc3bf7f/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:54.368 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:54.368 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:54.369 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103383 s, 101 MB/s 2020-06-12T17:50:54.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:54.371 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:54.372 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:54.388 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:54.389 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:54.390 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2497/4063e64c-bb7c-4928-b779-5d1ddcc3bf7f/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:54.478 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:54.479 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:54.479 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110716 s, 94.7 MB/s 2020-06-12T17:50:54.480 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_5367 2020-06-12T17:50:54.598 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.594+0000 7fc20719d700 1 Processor -- start 2020-06-12T17:50:54.599 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.594+0000 7fc20719d700 1 -- start start 2020-06-12T17:50:54.607 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.595+0000 7fc20719d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc200143340 0x7fc2001437a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:54.608 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.595+0000 7fc20719d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2000b0e50 0x7fc2000b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:54.608 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.595+0000 7fc20719d700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc200143c00 con 0x7fc2000ae8b0 2020-06-12T17:50:54.608 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.595+0000 7fc20719d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2000b4440 con 0x7fc200143340 2020-06-12T17:50:54.608 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.595+0000 7fc20719d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2000b46e0 con 0x7fc2000b0e50 2020-06-12T17:50:54.609 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.595+0000 7fc20619b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc2000ae8b0 0x7fc20005b560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41054/0 (socket says 172.21.15.38:41054) 2020-06-12T17:50:54.609 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.595+0000 7fc20619b700 1 -- 172.21.15.38:0/3901666325 learned_addr learned my addr 172.21.15.38:0/3901666325 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:54.609 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc20699c700 1 --2- 172.21.15.38:0/3901666325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2000b0e50 0x7fc2000b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:54.609 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc20599a700 1 --2- 172.21.15.38:0/3901666325 >> v2:172.21.15.150:3300/0 conn(0x7fc200143340 0x7fc2001437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:54.610 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc205199700 1 -- 172.21.15.38:0/3901666325 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4138132603 0 0) 0x7fc200143c00 con 0x7fc2000ae8b0 2020-06-12T17:50:54.610 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc205199700 1 -- 172.21.15.38:0/3901666325 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1e8003230 con 0x7fc2000ae8b0 2020-06-12T17:50:54.610 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc205199700 1 -- 172.21.15.38:0/3901666325 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1835100661 0 0) 0x7fc1e8003230 con 0x7fc2000ae8b0 2020-06-12T17:50:54.610 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc205199700 1 -- 172.21.15.38:0/3901666325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2000b0e50 msgr2=0x7fc2000b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:54.611 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc205199700 1 --2- 172.21.15.38:0/3901666325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2000b0e50 0x7fc2000b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:54.611 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc205199700 1 -- 172.21.15.38:0/3901666325 >> v2:172.21.15.150:3300/0 conn(0x7fc200143340 msgr2=0x7fc2001437a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:54.611 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc205199700 1 --2- 172.21.15.38:0/3901666325 >> v2:172.21.15.150:3300/0 conn(0x7fc200143340 0x7fc2001437a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:54.611 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc205199700 1 -- 172.21.15.38:0/3901666325 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2000b4980 con 0x7fc2000ae8b0 2020-06-12T17:50:54.611 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc205199700 1 -- 172.21.15.38:0/3901666325 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fc1f00016d0 con 0x7fc2000ae8b0 2020-06-12T17:50:54.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc205199700 1 -- 172.21.15.38:0/3901666325 >> v1:172.21.15.38:6789/0 conn(0x7fc2000ae8b0 legacy=0x7fc20005b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:54.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc205199700 1 --2- 172.21.15.38:0/3901666325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1e8003720 0x7fc1e8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:54.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc205199700 1 --2- 172.21.15.38:0/3901666325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1e8004060 0x7fc1e8004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:54.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc205199700 1 --2- 172.21.15.38:0/3901666325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2000b0e50 0x7fc1e8004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:54.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc205199700 1 -- 172.21.15.38:0/3901666325 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2000b4440 con 0x7fc1e8004060 2020-06-12T17:50:54.613 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc205199700 1 -- 172.21.15.38:0/3901666325 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2000b46e0 con 0x7fc1e8003720 2020-06-12T17:50:54.613 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc205199700 1 -- 172.21.15.38:0/3901666325 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e8004ff0 con 0x7fc2000b0e50 2020-06-12T17:50:54.613 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc20599a700 1 --2- 172.21.15.38:0/3901666325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1e8004060 0x7fc1e8004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:54.613 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc20619b700 1 --2- 172.21.15.38:0/3901666325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1e8003720 0x7fc1e8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:54.614 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc20699c700 1 --2- 172.21.15.38:0/3901666325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2000b0e50 0x7fc1e8004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:54.614 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc20599a700 1 -- 172.21.15.38:0/3901666325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2000b0e50 msgr2=0x7fc1e8004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:54.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc20599a700 1 --2- 172.21.15.38:0/3901666325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2000b0e50 0x7fc1e8004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:54.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc20599a700 1 -- 172.21.15.38:0/3901666325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1e8003720 msgr2=0x7fc1e8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:54.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc20599a700 1 --2- 172.21.15.38:0/3901666325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1e8003720 0x7fc1e8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:54.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc20599a700 1 -- 172.21.15.38:0/3901666325 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e8003230 con 0x7fc1e8004060 2020-06-12T17:50:54.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc20699c700 1 --2- 172.21.15.38:0/3901666325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2000b0e50 0x7fc1e8004ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:50:54.616 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc20599a700 1 --2- 172.21.15.38:0/3901666325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1e8004060 0x7fc1e8004530 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc1fc008910 tx=0x7fc1fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.616 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.596+0000 7fc20599a700 1 --2- 172.21.15.38:0/3901666325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1e8004060 0x7fc1e8004530 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc1fc008910 tx=0x7fc1fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.616 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.597+0000 7fc20599a700 1 --2- 172.21.15.38:0/3901666325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1e8004060 0x7fc1e8004530 secure :-1 s=READY pgs=755 cs=0 l=1 rx=0x7fc1fc008910 tx=0x7fc1fc007e60).ready entity=mon.0 client_cookie=62531ff67563cc35 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:54.616 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.597+0000 7fc20599a700 1 --2- 172.21.15.38:0/3901666325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1e8004060 0x7fc1e8004530 secure :-1 s=THROTTLE_DONE pgs=755 cs=0 l=1 rx=0x7fc1fc008910 tx=0x7fc1fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.597+0000 7fc20599a700 1 --2- 172.21.15.38:0/3901666325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1e8004060 0x7fc1e8004530 secure :-1 s=THROTTLE_DONE pgs=755 cs=0 l=1 rx=0x7fc1fc008910 tx=0x7fc1fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.597+0000 7fc205199700 1 -- 172.21.15.38:0/3901666325 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1fc008d50 con 0x7fc1e8004060 2020-06-12T17:50:54.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.597+0000 7fc20599a700 1 --2- 172.21.15.38:0/3901666325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1e8004060 0x7fc1e8004530 secure :-1 s=THROTTLE_DONE pgs=755 cs=0 l=1 rx=0x7fc1fc008910 tx=0x7fc1fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.597+0000 7fc205199700 1 -- 172.21.15.38:0/3901666325 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1fc0108e0 con 0x7fc1e8004060 2020-06-12T17:50:54.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.597+0000 7fc205199700 1 -- 172.21.15.38:0/3901666325 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1fc010d00 con 0x7fc1e8004060 2020-06-12T17:50:54.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.597+0000 7fc20719d700 1 -- 172.21.15.38:0/3901666325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1e8004060 msgr2=0x7fc1e8004530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:54.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.597+0000 7fc20719d700 1 --2- 172.21.15.38:0/3901666325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1e8004060 0x7fc1e8004530 secure :-1 s=READY pgs=755 cs=0 l=1 rx=0x7fc1fc008910 tx=0x7fc1fc007e60).stop 2020-06-12T17:50:54.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.597+0000 7fc20699c700 1 -- 172.21.15.38:0/3901666325 reap_dead start 2020-06-12T17:50:54.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.597+0000 7fc20719d700 1 -- 172.21.15.38:0/3901666325 shutdown_connections 2020-06-12T17:50:54.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.597+0000 7fc20719d700 1 -- 172.21.15.38:0/3901666325 >> 172.21.15.38:0/3901666325 conn(0x7fc2000b4cc0 msgr2=0x7fc2000b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:54.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.597+0000 7fc20719d700 1 -- 172.21.15.38:0/3901666325 shutdown_connections 2020-06-12T17:50:54.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.597+0000 7fc20719d700 1 -- 172.21.15.38:0/3901666325 wait complete. 2020-06-12T17:50:54.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.598+0000 7fc20719d700 1 Processor -- start 2020-06-12T17:50:54.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.598+0000 7fc20719d700 1 -- start start 2020-06-12T17:50:54.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.599+0000 7fc20719d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc2000b8750 0x7fc20013ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:54.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.599+0000 7fc20719d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc20013fb60 0x7fc200063ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:54.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.599+0000 7fc20719d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc200140240 con 0x7fc20013d900 2020-06-12T17:50:54.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.599+0000 7fc20719d700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2001404a0 con 0x7fc20013fb60 2020-06-12T17:50:54.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.599+0000 7fc20719d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc200140740 con 0x7fc2000b8750 2020-06-12T17:50:54.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.599+0000 7fc20599a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc20013fb60 0x7fc200063ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:54.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.599+0000 7fc20599a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc20013fb60 0x7fc200063ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39252/0 (socket says 172.21.15.38:39252) 2020-06-12T17:50:54.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.599+0000 7fc20599a700 1 -- 172.21.15.38:0/2032954964 learned_addr learned my addr 172.21.15.38:0/2032954964 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:54.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.599+0000 7fc20619b700 1 --2- 172.21.15.38:0/2032954964 >> v2:172.21.15.150:3300/0 conn(0x7fc2000b8750 0x7fc20013ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:54.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.599+0000 7fc20599a700 1 -- 172.21.15.38:0/2032954964 >> v2:172.21.15.150:3300/0 conn(0x7fc2000b8750 msgr2=0x7fc20013ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:54.622 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.599+0000 7fc20599a700 1 --2- 172.21.15.38:0/2032954964 >> v2:172.21.15.150:3300/0 conn(0x7fc2000b8750 0x7fc20013ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:54.622 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.599+0000 7fc20599a700 1 -- 172.21.15.38:0/2032954964 >> v1:172.21.15.150:6789/0 conn(0x7fc20013d900 legacy=0x7fc20013dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:54.622 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.599+0000 7fc20599a700 1 -- 172.21.15.38:0/2032954964 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2000b8b30 con 0x7fc20013fb60 2020-06-12T17:50:54.622 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.599+0000 7fc20599a700 1 --2- 172.21.15.38:0/2032954964 >> v2:172.21.15.38:3300/0 conn(0x7fc20013fb60 0x7fc200063ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc1fc008910 tx=0x7fc1fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.622 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.599+0000 7fc20599a700 1 --2- 172.21.15.38:0/2032954964 >> v2:172.21.15.38:3300/0 conn(0x7fc20013fb60 0x7fc200063ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc1fc008910 tx=0x7fc1fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.623 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.599+0000 7fc20599a700 1 --2- 172.21.15.38:0/2032954964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc20013fb60 0x7fc200063ed0 secure :-1 s=READY pgs=756 cs=0 l=1 rx=0x7fc1fc008910 tx=0x7fc1fc007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:54.623 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.600+0000 7fc20599a700 1 --2- 172.21.15.38:0/2032954964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc20013fb60 0x7fc200063ed0 secure :-1 s=THROTTLE_DONE pgs=756 cs=0 l=1 rx=0x7fc1fc008910 tx=0x7fc1fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.623 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.600+0000 7fc1ef7fe700 1 -- 172.21.15.38:0/2032954964 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1fc0078a0 con 0x7fc20013fb60 2020-06-12T17:50:54.623 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.600+0000 7fc20599a700 1 --2- 172.21.15.38:0/2032954964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc20013fb60 0x7fc200063ed0 secure :-1 s=THROTTLE_DONE pgs=756 cs=0 l=1 rx=0x7fc1fc008910 tx=0x7fc1fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.624 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.600+0000 7fc20599a700 1 --2- 172.21.15.38:0/2032954964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc20013fb60 0x7fc200063ed0 secure :-1 s=THROTTLE_DONE pgs=756 cs=0 l=1 rx=0x7fc1fc008910 tx=0x7fc1fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.624 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.600+0000 7fc1ef7fe700 1 -- 172.21.15.38:0/2032954964 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1fc0058b0 con 0x7fc20013fb60 2020-06-12T17:50:54.624 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.600+0000 7fc1ef7fe700 1 -- 172.21.15.38:0/2032954964 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1fc005c10 con 0x7fc20013fb60 2020-06-12T17:50:54.624 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.600+0000 7fc20719d700 1 -- 172.21.15.38:0/2032954964 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc200140be0 con 0x7fc20013fb60 2020-06-12T17:50:54.624 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.600+0000 7fc20719d700 1 -- 172.21.15.38:0/2032954964 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc200141080 con 0x7fc20013fb60 2020-06-12T17:50:54.625 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.600+0000 7fc20599a700 1 --2- 172.21.15.38:0/2032954964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc20013fb60 0x7fc200063ed0 secure :-1 s=THROTTLE_DONE pgs=756 cs=0 l=1 rx=0x7fc1fc008910 tx=0x7fc1fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.626 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.601+0000 7fc20719d700 1 -- 172.21.15.38:0/2032954964 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc200056c30 con 0x7fc20013fb60 2020-06-12T17:50:54.626 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.601+0000 7fc1ef7fe700 1 -- 172.21.15.38:0/2032954964 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fc1fc00a150 con 0x7fc20013fb60 2020-06-12T17:50:54.626 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.601+0000 7fc20599a700 1 --2- 172.21.15.38:0/2032954964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc20013fb60 0x7fc200063ed0 secure :-1 s=THROTTLE_DONE pgs=756 cs=0 l=1 rx=0x7fc1fc008910 tx=0x7fc1fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.626 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.601+0000 7fc1ef7fe700 1 --2- 172.21.15.38:0/2032954964 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc1e004d600 0x7fc1e004fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:54.627 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.601+0000 7fc1ef7fe700 1 -- 172.21.15.38:0/2032954964 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc1fc061090 con 0x7fc20013fb60 2020-06-12T17:50:54.627 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.601+0000 7fc20619b700 1 --2- 172.21.15.38:0/2032954964 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc1e004d600 0x7fc1e004fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:54.627 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.602+0000 7fc20619b700 1 --2- 172.21.15.38:0/2032954964 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc1e004d600 0x7fc1e004fac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc1f00013e0 tx=0x7fc1f000e8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.627 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.602+0000 7fc20619b700 1 --2- 172.21.15.38:0/2032954964 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc1e004d600 0x7fc1e004fac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc1f00013e0 tx=0x7fc1f000e8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.627 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.602+0000 7fc20619b700 1 --2- 172.21.15.38:0/2032954964 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc1e004d600 0x7fc1e004fac0 secure :-1 s=READY pgs=294 cs=0 l=1 rx=0x7fc1f00013e0 tx=0x7fc1f000e8d0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:54.628 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.604+0000 7fc20599a700 1 --2- 172.21.15.38:0/2032954964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc20013fb60 0x7fc200063ed0 secure :-1 s=THROTTLE_DONE pgs=756 cs=0 l=1 rx=0x7fc1fc008910 tx=0x7fc1fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.629 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.604+0000 7fc1ef7fe700 1 -- 172.21.15.38:0/2032954964 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fc1fc03c850 con 0x7fc20013fb60 2020-06-12T17:50:54.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.799+0000 7fc20719d700 1 -- 172.21.15.38:0/2032954964 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_5367", "target": ["mon-mgr", ""]}) v1 -- 0x7fc200066760 con 0x7fc1e004d600 2020-06-12T17:50:54.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.821+0000 7fc20619b700 1 --2- 172.21.15.38:0/2032954964 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc1e004d600 0x7fc1e004fac0 secure :-1 s=THROTTLE_DONE pgs=294 cs=0 l=1 rx=0x7fc1f00013e0 tx=0x7fc1f000e8d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.821+0000 7fc1ef7fe700 1 -- 172.21.15.38:0/2032954964 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc200066760 con 0x7fc1e004d600 2020-06-12T17:50:54.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.823+0000 7fc20719d700 1 -- 172.21.15.38:0/2032954964 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc1e004d600 msgr2=0x7fc1e004fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:54.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.823+0000 7fc20719d700 1 --2- 172.21.15.38:0/2032954964 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc1e004d600 0x7fc1e004fac0 secure :-1 s=READY pgs=294 cs=0 l=1 rx=0x7fc1f00013e0 tx=0x7fc1f000e8d0).stop 2020-06-12T17:50:54.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.823+0000 7fc20719d700 1 -- 172.21.15.38:0/2032954964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc20013fb60 msgr2=0x7fc200063ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:54.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.823+0000 7fc20719d700 1 --2- 172.21.15.38:0/2032954964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc20013fb60 0x7fc200063ed0 secure :-1 s=READY pgs=756 cs=0 l=1 rx=0x7fc1fc008910 tx=0x7fc1fc007e60).stop 2020-06-12T17:50:54.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.823+0000 7fc20719d700 1 -- 172.21.15.38:0/2032954964 shutdown_connections 2020-06-12T17:50:54.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.823+0000 7fc20719d700 1 --2- 172.21.15.38:0/2032954964 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc1e004d600 0x7fc1e004fac0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:54.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.823+0000 7fc20719d700 1 --2- 172.21.15.38:0/2032954964 >> v2:172.21.15.150:3300/0 conn(0x7fc2000b8750 0x7fc20013ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:54.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.823+0000 7fc20719d700 1 --2- 172.21.15.38:0/2032954964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc20013fb60 0x7fc200063ed0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:54.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.823+0000 7fc20719d700 1 -- 172.21.15.38:0/2032954964 >> 172.21.15.38:0/2032954964 conn(0x7fc2000b4cc0 msgr2=0x7fc200147d00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:54.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.823+0000 7fc20719d700 1 -- 172.21.15.38:0/2032954964 shutdown_connections 2020-06-12T17:50:54.829 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.823+0000 7fc20719d700 1 -- 172.21.15.38:0/2032954964 wait complete. 2020-06-12T17:50:54.837 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_5367 2020-06-12T17:50:54.954 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.951+0000 7efffb7c2700 1 Processor -- start 2020-06-12T17:50:54.955 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.951+0000 7efffb7c2700 1 -- start start 2020-06-12T17:50:54.957 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7efffb7c2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efff4146680 0x7efff40ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:54.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7efffb7c2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efff40b2eb0 0x7efff409d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:54.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7efffb7c2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efff409d620 0x7efff409da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:54.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7efffb7c2700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff4146d20 con 0x7efff4146680 2020-06-12T17:50:54.958 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7efffb7c2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff4066a80 con 0x7efff409d620 2020-06-12T17:50:54.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7efffb7c2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff4146f50 con 0x7efff40b2eb0 2020-06-12T17:50:54.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7efff955e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efff4146680 0x7efff40ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:54.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7efff955e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efff4146680 0x7efff40ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39258/0 (socket says 172.21.15.38:39258) 2020-06-12T17:50:54.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7efff955e700 1 -- 172.21.15.38:0/1859454931 learned_addr learned my addr 172.21.15.38:0/1859454931 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:54.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7efff9d5f700 1 --2- 172.21.15.38:0/1859454931 >> v2:172.21.15.150:3300/0 conn(0x7efff409d620 0x7efff409da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:54.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7efff8d5d700 1 --2- 172.21.15.38:0/1859454931 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efff40b2eb0 0x7efff409d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:54.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7efff955e700 1 -- 172.21.15.38:0/1859454931 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efff40b2eb0 msgr2=0x7efff409d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:54.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7efff955e700 1 --2- 172.21.15.38:0/1859454931 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efff40b2eb0 0x7efff409d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:54.960 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7efff955e700 1 -- 172.21.15.38:0/1859454931 >> v2:172.21.15.150:3300/0 conn(0x7efff409d620 msgr2=0x7efff409da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7efff955e700 1 --2- 172.21.15.38:0/1859454931 >> v2:172.21.15.150:3300/0 conn(0x7efff409d620 0x7efff409da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7efff955e700 1 -- 172.21.15.38:0/1859454931 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff4146a60 con 0x7efff4146680 2020-06-12T17:50:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7efff955e700 1 --2- 172.21.15.38:0/1859454931 >> v2:172.21.15.38:3300/0 conn(0x7efff4146680 0x7efff40ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efff0002f30 tx=0x7efff0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7efff955e700 1 --2- 172.21.15.38:0/1859454931 >> v2:172.21.15.38:3300/0 conn(0x7efff4146680 0x7efff40ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efff0002f30 tx=0x7efff0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7efff955e700 1 --2- 172.21.15.38:0/1859454931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efff4146680 0x7efff40ad5b0 secure :-1 s=READY pgs=757 cs=0 l=1 rx=0x7efff0002f30 tx=0x7efff0007e60).ready entity=mon.0 client_cookie=9bfb92ce52da86bc server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7efff955e700 1 --2- 172.21.15.38:0/1859454931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efff4146680 0x7efff40ad5b0 secure :-1 s=THROTTLE_DONE pgs=757 cs=0 l=1 rx=0x7efff0002f30 tx=0x7efff0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7effe3fff700 1 -- 172.21.15.38:0/1859454931 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efff0011580 con 0x7efff4146680 2020-06-12T17:50:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7efff955e700 1 --2- 172.21.15.38:0/1859454931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efff4146680 0x7efff40ad5b0 secure :-1 s=THROTTLE_DONE pgs=757 cs=0 l=1 rx=0x7efff0002f30 tx=0x7efff0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7efff955e700 1 --2- 172.21.15.38:0/1859454931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efff4146680 0x7efff40ad5b0 secure :-1 s=THROTTLE_DONE pgs=757 cs=0 l=1 rx=0x7efff0002f30 tx=0x7efff0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7effe3fff700 1 -- 172.21.15.38:0/1859454931 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff00116e0 con 0x7efff4146680 2020-06-12T17:50:54.963 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7effe3fff700 1 -- 172.21.15.38:0/1859454931 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efff0011ac0 con 0x7efff4146680 2020-06-12T17:50:54.963 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7efffb7c2700 1 -- 172.21.15.38:0/1859454931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efff4146680 msgr2=0x7efff40ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:54.963 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.952+0000 7efffb7c2700 1 --2- 172.21.15.38:0/1859454931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efff4146680 0x7efff40ad5b0 secure :-1 s=READY pgs=757 cs=0 l=1 rx=0x7efff0002f30 tx=0x7efff0007e60).stop 2020-06-12T17:50:54.963 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.953+0000 7efffb7c2700 1 -- 172.21.15.38:0/1859454931 shutdown_connections 2020-06-12T17:50:54.963 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.953+0000 7efffb7c2700 1 --2- 172.21.15.38:0/1859454931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efff4146680 0x7efff40ad5b0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:54.964 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.953+0000 7efffb7c2700 1 --2- 172.21.15.38:0/1859454931 >> v2:172.21.15.150:3300/0 conn(0x7efff409d620 0x7efff409da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:54.964 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.953+0000 7efffb7c2700 1 --2- 172.21.15.38:0/1859454931 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efff40b2eb0 0x7efff409d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:54.964 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.953+0000 7efffb7c2700 1 -- 172.21.15.38:0/1859454931 >> 172.21.15.38:0/1859454931 conn(0x7efff40b5a20 msgr2=0x7efff405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:54.964 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.953+0000 7efffb7c2700 1 -- 172.21.15.38:0/1859454931 shutdown_connections 2020-06-12T17:50:54.964 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.953+0000 7efffb7c2700 1 -- 172.21.15.38:0/1859454931 wait complete. 2020-06-12T17:50:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.954+0000 7efffb7c2700 1 Processor -- start 2020-06-12T17:50:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.954+0000 7efffb7c2700 1 -- start start 2020-06-12T17:50:54.968 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.955+0000 7efffb7c2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efff409d620 0x7efff40b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:54.968 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.955+0000 7efffb7c2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efff40b2eb0 0x7efff4061a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:54.968 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.955+0000 7efffb7c2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff4062ff0 con 0x7efff4146680 2020-06-12T17:50:54.969 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.955+0000 7efffb7c2700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff41281d0 con 0x7efff409d620 2020-06-12T17:50:54.969 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.955+0000 7efffb7c2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff40b0bf0 con 0x7efff40b2eb0 2020-06-12T17:50:54.969 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.955+0000 7efff955e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efff409d620 0x7efff40b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:54.969 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.955+0000 7efff955e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efff409d620 0x7efff40b2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39264/0 (socket says 172.21.15.38:39264) 2020-06-12T17:50:54.969 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.955+0000 7efff955e700 1 -- 172.21.15.38:0/4200823822 learned_addr learned my addr 172.21.15.38:0/4200823822 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:54.970 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.955+0000 7efff8d5d700 1 --2- 172.21.15.38:0/4200823822 >> v2:172.21.15.150:3300/0 conn(0x7efff40b2eb0 0x7efff4061a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:54.970 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.955+0000 7efff955e700 1 -- 172.21.15.38:0/4200823822 >> v2:172.21.15.150:3300/0 conn(0x7efff40b2eb0 msgr2=0x7efff4061a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:54.970 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.955+0000 7efff955e700 1 --2- 172.21.15.38:0/4200823822 >> v2:172.21.15.150:3300/0 conn(0x7efff40b2eb0 0x7efff4061a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:54.970 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.955+0000 7efff955e700 1 -- 172.21.15.38:0/4200823822 >> v1:172.21.15.150:6789/0 conn(0x7efff4146680 legacy=0x7efff41394e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:54.970 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.955+0000 7efff955e700 1 -- 172.21.15.38:0/4200823822 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff4127f30 con 0x7efff409d620 2020-06-12T17:50:54.971 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.955+0000 7efff8d5d700 1 --2- 172.21.15.38:0/4200823822 >> v2:172.21.15.150:3300/0 conn(0x7efff40b2eb0 0x7efff4061a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:50:54.971 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.955+0000 7efff955e700 1 --2- 172.21.15.38:0/4200823822 >> v2:172.21.15.38:3300/0 conn(0x7efff409d620 0x7efff40b2610 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efff0002f30 tx=0x7efff0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.971 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.955+0000 7efff955e700 1 --2- 172.21.15.38:0/4200823822 >> v2:172.21.15.38:3300/0 conn(0x7efff409d620 0x7efff40b2610 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efff0002f30 tx=0x7efff0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.971 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.955+0000 7efff955e700 1 --2- 172.21.15.38:0/4200823822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efff409d620 0x7efff40b2610 secure :-1 s=READY pgs=758 cs=0 l=1 rx=0x7efff0002f30 tx=0x7efff0007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:54.971 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.955+0000 7efff955e700 1 --2- 172.21.15.38:0/4200823822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efff409d620 0x7efff40b2610 secure :-1 s=THROTTLE_DONE pgs=758 cs=0 l=1 rx=0x7efff0002f30 tx=0x7efff0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.972 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.955+0000 7effe27fc700 1 -- 172.21.15.38:0/4200823822 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efff0011d80 con 0x7efff409d620 2020-06-12T17:50:54.972 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.955+0000 7efff955e700 1 --2- 172.21.15.38:0/4200823822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efff409d620 0x7efff40b2610 secure :-1 s=THROTTLE_DONE pgs=758 cs=0 l=1 rx=0x7efff0002f30 tx=0x7efff0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.972 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.955+0000 7efff955e700 1 --2- 172.21.15.38:0/4200823822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efff409d620 0x7efff40b2610 secure :-1 s=THROTTLE_DONE pgs=758 cs=0 l=1 rx=0x7efff0002f30 tx=0x7efff0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.972 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.955+0000 7effe27fc700 1 -- 172.21.15.38:0/4200823822 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff0007150 con 0x7efff409d620 2020-06-12T17:50:54.972 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.955+0000 7efffb7c2700 1 -- 172.21.15.38:0/4200823822 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff4139bf0 con 0x7efff409d620 2020-06-12T17:50:54.973 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.955+0000 7effe27fc700 1 -- 172.21.15.38:0/4200823822 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efff00074f0 con 0x7efff409d620 2020-06-12T17:50:54.973 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.956+0000 7efffb7c2700 1 -- 172.21.15.38:0/4200823822 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff40b79f0 con 0x7efff409d620 2020-06-12T17:50:54.973 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.956+0000 7efff955e700 1 --2- 172.21.15.38:0/4200823822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efff409d620 0x7efff40b2610 secure :-1 s=THROTTLE_DONE pgs=758 cs=0 l=1 rx=0x7efff0002f30 tx=0x7efff0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.973 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.957+0000 7efffb7c2700 1 -- 172.21.15.38:0/4200823822 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff40b7ca0 con 0x7efff409d620 2020-06-12T17:50:54.973 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.957+0000 7effe27fc700 1 -- 172.21.15.38:0/4200823822 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7efff00056c0 con 0x7efff409d620 2020-06-12T17:50:54.973 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.957+0000 7efff955e700 1 --2- 172.21.15.38:0/4200823822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efff409d620 0x7efff40b2610 secure :-1 s=THROTTLE_DONE pgs=758 cs=0 l=1 rx=0x7efff0002f30 tx=0x7efff0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.974 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.957+0000 7effe27fc700 1 --2- 172.21.15.38:0/4200823822 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7effd404d5b0 0x7effd404fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:54.974 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.957+0000 7effe27fc700 1 -- 172.21.15.38:0/4200823822 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7efff0061810 con 0x7efff409d620 2020-06-12T17:50:54.974 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.957+0000 7efff8d5d700 1 --2- 172.21.15.38:0/4200823822 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7effd404d5b0 0x7effd404fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:54.974 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.957+0000 7efff8d5d700 1 --2- 172.21.15.38:0/4200823822 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7effd404d5b0 0x7effd404fa70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7effe4002f30 tx=0x7effe4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.974 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.957+0000 7efff8d5d700 1 --2- 172.21.15.38:0/4200823822 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7effd404d5b0 0x7effd404fa70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7effe4002f30 tx=0x7effe4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.975 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.957+0000 7efff8d5d700 1 --2- 172.21.15.38:0/4200823822 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7effd404d5b0 0x7effd404fa70 secure :-1 s=READY pgs=295 cs=0 l=1 rx=0x7effe4002f30 tx=0x7effe4007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:54.975 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.960+0000 7efff955e700 1 --2- 172.21.15.38:0/4200823822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efff409d620 0x7efff40b2610 secure :-1 s=THROTTLE_DONE pgs=758 cs=0 l=1 rx=0x7efff0002f30 tx=0x7efff0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:54.975 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:54.960+0000 7effe27fc700 1 -- 172.21.15.38:0/4200823822 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7efff003cf90 con 0x7efff409d620 2020-06-12T17:50:55.158 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:55.154+0000 7efffb7c2700 1 -- 172.21.15.38:0/4200823822 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_5367", "target": ["mon-mgr", ""]}) v1 -- 0x7efff4063180 con 0x7effd404d5b0 2020-06-12T17:50:55.161 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:55.158+0000 7efff8d5d700 1 --2- 172.21.15.38:0/4200823822 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7effd404d5b0 0x7effd404fa70 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7effe4002f30 tx=0x7effe4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:55.162 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:55.158+0000 7effe27fc700 1 -- 172.21.15.38:0/4200823822 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7efff4063180 con 0x7effd404d5b0 2020-06-12T17:50:55.162 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_5367/b257439f-0ebc-45b5-9946-7aec7d95e9b3 2020-06-12T17:50:55.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:55.159+0000 7efffb7c2700 1 -- 172.21.15.38:0/4200823822 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7effd404d5b0 msgr2=0x7effd404fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:55.163 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:55.159+0000 7efffb7c2700 1 --2- 172.21.15.38:0/4200823822 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7effd404d5b0 0x7effd404fa70 secure :-1 s=READY pgs=295 cs=0 l=1 rx=0x7effe4002f30 tx=0x7effe4007e60).stop 2020-06-12T17:50:55.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:55.159+0000 7efffb7c2700 1 -- 172.21.15.38:0/4200823822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efff409d620 msgr2=0x7efff40b2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:55.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:55.159+0000 7efffb7c2700 1 --2- 172.21.15.38:0/4200823822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efff409d620 0x7efff40b2610 secure :-1 s=READY pgs=758 cs=0 l=1 rx=0x7efff0002f30 tx=0x7efff0007e60).stop 2020-06-12T17:50:55.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:55.160+0000 7efffb7c2700 1 -- 172.21.15.38:0/4200823822 shutdown_connections 2020-06-12T17:50:55.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:55.160+0000 7efffb7c2700 1 --2- 172.21.15.38:0/4200823822 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7effd404d5b0 0x7effd404fa70 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:55.164 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:55.160+0000 7efffb7c2700 1 --2- 172.21.15.38:0/4200823822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efff409d620 0x7efff40b2610 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:55.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:55.160+0000 7efffb7c2700 1 --2- 172.21.15.38:0/4200823822 >> v2:172.21.15.150:3300/0 conn(0x7efff40b2eb0 0x7efff4061a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:55.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:55.160+0000 7efffb7c2700 1 -- 172.21.15.38:0/4200823822 >> 172.21.15.38:0/4200823822 conn(0x7efff40b5a20 msgr2=0x7efff409bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:55.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:55.160+0000 7efffb7c2700 1 -- 172.21.15.38:0/4200823822 shutdown_connections 2020-06-12T17:50:55.165 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:55.160+0000 7efffb7c2700 1 -- 172.21.15.38:0/4200823822 wait complete. 2020-06-12T17:50:55.173 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_5367 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_5367/b257439f-0ebc-45b5-9946-7aec7d95e9b3 2020-06-12T17:50:55.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:55.174 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:55.174 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:55.194 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:55.194 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:55.195 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5367/b257439f-0ebc-45b5-9946-7aec7d95e9b3/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:55.286 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:55.286 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:55.286 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010547 s, 99.4 MB/s 2020-06-12T17:50:55.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:55.288 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:55.289 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:55.304 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:55.305 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:55.306 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5367/b257439f-0ebc-45b5-9946-7aec7d95e9b3/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:55.394 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:55.395 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:55.395 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113937 s, 92.0 MB/s 2020-06-12T17:50:55.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:55.396 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:55.396 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:55.411 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:55.412 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:55.412 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5367/b257439f-0ebc-45b5-9946-7aec7d95e9b3/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:55.498 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:55.498 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:55.499 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103513 s, 101 MB/s 2020-06-12T17:50:55.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:55.500 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:55.500 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:55.515 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:55.516 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:55.516 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5367/b257439f-0ebc-45b5-9946-7aec7d95e9b3/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:55.602 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:55.602 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:55.602 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126965 s, 82.6 MB/s 2020-06-12T17:50:55.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:55.604 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:55.604 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:55.619 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:55.620 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:55.620 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5367/b257439f-0ebc-45b5-9946-7aec7d95e9b3/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:55.708 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:55.709 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:55.709 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114545 s, 91.5 MB/s 2020-06-12T17:50:55.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:55.710 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:55.711 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:55.726 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:55.726 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:55.727 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5367/b257439f-0ebc-45b5-9946-7aec7d95e9b3/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:55.819 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:55.819 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:55.820 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111398 s, 94.1 MB/s 2020-06-12T17:50:55.821 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:55.822 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:55.822 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:55.837 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:55.837 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:55.838 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5367/b257439f-0ebc-45b5-9946-7aec7d95e9b3/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:55.925 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:55.925 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:55.925 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111056 s, 94.4 MB/s 2020-06-12T17:50:55.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:55.927 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:55.927 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:55.942 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:55.943 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:55.943 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5367/b257439f-0ebc-45b5-9946-7aec7d95e9b3/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:56.039 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:56.039 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:56.039 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106589 s, 98.4 MB/s 2020-06-12T17:50:56.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:56.040 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:56.041 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:56.056 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:56.057 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:56.057 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5367/b257439f-0ebc-45b5-9946-7aec7d95e9b3/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:56.143 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:56.143 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:56.144 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102068 s, 103 MB/s 2020-06-12T17:50:56.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:56.145 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:56.146 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:56.182 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:56.183 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:56.183 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5367/b257439f-0ebc-45b5-9946-7aec7d95e9b3/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:56.272 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:56.272 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:56.273 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129254 s, 81.1 MB/s 2020-06-12T17:50:56.274 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_1712 2020-06-12T17:50:56.392 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.389+0000 7f1aabf76700 1 Processor -- start 2020-06-12T17:50:56.392 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.389+0000 7f1aabf76700 1 -- start start 2020-06-12T17:50:56.395 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.390+0000 7f1aabf76700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1aa4146680 0x7f1aa40ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:56.395 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.390+0000 7f1aabf76700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1aa40b2eb0 0x7f1aa409d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:56.396 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.390+0000 7f1aabf76700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa4146d20 con 0x7f1aa409d620 2020-06-12T17:50:56.396 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.390+0000 7f1aabf76700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa4066a80 con 0x7f1aa40b2eb0 2020-06-12T17:50:56.396 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.390+0000 7f1aabf76700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa4146f50 con 0x7f1aa4146680 2020-06-12T17:50:56.397 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.390+0000 7f1aa9511700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1aa40b2eb0 0x7f1aa409d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:56.397 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.390+0000 7f1aaa513700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f1aa409d620 0x7f1aa409b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41092/0 (socket says 172.21.15.38:41092) 2020-06-12T17:50:56.397 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.390+0000 7f1aa9511700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1aa40b2eb0 0x7f1aa409d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39274/0 (socket says 172.21.15.38:39274) 2020-06-12T17:50:56.397 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.390+0000 7f1aaa513700 1 -- 172.21.15.38:0/2176227937 learned_addr learned my addr 172.21.15.38:0/2176227937 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:56.397 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.390+0000 7f1aa9d12700 1 --2- 172.21.15.38:0/2176227937 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1aa4146680 0x7f1aa40ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:56.398 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.390+0000 7f1aa9511700 1 -- 172.21.15.38:0/2176227937 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1aa4146680 msgr2=0x7f1aa40ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:56.398 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.390+0000 7f1aa9511700 1 --2- 172.21.15.38:0/2176227937 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1aa4146680 0x7f1aa40ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:56.398 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.390+0000 7f1aa8d10700 1 -- 172.21.15.38:0/2176227937 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347399328 0 0) 0x7f1aa4146d20 con 0x7f1aa409d620 2020-06-12T17:50:56.398 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.390+0000 7f1aa9511700 1 -- 172.21.15.38:0/2176227937 >> v1:172.21.15.38:6789/0 conn(0x7f1aa409d620 legacy=0x7f1aa409b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:56.398 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.390+0000 7f1aa9511700 1 -- 172.21.15.38:0/2176227937 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa4146a60 con 0x7f1aa40b2eb0 2020-06-12T17:50:56.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.390+0000 7f1aa9511700 1 --2- 172.21.15.38:0/2176227937 >> v2:172.21.15.38:3300/0 conn(0x7f1aa40b2eb0 0x7f1aa409d1c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1a94002f30 tx=0x7f1a94007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.390+0000 7f1aa9511700 1 --2- 172.21.15.38:0/2176227937 >> v2:172.21.15.38:3300/0 conn(0x7f1aa40b2eb0 0x7f1aa409d1c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1a94002f30 tx=0x7f1a94007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.390+0000 7f1aa9511700 1 --2- 172.21.15.38:0/2176227937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1aa40b2eb0 0x7f1aa409d1c0 secure :-1 s=READY pgs=760 cs=0 l=1 rx=0x7f1a94002f30 tx=0x7f1a94007e60).ready entity=mon.0 client_cookie=bda0d6a09e553d3e server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:56.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.390+0000 7f1aa9511700 1 --2- 172.21.15.38:0/2176227937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1aa40b2eb0 0x7f1aa409d1c0 secure :-1 s=THROTTLE_DONE pgs=760 cs=0 l=1 rx=0x7f1a94002f30 tx=0x7f1a94007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.390+0000 7f1aa9511700 1 --2- 172.21.15.38:0/2176227937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1aa40b2eb0 0x7f1aa409d1c0 secure :-1 s=THROTTLE_DONE pgs=760 cs=0 l=1 rx=0x7f1a94002f30 tx=0x7f1a94007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.400 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.390+0000 7f1aa8d10700 1 -- 172.21.15.38:0/2176227937 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a94011430 con 0x7f1aa40b2eb0 2020-06-12T17:50:56.400 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.390+0000 7f1aa9511700 1 --2- 172.21.15.38:0/2176227937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1aa40b2eb0 0x7f1aa409d1c0 secure :-1 s=THROTTLE_DONE pgs=760 cs=0 l=1 rx=0x7f1a94002f30 tx=0x7f1a94007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.400 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.390+0000 7f1aa8d10700 1 -- 172.21.15.38:0/2176227937 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a94011590 con 0x7f1aa40b2eb0 2020-06-12T17:50:56.400 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.390+0000 7f1aa8d10700 1 -- 172.21.15.38:0/2176227937 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a94011970 con 0x7f1aa40b2eb0 2020-06-12T17:50:56.400 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.390+0000 7f1aabf76700 1 -- 172.21.15.38:0/2176227937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1aa40b2eb0 msgr2=0x7f1aa409d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:56.401 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.390+0000 7f1aabf76700 1 --2- 172.21.15.38:0/2176227937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1aa40b2eb0 0x7f1aa409d1c0 secure :-1 s=READY pgs=760 cs=0 l=1 rx=0x7f1a94002f30 tx=0x7f1a94007e60).stop 2020-06-12T17:50:56.401 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.391+0000 7f1aabf76700 1 -- 172.21.15.38:0/2176227937 shutdown_connections 2020-06-12T17:50:56.401 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.391+0000 7f1aabf76700 1 --2- 172.21.15.38:0/2176227937 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1aa4146680 0x7f1aa40ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:56.401 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.391+0000 7f1aabf76700 1 --2- 172.21.15.38:0/2176227937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1aa40b2eb0 0x7f1aa409d1c0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:56.401 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.391+0000 7f1aabf76700 1 -- 172.21.15.38:0/2176227937 >> 172.21.15.38:0/2176227937 conn(0x7f1aa40b5a20 msgr2=0x7f1aa405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:56.402 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.391+0000 7f1aabf76700 1 -- 172.21.15.38:0/2176227937 shutdown_connections 2020-06-12T17:50:56.402 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.391+0000 7f1aabf76700 1 -- 172.21.15.38:0/2176227937 wait complete. 2020-06-12T17:50:56.402 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.392+0000 7f1aabf76700 1 Processor -- start 2020-06-12T17:50:56.402 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.392+0000 7f1aabf76700 1 -- start start 2020-06-12T17:50:56.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.393+0000 7f1aabf76700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1aa40b2eb0 0x7f1aa41401e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.393+0000 7f1aabf76700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa413faa0 con 0x7f1aa4146680 2020-06-12T17:50:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.393+0000 7f1aabf76700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa413fd40 con 0x7f1aa409d620 2020-06-12T17:50:56.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.393+0000 7f1aabf76700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa413f890 con 0x7f1aa40b2eb0 2020-06-12T17:50:56.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.393+0000 7f1aaa513700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f1aa4146680 0x7f1aa4062e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41098/0 (socket says 172.21.15.38:41098) 2020-06-12T17:50:56.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.393+0000 7f1aaa513700 1 -- 172.21.15.38:0/1993386581 learned_addr learned my addr 172.21.15.38:0/1993386581 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:56.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.393+0000 7f1aa9511700 1 --2- 172.21.15.38:0/1993386581 >> v2:172.21.15.150:3300/0 conn(0x7f1aa40b2eb0 0x7f1aa41401e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:56.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.393+0000 7f1a92ffd700 1 -- 172.21.15.38:0/1993386581 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715346918 0 0) 0x7f1aa413faa0 con 0x7f1aa4146680 2020-06-12T17:50:56.437 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.393+0000 7f1a92ffd700 1 -- 172.21.15.38:0/1993386581 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a84002fe0 con 0x7f1aa4146680 2020-06-12T17:50:56.437 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.393+0000 7f1a92ffd700 1 -- 172.21.15.38:0/1993386581 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3552094478 0 0) 0x7f1a84002fe0 con 0x7f1aa4146680 2020-06-12T17:50:56.437 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.393+0000 7f1a92ffd700 1 -- 172.21.15.38:0/1993386581 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1aa413faa0 con 0x7f1aa4146680 2020-06-12T17:50:56.437 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.393+0000 7f1a92ffd700 1 -- 172.21.15.38:0/1993386581 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f1a9c001be0 con 0x7f1aa4146680 2020-06-12T17:50:56.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.393+0000 7f1a92ffd700 1 -- 172.21.15.38:0/1993386581 >> v2:172.21.15.150:3300/0 conn(0x7f1aa40b2eb0 msgr2=0x7f1aa41401e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:56.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.393+0000 7f1a92ffd700 1 --2- 172.21.15.38:0/1993386581 >> v2:172.21.15.150:3300/0 conn(0x7f1aa40b2eb0 0x7f1aa41401e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:56.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.393+0000 7f1a92ffd700 1 -- 172.21.15.38:0/1993386581 >> v1:172.21.15.150:6789/0 conn(0x7f1aa409d620 legacy=0x7f1aa413d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:56.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.393+0000 7f1a92ffd700 1 -- 172.21.15.38:0/1993386581 >> v1:172.21.15.38:6789/0 conn(0x7f1aa4146680 legacy=0x7f1aa4062e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:56.438 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.393+0000 7f1a92ffd700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a840049b0 0x7f1a84004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.393+0000 7f1a92ffd700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a84003920 0x7f1a84003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.393+0000 7f1a92ffd700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a840041c0 0x7f1a8400b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.393+0000 7f1a92ffd700 1 -- 172.21.15.38:0/1993386581 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa413f890 con 0x7f1a84003920 2020-06-12T17:50:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.393+0000 7f1a92ffd700 1 -- 172.21.15.38:0/1993386581 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840046a0 con 0x7f1a840041c0 2020-06-12T17:50:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.393+0000 7f1a92ffd700 1 -- 172.21.15.38:0/1993386581 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8400bbb0 con 0x7f1a840049b0 2020-06-12T17:50:56.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.393+0000 7f1aa9511700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a84003920 0x7f1a84003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:56.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.393+0000 7f1aa9d12700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a840049b0 0x7f1a84004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:56.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.393+0000 7f1aaa513700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a840041c0 0x7f1a8400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:56.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.394+0000 7f1aa9511700 1 -- 172.21.15.38:0/1993386581 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a840049b0 msgr2=0x7f1a84004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:56.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.394+0000 7f1aa9511700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a840049b0 0x7f1a84004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:56.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.394+0000 7f1aa9511700 1 -- 172.21.15.38:0/1993386581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a840041c0 msgr2=0x7f1a8400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:56.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.394+0000 7f1aa9511700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a840041c0 0x7f1a8400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:56.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.394+0000 7f1aa9511700 1 -- 172.21.15.38:0/1993386581 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa4062b20 con 0x7f1a84003920 2020-06-12T17:50:56.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.394+0000 7f1aaa513700 1 -- 172.21.15.38:0/1993386581 reap_dead start 2020-06-12T17:50:56.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.394+0000 7f1aabf76700 1 -- 172.21.15.38:0/1993386581 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa413f3d0 con 0x7f1a84003920 2020-06-12T17:50:56.450 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.394+0000 7f1aabf76700 1 -- 172.21.15.38:0/1993386581 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa4140420 con 0x7f1a84003920 2020-06-12T17:50:56.451 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.394+0000 7f1aa9511700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a84003920 0x7f1a84003d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1a94002f30 tx=0x7f1a94007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.451 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.394+0000 7f1aa9511700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a84003920 0x7f1a84003d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1a94002f30 tx=0x7f1a94007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.451 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.394+0000 7f1aa9511700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a84003920 0x7f1a84003d60 secure :-1 s=READY pgs=762 cs=0 l=1 rx=0x7f1a94002f30 tx=0x7f1a94007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:56.451 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.394+0000 7f1aa9511700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a84003920 0x7f1a84003d60 secure :-1 s=THROTTLE_DONE pgs=762 cs=0 l=1 rx=0x7f1a94002f30 tx=0x7f1a94007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.452 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.394+0000 7f1a92ffd700 1 -- 172.21.15.38:0/1993386581 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a9400f830 con 0x7f1a84003920 2020-06-12T17:50:56.452 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.394+0000 7f1aa9511700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a84003920 0x7f1a84003d60 secure :-1 s=THROTTLE_DONE pgs=762 cs=0 l=1 rx=0x7f1a94002f30 tx=0x7f1a94007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.452 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.394+0000 7f1aa9511700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a84003920 0x7f1a84003d60 secure :-1 s=THROTTLE_DONE pgs=762 cs=0 l=1 rx=0x7f1a94002f30 tx=0x7f1a94007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.452 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.394+0000 7f1a92ffd700 1 -- 172.21.15.38:0/1993386581 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a94007150 con 0x7f1a84003920 2020-06-12T17:50:56.452 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.394+0000 7f1a92ffd700 1 -- 172.21.15.38:0/1993386581 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a940074b0 con 0x7f1a84003920 2020-06-12T17:50:56.453 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.395+0000 7f1aa9511700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a84003920 0x7f1a84003d60 secure :-1 s=THROTTLE_DONE pgs=762 cs=0 l=1 rx=0x7f1a94002f30 tx=0x7f1a94007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.453 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.395+0000 7f1aabf76700 1 -- 172.21.15.38:0/1993386581 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa413f620 con 0x7f1a84003920 2020-06-12T17:50:56.453 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.395+0000 7f1a92ffd700 1 -- 172.21.15.38:0/1993386581 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f1a940056c0 con 0x7f1a84003920 2020-06-12T17:50:56.453 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.395+0000 7f1aa9511700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a84003920 0x7f1a84003d60 secure :-1 s=THROTTLE_DONE pgs=762 cs=0 l=1 rx=0x7f1a94002f30 tx=0x7f1a94007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.453 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.395+0000 7f1a92ffd700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1a84051440 0x7f1a84053900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:56.454 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.395+0000 7f1a92ffd700 1 -- 172.21.15.38:0/1993386581 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1a940615b0 con 0x7f1a84003920 2020-06-12T17:50:56.454 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.396+0000 7f1aa9d12700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1a84051440 0x7f1a84053900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:56.454 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.396+0000 7f1aa9d12700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1a84051440 0x7f1a84053900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1aa40b29f0 tx=0x7f1aa0002500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.454 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.396+0000 7f1aa9d12700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1a84051440 0x7f1a84053900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1aa40b29f0 tx=0x7f1aa0002500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.454 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.396+0000 7f1aa9d12700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1a84051440 0x7f1a84053900 secure :-1 s=READY pgs=296 cs=0 l=1 rx=0x7f1aa40b29f0 tx=0x7f1aa0002500).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:56.455 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.399+0000 7f1aa9511700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a84003920 0x7f1a84003d60 secure :-1 s=THROTTLE_DONE pgs=762 cs=0 l=1 rx=0x7f1a94002f30 tx=0x7f1a94007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.455 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.399+0000 7f1a92ffd700 1 -- 172.21.15.38:0/1993386581 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f1a9403cdd0 con 0x7f1a84003920 2020-06-12T17:50:56.599 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.596+0000 7f1aabf76700 1 -- 172.21.15.38:0/1993386581 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_1712", "target": ["mon-mgr", ""]}) v1 -- 0x7f1aa40b6040 con 0x7f1a84051440 2020-06-12T17:50:56.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.614+0000 7f1aa9d12700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1a84051440 0x7f1a84053900 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7f1aa40b29f0 tx=0x7f1aa0002500).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.614+0000 7f1a92ffd700 1 -- 172.21.15.38:0/1993386581 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1aa40b6040 con 0x7f1a84051440 2020-06-12T17:50:56.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.616+0000 7f1aabf76700 1 -- 172.21.15.38:0/1993386581 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1a84051440 msgr2=0x7f1a84053900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:56.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.616+0000 7f1aabf76700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1a84051440 0x7f1a84053900 secure :-1 s=READY pgs=296 cs=0 l=1 rx=0x7f1aa40b29f0 tx=0x7f1aa0002500).stop 2020-06-12T17:50:56.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.616+0000 7f1aabf76700 1 -- 172.21.15.38:0/1993386581 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a84003920 msgr2=0x7f1a84003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:56.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.616+0000 7f1aabf76700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a84003920 0x7f1a84003d60 secure :-1 s=READY pgs=762 cs=0 l=1 rx=0x7f1a94002f30 tx=0x7f1a94007e60).stop 2020-06-12T17:50:56.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.616+0000 7f1aabf76700 1 -- 172.21.15.38:0/1993386581 shutdown_connections 2020-06-12T17:50:56.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.616+0000 7f1aabf76700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f1a84051440 0x7f1a84053900 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:56.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.616+0000 7f1aabf76700 1 --2- 172.21.15.38:0/1993386581 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a84003920 0x7f1a84003d60 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:56.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.616+0000 7f1aabf76700 1 -- 172.21.15.38:0/1993386581 >> 172.21.15.38:0/1993386581 conn(0x7f1aa40b5a20 msgr2=0x7f1aa40b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:56.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.616+0000 7f1aabf76700 1 -- 172.21.15.38:0/1993386581 shutdown_connections 2020-06-12T17:50:56.621 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.616+0000 7f1aabf76700 1 -- 172.21.15.38:0/1993386581 wait complete. 2020-06-12T17:50:56.630 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_1712 2020-06-12T17:50:56.747 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.744+0000 7f7ee5df9700 1 Processor -- start 2020-06-12T17:50:56.748 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.744+0000 7f7ee5df9700 1 -- start start 2020-06-12T17:50:56.755 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.745+0000 7f7ee5df9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ee0146680 0x7f7ee00ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:56.755 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.745+0000 7f7ee5df9700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee0146d20 con 0x7f7ee009d8d0 2020-06-12T17:50:56.756 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.745+0000 7f7ee5df9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee0066a80 con 0x7f7ee00b2eb0 2020-06-12T17:50:56.756 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.745+0000 7f7ee5df9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee0146f50 con 0x7f7ee0146680 2020-06-12T17:50:56.756 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.745+0000 7f7edffff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7ee009d8d0 0x7f7ee01421d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41112/0 (socket says 172.21.15.38:41112) 2020-06-12T17:50:56.756 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.745+0000 7f7edffff700 1 -- 172.21.15.38:0/1959280710 learned_addr learned my addr 172.21.15.38:0/1959280710 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:56.756 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.745+0000 7f7edf7fe700 1 --2- 172.21.15.38:0/1959280710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ee0146680 0x7f7ee00ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:56.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.745+0000 7f7ede7fc700 1 -- 172.21.15.38:0/1959280710 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415000664 0 0) 0x7f7ee0146d20 con 0x7f7ee009d8d0 2020-06-12T17:50:56.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.745+0000 7f7ede7fc700 1 -- 172.21.15.38:0/1959280710 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ecc003230 con 0x7f7ee009d8d0 2020-06-12T17:50:56.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7ede7fc700 1 -- 172.21.15.38:0/1959280710 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3837172283 0 0) 0x7f7ecc003230 con 0x7f7ee009d8d0 2020-06-12T17:50:56.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7ede7fc700 1 -- 172.21.15.38:0/1959280710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ee0146680 msgr2=0x7f7ee00ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:56.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7ede7fc700 1 --2- 172.21.15.38:0/1959280710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ee0146680 0x7f7ee00ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:56.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7ede7fc700 1 -- 172.21.15.38:0/1959280710 >> v1:172.21.15.150:6789/0 conn(0x7f7ee00b2eb0 legacy=0x7f7ee009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:56.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7ede7fc700 1 -- 172.21.15.38:0/1959280710 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee0146a60 con 0x7f7ee009d8d0 2020-06-12T17:50:56.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7ede7fc700 1 -- 172.21.15.38:0/1959280710 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f7ed8001a50 con 0x7f7ee009d8d0 2020-06-12T17:50:56.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7edf7fe700 1 --2- 172.21.15.38:0/1959280710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ee0146680 0x7f7ee00ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:50:56.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7ede7fc700 1 -- 172.21.15.38:0/1959280710 >> v1:172.21.15.38:6789/0 conn(0x7f7ee009d8d0 legacy=0x7f7ee01421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:56.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7ede7fc700 1 --2- 172.21.15.38:0/1959280710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ee0146680 0x7f7ecc003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:56.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7ede7fc700 1 --2- 172.21.15.38:0/1959280710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ecc003bb0 0x7f7ecc004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:56.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7ede7fc700 1 --2- 172.21.15.38:0/1959280710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ecc004590 0x7f7ecc004a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:56.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7ede7fc700 1 -- 172.21.15.38:0/1959280710 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee0146f50 con 0x7f7ecc004590 2020-06-12T17:50:56.760 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7ede7fc700 1 -- 172.21.15.38:0/1959280710 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc005050 con 0x7f7ecc003bb0 2020-06-12T17:50:56.760 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7ede7fc700 1 -- 172.21.15.38:0/1959280710 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc005210 con 0x7f7ee0146680 2020-06-12T17:50:56.760 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7edffff700 1 --2- 172.21.15.38:0/1959280710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ecc004590 0x7f7ecc004a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:56.760 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7edf7fe700 1 --2- 172.21.15.38:0/1959280710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ee0146680 0x7f7ecc003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:56.760 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7edeffd700 1 --2- 172.21.15.38:0/1959280710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ecc003bb0 0x7f7ecc004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:56.761 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7edffff700 1 -- 172.21.15.38:0/1959280710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ee0146680 msgr2=0x7f7ecc003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:56.761 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7edffff700 1 --2- 172.21.15.38:0/1959280710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ee0146680 0x7f7ecc003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:56.761 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7edffff700 1 -- 172.21.15.38:0/1959280710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ecc003bb0 msgr2=0x7f7ecc004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:56.761 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7edffff700 1 --2- 172.21.15.38:0/1959280710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ecc003bb0 0x7f7ecc004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:56.762 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7edffff700 1 -- 172.21.15.38:0/1959280710 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ecc003230 con 0x7f7ecc004590 2020-06-12T17:50:56.762 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7edffff700 1 --2- 172.21.15.38:0/1959280710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ecc004590 0x7f7ecc004a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7ed8001760 tx=0x7f7ee0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.762 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7edffff700 1 --2- 172.21.15.38:0/1959280710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ecc004590 0x7f7ecc004a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7ed8001760 tx=0x7f7ee0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.762 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7edffff700 1 --2- 172.21.15.38:0/1959280710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ecc004590 0x7f7ecc004a10 secure :-1 s=READY pgs=764 cs=0 l=1 rx=0x7f7ed8001760 tx=0x7f7ee0146220).ready entity=mon.0 client_cookie=fcf6225512bb82d4 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:56.762 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7edffff700 1 --2- 172.21.15.38:0/1959280710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ecc004590 0x7f7ecc004a10 secure :-1 s=THROTTLE_DONE pgs=764 cs=0 l=1 rx=0x7f7ed8001760 tx=0x7f7ee0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.763 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7ede7fc700 1 -- 172.21.15.38:0/1959280710 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ed800cea0 con 0x7f7ecc004590 2020-06-12T17:50:56.763 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7edffff700 1 --2- 172.21.15.38:0/1959280710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ecc004590 0x7f7ecc004a10 secure :-1 s=THROTTLE_DONE pgs=764 cs=0 l=1 rx=0x7f7ed8001760 tx=0x7f7ee0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.763 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7edffff700 1 --2- 172.21.15.38:0/1959280710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ecc004590 0x7f7ecc004a10 secure :-1 s=THROTTLE_DONE pgs=764 cs=0 l=1 rx=0x7f7ed8001760 tx=0x7f7ee0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.763 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7ede7fc700 1 -- 172.21.15.38:0/1959280710 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed800e540 con 0x7f7ecc004590 2020-06-12T17:50:56.763 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7ede7fc700 1 -- 172.21.15.38:0/1959280710 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ed800e960 con 0x7f7ecc004590 2020-06-12T17:50:56.764 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7ee5df9700 1 -- 172.21.15.38:0/1959280710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ecc004590 msgr2=0x7f7ecc004a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:56.764 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7ee5df9700 1 --2- 172.21.15.38:0/1959280710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ecc004590 0x7f7ecc004a10 secure :-1 s=READY pgs=764 cs=0 l=1 rx=0x7f7ed8001760 tx=0x7f7ee0146220).stop 2020-06-12T17:50:56.764 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.746+0000 7f7edffff700 1 -- 172.21.15.38:0/1959280710 reap_dead start 2020-06-12T17:50:56.764 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.747+0000 7f7ee5df9700 1 -- 172.21.15.38:0/1959280710 shutdown_connections 2020-06-12T17:50:56.765 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.747+0000 7f7ee5df9700 1 -- 172.21.15.38:0/1959280710 >> 172.21.15.38:0/1959280710 conn(0x7f7ee00b5a20 msgr2=0x7f7ee005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:56.765 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.747+0000 7f7ee5df9700 1 -- 172.21.15.38:0/1959280710 shutdown_connections 2020-06-12T17:50:56.765 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.747+0000 7f7ee5df9700 1 -- 172.21.15.38:0/1959280710 wait complete. 2020-06-12T17:50:56.765 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.748+0000 7f7ee5df9700 1 Processor -- start 2020-06-12T17:50:56.765 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.748+0000 7f7ee5df9700 1 -- start start 2020-06-12T17:50:56.766 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.749+0000 7f7ee5df9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ee0065ca0 0x7f7ee00b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:56.766 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.749+0000 7f7ee5df9700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7ee01539e0 0x7f7ee009b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:56.766 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.749+0000 7f7ee5df9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee0153f90 con 0x7f7ee00aec00 2020-06-12T17:50:56.766 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.749+0000 7f7ee5df9700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee00b2590 con 0x7f7ee01539e0 2020-06-12T17:50:56.766 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.749+0000 7f7ee5df9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee00b2830 con 0x7f7ee0065ca0 2020-06-12T17:50:56.767 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.749+0000 7f7edffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7ee01539e0 0x7f7ee009b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:56.767 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.749+0000 7f7edffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7ee01539e0 0x7f7ee009b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39308/0 (socket says 172.21.15.38:39308) 2020-06-12T17:50:56.767 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.749+0000 7f7edffff700 1 -- 172.21.15.38:0/2115378881 learned_addr learned my addr 172.21.15.38:0/2115378881 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:56.767 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.749+0000 7f7edf7fe700 1 --2- 172.21.15.38:0/2115378881 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ee0065ca0 0x7f7ee00b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:56.767 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.749+0000 7f7edffff700 1 -- 172.21.15.38:0/2115378881 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ee0065ca0 msgr2=0x7f7ee00b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:56.768 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.749+0000 7f7edffff700 1 --2- 172.21.15.38:0/2115378881 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ee0065ca0 0x7f7ee00b06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:56.768 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.749+0000 7f7edffff700 1 -- 172.21.15.38:0/2115378881 >> v1:172.21.15.150:6789/0 conn(0x7f7ee00aec00 legacy=0x7f7ee013f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:56.768 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.749+0000 7f7edffff700 1 -- 172.21.15.38:0/2115378881 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee0066080 con 0x7f7ee01539e0 2020-06-12T17:50:56.768 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.749+0000 7f7edffff700 1 --2- 172.21.15.38:0/2115378881 >> v2:172.21.15.38:3300/0 conn(0x7f7ee01539e0 0x7f7ee009b880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7ee00b1a60 tx=0x7f7ee0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.749+0000 7f7edffff700 1 --2- 172.21.15.38:0/2115378881 >> v2:172.21.15.38:3300/0 conn(0x7f7ee01539e0 0x7f7ee009b880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7ee00b1a60 tx=0x7f7ee0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.749+0000 7f7edffff700 1 --2- 172.21.15.38:0/2115378881 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ee01539e0 0x7f7ee009b880 secure :-1 s=READY pgs=765 cs=0 l=1 rx=0x7f7ee00b1a60 tx=0x7f7ee0146220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:56.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.749+0000 7f7edffff700 1 --2- 172.21.15.38:0/2115378881 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ee01539e0 0x7f7ee009b880 secure :-1 s=THROTTLE_DONE pgs=765 cs=0 l=1 rx=0x7f7ee00b1a60 tx=0x7f7ee0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.749+0000 7f7edffff700 1 --2- 172.21.15.38:0/2115378881 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ee01539e0 0x7f7ee009b880 secure :-1 s=THROTTLE_DONE pgs=765 cs=0 l=1 rx=0x7f7ee00b1a60 tx=0x7f7ee0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.749+0000 7f7edcff9700 1 -- 172.21.15.38:0/2115378881 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ed800cea0 con 0x7f7ee01539e0 2020-06-12T17:50:56.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.749+0000 7f7edffff700 1 --2- 172.21.15.38:0/2115378881 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ee01539e0 0x7f7ee009b880 secure :-1 s=THROTTLE_DONE pgs=765 cs=0 l=1 rx=0x7f7ee00b1a60 tx=0x7f7ee0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.750+0000 7f7edcff9700 1 -- 172.21.15.38:0/2115378881 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed8001c70 con 0x7f7ee01539e0 2020-06-12T17:50:56.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.750+0000 7f7ee5df9700 1 -- 172.21.15.38:0/2115378881 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee00b0f90 con 0x7f7ee01539e0 2020-06-12T17:50:56.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.750+0000 7f7edcff9700 1 -- 172.21.15.38:0/2115378881 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ed8004b20 con 0x7f7ee01539e0 2020-06-12T17:50:56.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.750+0000 7f7ee5df9700 1 -- 172.21.15.38:0/2115378881 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee009bce0 con 0x7f7ee01539e0 2020-06-12T17:50:56.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.750+0000 7f7edffff700 1 --2- 172.21.15.38:0/2115378881 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ee01539e0 0x7f7ee009b880 secure :-1 s=THROTTLE_DONE pgs=765 cs=0 l=1 rx=0x7f7ee00b1a60 tx=0x7f7ee0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.751+0000 7f7ee5df9700 1 -- 172.21.15.38:0/2115378881 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee0056c30 con 0x7f7ee01539e0 2020-06-12T17:50:56.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.751+0000 7f7edcff9700 1 -- 172.21.15.38:0/2115378881 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f7ed8004c80 con 0x7f7ee01539e0 2020-06-12T17:50:56.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.751+0000 7f7edffff700 1 --2- 172.21.15.38:0/2115378881 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ee01539e0 0x7f7ee009b880 secure :-1 s=THROTTLE_DONE pgs=765 cs=0 l=1 rx=0x7f7ee00b1a60 tx=0x7f7ee0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.751+0000 7f7edcff9700 1 --2- 172.21.15.38:0/2115378881 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7ec004d6b0 0x7f7ec004fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:56.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.751+0000 7f7edcff9700 1 -- 172.21.15.38:0/2115378881 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7ed8061150 con 0x7f7ee01539e0 2020-06-12T17:50:56.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.751+0000 7f7edf7fe700 1 --2- 172.21.15.38:0/2115378881 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7ec004d6b0 0x7f7ec004fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:56.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.752+0000 7f7edf7fe700 1 --2- 172.21.15.38:0/2115378881 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7ec004d6b0 0x7f7ec004fb70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7ed0002f30 tx=0x7f7ed0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.752+0000 7f7edf7fe700 1 --2- 172.21.15.38:0/2115378881 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7ec004d6b0 0x7f7ec004fb70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7ed0002f30 tx=0x7f7ed0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.752+0000 7f7edf7fe700 1 --2- 172.21.15.38:0/2115378881 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7ec004d6b0 0x7f7ec004fb70 secure :-1 s=READY pgs=297 cs=0 l=1 rx=0x7f7ed0002f30 tx=0x7f7ed0007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:56.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.754+0000 7f7edffff700 1 --2- 172.21.15.38:0/2115378881 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ee01539e0 0x7f7ee009b880 secure :-1 s=THROTTLE_DONE pgs=765 cs=0 l=1 rx=0x7f7ee00b1a60 tx=0x7f7ee0146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.754+0000 7f7edcff9700 1 -- 172.21.15.38:0/2115378881 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f7ed803c990 con 0x7f7ee01539e0 2020-06-12T17:50:56.959 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.956+0000 7f7ee5df9700 1 -- 172.21.15.38:0/2115378881 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_1712", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ee00b29a0 con 0x7f7ec004d6b0 2020-06-12T17:50:56.962 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.959+0000 7f7edf7fe700 1 --2- 172.21.15.38:0/2115378881 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7ec004d6b0 0x7f7ec004fb70 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7f7ed0002f30 tx=0x7f7ed0007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:56.963 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.959+0000 7f7edcff9700 1 -- 172.21.15.38:0/2115378881 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f7ee00b29a0 con 0x7f7ec004d6b0 2020-06-12T17:50:56.963 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_1712/0bf39812-d071-4b80-b1ab-dbbc36d2978d 2020-06-12T17:50:56.964 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.960+0000 7f7ee5df9700 1 -- 172.21.15.38:0/2115378881 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7ec004d6b0 msgr2=0x7f7ec004fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:56.964 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.960+0000 7f7ee5df9700 1 --2- 172.21.15.38:0/2115378881 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7ec004d6b0 0x7f7ec004fb70 secure :-1 s=READY pgs=297 cs=0 l=1 rx=0x7f7ed0002f30 tx=0x7f7ed0007e60).stop 2020-06-12T17:50:56.964 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.960+0000 7f7ee5df9700 1 -- 172.21.15.38:0/2115378881 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ee01539e0 msgr2=0x7f7ee009b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:56.965 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.960+0000 7f7ee5df9700 1 --2- 172.21.15.38:0/2115378881 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ee01539e0 0x7f7ee009b880 secure :-1 s=READY pgs=765 cs=0 l=1 rx=0x7f7ee00b1a60 tx=0x7f7ee0146220).stop 2020-06-12T17:50:56.965 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.960+0000 7f7ee5df9700 1 -- 172.21.15.38:0/2115378881 shutdown_connections 2020-06-12T17:50:56.965 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.960+0000 7f7ee5df9700 1 --2- 172.21.15.38:0/2115378881 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f7ec004d6b0 0x7f7ec004fb70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:56.965 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.960+0000 7f7ee5df9700 1 --2- 172.21.15.38:0/2115378881 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ee0065ca0 0x7f7ee00b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:56.965 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.960+0000 7f7ee5df9700 1 --2- 172.21.15.38:0/2115378881 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ee01539e0 0x7f7ee009b880 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:56.966 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.960+0000 7f7ee5df9700 1 -- 172.21.15.38:0/2115378881 >> 172.21.15.38:0/2115378881 conn(0x7f7ee00b5a20 msgr2=0x7f7ee00b3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:56.966 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.961+0000 7f7ee5df9700 1 -- 172.21.15.38:0/2115378881 shutdown_connections 2020-06-12T17:50:56.966 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:56.961+0000 7f7ee5df9700 1 -- 172.21.15.38:0/2115378881 wait complete. 2020-06-12T17:50:56.974 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_1712 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_1712/0bf39812-d071-4b80-b1ab-dbbc36d2978d 2020-06-12T17:50:56.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:56.975 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:56.976 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:56.995 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:56.995 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:56.996 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1712/0bf39812-d071-4b80-b1ab-dbbc36d2978d/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:57.086 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:57.087 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:57.087 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109917 s, 95.4 MB/s 2020-06-12T17:50:57.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:57.089 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:57.089 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:57.104 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:57.104 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:57.105 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1712/0bf39812-d071-4b80-b1ab-dbbc36d2978d/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:57.193 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:57.193 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:57.194 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118703 s, 88.3 MB/s 2020-06-12T17:50:57.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:57.195 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:57.196 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:57.211 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:57.211 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:57.212 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1712/0bf39812-d071-4b80-b1ab-dbbc36d2978d/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:57.298 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:57.299 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:57.299 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107233 s, 97.8 MB/s 2020-06-12T17:50:57.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:57.300 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:57.301 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:57.316 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:57.317 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:57.318 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1712/0bf39812-d071-4b80-b1ab-dbbc36d2978d/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:57.408 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:57.408 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:57.408 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136392 s, 76.9 MB/s 2020-06-12T17:50:57.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:57.410 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:57.410 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:57.428 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:57.428 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:57.429 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1712/0bf39812-d071-4b80-b1ab-dbbc36d2978d/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:57.516 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:57.516 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:57.517 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110277 s, 95.1 MB/s 2020-06-12T17:50:57.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:57.518 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:57.519 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:57.534 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:57.534 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:57.535 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1712/0bf39812-d071-4b80-b1ab-dbbc36d2978d/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:57.621 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:57.621 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:57.622 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009726 s, 108 MB/s 2020-06-12T17:50:57.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:57.623 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:57.624 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:57.678 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:57.679 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:57.679 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1712/0bf39812-d071-4b80-b1ab-dbbc36d2978d/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:57.767 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:57.767 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:57.767 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122383 s, 85.7 MB/s 2020-06-12T17:50:57.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:57.769 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:57.770 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:57.784 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:57.785 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:57.786 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1712/0bf39812-d071-4b80-b1ab-dbbc36d2978d/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:57.871 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:57.871 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:57.871 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00900762 s, 116 MB/s 2020-06-12T17:50:57.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:57.873 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:57.873 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:57.888 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:57.889 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:57.889 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1712/0bf39812-d071-4b80-b1ab-dbbc36d2978d/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:57.978 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:57.978 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:57.978 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959963 s, 109 MB/s 2020-06-12T17:50:57.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:57.980 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:57.980 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:57.995 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:57.996 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:57.996 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1712/0bf39812-d071-4b80-b1ab-dbbc36d2978d/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:58.085 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:58.085 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:58.085 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114826 s, 91.3 MB/s 2020-06-12T17:50:58.087 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_4131 2020-06-12T17:50:58.204 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.201+0000 7f96fe4e2700 1 Processor -- start 2020-06-12T17:50:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.201+0000 7f96fe4e2700 1 -- start start 2020-06-12T17:50:58.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96fe4e2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f96f809df00 0x7f96f813c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96fe4e2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96f8142e90 0x7f96f8066790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96fe4e2700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f809b960 con 0x7f96f80b3ac0 2020-06-12T17:50:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96fe4e2700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f809bc00 con 0x7f96f809df00 2020-06-12T17:50:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96fe4e2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f80b48f0 con 0x7f96f8142e90 2020-06-12T17:50:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96f77fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f96f809df00 0x7f96f813c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96f77fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f96f809df00 0x7f96f813c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39316/0 (socket says 172.21.15.38:39316) 2020-06-12T17:50:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96f7fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f96f80b3ac0 0x7f96f813bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41128/0 (socket says 172.21.15.38:41128) 2020-06-12T17:50:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96f77fe700 1 -- 172.21.15.38:0/2366408480 learned_addr learned my addr 172.21.15.38:0/2366408480 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96fca7f700 1 --2- 172.21.15.38:0/2366408480 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96f8142e90 0x7f96f8066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:58.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96f77fe700 1 -- 172.21.15.38:0/2366408480 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96f8142e90 msgr2=0x7f96f8066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:58.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96f77fe700 1 --2- 172.21.15.38:0/2366408480 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96f8142e90 0x7f96f8066790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:58.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96f77fe700 1 -- 172.21.15.38:0/2366408480 >> v1:172.21.15.38:6789/0 conn(0x7f96f80b3ac0 legacy=0x7f96f813bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:58.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96f6ffd700 1 -- 172.21.15.38:0/2366408480 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3294932935 0 0) 0x7f96f809b960 con 0x7f96f80b3ac0 2020-06-12T17:50:58.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96f77fe700 1 -- 172.21.15.38:0/2366408480 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f80b3ea0 con 0x7f96f809df00 2020-06-12T17:50:58.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96fca7f700 1 --2- 172.21.15.38:0/2366408480 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96f8142e90 0x7f96f8066790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:50:58.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96f77fe700 1 --2- 172.21.15.38:0/2366408480 >> v2:172.21.15.38:3300/0 conn(0x7f96f809df00 0x7f96f813c650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f96ec002f30 tx=0x7f96ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96f77fe700 1 --2- 172.21.15.38:0/2366408480 >> v2:172.21.15.38:3300/0 conn(0x7f96f809df00 0x7f96f813c650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f96ec002f30 tx=0x7f96ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96f77fe700 1 --2- 172.21.15.38:0/2366408480 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96f809df00 0x7f96f813c650 secure :-1 s=READY pgs=767 cs=0 l=1 rx=0x7f96ec002f30 tx=0x7f96ec007e60).ready entity=mon.0 client_cookie=5cc7f8cda620bb51 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:58.211 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96f77fe700 1 --2- 172.21.15.38:0/2366408480 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96f809df00 0x7f96f813c650 secure :-1 s=THROTTLE_DONE pgs=767 cs=0 l=1 rx=0x7f96ec002f30 tx=0x7f96ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96f6ffd700 1 -- 172.21.15.38:0/2366408480 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96ec0116e0 con 0x7f96f809df00 2020-06-12T17:50:58.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96f77fe700 1 --2- 172.21.15.38:0/2366408480 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96f809df00 0x7f96f813c650 secure :-1 s=THROTTLE_DONE pgs=767 cs=0 l=1 rx=0x7f96ec002f30 tx=0x7f96ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96f6ffd700 1 -- 172.21.15.38:0/2366408480 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ec011840 con 0x7f96f809df00 2020-06-12T17:50:58.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96f77fe700 1 --2- 172.21.15.38:0/2366408480 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96f809df00 0x7f96f813c650 secure :-1 s=THROTTLE_DONE pgs=767 cs=0 l=1 rx=0x7f96ec002f30 tx=0x7f96ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96f6ffd700 1 -- 172.21.15.38:0/2366408480 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96ec011c20 con 0x7f96f809df00 2020-06-12T17:50:58.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96fe4e2700 1 -- 172.21.15.38:0/2366408480 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96f809df00 msgr2=0x7f96f813c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:58.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.202+0000 7f96fe4e2700 1 --2- 172.21.15.38:0/2366408480 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96f809df00 0x7f96f813c650 secure :-1 s=READY pgs=767 cs=0 l=1 rx=0x7f96ec002f30 tx=0x7f96ec007e60).stop 2020-06-12T17:50:58.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.203+0000 7f96fe4e2700 1 -- 172.21.15.38:0/2366408480 shutdown_connections 2020-06-12T17:50:58.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.203+0000 7f96fe4e2700 1 --2- 172.21.15.38:0/2366408480 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96f8142e90 0x7f96f8066790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:58.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.203+0000 7f96fe4e2700 1 --2- 172.21.15.38:0/2366408480 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96f809df00 0x7f96f813c650 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:58.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.203+0000 7f96fe4e2700 1 -- 172.21.15.38:0/2366408480 >> 172.21.15.38:0/2366408480 conn(0x7f96f80b5a20 msgr2=0x7f96f805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:58.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.203+0000 7f96fe4e2700 1 -- 172.21.15.38:0/2366408480 shutdown_connections 2020-06-12T17:50:58.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.203+0000 7f96fe4e2700 1 -- 172.21.15.38:0/2366408480 wait complete. 2020-06-12T17:50:58.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.204+0000 7f96fe4e2700 1 Processor -- start 2020-06-12T17:50:58.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.204+0000 7f96fe4e2700 1 -- start start 2020-06-12T17:50:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96fe4e2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96f809df00 0x7f96f80ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96fe4e2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f96f80b3ac0 0x7f96f8145980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96fe4e2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f96f8142e90 0x7f96f8151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96fe4e2700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f8154560 con 0x7f96f80b3ac0 2020-06-12T17:50:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96fe4e2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f8145de0 con 0x7f96f8142e90 2020-06-12T17:50:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96fe4e2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f80afa20 con 0x7f96f809df00 2020-06-12T17:50:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96f77fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f96f80b3ac0 0x7f96f8145980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:58.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96f77fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f96f80b3ac0 0x7f96f8145980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39320/0 (socket says 172.21.15.38:39320) 2020-06-12T17:50:58.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96f77fe700 1 -- 172.21.15.38:0/3096299714 learned_addr learned my addr 172.21.15.38:0/3096299714 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:58.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96f7fff700 1 --2- 172.21.15.38:0/3096299714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96f809df00 0x7f96f80ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:58.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96fca7f700 1 --2- 172.21.15.38:0/3096299714 >> v2:172.21.15.150:3300/0 conn(0x7f96f8142e90 0x7f96f8151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:58.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96f77fe700 1 -- 172.21.15.38:0/3096299714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96f809df00 msgr2=0x7f96f80ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:58.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96f77fe700 1 --2- 172.21.15.38:0/3096299714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96f809df00 0x7f96f80ae3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:58.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96f77fe700 1 -- 172.21.15.38:0/3096299714 >> v2:172.21.15.150:3300/0 conn(0x7f96f8142e90 msgr2=0x7f96f8151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:58.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96f77fe700 1 --2- 172.21.15.38:0/3096299714 >> v2:172.21.15.150:3300/0 conn(0x7f96f8142e90 0x7f96f8151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:58.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96f77fe700 1 -- 172.21.15.38:0/3096299714 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f80afcc0 con 0x7f96f80b3ac0 2020-06-12T17:50:58.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96f7fff700 1 --2- 172.21.15.38:0/3096299714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96f809df00 0x7f96f80ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:50:58.222 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96fca7f700 1 --2- 172.21.15.38:0/3096299714 >> v2:172.21.15.150:3300/0 conn(0x7f96f8142e90 0x7f96f8151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:50:58.222 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96f77fe700 1 --2- 172.21.15.38:0/3096299714 >> v2:172.21.15.38:3300/0 conn(0x7f96f80b3ac0 0x7f96f8145980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f96ec002f30 tx=0x7f96ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.222 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96f77fe700 1 --2- 172.21.15.38:0/3096299714 >> v2:172.21.15.38:3300/0 conn(0x7f96f80b3ac0 0x7f96f8145980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f96ec002f30 tx=0x7f96ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.222 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96f77fe700 1 --2- 172.21.15.38:0/3096299714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96f80b3ac0 0x7f96f8145980 secure :-1 s=READY pgs=768 cs=0 l=1 rx=0x7f96ec002f30 tx=0x7f96ec007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:58.222 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96f77fe700 1 --2- 172.21.15.38:0/3096299714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96f80b3ac0 0x7f96f8145980 secure :-1 s=THROTTLE_DONE pgs=768 cs=0 l=1 rx=0x7f96ec002f30 tx=0x7f96ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96f57fa700 1 -- 172.21.15.38:0/3096299714 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96ec0072a0 con 0x7f96f80b3ac0 2020-06-12T17:50:58.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96f77fe700 1 --2- 172.21.15.38:0/3096299714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96f80b3ac0 0x7f96f8145980 secure :-1 s=THROTTLE_DONE pgs=768 cs=0 l=1 rx=0x7f96ec002f30 tx=0x7f96ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96f77fe700 1 --2- 172.21.15.38:0/3096299714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96f80b3ac0 0x7f96f8145980 secure :-1 s=THROTTLE_DONE pgs=768 cs=0 l=1 rx=0x7f96ec002f30 tx=0x7f96ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96f57fa700 1 -- 172.21.15.38:0/3096299714 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ec007400 con 0x7f96f80b3ac0 2020-06-12T17:50:58.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96fe4e2700 1 -- 172.21.15.38:0/3096299714 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f8151670 con 0x7f96f80b3ac0 2020-06-12T17:50:58.224 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96f57fa700 1 -- 172.21.15.38:0/3096299714 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96ec0075f0 con 0x7f96f80b3ac0 2020-06-12T17:50:58.224 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.205+0000 7f96fe4e2700 1 -- 172.21.15.38:0/3096299714 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f80af2b0 con 0x7f96f80b3ac0 2020-06-12T17:50:58.224 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.206+0000 7f96f77fe700 1 --2- 172.21.15.38:0/3096299714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96f80b3ac0 0x7f96f8145980 secure :-1 s=THROTTLE_DONE pgs=768 cs=0 l=1 rx=0x7f96ec002f30 tx=0x7f96ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.224 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.206+0000 7f96fe4e2700 1 -- 172.21.15.38:0/3096299714 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f8056c30 con 0x7f96f80b3ac0 2020-06-12T17:50:58.224 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.206+0000 7f96f57fa700 1 -- 172.21.15.38:0/3096299714 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f96ec0058b0 con 0x7f96f80b3ac0 2020-06-12T17:50:58.224 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.206+0000 7f96f77fe700 1 --2- 172.21.15.38:0/3096299714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96f80b3ac0 0x7f96f8145980 secure :-1 s=THROTTLE_DONE pgs=768 cs=0 l=1 rx=0x7f96ec002f30 tx=0x7f96ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.225 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.207+0000 7f96f57fa700 1 --2- 172.21.15.38:0/3096299714 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f96d804d4f0 0x7f96d804f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:58.225 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.207+0000 7f96f57fa700 1 -- 172.21.15.38:0/3096299714 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f96ec0614f0 con 0x7f96f80b3ac0 2020-06-12T17:50:58.225 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.207+0000 7f96f7fff700 1 --2- 172.21.15.38:0/3096299714 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f96d804d4f0 0x7f96d804f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:58.225 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.207+0000 7f96f7fff700 1 --2- 172.21.15.38:0/3096299714 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f96d804d4f0 0x7f96d804f9b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f96e8000b80 tx=0x7f96e8001490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.226 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.207+0000 7f96f7fff700 1 --2- 172.21.15.38:0/3096299714 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f96d804d4f0 0x7f96d804f9b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f96e8000b80 tx=0x7f96e8001490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.226 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.207+0000 7f96f7fff700 1 --2- 172.21.15.38:0/3096299714 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f96d804d4f0 0x7f96d804f9b0 secure :-1 s=READY pgs=298 cs=0 l=1 rx=0x7f96e8000b80 tx=0x7f96e8001490).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:58.226 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.210+0000 7f96f77fe700 1 --2- 172.21.15.38:0/3096299714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96f80b3ac0 0x7f96f8145980 secure :-1 s=THROTTLE_DONE pgs=768 cs=0 l=1 rx=0x7f96ec002f30 tx=0x7f96ec007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.226 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.210+0000 7f96f57fa700 1 -- 172.21.15.38:0/3096299714 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f96ec03cd10 con 0x7f96f80b3ac0 2020-06-12T17:50:58.407 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.403+0000 7f96fe4e2700 1 -- 172.21.15.38:0/3096299714 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_4131", "target": ["mon-mgr", ""]}) v1 -- 0x7f96f80af5c0 con 0x7f96d804d4f0 2020-06-12T17:50:58.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.422+0000 7f96f7fff700 1 --2- 172.21.15.38:0/3096299714 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f96d804d4f0 0x7f96d804f9b0 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7f96e8000b80 tx=0x7f96e8001490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.422+0000 7f96f57fa700 1 -- 172.21.15.38:0/3096299714 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f96e800de30 con 0x7f96d804d4f0 2020-06-12T17:50:58.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.424+0000 7f96fe4e2700 1 -- 172.21.15.38:0/3096299714 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f96d804d4f0 msgr2=0x7f96d804f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:58.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.424+0000 7f96fe4e2700 1 --2- 172.21.15.38:0/3096299714 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f96d804d4f0 0x7f96d804f9b0 secure :-1 s=READY pgs=298 cs=0 l=1 rx=0x7f96e8000b80 tx=0x7f96e8001490).stop 2020-06-12T17:50:58.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.424+0000 7f96fe4e2700 1 -- 172.21.15.38:0/3096299714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96f80b3ac0 msgr2=0x7f96f8145980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:58.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.424+0000 7f96fe4e2700 1 --2- 172.21.15.38:0/3096299714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96f80b3ac0 0x7f96f8145980 secure :-1 s=READY pgs=768 cs=0 l=1 rx=0x7f96ec002f30 tx=0x7f96ec007e60).stop 2020-06-12T17:50:58.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.424+0000 7f96fe4e2700 1 -- 172.21.15.38:0/3096299714 shutdown_connections 2020-06-12T17:50:58.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.424+0000 7f96fe4e2700 1 --2- 172.21.15.38:0/3096299714 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f96d804d4f0 0x7f96d804f9b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:58.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.424+0000 7f96fe4e2700 1 --2- 172.21.15.38:0/3096299714 >> v2:172.21.15.150:3300/0 conn(0x7f96f8142e90 0x7f96f8151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:58.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.424+0000 7f96fe4e2700 1 --2- 172.21.15.38:0/3096299714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96f809df00 0x7f96f80ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:58.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.424+0000 7f96fe4e2700 1 --2- 172.21.15.38:0/3096299714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96f80b3ac0 0x7f96f8145980 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:58.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.424+0000 7f96fe4e2700 1 -- 172.21.15.38:0/3096299714 >> 172.21.15.38:0/3096299714 conn(0x7f96f80b5a20 msgr2=0x7f96f80b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:58.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.424+0000 7f96fe4e2700 1 -- 172.21.15.38:0/3096299714 shutdown_connections 2020-06-12T17:50:58.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.424+0000 7f96fe4e2700 1 -- 172.21.15.38:0/3096299714 wait complete. 2020-06-12T17:50:58.438 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_4131 2020-06-12T17:50:58.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.551+0000 7f0e43c2a700 1 Processor -- start 2020-06-12T17:50:58.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.551+0000 7f0e43c2a700 1 -- start start 2020-06-12T17:50:58.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.552+0000 7f0e43c2a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e3c146680 0x7f0e3c0ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:58.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.552+0000 7f0e43c2a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0e3c0b2eb0 0x7f0e3c09d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:50:58.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.552+0000 7f0e43c2a700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3c146d20 con 0x7f0e3c09d620 2020-06-12T17:50:58.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.552+0000 7f0e43c2a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3c066a80 con 0x7f0e3c0b2eb0 2020-06-12T17:50:58.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.552+0000 7f0e43c2a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c146f50 con 0x7f0e3c146680 2020-06-12T17:50:58.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.552+0000 7f0e421c7700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f0e3c09d620 0x7f0e3c09b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41146/0 (socket says 172.21.15.38:41146) 2020-06-12T17:50:58.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.552+0000 7f0e421c7700 1 -- 172.21.15.38:0/2085211079 learned_addr learned my addr 172.21.15.38:0/2085211079 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:50:58.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.552+0000 7f0e411c5700 1 --2- 172.21.15.38:0/2085211079 >> v2:172.21.15.150:3300/0 conn(0x7f0e3c0b2eb0 0x7f0e3c09d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:58.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.552+0000 7f0e419c6700 1 --2- 172.21.15.38:0/2085211079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e3c146680 0x7f0e3c0ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:58.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.552+0000 7f0e409c4700 1 -- 172.21.15.38:0/2085211079 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 679073770 0 0) 0x7f0e3c146d20 con 0x7f0e3c09d620 2020-06-12T17:50:58.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.552+0000 7f0e409c4700 1 -- 172.21.15.38:0/2085211079 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e24003230 con 0x7f0e3c09d620 2020-06-12T17:50:58.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.552+0000 7f0e411c5700 1 -- 172.21.15.38:0/2085211079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e3c146680 msgr2=0x7f0e3c0ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:50:58.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.552+0000 7f0e411c5700 1 --2- 172.21.15.38:0/2085211079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e3c146680 0x7f0e3c0ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:58.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.552+0000 7f0e411c5700 1 -- 172.21.15.38:0/2085211079 >> v1:172.21.15.38:6789/0 conn(0x7f0e3c09d620 legacy=0x7f0e3c09b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:58.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.552+0000 7f0e409c4700 1 -- 172.21.15.38:0/2085211079 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3192462690 0 0) 0x7f0e24003230 con 0x7f0e3c09d620 2020-06-12T17:50:58.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.552+0000 7f0e411c5700 1 -- 172.21.15.38:0/2085211079 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c146a60 con 0x7f0e3c0b2eb0 2020-06-12T17:50:58.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.552+0000 7f0e419c6700 1 --2- 172.21.15.38:0/2085211079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e3c146680 0x7f0e3c0ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:50:58.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.552+0000 7f0e411c5700 1 --2- 172.21.15.38:0/2085211079 >> v2:172.21.15.150:3300/0 conn(0x7f0e3c0b2eb0 0x7f0e3c09d1c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0e34001870 tx=0x7f0e380081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.553+0000 7f0e411c5700 1 --2- 172.21.15.38:0/2085211079 >> v2:172.21.15.150:3300/0 conn(0x7f0e3c0b2eb0 0x7f0e3c09d1c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0e34001870 tx=0x7f0e380081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.553+0000 7f0e411c5700 1 --2- 172.21.15.38:0/2085211079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e3c0b2eb0 0x7f0e3c09d1c0 secure :-1 s=READY pgs=427 cs=0 l=1 rx=0x7f0e34001870 tx=0x7f0e380081e0).ready entity=mon.1 client_cookie=a46605603a406392 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:58.565 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.553+0000 7f0e411c5700 1 --2- 172.21.15.38:0/2085211079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e3c0b2eb0 0x7f0e3c09d1c0 secure :-1 s=THROTTLE_DONE pgs=427 cs=0 l=1 rx=0x7f0e34001870 tx=0x7f0e380081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.553+0000 7f0e409c4700 1 -- 172.21.15.38:0/2085211079 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e340016d0 con 0x7f0e3c0b2eb0 2020-06-12T17:50:58.566 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.553+0000 7f0e411c5700 1 --2- 172.21.15.38:0/2085211079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e3c0b2eb0 0x7f0e3c09d1c0 secure :-1 s=THROTTLE_DONE pgs=427 cs=0 l=1 rx=0x7f0e34001870 tx=0x7f0e380081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.553+0000 7f0e409c4700 1 -- 172.21.15.38:0/2085211079 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e38010920 con 0x7f0e3c0b2eb0 2020-06-12T17:50:58.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.553+0000 7f0e411c5700 1 --2- 172.21.15.38:0/2085211079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e3c0b2eb0 0x7f0e3c09d1c0 secure :-1 s=THROTTLE_DONE pgs=427 cs=0 l=1 rx=0x7f0e34001870 tx=0x7f0e380081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.553+0000 7f0e409c4700 1 -- 172.21.15.38:0/2085211079 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e38010c80 con 0x7f0e3c0b2eb0 2020-06-12T17:50:58.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.553+0000 7f0e43c2a700 1 -- 172.21.15.38:0/2085211079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e3c0b2eb0 msgr2=0x7f0e3c09d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:58.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.553+0000 7f0e43c2a700 1 --2- 172.21.15.38:0/2085211079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e3c0b2eb0 0x7f0e3c09d1c0 secure :-1 s=READY pgs=427 cs=0 l=1 rx=0x7f0e34001870 tx=0x7f0e380081e0).stop 2020-06-12T17:50:58.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.553+0000 7f0e43c2a700 1 -- 172.21.15.38:0/2085211079 shutdown_connections 2020-06-12T17:50:58.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.553+0000 7f0e43c2a700 1 --2- 172.21.15.38:0/2085211079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e3c146680 0x7f0e3c0ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:50:58.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.553+0000 7f0e43c2a700 1 --2- 172.21.15.38:0/2085211079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e3c0b2eb0 0x7f0e3c09d1c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:58.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.553+0000 7f0e43c2a700 1 -- 172.21.15.38:0/2085211079 >> 172.21.15.38:0/2085211079 conn(0x7f0e3c0b5a20 msgr2=0x7f0e3c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:58.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.553+0000 7f0e43c2a700 1 -- 172.21.15.38:0/2085211079 shutdown_connections 2020-06-12T17:50:58.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.553+0000 7f0e43c2a700 1 -- 172.21.15.38:0/2085211079 wait complete. 2020-06-12T17:50:58.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.554+0000 7f0e43c2a700 1 Processor -- start 2020-06-12T17:50:58.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.554+0000 7f0e43c2a700 1 -- start start 2020-06-12T17:50:58.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.555+0000 7f0e43c2a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0e3c09d620 0x7f0e3c090880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:58.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.555+0000 7f0e43c2a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e3c0b2eb0 0x7f0e3c065920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:58.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.555+0000 7f0e43c2a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0e3c146680 0x7f0e3c065d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:58.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.555+0000 7f0e43c2a700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3c1536c0 con 0x7f0e3c146680 2020-06-12T17:50:58.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.555+0000 7f0e43c2a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3c091000 con 0x7f0e3c09d620 2020-06-12T17:50:58.575 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.555+0000 7f0e43c2a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c0912a0 con 0x7f0e3c0b2eb0 2020-06-12T17:50:58.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.555+0000 7f0e421c7700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0e3c146680 0x7f0e3c065d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:58.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.555+0000 7f0e421c7700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0e3c146680 0x7f0e3c065d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39336/0 (socket says 172.21.15.38:39336) 2020-06-12T17:50:58.576 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.555+0000 7f0e421c7700 1 -- 172.21.15.38:0/1462945835 learned_addr learned my addr 172.21.15.38:0/1462945835 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:50:58.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.555+0000 7f0e411c5700 1 --2- 172.21.15.38:0/1462945835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e3c0b2eb0 0x7f0e3c065920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:58.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.555+0000 7f0e419c6700 1 --2- 172.21.15.38:0/1462945835 >> v2:172.21.15.150:3300/0 conn(0x7f0e3c09d620 0x7f0e3c090880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:58.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.555+0000 7f0e421c7700 1 -- 172.21.15.38:0/1462945835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e3c0b2eb0 msgr2=0x7f0e3c065920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:58.577 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.555+0000 7f0e421c7700 1 --2- 172.21.15.38:0/1462945835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e3c0b2eb0 0x7f0e3c065920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:58.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.555+0000 7f0e421c7700 1 -- 172.21.15.38:0/1462945835 >> v2:172.21.15.150:3300/0 conn(0x7f0e3c09d620 msgr2=0x7f0e3c090880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:58.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.555+0000 7f0e421c7700 1 --2- 172.21.15.38:0/1462945835 >> v2:172.21.15.150:3300/0 conn(0x7f0e3c09d620 0x7f0e3c090880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:58.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.555+0000 7f0e421c7700 1 -- 172.21.15.38:0/1462945835 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c090ce0 con 0x7f0e3c146680 2020-06-12T17:50:58.578 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.555+0000 7f0e421c7700 1 --2- 172.21.15.38:0/1462945835 >> v2:172.21.15.38:3300/0 conn(0x7f0e3c146680 0x7f0e3c065d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0e34001930 tx=0x7f0e34001ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.555+0000 7f0e421c7700 1 --2- 172.21.15.38:0/1462945835 >> v2:172.21.15.38:3300/0 conn(0x7f0e3c146680 0x7f0e3c065d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0e34001930 tx=0x7f0e34001ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.556+0000 7f0e421c7700 1 --2- 172.21.15.38:0/1462945835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e3c146680 0x7f0e3c065d80 secure :-1 s=READY pgs=770 cs=0 l=1 rx=0x7f0e34001930 tx=0x7f0e34001ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:58.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.556+0000 7f0e421c7700 1 --2- 172.21.15.38:0/1462945835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e3c146680 0x7f0e3c065d80 secure :-1 s=THROTTLE_DONE pgs=770 cs=0 l=1 rx=0x7f0e34001930 tx=0x7f0e34001ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.556+0000 7f0e2affd700 1 -- 172.21.15.38:0/1462945835 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e340129f0 con 0x7f0e3c146680 2020-06-12T17:50:58.579 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.556+0000 7f0e421c7700 1 --2- 172.21.15.38:0/1462945835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e3c146680 0x7f0e3c065d80 secure :-1 s=THROTTLE_DONE pgs=770 cs=0 l=1 rx=0x7f0e34001930 tx=0x7f0e34001ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.556+0000 7f0e421c7700 1 --2- 172.21.15.38:0/1462945835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e3c146680 0x7f0e3c065d80 secure :-1 s=THROTTLE_DONE pgs=770 cs=0 l=1 rx=0x7f0e34001930 tx=0x7f0e34001ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.556+0000 7f0e2affd700 1 -- 172.21.15.38:0/1462945835 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e34012b50 con 0x7f0e3c146680 2020-06-12T17:50:58.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.556+0000 7f0e2affd700 1 -- 172.21.15.38:0/1462945835 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e3400c540 con 0x7f0e3c146680 2020-06-12T17:50:58.580 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.556+0000 7f0e43c2a700 1 -- 172.21.15.38:0/1462945835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3c153b20 con 0x7f0e3c146680 2020-06-12T17:50:58.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.556+0000 7f0e43c2a700 1 -- 172.21.15.38:0/1462945835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3c153fc0 con 0x7f0e3c146680 2020-06-12T17:50:58.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.556+0000 7f0e421c7700 1 --2- 172.21.15.38:0/1462945835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e3c146680 0x7f0e3c065d80 secure :-1 s=THROTTLE_DONE pgs=770 cs=0 l=1 rx=0x7f0e34001930 tx=0x7f0e34001ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.581 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.557+0000 7f0e43c2a700 1 -- 172.21.15.38:0/1462945835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e3c056c30 con 0x7f0e3c146680 2020-06-12T17:50:58.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.557+0000 7f0e2affd700 1 -- 172.21.15.38:0/1462945835 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f0e3400c780 con 0x7f0e3c146680 2020-06-12T17:50:58.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.557+0000 7f0e421c7700 1 --2- 172.21.15.38:0/1462945835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e3c146680 0x7f0e3c065d80 secure :-1 s=THROTTLE_DONE pgs=770 cs=0 l=1 rx=0x7f0e34001930 tx=0x7f0e34001ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.557+0000 7f0e2affd700 1 --2- 172.21.15.38:0/1462945835 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0e1c04d720 0x7f0e1c04fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:50:58.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.558+0000 7f0e2affd700 1 -- 172.21.15.38:0/1462945835 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0e34061070 con 0x7f0e3c146680 2020-06-12T17:50:58.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.558+0000 7f0e419c6700 1 --2- 172.21.15.38:0/1462945835 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0e1c04d720 0x7f0e1c04fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:50:58.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.558+0000 7f0e419c6700 1 --2- 172.21.15.38:0/1462945835 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0e1c04d720 0x7f0e1c04fbe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0e2c002f30 tx=0x7f0e2c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.558+0000 7f0e419c6700 1 --2- 172.21.15.38:0/1462945835 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0e1c04d720 0x7f0e1c04fbe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0e2c002f30 tx=0x7f0e2c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.558+0000 7f0e419c6700 1 --2- 172.21.15.38:0/1462945835 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0e1c04d720 0x7f0e1c04fbe0 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7f0e2c002f30 tx=0x7f0e2c007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:50:58.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.561+0000 7f0e421c7700 1 --2- 172.21.15.38:0/1462945835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e3c146680 0x7f0e3c065d80 secure :-1 s=THROTTLE_DONE pgs=770 cs=0 l=1 rx=0x7f0e34001930 tx=0x7f0e34001ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.561+0000 7f0e2affd700 1 -- 172.21.15.38:0/1462945835 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f0e3403c7d0 con 0x7f0e3c146680 2020-06-12T17:50:58.763 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.759+0000 7f0e43c2a700 1 -- 172.21.15.38:0/1462945835 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_4131", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e3c090e70 con 0x7f0e1c04d720 2020-06-12T17:50:58.766 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.762+0000 7f0e419c6700 1 --2- 172.21.15.38:0/1462945835 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0e1c04d720 0x7f0e1c04fbe0 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f0e2c002f30 tx=0x7f0e2c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:50:58.766 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.762+0000 7f0e2affd700 1 -- 172.21.15.38:0/1462945835 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f0e3c090e70 con 0x7f0e1c04d720 2020-06-12T17:50:58.766 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_4131/8f145976-61aa-453a-8cd7-7480e58b64dc 2020-06-12T17:50:58.768 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.764+0000 7f0e43c2a700 1 -- 172.21.15.38:0/1462945835 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0e1c04d720 msgr2=0x7f0e1c04fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:58.768 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.764+0000 7f0e43c2a700 1 --2- 172.21.15.38:0/1462945835 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0e1c04d720 0x7f0e1c04fbe0 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7f0e2c002f30 tx=0x7f0e2c007e60).stop 2020-06-12T17:50:58.768 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.764+0000 7f0e43c2a700 1 -- 172.21.15.38:0/1462945835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e3c146680 msgr2=0x7f0e3c065d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:50:58.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.764+0000 7f0e43c2a700 1 --2- 172.21.15.38:0/1462945835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e3c146680 0x7f0e3c065d80 secure :-1 s=READY pgs=770 cs=0 l=1 rx=0x7f0e34001930 tx=0x7f0e34001ae0).stop 2020-06-12T17:50:58.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.764+0000 7f0e43c2a700 1 -- 172.21.15.38:0/1462945835 shutdown_connections 2020-06-12T17:50:58.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.764+0000 7f0e43c2a700 1 --2- 172.21.15.38:0/1462945835 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0e1c04d720 0x7f0e1c04fbe0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:58.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.764+0000 7f0e43c2a700 1 --2- 172.21.15.38:0/1462945835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e3c146680 0x7f0e3c065d80 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:58.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.764+0000 7f0e43c2a700 1 --2- 172.21.15.38:0/1462945835 >> v2:172.21.15.150:3300/0 conn(0x7f0e3c09d620 0x7f0e3c090880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:58.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.764+0000 7f0e43c2a700 1 --2- 172.21.15.38:0/1462945835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e3c0b2eb0 0x7f0e3c065920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:50:58.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.764+0000 7f0e43c2a700 1 -- 172.21.15.38:0/1462945835 >> 172.21.15.38:0/1462945835 conn(0x7f0e3c0b5a20 msgr2=0x7f0e3c09b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:50:58.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.764+0000 7f0e43c2a700 1 -- 172.21.15.38:0/1462945835 shutdown_connections 2020-06-12T17:50:58.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:50:58.764+0000 7f0e43c2a700 1 -- 172.21.15.38:0/1462945835 wait complete. 2020-06-12T17:50:58.778 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_4131 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_4131/8f145976-61aa-453a-8cd7-7480e58b64dc 2020-06-12T17:50:58.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:58.779 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:58.779 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:58.794 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:58.795 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:58.795 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4131/8f145976-61aa-453a-8cd7-7480e58b64dc/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:58.887 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:58.888 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:58.888 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131589 s, 79.7 MB/s 2020-06-12T17:50:58.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:58.889 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:58.890 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:58.908 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:58.909 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:58.909 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4131/8f145976-61aa-453a-8cd7-7480e58b64dc/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:58.998 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:58.998 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:58.999 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105525 s, 99.4 MB/s 2020-06-12T17:50:59.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:59.000 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:59.001 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:59.016 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:59.017 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:59.017 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4131/8f145976-61aa-453a-8cd7-7480e58b64dc/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:59.106 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:59.107 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:59.107 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131136 s, 80.0 MB/s 2020-06-12T17:50:59.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:59.109 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:59.109 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:59.124 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:59.125 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:59.126 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4131/8f145976-61aa-453a-8cd7-7480e58b64dc/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:59.213 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:59.214 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:59.214 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114225 s, 91.8 MB/s 2020-06-12T17:50:59.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:59.216 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:59.216 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:59.231 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:59.232 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:59.232 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4131/8f145976-61aa-453a-8cd7-7480e58b64dc/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:59.319 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:59.319 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:59.320 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108112 s, 97.0 MB/s 2020-06-12T17:50:59.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:59.322 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:59.322 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:59.337 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:59.338 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:59.338 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4131/8f145976-61aa-453a-8cd7-7480e58b64dc/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:59.425 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:59.426 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:59.426 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010692 s, 98.1 MB/s 2020-06-12T17:50:59.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:59.428 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:59.428 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:59.444 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:59.444 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:59.445 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4131/8f145976-61aa-453a-8cd7-7480e58b64dc/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:59.531 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:59.532 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:59.532 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103752 s, 101 MB/s 2020-06-12T17:50:59.533 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:59.534 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:59.535 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:59.550 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:59.551 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:59.551 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4131/8f145976-61aa-453a-8cd7-7480e58b64dc/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:59.639 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:59.640 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:59.640 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126303 s, 83.0 MB/s 2020-06-12T17:50:59.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:59.649 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:59.650 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:59.670 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:59.670 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:59.671 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4131/8f145976-61aa-453a-8cd7-7480e58b64dc/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:59.760 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:59.761 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:59.761 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134978 s, 77.7 MB/s 2020-06-12T17:50:59.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:50:59.763 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:50:59.763 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:50:59.778 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:50:59.779 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:50:59.780 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4131/8f145976-61aa-453a-8cd7-7480e58b64dc/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:50:59.875 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:50:59.875 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:50:59.876 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122901 s, 85.3 MB/s 2020-06-12T17:50:59.876 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_1797 2020-06-12T17:51:00.033 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.029+0000 7f4d92760700 1 Processor -- start 2020-06-12T17:51:00.033 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.029+0000 7f4d92760700 1 -- start start 2020-06-12T17:51:00.037 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.030+0000 7f4d92760700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d8c0bd2b0 0x7f4d8c149f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:00.037 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.030+0000 7f4d92760700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8c0b7fd0 con 0x7f4d8c13fcd0 2020-06-12T17:51:00.037 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.030+0000 7f4d92760700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8c1405e0 con 0x7f4d8c140150 2020-06-12T17:51:00.037 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.030+0000 7f4d92760700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c0b7540 con 0x7f4d8c0bd2b0 2020-06-12T17:51:00.038 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.030+0000 7f4d8b7fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4d8c13fcd0 0x7f4d8c146410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41156/0 (socket says 172.21.15.38:41156) 2020-06-12T17:51:00.038 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.030+0000 7f4d8b7fe700 1 -- 172.21.15.38:0/3886066711 learned_addr learned my addr 172.21.15.38:0/3886066711 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:00.038 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d8affd700 1 -- 172.21.15.38:0/3886066711 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 404971552 0 0) 0x7f4d8c0b7fd0 con 0x7f4d8c13fcd0 2020-06-12T17:51:00.038 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d8bfff700 1 --2- 172.21.15.38:0/3886066711 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d8c0bd2b0 0x7f4d8c149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:00.038 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d8affd700 1 -- 172.21.15.38:0/3886066711 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d78003230 con 0x7f4d8c13fcd0 2020-06-12T17:51:00.039 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d8affd700 1 -- 172.21.15.38:0/3886066711 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 424162124 0 0) 0x7f4d78003230 con 0x7f4d8c13fcd0 2020-06-12T17:51:00.039 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d8affd700 1 -- 172.21.15.38:0/3886066711 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d8c0bd2b0 msgr2=0x7f4d8c149f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:00.039 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d8affd700 1 --2- 172.21.15.38:0/3886066711 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d8c0bd2b0 0x7f4d8c149f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:00.039 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d8affd700 1 -- 172.21.15.38:0/3886066711 >> v1:172.21.15.150:6789/0 conn(0x7f4d8c140150 legacy=0x7f4d8c146b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:00.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d8affd700 1 -- 172.21.15.38:0/3886066711 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8c0b77e0 con 0x7f4d8c13fcd0 2020-06-12T17:51:00.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d8affd700 1 -- 172.21.15.38:0/3886066711 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f4d800016d0 con 0x7f4d8c13fcd0 2020-06-12T17:51:00.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d8affd700 1 -- 172.21.15.38:0/3886066711 >> v1:172.21.15.38:6789/0 conn(0x7f4d8c13fcd0 legacy=0x7f4d8c146410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:00.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d8affd700 1 --2- 172.21.15.38:0/3886066711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d78003750 0x7f4d78003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:00.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d8affd700 1 --2- 172.21.15.38:0/3886066711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d78004090 0x7f4d78004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:00.040 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d8affd700 1 --2- 172.21.15.38:0/3886066711 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d8c0bd2b0 0x7f4d78004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:00.041 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d8affd700 1 -- 172.21.15.38:0/3886066711 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c0b7540 con 0x7f4d78004090 2020-06-12T17:51:00.041 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d8affd700 1 -- 172.21.15.38:0/3886066711 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d78004fb0 con 0x7f4d78003750 2020-06-12T17:51:00.041 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d8affd700 1 -- 172.21.15.38:0/3886066711 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d78005170 con 0x7f4d8c0bd2b0 2020-06-12T17:51:00.041 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d8b7fe700 1 --2- 172.21.15.38:0/3886066711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d78004090 0x7f4d78004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:00.041 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d8bfff700 1 --2- 172.21.15.38:0/3886066711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d78003750 0x7f4d78003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:00.042 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d90cfd700 1 --2- 172.21.15.38:0/3886066711 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d8c0bd2b0 0x7f4d78004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:00.042 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d8b7fe700 1 -- 172.21.15.38:0/3886066711 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d8c0bd2b0 msgr2=0x7f4d78004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:00.042 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d8b7fe700 1 --2- 172.21.15.38:0/3886066711 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d8c0bd2b0 0x7f4d78004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:00.042 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d8b7fe700 1 -- 172.21.15.38:0/3886066711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d78003750 msgr2=0x7f4d78003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:00.042 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d8b7fe700 1 --2- 172.21.15.38:0/3886066711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d78003750 0x7f4d78003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:00.043 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d8b7fe700 1 -- 172.21.15.38:0/3886066711 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d78003230 con 0x7f4d78004090 2020-06-12T17:51:00.043 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d90cfd700 1 --2- 172.21.15.38:0/3886066711 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d8c0bd2b0 0x7f4d78004b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:51:00.043 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d8b7fe700 1 --2- 172.21.15.38:0/3886066711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d78004090 0x7f4d78004570 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4d800013e0 tx=0x7f4d8c0b8490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.043 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d8b7fe700 1 --2- 172.21.15.38:0/3886066711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d78004090 0x7f4d78004570 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4d800013e0 tx=0x7f4d8c0b8490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.043 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.031+0000 7f4d8b7fe700 1 --2- 172.21.15.38:0/3886066711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d78004090 0x7f4d78004570 secure :-1 s=READY pgs=772 cs=0 l=1 rx=0x7f4d800013e0 tx=0x7f4d8c0b8490).ready entity=mon.0 client_cookie=eebbb38f8f281cff server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:00.044 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.032+0000 7f4d8b7fe700 1 --2- 172.21.15.38:0/3886066711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d78004090 0x7f4d78004570 secure :-1 s=THROTTLE_DONE pgs=772 cs=0 l=1 rx=0x7f4d800013e0 tx=0x7f4d8c0b8490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.044 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.032+0000 7f4d8b7fe700 1 --2- 172.21.15.38:0/3886066711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d78004090 0x7f4d78004570 secure :-1 s=THROTTLE_DONE pgs=772 cs=0 l=1 rx=0x7f4d800013e0 tx=0x7f4d8c0b8490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.044 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.032+0000 7f4d8affd700 1 -- 172.21.15.38:0/3886066711 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d8000ce70 con 0x7f4d78004090 2020-06-12T17:51:00.044 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.032+0000 7f4d8b7fe700 1 --2- 172.21.15.38:0/3886066711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d78004090 0x7f4d78004570 secure :-1 s=THROTTLE_DONE pgs=772 cs=0 l=1 rx=0x7f4d800013e0 tx=0x7f4d8c0b8490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.045 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.032+0000 7f4d8affd700 1 -- 172.21.15.38:0/3886066711 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8000e350 con 0x7f4d78004090 2020-06-12T17:51:00.045 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.032+0000 7f4d8affd700 1 -- 172.21.15.38:0/3886066711 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d800100b0 con 0x7f4d78004090 2020-06-12T17:51:00.045 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.032+0000 7f4d92760700 1 -- 172.21.15.38:0/3886066711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d78004090 msgr2=0x7f4d78004570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:00.046 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.032+0000 7f4d92760700 1 --2- 172.21.15.38:0/3886066711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d78004090 0x7f4d78004570 secure :-1 s=READY pgs=772 cs=0 l=1 rx=0x7f4d800013e0 tx=0x7f4d8c0b8490).stop 2020-06-12T17:51:00.046 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.032+0000 7f4d90cfd700 1 -- 172.21.15.38:0/3886066711 reap_dead start 2020-06-12T17:51:00.047 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.032+0000 7f4d92760700 1 -- 172.21.15.38:0/3886066711 shutdown_connections 2020-06-12T17:51:00.047 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.032+0000 7f4d92760700 1 -- 172.21.15.38:0/3886066711 >> 172.21.15.38:0/3886066711 conn(0x7f4d8c066080 msgr2=0x7f4d8c0bc820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:00.047 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.032+0000 7f4d92760700 1 -- 172.21.15.38:0/3886066711 shutdown_connections 2020-06-12T17:51:00.047 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.032+0000 7f4d92760700 1 -- 172.21.15.38:0/3886066711 wait complete. 2020-06-12T17:51:00.047 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.033+0000 7f4d92760700 1 Processor -- start 2020-06-12T17:51:00.048 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.033+0000 7f4d92760700 1 -- start start 2020-06-12T17:51:00.051 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.034+0000 7f4d92760700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4d8c0a11f0 0x7f4d8c157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:00.052 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.034+0000 7f4d92760700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d8c0a0580 0x7f4d8c152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:00.052 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.034+0000 7f4d92760700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8c0a1690 con 0x7f4d8c144ff0 2020-06-12T17:51:00.052 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.034+0000 7f4d92760700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8c0a1930 con 0x7f4d8c0a11f0 2020-06-12T17:51:00.052 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.034+0000 7f4d92760700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c09f9d0 con 0x7f4d8c0a0580 2020-06-12T17:51:00.053 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.034+0000 7f4d8bfff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4d8c144ff0 0x7f4d8c09fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41166/0 (socket says 172.21.15.38:41166) 2020-06-12T17:51:00.053 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.034+0000 7f4d8bfff700 1 -- 172.21.15.38:0/2684722878 learned_addr learned my addr 172.21.15.38:0/2684722878 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:00.053 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.034+0000 7f4d8b7fe700 1 --2- 172.21.15.38:0/2684722878 >> v2:172.21.15.150:3300/0 conn(0x7f4d8c0a11f0 0x7f4d8c157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:00.053 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.034+0000 7f4d897fa700 1 -- 172.21.15.38:0/2684722878 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191051112 0 0) 0x7f4d8c0a1690 con 0x7f4d8c144ff0 2020-06-12T17:51:00.053 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.034+0000 7f4d897fa700 1 -- 172.21.15.38:0/2684722878 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d6c002fe0 con 0x7f4d8c144ff0 2020-06-12T17:51:00.054 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.034+0000 7f4d90cfd700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d8c0a0580 0x7f4d8c152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:00.054 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.034+0000 7f4d897fa700 1 -- 172.21.15.38:0/2684722878 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2130374721 0 0) 0x7f4d6c002fe0 con 0x7f4d8c144ff0 2020-06-12T17:51:00.054 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.034+0000 7f4d897fa700 1 -- 172.21.15.38:0/2684722878 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4d8c0a1690 con 0x7f4d8c144ff0 2020-06-12T17:51:00.054 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.034+0000 7f4d897fa700 1 -- 172.21.15.38:0/2684722878 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f4d7c001490 con 0x7f4d8c144ff0 2020-06-12T17:51:00.054 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d897fa700 1 -- 172.21.15.38:0/2684722878 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d8c0a0580 msgr2=0x7f4d8c152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:00.055 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d897fa700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d8c0a0580 0x7f4d8c152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:00.055 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d897fa700 1 -- 172.21.15.38:0/2684722878 >> v2:172.21.15.150:3300/0 conn(0x7f4d8c0a11f0 msgr2=0x7f4d8c157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:00.055 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d897fa700 1 --2- 172.21.15.38:0/2684722878 >> v2:172.21.15.150:3300/0 conn(0x7f4d8c0a11f0 0x7f4d8c157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:00.055 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d897fa700 1 -- 172.21.15.38:0/2684722878 >> v1:172.21.15.38:6789/0 conn(0x7f4d8c144ff0 legacy=0x7f4d8c09fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:00.055 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d897fa700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d6c0049b0 0x7f4d6c004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:00.056 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d897fa700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d8c0a0580 0x7f4d6c003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:00.056 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d897fa700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d6c003d80 0x7f4d6c004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:00.056 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d897fa700 1 -- 172.21.15.38:0/2684722878 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c0a1930 con 0x7f4d6c0049b0 2020-06-12T17:51:00.056 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d897fa700 1 -- 172.21.15.38:0/2684722878 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c09f9d0 con 0x7f4d6c003d80 2020-06-12T17:51:00.056 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d897fa700 1 -- 172.21.15.38:0/2684722878 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c004770 con 0x7f4d8c0a0580 2020-06-12T17:51:00.057 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d8b7fe700 1 --2- 172.21.15.38:0/2684722878 >> v2:172.21.15.150:3300/0 conn(0x7f4d8c0a11f0 0x7f4d8c157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:51:00.057 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d8bfff700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d6c0049b0 0x7f4d6c004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:00.057 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d90cfd700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d6c003d80 0x7f4d6c004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:00.057 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d8b7fe700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d8c0a0580 0x7f4d6c003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:00.058 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d8bfff700 1 -- 172.21.15.38:0/2684722878 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d8c0a0580 msgr2=0x7f4d6c003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:00.058 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d8bfff700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d8c0a0580 0x7f4d6c003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:00.058 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d8bfff700 1 -- 172.21.15.38:0/2684722878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d6c003d80 msgr2=0x7f4d6c004200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:00.058 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d8bfff700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d6c003d80 0x7f4d6c004200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:00.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d8bfff700 1 -- 172.21.15.38:0/2684722878 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8c1453d0 con 0x7f4d6c0049b0 2020-06-12T17:51:00.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d92760700 1 -- 172.21.15.38:0/2684722878 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d8c148dc0 con 0x7f4d6c0049b0 2020-06-12T17:51:00.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d8bfff700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d6c0049b0 0x7f4d6c004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4d7c007fe0 tx=0x7f4d7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d92760700 1 -- 172.21.15.38:0/2684722878 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8c1531f0 con 0x7f4d6c0049b0 2020-06-12T17:51:00.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d8bfff700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d6c0049b0 0x7f4d6c004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4d7c007fe0 tx=0x7f4d7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d8bfff700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d6c0049b0 0x7f4d6c004dd0 secure :-1 s=READY pgs=774 cs=0 l=1 rx=0x7f4d7c007fe0 tx=0x7f4d7c007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:00.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d8bfff700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d6c0049b0 0x7f4d6c004dd0 secure :-1 s=THROTTLE_DONE pgs=774 cs=0 l=1 rx=0x7f4d7c007fe0 tx=0x7f4d7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d897fa700 1 -- 172.21.15.38:0/2684722878 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d7c007540 con 0x7f4d6c0049b0 2020-06-12T17:51:00.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d8bfff700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d6c0049b0 0x7f4d6c004dd0 secure :-1 s=THROTTLE_DONE pgs=774 cs=0 l=1 rx=0x7f4d7c007fe0 tx=0x7f4d7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d8bfff700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d6c0049b0 0x7f4d6c004dd0 secure :-1 s=THROTTLE_DONE pgs=774 cs=0 l=1 rx=0x7f4d7c007fe0 tx=0x7f4d7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.061 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d897fa700 1 -- 172.21.15.38:0/2684722878 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7c0058d0 con 0x7f4d6c0049b0 2020-06-12T17:51:00.061 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.035+0000 7f4d897fa700 1 -- 172.21.15.38:0/2684722878 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d7c005cb0 con 0x7f4d6c0049b0 2020-06-12T17:51:00.061 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.036+0000 7f4d8bfff700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d6c0049b0 0x7f4d6c004dd0 secure :-1 s=THROTTLE_DONE pgs=774 cs=0 l=1 rx=0x7f4d7c007fe0 tx=0x7f4d7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.061 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.036+0000 7f4d92760700 1 -- 172.21.15.38:0/2684722878 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d68003340 con 0x7f4d6c0049b0 2020-06-12T17:51:00.061 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.036+0000 7f4d897fa700 1 -- 172.21.15.38:0/2684722878 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f4d7c00a390 con 0x7f4d6c0049b0 2020-06-12T17:51:00.062 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.036+0000 7f4d8bfff700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d6c0049b0 0x7f4d6c004dd0 secure :-1 s=THROTTLE_DONE pgs=774 cs=0 l=1 rx=0x7f4d7c007fe0 tx=0x7f4d7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.062 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.037+0000 7f4d897fa700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4d6c0555b0 0x7f4d6c057a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:00.062 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.037+0000 7f4d897fa700 1 -- 172.21.15.38:0/2684722878 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f4d7c061fc0 con 0x7f4d6c0049b0 2020-06-12T17:51:00.062 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.037+0000 7f4d8b7fe700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4d6c0555b0 0x7f4d6c057a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:00.062 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.037+0000 7f4d8b7fe700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4d6c0555b0 0x7f4d6c057a70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4d800013e0 tx=0x7f4d8c0b8490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.063 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.037+0000 7f4d8b7fe700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4d6c0555b0 0x7f4d6c057a70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4d800013e0 tx=0x7f4d8c0b8490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.063 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.037+0000 7f4d8b7fe700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4d6c0555b0 0x7f4d6c057a70 secure :-1 s=READY pgs=300 cs=0 l=1 rx=0x7f4d800013e0 tx=0x7f4d8c0b8490).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:00.063 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.040+0000 7f4d8bfff700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d6c0049b0 0x7f4d6c004dd0 secure :-1 s=THROTTLE_DONE pgs=774 cs=0 l=1 rx=0x7f4d7c007fe0 tx=0x7f4d7c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.063 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.040+0000 7f4d897fa700 1 -- 172.21.15.38:0/2684722878 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f4d7c03d720 con 0x7f4d6c0049b0 2020-06-12T17:51:00.237 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.234+0000 7f4d92760700 1 -- 172.21.15.38:0/2684722878 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_1797", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d68002200 con 0x7f4d6c0555b0 2020-06-12T17:51:00.259 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.256+0000 7f4d8b7fe700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4d6c0555b0 0x7f4d6c057a70 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7f4d800013e0 tx=0x7f4d8c0b8490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.260 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.256+0000 7f4d897fa700 1 -- 172.21.15.38:0/2684722878 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f4d68002200 con 0x7f4d6c0555b0 2020-06-12T17:51:00.261 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.258+0000 7f4d92760700 1 -- 172.21.15.38:0/2684722878 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4d6c0555b0 msgr2=0x7f4d6c057a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:00.261 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.258+0000 7f4d92760700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f4d6c0555b0 0x7f4d6c057a70 secure :-1 s=READY pgs=300 cs=0 l=1 rx=0x7f4d800013e0 tx=0x7f4d8c0b8490).stop 2020-06-12T17:51:00.261 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.258+0000 7f4d92760700 1 -- 172.21.15.38:0/2684722878 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d6c0049b0 msgr2=0x7f4d6c004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:00.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.258+0000 7f4d92760700 1 --2- 172.21.15.38:0/2684722878 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d6c0049b0 0x7f4d6c004dd0 secure :-1 s=READY pgs=774 cs=0 l=1 rx=0x7f4d7c007fe0 tx=0x7f4d7c007e60).stop 2020-06-12T17:51:00.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.258+0000 7f4d90cfd700 1 -- 172.21.15.38:0/2684722878 reap_dead start 2020-06-12T17:51:00.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.258+0000 7f4d92760700 1 -- 172.21.15.38:0/2684722878 shutdown_connections 2020-06-12T17:51:00.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.258+0000 7f4d92760700 1 -- 172.21.15.38:0/2684722878 >> 172.21.15.38:0/2684722878 conn(0x7f4d8c066080 msgr2=0x7f4d8c05be00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:00.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.258+0000 7f4d92760700 1 -- 172.21.15.38:0/2684722878 shutdown_connections 2020-06-12T17:51:00.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.258+0000 7f4d92760700 1 -- 172.21.15.38:0/2684722878 wait complete. 2020-06-12T17:51:00.271 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_1797 2020-06-12T17:51:00.389 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.385+0000 7f36cdeb8700 1 Processor -- start 2020-06-12T17:51:00.390 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.385+0000 7f36cdeb8700 1 -- start start 2020-06-12T17:51:00.392 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.386+0000 7f36cdeb8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36c80a2460 0x7f36c80a2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:00.392 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.386+0000 7f36cdeb8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f36c8146060 0x7f36c809d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:00.393 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.386+0000 7f36cdeb8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36c805f7a0 con 0x7f36c809dd10 2020-06-12T17:51:00.393 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.386+0000 7f36cdeb8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c805f2b0 con 0x7f36c8146060 2020-06-12T17:51:00.393 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.386+0000 7f36cdeb8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c805fa40 con 0x7f36c80a2460 2020-06-12T17:51:00.393 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.387+0000 7f36c77fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36c80a2460 0x7f36c80a2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:00.394 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.387+0000 7f36c6ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f36c8146060 0x7f36c809d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:00.394 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.387+0000 7f36c7fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f36c809dd10 0x7f36c813fc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:33684/0 (socket says 172.21.15.38:33684) 2020-06-12T17:51:00.394 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.387+0000 7f36c7fff700 1 -- 172.21.15.38:0/3853481753 learned_addr learned my addr 172.21.15.38:0/3853481753 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:00.394 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.387+0000 7f36c6ffd700 1 -- 172.21.15.38:0/3853481753 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36c80a2460 msgr2=0x7f36c80a2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:00.394 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.387+0000 7f36c6ffd700 1 --2- 172.21.15.38:0/3853481753 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36c80a2460 0x7f36c80a2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:00.395 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.387+0000 7f36c6ffd700 1 -- 172.21.15.38:0/3853481753 >> v1:172.21.15.150:6789/0 conn(0x7f36c809dd10 legacy=0x7f36c813fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:00.395 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.387+0000 7f36c6ffd700 1 -- 172.21.15.38:0/3853481753 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c80b7bf0 con 0x7f36c8146060 2020-06-12T17:51:00.395 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.387+0000 7f36c6ffd700 1 --2- 172.21.15.38:0/3853481753 >> v2:172.21.15.150:3300/0 conn(0x7f36c8146060 0x7f36c809d8b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f36bc002f30 tx=0x7f36bc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.395 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.387+0000 7f36c6ffd700 1 --2- 172.21.15.38:0/3853481753 >> v2:172.21.15.150:3300/0 conn(0x7f36c8146060 0x7f36c809d8b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f36bc002f30 tx=0x7f36bc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.403 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.387+0000 7f36c6ffd700 1 --2- 172.21.15.38:0/3853481753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36c8146060 0x7f36c809d8b0 secure :-1 s=READY pgs=430 cs=0 l=1 rx=0x7f36bc002f30 tx=0x7f36bc007e60).ready entity=mon.1 client_cookie=b5898c715ca374b6 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:00.404 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.387+0000 7f36c6ffd700 1 --2- 172.21.15.38:0/3853481753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36c8146060 0x7f36c809d8b0 secure :-1 s=THROTTLE_DONE pgs=430 cs=0 l=1 rx=0x7f36bc002f30 tx=0x7f36bc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.404 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.387+0000 7f36c67fc700 1 -- 172.21.15.38:0/3853481753 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36bc011380 con 0x7f36c8146060 2020-06-12T17:51:00.404 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.387+0000 7f36c6ffd700 1 --2- 172.21.15.38:0/3853481753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36c8146060 0x7f36c809d8b0 secure :-1 s=THROTTLE_DONE pgs=430 cs=0 l=1 rx=0x7f36bc002f30 tx=0x7f36bc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.404 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.387+0000 7f36c6ffd700 1 --2- 172.21.15.38:0/3853481753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36c8146060 0x7f36c809d8b0 secure :-1 s=THROTTLE_DONE pgs=430 cs=0 l=1 rx=0x7f36bc002f30 tx=0x7f36bc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.405 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.387+0000 7f36c67fc700 1 -- 172.21.15.38:0/3853481753 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36bc0114e0 con 0x7f36c8146060 2020-06-12T17:51:00.405 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.387+0000 7f36c67fc700 1 -- 172.21.15.38:0/3853481753 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36bc011900 con 0x7f36c8146060 2020-06-12T17:51:00.405 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.387+0000 7f36cdeb8700 1 -- 172.21.15.38:0/3853481753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36c8146060 msgr2=0x7f36c809d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:00.405 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.387+0000 7f36cdeb8700 1 --2- 172.21.15.38:0/3853481753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36c8146060 0x7f36c809d8b0 secure :-1 s=READY pgs=430 cs=0 l=1 rx=0x7f36bc002f30 tx=0x7f36bc007e60).stop 2020-06-12T17:51:00.406 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.388+0000 7f36cdeb8700 1 -- 172.21.15.38:0/3853481753 shutdown_connections 2020-06-12T17:51:00.406 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.388+0000 7f36cdeb8700 1 --2- 172.21.15.38:0/3853481753 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36c80a2460 0x7f36c80a2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:00.406 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.388+0000 7f36cdeb8700 1 --2- 172.21.15.38:0/3853481753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36c8146060 0x7f36c809d8b0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:00.406 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.388+0000 7f36cdeb8700 1 -- 172.21.15.38:0/3853481753 >> 172.21.15.38:0/3853481753 conn(0x7f36c805b450 msgr2=0x7f36c805b860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:00.407 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.388+0000 7f36cdeb8700 1 -- 172.21.15.38:0/3853481753 shutdown_connections 2020-06-12T17:51:00.407 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.388+0000 7f36cdeb8700 1 -- 172.21.15.38:0/3853481753 wait complete. 2020-06-12T17:51:00.407 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.389+0000 7f36cdeb8700 1 Processor -- start 2020-06-12T17:51:00.407 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.389+0000 7f36cdeb8700 1 -- start start 2020-06-12T17:51:00.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.390+0000 7f36cdeb8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f36c809dd10 0x7f36c80b6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:00.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.390+0000 7f36cdeb8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36c80a2460 0x7f36c813fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:00.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.390+0000 7f36cdeb8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36c8140240 con 0x7f36c8146060 2020-06-12T17:51:00.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.390+0000 7f36cdeb8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c80b2e60 con 0x7f36c809dd10 2020-06-12T17:51:00.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.390+0000 7f36cdeb8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c80b3100 con 0x7f36c80a2460 2020-06-12T17:51:00.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.390+0000 7f36c77fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f36c809dd10 0x7f36c80b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:00.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.390+0000 7f36c6ffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36c80a2460 0x7f36c813fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:00.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.390+0000 7f36c7fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f36c8146060 0x7f36c8153790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:33690/0 (socket says 172.21.15.38:33690) 2020-06-12T17:51:00.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.390+0000 7f36c7fff700 1 -- 172.21.15.38:0/1032902239 learned_addr learned my addr 172.21.15.38:0/1032902239 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:00.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.390+0000 7f36c77fe700 1 -- 172.21.15.38:0/1032902239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36c80a2460 msgr2=0x7f36c813fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:00.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.390+0000 7f36c77fe700 1 --2- 172.21.15.38:0/1032902239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36c80a2460 0x7f36c813fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:00.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.390+0000 7f36c77fe700 1 -- 172.21.15.38:0/1032902239 >> v1:172.21.15.150:6789/0 conn(0x7f36c8146060 legacy=0x7f36c8153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:00.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.390+0000 7f36c4ff9700 1 -- 172.21.15.38:0/1032902239 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3061754720 0 0) 0x7f36c805f7a0 con 0x7f36c8146060 2020-06-12T17:51:00.435 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.390+0000 7f36c77fe700 1 -- 172.21.15.38:0/1032902239 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c80b3840 con 0x7f36c809dd10 2020-06-12T17:51:00.435 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.390+0000 7f36c77fe700 1 --2- 172.21.15.38:0/1032902239 >> v2:172.21.15.150:3300/0 conn(0x7f36c809dd10 0x7f36c80b6520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f36b8002f30 tx=0x7f36b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.435 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.390+0000 7f36c77fe700 1 --2- 172.21.15.38:0/1032902239 >> v2:172.21.15.150:3300/0 conn(0x7f36c809dd10 0x7f36c80b6520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f36b8002f30 tx=0x7f36b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.435 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.390+0000 7f36c77fe700 1 --2- 172.21.15.38:0/1032902239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36c809dd10 0x7f36c80b6520 secure :-1 s=READY pgs=432 cs=0 l=1 rx=0x7f36b8002f30 tx=0x7f36b8007e60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:00.435 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.390+0000 7f36c77fe700 1 --2- 172.21.15.38:0/1032902239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36c809dd10 0x7f36c80b6520 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7f36b8002f30 tx=0x7f36b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.390+0000 7f36c4ff9700 1 -- 172.21.15.38:0/1032902239 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36b8007530 con 0x7f36c809dd10 2020-06-12T17:51:00.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.390+0000 7f36c77fe700 1 --2- 172.21.15.38:0/1032902239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36c809dd10 0x7f36c80b6520 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7f36b8002f30 tx=0x7f36b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.390+0000 7f36c77fe700 1 --2- 172.21.15.38:0/1032902239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36c809dd10 0x7f36c80b6520 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7f36b8002f30 tx=0x7f36b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.390+0000 7f36c4ff9700 1 -- 172.21.15.38:0/1032902239 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b80056c0 con 0x7f36c809dd10 2020-06-12T17:51:00.436 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.390+0000 7f36cdeb8700 1 -- 172.21.15.38:0/1032902239 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c80b29c0 con 0x7f36c809dd10 2020-06-12T17:51:00.437 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.390+0000 7f36c4ff9700 1 -- 172.21.15.38:0/1032902239 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36b8005aa0 con 0x7f36c809dd10 2020-06-12T17:51:00.437 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.390+0000 7f36cdeb8700 1 -- 172.21.15.38:0/1032902239 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c8154060 con 0x7f36c809dd10 2020-06-12T17:51:00.437 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.391+0000 7f36c77fe700 1 --2- 172.21.15.38:0/1032902239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36c809dd10 0x7f36c80b6520 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7f36b8002f30 tx=0x7f36b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.437 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.392+0000 7f36cdeb8700 1 -- 172.21.15.38:0/1032902239 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c80b2cd0 con 0x7f36c809dd10 2020-06-12T17:51:00.440 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.392+0000 7f36c4ff9700 1 -- 172.21.15.38:0/1032902239 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f36b8005d20 con 0x7f36c809dd10 2020-06-12T17:51:00.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.392+0000 7f36c77fe700 1 --2- 172.21.15.38:0/1032902239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36c809dd10 0x7f36c80b6520 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7f36b8002f30 tx=0x7f36b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.392+0000 7f36c4ff9700 1 --2- 172.21.15.38:0/1032902239 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f36a804d530 0x7f36a804f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:00.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.392+0000 7f36c4ff9700 1 -- 172.21.15.38:0/1032902239 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f36b800d0c0 con 0x7f36c809dd10 2020-06-12T17:51:00.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.392+0000 7f36c6ffd700 1 --2- 172.21.15.38:0/1032902239 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f36a804d530 0x7f36a804f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:00.441 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.392+0000 7f36c6ffd700 1 --2- 172.21.15.38:0/1032902239 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f36a804d530 0x7f36a804f9f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f36bc002f30 tx=0x7f36bc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.393+0000 7f36c6ffd700 1 --2- 172.21.15.38:0/1032902239 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f36a804d530 0x7f36a804f9f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f36bc002f30 tx=0x7f36bc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.393+0000 7f36c6ffd700 1 --2- 172.21.15.38:0/1032902239 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f36a804d530 0x7f36a804f9f0 secure :-1 s=READY pgs=301 cs=0 l=1 rx=0x7f36bc002f30 tx=0x7f36bc007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:00.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.396+0000 7f36c77fe700 1 --2- 172.21.15.38:0/1032902239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36c809dd10 0x7f36c80b6520 secure :-1 s=THROTTLE_DONE pgs=432 cs=0 l=1 rx=0x7f36b8002f30 tx=0x7f36b8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.442 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.396+0000 7f36c4ff9700 1 -- 172.21.15.38:0/1032902239 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f36b803c760 con 0x7f36c809dd10 2020-06-12T17:51:00.598 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.595+0000 7f36cdeb8700 1 -- 172.21.15.38:0/1032902239 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_1797", "target": ["mon-mgr", ""]}) v1 -- 0x7f36c8056c30 con 0x7f36a804d530 2020-06-12T17:51:00.602 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.599+0000 7f36c6ffd700 1 --2- 172.21.15.38:0/1032902239 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f36a804d530 0x7f36a804f9f0 secure :-1 s=THROTTLE_DONE pgs=301 cs=0 l=1 rx=0x7f36bc002f30 tx=0x7f36bc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:00.602 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.599+0000 7f36c4ff9700 1 -- 172.21.15.38:0/1032902239 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f36c8056c30 con 0x7f36a804d530 2020-06-12T17:51:00.603 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_1797/2b2dc9ba-9ccd-4c56-82a9-827e40bac536 2020-06-12T17:51:00.604 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.600+0000 7f36cdeb8700 1 -- 172.21.15.38:0/1032902239 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f36a804d530 msgr2=0x7f36a804f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:00.605 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.600+0000 7f36cdeb8700 1 --2- 172.21.15.38:0/1032902239 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f36a804d530 0x7f36a804f9f0 secure :-1 s=READY pgs=301 cs=0 l=1 rx=0x7f36bc002f30 tx=0x7f36bc007e60).stop 2020-06-12T17:51:00.605 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.600+0000 7f36cdeb8700 1 -- 172.21.15.38:0/1032902239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36c809dd10 msgr2=0x7f36c80b6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:00.605 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.600+0000 7f36cdeb8700 1 --2- 172.21.15.38:0/1032902239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36c809dd10 0x7f36c80b6520 secure :-1 s=READY pgs=432 cs=0 l=1 rx=0x7f36b8002f30 tx=0x7f36b8007e60).stop 2020-06-12T17:51:00.605 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.600+0000 7f36cdeb8700 1 -- 172.21.15.38:0/1032902239 shutdown_connections 2020-06-12T17:51:00.605 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.600+0000 7f36cdeb8700 1 --2- 172.21.15.38:0/1032902239 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f36a804d530 0x7f36a804f9f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:00.606 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.600+0000 7f36cdeb8700 1 --2- 172.21.15.38:0/1032902239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36c809dd10 0x7f36c80b6520 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:00.606 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.600+0000 7f36cdeb8700 1 --2- 172.21.15.38:0/1032902239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36c80a2460 0x7f36c813fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:00.606 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.600+0000 7f36cdeb8700 1 -- 172.21.15.38:0/1032902239 >> 172.21.15.38:0/1032902239 conn(0x7f36c805b450 msgr2=0x7f36c8146a80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:00.606 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.601+0000 7f36cdeb8700 1 -- 172.21.15.38:0/1032902239 shutdown_connections 2020-06-12T17:51:00.606 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:00.601+0000 7f36cdeb8700 1 -- 172.21.15.38:0/1032902239 wait complete. 2020-06-12T17:51:00.614 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_1797 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_1797/2b2dc9ba-9ccd-4c56-82a9-827e40bac536 2020-06-12T17:51:00.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:00.615 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:00.616 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:00.633 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:00.633 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:00.634 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1797/2b2dc9ba-9ccd-4c56-82a9-827e40bac536/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:00.725 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:00.726 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:00.726 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101367 s, 103 MB/s 2020-06-12T17:51:00.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:00.727 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:00.727 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:00.742 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:00.743 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:00.744 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1797/2b2dc9ba-9ccd-4c56-82a9-827e40bac536/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:00.833 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:00.834 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:00.834 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112913 s, 92.9 MB/s 2020-06-12T17:51:00.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:00.836 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:00.836 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:00.851 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:00.852 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:00.852 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1797/2b2dc9ba-9ccd-4c56-82a9-827e40bac536/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:00.939 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:00.939 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:00.940 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011119 s, 94.3 MB/s 2020-06-12T17:51:00.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:00.941 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:00.942 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:00.957 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:00.957 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:00.958 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1797/2b2dc9ba-9ccd-4c56-82a9-827e40bac536/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:01.046 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:01.047 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:01.047 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103569 s, 101 MB/s 2020-06-12T17:51:01.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:01.049 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:01.049 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:01.065 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:01.065 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:01.066 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1797/2b2dc9ba-9ccd-4c56-82a9-827e40bac536/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:01.152 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:01.153 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:01.153 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104828 s, 100 MB/s 2020-06-12T17:51:01.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:01.155 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:01.156 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:01.172 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:01.173 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:01.173 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1797/2b2dc9ba-9ccd-4c56-82a9-827e40bac536/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:01.259 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:01.260 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:01.260 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107325 s, 97.7 MB/s 2020-06-12T17:51:01.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:01.263 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:01.264 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:01.281 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:01.281 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:01.282 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1797/2b2dc9ba-9ccd-4c56-82a9-827e40bac536/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:01.371 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:01.371 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:01.372 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100583 s, 104 MB/s 2020-06-12T17:51:01.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:01.374 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:01.375 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:01.391 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:01.392 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:01.393 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1797/2b2dc9ba-9ccd-4c56-82a9-827e40bac536/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:01.481 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:01.482 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:01.482 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131544 s, 79.7 MB/s 2020-06-12T17:51:01.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:01.484 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:01.484 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:01.499 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:01.499 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:01.500 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1797/2b2dc9ba-9ccd-4c56-82a9-827e40bac536/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:01.591 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:01.592 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:01.592 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114944 s, 91.2 MB/s 2020-06-12T17:51:01.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:01.593 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:01.594 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:01.609 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:01.609 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:01.610 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1797/2b2dc9ba-9ccd-4c56-82a9-827e40bac536/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:01.697 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:01.698 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:01.698 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112972 s, 92.8 MB/s 2020-06-12T17:51:01.700 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_7861 2020-06-12T17:51:01.818 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.815+0000 7fab3594d700 1 Processor -- start 2020-06-12T17:51:01.819 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.815+0000 7fab3594d700 1 -- start start 2020-06-12T17:51:01.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.816+0000 7fab3594d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fab3009df00 0x7fab3013c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:01.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.816+0000 7fab3594d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fab30142e90 0x7fab30066790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:01.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.816+0000 7fab3594d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab3009b960 con 0x7fab300b3ac0 2020-06-12T17:51:01.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.816+0000 7fab3594d700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab30143270 con 0x7fab3009df00 2020-06-12T17:51:01.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.816+0000 7fab3594d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab3009bc00 con 0x7fab30142e90 2020-06-12T17:51:01.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.816+0000 7fab2e7fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fab3009df00 0x7fab3013c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:01.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.816+0000 7fab2e7fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fab3009df00 0x7fab3013c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39378/0 (socket says 172.21.15.38:39378) 2020-06-12T17:51:01.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.816+0000 7fab2e7fc700 1 -- 172.21.15.38:0/2132469096 learned_addr learned my addr 172.21.15.38:0/2132469096 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:01.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.816+0000 7fab2f7fe700 1 --2- 172.21.15.38:0/2132469096 >> v2:172.21.15.150:3300/0 conn(0x7fab30142e90 0x7fab30066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:01.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.816+0000 7fab2e7fc700 1 -- 172.21.15.38:0/2132469096 >> v2:172.21.15.150:3300/0 conn(0x7fab30142e90 msgr2=0x7fab30066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:01.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.816+0000 7fab2e7fc700 1 --2- 172.21.15.38:0/2132469096 >> v2:172.21.15.150:3300/0 conn(0x7fab30142e90 0x7fab30066790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:01.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.816+0000 7fab2e7fc700 1 -- 172.21.15.38:0/2132469096 >> v1:172.21.15.150:6789/0 conn(0x7fab300b3ac0 legacy=0x7fab3013bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:01.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.816+0000 7fab2e7fc700 1 -- 172.21.15.38:0/2132469096 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab300b48f0 con 0x7fab3009df00 2020-06-12T17:51:01.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.816+0000 7fab2e7fc700 1 --2- 172.21.15.38:0/2132469096 >> v2:172.21.15.38:3300/0 conn(0x7fab3009df00 0x7fab3013c650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fab3013cb40 tx=0x7fab20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:01.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.816+0000 7fab2e7fc700 1 --2- 172.21.15.38:0/2132469096 >> v2:172.21.15.38:3300/0 conn(0x7fab3009df00 0x7fab3013c650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fab3013cb40 tx=0x7fab20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:01.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.816+0000 7fab2e7fc700 1 --2- 172.21.15.38:0/2132469096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab3009df00 0x7fab3013c650 secure :-1 s=READY pgs=775 cs=0 l=1 rx=0x7fab3013cb40 tx=0x7fab20007e60).ready entity=mon.0 client_cookie=bb030d331ea5f868 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:01.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.816+0000 7fab2e7fc700 1 --2- 172.21.15.38:0/2132469096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab3009df00 0x7fab3013c650 secure :-1 s=THROTTLE_DONE pgs=775 cs=0 l=1 rx=0x7fab3013cb40 tx=0x7fab20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:01.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.816+0000 7fab2e7fc700 1 --2- 172.21.15.38:0/2132469096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab3009df00 0x7fab3013c650 secure :-1 s=THROTTLE_DONE pgs=775 cs=0 l=1 rx=0x7fab3013cb40 tx=0x7fab20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:01.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.816+0000 7fab2dffb700 1 -- 172.21.15.38:0/2132469096 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab200116e0 con 0x7fab3009df00 2020-06-12T17:51:01.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.817+0000 7fab2e7fc700 1 --2- 172.21.15.38:0/2132469096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab3009df00 0x7fab3013c650 secure :-1 s=THROTTLE_DONE pgs=775 cs=0 l=1 rx=0x7fab3013cb40 tx=0x7fab20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:01.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.817+0000 7fab2dffb700 1 -- 172.21.15.38:0/2132469096 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab20011840 con 0x7fab3009df00 2020-06-12T17:51:01.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.817+0000 7fab2dffb700 1 -- 172.21.15.38:0/2132469096 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab20011c20 con 0x7fab3009df00 2020-06-12T17:51:01.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.817+0000 7fab3594d700 1 -- 172.21.15.38:0/2132469096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab3009df00 msgr2=0x7fab3013c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:01.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.817+0000 7fab3594d700 1 --2- 172.21.15.38:0/2132469096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab3009df00 0x7fab3013c650 secure :-1 s=READY pgs=775 cs=0 l=1 rx=0x7fab3013cb40 tx=0x7fab20007e60).stop 2020-06-12T17:51:01.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.817+0000 7fab3594d700 1 -- 172.21.15.38:0/2132469096 shutdown_connections 2020-06-12T17:51:01.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.817+0000 7fab3594d700 1 --2- 172.21.15.38:0/2132469096 >> v2:172.21.15.150:3300/0 conn(0x7fab30142e90 0x7fab30066790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:01.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.817+0000 7fab3594d700 1 --2- 172.21.15.38:0/2132469096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab3009df00 0x7fab3013c650 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:01.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.817+0000 7fab3594d700 1 -- 172.21.15.38:0/2132469096 >> 172.21.15.38:0/2132469096 conn(0x7fab300b5a20 msgr2=0x7fab3005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:01.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.817+0000 7fab3594d700 1 -- 172.21.15.38:0/2132469096 shutdown_connections 2020-06-12T17:51:01.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.817+0000 7fab3594d700 1 -- 172.21.15.38:0/2132469096 wait complete. 2020-06-12T17:51:01.830 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.818+0000 7fab3594d700 1 Processor -- start 2020-06-12T17:51:01.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.818+0000 7fab3594d700 1 -- start start 2020-06-12T17:51:01.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.819+0000 7fab3594d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fab3009df00 0x7fab30146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:01.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.819+0000 7fab3594d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab300b3ac0 0x7fab3013c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:01.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.819+0000 7fab3594d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab30145e70 con 0x7fab30142e90 2020-06-12T17:51:01.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.819+0000 7fab3594d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab30145c60 con 0x7fab3009df00 2020-06-12T17:51:01.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.819+0000 7fab3594d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab300af950 con 0x7fab300b3ac0 2020-06-12T17:51:01.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.819+0000 7fab2effd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fab3009df00 0x7fab30146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:01.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.819+0000 7fab2e7fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab300b3ac0 0x7fab3013c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:01.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.819+0000 7fab2f7fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fab30142e90 0x7fab30144380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:33704/0 (socket says 172.21.15.38:33704) 2020-06-12T17:51:01.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.819+0000 7fab2f7fe700 1 -- 172.21.15.38:0/3957427112 learned_addr learned my addr 172.21.15.38:0/3957427112 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:01.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.820+0000 7fab2e7fc700 1 -- 172.21.15.38:0/3957427112 >> v2:172.21.15.150:3300/0 conn(0x7fab3009df00 msgr2=0x7fab30146190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:01.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.820+0000 7fab2e7fc700 1 --2- 172.21.15.38:0/3957427112 >> v2:172.21.15.150:3300/0 conn(0x7fab3009df00 0x7fab30146190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:01.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.820+0000 7fab2e7fc700 1 -- 172.21.15.38:0/3957427112 >> v1:172.21.15.150:6789/0 conn(0x7fab30142e90 legacy=0x7fab30144380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:01.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.820+0000 7fab2e7fc700 1 -- 172.21.15.38:0/3957427112 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab300afdf0 con 0x7fab300b3ac0 2020-06-12T17:51:01.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.820+0000 7fab2effd700 1 --2- 172.21.15.38:0/3957427112 >> v2:172.21.15.150:3300/0 conn(0x7fab3009df00 0x7fab30146190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:51:01.834 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.820+0000 7fab2e7fc700 1 --2- 172.21.15.38:0/3957427112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab300b3ac0 0x7fab3013c020 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fab3013cb40 tx=0x7fab20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:01.834 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.820+0000 7fab2e7fc700 1 --2- 172.21.15.38:0/3957427112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab300b3ac0 0x7fab3013c020 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fab3013cb40 tx=0x7fab20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:01.834 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.820+0000 7fab2e7fc700 1 --2- 172.21.15.38:0/3957427112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab300b3ac0 0x7fab3013c020 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7fab3013cb40 tx=0x7fab20007e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:01.834 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.820+0000 7fab2e7fc700 1 --2- 172.21.15.38:0/3957427112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab300b3ac0 0x7fab3013c020 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fab3013cb40 tx=0x7fab20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:01.834 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.820+0000 7fab1ffff700 1 -- 172.21.15.38:0/3957427112 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab200058b0 con 0x7fab300b3ac0 2020-06-12T17:51:01.835 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.820+0000 7fab2e7fc700 1 --2- 172.21.15.38:0/3957427112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab300b3ac0 0x7fab3013c020 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fab3013cb40 tx=0x7fab20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:01.835 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.820+0000 7fab1ffff700 1 -- 172.21.15.38:0/3957427112 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab20005a10 con 0x7fab300b3ac0 2020-06-12T17:51:01.835 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.820+0000 7fab2e7fc700 1 --2- 172.21.15.38:0/3957427112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab300b3ac0 0x7fab3013c020 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fab3013cb40 tx=0x7fab20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:01.835 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.820+0000 7fab3594d700 1 -- 172.21.15.38:0/3957427112 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab300671d0 con 0x7fab300b3ac0 2020-06-12T17:51:01.835 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.820+0000 7fab1ffff700 1 -- 172.21.15.38:0/3957427112 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab20005db0 con 0x7fab300b3ac0 2020-06-12T17:51:01.835 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.820+0000 7fab3594d700 1 -- 172.21.15.38:0/3957427112 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab30140e80 con 0x7fab300b3ac0 2020-06-12T17:51:01.836 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.821+0000 7fab2e7fc700 1 --2- 172.21.15.38:0/3957427112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab300b3ac0 0x7fab3013c020 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fab3013cb40 tx=0x7fab20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:01.836 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.821+0000 7fab3594d700 1 -- 172.21.15.38:0/3957427112 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab30056c30 con 0x7fab300b3ac0 2020-06-12T17:51:01.836 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.821+0000 7fab1ffff700 1 -- 172.21.15.38:0/3957427112 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fab20015250 con 0x7fab300b3ac0 2020-06-12T17:51:01.836 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.821+0000 7fab2e7fc700 1 --2- 172.21.15.38:0/3957427112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab300b3ac0 0x7fab3013c020 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fab3013cb40 tx=0x7fab20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:01.836 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.821+0000 7fab1ffff700 1 --2- 172.21.15.38:0/3957427112 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fab0c04d580 0x7fab0c04fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:01.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.821+0000 7fab1ffff700 1 -- 172.21.15.38:0/3957427112 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fab200611a0 con 0x7fab300b3ac0 2020-06-12T17:51:01.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.822+0000 7fab2effd700 1 --2- 172.21.15.38:0/3957427112 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fab0c04d580 0x7fab0c04fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:01.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.822+0000 7fab2effd700 1 --2- 172.21.15.38:0/3957427112 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fab0c04d580 0x7fab0c04fa40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fab30061380 tx=0x7fab24001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:01.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.822+0000 7fab2effd700 1 --2- 172.21.15.38:0/3957427112 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fab0c04d580 0x7fab0c04fa40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fab30061380 tx=0x7fab24001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:01.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.822+0000 7fab2effd700 1 --2- 172.21.15.38:0/3957427112 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fab0c04d580 0x7fab0c04fa40 secure :-1 s=READY pgs=302 cs=0 l=1 rx=0x7fab30061380 tx=0x7fab24001760).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:01.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.825+0000 7fab2e7fc700 1 --2- 172.21.15.38:0/3957427112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab300b3ac0 0x7fab3013c020 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fab3013cb40 tx=0x7fab20007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:01.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:01.825+0000 7fab1ffff700 1 -- 172.21.15.38:0/3957427112 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fab2003c960 con 0x7fab300b3ac0 2020-06-12T17:51:02.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.018+0000 7fab3594d700 1 -- 172.21.15.38:0/3957427112 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_7861", "target": ["mon-mgr", ""]}) v1 -- 0x7fab30146000 con 0x7fab0c04d580 2020-06-12T17:51:02.041 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.038+0000 7fab2effd700 1 --2- 172.21.15.38:0/3957427112 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fab0c04d580 0x7fab0c04fa40 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7fab30061380 tx=0x7fab24001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:02.042 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.038+0000 7fab1ffff700 1 -- 172.21.15.38:0/3957427112 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fab30146000 con 0x7fab0c04d580 2020-06-12T17:51:02.043 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.039+0000 7fab3594d700 1 -- 172.21.15.38:0/3957427112 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fab0c04d580 msgr2=0x7fab0c04fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:02.044 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.039+0000 7fab3594d700 1 --2- 172.21.15.38:0/3957427112 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fab0c04d580 0x7fab0c04fa40 secure :-1 s=READY pgs=302 cs=0 l=1 rx=0x7fab30061380 tx=0x7fab24001760).stop 2020-06-12T17:51:02.044 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.039+0000 7fab3594d700 1 -- 172.21.15.38:0/3957427112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab300b3ac0 msgr2=0x7fab3013c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:02.044 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.039+0000 7fab3594d700 1 --2- 172.21.15.38:0/3957427112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab300b3ac0 0x7fab3013c020 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7fab3013cb40 tx=0x7fab20007e60).stop 2020-06-12T17:51:02.044 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.040+0000 7fab3594d700 1 -- 172.21.15.38:0/3957427112 shutdown_connections 2020-06-12T17:51:02.044 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.040+0000 7fab3594d700 1 --2- 172.21.15.38:0/3957427112 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fab0c04d580 0x7fab0c04fa40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:02.045 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.040+0000 7fab3594d700 1 --2- 172.21.15.38:0/3957427112 >> v2:172.21.15.150:3300/0 conn(0x7fab3009df00 0x7fab30146190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:02.045 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.040+0000 7fab3594d700 1 --2- 172.21.15.38:0/3957427112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab300b3ac0 0x7fab3013c020 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:02.045 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.040+0000 7fab3594d700 1 -- 172.21.15.38:0/3957427112 >> 172.21.15.38:0/3957427112 conn(0x7fab300b5a20 msgr2=0x7fab300b64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:02.045 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.040+0000 7fab3594d700 1 -- 172.21.15.38:0/3957427112 shutdown_connections 2020-06-12T17:51:02.046 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.040+0000 7fab3594d700 1 -- 172.21.15.38:0/3957427112 wait complete. 2020-06-12T17:51:02.053 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_7861 2020-06-12T17:51:02.171 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.167+0000 7f7004810700 1 Processor -- start 2020-06-12T17:51:02.172 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.167+0000 7f7004810700 1 -- start start 2020-06-12T17:51:02.177 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.168+0000 7f7004810700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f70000b4130 0x7f7000142420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:02.178 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.168+0000 7f7004810700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7000142880 0x7f700014c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:02.178 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.168+0000 7f7004810700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7000066da0 con 0x7f70000afb40 2020-06-12T17:51:02.178 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.168+0000 7f7004810700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7000142ca0 con 0x7f70000b4130 2020-06-12T17:51:02.178 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.168+0000 7f7004810700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70000b0270 con 0x7f7000142880 2020-06-12T17:51:02.178 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.168+0000 7f6ffeffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f70000b4130 0x7f7000142420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:02.179 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.168+0000 7f6fff7fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f70000afb40 0x7f700005b420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41208/0 (socket says 172.21.15.38:41208) 2020-06-12T17:51:02.179 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.168+0000 7f6fff7fe700 1 -- 172.21.15.38:0/2670670151 learned_addr learned my addr 172.21.15.38:0/2670670151 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:02.179 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.169+0000 7f6ffeffd700 1 -- 172.21.15.38:0/2670670151 >> v2:172.21.15.150:3300/0 conn(0x7f7000142880 msgr2=0x7f700014c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:02.180 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.169+0000 7f6ffffff700 1 --2- 172.21.15.38:0/2670670151 >> v2:172.21.15.150:3300/0 conn(0x7f7000142880 0x7f700014c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:02.180 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.169+0000 7f6ffeffd700 1 --2- 172.21.15.38:0/2670670151 >> v2:172.21.15.150:3300/0 conn(0x7f7000142880 0x7f700014c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:02.180 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.169+0000 7f6ffe7fc700 1 -- 172.21.15.38:0/2670670151 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2058416621 0 0) 0x7f7000066da0 con 0x7f70000afb40 2020-06-12T17:51:02.180 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.169+0000 7f6ffeffd700 1 -- 172.21.15.38:0/2670670151 >> v1:172.21.15.38:6789/0 conn(0x7f70000afb40 legacy=0x7f700005b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:02.180 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.169+0000 7f6ffeffd700 1 -- 172.21.15.38:0/2670670151 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7000145b70 con 0x7f70000b4130 2020-06-12T17:51:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.169+0000 7f6ffeffd700 1 --2- 172.21.15.38:0/2670670151 >> v2:172.21.15.38:3300/0 conn(0x7f70000b4130 0x7f7000142420 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6ff4002f30 tx=0x7f6ff4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.169+0000 7f6ffeffd700 1 --2- 172.21.15.38:0/2670670151 >> v2:172.21.15.38:3300/0 conn(0x7f70000b4130 0x7f7000142420 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6ff4002f30 tx=0x7f6ff4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.169+0000 7f6ffeffd700 1 --2- 172.21.15.38:0/2670670151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70000b4130 0x7f7000142420 secure :-1 s=READY pgs=777 cs=0 l=1 rx=0x7f6ff4002f30 tx=0x7f6ff4007e60).ready entity=mon.0 client_cookie=9a2e4e9e43a03f03 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.169+0000 7f6ffeffd700 1 --2- 172.21.15.38:0/2670670151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70000b4130 0x7f7000142420 secure :-1 s=THROTTLE_DONE pgs=777 cs=0 l=1 rx=0x7f6ff4002f30 tx=0x7f6ff4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.169+0000 7f6ffe7fc700 1 -- 172.21.15.38:0/2670670151 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ff4011430 con 0x7f70000b4130 2020-06-12T17:51:02.182 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.169+0000 7f6ffeffd700 1 --2- 172.21.15.38:0/2670670151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70000b4130 0x7f7000142420 secure :-1 s=THROTTLE_DONE pgs=777 cs=0 l=1 rx=0x7f6ff4002f30 tx=0x7f6ff4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:02.182 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.169+0000 7f6ffeffd700 1 --2- 172.21.15.38:0/2670670151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70000b4130 0x7f7000142420 secure :-1 s=THROTTLE_DONE pgs=777 cs=0 l=1 rx=0x7f6ff4002f30 tx=0x7f6ff4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:02.182 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.169+0000 7f6ffe7fc700 1 -- 172.21.15.38:0/2670670151 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff4011590 con 0x7f70000b4130 2020-06-12T17:51:02.182 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.169+0000 7f6ffe7fc700 1 -- 172.21.15.38:0/2670670151 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ff4011930 con 0x7f70000b4130 2020-06-12T17:51:02.182 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.169+0000 7f7004810700 1 -- 172.21.15.38:0/2670670151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70000b4130 msgr2=0x7f7000142420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:02.183 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.169+0000 7f7004810700 1 --2- 172.21.15.38:0/2670670151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70000b4130 0x7f7000142420 secure :-1 s=READY pgs=777 cs=0 l=1 rx=0x7f6ff4002f30 tx=0x7f6ff4007e60).stop 2020-06-12T17:51:02.183 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.169+0000 7f7004810700 1 -- 172.21.15.38:0/2670670151 shutdown_connections 2020-06-12T17:51:02.183 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.169+0000 7f7004810700 1 --2- 172.21.15.38:0/2670670151 >> v2:172.21.15.150:3300/0 conn(0x7f7000142880 0x7f700014c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:02.183 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.169+0000 7f7004810700 1 --2- 172.21.15.38:0/2670670151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70000b4130 0x7f7000142420 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:02.183 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.169+0000 7f7004810700 1 -- 172.21.15.38:0/2670670151 >> 172.21.15.38:0/2670670151 conn(0x7f70000b4cc0 msgr2=0x7f70000b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:02.184 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.169+0000 7f7004810700 1 -- 172.21.15.38:0/2670670151 shutdown_connections 2020-06-12T17:51:02.184 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.169+0000 7f7004810700 1 -- 172.21.15.38:0/2670670151 wait complete. 2020-06-12T17:51:02.184 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.170+0000 7f7004810700 1 Processor -- start 2020-06-12T17:51:02.184 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.171+0000 7f7004810700 1 -- start start 2020-06-12T17:51:02.184 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.171+0000 7f7004810700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f70000afb40 0x7f70001349a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:02.185 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.171+0000 7f7004810700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f70000b4130 0x7f70000b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:02.185 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.171+0000 7f7004810700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7000142880 0x7f7000136e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:02.185 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.171+0000 7f7004810700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70000b7840 con 0x7f70000afb40 2020-06-12T17:51:02.185 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.171+0000 7f7004810700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7000135960 con 0x7f70000b4130 2020-06-12T17:51:02.185 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.171+0000 7f7004810700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7000135c00 con 0x7f7000142880 2020-06-12T17:51:02.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.171+0000 7f6fff7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f70000afb40 0x7f70001349a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:02.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.171+0000 7f6fff7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f70000afb40 0x7f70001349a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39398/0 (socket says 172.21.15.38:39398) 2020-06-12T17:51:02.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.171+0000 7f6fff7fe700 1 -- 172.21.15.38:0/1409172487 learned_addr learned my addr 172.21.15.38:0/1409172487 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:02.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.172+0000 7f6ffeffd700 1 --2- 172.21.15.38:0/1409172487 >> v2:172.21.15.150:3300/0 conn(0x7f70000b4130 0x7f70000b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:02.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.172+0000 7f6ffffff700 1 --2- 172.21.15.38:0/1409172487 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7000142880 0x7f7000136e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:02.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.172+0000 7f6fff7fe700 1 -- 172.21.15.38:0/1409172487 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7000142880 msgr2=0x7f7000136e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:02.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.172+0000 7f6fff7fe700 1 --2- 172.21.15.38:0/1409172487 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7000142880 0x7f7000136e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:02.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.172+0000 7f6fff7fe700 1 -- 172.21.15.38:0/1409172487 >> v2:172.21.15.150:3300/0 conn(0x7f70000b4130 msgr2=0x7f70000b8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:02.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.172+0000 7f6fff7fe700 1 --2- 172.21.15.38:0/1409172487 >> v2:172.21.15.150:3300/0 conn(0x7f70000b4130 0x7f70000b8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:02.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.172+0000 7f6fff7fe700 1 -- 172.21.15.38:0/1409172487 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70001372a0 con 0x7f70000afb40 2020-06-12T17:51:02.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.172+0000 7f6fff7fe700 1 --2- 172.21.15.38:0/1409172487 >> v2:172.21.15.38:3300/0 conn(0x7f70000afb40 0x7f70001349a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ff0000b80 tx=0x7f6ff00016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:02.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.172+0000 7f6fff7fe700 1 --2- 172.21.15.38:0/1409172487 >> v2:172.21.15.38:3300/0 conn(0x7f70000afb40 0x7f70001349a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ff0000b80 tx=0x7f6ff00016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:02.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.172+0000 7f6fff7fe700 1 --2- 172.21.15.38:0/1409172487 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70000afb40 0x7f70001349a0 secure :-1 s=READY pgs=778 cs=0 l=1 rx=0x7f6ff0000b80 tx=0x7f6ff00016e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:02.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.172+0000 7f6fff7fe700 1 --2- 172.21.15.38:0/1409172487 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70000afb40 0x7f70001349a0 secure :-1 s=THROTTLE_DONE pgs=778 cs=0 l=1 rx=0x7f6ff0000b80 tx=0x7f6ff00016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:02.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.172+0000 7f6fff7fe700 1 --2- 172.21.15.38:0/1409172487 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70000afb40 0x7f70001349a0 secure :-1 s=THROTTLE_DONE pgs=778 cs=0 l=1 rx=0x7f6ff0000b80 tx=0x7f6ff00016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:02.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.172+0000 7f6ffcff9700 1 -- 172.21.15.38:0/1409172487 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ff0005ca0 con 0x7f70000afb40 2020-06-12T17:51:02.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.172+0000 7f6fff7fe700 1 --2- 172.21.15.38:0/1409172487 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70000afb40 0x7f70001349a0 secure :-1 s=THROTTLE_DONE pgs=778 cs=0 l=1 rx=0x7f6ff0000b80 tx=0x7f6ff00016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:02.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.172+0000 7f6ffcff9700 1 -- 172.21.15.38:0/1409172487 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff0005e00 con 0x7f70000afb40 2020-06-12T17:51:02.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.172+0000 7f6ffcff9700 1 -- 172.21.15.38:0/1409172487 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ff00062b0 con 0x7f70000afb40 2020-06-12T17:51:02.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.172+0000 7f7004810700 1 -- 172.21.15.38:0/1409172487 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7000132a10 con 0x7f70000afb40 2020-06-12T17:51:02.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.172+0000 7f7004810700 1 -- 172.21.15.38:0/1409172487 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7000132ee0 con 0x7f70000afb40 2020-06-12T17:51:02.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.173+0000 7f6fff7fe700 1 --2- 172.21.15.38:0/1409172487 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70000afb40 0x7f70001349a0 secure :-1 s=THROTTLE_DONE pgs=778 cs=0 l=1 rx=0x7f6ff0000b80 tx=0x7f6ff00016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:02.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.173+0000 7f7004810700 1 -- 172.21.15.38:0/1409172487 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7000056c30 con 0x7f70000afb40 2020-06-12T17:51:02.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.173+0000 7f6ffcff9700 1 -- 172.21.15.38:0/1409172487 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f6ff0006520 con 0x7f70000afb40 2020-06-12T17:51:02.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.173+0000 7f6fff7fe700 1 --2- 172.21.15.38:0/1409172487 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70000afb40 0x7f70001349a0 secure :-1 s=THROTTLE_DONE pgs=778 cs=0 l=1 rx=0x7f6ff0000b80 tx=0x7f6ff00016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:02.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.173+0000 7f6ffcff9700 1 --2- 172.21.15.38:0/1409172487 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6fe004d490 0x7f6fe004f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:02.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.173+0000 7f6ffcff9700 1 -- 172.21.15.38:0/1409172487 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f6ff0060f10 con 0x7f70000afb40 2020-06-12T17:51:02.192 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.174+0000 7f6ffeffd700 1 --2- 172.21.15.38:0/1409172487 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6fe004d490 0x7f6fe004f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:02.192 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.174+0000 7f6ffeffd700 1 --2- 172.21.15.38:0/1409172487 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6fe004d490 0x7f6fe004f950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6ff4002f30 tx=0x7f6ff4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:02.192 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.174+0000 7f6ffeffd700 1 --2- 172.21.15.38:0/1409172487 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6fe004d490 0x7f6fe004f950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6ff4002f30 tx=0x7f6ff4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:02.192 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.174+0000 7f6ffeffd700 1 --2- 172.21.15.38:0/1409172487 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6fe004d490 0x7f6fe004f950 secure :-1 s=READY pgs=303 cs=0 l=1 rx=0x7f6ff4002f30 tx=0x7f6ff4007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:02.193 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.177+0000 7f6fff7fe700 1 --2- 172.21.15.38:0/1409172487 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70000afb40 0x7f70001349a0 secure :-1 s=THROTTLE_DONE pgs=778 cs=0 l=1 rx=0x7f6ff0000b80 tx=0x7f6ff00016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:02.193 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.177+0000 7f6ffcff9700 1 -- 172.21.15.38:0/1409172487 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f6ff003c690 con 0x7f70000afb40 2020-06-12T17:51:02.379 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.376+0000 7f7004810700 1 -- 172.21.15.38:0/1409172487 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_7861", "target": ["mon-mgr", ""]}) v1 -- 0x7f7000135d70 con 0x7f6fe004d490 2020-06-12T17:51:02.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.380+0000 7f6ffeffd700 1 --2- 172.21.15.38:0/1409172487 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6fe004d490 0x7f6fe004f950 secure :-1 s=THROTTLE_DONE pgs=303 cs=0 l=1 rx=0x7f6ff4002f30 tx=0x7f6ff4007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:02.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.380+0000 7f6ffcff9700 1 -- 172.21.15.38:0/1409172487 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f7000135d70 con 0x7f6fe004d490 2020-06-12T17:51:02.384 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_7861/e7626b4e-d81c-4a08-9eab-11776e28e709 2020-06-12T17:51:02.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.381+0000 7f7004810700 1 -- 172.21.15.38:0/1409172487 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6fe004d490 msgr2=0x7f6fe004f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:02.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.381+0000 7f7004810700 1 --2- 172.21.15.38:0/1409172487 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6fe004d490 0x7f6fe004f950 secure :-1 s=READY pgs=303 cs=0 l=1 rx=0x7f6ff4002f30 tx=0x7f6ff4007e60).stop 2020-06-12T17:51:02.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.381+0000 7f7004810700 1 -- 172.21.15.38:0/1409172487 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70000afb40 msgr2=0x7f70001349a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:02.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.381+0000 7f7004810700 1 --2- 172.21.15.38:0/1409172487 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70000afb40 0x7f70001349a0 secure :-1 s=READY pgs=778 cs=0 l=1 rx=0x7f6ff0000b80 tx=0x7f6ff00016e0).stop 2020-06-12T17:51:02.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.381+0000 7f7004810700 1 -- 172.21.15.38:0/1409172487 shutdown_connections 2020-06-12T17:51:02.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.381+0000 7f7004810700 1 --2- 172.21.15.38:0/1409172487 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f6fe004d490 0x7f6fe004f950 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:02.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.381+0000 7f7004810700 1 --2- 172.21.15.38:0/1409172487 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70000afb40 0x7f70001349a0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:02.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.381+0000 7f7004810700 1 --2- 172.21.15.38:0/1409172487 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7000142880 0x7f7000136e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:02.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.381+0000 7f7004810700 1 --2- 172.21.15.38:0/1409172487 >> v2:172.21.15.150:3300/0 conn(0x7f70000b4130 0x7f70000b8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:02.387 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.381+0000 7f7004810700 1 -- 172.21.15.38:0/1409172487 >> 172.21.15.38:0/1409172487 conn(0x7f70000b4cc0 msgr2=0x7f70000b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:02.387 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.381+0000 7f7004810700 1 -- 172.21.15.38:0/1409172487 shutdown_connections 2020-06-12T17:51:02.387 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:02.381+0000 7f7004810700 1 -- 172.21.15.38:0/1409172487 wait complete. 2020-06-12T17:51:02.394 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_7861 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_7861/e7626b4e-d81c-4a08-9eab-11776e28e709 2020-06-12T17:51:02.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:02.396 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:02.396 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:02.411 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:02.412 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:02.412 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7861/e7626b4e-d81c-4a08-9eab-11776e28e709/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:02.501 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:02.502 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:02.502 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107455 s, 97.6 MB/s 2020-06-12T17:51:02.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:02.503 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:02.504 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:02.519 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:02.519 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:02.520 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7861/e7626b4e-d81c-4a08-9eab-11776e28e709/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:02.606 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:02.606 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:02.606 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104782 s, 100 MB/s 2020-06-12T17:51:02.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:02.608 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:02.608 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:02.623 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:02.632 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:02.633 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7861/e7626b4e-d81c-4a08-9eab-11776e28e709/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:02.711 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:02.711 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:02.711 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108806 s, 96.4 MB/s 2020-06-12T17:51:02.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:02.713 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:02.713 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:02.736 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:02.736 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:02.737 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7861/e7626b4e-d81c-4a08-9eab-11776e28e709/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:02.827 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:02.828 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:02.828 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130091 s, 80.6 MB/s 2020-06-12T17:51:02.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:02.830 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:02.830 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:02.845 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:02.846 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:02.847 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7861/e7626b4e-d81c-4a08-9eab-11776e28e709/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:02.935 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:02.936 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:02.936 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113212 s, 92.6 MB/s 2020-06-12T17:51:02.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:02.937 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:02.938 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:02.956 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:02.957 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:02.957 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7861/e7626b4e-d81c-4a08-9eab-11776e28e709/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:03.056 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:03.056 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:03.057 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129051 s, 81.3 MB/s 2020-06-12T17:51:03.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:03.058 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:03.058 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:03.074 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:03.075 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:03.076 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7861/e7626b4e-d81c-4a08-9eab-11776e28e709/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:03.168 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:03.168 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:03.169 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114539 s, 91.5 MB/s 2020-06-12T17:51:03.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:03.170 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:03.170 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:03.223 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:03.224 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:03.224 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7861/e7626b4e-d81c-4a08-9eab-11776e28e709/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:03.317 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:03.390 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:03.390 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012925 s, 81.1 MB/s 2020-06-12T17:51:03.392 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:03.392 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:03.394 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:03.430 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:03.431 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:03.431 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7861/e7626b4e-d81c-4a08-9eab-11776e28e709/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:03.533 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:03.533 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:03.533 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118396 s, 88.6 MB/s 2020-06-12T17:51:03.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:03.535 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:03.539 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:03.557 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:03.557 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:03.558 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7861/e7626b4e-d81c-4a08-9eab-11776e28e709/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:03.652 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:03.652 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:03.653 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110829 s, 94.6 MB/s 2020-06-12T17:51:03.657 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_1951 2020-06-12T17:51:03.807 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.803+0000 7fe272bf2700 1 Processor -- start 2020-06-12T17:51:03.807 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.803+0000 7fe272bf2700 1 -- start start 2020-06-12T17:51:03.812 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.804+0000 7fe272bf2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe26c0b11e0 0x7fe26c0b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:03.812 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.804+0000 7fe272bf2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe26c0afc20 0x7fe26c0b0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:03.812 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.804+0000 7fe272bf2700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe26c0b2900 con 0x7fe26c0b2380 2020-06-12T17:51:03.813 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.804+0000 7fe272bf2700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe26c0ae7d0 con 0x7fe26c0afc20 2020-06-12T17:51:03.813 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.804+0000 7fe272bf2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe26c0b1ad0 con 0x7fe26c0b11e0 2020-06-12T17:51:03.814 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.804+0000 7fe2723f1700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe26c0afc20 0x7fe26c0b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:03.814 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.804+0000 7fe2723f1700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe26c0afc20 0x7fe26c0b0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39406/0 (socket says 172.21.15.38:39406) 2020-06-12T17:51:03.814 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.804+0000 7fe2723f1700 1 -- 172.21.15.38:0/3766599417 learned_addr learned my addr 172.21.15.38:0/3766599417 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:03.815 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.804+0000 7fe2713ef700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe26c0b2380 0x7fe26c0ae0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41222/0 (socket says 172.21.15.38:41222) 2020-06-12T17:51:03.815 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.805+0000 7fe2723f1700 1 -- 172.21.15.38:0/3766599417 >> v2:172.21.15.150:3300/0 conn(0x7fe26c0b11e0 msgr2=0x7fe26c0b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:03.815 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.805+0000 7fe271bf0700 1 --2- 172.21.15.38:0/3766599417 >> v2:172.21.15.150:3300/0 conn(0x7fe26c0b11e0 0x7fe26c0b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:03.816 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.805+0000 7fe2723f1700 1 --2- 172.21.15.38:0/3766599417 >> v2:172.21.15.150:3300/0 conn(0x7fe26c0b11e0 0x7fe26c0b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:03.817 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.805+0000 7fe2723f1700 1 -- 172.21.15.38:0/3766599417 >> v1:172.21.15.38:6789/0 conn(0x7fe26c0b2380 legacy=0x7fe26c0ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:03.817 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.805+0000 7fe270bee700 1 -- 172.21.15.38:0/3766599417 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436832161 0 0) 0x7fe26c0b2900 con 0x7fe26c0b2380 2020-06-12T17:51:03.817 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.805+0000 7fe2723f1700 1 -- 172.21.15.38:0/3766599417 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26c0b1d70 con 0x7fe26c0afc20 2020-06-12T17:51:03.817 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.805+0000 7fe271bf0700 1 --2- 172.21.15.38:0/3766599417 >> v2:172.21.15.150:3300/0 conn(0x7fe26c0b11e0 0x7fe26c0b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:51:03.817 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.805+0000 7fe2723f1700 1 --2- 172.21.15.38:0/3766599417 >> v2:172.21.15.38:3300/0 conn(0x7fe26c0afc20 0x7fe26c0b0060 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe2640032b0 tx=0x7fe2640081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:03.818 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.805+0000 7fe2723f1700 1 --2- 172.21.15.38:0/3766599417 >> v2:172.21.15.38:3300/0 conn(0x7fe26c0afc20 0x7fe26c0b0060 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe2640032b0 tx=0x7fe2640081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:03.818 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.805+0000 7fe2723f1700 1 --2- 172.21.15.38:0/3766599417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe26c0afc20 0x7fe26c0b0060 secure :-1 s=READY pgs=780 cs=0 l=1 rx=0x7fe2640032b0 tx=0x7fe2640081e0).ready entity=mon.0 client_cookie=6be3ea14d0ac61b server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:03.818 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.805+0000 7fe2723f1700 1 --2- 172.21.15.38:0/3766599417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe26c0afc20 0x7fe26c0b0060 secure :-1 s=THROTTLE_DONE pgs=780 cs=0 l=1 rx=0x7fe2640032b0 tx=0x7fe2640081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:03.818 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.805+0000 7fe270bee700 1 -- 172.21.15.38:0/3766599417 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe26400a160 con 0x7fe26c0afc20 2020-06-12T17:51:03.818 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.805+0000 7fe2723f1700 1 --2- 172.21.15.38:0/3766599417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe26c0afc20 0x7fe26c0b0060 secure :-1 s=THROTTLE_DONE pgs=780 cs=0 l=1 rx=0x7fe2640032b0 tx=0x7fe2640081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:03.819 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.805+0000 7fe2723f1700 1 --2- 172.21.15.38:0/3766599417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe26c0afc20 0x7fe26c0b0060 secure :-1 s=THROTTLE_DONE pgs=780 cs=0 l=1 rx=0x7fe2640032b0 tx=0x7fe2640081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:03.820 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.805+0000 7fe270bee700 1 -- 172.21.15.38:0/3766599417 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26400a2c0 con 0x7fe26c0afc20 2020-06-12T17:51:03.820 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.805+0000 7fe270bee700 1 -- 172.21.15.38:0/3766599417 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe26400a660 con 0x7fe26c0afc20 2020-06-12T17:51:03.820 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.805+0000 7fe272bf2700 1 -- 172.21.15.38:0/3766599417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe26c0afc20 msgr2=0x7fe26c0b0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:03.820 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.805+0000 7fe272bf2700 1 --2- 172.21.15.38:0/3766599417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe26c0afc20 0x7fe26c0b0060 secure :-1 s=READY pgs=780 cs=0 l=1 rx=0x7fe2640032b0 tx=0x7fe2640081e0).stop 2020-06-12T17:51:03.821 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.805+0000 7fe272bf2700 1 -- 172.21.15.38:0/3766599417 shutdown_connections 2020-06-12T17:51:03.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.805+0000 7fe272bf2700 1 --2- 172.21.15.38:0/3766599417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe26c0afc20 0x7fe26c0b0060 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:03.822 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.805+0000 7fe272bf2700 1 --2- 172.21.15.38:0/3766599417 >> v2:172.21.15.150:3300/0 conn(0x7fe26c0b11e0 0x7fe26c0b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:03.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.805+0000 7fe272bf2700 1 -- 172.21.15.38:0/3766599417 >> 172.21.15.38:0/3766599417 conn(0x7fe26c0b4cc0 msgr2=0x7fe26c0b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:03.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.806+0000 7fe272bf2700 1 -- 172.21.15.38:0/3766599417 shutdown_connections 2020-06-12T17:51:03.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.806+0000 7fe272bf2700 1 -- 172.21.15.38:0/3766599417 wait complete. 2020-06-12T17:51:03.823 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.807+0000 7fe272bf2700 1 Processor -- start 2020-06-12T17:51:03.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.807+0000 7fe272bf2700 1 -- start start 2020-06-12T17:51:03.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.807+0000 7fe272bf2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe26c0afc20 0x7fe26c0b6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:03.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.807+0000 7fe272bf2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe26c0b11e0 0x7fe26c0658f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:03.824 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.807+0000 7fe272bf2700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe26c153690 con 0x7fe26c0b2380 2020-06-12T17:51:03.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.807+0000 7fe272bf2700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe26c0b6ba0 con 0x7fe26c0afc20 2020-06-12T17:51:03.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.807+0000 7fe272bf2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe26c066190 con 0x7fe26c0b11e0 2020-06-12T17:51:03.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.807+0000 7fe271bf0700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe26c0afc20 0x7fe26c0b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:03.825 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.807+0000 7fe271bf0700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe26c0afc20 0x7fe26c0b6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39410/0 (socket says 172.21.15.38:39410) 2020-06-12T17:51:03.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.807+0000 7fe2723f1700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe26c0b2380 0x7fe26c064540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41230/0 (socket says 172.21.15.38:41230) 2020-06-12T17:51:03.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.807+0000 7fe271bf0700 1 -- 172.21.15.38:0/3655679088 learned_addr learned my addr 172.21.15.38:0/3655679088 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:03.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.808+0000 7fe2713ef700 1 --2- 172.21.15.38:0/3655679088 >> v2:172.21.15.150:3300/0 conn(0x7fe26c0b11e0 0x7fe26c0658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:03.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.808+0000 7fe271bf0700 1 -- 172.21.15.38:0/3655679088 >> v2:172.21.15.150:3300/0 conn(0x7fe26c0b11e0 msgr2=0x7fe26c0658f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:03.826 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.808+0000 7fe271bf0700 1 --2- 172.21.15.38:0/3655679088 >> v2:172.21.15.150:3300/0 conn(0x7fe26c0b11e0 0x7fe26c0658f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:03.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.808+0000 7fe25affd700 1 -- 172.21.15.38:0/3655679088 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931873420 0 0) 0x7fe26c0b1d70 con 0x7fe26c0b2380 2020-06-12T17:51:03.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.808+0000 7fe271bf0700 1 -- 172.21.15.38:0/3655679088 >> v1:172.21.15.38:6789/0 conn(0x7fe26c0b2380 legacy=0x7fe26c064540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:03.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.808+0000 7fe271bf0700 1 -- 172.21.15.38:0/3655679088 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26c1538d0 con 0x7fe26c0afc20 2020-06-12T17:51:03.827 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.808+0000 7fe2713ef700 1 --2- 172.21.15.38:0/3655679088 >> v2:172.21.15.150:3300/0 conn(0x7fe26c0b11e0 0x7fe26c0658f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:51:03.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.808+0000 7fe271bf0700 1 --2- 172.21.15.38:0/3655679088 >> v2:172.21.15.38:3300/0 conn(0x7fe26c0afc20 0x7fe26c0b6740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe25c002f30 tx=0x7fe25c007ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:03.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.808+0000 7fe271bf0700 1 --2- 172.21.15.38:0/3655679088 >> v2:172.21.15.38:3300/0 conn(0x7fe26c0afc20 0x7fe26c0b6740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe25c002f30 tx=0x7fe25c007ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:03.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.808+0000 7fe271bf0700 1 --2- 172.21.15.38:0/3655679088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe26c0afc20 0x7fe26c0b6740 secure :-1 s=READY pgs=782 cs=0 l=1 rx=0x7fe25c002f30 tx=0x7fe25c007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:03.828 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.808+0000 7fe271bf0700 1 --2- 172.21.15.38:0/3655679088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe26c0afc20 0x7fe26c0b6740 secure :-1 s=THROTTLE_DONE pgs=782 cs=0 l=1 rx=0x7fe25c002f30 tx=0x7fe25c007ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:03.829 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.808+0000 7fe25affd700 1 -- 172.21.15.38:0/3655679088 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe25c008e80 con 0x7fe26c0afc20 2020-06-12T17:51:03.829 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.808+0000 7fe271bf0700 1 --2- 172.21.15.38:0/3655679088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe26c0afc20 0x7fe26c0b6740 secure :-1 s=THROTTLE_DONE pgs=782 cs=0 l=1 rx=0x7fe25c002f30 tx=0x7fe25c007ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:03.829 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.808+0000 7fe271bf0700 1 --2- 172.21.15.38:0/3655679088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe26c0afc20 0x7fe26c0b6740 secure :-1 s=THROTTLE_DONE pgs=782 cs=0 l=1 rx=0x7fe25c002f30 tx=0x7fe25c007ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:03.829 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.808+0000 7fe25affd700 1 -- 172.21.15.38:0/3655679088 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25c007160 con 0x7fe26c0afc20 2020-06-12T17:51:03.829 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.808+0000 7fe272bf2700 1 -- 172.21.15.38:0/3655679088 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe26c064c50 con 0x7fe26c0afc20 2020-06-12T17:51:03.830 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.808+0000 7fe25affd700 1 -- 172.21.15.38:0/3655679088 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe25c007500 con 0x7fe26c0afc20 2020-06-12T17:51:03.830 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.808+0000 7fe272bf2700 1 -- 172.21.15.38:0/3655679088 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26c157970 con 0x7fe26c0afc20 2020-06-12T17:51:03.830 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.809+0000 7fe271bf0700 1 --2- 172.21.15.38:0/3655679088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe26c0afc20 0x7fe26c0b6740 secure :-1 s=THROTTLE_DONE pgs=782 cs=0 l=1 rx=0x7fe25c002f30 tx=0x7fe25c007ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:03.831 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.809+0000 7fe25affd700 1 -- 172.21.15.38:0/3655679088 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fe25c0059c0 con 0x7fe26c0afc20 2020-06-12T17:51:03.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.809+0000 7fe271bf0700 1 --2- 172.21.15.38:0/3655679088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe26c0afc20 0x7fe26c0b6740 secure :-1 s=THROTTLE_DONE pgs=782 cs=0 l=1 rx=0x7fe25c002f30 tx=0x7fe25c007ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:03.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.809+0000 7fe272bf2700 1 -- 172.21.15.38:0/3655679088 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe26c065f90 con 0x7fe26c0afc20 2020-06-12T17:51:03.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.810+0000 7fe25affd700 1 --2- 172.21.15.38:0/3655679088 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe24c04d4c0 0x7fe24c04f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:03.832 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.810+0000 7fe25affd700 1 -- 172.21.15.38:0/3655679088 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe25c060f00 con 0x7fe26c0afc20 2020-06-12T17:51:03.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.810+0000 7fe2713ef700 1 --2- 172.21.15.38:0/3655679088 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe24c04d4c0 0x7fe24c04f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:03.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.810+0000 7fe2713ef700 1 --2- 172.21.15.38:0/3655679088 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe24c04d4c0 0x7fe24c04f980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe268000b80 tx=0x7fe268001600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:03.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.810+0000 7fe2713ef700 1 --2- 172.21.15.38:0/3655679088 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe24c04d4c0 0x7fe24c04f980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe268000b80 tx=0x7fe268001600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:03.833 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.810+0000 7fe2713ef700 1 --2- 172.21.15.38:0/3655679088 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe24c04d4c0 0x7fe24c04f980 secure :-1 s=READY pgs=304 cs=0 l=1 rx=0x7fe268000b80 tx=0x7fe268001600).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:03.836 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.813+0000 7fe271bf0700 1 --2- 172.21.15.38:0/3655679088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe26c0afc20 0x7fe26c0b6740 secure :-1 s=THROTTLE_DONE pgs=782 cs=0 l=1 rx=0x7fe25c002f30 tx=0x7fe25c007ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:03.836 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:03.813+0000 7fe25affd700 1 -- 172.21.15.38:0/3655679088 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fe25c03c600 con 0x7fe26c0afc20 2020-06-12T17:51:04.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.005+0000 7fe272bf2700 1 -- 172.21.15.38:0/3655679088 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_1951", "target": ["mon-mgr", ""]}) v1 -- 0x7fe26c153ad0 con 0x7fe24c04d4c0 2020-06-12T17:51:04.028 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.025+0000 7fe2713ef700 1 --2- 172.21.15.38:0/3655679088 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe24c04d4c0 0x7fe24c04f980 secure :-1 s=THROTTLE_DONE pgs=304 cs=0 l=1 rx=0x7fe268000b80 tx=0x7fe268001600).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:04.029 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.025+0000 7fe25affd700 1 -- 172.21.15.38:0/3655679088 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe26800cf30 con 0x7fe24c04d4c0 2020-06-12T17:51:04.030 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.026+0000 7fe272bf2700 1 -- 172.21.15.38:0/3655679088 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe24c04d4c0 msgr2=0x7fe24c04f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:04.030 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.026+0000 7fe272bf2700 1 --2- 172.21.15.38:0/3655679088 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe24c04d4c0 0x7fe24c04f980 secure :-1 s=READY pgs=304 cs=0 l=1 rx=0x7fe268000b80 tx=0x7fe268001600).stop 2020-06-12T17:51:04.030 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.026+0000 7fe272bf2700 1 -- 172.21.15.38:0/3655679088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe26c0afc20 msgr2=0x7fe26c0b6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:04.030 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.026+0000 7fe272bf2700 1 --2- 172.21.15.38:0/3655679088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe26c0afc20 0x7fe26c0b6740 secure :-1 s=READY pgs=782 cs=0 l=1 rx=0x7fe25c002f30 tx=0x7fe25c007ef0).stop 2020-06-12T17:51:04.031 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.026+0000 7fe272bf2700 1 -- 172.21.15.38:0/3655679088 shutdown_connections 2020-06-12T17:51:04.031 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.026+0000 7fe272bf2700 1 --2- 172.21.15.38:0/3655679088 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe24c04d4c0 0x7fe24c04f980 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:04.031 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.026+0000 7fe272bf2700 1 --2- 172.21.15.38:0/3655679088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe26c0afc20 0x7fe26c0b6740 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:04.031 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.026+0000 7fe272bf2700 1 --2- 172.21.15.38:0/3655679088 >> v2:172.21.15.150:3300/0 conn(0x7fe26c0b11e0 0x7fe26c0658f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:04.032 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.026+0000 7fe272bf2700 1 -- 172.21.15.38:0/3655679088 >> 172.21.15.38:0/3655679088 conn(0x7fe26c0b4cc0 msgr2=0x7fe26c0ad540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:04.032 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.026+0000 7fe272bf2700 1 -- 172.21.15.38:0/3655679088 shutdown_connections 2020-06-12T17:51:04.032 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.026+0000 7fe272bf2700 1 -- 172.21.15.38:0/3655679088 wait complete. 2020-06-12T17:51:04.040 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_1951 2020-06-12T17:51:04.174 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.155+0000 7f2b81eeb700 1 Processor -- start 2020-06-12T17:51:04.174 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.155+0000 7f2b81eeb700 1 -- start start 2020-06-12T17:51:04.176 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.156+0000 7f2b81eeb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2b7c09e400 0x7f2b7c0b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:04.176 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.156+0000 7f2b81eeb700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2b7c0b2eb0 0x7f2b7c0b3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:04.176 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.156+0000 7f2b81eeb700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7c146400 con 0x7f2b7c140300 2020-06-12T17:51:04.176 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.156+0000 7f2b81eeb700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b7c09c7c0 con 0x7f2b7c0b2eb0 2020-06-12T17:51:04.177 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.156+0000 7f2b81eeb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b7c1466a0 con 0x7f2b7c09e400 2020-06-12T17:51:04.177 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.156+0000 7f2b7bfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2b7c0b2eb0 0x7f2b7c0b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:04.177 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.156+0000 7f2b7bfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2b7c0b2eb0 0x7f2b7c0b3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39422/0 (socket says 172.21.15.38:39422) 2020-06-12T17:51:04.177 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.156+0000 7f2b7bfff700 1 -- 172.21.15.38:0/2991400160 learned_addr learned my addr 172.21.15.38:0/2991400160 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:04.177 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.156+0000 7f2b73fff700 1 --2- 172.21.15.38:0/2991400160 >> v2:172.21.15.150:3300/0 conn(0x7f2b7c09e400 0x7f2b7c0b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:04.178 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.156+0000 7f2b7bfff700 1 -- 172.21.15.38:0/2991400160 >> v2:172.21.15.150:3300/0 conn(0x7f2b7c09e400 msgr2=0x7f2b7c0b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:04.178 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.156+0000 7f2b7bfff700 1 --2- 172.21.15.38:0/2991400160 >> v2:172.21.15.150:3300/0 conn(0x7f2b7c09e400 0x7f2b7c0b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:04.178 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.156+0000 7f2b7bfff700 1 -- 172.21.15.38:0/2991400160 >> v1:172.21.15.150:6789/0 conn(0x7f2b7c140300 legacy=0x7f2b7c0b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:04.178 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.156+0000 7f2b7bfff700 1 -- 172.21.15.38:0/2991400160 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c146940 con 0x7f2b7c0b2eb0 2020-06-12T17:51:04.179 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.156+0000 7f2b7bfff700 1 --2- 172.21.15.38:0/2991400160 >> v2:172.21.15.38:3300/0 conn(0x7f2b7c0b2eb0 0x7f2b7c0b3320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2b740032b0 tx=0x7f2b740081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:04.179 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.156+0000 7f2b7bfff700 1 --2- 172.21.15.38:0/2991400160 >> v2:172.21.15.38:3300/0 conn(0x7f2b7c0b2eb0 0x7f2b7c0b3320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2b740032b0 tx=0x7f2b740081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:04.179 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.156+0000 7f2b7bfff700 1 --2- 172.21.15.38:0/2991400160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7c0b2eb0 0x7f2b7c0b3320 secure :-1 s=READY pgs=783 cs=0 l=1 rx=0x7f2b740032b0 tx=0x7f2b740081e0).ready entity=mon.0 client_cookie=d1089f0355e0286b server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:04.179 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.156+0000 7f2b7bfff700 1 --2- 172.21.15.38:0/2991400160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7c0b2eb0 0x7f2b7c0b3320 secure :-1 s=THROTTLE_DONE pgs=783 cs=0 l=1 rx=0x7f2b740032b0 tx=0x7f2b740081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:04.180 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.157+0000 7f2b7affd700 1 -- 172.21.15.38:0/2991400160 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b7400a160 con 0x7f2b7c0b2eb0 2020-06-12T17:51:04.180 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.157+0000 7f2b7bfff700 1 --2- 172.21.15.38:0/2991400160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7c0b2eb0 0x7f2b7c0b3320 secure :-1 s=THROTTLE_DONE pgs=783 cs=0 l=1 rx=0x7f2b740032b0 tx=0x7f2b740081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:04.180 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.157+0000 7f2b7bfff700 1 --2- 172.21.15.38:0/2991400160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7c0b2eb0 0x7f2b7c0b3320 secure :-1 s=THROTTLE_DONE pgs=783 cs=0 l=1 rx=0x7f2b740032b0 tx=0x7f2b740081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:04.180 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.157+0000 7f2b7affd700 1 -- 172.21.15.38:0/2991400160 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7400a2c0 con 0x7f2b7c0b2eb0 2020-06-12T17:51:04.181 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.157+0000 7f2b7affd700 1 -- 172.21.15.38:0/2991400160 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b7400a6a0 con 0x7f2b7c0b2eb0 2020-06-12T17:51:04.181 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.157+0000 7f2b81eeb700 1 -- 172.21.15.38:0/2991400160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7c0b2eb0 msgr2=0x7f2b7c0b3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:04.181 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.157+0000 7f2b81eeb700 1 --2- 172.21.15.38:0/2991400160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7c0b2eb0 0x7f2b7c0b3320 secure :-1 s=READY pgs=783 cs=0 l=1 rx=0x7f2b740032b0 tx=0x7f2b740081e0).stop 2020-06-12T17:51:04.181 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.157+0000 7f2b81eeb700 1 -- 172.21.15.38:0/2991400160 shutdown_connections 2020-06-12T17:51:04.181 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.157+0000 7f2b81eeb700 1 --2- 172.21.15.38:0/2991400160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7c0b2eb0 0x7f2b7c0b3320 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:04.182 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.157+0000 7f2b81eeb700 1 --2- 172.21.15.38:0/2991400160 >> v2:172.21.15.150:3300/0 conn(0x7f2b7c09e400 0x7f2b7c0b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:04.182 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.157+0000 7f2b81eeb700 1 -- 172.21.15.38:0/2991400160 >> 172.21.15.38:0/2991400160 conn(0x7f2b7c0b5a20 msgr2=0x7f2b7c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:04.182 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.157+0000 7f2b81eeb700 1 -- 172.21.15.38:0/2991400160 shutdown_connections 2020-06-12T17:51:04.182 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.157+0000 7f2b81eeb700 1 -- 172.21.15.38:0/2991400160 wait complete. 2020-06-12T17:51:04.183 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.158+0000 7f2b81eeb700 1 Processor -- start 2020-06-12T17:51:04.183 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.158+0000 7f2b81eeb700 1 -- start start 2020-06-12T17:51:04.183 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b81eeb700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2b7c09e400 0x7f2b7c142100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:04.183 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b81eeb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b7c0b2eb0 0x7f2b7c143080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:04.183 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b81eeb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2b7c140300 0x7f2b7c13f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:04.184 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b81eeb700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b7c140930 con 0x7f2b7c09e400 2020-06-12T17:51:04.184 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b81eeb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b7c142880 con 0x7f2b7c140300 2020-06-12T17:51:04.184 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b81eeb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c142b20 con 0x7f2b7c0b2eb0 2020-06-12T17:51:04.185 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b7b7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2b7c09e400 0x7f2b7c142100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:04.185 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b7b7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2b7c09e400 0x7f2b7c142100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39424/0 (socket says 172.21.15.38:39424) 2020-06-12T17:51:04.185 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b7b7fe700 1 -- 172.21.15.38:0/1542835009 learned_addr learned my addr 172.21.15.38:0/1542835009 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:04.185 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b7bfff700 1 --2- 172.21.15.38:0/1542835009 >> v2:172.21.15.150:3300/0 conn(0x7f2b7c140300 0x7f2b7c13f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:04.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b73fff700 1 --2- 172.21.15.38:0/1542835009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b7c0b2eb0 0x7f2b7c143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:04.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b7b7fe700 1 -- 172.21.15.38:0/1542835009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b7c0b2eb0 msgr2=0x7f2b7c143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:04.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b7b7fe700 1 --2- 172.21.15.38:0/1542835009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b7c0b2eb0 0x7f2b7c143080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:04.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b7b7fe700 1 -- 172.21.15.38:0/1542835009 >> v2:172.21.15.150:3300/0 conn(0x7f2b7c140300 msgr2=0x7f2b7c13f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:04.186 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b7b7fe700 1 --2- 172.21.15.38:0/1542835009 >> v2:172.21.15.150:3300/0 conn(0x7f2b7c140300 0x7f2b7c13f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:04.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b7b7fe700 1 -- 172.21.15.38:0/1542835009 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c142dc0 con 0x7f2b7c09e400 2020-06-12T17:51:04.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b7bfff700 1 --2- 172.21.15.38:0/1542835009 >> v2:172.21.15.150:3300/0 conn(0x7f2b7c140300 0x7f2b7c13f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:51:04.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b7b7fe700 1 --2- 172.21.15.38:0/1542835009 >> v2:172.21.15.38:3300/0 conn(0x7f2b7c09e400 0x7f2b7c142100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2b7c061380 tx=0x7f2b6c001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:04.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b7b7fe700 1 --2- 172.21.15.38:0/1542835009 >> v2:172.21.15.38:3300/0 conn(0x7f2b7c09e400 0x7f2b7c142100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2b7c061380 tx=0x7f2b6c001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:04.187 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b7b7fe700 1 --2- 172.21.15.38:0/1542835009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7c09e400 0x7f2b7c142100 secure :-1 s=READY pgs=784 cs=0 l=1 rx=0x7f2b7c061380 tx=0x7f2b6c001820).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:04.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b7b7fe700 1 --2- 172.21.15.38:0/1542835009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7c09e400 0x7f2b7c142100 secure :-1 s=THROTTLE_DONE pgs=784 cs=0 l=1 rx=0x7f2b7c061380 tx=0x7f2b6c001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:04.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b797fa700 1 -- 172.21.15.38:0/1542835009 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b6c00cbf0 con 0x7f2b7c09e400 2020-06-12T17:51:04.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b7b7fe700 1 --2- 172.21.15.38:0/1542835009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7c09e400 0x7f2b7c142100 secure :-1 s=THROTTLE_DONE pgs=784 cs=0 l=1 rx=0x7f2b7c061380 tx=0x7f2b6c001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:04.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b81eeb700 1 -- 172.21.15.38:0/1542835009 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7c142560 con 0x7f2b7c09e400 2020-06-12T17:51:04.188 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b797fa700 1 -- 172.21.15.38:0/1542835009 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6c00cd50 con 0x7f2b7c09e400 2020-06-12T17:51:04.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b7b7fe700 1 --2- 172.21.15.38:0/1542835009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7c09e400 0x7f2b7c142100 secure :-1 s=THROTTLE_DONE pgs=784 cs=0 l=1 rx=0x7f2b7c061380 tx=0x7f2b6c001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:04.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b797fa700 1 -- 172.21.15.38:0/1542835009 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b6c012260 con 0x7f2b7c09e400 2020-06-12T17:51:04.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.159+0000 7f2b81eeb700 1 -- 172.21.15.38:0/1542835009 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7c13f940 con 0x7f2b7c09e400 2020-06-12T17:51:04.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.160+0000 7f2b7b7fe700 1 --2- 172.21.15.38:0/1542835009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7c09e400 0x7f2b7c142100 secure :-1 s=THROTTLE_DONE pgs=784 cs=0 l=1 rx=0x7f2b7c061380 tx=0x7f2b6c001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:04.189 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.160+0000 7f2b81eeb700 1 -- 172.21.15.38:0/1542835009 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b7c13fde0 con 0x7f2b7c09e400 2020-06-12T17:51:04.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.160+0000 7f2b797fa700 1 -- 172.21.15.38:0/1542835009 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f2b6c012520 con 0x7f2b7c09e400 2020-06-12T17:51:04.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.160+0000 7f2b7b7fe700 1 --2- 172.21.15.38:0/1542835009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7c09e400 0x7f2b7c142100 secure :-1 s=THROTTLE_DONE pgs=784 cs=0 l=1 rx=0x7f2b7c061380 tx=0x7f2b6c001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:04.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.161+0000 7f2b797fa700 1 --2- 172.21.15.38:0/1542835009 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2b6004d610 0x7f2b6004fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:04.190 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.161+0000 7f2b797fa700 1 -- 172.21.15.38:0/1542835009 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2b6c060bc0 con 0x7f2b7c09e400 2020-06-12T17:51:04.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.161+0000 7f2b73fff700 1 --2- 172.21.15.38:0/1542835009 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2b6004d610 0x7f2b6004fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:04.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.161+0000 7f2b73fff700 1 --2- 172.21.15.38:0/1542835009 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2b6004d610 0x7f2b6004fad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2b64002f30 tx=0x7f2b64009f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:04.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.161+0000 7f2b73fff700 1 --2- 172.21.15.38:0/1542835009 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2b6004d610 0x7f2b6004fad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2b64002f30 tx=0x7f2b64009f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:04.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.161+0000 7f2b73fff700 1 --2- 172.21.15.38:0/1542835009 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2b6004d610 0x7f2b6004fad0 secure :-1 s=READY pgs=305 cs=0 l=1 rx=0x7f2b64002f30 tx=0x7f2b64009f30).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:04.191 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.164+0000 7f2b7b7fe700 1 --2- 172.21.15.38:0/1542835009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7c09e400 0x7f2b7c142100 secure :-1 s=THROTTLE_DONE pgs=784 cs=0 l=1 rx=0x7f2b7c061380 tx=0x7f2b6c001820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:04.192 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.164+0000 7f2b797fa700 1 -- 172.21.15.38:0/1542835009 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f2b7c13fde0 con 0x7f2b7c09e400 2020-06-12T17:51:04.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.361+0000 7f2b81eeb700 1 -- 172.21.15.38:0/1542835009 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_1951", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b7c13fde0 con 0x7f2b6004d610 2020-06-12T17:51:04.368 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.365+0000 7f2b73fff700 1 --2- 172.21.15.38:0/1542835009 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2b6004d610 0x7f2b6004fad0 secure :-1 s=THROTTLE_DONE pgs=305 cs=0 l=1 rx=0x7f2b64002f30 tx=0x7f2b64009f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:04.368 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.365+0000 7f2b797fa700 1 -- 172.21.15.38:0/1542835009 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f2b7c13fde0 con 0x7f2b6004d610 2020-06-12T17:51:04.369 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_1951/8c925923-42a7-4bc4-a807-e273dda70d4a 2020-06-12T17:51:04.370 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.366+0000 7f2b81eeb700 1 -- 172.21.15.38:0/1542835009 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2b6004d610 msgr2=0x7f2b6004fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:04.370 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.366+0000 7f2b81eeb700 1 --2- 172.21.15.38:0/1542835009 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2b6004d610 0x7f2b6004fad0 secure :-1 s=READY pgs=305 cs=0 l=1 rx=0x7f2b64002f30 tx=0x7f2b64009f30).stop 2020-06-12T17:51:04.371 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.366+0000 7f2b81eeb700 1 -- 172.21.15.38:0/1542835009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7c09e400 msgr2=0x7f2b7c142100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:04.371 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.366+0000 7f2b81eeb700 1 --2- 172.21.15.38:0/1542835009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7c09e400 0x7f2b7c142100 secure :-1 s=READY pgs=784 cs=0 l=1 rx=0x7f2b7c061380 tx=0x7f2b6c001820).stop 2020-06-12T17:51:04.371 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.366+0000 7f2b81eeb700 1 -- 172.21.15.38:0/1542835009 shutdown_connections 2020-06-12T17:51:04.371 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.366+0000 7f2b81eeb700 1 --2- 172.21.15.38:0/1542835009 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2b6004d610 0x7f2b6004fad0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:04.371 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.366+0000 7f2b81eeb700 1 --2- 172.21.15.38:0/1542835009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7c09e400 0x7f2b7c142100 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:04.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.366+0000 7f2b81eeb700 1 --2- 172.21.15.38:0/1542835009 >> v2:172.21.15.150:3300/0 conn(0x7f2b7c140300 0x7f2b7c13f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:04.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.366+0000 7f2b81eeb700 1 --2- 172.21.15.38:0/1542835009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b7c0b2eb0 0x7f2b7c143080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:04.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.366+0000 7f2b81eeb700 1 -- 172.21.15.38:0/1542835009 >> 172.21.15.38:0/1542835009 conn(0x7f2b7c0b5a20 msgr2=0x7f2b7c0b7550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:04.372 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.366+0000 7f2b81eeb700 1 -- 172.21.15.38:0/1542835009 shutdown_connections 2020-06-12T17:51:04.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:04.366+0000 7f2b81eeb700 1 -- 172.21.15.38:0/1542835009 wait complete. 2020-06-12T17:51:04.384 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_1951 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_1951/8c925923-42a7-4bc4-a807-e273dda70d4a 2020-06-12T17:51:04.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:04.385 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:04.386 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:04.403 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:04.403 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:04.404 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1951/8c925923-42a7-4bc4-a807-e273dda70d4a/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:04.493 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:04.494 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:04.494 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105756 s, 99.2 MB/s 2020-06-12T17:51:04.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:04.496 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:04.496 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:04.513 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:04.514 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:04.514 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1951/8c925923-42a7-4bc4-a807-e273dda70d4a/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:04.599 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:04.600 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:04.600 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912846 s, 115 MB/s 2020-06-12T17:51:04.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:04.601 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:04.605 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:04.621 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:04.621 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:04.622 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1951/8c925923-42a7-4bc4-a807-e273dda70d4a/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:04.710 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:04.711 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:04.711 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119925 s, 87.4 MB/s 2020-06-12T17:51:04.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:04.714 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:04.714 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:04.768 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:04.769 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:04.770 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1951/8c925923-42a7-4bc4-a807-e273dda70d4a/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:04.859 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:04.859 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:04.860 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107574 s, 97.5 MB/s 2020-06-12T17:51:04.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:04.862 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:04.863 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:04.879 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:04.879 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:04.880 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1951/8c925923-42a7-4bc4-a807-e273dda70d4a/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:04.974 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:04.974 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:04.975 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113848 s, 92.1 MB/s 2020-06-12T17:51:04.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:04.977 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:04.977 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:05.002 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:05.003 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:05.003 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1951/8c925923-42a7-4bc4-a807-e273dda70d4a/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:05.091 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:05.091 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:05.092 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110523 s, 94.9 MB/s 2020-06-12T17:51:05.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:05.093 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:05.093 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:05.109 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:05.109 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:05.110 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1951/8c925923-42a7-4bc4-a807-e273dda70d4a/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:05.196 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:05.197 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:05.197 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106086 s, 98.8 MB/s 2020-06-12T17:51:05.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:05.199 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:05.199 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:05.221 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:05.221 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:05.222 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1951/8c925923-42a7-4bc4-a807-e273dda70d4a/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:05.308 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:05.308 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:05.308 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108688 s, 96.5 MB/s 2020-06-12T17:51:05.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:05.310 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:05.310 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:05.327 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:05.328 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:05.329 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1951/8c925923-42a7-4bc4-a807-e273dda70d4a/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:05.417 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:05.418 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:05.418 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121299 s, 86.4 MB/s 2020-06-12T17:51:05.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:05.420 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:05.420 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:05.443 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:05.443 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:05.444 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1951/8c925923-42a7-4bc4-a807-e273dda70d4a/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:05.534 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:05.534 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:05.535 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131807 s, 79.6 MB/s 2020-06-12T17:51:05.536 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_3298 2020-06-12T17:51:05.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.650+0000 7f6258b79700 1 Processor -- start 2020-06-12T17:51:05.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.650+0000 7f6258b79700 1 -- start start 2020-06-12T17:51:05.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.651+0000 7f6258b79700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62540b3ac0 0x7f625409df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:05.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.651+0000 7f6258b79700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6254142e90 0x7f625413bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:05.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.651+0000 7f6258b79700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f625409b960 con 0x7f625413c3a0 2020-06-12T17:51:05.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.651+0000 7f6258b79700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f625409bc00 con 0x7f6254142e90 2020-06-12T17:51:05.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.651+0000 7f6258b79700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62540b48f0 con 0x7f62540b3ac0 2020-06-12T17:51:05.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.651+0000 7f6251d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6254142e90 0x7f625413bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:05.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.651+0000 7f6251d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6254142e90 0x7f625413bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39434/0 (socket says 172.21.15.38:39434) 2020-06-12T17:51:05.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.651+0000 7f6252d9d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f625413c3a0 0x7f6254066790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41252/0 (socket says 172.21.15.38:41252) 2020-06-12T17:51:05.666 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.651+0000 7f6251d9b700 1 -- 172.21.15.38:0/2547304309 learned_addr learned my addr 172.21.15.38:0/2547304309 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:05.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.652+0000 7f625259c700 1 --2- 172.21.15.38:0/2547304309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62540b3ac0 0x7f625409df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:05.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.652+0000 7f6251d9b700 1 -- 172.21.15.38:0/2547304309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62540b3ac0 msgr2=0x7f625409df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:05.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.652+0000 7f6251d9b700 1 --2- 172.21.15.38:0/2547304309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62540b3ac0 0x7f625409df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:05.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.652+0000 7f6251d9b700 1 -- 172.21.15.38:0/2547304309 >> v1:172.21.15.38:6789/0 conn(0x7f625413c3a0 legacy=0x7f6254066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:05.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.652+0000 7f6251d9b700 1 -- 172.21.15.38:0/2547304309 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62540b3ea0 con 0x7f6254142e90 2020-06-12T17:51:05.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.652+0000 7f6251d9b700 1 --2- 172.21.15.38:0/2547304309 >> v2:172.21.15.38:3300/0 conn(0x7f6254142e90 0x7f625413bf40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6244002f30 tx=0x7f6244007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:05.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.652+0000 7f6251d9b700 1 --2- 172.21.15.38:0/2547304309 >> v2:172.21.15.38:3300/0 conn(0x7f6254142e90 0x7f625413bf40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6244002f30 tx=0x7f6244007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:05.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.652+0000 7f6251d9b700 1 --2- 172.21.15.38:0/2547304309 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6254142e90 0x7f625413bf40 secure :-1 s=READY pgs=786 cs=0 l=1 rx=0x7f6244002f30 tx=0x7f6244007e60).ready entity=mon.0 client_cookie=9674a28bace70658 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:05.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.652+0000 7f6251d9b700 1 --2- 172.21.15.38:0/2547304309 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6254142e90 0x7f625413bf40 secure :-1 s=THROTTLE_DONE pgs=786 cs=0 l=1 rx=0x7f6244002f30 tx=0x7f6244007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:05.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.652+0000 7f6251d9b700 1 --2- 172.21.15.38:0/2547304309 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6254142e90 0x7f625413bf40 secure :-1 s=THROTTLE_DONE pgs=786 cs=0 l=1 rx=0x7f6244002f30 tx=0x7f6244007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:05.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.652+0000 7f6251d9b700 1 --2- 172.21.15.38:0/2547304309 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6254142e90 0x7f625413bf40 secure :-1 s=THROTTLE_DONE pgs=786 cs=0 l=1 rx=0x7f6244002f30 tx=0x7f6244007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:05.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.652+0000 7f625159a700 1 -- 172.21.15.38:0/2547304309 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6244009e40 con 0x7f6254142e90 2020-06-12T17:51:05.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.652+0000 7f625159a700 1 -- 172.21.15.38:0/2547304309 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6244009840 con 0x7f6254142e90 2020-06-12T17:51:05.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.652+0000 7f625159a700 1 -- 172.21.15.38:0/2547304309 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f624400b350 con 0x7f6254142e90 2020-06-12T17:51:05.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.652+0000 7f6258b79700 1 -- 172.21.15.38:0/2547304309 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6254142e90 msgr2=0x7f625413bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:05.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.652+0000 7f6258b79700 1 --2- 172.21.15.38:0/2547304309 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6254142e90 0x7f625413bf40 secure :-1 s=READY pgs=786 cs=0 l=1 rx=0x7f6244002f30 tx=0x7f6244007e60).stop 2020-06-12T17:51:05.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.653+0000 7f6258b79700 1 -- 172.21.15.38:0/2547304309 shutdown_connections 2020-06-12T17:51:05.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.653+0000 7f6258b79700 1 --2- 172.21.15.38:0/2547304309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62540b3ac0 0x7f625409df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:05.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.653+0000 7f6258b79700 1 --2- 172.21.15.38:0/2547304309 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6254142e90 0x7f625413bf40 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:05.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.653+0000 7f6258b79700 1 -- 172.21.15.38:0/2547304309 >> 172.21.15.38:0/2547304309 conn(0x7f62540b5a20 msgr2=0x7f625405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:05.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.653+0000 7f6258b79700 1 -- 172.21.15.38:0/2547304309 shutdown_connections 2020-06-12T17:51:05.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.653+0000 7f6258b79700 1 -- 172.21.15.38:0/2547304309 wait complete. 2020-06-12T17:51:05.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.654+0000 7f6258b79700 1 Processor -- start 2020-06-12T17:51:05.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.654+0000 7f6258b79700 1 -- start start 2020-06-12T17:51:05.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.654+0000 7f6258b79700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62540b3ac0 0x7f6254066f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:05.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.654+0000 7f6258b79700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f625413c3a0 0x7f6254065ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:05.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.654+0000 7f6258b79700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6254066100 con 0x7f6254142e90 2020-06-12T17:51:05.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.654+0000 7f6258b79700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6254156c70 con 0x7f625413c3a0 2020-06-12T17:51:05.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.654+0000 7f6258b79700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6254156f10 con 0x7f62540b3ac0 2020-06-12T17:51:05.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.655+0000 7f6251d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f625413c3a0 0x7f6254065ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:05.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.655+0000 7f6251d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f625413c3a0 0x7f6254065ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39440/0 (socket says 172.21.15.38:39440) 2020-06-12T17:51:05.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.655+0000 7f6251d9b700 1 -- 172.21.15.38:0/1330432344 learned_addr learned my addr 172.21.15.38:0/1330432344 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:05.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.655+0000 7f625259c700 1 --2- 172.21.15.38:0/1330432344 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62540b3ac0 0x7f6254066f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:05.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.655+0000 7f6251d9b700 1 -- 172.21.15.38:0/1330432344 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62540b3ac0 msgr2=0x7f6254066f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:05.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.655+0000 7f6251d9b700 1 --2- 172.21.15.38:0/1330432344 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62540b3ac0 0x7f6254066f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:05.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.655+0000 7f6251d9b700 1 -- 172.21.15.38:0/1330432344 >> v1:172.21.15.150:6789/0 conn(0x7f6254142e90 legacy=0x7f625413b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:05.701 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.655+0000 7f6251d9b700 1 -- 172.21.15.38:0/1330432344 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62541571b0 con 0x7f625413c3a0 2020-06-12T17:51:05.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.655+0000 7f6251d9b700 1 --2- 172.21.15.38:0/1330432344 >> v2:172.21.15.38:3300/0 conn(0x7f625413c3a0 0x7f6254065ca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f625413fd60 tx=0x7f6244007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:05.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.655+0000 7f6251d9b700 1 --2- 172.21.15.38:0/1330432344 >> v2:172.21.15.38:3300/0 conn(0x7f625413c3a0 0x7f6254065ca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f625413fd60 tx=0x7f6244007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:05.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.655+0000 7f6251d9b700 1 --2- 172.21.15.38:0/1330432344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f625413c3a0 0x7f6254065ca0 secure :-1 s=READY pgs=787 cs=0 l=1 rx=0x7f625413fd60 tx=0x7f6244007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:05.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.655+0000 7f6251d9b700 1 --2- 172.21.15.38:0/1330432344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f625413c3a0 0x7f6254065ca0 secure :-1 s=THROTTLE_DONE pgs=787 cs=0 l=1 rx=0x7f625413fd60 tx=0x7f6244007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:05.702 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.655+0000 7f62437fe700 1 -- 172.21.15.38:0/1330432344 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62440058b0 con 0x7f625413c3a0 2020-06-12T17:51:05.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.655+0000 7f6251d9b700 1 --2- 172.21.15.38:0/1330432344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f625413c3a0 0x7f6254065ca0 secure :-1 s=THROTTLE_DONE pgs=787 cs=0 l=1 rx=0x7f625413fd60 tx=0x7f6244007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:05.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.655+0000 7f6251d9b700 1 --2- 172.21.15.38:0/1330432344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f625413c3a0 0x7f6254065ca0 secure :-1 s=THROTTLE_DONE pgs=787 cs=0 l=1 rx=0x7f625413fd60 tx=0x7f6244007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:05.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.655+0000 7f62437fe700 1 -- 172.21.15.38:0/1330432344 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6244005a10 con 0x7f625413c3a0 2020-06-12T17:51:05.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.655+0000 7f6258b79700 1 -- 172.21.15.38:0/1330432344 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6254156960 con 0x7f625413c3a0 2020-06-12T17:51:05.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.655+0000 7f62437fe700 1 -- 172.21.15.38:0/1330432344 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6244005d70 con 0x7f625413c3a0 2020-06-12T17:51:05.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.655+0000 7f6258b79700 1 -- 172.21.15.38:0/1330432344 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6254157650 con 0x7f625413c3a0 2020-06-12T17:51:05.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.656+0000 7f6251d9b700 1 --2- 172.21.15.38:0/1330432344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f625413c3a0 0x7f6254065ca0 secure :-1 s=THROTTLE_DONE pgs=787 cs=0 l=1 rx=0x7f625413fd60 tx=0x7f6244007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:05.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.656+0000 7f6258b79700 1 -- 172.21.15.38:0/1330432344 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625413eaa0 con 0x7f625413c3a0 2020-06-12T17:51:05.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.656+0000 7f62437fe700 1 -- 172.21.15.38:0/1330432344 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f624400d320 con 0x7f625413c3a0 2020-06-12T17:51:05.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.656+0000 7f6251d9b700 1 --2- 172.21.15.38:0/1330432344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f625413c3a0 0x7f6254065ca0 secure :-1 s=THROTTLE_DONE pgs=787 cs=0 l=1 rx=0x7f625413fd60 tx=0x7f6244007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:05.704 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.657+0000 7f62437fe700 1 --2- 172.21.15.38:0/1330432344 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f623004d650 0x7f623004fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:05.705 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.657+0000 7f62437fe700 1 -- 172.21.15.38:0/1330432344 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f62440615a0 con 0x7f625413c3a0 2020-06-12T17:51:05.705 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.657+0000 7f625259c700 1 --2- 172.21.15.38:0/1330432344 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f623004d650 0x7f623004fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:05.705 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.657+0000 7f625259c700 1 --2- 172.21.15.38:0/1330432344 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f623004d650 0x7f623004fb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6248002f30 tx=0x7f624800e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:05.705 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.657+0000 7f625259c700 1 --2- 172.21.15.38:0/1330432344 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f623004d650 0x7f623004fb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6248002f30 tx=0x7f624800e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:05.705 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.657+0000 7f625259c700 1 --2- 172.21.15.38:0/1330432344 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f623004d650 0x7f623004fb10 secure :-1 s=READY pgs=306 cs=0 l=1 rx=0x7f6248002f30 tx=0x7f624800e0c0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:05.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.660+0000 7f6251d9b700 1 --2- 172.21.15.38:0/1330432344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f625413c3a0 0x7f6254065ca0 secure :-1 s=THROTTLE_DONE pgs=787 cs=0 l=1 rx=0x7f625413fd60 tx=0x7f6244007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:05.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.660+0000 7f62437fe700 1 -- 172.21.15.38:0/1330432344 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f624403cd80 con 0x7f625413c3a0 2020-06-12T17:51:05.855 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.852+0000 7f6258b79700 1 -- 172.21.15.38:0/1330432344 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_3298", "target": ["mon-mgr", ""]}) v1 -- 0x7f6254156af0 con 0x7f623004d650 2020-06-12T17:51:05.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.870+0000 7f625259c700 1 --2- 172.21.15.38:0/1330432344 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f623004d650 0x7f623004fb10 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7f6248002f30 tx=0x7f624800e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:05.874 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.870+0000 7f62437fe700 1 -- 172.21.15.38:0/1330432344 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f62480071f0 con 0x7f623004d650 2020-06-12T17:51:05.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.871+0000 7f6258b79700 1 -- 172.21.15.38:0/1330432344 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f623004d650 msgr2=0x7f623004fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:05.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.871+0000 7f6258b79700 1 --2- 172.21.15.38:0/1330432344 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f623004d650 0x7f623004fb10 secure :-1 s=READY pgs=306 cs=0 l=1 rx=0x7f6248002f30 tx=0x7f624800e0c0).stop 2020-06-12T17:51:05.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.871+0000 7f6258b79700 1 -- 172.21.15.38:0/1330432344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f625413c3a0 msgr2=0x7f6254065ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:05.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.871+0000 7f6258b79700 1 --2- 172.21.15.38:0/1330432344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f625413c3a0 0x7f6254065ca0 secure :-1 s=READY pgs=787 cs=0 l=1 rx=0x7f625413fd60 tx=0x7f6244007e60).stop 2020-06-12T17:51:05.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.871+0000 7f6258b79700 1 -- 172.21.15.38:0/1330432344 shutdown_connections 2020-06-12T17:51:05.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.871+0000 7f6258b79700 1 --2- 172.21.15.38:0/1330432344 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f623004d650 0x7f623004fb10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:05.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.871+0000 7f6258b79700 1 --2- 172.21.15.38:0/1330432344 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62540b3ac0 0x7f6254066f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:05.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.871+0000 7f6258b79700 1 --2- 172.21.15.38:0/1330432344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f625413c3a0 0x7f6254065ca0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:05.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.871+0000 7f6258b79700 1 -- 172.21.15.38:0/1330432344 >> 172.21.15.38:0/1330432344 conn(0x7f62540b5a20 msgr2=0x7f62540b7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:05.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.871+0000 7f6258b79700 1 -- 172.21.15.38:0/1330432344 shutdown_connections 2020-06-12T17:51:05.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:05.871+0000 7f6258b79700 1 -- 172.21.15.38:0/1330432344 wait complete. 2020-06-12T17:51:05.885 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_3298 2020-06-12T17:51:06.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.006+0000 7fe77aea4700 1 Processor -- start 2020-06-12T17:51:06.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.006+0000 7fe77aea4700 1 -- start start 2020-06-12T17:51:06.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.007+0000 7fe77aea4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe774146680 0x7fe7740ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:06.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.007+0000 7fe77aea4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe77409d8d0 0x7fe7741421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:06.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.007+0000 7fe77aea4700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe774146d20 con 0x7fe7740b2eb0 2020-06-12T17:51:06.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.007+0000 7fe77aea4700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe774066a80 con 0x7fe774146680 2020-06-12T17:51:06.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.007+0000 7fe77aea4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe774146f50 con 0x7fe77409d8d0 2020-06-12T17:51:06.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.007+0000 7fe778c40700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe774146680 0x7fe7740ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:06.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.007+0000 7fe773fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe7740b2eb0 0x7fe77409d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41262/0 (socket says 172.21.15.38:41262) 2020-06-12T17:51:06.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.007+0000 7fe773fff700 1 -- 172.21.15.38:0/3440303502 learned_addr learned my addr 172.21.15.38:0/3440303502 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:06.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.007+0000 7fe779441700 1 --2- 172.21.15.38:0/3440303502 >> v2:172.21.15.150:3300/0 conn(0x7fe77409d8d0 0x7fe7741421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:06.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.007+0000 7fe778c40700 1 -- 172.21.15.38:0/3440303502 >> v2:172.21.15.150:3300/0 conn(0x7fe77409d8d0 msgr2=0x7fe7741421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:06.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.007+0000 7fe778c40700 1 --2- 172.21.15.38:0/3440303502 >> v2:172.21.15.150:3300/0 conn(0x7fe77409d8d0 0x7fe7741421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:06.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.007+0000 7fe778c40700 1 -- 172.21.15.38:0/3440303502 >> v1:172.21.15.38:6789/0 conn(0x7fe7740b2eb0 legacy=0x7fe77409d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:06.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.007+0000 7fe778c40700 1 -- 172.21.15.38:0/3440303502 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe774146a60 con 0x7fe774146680 2020-06-12T17:51:06.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.007+0000 7fe778c40700 1 --2- 172.21.15.38:0/3440303502 >> v2:172.21.15.38:3300/0 conn(0x7fe774146680 0x7fe7740ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe7680010d0 tx=0x7fe764007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:06.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.007+0000 7fe778c40700 1 --2- 172.21.15.38:0/3440303502 >> v2:172.21.15.38:3300/0 conn(0x7fe774146680 0x7fe7740ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe7680010d0 tx=0x7fe764007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:06.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.007+0000 7fe778c40700 1 --2- 172.21.15.38:0/3440303502 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe774146680 0x7fe7740ad5b0 secure :-1 s=READY pgs=789 cs=0 l=1 rx=0x7fe7680010d0 tx=0x7fe764007e60).ready entity=mon.0 client_cookie=6bf4513eba342e8b server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:06.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.008+0000 7fe778c40700 1 --2- 172.21.15.38:0/3440303502 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe774146680 0x7fe7740ad5b0 secure :-1 s=THROTTLE_DONE pgs=789 cs=0 l=1 rx=0x7fe7680010d0 tx=0x7fe764007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:06.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.008+0000 7fe778c40700 1 --2- 172.21.15.38:0/3440303502 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe774146680 0x7fe7740ad5b0 secure :-1 s=THROTTLE_DONE pgs=789 cs=0 l=1 rx=0x7fe7680010d0 tx=0x7fe764007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:06.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.008+0000 7fe7737fe700 1 -- 172.21.15.38:0/3440303502 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe764008ea0 con 0x7fe774146680 2020-06-12T17:51:06.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.008+0000 7fe778c40700 1 --2- 172.21.15.38:0/3440303502 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe774146680 0x7fe7740ad5b0 secure :-1 s=THROTTLE_DONE pgs=789 cs=0 l=1 rx=0x7fe7680010d0 tx=0x7fe764007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:06.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.008+0000 7fe7737fe700 1 -- 172.21.15.38:0/3440303502 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe764011600 con 0x7fe774146680 2020-06-12T17:51:06.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.008+0000 7fe7737fe700 1 -- 172.21.15.38:0/3440303502 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7640119a0 con 0x7fe774146680 2020-06-12T17:51:06.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.008+0000 7fe77aea4700 1 -- 172.21.15.38:0/3440303502 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe774146680 msgr2=0x7fe7740ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:06.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.008+0000 7fe77aea4700 1 --2- 172.21.15.38:0/3440303502 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe774146680 0x7fe7740ad5b0 secure :-1 s=READY pgs=789 cs=0 l=1 rx=0x7fe7680010d0 tx=0x7fe764007e60).stop 2020-06-12T17:51:06.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.008+0000 7fe77aea4700 1 -- 172.21.15.38:0/3440303502 shutdown_connections 2020-06-12T17:51:06.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.008+0000 7fe77aea4700 1 --2- 172.21.15.38:0/3440303502 >> v2:172.21.15.150:3300/0 conn(0x7fe77409d8d0 0x7fe7741421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:06.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.008+0000 7fe77aea4700 1 --2- 172.21.15.38:0/3440303502 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe774146680 0x7fe7740ad5b0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:06.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.008+0000 7fe77aea4700 1 -- 172.21.15.38:0/3440303502 >> 172.21.15.38:0/3440303502 conn(0x7fe7740b5a20 msgr2=0x7fe77405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:06.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.008+0000 7fe77aea4700 1 -- 172.21.15.38:0/3440303502 shutdown_connections 2020-06-12T17:51:06.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.008+0000 7fe77aea4700 1 -- 172.21.15.38:0/3440303502 wait complete. 2020-06-12T17:51:06.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.009+0000 7fe77aea4700 1 Processor -- start 2020-06-12T17:51:06.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.009+0000 7fe77aea4700 1 -- start start 2020-06-12T17:51:06.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.010+0000 7fe77aea4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe77409d8d0 0x7fe77409c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:06.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.010+0000 7fe77aea4700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7740b1880 con 0x7fe774146680 2020-06-12T17:51:06.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.010+0000 7fe77aea4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe77409cc30 con 0x7fe7740b2eb0 2020-06-12T17:51:06.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.010+0000 7fe77aea4700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7740649f0 con 0x7fe77409d8d0 2020-06-12T17:51:06.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.010+0000 7fe778c40700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe77409d8d0 0x7fe77409c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:06.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.010+0000 7fe778c40700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe77409d8d0 0x7fe77409c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39454/0 (socket says 172.21.15.38:39454) 2020-06-12T17:51:06.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.010+0000 7fe778c40700 1 -- 172.21.15.38:0/21791114 learned_addr learned my addr 172.21.15.38:0/21791114 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:06.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.010+0000 7fe778c40700 1 -- 172.21.15.38:0/21791114 >> v1:172.21.15.150:6789/0 conn(0x7fe7740b2eb0 legacy=0x7fe7741412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:06.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.010+0000 7fe778c40700 1 -- 172.21.15.38:0/21791114 >> v1:172.21.15.38:6789/0 conn(0x7fe774146680 legacy=0x7fe7740b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:06.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.011+0000 7fe778c40700 1 -- 172.21.15.38:0/21791114 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe774064c90 con 0x7fe77409d8d0 2020-06-12T17:51:06.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.010+0000 7fe771ffb700 1 -- 172.21.15.38:0/21791114 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2467184422 0 0) 0x7fe7740b1880 con 0x7fe774146680 2020-06-12T17:51:06.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.011+0000 7fe778c40700 1 --2- 172.21.15.38:0/21791114 >> v2:172.21.15.38:3300/0 conn(0x7fe77409d8d0 0x7fe77409c7d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe7680010d0 tx=0x7fe764007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:06.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.011+0000 7fe778c40700 1 --2- 172.21.15.38:0/21791114 >> v2:172.21.15.38:3300/0 conn(0x7fe77409d8d0 0x7fe77409c7d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe7680010d0 tx=0x7fe764007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:06.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.011+0000 7fe778c40700 1 --2- 172.21.15.38:0/21791114 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe77409d8d0 0x7fe77409c7d0 secure :-1 s=READY pgs=791 cs=0 l=1 rx=0x7fe7680010d0 tx=0x7fe764007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:06.025 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.011+0000 7fe778c40700 1 --2- 172.21.15.38:0/21791114 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe77409d8d0 0x7fe77409c7d0 secure :-1 s=THROTTLE_DONE pgs=791 cs=0 l=1 rx=0x7fe7680010d0 tx=0x7fe764007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:06.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.011+0000 7fe771ffb700 1 -- 172.21.15.38:0/21791114 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe764008e00 con 0x7fe77409d8d0 2020-06-12T17:51:06.026 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.011+0000 7fe778c40700 1 --2- 172.21.15.38:0/21791114 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe77409d8d0 0x7fe77409c7d0 secure :-1 s=THROTTLE_DONE pgs=791 cs=0 l=1 rx=0x7fe7680010d0 tx=0x7fe764007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:06.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.011+0000 7fe778c40700 1 --2- 172.21.15.38:0/21791114 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe77409d8d0 0x7fe77409c7d0 secure :-1 s=THROTTLE_DONE pgs=791 cs=0 l=1 rx=0x7fe7680010d0 tx=0x7fe764007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:06.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.011+0000 7fe771ffb700 1 -- 172.21.15.38:0/21791114 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe764007160 con 0x7fe77409d8d0 2020-06-12T17:51:06.027 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.011+0000 7fe77aea4700 1 -- 172.21.15.38:0/21791114 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7740646e0 con 0x7fe77409d8d0 2020-06-12T17:51:06.028 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.011+0000 7fe771ffb700 1 -- 172.21.15.38:0/21791114 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe764007500 con 0x7fe77409d8d0 2020-06-12T17:51:06.028 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.011+0000 7fe77aea4700 1 -- 172.21.15.38:0/21791114 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7741419f0 con 0x7fe77409d8d0 2020-06-12T17:51:06.029 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.011+0000 7fe778c40700 1 --2- 172.21.15.38:0/21791114 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe77409d8d0 0x7fe77409c7d0 secure :-1 s=THROTTLE_DONE pgs=791 cs=0 l=1 rx=0x7fe7680010d0 tx=0x7fe764007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:06.029 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.012+0000 7fe77aea4700 1 -- 172.21.15.38:0/21791114 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe774056c30 con 0x7fe77409d8d0 2020-06-12T17:51:06.029 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.012+0000 7fe771ffb700 1 -- 172.21.15.38:0/21791114 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fe7640058d0 con 0x7fe77409d8d0 2020-06-12T17:51:06.029 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.012+0000 7fe778c40700 1 --2- 172.21.15.38:0/21791114 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe77409d8d0 0x7fe77409c7d0 secure :-1 s=THROTTLE_DONE pgs=791 cs=0 l=1 rx=0x7fe7680010d0 tx=0x7fe764007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:06.029 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.012+0000 7fe771ffb700 1 --2- 172.21.15.38:0/21791114 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe75404d390 0x7fe75404f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:06.030 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.012+0000 7fe771ffb700 1 -- 172.21.15.38:0/21791114 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe7640621a0 con 0x7fe77409d8d0 2020-06-12T17:51:06.030 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.013+0000 7fe773fff700 1 --2- 172.21.15.38:0/21791114 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe75404d390 0x7fe75404f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:06.030 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.013+0000 7fe773fff700 1 --2- 172.21.15.38:0/21791114 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe75404d390 0x7fe75404f850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe774062d10 tx=0x7fe768001480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:06.030 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.013+0000 7fe773fff700 1 --2- 172.21.15.38:0/21791114 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe75404d390 0x7fe75404f850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe774062d10 tx=0x7fe768001480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:06.030 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.013+0000 7fe773fff700 1 --2- 172.21.15.38:0/21791114 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe75404d390 0x7fe75404f850 secure :-1 s=READY pgs=307 cs=0 l=1 rx=0x7fe774062d10 tx=0x7fe768001480).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:06.031 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.016+0000 7fe778c40700 1 --2- 172.21.15.38:0/21791114 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe77409d8d0 0x7fe77409c7d0 secure :-1 s=THROTTLE_DONE pgs=791 cs=0 l=1 rx=0x7fe7680010d0 tx=0x7fe764007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:06.031 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.016+0000 7fe771ffb700 1 -- 172.21.15.38:0/21791114 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fe76403d9c0 con 0x7fe77409d8d0 2020-06-12T17:51:06.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.212+0000 7fe77aea4700 1 -- 172.21.15.38:0/21791114 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_3298", "target": ["mon-mgr", ""]}) v1 -- 0x7fe774064870 con 0x7fe75404d390 2020-06-12T17:51:06.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.215+0000 7fe773fff700 1 --2- 172.21.15.38:0/21791114 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe75404d390 0x7fe75404f850 secure :-1 s=THROTTLE_DONE pgs=307 cs=0 l=1 rx=0x7fe774062d10 tx=0x7fe768001480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:06.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.215+0000 7fe771ffb700 1 -- 172.21.15.38:0/21791114 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7fe76800c270 con 0x7fe75404d390 2020-06-12T17:51:06.219 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_3298/4b55c2c8-4c88-4d21-be85-3f428c4bde2f 2020-06-12T17:51:06.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.217+0000 7fe77aea4700 1 -- 172.21.15.38:0/21791114 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe75404d390 msgr2=0x7fe75404f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:06.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.217+0000 7fe77aea4700 1 --2- 172.21.15.38:0/21791114 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe75404d390 0x7fe75404f850 secure :-1 s=READY pgs=307 cs=0 l=1 rx=0x7fe774062d10 tx=0x7fe768001480).stop 2020-06-12T17:51:06.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.217+0000 7fe77aea4700 1 -- 172.21.15.38:0/21791114 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe77409d8d0 msgr2=0x7fe77409c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:06.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.217+0000 7fe77aea4700 1 --2- 172.21.15.38:0/21791114 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe77409d8d0 0x7fe77409c7d0 secure :-1 s=READY pgs=791 cs=0 l=1 rx=0x7fe7680010d0 tx=0x7fe764007e60).stop 2020-06-12T17:51:06.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.217+0000 7fe77aea4700 1 -- 172.21.15.38:0/21791114 shutdown_connections 2020-06-12T17:51:06.222 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.217+0000 7fe77aea4700 1 --2- 172.21.15.38:0/21791114 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe75404d390 0x7fe75404f850 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:06.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.217+0000 7fe77aea4700 1 --2- 172.21.15.38:0/21791114 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe77409d8d0 0x7fe77409c7d0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:06.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.217+0000 7fe77aea4700 1 -- 172.21.15.38:0/21791114 >> 172.21.15.38:0/21791114 conn(0x7fe7740b5a20 msgr2=0x7fe7740b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:06.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.217+0000 7fe77aea4700 1 -- 172.21.15.38:0/21791114 shutdown_connections 2020-06-12T17:51:06.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:06.217+0000 7fe77aea4700 1 -- 172.21.15.38:0/21791114 wait complete. 2020-06-12T17:51:06.230 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_3298 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_3298/4b55c2c8-4c88-4d21-be85-3f428c4bde2f 2020-06-12T17:51:06.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:06.231 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:06.232 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:06.249 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:06.250 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:06.250 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3298/4b55c2c8-4c88-4d21-be85-3f428c4bde2f/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:06.343 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:06.343 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:06.344 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118718 s, 88.3 MB/s 2020-06-12T17:51:06.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:06.345 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:06.345 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:06.361 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:06.362 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:06.362 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3298/4b55c2c8-4c88-4d21-be85-3f428c4bde2f/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:06.453 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:06.454 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:06.454 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954955 s, 110 MB/s 2020-06-12T17:51:06.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:06.455 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:06.456 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:06.478 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:06.479 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:06.479 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3298/4b55c2c8-4c88-4d21-be85-3f428c4bde2f/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:06.566 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:06.567 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:06.567 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110604 s, 94.8 MB/s 2020-06-12T17:51:06.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:06.569 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:06.569 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:06.585 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:06.586 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:06.586 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3298/4b55c2c8-4c88-4d21-be85-3f428c4bde2f/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:06.674 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:06.675 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:06.675 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108388 s, 96.7 MB/s 2020-06-12T17:51:06.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:06.677 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:06.678 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:06.693 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:06.693 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:06.694 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3298/4b55c2c8-4c88-4d21-be85-3f428c4bde2f/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:06.782 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:06.784 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:06.784 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119687 s, 87.6 MB/s 2020-06-12T17:51:06.785 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:06.787 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:06.787 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:06.810 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:06.810 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:06.811 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3298/4b55c2c8-4c88-4d21-be85-3f428c4bde2f/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:06.899 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:06.900 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:06.900 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114982 s, 91.2 MB/s 2020-06-12T17:51:06.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:06.902 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:06.902 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:06.918 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:06.918 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:06.919 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3298/4b55c2c8-4c88-4d21-be85-3f428c4bde2f/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:07.009 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:07.009 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:07.010 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118767 s, 88.3 MB/s 2020-06-12T17:51:07.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:07.011 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:07.012 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:07.028 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:07.029 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:07.029 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3298/4b55c2c8-4c88-4d21-be85-3f428c4bde2f/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:07.116 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:07.116 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:07.116 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114209 s, 91.8 MB/s 2020-06-12T17:51:07.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:07.118 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:07.119 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:07.134 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:07.134 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:07.135 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3298/4b55c2c8-4c88-4d21-be85-3f428c4bde2f/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:07.221 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:07.222 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:07.222 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103912 s, 101 MB/s 2020-06-12T17:51:07.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:07.224 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:07.224 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:07.240 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:07.241 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:07.241 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_3298/4b55c2c8-4c88-4d21-be85-3f428c4bde2f/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:07.328 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:07.328 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:07.329 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114539 s, 91.5 MB/s 2020-06-12T17:51:07.330 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_7219 2020-06-12T17:51:07.447 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.443+0000 7fd4a9f9f700 1 Processor -- start 2020-06-12T17:51:07.447 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.444+0000 7fd4a9f9f700 1 -- start start 2020-06-12T17:51:07.450 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.444+0000 7fd4a9f9f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd4a40b15c0 0x7fd4a40b2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:07.450 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.444+0000 7fd4a9f9f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd4a40afc20 0x7fd4a40b0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:07.450 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.444+0000 7fd4a9f9f700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a40b2900 con 0x7fd4a40b11e0 2020-06-12T17:51:07.450 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.444+0000 7fd4a9f9f700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a40ae7d0 con 0x7fd4a40afc20 2020-06-12T17:51:07.451 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.444+0000 7fd4a9f9f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a40b1ad0 con 0x7fd4a40b15c0 2020-06-12T17:51:07.451 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.444+0000 7fd4a979e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd4a40afc20 0x7fd4a40b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:07.451 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.445+0000 7fd4a979e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd4a40afc20 0x7fd4a40b0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39462/0 (socket says 172.21.15.38:39462) 2020-06-12T17:51:07.451 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.444+0000 7fd4a8f9d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd4a40b11e0 0x7fd4a40ae0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41276/0 (socket says 172.21.15.38:41276) 2020-06-12T17:51:07.451 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.445+0000 7fd4a979e700 1 -- 172.21.15.38:0/3725441511 learned_addr learned my addr 172.21.15.38:0/3725441511 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:07.452 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.445+0000 7fd4a3fff700 1 --2- 172.21.15.38:0/3725441511 >> v2:172.21.15.150:3300/0 conn(0x7fd4a40b15c0 0x7fd4a40b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:07.452 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.445+0000 7fd4a979e700 1 -- 172.21.15.38:0/3725441511 >> v2:172.21.15.150:3300/0 conn(0x7fd4a40b15c0 msgr2=0x7fd4a40b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:07.452 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.445+0000 7fd4a979e700 1 --2- 172.21.15.38:0/3725441511 >> v2:172.21.15.150:3300/0 conn(0x7fd4a40b15c0 0x7fd4a40b2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:07.452 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.445+0000 7fd4a979e700 1 -- 172.21.15.38:0/3725441511 >> v1:172.21.15.38:6789/0 conn(0x7fd4a40b11e0 legacy=0x7fd4a40ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:07.452 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.445+0000 7fd4a979e700 1 -- 172.21.15.38:0/3725441511 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a40b1d70 con 0x7fd4a40afc20 2020-06-12T17:51:07.453 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.445+0000 7fd4a37fe700 1 -- 172.21.15.38:0/3725441511 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2267993538 0 0) 0x7fd4a40b2900 con 0x7fd4a40b11e0 2020-06-12T17:51:07.453 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.445+0000 7fd4a979e700 1 --2- 172.21.15.38:0/3725441511 >> v2:172.21.15.38:3300/0 conn(0x7fd4a40afc20 0x7fd4a40b0090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd49c0032b0 tx=0x7fd49c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.453 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.445+0000 7fd4a979e700 1 --2- 172.21.15.38:0/3725441511 >> v2:172.21.15.38:3300/0 conn(0x7fd4a40afc20 0x7fd4a40b0090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd49c0032b0 tx=0x7fd49c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.453 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.445+0000 7fd4a979e700 1 --2- 172.21.15.38:0/3725441511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4a40afc20 0x7fd4a40b0090 secure :-1 s=READY pgs=793 cs=0 l=1 rx=0x7fd49c0032b0 tx=0x7fd49c0081e0).ready entity=mon.0 client_cookie=b24388b3167be0c9 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:07.453 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.445+0000 7fd4a979e700 1 --2- 172.21.15.38:0/3725441511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4a40afc20 0x7fd4a40b0090 secure :-1 s=THROTTLE_DONE pgs=793 cs=0 l=1 rx=0x7fd49c0032b0 tx=0x7fd49c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.458 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.445+0000 7fd4a37fe700 1 -- 172.21.15.38:0/3725441511 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd49c00a160 con 0x7fd4a40afc20 2020-06-12T17:51:07.458 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.445+0000 7fd4a979e700 1 --2- 172.21.15.38:0/3725441511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4a40afc20 0x7fd4a40b0090 secure :-1 s=THROTTLE_DONE pgs=793 cs=0 l=1 rx=0x7fd49c0032b0 tx=0x7fd49c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.458 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.445+0000 7fd4a37fe700 1 -- 172.21.15.38:0/3725441511 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49c00a2c0 con 0x7fd4a40afc20 2020-06-12T17:51:07.458 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.445+0000 7fd4a979e700 1 --2- 172.21.15.38:0/3725441511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4a40afc20 0x7fd4a40b0090 secure :-1 s=THROTTLE_DONE pgs=793 cs=0 l=1 rx=0x7fd49c0032b0 tx=0x7fd49c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.459 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.445+0000 7fd4a37fe700 1 -- 172.21.15.38:0/3725441511 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd49c00a660 con 0x7fd4a40afc20 2020-06-12T17:51:07.459 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.445+0000 7fd4a9f9f700 1 -- 172.21.15.38:0/3725441511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4a40afc20 msgr2=0x7fd4a40b0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:07.459 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.445+0000 7fd4a9f9f700 1 --2- 172.21.15.38:0/3725441511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4a40afc20 0x7fd4a40b0090 secure :-1 s=READY pgs=793 cs=0 l=1 rx=0x7fd49c0032b0 tx=0x7fd49c0081e0).stop 2020-06-12T17:51:07.459 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.446+0000 7fd4a9f9f700 1 -- 172.21.15.38:0/3725441511 shutdown_connections 2020-06-12T17:51:07.459 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.446+0000 7fd4a9f9f700 1 --2- 172.21.15.38:0/3725441511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4a40afc20 0x7fd4a40b0090 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:07.460 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.446+0000 7fd4a9f9f700 1 --2- 172.21.15.38:0/3725441511 >> v2:172.21.15.150:3300/0 conn(0x7fd4a40b15c0 0x7fd4a40b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:07.460 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.446+0000 7fd4a9f9f700 1 -- 172.21.15.38:0/3725441511 >> 172.21.15.38:0/3725441511 conn(0x7fd4a40b4cc0 msgr2=0x7fd4a40b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:07.460 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.446+0000 7fd4a9f9f700 1 -- 172.21.15.38:0/3725441511 shutdown_connections 2020-06-12T17:51:07.460 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.446+0000 7fd4a9f9f700 1 -- 172.21.15.38:0/3725441511 wait complete. 2020-06-12T17:51:07.460 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.447+0000 7fd4a9f9f700 1 Processor -- start 2020-06-12T17:51:07.461 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.447+0000 7fd4a9f9f700 1 -- start start 2020-06-12T17:51:07.464 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.447+0000 7fd4a9f9f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4a40afc20 0x7fd4a4063d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:07.464 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.447+0000 7fd4a9f9f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd4a40b11e0 0x7fd4a4065c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:07.464 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.447+0000 7fd4a9f9f700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a4066080 con 0x7fd4a40b15c0 2020-06-12T17:51:07.464 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.447+0000 7fd4a9f9f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a4063340 con 0x7fd4a40b11e0 2020-06-12T17:51:07.465 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.447+0000 7fd4a9f9f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a40acdd0 con 0x7fd4a40afc20 2020-06-12T17:51:07.465 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.448+0000 7fd4a979e700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd4a40b15c0 0x7fd4a40ad510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41286/0 (socket says 172.21.15.38:41286) 2020-06-12T17:51:07.465 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.448+0000 7fd4a979e700 1 -- 172.21.15.38:0/3429573298 learned_addr learned my addr 172.21.15.38:0/3429573298 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:07.465 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.448+0000 7fd4a8f9d700 1 --2- 172.21.15.38:0/3429573298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4a40afc20 0x7fd4a4063d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:07.465 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.448+0000 7fd4a3fff700 1 --2- 172.21.15.38:0/3429573298 >> v2:172.21.15.150:3300/0 conn(0x7fd4a40b11e0 0x7fd4a4065c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:07.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.448+0000 7fd4a1ffb700 1 -- 172.21.15.38:0/3429573298 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369695433 0 0) 0x7fd4a40b1d70 con 0x7fd4a40b15c0 2020-06-12T17:51:07.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.448+0000 7fd4a1ffb700 1 -- 172.21.15.38:0/3429573298 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd484002fe0 con 0x7fd4a40b15c0 2020-06-12T17:51:07.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.448+0000 7fd4a8f9d700 1 -- 172.21.15.38:0/3429573298 >> v2:172.21.15.150:3300/0 conn(0x7fd4a40b11e0 msgr2=0x7fd4a4065c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:07.472 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.448+0000 7fd4a8f9d700 1 --2- 172.21.15.38:0/3429573298 >> v2:172.21.15.150:3300/0 conn(0x7fd4a40b11e0 0x7fd4a4065c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:07.472 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.448+0000 7fd4a8f9d700 1 -- 172.21.15.38:0/3429573298 >> v1:172.21.15.38:6789/0 conn(0x7fd4a40b15c0 legacy=0x7fd4a40ad510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:07.472 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.448+0000 7fd4a1ffb700 1 -- 172.21.15.38:0/3429573298 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 627013466 0 0) 0x7fd484002fe0 con 0x7fd4a40b15c0 2020-06-12T17:51:07.473 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.448+0000 7fd4a8f9d700 1 -- 172.21.15.38:0/3429573298 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a40ad070 con 0x7fd4a40afc20 2020-06-12T17:51:07.473 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.448+0000 7fd4a3fff700 1 --2- 172.21.15.38:0/3429573298 >> v2:172.21.15.150:3300/0 conn(0x7fd4a40b11e0 0x7fd4a4065c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:51:07.473 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.448+0000 7fd4a8f9d700 1 --2- 172.21.15.38:0/3429573298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4a40afc20 0x7fd4a4063d50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd49c011f00 tx=0x7fd4940016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.473 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.448+0000 7fd4a8f9d700 1 --2- 172.21.15.38:0/3429573298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4a40afc20 0x7fd4a4063d50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd49c011f00 tx=0x7fd4940016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.474 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.448+0000 7fd4a8f9d700 1 --2- 172.21.15.38:0/3429573298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4a40afc20 0x7fd4a4063d50 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7fd49c011f00 tx=0x7fd4940016e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:07.474 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.448+0000 7fd4a8f9d700 1 --2- 172.21.15.38:0/3429573298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4a40afc20 0x7fd4a4063d50 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fd49c011f00 tx=0x7fd4940016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.474 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.448+0000 7fd4a1ffb700 1 -- 172.21.15.38:0/3429573298 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd49c011d60 con 0x7fd4a40afc20 2020-06-12T17:51:07.474 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.448+0000 7fd4a8f9d700 1 --2- 172.21.15.38:0/3429573298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4a40afc20 0x7fd4a4063d50 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fd49c011f00 tx=0x7fd4940016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.474 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.448+0000 7fd4a1ffb700 1 -- 172.21.15.38:0/3429573298 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd494011170 con 0x7fd4a40afc20 2020-06-12T17:51:07.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.448+0000 7fd4a8f9d700 1 --2- 172.21.15.38:0/3429573298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4a40afc20 0x7fd4a4063d50 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fd49c011f00 tx=0x7fd4940016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.448+0000 7fd4a1ffb700 1 -- 172.21.15.38:0/3429573298 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd494011510 con 0x7fd4a40afc20 2020-06-12T17:51:07.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.448+0000 7fd4a9f9f700 1 -- 172.21.15.38:0/3429573298 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a4062c30 con 0x7fd4a40afc20 2020-06-12T17:51:07.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.448+0000 7fd4a9f9f700 1 -- 172.21.15.38:0/3429573298 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a4063100 con 0x7fd4a40afc20 2020-06-12T17:51:07.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.449+0000 7fd4a8f9d700 1 --2- 172.21.15.38:0/3429573298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4a40afc20 0x7fd4a4063d50 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fd49c011f00 tx=0x7fd4940016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.449+0000 7fd4a9f9f700 1 -- 172.21.15.38:0/3429573298 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a40666a0 con 0x7fd4a40afc20 2020-06-12T17:51:07.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.449+0000 7fd4a1ffb700 1 -- 172.21.15.38:0/3429573298 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fd49400b0a0 con 0x7fd4a40afc20 2020-06-12T17:51:07.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.449+0000 7fd4a8f9d700 1 --2- 172.21.15.38:0/3429573298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4a40afc20 0x7fd4a4063d50 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fd49c011f00 tx=0x7fd4940016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.450+0000 7fd4a1ffb700 1 --2- 172.21.15.38:0/3429573298 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd48404d850 0x7fd48404fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:07.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.450+0000 7fd4a1ffb700 1 -- 172.21.15.38:0/3429573298 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd494060860 con 0x7fd4a40afc20 2020-06-12T17:51:07.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.450+0000 7fd4a3fff700 1 --2- 172.21.15.38:0/3429573298 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd48404d850 0x7fd48404fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:07.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.450+0000 7fd4a3fff700 1 --2- 172.21.15.38:0/3429573298 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd48404d850 0x7fd48404fd10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd498002f30 tx=0x7fd49800e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.450+0000 7fd4a3fff700 1 --2- 172.21.15.38:0/3429573298 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd48404d850 0x7fd48404fd10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd498002f30 tx=0x7fd49800e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.450+0000 7fd4a3fff700 1 --2- 172.21.15.38:0/3429573298 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd48404d850 0x7fd48404fd10 secure :-1 s=READY pgs=308 cs=0 l=1 rx=0x7fd498002f30 tx=0x7fd49800e0c0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:07.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.454+0000 7fd4a8f9d700 1 --2- 172.21.15.38:0/3429573298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4a40afc20 0x7fd4a4063d50 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7fd49c011f00 tx=0x7fd4940016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.454+0000 7fd4a1ffb700 1 -- 172.21.15.38:0/3429573298 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fd49403bfc0 con 0x7fd4a40afc20 2020-06-12T17:51:07.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.646+0000 7fd4a9f9f700 1 -- 172.21.15.38:0/3429573298 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_7219", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4a40ad200 con 0x7fd48404d850 2020-06-12T17:51:07.676 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.669+0000 7fd4a3fff700 1 --2- 172.21.15.38:0/3429573298 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd48404d850 0x7fd48404fd10 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7fd498002f30 tx=0x7fd49800e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.669+0000 7fd4a1ffb700 1 -- 172.21.15.38:0/3429573298 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd4a40ad200 con 0x7fd48404d850 2020-06-12T17:51:07.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.670+0000 7fd4a9f9f700 1 -- 172.21.15.38:0/3429573298 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd48404d850 msgr2=0x7fd48404fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:07.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.670+0000 7fd4a9f9f700 1 --2- 172.21.15.38:0/3429573298 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd48404d850 0x7fd48404fd10 secure :-1 s=READY pgs=308 cs=0 l=1 rx=0x7fd498002f30 tx=0x7fd49800e0c0).stop 2020-06-12T17:51:07.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.670+0000 7fd4a9f9f700 1 -- 172.21.15.38:0/3429573298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4a40afc20 msgr2=0x7fd4a4063d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:07.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.670+0000 7fd4a9f9f700 1 --2- 172.21.15.38:0/3429573298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4a40afc20 0x7fd4a4063d50 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7fd49c011f00 tx=0x7fd4940016e0).stop 2020-06-12T17:51:07.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.670+0000 7fd4a9f9f700 1 -- 172.21.15.38:0/3429573298 shutdown_connections 2020-06-12T17:51:07.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.670+0000 7fd4a9f9f700 1 --2- 172.21.15.38:0/3429573298 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd48404d850 0x7fd48404fd10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:07.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.670+0000 7fd4a9f9f700 1 --2- 172.21.15.38:0/3429573298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4a40afc20 0x7fd4a4063d50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:07.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.670+0000 7fd4a9f9f700 1 --2- 172.21.15.38:0/3429573298 >> v2:172.21.15.150:3300/0 conn(0x7fd4a40b11e0 0x7fd4a4065c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:07.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.670+0000 7fd4a9f9f700 1 -- 172.21.15.38:0/3429573298 >> 172.21.15.38:0/3429573298 conn(0x7fd4a40b4cc0 msgr2=0x7fd4a4146980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:07.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.670+0000 7fd4a9f9f700 1 -- 172.21.15.38:0/3429573298 shutdown_connections 2020-06-12T17:51:07.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.670+0000 7fd4a9f9f700 1 -- 172.21.15.38:0/3429573298 wait complete. 2020-06-12T17:51:07.684 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_7219 2020-06-12T17:51:07.801 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.797+0000 7f2c4478b700 1 Processor -- start 2020-06-12T17:51:07.802 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.798+0000 7f2c4478b700 1 -- start start 2020-06-12T17:51:07.809 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.798+0000 7f2c4478b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2c3c146680 0x7f2c3c0ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:07.809 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.798+0000 7f2c4478b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c3c09d8d0 0x7f2c3c1421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:07.809 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.798+0000 7f2c4478b700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c3c146d20 con 0x7f2c3c0b2eb0 2020-06-12T17:51:07.809 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.798+0000 7f2c4478b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c3c066a80 con 0x7f2c3c146680 2020-06-12T17:51:07.810 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.798+0000 7f2c4478b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c146f50 con 0x7f2c3c09d8d0 2020-06-12T17:51:07.810 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.799+0000 7f2c41d26700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f2c3c0b2eb0 0x7f2c3c09d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41290/0 (socket says 172.21.15.38:41290) 2020-06-12T17:51:07.810 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.799+0000 7f2c41d26700 1 -- 172.21.15.38:0/35527349 learned_addr learned my addr 172.21.15.38:0/35527349 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:07.810 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.799+0000 7f2c42d28700 1 --2- 172.21.15.38:0/35527349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c3c09d8d0 0x7f2c3c1421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:07.810 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.799+0000 7f2c42527700 1 --2- 172.21.15.38:0/35527349 >> v2:172.21.15.150:3300/0 conn(0x7f2c3c146680 0x7f2c3c0ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:07.811 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.799+0000 7f2c41525700 1 -- 172.21.15.38:0/35527349 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3905599898 0 0) 0x7f2c3c146d20 con 0x7f2c3c0b2eb0 2020-06-12T17:51:07.811 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.799+0000 7f2c41525700 1 -- 172.21.15.38:0/35527349 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c24003230 con 0x7f2c3c0b2eb0 2020-06-12T17:51:07.811 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.799+0000 7f2c41525700 1 -- 172.21.15.38:0/35527349 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2208344785 0 0) 0x7f2c24003230 con 0x7f2c3c0b2eb0 2020-06-12T17:51:07.811 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.799+0000 7f2c41525700 1 -- 172.21.15.38:0/35527349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c3c09d8d0 msgr2=0x7f2c3c1421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:07.811 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.799+0000 7f2c41525700 1 --2- 172.21.15.38:0/35527349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c3c09d8d0 0x7f2c3c1421d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:07.812 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.799+0000 7f2c41525700 1 -- 172.21.15.38:0/35527349 >> v2:172.21.15.150:3300/0 conn(0x7f2c3c146680 msgr2=0x7f2c3c0ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:07.812 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.799+0000 7f2c41525700 1 --2- 172.21.15.38:0/35527349 >> v2:172.21.15.150:3300/0 conn(0x7f2c3c146680 0x7f2c3c0ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:07.812 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.799+0000 7f2c41525700 1 -- 172.21.15.38:0/35527349 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3c146a60 con 0x7f2c3c0b2eb0 2020-06-12T17:51:07.812 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.799+0000 7f2c41525700 1 -- 172.21.15.38:0/35527349 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f2c340016d0 con 0x7f2c3c0b2eb0 2020-06-12T17:51:07.812 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.799+0000 7f2c41525700 1 -- 172.21.15.38:0/35527349 >> v1:172.21.15.38:6789/0 conn(0x7f2c3c0b2eb0 legacy=0x7f2c3c09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:07.813 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.799+0000 7f2c41525700 1 --2- 172.21.15.38:0/35527349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c24003720 0x7f2c24003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:07.813 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.799+0000 7f2c41525700 1 --2- 172.21.15.38:0/35527349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c24004010 0x7f2c240044f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:07.813 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.799+0000 7f2c41525700 1 --2- 172.21.15.38:0/35527349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c24004a60 0x7f2c24004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:07.813 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.799+0000 7f2c41525700 1 -- 172.21.15.38:0/35527349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c066a80 con 0x7f2c24004010 2020-06-12T17:51:07.813 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.799+0000 7f2c41525700 1 -- 172.21.15.38:0/35527349 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c146f50 con 0x7f2c24004a60 2020-06-12T17:51:07.814 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.799+0000 7f2c41525700 1 -- 172.21.15.38:0/35527349 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2400daa0 con 0x7f2c24003720 2020-06-12T17:51:07.814 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.799+0000 7f2c42d28700 1 --2- 172.21.15.38:0/35527349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c3c09d8d0 0x7f2c3c1421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:51:07.814 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.799+0000 7f2c41d26700 1 --2- 172.21.15.38:0/35527349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c24004010 0x7f2c240044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:07.814 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.799+0000 7f2c42527700 1 --2- 172.21.15.38:0/35527349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c24003720 0x7f2c24003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:07.814 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.799+0000 7f2c42d28700 1 --2- 172.21.15.38:0/35527349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c24004a60 0x7f2c24004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:07.815 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.800+0000 7f2c41d26700 1 -- 172.21.15.38:0/35527349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c24003720 msgr2=0x7f2c24003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:07.815 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.800+0000 7f2c41d26700 1 --2- 172.21.15.38:0/35527349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c24003720 0x7f2c24003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:07.815 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.800+0000 7f2c41d26700 1 -- 172.21.15.38:0/35527349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c24004a60 msgr2=0x7f2c24004ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:07.815 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.800+0000 7f2c41d26700 1 --2- 172.21.15.38:0/35527349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c24004a60 0x7f2c24004ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:07.815 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.800+0000 7f2c41d26700 1 -- 172.21.15.38:0/35527349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c24003230 con 0x7f2c24004010 2020-06-12T17:51:07.816 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.800+0000 7f2c42d28700 1 --2- 172.21.15.38:0/35527349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c24004a60 0x7f2c24004ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:51:07.816 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.800+0000 7f2c41d26700 1 --2- 172.21.15.38:0/35527349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c24004010 0x7f2c240044f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2c340013e0 tx=0x7f2c3400e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.816 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.800+0000 7f2c41d26700 1 --2- 172.21.15.38:0/35527349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c24004010 0x7f2c240044f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2c340013e0 tx=0x7f2c3400e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.816 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.800+0000 7f2c41d26700 1 --2- 172.21.15.38:0/35527349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c24004010 0x7f2c240044f0 secure :-1 s=READY pgs=796 cs=0 l=1 rx=0x7f2c340013e0 tx=0x7f2c3400e960).ready entity=mon.0 client_cookie=4a5873e1c0df368a server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:07.816 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.800+0000 7f2c41d26700 1 --2- 172.21.15.38:0/35527349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c24004010 0x7f2c240044f0 secure :-1 s=THROTTLE_DONE pgs=796 cs=0 l=1 rx=0x7f2c340013e0 tx=0x7f2c3400e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.817 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.800+0000 7f2c41525700 1 -- 172.21.15.38:0/35527349 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c3400ce70 con 0x7f2c24004010 2020-06-12T17:51:07.817 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.800+0000 7f2c41d26700 1 --2- 172.21.15.38:0/35527349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c24004010 0x7f2c240044f0 secure :-1 s=THROTTLE_DONE pgs=796 cs=0 l=1 rx=0x7f2c340013e0 tx=0x7f2c3400e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.817 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.800+0000 7f2c41d26700 1 --2- 172.21.15.38:0/35527349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c24004010 0x7f2c240044f0 secure :-1 s=THROTTLE_DONE pgs=796 cs=0 l=1 rx=0x7f2c340013e0 tx=0x7f2c3400e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.817 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.800+0000 7f2c41525700 1 -- 172.21.15.38:0/35527349 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3400e350 con 0x7f2c24004010 2020-06-12T17:51:07.817 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.800+0000 7f2c41525700 1 -- 172.21.15.38:0/35527349 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c3400e6f0 con 0x7f2c24004010 2020-06-12T17:51:07.834 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.800+0000 7f2c4478b700 1 -- 172.21.15.38:0/35527349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c24004010 msgr2=0x7f2c240044f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:07.835 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.800+0000 7f2c4478b700 1 --2- 172.21.15.38:0/35527349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c24004010 0x7f2c240044f0 secure :-1 s=READY pgs=796 cs=0 l=1 rx=0x7f2c340013e0 tx=0x7f2c3400e960).stop 2020-06-12T17:51:07.835 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.800+0000 7f2c42d28700 1 -- 172.21.15.38:0/35527349 reap_dead start 2020-06-12T17:51:07.835 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.800+0000 7f2c4478b700 1 -- 172.21.15.38:0/35527349 shutdown_connections 2020-06-12T17:51:07.836 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.800+0000 7f2c4478b700 1 -- 172.21.15.38:0/35527349 >> 172.21.15.38:0/35527349 conn(0x7f2c3c0b5a20 msgr2=0x7f2c3c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:07.836 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.800+0000 7f2c4478b700 1 -- 172.21.15.38:0/35527349 shutdown_connections 2020-06-12T17:51:07.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.801+0000 7f2c4478b700 1 -- 172.21.15.38:0/35527349 wait complete. 2020-06-12T17:51:07.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.801+0000 7f2c4478b700 1 Processor -- start 2020-06-12T17:51:07.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.802+0000 7f2c4478b700 1 -- start start 2020-06-12T17:51:07.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.802+0000 7f2c4478b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2c3c061ed0 0x7f2c3c13ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:07.837 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.802+0000 7f2c4478b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c3c0af070 0x7f2c3c0af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:07.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.802+0000 7f2c4478b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c3c1418f0 con 0x7f2c3c130a00 2020-06-12T17:51:07.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.802+0000 7f2c4478b700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c3c141b90 con 0x7f2c3c061ed0 2020-06-12T17:51:07.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.802+0000 7f2c4478b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c141650 con 0x7f2c3c0af070 2020-06-12T17:51:07.838 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.802+0000 7f2c41d26700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2c3c061ed0 0x7f2c3c13ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:07.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.802+0000 7f2c41d26700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2c3c061ed0 0x7f2c3c13ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39488/0 (socket says 172.21.15.38:39488) 2020-06-12T17:51:07.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.802+0000 7f2c41d26700 1 -- 172.21.15.38:0/3171124150 learned_addr learned my addr 172.21.15.38:0/3171124150 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:07.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.802+0000 7f2c42d28700 1 --2- 172.21.15.38:0/3171124150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c3c0af070 0x7f2c3c0af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:07.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.803+0000 7f2c41d26700 1 -- 172.21.15.38:0/3171124150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c3c0af070 msgr2=0x7f2c3c0af500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:07.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.803+0000 7f2c41d26700 1 --2- 172.21.15.38:0/3171124150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c3c0af070 0x7f2c3c0af500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:07.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.803+0000 7f2c41d26700 1 -- 172.21.15.38:0/3171124150 >> v1:172.21.15.150:6789/0 conn(0x7f2c3c130a00 legacy=0x7f2c3c13e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:07.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.803+0000 7f2c41d26700 1 -- 172.21.15.38:0/3171124150 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3c13f2f0 con 0x7f2c3c061ed0 2020-06-12T17:51:07.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.803+0000 7f2c41d26700 1 --2- 172.21.15.38:0/3171124150 >> v2:172.21.15.38:3300/0 conn(0x7f2c3c061ed0 0x7f2c3c13ee90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2c340013e0 tx=0x7f2c3400e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.803+0000 7f2c41d26700 1 --2- 172.21.15.38:0/3171124150 >> v2:172.21.15.38:3300/0 conn(0x7f2c3c061ed0 0x7f2c3c13ee90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2c340013e0 tx=0x7f2c3400e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.803+0000 7f2c41d26700 1 --2- 172.21.15.38:0/3171124150 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c3c061ed0 0x7f2c3c13ee90 secure :-1 s=READY pgs=797 cs=0 l=1 rx=0x7f2c340013e0 tx=0x7f2c3400e960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:07.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.803+0000 7f2c41d26700 1 --2- 172.21.15.38:0/3171124150 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c3c061ed0 0x7f2c3c13ee90 secure :-1 s=THROTTLE_DONE pgs=797 cs=0 l=1 rx=0x7f2c340013e0 tx=0x7f2c3400e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.803+0000 7f2c41d26700 1 --2- 172.21.15.38:0/3171124150 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c3c061ed0 0x7f2c3c13ee90 secure :-1 s=THROTTLE_DONE pgs=797 cs=0 l=1 rx=0x7f2c340013e0 tx=0x7f2c3400e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.803+0000 7f2c2f7fe700 1 -- 172.21.15.38:0/3171124150 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c3400e740 con 0x7f2c3c061ed0 2020-06-12T17:51:07.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.803+0000 7f2c41d26700 1 --2- 172.21.15.38:0/3171124150 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c3c061ed0 0x7f2c3c13ee90 secure :-1 s=THROTTLE_DONE pgs=797 cs=0 l=1 rx=0x7f2c340013e0 tx=0x7f2c3400e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.803+0000 7f2c2f7fe700 1 -- 172.21.15.38:0/3171124150 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3400fe40 con 0x7f2c3c061ed0 2020-06-12T17:51:07.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.803+0000 7f2c4478b700 1 -- 172.21.15.38:0/3171124150 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c3c0af960 con 0x7f2c3c061ed0 2020-06-12T17:51:07.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.803+0000 7f2c2f7fe700 1 -- 172.21.15.38:0/3171124150 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c340106a0 con 0x7f2c3c061ed0 2020-06-12T17:51:07.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.803+0000 7f2c4478b700 1 -- 172.21.15.38:0/3171124150 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c3c0afe30 con 0x7f2c3c061ed0 2020-06-12T17:51:07.850 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.803+0000 7f2c41d26700 1 --2- 172.21.15.38:0/3171124150 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c3c061ed0 0x7f2c3c13ee90 secure :-1 s=THROTTLE_DONE pgs=797 cs=0 l=1 rx=0x7f2c340013e0 tx=0x7f2c3400e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.850 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.804+0000 7f2c2f7fe700 1 -- 172.21.15.38:0/3171124150 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f2c34010910 con 0x7f2c3c061ed0 2020-06-12T17:51:07.850 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.804+0000 7f2c41d26700 1 --2- 172.21.15.38:0/3171124150 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c3c061ed0 0x7f2c3c13ee90 secure :-1 s=THROTTLE_DONE pgs=797 cs=0 l=1 rx=0x7f2c340013e0 tx=0x7f2c3400e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.850 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.804+0000 7f2c4478b700 1 -- 172.21.15.38:0/3171124150 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c3c0aed60 con 0x7f2c3c061ed0 2020-06-12T17:51:07.850 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.804+0000 7f2c2f7fe700 1 --2- 172.21.15.38:0/3171124150 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2c1c04d5f0 0x7f2c1c04fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:07.851 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.804+0000 7f2c2f7fe700 1 -- 172.21.15.38:0/3171124150 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2c340615f0 con 0x7f2c3c061ed0 2020-06-12T17:51:07.851 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.804+0000 7f2c42527700 1 --2- 172.21.15.38:0/3171124150 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2c1c04d5f0 0x7f2c1c04fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:07.851 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.804+0000 7f2c42527700 1 --2- 172.21.15.38:0/3171124150 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2c1c04d5f0 0x7f2c1c04fab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2c3c142290 tx=0x7f2c30007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.851 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.805+0000 7f2c42527700 1 --2- 172.21.15.38:0/3171124150 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2c1c04d5f0 0x7f2c1c04fab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2c3c142290 tx=0x7f2c30007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.851 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.805+0000 7f2c42527700 1 --2- 172.21.15.38:0/3171124150 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2c1c04d5f0 0x7f2c1c04fab0 secure :-1 s=READY pgs=309 cs=0 l=1 rx=0x7f2c3c142290 tx=0x7f2c30007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:07.852 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.808+0000 7f2c41d26700 1 --2- 172.21.15.38:0/3171124150 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c3c061ed0 0x7f2c3c13ee90 secure :-1 s=THROTTLE_DONE pgs=797 cs=0 l=1 rx=0x7f2c340013e0 tx=0x7f2c3400e960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:07.852 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:07.808+0000 7f2c2f7fe700 1 -- 172.21.15.38:0/3171124150 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f2c3403ce70 con 0x7f2c3c061ed0 2020-06-12T17:51:08.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:08.002+0000 7f2c4478b700 1 -- 172.21.15.38:0/3171124150 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_7219", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c3c056c30 con 0x7f2c1c04d5f0 2020-06-12T17:51:08.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:08.005+0000 7f2c42527700 1 --2- 172.21.15.38:0/3171124150 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2c1c04d5f0 0x7f2c1c04fab0 secure :-1 s=THROTTLE_DONE pgs=309 cs=0 l=1 rx=0x7f2c3c142290 tx=0x7f2c30007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:08.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:08.005+0000 7f2c2f7fe700 1 -- 172.21.15.38:0/3171124150 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f2c3c056c30 con 0x7f2c1c04d5f0 2020-06-12T17:51:08.010 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_7219/d9923b08-2297-4732-8968-9bd9cc1f9ec6 2020-06-12T17:51:08.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:08.006+0000 7f2c4478b700 1 -- 172.21.15.38:0/3171124150 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2c1c04d5f0 msgr2=0x7f2c1c04fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:08.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:08.006+0000 7f2c4478b700 1 --2- 172.21.15.38:0/3171124150 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2c1c04d5f0 0x7f2c1c04fab0 secure :-1 s=READY pgs=309 cs=0 l=1 rx=0x7f2c3c142290 tx=0x7f2c30007e60).stop 2020-06-12T17:51:08.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:08.006+0000 7f2c4478b700 1 -- 172.21.15.38:0/3171124150 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c3c061ed0 msgr2=0x7f2c3c13ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:08.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:08.006+0000 7f2c4478b700 1 --2- 172.21.15.38:0/3171124150 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c3c061ed0 0x7f2c3c13ee90 secure :-1 s=READY pgs=797 cs=0 l=1 rx=0x7f2c340013e0 tx=0x7f2c3400e960).stop 2020-06-12T17:51:08.012 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:08.006+0000 7f2c4478b700 1 -- 172.21.15.38:0/3171124150 shutdown_connections 2020-06-12T17:51:08.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:08.006+0000 7f2c4478b700 1 --2- 172.21.15.38:0/3171124150 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f2c1c04d5f0 0x7f2c1c04fab0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:08.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:08.006+0000 7f2c4478b700 1 --2- 172.21.15.38:0/3171124150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c3c0af070 0x7f2c3c0af500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:08.013 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:08.006+0000 7f2c4478b700 1 --2- 172.21.15.38:0/3171124150 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c3c061ed0 0x7f2c3c13ee90 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:08.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:08.006+0000 7f2c4478b700 1 -- 172.21.15.38:0/3171124150 >> 172.21.15.38:0/3171124150 conn(0x7f2c3c0b5a20 msgr2=0x7f2c3c142f70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:08.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:08.007+0000 7f2c4478b700 1 -- 172.21.15.38:0/3171124150 shutdown_connections 2020-06-12T17:51:08.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:08.007+0000 7f2c4478b700 1 -- 172.21.15.38:0/3171124150 wait complete. 2020-06-12T17:51:08.020 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_7219 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_7219/d9923b08-2297-4732-8968-9bd9cc1f9ec6 2020-06-12T17:51:08.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:08.021 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:08.022 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:08.060 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:08.061 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:08.061 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7219/d9923b08-2297-4732-8968-9bd9cc1f9ec6/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:08.178 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:08.178 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:08.179 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117542 s, 89.2 MB/s 2020-06-12T17:51:08.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:08.186 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:08.187 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:08.217 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:08.217 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:08.218 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7219/d9923b08-2297-4732-8968-9bd9cc1f9ec6/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:08.327 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:08.327 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:08.327 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131798 s, 79.6 MB/s 2020-06-12T17:51:08.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:08.329 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:08.329 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:08.391 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:08.391 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:08.392 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7219/d9923b08-2297-4732-8968-9bd9cc1f9ec6/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:08.488 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:08.488 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:08.488 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00987622 s, 106 MB/s 2020-06-12T17:51:08.489 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:08.490 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:08.490 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:08.509 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:08.510 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:08.511 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7219/d9923b08-2297-4732-8968-9bd9cc1f9ec6/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:08.602 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:08.603 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:08.603 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131596 s, 79.7 MB/s 2020-06-12T17:51:08.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:08.604 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:08.605 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:08.620 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:08.620 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:08.621 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7219/d9923b08-2297-4732-8968-9bd9cc1f9ec6/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:08.707 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:08.707 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:08.707 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941621 s, 111 MB/s 2020-06-12T17:51:08.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:08.709 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:08.709 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:08.729 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:08.729 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:08.730 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7219/d9923b08-2297-4732-8968-9bd9cc1f9ec6/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:08.816 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:08.816 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:08.817 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102314 s, 102 MB/s 2020-06-12T17:51:08.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:08.818 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:08.819 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:08.835 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:08.835 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:08.836 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7219/d9923b08-2297-4732-8968-9bd9cc1f9ec6/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:08.923 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:08.923 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:08.924 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110213 s, 95.1 MB/s 2020-06-12T17:51:08.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:08.925 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:08.926 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:08.951 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:08.951 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:08.952 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7219/d9923b08-2297-4732-8968-9bd9cc1f9ec6/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:09.041 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:09.041 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:09.041 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106831 s, 98.2 MB/s 2020-06-12T17:51:09.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:09.043 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:09.043 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:09.059 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:09.059 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:09.060 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7219/d9923b08-2297-4732-8968-9bd9cc1f9ec6/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:09.146 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:09.147 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:09.147 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105987 s, 98.9 MB/s 2020-06-12T17:51:09.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:09.149 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:09.149 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:09.167 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:09.167 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:09.168 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7219/d9923b08-2297-4732-8968-9bd9cc1f9ec6/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:09.256 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:09.257 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:09.257 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112463 s, 93.2 MB/s 2020-06-12T17:51:09.259 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_4313 2020-06-12T17:51:09.378 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.374+0000 7f9fffefb700 1 Processor -- start 2020-06-12T17:51:09.378 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.374+0000 7f9fffefb700 1 -- start start 2020-06-12T17:51:09.380 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.375+0000 7f9fffefb700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9ff80b3ac0 0x7f9ff809df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:09.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.375+0000 7f9fffefb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9ff813c650 0x7f9ff8066790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:09.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.375+0000 7f9fffefb700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff809b960 con 0x7f9ff8142e90 2020-06-12T17:51:09.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.375+0000 7f9fffefb700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff809bc00 con 0x7f9ff80b3ac0 2020-06-12T17:51:09.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.375+0000 7f9fffefb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff80b48f0 con 0x7f9ff813c650 2020-06-12T17:51:09.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.375+0000 7f9ffdc97700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9ff80b3ac0 0x7f9ff809df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:09.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.375+0000 7f9ffdc97700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9ff80b3ac0 0x7f9ff809df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39498/0 (socket says 172.21.15.38:39498) 2020-06-12T17:51:09.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.375+0000 7f9ffdc97700 1 -- 172.21.15.38:0/487728312 learned_addr learned my addr 172.21.15.38:0/487728312 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:09.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.375+0000 7f9ffe498700 1 --2- 172.21.15.38:0/487728312 >> v2:172.21.15.150:3300/0 conn(0x7f9ff813c650 0x7f9ff8066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:09.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.375+0000 7f9ffdc97700 1 -- 172.21.15.38:0/487728312 >> v2:172.21.15.150:3300/0 conn(0x7f9ff813c650 msgr2=0x7f9ff8066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:09.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.375+0000 7f9ffdc97700 1 --2- 172.21.15.38:0/487728312 >> v2:172.21.15.150:3300/0 conn(0x7f9ff813c650 0x7f9ff8066790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:09.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.375+0000 7f9ffdc97700 1 -- 172.21.15.38:0/487728312 >> v1:172.21.15.150:6789/0 conn(0x7f9ff8142e90 legacy=0x7f9ff813bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:09.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.375+0000 7f9ffcc95700 1 -- 172.21.15.38:0/487728312 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3615383243 0 0) 0x7f9ff809b960 con 0x7f9ff8142e90 2020-06-12T17:51:09.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.375+0000 7f9ffdc97700 1 -- 172.21.15.38:0/487728312 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff80b3ea0 con 0x7f9ff80b3ac0 2020-06-12T17:51:09.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.376+0000 7f9ffdc97700 1 --2- 172.21.15.38:0/487728312 >> v2:172.21.15.38:3300/0 conn(0x7f9ff80b3ac0 0x7f9ff809df00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9ff81433b0 tx=0x7f9fe8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.376+0000 7f9ffdc97700 1 --2- 172.21.15.38:0/487728312 >> v2:172.21.15.38:3300/0 conn(0x7f9ff80b3ac0 0x7f9ff809df00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9ff81433b0 tx=0x7f9fe8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.376+0000 7f9ffdc97700 1 --2- 172.21.15.38:0/487728312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff80b3ac0 0x7f9ff809df00 secure :-1 s=READY pgs=798 cs=0 l=1 rx=0x7f9ff81433b0 tx=0x7f9fe8007e60).ready entity=mon.0 client_cookie=485918728146c50 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:09.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.376+0000 7f9ffdc97700 1 --2- 172.21.15.38:0/487728312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff80b3ac0 0x7f9ff809df00 secure :-1 s=THROTTLE_DONE pgs=798 cs=0 l=1 rx=0x7f9ff81433b0 tx=0x7f9fe8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.376+0000 7f9ffcc95700 1 -- 172.21.15.38:0/487728312 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fe8011630 con 0x7f9ff80b3ac0 2020-06-12T17:51:09.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.376+0000 7f9ffdc97700 1 --2- 172.21.15.38:0/487728312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff80b3ac0 0x7f9ff809df00 secure :-1 s=THROTTLE_DONE pgs=798 cs=0 l=1 rx=0x7f9ff81433b0 tx=0x7f9fe8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.376+0000 7f9ffcc95700 1 -- 172.21.15.38:0/487728312 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe8011790 con 0x7f9ff80b3ac0 2020-06-12T17:51:09.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.376+0000 7f9ffdc97700 1 --2- 172.21.15.38:0/487728312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff80b3ac0 0x7f9ff809df00 secure :-1 s=THROTTLE_DONE pgs=798 cs=0 l=1 rx=0x7f9ff81433b0 tx=0x7f9fe8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.376+0000 7f9fffefb700 1 -- 172.21.15.38:0/487728312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff80b3ac0 msgr2=0x7f9ff809df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:09.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.376+0000 7f9ffcc95700 1 -- 172.21.15.38:0/487728312 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fe8011b30 con 0x7f9ff80b3ac0 2020-06-12T17:51:09.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.376+0000 7f9fffefb700 1 --2- 172.21.15.38:0/487728312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff80b3ac0 0x7f9ff809df00 secure :-1 s=READY pgs=798 cs=0 l=1 rx=0x7f9ff81433b0 tx=0x7f9fe8007e60).stop 2020-06-12T17:51:09.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.376+0000 7f9fffefb700 1 -- 172.21.15.38:0/487728312 shutdown_connections 2020-06-12T17:51:09.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.376+0000 7f9fffefb700 1 --2- 172.21.15.38:0/487728312 >> v2:172.21.15.150:3300/0 conn(0x7f9ff813c650 0x7f9ff8066790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:09.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.376+0000 7f9fffefb700 1 --2- 172.21.15.38:0/487728312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff80b3ac0 0x7f9ff809df00 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:09.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.376+0000 7f9fffefb700 1 -- 172.21.15.38:0/487728312 >> 172.21.15.38:0/487728312 conn(0x7f9ff80b5a20 msgr2=0x7f9ff805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:09.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.376+0000 7f9fffefb700 1 -- 172.21.15.38:0/487728312 shutdown_connections 2020-06-12T17:51:09.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.376+0000 7f9fffefb700 1 -- 172.21.15.38:0/487728312 wait complete. 2020-06-12T17:51:09.389 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.377+0000 7f9fffefb700 1 Processor -- start 2020-06-12T17:51:09.390 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.377+0000 7f9fffefb700 1 -- start start 2020-06-12T17:51:09.390 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.378+0000 7f9fffefb700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9ff813c650 0x7f9ff8155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:09.390 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.378+0000 7f9fffefb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ff8142e90 0x7f9ff80645f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:09.390 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.378+0000 7f9fffefb700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff80615b0 con 0x7f9ff80b3ac0 2020-06-12T17:51:09.390 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.378+0000 7f9fffefb700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff813c4f0 con 0x7f9ff813c650 2020-06-12T17:51:09.391 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.378+0000 7f9fffefb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff8061850 con 0x7f9ff8142e90 2020-06-12T17:51:09.391 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.378+0000 7f9ffd496700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9ff813c650 0x7f9ff8155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:09.391 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.378+0000 7f9ffd496700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9ff813c650 0x7f9ff8155140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39502/0 (socket says 172.21.15.38:39502) 2020-06-12T17:51:09.391 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.378+0000 7f9ffd496700 1 -- 172.21.15.38:0/3862824348 learned_addr learned my addr 172.21.15.38:0/3862824348 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:09.391 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.378+0000 7f9ffe498700 1 --2- 172.21.15.38:0/3862824348 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ff8142e90 0x7f9ff80645f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:09.392 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.378+0000 7f9ffd496700 1 -- 172.21.15.38:0/3862824348 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ff8142e90 msgr2=0x7f9ff80645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:09.392 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.378+0000 7f9ffd496700 1 --2- 172.21.15.38:0/3862824348 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ff8142e90 0x7f9ff80645f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:09.392 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.378+0000 7f9ffd496700 1 -- 172.21.15.38:0/3862824348 >> v1:172.21.15.150:6789/0 conn(0x7f9ff80b3ac0 legacy=0x7f9ff8063960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:09.392 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.378+0000 7f9ffd496700 1 -- 172.21.15.38:0/3862824348 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff8066380 con 0x7f9ff813c650 2020-06-12T17:51:09.392 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.378+0000 7f9ffd496700 1 --2- 172.21.15.38:0/3862824348 >> v2:172.21.15.38:3300/0 conn(0x7f9ff813c650 0x7f9ff8155140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9ff4000f00 tx=0x7f9ff4001be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.393 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.379+0000 7f9ffd496700 1 --2- 172.21.15.38:0/3862824348 >> v2:172.21.15.38:3300/0 conn(0x7f9ff813c650 0x7f9ff8155140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9ff4000f00 tx=0x7f9ff4001be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.393 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.379+0000 7f9ffd496700 1 --2- 172.21.15.38:0/3862824348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff813c650 0x7f9ff8155140 secure :-1 s=READY pgs=799 cs=0 l=1 rx=0x7f9ff4000f00 tx=0x7f9ff4001be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:09.393 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.379+0000 7f9ffd496700 1 --2- 172.21.15.38:0/3862824348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff813c650 0x7f9ff8155140 secure :-1 s=THROTTLE_DONE pgs=799 cs=0 l=1 rx=0x7f9ff4000f00 tx=0x7f9ff4001be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.393 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.379+0000 7f9ffd496700 1 --2- 172.21.15.38:0/3862824348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff813c650 0x7f9ff8155140 secure :-1 s=THROTTLE_DONE pgs=799 cs=0 l=1 rx=0x7f9ff4000f00 tx=0x7f9ff4001be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.393 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.379+0000 7f9fe6ffd700 1 -- 172.21.15.38:0/3862824348 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ff40101c0 con 0x7f9ff813c650 2020-06-12T17:51:09.394 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.379+0000 7f9ffd496700 1 --2- 172.21.15.38:0/3862824348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff813c650 0x7f9ff8155140 secure :-1 s=THROTTLE_DONE pgs=799 cs=0 l=1 rx=0x7f9ff4000f00 tx=0x7f9ff4001be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.394 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.379+0000 7f9fe6ffd700 1 -- 172.21.15.38:0/3862824348 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff4010320 con 0x7f9ff813c650 2020-06-12T17:51:09.394 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.379+0000 7f9fffefb700 1 -- 172.21.15.38:0/3862824348 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff8155640 con 0x7f9ff813c650 2020-06-12T17:51:09.394 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.379+0000 7f9fe6ffd700 1 -- 172.21.15.38:0/3862824348 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ff4010740 con 0x7f9ff813c650 2020-06-12T17:51:09.395 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.379+0000 7f9fffefb700 1 -- 172.21.15.38:0/3862824348 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff8062af0 con 0x7f9ff813c650 2020-06-12T17:51:09.395 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.379+0000 7f9ffd496700 1 --2- 172.21.15.38:0/3862824348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff813c650 0x7f9ff8155140 secure :-1 s=THROTTLE_DONE pgs=799 cs=0 l=1 rx=0x7f9ff4000f00 tx=0x7f9ff4001be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.395 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.380+0000 7f9fe6ffd700 1 -- 172.21.15.38:0/3862824348 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f9ff4006860 con 0x7f9ff813c650 2020-06-12T17:51:09.395 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.380+0000 7f9ffd496700 1 --2- 172.21.15.38:0/3862824348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff813c650 0x7f9ff8155140 secure :-1 s=THROTTLE_DONE pgs=799 cs=0 l=1 rx=0x7f9ff4000f00 tx=0x7f9ff4001be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.395 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.380+0000 7f9fffefb700 1 -- 172.21.15.38:0/3862824348 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff8056c30 con 0x7f9ff813c650 2020-06-12T17:51:09.396 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.380+0000 7f9fe6ffd700 1 --2- 172.21.15.38:0/3862824348 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9fd804d430 0x7f9fd804f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:09.396 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.380+0000 7f9fe6ffd700 1 -- 172.21.15.38:0/3862824348 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9ff4061320 con 0x7f9ff813c650 2020-06-12T17:51:09.396 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.380+0000 7f9ffdc97700 1 --2- 172.21.15.38:0/3862824348 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9fd804d430 0x7f9fd804f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:09.396 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.381+0000 7f9ffdc97700 1 --2- 172.21.15.38:0/3862824348 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9fd804d430 0x7f9fd804f8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9ff80b2110 tx=0x7f9fe8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.396 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.381+0000 7f9ffdc97700 1 --2- 172.21.15.38:0/3862824348 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9fd804d430 0x7f9fd804f8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9ff80b2110 tx=0x7f9fe8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.397 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.381+0000 7f9ffdc97700 1 --2- 172.21.15.38:0/3862824348 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9fd804d430 0x7f9fd804f8f0 secure :-1 s=READY pgs=310 cs=0 l=1 rx=0x7f9ff80b2110 tx=0x7f9fe8007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:09.397 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.384+0000 7f9ffd496700 1 --2- 172.21.15.38:0/3862824348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff813c650 0x7f9ff8155140 secure :-1 s=THROTTLE_DONE pgs=799 cs=0 l=1 rx=0x7f9ff4000f00 tx=0x7f9ff4001be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.397 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.384+0000 7f9fe6ffd700 1 -- 172.21.15.38:0/3862824348 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f9ff403cb00 con 0x7f9ff813c650 2020-06-12T17:51:09.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.579+0000 7f9fffefb700 1 -- 172.21.15.38:0/3862824348 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_4313", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ff8061990 con 0x7f9fd804d430 2020-06-12T17:51:09.601 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.598+0000 7f9ffdc97700 1 --2- 172.21.15.38:0/3862824348 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9fd804d430 0x7f9fd804f8f0 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7f9ff80b2110 tx=0x7f9fe8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.602 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.598+0000 7f9fe6ffd700 1 -- 172.21.15.38:0/3862824348 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f9ff8061990 con 0x7f9fd804d430 2020-06-12T17:51:09.603 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.599+0000 7f9fffefb700 1 -- 172.21.15.38:0/3862824348 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9fd804d430 msgr2=0x7f9fd804f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:09.603 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.599+0000 7f9fffefb700 1 --2- 172.21.15.38:0/3862824348 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9fd804d430 0x7f9fd804f8f0 secure :-1 s=READY pgs=310 cs=0 l=1 rx=0x7f9ff80b2110 tx=0x7f9fe8007e60).stop 2020-06-12T17:51:09.603 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.599+0000 7f9fffefb700 1 -- 172.21.15.38:0/3862824348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff813c650 msgr2=0x7f9ff8155140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:09.604 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.599+0000 7f9fffefb700 1 --2- 172.21.15.38:0/3862824348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff813c650 0x7f9ff8155140 secure :-1 s=READY pgs=799 cs=0 l=1 rx=0x7f9ff4000f00 tx=0x7f9ff4001be0).stop 2020-06-12T17:51:09.604 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.599+0000 7f9fffefb700 1 -- 172.21.15.38:0/3862824348 shutdown_connections 2020-06-12T17:51:09.604 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.599+0000 7f9fffefb700 1 --2- 172.21.15.38:0/3862824348 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9fd804d430 0x7f9fd804f8f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:09.604 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.599+0000 7f9fffefb700 1 --2- 172.21.15.38:0/3862824348 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ff8142e90 0x7f9ff80645f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:09.604 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.599+0000 7f9fffefb700 1 --2- 172.21.15.38:0/3862824348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9ff813c650 0x7f9ff8155140 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:09.606 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.599+0000 7f9fffefb700 1 -- 172.21.15.38:0/3862824348 >> 172.21.15.38:0/3862824348 conn(0x7f9ff80b5a20 msgr2=0x7f9ff8066d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:09.606 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.599+0000 7f9fffefb700 1 -- 172.21.15.38:0/3862824348 shutdown_connections 2020-06-12T17:51:09.606 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.599+0000 7f9fffefb700 1 -- 172.21.15.38:0/3862824348 wait complete. 2020-06-12T17:51:09.614 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_4313 2020-06-12T17:51:09.731 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.728+0000 7f0cfe054700 1 Processor -- start 2020-06-12T17:51:09.732 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.728+0000 7f0cfe054700 1 -- start start 2020-06-12T17:51:09.734 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.728+0000 7f0cfe054700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0cf8140300 0x7f0cf80b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:09.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.729+0000 7f0cfe054700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0cf80b2eb0 0x7f0cf80b3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:09.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.729+0000 7f0cfe054700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf8146400 con 0x7f0cf809e400 2020-06-12T17:51:09.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.729+0000 7f0cfe054700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf809c7c0 con 0x7f0cf80b2eb0 2020-06-12T17:51:09.735 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.729+0000 7f0cfe054700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf81466a0 con 0x7f0cf8140300 2020-06-12T17:51:09.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.729+0000 7f0cf7fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0cf80b2eb0 0x7f0cf80b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:09.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.729+0000 7f0cf7fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0cf80b2eb0 0x7f0cf80b3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39510/0 (socket says 172.21.15.38:39510) 2020-06-12T17:51:09.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.729+0000 7f0cf7fff700 1 -- 172.21.15.38:0/1200543149 learned_addr learned my addr 172.21.15.38:0/1200543149 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:09.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.729+0000 7f0cf77fe700 1 --2- 172.21.15.38:0/1200543149 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0cf8140300 0x7f0cf80b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:09.736 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.729+0000 7f0cf7fff700 1 -- 172.21.15.38:0/1200543149 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0cf8140300 msgr2=0x7f0cf80b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:09.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.729+0000 7f0cf7fff700 1 --2- 172.21.15.38:0/1200543149 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0cf8140300 0x7f0cf80b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:09.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.729+0000 7f0cf7fff700 1 -- 172.21.15.38:0/1200543149 >> v1:172.21.15.150:6789/0 conn(0x7f0cf809e400 legacy=0x7f0cf80b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:09.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.729+0000 7f0cf7fff700 1 -- 172.21.15.38:0/1200543149 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf8146940 con 0x7f0cf80b2eb0 2020-06-12T17:51:09.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.729+0000 7f0cf7fff700 1 --2- 172.21.15.38:0/1200543149 >> v2:172.21.15.38:3300/0 conn(0x7f0cf80b2eb0 0x7f0cf80b3340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0cf00032b0 tx=0x7f0cf00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.737 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.729+0000 7f0cf7fff700 1 --2- 172.21.15.38:0/1200543149 >> v2:172.21.15.38:3300/0 conn(0x7f0cf80b2eb0 0x7f0cf80b3340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0cf00032b0 tx=0x7f0cf00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.729+0000 7f0cf7fff700 1 --2- 172.21.15.38:0/1200543149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf80b2eb0 0x7f0cf80b3340 secure :-1 s=READY pgs=800 cs=0 l=1 rx=0x7f0cf00032b0 tx=0x7f0cf00081e0).ready entity=mon.0 client_cookie=42d547cff5677d47 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:09.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.729+0000 7f0cf7fff700 1 --2- 172.21.15.38:0/1200543149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf80b2eb0 0x7f0cf80b3340 secure :-1 s=THROTTLE_DONE pgs=800 cs=0 l=1 rx=0x7f0cf00032b0 tx=0x7f0cf00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.729+0000 7f0cf67fc700 1 -- 172.21.15.38:0/1200543149 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cf0011ea0 con 0x7f0cf80b2eb0 2020-06-12T17:51:09.738 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.729+0000 7f0cf7fff700 1 --2- 172.21.15.38:0/1200543149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf80b2eb0 0x7f0cf80b3340 secure :-1 s=THROTTLE_DONE pgs=800 cs=0 l=1 rx=0x7f0cf00032b0 tx=0x7f0cf00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.729+0000 7f0cf7fff700 1 --2- 172.21.15.38:0/1200543149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf80b2eb0 0x7f0cf80b3340 secure :-1 s=THROTTLE_DONE pgs=800 cs=0 l=1 rx=0x7f0cf00032b0 tx=0x7f0cf00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.729+0000 7f0cf67fc700 1 -- 172.21.15.38:0/1200543149 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf000a160 con 0x7f0cf80b2eb0 2020-06-12T17:51:09.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.729+0000 7f0cf67fc700 1 -- 172.21.15.38:0/1200543149 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cf000a580 con 0x7f0cf80b2eb0 2020-06-12T17:51:09.739 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.729+0000 7f0cfe054700 1 -- 172.21.15.38:0/1200543149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf80b2eb0 msgr2=0x7f0cf80b3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:09.740 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.729+0000 7f0cfe054700 1 --2- 172.21.15.38:0/1200543149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf80b2eb0 0x7f0cf80b3340 secure :-1 s=READY pgs=800 cs=0 l=1 rx=0x7f0cf00032b0 tx=0x7f0cf00081e0).stop 2020-06-12T17:51:09.740 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.730+0000 7f0cfe054700 1 -- 172.21.15.38:0/1200543149 shutdown_connections 2020-06-12T17:51:09.740 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.730+0000 7f0cfe054700 1 --2- 172.21.15.38:0/1200543149 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0cf8140300 0x7f0cf80b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:09.741 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.730+0000 7f0cfe054700 1 --2- 172.21.15.38:0/1200543149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf80b2eb0 0x7f0cf80b3340 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:09.741 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.730+0000 7f0cfe054700 1 -- 172.21.15.38:0/1200543149 >> 172.21.15.38:0/1200543149 conn(0x7f0cf80b5a20 msgr2=0x7f0cf805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:09.741 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.730+0000 7f0cfe054700 1 -- 172.21.15.38:0/1200543149 shutdown_connections 2020-06-12T17:51:09.742 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.730+0000 7f0cfe054700 1 -- 172.21.15.38:0/1200543149 wait complete. 2020-06-12T17:51:09.742 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.731+0000 7f0cfe054700 1 Processor -- start 2020-06-12T17:51:09.742 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.731+0000 7f0cfe054700 1 -- start start 2020-06-12T17:51:09.747 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.732+0000 7f0cfe054700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0cf809e400 0x7f0cf8156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:09.748 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.732+0000 7f0cfe054700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0cf8140300 0x7f0cf8140700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:09.748 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.732+0000 7f0cfe054700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf8142ee0 con 0x7f0cf80b2eb0 2020-06-12T17:51:09.748 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.732+0000 7f0cfe054700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf8142090 con 0x7f0cf809e400 2020-06-12T17:51:09.749 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.732+0000 7f0cfe054700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf8142330 con 0x7f0cf8140300 2020-06-12T17:51:09.749 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.732+0000 7f0cf77fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0cf809e400 0x7f0cf8156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:09.749 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.732+0000 7f0cf7fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0cf8140300 0x7f0cf8140700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:09.749 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.732+0000 7f0cf77fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0cf809e400 0x7f0cf8156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:48990/0 (socket says 172.21.15.38:48990) 2020-06-12T17:51:09.749 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.732+0000 7f0cf6ffd700 1 --1- 172.21.15.38:0/1763732136 >> v1:172.21.15.150:6789/0 conn(0x7f0cf80b2eb0 0x7f0cf81427d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:33832/0 (socket says 172.21.15.38:33832) 2020-06-12T17:51:09.752 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.732+0000 7f0cf77fe700 1 -- 172.21.15.38:0/1763732136 learned_addr learned my addr 172.21.15.38:0/1763732136 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:09.752 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.732+0000 7f0cf7fff700 1 -- 172.21.15.38:0/1763732136 >> v2:172.21.15.150:3300/0 conn(0x7f0cf809e400 msgr2=0x7f0cf8156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:09.752 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.732+0000 7f0cf7fff700 1 --2- 172.21.15.38:0/1763732136 >> v2:172.21.15.150:3300/0 conn(0x7f0cf809e400 0x7f0cf8156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:09.753 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.732+0000 7f0cf7fff700 1 -- 172.21.15.38:0/1763732136 >> v1:172.21.15.150:6789/0 conn(0x7f0cf80b2eb0 legacy=0x7f0cf81427d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:09.753 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.732+0000 7f0cf7fff700 1 -- 172.21.15.38:0/1763732136 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf8141d80 con 0x7f0cf8140300 2020-06-12T17:51:09.753 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.732+0000 7f0cf77fe700 1 --2- 172.21.15.38:0/1763732136 >> v2:172.21.15.150:3300/0 conn(0x7f0cf809e400 0x7f0cf8156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:51:09.753 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.732+0000 7f0cf7fff700 1 --2- 172.21.15.38:0/1763732136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0cf8140300 0x7f0cf8140700 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0cf00032b0 tx=0x7f0cf00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.755 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.732+0000 7f0cf7fff700 1 --2- 172.21.15.38:0/1763732136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0cf8140300 0x7f0cf8140700 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0cf00032b0 tx=0x7f0cf00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.755 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.733+0000 7f0cf7fff700 1 --2- 172.21.15.38:0/1763732136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0cf8140300 0x7f0cf8140700 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f0cf00032b0 tx=0x7f0cf00081e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:09.755 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.733+0000 7f0cf7fff700 1 --2- 172.21.15.38:0/1763732136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0cf8140300 0x7f0cf8140700 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f0cf00032b0 tx=0x7f0cf00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.756 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.733+0000 7f0cf4ff9700 1 -- 172.21.15.38:0/1763732136 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cf000a5c0 con 0x7f0cf8140300 2020-06-12T17:51:09.756 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.733+0000 7f0cf7fff700 1 --2- 172.21.15.38:0/1763732136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0cf8140300 0x7f0cf8140700 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f0cf00032b0 tx=0x7f0cf00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.756 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.733+0000 7f0cfe054700 1 -- 172.21.15.38:0/1763732136 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf8145fa0 con 0x7f0cf8140300 2020-06-12T17:51:09.756 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.733+0000 7f0cf4ff9700 1 -- 172.21.15.38:0/1763732136 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf0005c30 con 0x7f0cf8140300 2020-06-12T17:51:09.756 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.733+0000 7f0cf7fff700 1 --2- 172.21.15.38:0/1763732136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0cf8140300 0x7f0cf8140700 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f0cf00032b0 tx=0x7f0cf00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.733+0000 7f0cf4ff9700 1 -- 172.21.15.38:0/1763732136 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cf0005da0 con 0x7f0cf8140300 2020-06-12T17:51:09.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.733+0000 7f0cfe054700 1 -- 172.21.15.38:0/1763732136 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf8145a90 con 0x7f0cf8140300 2020-06-12T17:51:09.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.734+0000 7f0cf7fff700 1 --2- 172.21.15.38:0/1763732136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0cf8140300 0x7f0cf8140700 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f0cf00032b0 tx=0x7f0cf00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.734+0000 7f0cfe054700 1 -- 172.21.15.38:0/1763732136 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf8056c30 con 0x7f0cf8140300 2020-06-12T17:51:09.757 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.734+0000 7f0cf7fff700 1 --2- 172.21.15.38:0/1763732136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0cf8140300 0x7f0cf8140700 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f0cf00032b0 tx=0x7f0cf00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.734+0000 7f0cf4ff9700 1 -- 172.21.15.38:0/1763732136 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f0cf0007340 con 0x7f0cf8140300 2020-06-12T17:51:09.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.734+0000 7f0cf4ff9700 1 --2- 172.21.15.38:0/1763732136 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0cd804d640 0x7f0cd804fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:09.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.734+0000 7f0cf4ff9700 1 -- 172.21.15.38:0/1763732136 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0cf0061b60 con 0x7f0cf8140300 2020-06-12T17:51:09.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.734+0000 7f0cf77fe700 1 --2- 172.21.15.38:0/1763732136 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0cd804d640 0x7f0cd804fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:09.758 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.735+0000 7f0cf77fe700 1 --2- 172.21.15.38:0/1763732136 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0cd804d640 0x7f0cd804fb00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0ce8003070 tx=0x7f0ce8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.735+0000 7f0cf77fe700 1 --2- 172.21.15.38:0/1763732136 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0cd804d640 0x7f0cd804fb00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0ce8003070 tx=0x7f0ce8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.735+0000 7f0cf77fe700 1 --2- 172.21.15.38:0/1763732136 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0cd804d640 0x7f0cd804fb00 secure :-1 s=READY pgs=311 cs=0 l=1 rx=0x7f0ce8003070 tx=0x7f0ce8007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:09.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.738+0000 7f0cf7fff700 1 --2- 172.21.15.38:0/1763732136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0cf8140300 0x7f0cf8140700 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f0cf00032b0 tx=0x7f0cf00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.759 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.738+0000 7f0cf4ff9700 1 -- 172.21.15.38:0/1763732136 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f0cf003d2e0 con 0x7f0cf8140300 2020-06-12T17:51:09.935 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.932+0000 7f0cfe054700 1 -- 172.21.15.38:0/1763732136 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_4313", "target": ["mon-mgr", ""]}) v1 -- 0x7f0cf809c2e0 con 0x7f0cd804d640 2020-06-12T17:51:09.938 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.935+0000 7f0cf77fe700 1 --2- 172.21.15.38:0/1763732136 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0cd804d640 0x7f0cd804fb00 secure :-1 s=THROTTLE_DONE pgs=311 cs=0 l=1 rx=0x7f0ce8003070 tx=0x7f0ce8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:09.939 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.935+0000 7f0cf4ff9700 1 -- 172.21.15.38:0/1763732136 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f0cf809c2e0 con 0x7f0cd804d640 2020-06-12T17:51:09.939 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_4313/a21804b6-c9dd-41ee-a603-a2f02e0bc4aa 2020-06-12T17:51:09.940 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.936+0000 7f0cfe054700 1 -- 172.21.15.38:0/1763732136 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0cd804d640 msgr2=0x7f0cd804fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:09.940 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.936+0000 7f0cfe054700 1 --2- 172.21.15.38:0/1763732136 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0cd804d640 0x7f0cd804fb00 secure :-1 s=READY pgs=311 cs=0 l=1 rx=0x7f0ce8003070 tx=0x7f0ce8007e60).stop 2020-06-12T17:51:09.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.936+0000 7f0cfe054700 1 -- 172.21.15.38:0/1763732136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0cf8140300 msgr2=0x7f0cf8140700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:09.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.936+0000 7f0cfe054700 1 --2- 172.21.15.38:0/1763732136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0cf8140300 0x7f0cf8140700 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f0cf00032b0 tx=0x7f0cf00081e0).stop 2020-06-12T17:51:09.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.936+0000 7f0cfe054700 1 -- 172.21.15.38:0/1763732136 shutdown_connections 2020-06-12T17:51:09.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.936+0000 7f0cfe054700 1 --2- 172.21.15.38:0/1763732136 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0cd804d640 0x7f0cd804fb00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:09.941 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.936+0000 7f0cfe054700 1 --2- 172.21.15.38:0/1763732136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0cf8140300 0x7f0cf8140700 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:09.942 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.936+0000 7f0cfe054700 1 --2- 172.21.15.38:0/1763732136 >> v2:172.21.15.150:3300/0 conn(0x7f0cf809e400 0x7f0cf8156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:09.942 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.936+0000 7f0cfe054700 1 -- 172.21.15.38:0/1763732136 >> 172.21.15.38:0/1763732136 conn(0x7f0cf80b5a20 msgr2=0x7f0cf80b6390 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:09.942 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.936+0000 7f0cfe054700 1 -- 172.21.15.38:0/1763732136 shutdown_connections 2020-06-12T17:51:09.943 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:09.936+0000 7f0cfe054700 1 -- 172.21.15.38:0/1763732136 wait complete. 2020-06-12T17:51:09.950 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_4313 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_4313/a21804b6-c9dd-41ee-a603-a2f02e0bc4aa 2020-06-12T17:51:09.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:09.951 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:09.951 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:09.967 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:09.968 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:09.968 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4313/a21804b6-c9dd-41ee-a603-a2f02e0bc4aa/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:10.060 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:10.060 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:10.061 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112121 s, 93.5 MB/s 2020-06-12T17:51:10.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:10.062 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:10.063 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:10.077 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:10.078 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:10.078 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4313/a21804b6-c9dd-41ee-a603-a2f02e0bc4aa/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:10.167 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:10.168 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:10.168 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012086 s, 86.8 MB/s 2020-06-12T17:51:10.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:10.169 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:10.170 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:10.185 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:10.186 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:10.186 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4313/a21804b6-c9dd-41ee-a603-a2f02e0bc4aa/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:10.279 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:10.280 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:10.280 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955103 s, 110 MB/s 2020-06-12T17:51:10.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:10.281 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:10.282 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:10.341 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:10.341 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:10.342 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4313/a21804b6-c9dd-41ee-a603-a2f02e0bc4aa/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:10.432 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:10.432 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:10.432 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140809 s, 74.5 MB/s 2020-06-12T17:51:10.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:10.434 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:10.434 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:10.449 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:10.450 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:10.450 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4313/a21804b6-c9dd-41ee-a603-a2f02e0bc4aa/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:10.544 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:10.545 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:10.545 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112158 s, 93.5 MB/s 2020-06-12T17:51:10.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:10.546 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:10.546 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:10.561 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:10.562 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:10.562 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4313/a21804b6-c9dd-41ee-a603-a2f02e0bc4aa/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:10.646 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:10.646 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:10.647 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011297 s, 92.8 MB/s 2020-06-12T17:51:10.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:10.649 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:10.649 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:10.664 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:10.665 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:10.665 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4313/a21804b6-c9dd-41ee-a603-a2f02e0bc4aa/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:10.753 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:10.753 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:10.754 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112617 s, 93.1 MB/s 2020-06-12T17:51:10.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:10.755 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:10.756 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:10.772 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:10.773 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:10.774 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4313/a21804b6-c9dd-41ee-a603-a2f02e0bc4aa/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:10.862 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:10.862 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:10.863 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012112 s, 86.6 MB/s 2020-06-12T17:51:10.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:10.864 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:10.865 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:10.880 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:10.881 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:10.881 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4313/a21804b6-c9dd-41ee-a603-a2f02e0bc4aa/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:10.972 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:10.972 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:10.973 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116501 s, 90.0 MB/s 2020-06-12T17:51:10.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:10.974 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:10.974 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:10.991 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:10.991 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:10.992 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4313/a21804b6-c9dd-41ee-a603-a2f02e0bc4aa/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:11.080 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:11.080 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:11.080 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115714 s, 90.6 MB/s 2020-06-12T17:51:11.082 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_9868 2020-06-12T17:51:11.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.196+0000 7fc987e08700 1 Processor -- start 2020-06-12T17:51:11.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.196+0000 7fc987e08700 1 -- start start 2020-06-12T17:51:11.203 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.197+0000 7fc987e08700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc980146680 0x7fc9800ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:11.203 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.197+0000 7fc987e08700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc9800b2eb0 0x7fc98009d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:11.203 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.197+0000 7fc987e08700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc980146d20 con 0x7fc98009d620 2020-06-12T17:51:11.204 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.197+0000 7fc987e08700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc980066a80 con 0x7fc980146680 2020-06-12T17:51:11.204 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.197+0000 7fc987e08700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc980146f50 con 0x7fc9800b2eb0 2020-06-12T17:51:11.204 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.197+0000 7fc985ba4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc980146680 0x7fc9800ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:11.204 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.197+0000 7fc9863a5700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc98009d620 0x7fc98009b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41338/0 (socket says 172.21.15.38:41338) 2020-06-12T17:51:11.205 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.197+0000 7fc9863a5700 1 -- 172.21.15.38:0/3877777929 learned_addr learned my addr 172.21.15.38:0/3877777929 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:11.205 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.198+0000 7fc9853a3700 1 --2- 172.21.15.38:0/3877777929 >> v2:172.21.15.150:3300/0 conn(0x7fc9800b2eb0 0x7fc98009d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:11.205 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.198+0000 7fc985ba4700 1 -- 172.21.15.38:0/3877777929 >> v2:172.21.15.150:3300/0 conn(0x7fc9800b2eb0 msgr2=0x7fc98009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:11.205 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.198+0000 7fc985ba4700 1 --2- 172.21.15.38:0/3877777929 >> v2:172.21.15.150:3300/0 conn(0x7fc9800b2eb0 0x7fc98009d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:11.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.198+0000 7fc984ba2700 1 -- 172.21.15.38:0/3877777929 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518920502 0 0) 0x7fc980146d20 con 0x7fc98009d620 2020-06-12T17:51:11.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.198+0000 7fc985ba4700 1 -- 172.21.15.38:0/3877777929 >> v1:172.21.15.38:6789/0 conn(0x7fc98009d620 legacy=0x7fc98009b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:11.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.198+0000 7fc985ba4700 1 -- 172.21.15.38:0/3877777929 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc980146a60 con 0x7fc980146680 2020-06-12T17:51:11.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.198+0000 7fc9853a3700 1 --2- 172.21.15.38:0/3877777929 >> v2:172.21.15.150:3300/0 conn(0x7fc9800b2eb0 0x7fc98009d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:51:11.206 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.198+0000 7fc985ba4700 1 --2- 172.21.15.38:0/3877777929 >> v2:172.21.15.38:3300/0 conn(0x7fc980146680 0x7fc9800ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc970002f30 tx=0x7fc970007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.198+0000 7fc985ba4700 1 --2- 172.21.15.38:0/3877777929 >> v2:172.21.15.38:3300/0 conn(0x7fc980146680 0x7fc9800ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc970002f30 tx=0x7fc970007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.198+0000 7fc985ba4700 1 --2- 172.21.15.38:0/3877777929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc980146680 0x7fc9800ad5b0 secure :-1 s=READY pgs=802 cs=0 l=1 rx=0x7fc970002f30 tx=0x7fc970007e60).ready entity=mon.0 client_cookie=c2f9b6d824c2baec server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:11.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.198+0000 7fc985ba4700 1 --2- 172.21.15.38:0/3877777929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc980146680 0x7fc9800ad5b0 secure :-1 s=THROTTLE_DONE pgs=802 cs=0 l=1 rx=0x7fc970002f30 tx=0x7fc970007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.198+0000 7fc984ba2700 1 -- 172.21.15.38:0/3877777929 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc970011430 con 0x7fc980146680 2020-06-12T17:51:11.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.198+0000 7fc985ba4700 1 --2- 172.21.15.38:0/3877777929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc980146680 0x7fc9800ad5b0 secure :-1 s=THROTTLE_DONE pgs=802 cs=0 l=1 rx=0x7fc970002f30 tx=0x7fc970007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.198+0000 7fc985ba4700 1 --2- 172.21.15.38:0/3877777929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc980146680 0x7fc9800ad5b0 secure :-1 s=THROTTLE_DONE pgs=802 cs=0 l=1 rx=0x7fc970002f30 tx=0x7fc970007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.198+0000 7fc984ba2700 1 -- 172.21.15.38:0/3877777929 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc970011590 con 0x7fc980146680 2020-06-12T17:51:11.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.198+0000 7fc984ba2700 1 -- 172.21.15.38:0/3877777929 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc970011930 con 0x7fc980146680 2020-06-12T17:51:11.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.198+0000 7fc987e08700 1 -- 172.21.15.38:0/3877777929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc980146680 msgr2=0x7fc9800ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:11.208 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.198+0000 7fc987e08700 1 --2- 172.21.15.38:0/3877777929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc980146680 0x7fc9800ad5b0 secure :-1 s=READY pgs=802 cs=0 l=1 rx=0x7fc970002f30 tx=0x7fc970007e60).stop 2020-06-12T17:51:11.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.198+0000 7fc987e08700 1 -- 172.21.15.38:0/3877777929 shutdown_connections 2020-06-12T17:51:11.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.198+0000 7fc987e08700 1 --2- 172.21.15.38:0/3877777929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc980146680 0x7fc9800ad5b0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:11.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.198+0000 7fc987e08700 1 --2- 172.21.15.38:0/3877777929 >> v2:172.21.15.150:3300/0 conn(0x7fc9800b2eb0 0x7fc98009d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:11.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.198+0000 7fc987e08700 1 -- 172.21.15.38:0/3877777929 >> 172.21.15.38:0/3877777929 conn(0x7fc9800b5a20 msgr2=0x7fc98005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:11.209 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.199+0000 7fc987e08700 1 -- 172.21.15.38:0/3877777929 shutdown_connections 2020-06-12T17:51:11.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.199+0000 7fc987e08700 1 -- 172.21.15.38:0/3877777929 wait complete. 2020-06-12T17:51:11.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.199+0000 7fc987e08700 1 Processor -- start 2020-06-12T17:51:11.210 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.200+0000 7fc987e08700 1 -- start start 2020-06-12T17:51:11.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.200+0000 7fc987e08700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc98009d620 0x7fc980065fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:11.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.200+0000 7fc987e08700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9800b2eb0 0x7fc980152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:11.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.200+0000 7fc987e08700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc980153140 con 0x7fc980146680 2020-06-12T17:51:11.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.200+0000 7fc987e08700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc980065c50 con 0x7fc98009d620 2020-06-12T17:51:11.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.200+0000 7fc987e08700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc980156c70 con 0x7fc9800b2eb0 2020-06-12T17:51:11.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.200+0000 7fc9863a5700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc980146680 0x7fc9800b3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41348/0 (socket says 172.21.15.38:41348) 2020-06-12T17:51:11.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.200+0000 7fc9863a5700 1 -- 172.21.15.38:0/2429180112 learned_addr learned my addr 172.21.15.38:0/2429180112 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:11.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.200+0000 7fc96effd700 1 -- 172.21.15.38:0/2429180112 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156783013 0 0) 0x7fc978001030 con 0x7fc980146680 2020-06-12T17:51:11.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc96effd700 1 -- 172.21.15.38:0/2429180112 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc960002fe0 con 0x7fc980146680 2020-06-12T17:51:11.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc985ba4700 1 --2- 172.21.15.38:0/2429180112 >> v2:172.21.15.150:3300/0 conn(0x7fc98009d620 0x7fc980065fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:11.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc9853a3700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9800b2eb0 0x7fc980152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:11.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc96effd700 1 -- 172.21.15.38:0/2429180112 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2253788667 0 0) 0x7fc960002fe0 con 0x7fc980146680 2020-06-12T17:51:11.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc96effd700 1 -- 172.21.15.38:0/2429180112 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc960003920 con 0x7fc980146680 2020-06-12T17:51:11.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc96effd700 1 -- 172.21.15.38:0/2429180112 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fc978001960 con 0x7fc980146680 2020-06-12T17:51:11.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc96effd700 1 -- 172.21.15.38:0/2429180112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9800b2eb0 msgr2=0x7fc980152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:11.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc96effd700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9800b2eb0 0x7fc980152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:11.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc96effd700 1 -- 172.21.15.38:0/2429180112 >> v2:172.21.15.150:3300/0 conn(0x7fc98009d620 msgr2=0x7fc980065fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:11.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc96effd700 1 --2- 172.21.15.38:0/2429180112 >> v2:172.21.15.150:3300/0 conn(0x7fc98009d620 0x7fc980065fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:11.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc96effd700 1 -- 172.21.15.38:0/2429180112 >> v1:172.21.15.38:6789/0 conn(0x7fc980146680 legacy=0x7fc9800b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:11.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc96effd700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9800b2eb0 0x7fc960004c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:11.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc96effd700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc960005070 0x7fc960003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:11.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc96effd700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc960003f10 0x7fc960004390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:11.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc96effd700 1 -- 172.21.15.38:0/2429180112 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc980065c50 con 0x7fc960003f10 2020-06-12T17:51:11.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc96effd700 1 -- 172.21.15.38:0/2429180112 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc980156c70 con 0x7fc960005070 2020-06-12T17:51:11.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc96effd700 1 -- 172.21.15.38:0/2429180112 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600048d0 con 0x7fc9800b2eb0 2020-06-12T17:51:11.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc9863a5700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc960003f10 0x7fc960004390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:11.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc985ba4700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9800b2eb0 0x7fc960004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:11.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc9853a3700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc960005070 0x7fc960003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:11.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc9863a5700 1 -- 172.21.15.38:0/2429180112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9800b2eb0 msgr2=0x7fc960004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:11.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc9863a5700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9800b2eb0 0x7fc960004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:11.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc9863a5700 1 -- 172.21.15.38:0/2429180112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc960005070 msgr2=0x7fc960003ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:11.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc9863a5700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc960005070 0x7fc960003ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:11.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc9863a5700 1 -- 172.21.15.38:0/2429180112 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc980156f10 con 0x7fc960003f10 2020-06-12T17:51:11.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc987e08700 1 -- 172.21.15.38:0/2429180112 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9801571b0 con 0x7fc960003f10 2020-06-12T17:51:11.222 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc9853a3700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc960005070 0x7fc960003ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:51:11.222 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc9863a5700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc960003f10 0x7fc960004390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc978005540 tx=0x7fc97800ea50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.222 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.201+0000 7fc987e08700 1 -- 172.21.15.38:0/2429180112 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9800b24b0 con 0x7fc960003f10 2020-06-12T17:51:11.222 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.202+0000 7fc9863a5700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc960003f10 0x7fc960004390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc978005540 tx=0x7fc97800ea50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.202+0000 7fc9863a5700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc960003f10 0x7fc960004390 secure :-1 s=READY pgs=804 cs=0 l=1 rx=0x7fc978005540 tx=0x7fc97800ea50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:11.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.202+0000 7fc9863a5700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc960003f10 0x7fc960004390 secure :-1 s=THROTTLE_DONE pgs=804 cs=0 l=1 rx=0x7fc978005540 tx=0x7fc97800ea50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.202+0000 7fc9863a5700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc960003f10 0x7fc960004390 secure :-1 s=THROTTLE_DONE pgs=804 cs=0 l=1 rx=0x7fc978005540 tx=0x7fc97800ea50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.202+0000 7fc96effd700 1 -- 172.21.15.38:0/2429180112 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc978011db0 con 0x7fc960003f10 2020-06-12T17:51:11.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.202+0000 7fc9863a5700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc960003f10 0x7fc960004390 secure :-1 s=THROTTLE_DONE pgs=804 cs=0 l=1 rx=0x7fc978005540 tx=0x7fc97800ea50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.224 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.202+0000 7fc96effd700 1 -- 172.21.15.38:0/2429180112 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97800b070 con 0x7fc960003f10 2020-06-12T17:51:11.224 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.202+0000 7fc96effd700 1 -- 172.21.15.38:0/2429180112 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc97800b450 con 0x7fc960003f10 2020-06-12T17:51:11.224 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.202+0000 7fc9863a5700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc960003f10 0x7fc960004390 secure :-1 s=THROTTLE_DONE pgs=804 cs=0 l=1 rx=0x7fc978005540 tx=0x7fc97800ea50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.224 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.203+0000 7fc96effd700 1 -- 172.21.15.38:0/2429180112 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fc97800a650 con 0x7fc960003f10 2020-06-12T17:51:11.225 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.203+0000 7fc9863a5700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc960003f10 0x7fc960004390 secure :-1 s=THROTTLE_DONE pgs=804 cs=0 l=1 rx=0x7fc978005540 tx=0x7fc97800ea50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.225 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.203+0000 7fc987e08700 1 -- 172.21.15.38:0/2429180112 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc980157340 con 0x7fc960003f10 2020-06-12T17:51:11.225 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.203+0000 7fc96effd700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc9600557a0 0x7fc960057c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:11.225 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.203+0000 7fc96effd700 1 -- 172.21.15.38:0/2429180112 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc978061020 con 0x7fc960003f10 2020-06-12T17:51:11.226 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.203+0000 7fc985ba4700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc9600557a0 0x7fc960057c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:11.226 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.203+0000 7fc985ba4700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc9600557a0 0x7fc960057c60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc970002f30 tx=0x7fc970007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.226 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.204+0000 7fc985ba4700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc9600557a0 0x7fc960057c60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc970002f30 tx=0x7fc970007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.227 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.204+0000 7fc985ba4700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc9600557a0 0x7fc960057c60 secure :-1 s=READY pgs=312 cs=0 l=1 rx=0x7fc970002f30 tx=0x7fc970007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:11.227 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.207+0000 7fc9863a5700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc960003f10 0x7fc960004390 secure :-1 s=THROTTLE_DONE pgs=804 cs=0 l=1 rx=0x7fc978005540 tx=0x7fc97800ea50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.227 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.207+0000 7fc96effd700 1 -- 172.21.15.38:0/2429180112 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fc97803c740 con 0x7fc960003f10 2020-06-12T17:51:11.406 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.403+0000 7fc987e08700 1 -- 172.21.15.38:0/2429180112 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_9868", "target": ["mon-mgr", ""]}) v1 -- 0x7fc980067b20 con 0x7fc9600557a0 2020-06-12T17:51:11.426 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.422+0000 7fc985ba4700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc9600557a0 0x7fc960057c60 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7fc970002f30 tx=0x7fc970007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.422+0000 7fc96effd700 1 -- 172.21.15.38:0/2429180112 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc980067b20 con 0x7fc9600557a0 2020-06-12T17:51:11.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.424+0000 7fc987e08700 1 -- 172.21.15.38:0/2429180112 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc9600557a0 msgr2=0x7fc960057c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:11.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.424+0000 7fc987e08700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fc9600557a0 0x7fc960057c60 secure :-1 s=READY pgs=312 cs=0 l=1 rx=0x7fc970002f30 tx=0x7fc970007e60).stop 2020-06-12T17:51:11.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.424+0000 7fc987e08700 1 -- 172.21.15.38:0/2429180112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc960003f10 msgr2=0x7fc960004390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:11.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.424+0000 7fc987e08700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc960003f10 0x7fc960004390 secure :-1 s=READY pgs=804 cs=0 l=1 rx=0x7fc978005540 tx=0x7fc97800ea50).stop 2020-06-12T17:51:11.432 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.424+0000 7fc9863a5700 1 -- 172.21.15.38:0/2429180112 reap_dead start 2020-06-12T17:51:11.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.424+0000 7fc987e08700 1 -- 172.21.15.38:0/2429180112 shutdown_connections 2020-06-12T17:51:11.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.424+0000 7fc987e08700 1 --2- 172.21.15.38:0/2429180112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc960003f10 0x7fc960004390 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:11.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.424+0000 7fc987e08700 1 -- 172.21.15.38:0/2429180112 >> 172.21.15.38:0/2429180112 conn(0x7fc9800b5a20 msgr2=0x7fc980145960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:11.433 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.424+0000 7fc987e08700 1 -- 172.21.15.38:0/2429180112 shutdown_connections 2020-06-12T17:51:11.434 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.424+0000 7fc987e08700 1 -- 172.21.15.38:0/2429180112 wait complete. 2020-06-12T17:51:11.438 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_9868 2020-06-12T17:51:11.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.552+0000 7f731cd05700 1 Processor -- start 2020-06-12T17:51:11.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.552+0000 7f731cd05700 1 -- start start 2020-06-12T17:51:11.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.553+0000 7f731cd05700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f731809e400 0x7f73180b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:11.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.553+0000 7f731cd05700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7318146400 con 0x7f7318140300 2020-06-12T17:51:11.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.553+0000 7f731cd05700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73181466a0 con 0x7f73180b2eb0 2020-06-12T17:51:11.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.553+0000 7f731cd05700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f731809c7c0 con 0x7f731809e400 2020-06-12T17:51:11.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.553+0000 7f731659c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7318140300 0x7f73180b19c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41358/0 (socket says 172.21.15.38:41358) 2020-06-12T17:51:11.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.553+0000 7f731659c700 1 -- 172.21.15.38:0/50151387 learned_addr learned my addr 172.21.15.38:0/50151387 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:11.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.553+0000 7f730ffff700 1 --2- 172.21.15.38:0/50151387 >> v2:172.21.15.150:3300/0 conn(0x7f731809e400 0x7f73180b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:11.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.553+0000 7f7315d9b700 1 -- 172.21.15.38:0/50151387 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3535790080 0 0) 0x7f7318146400 con 0x7f7318140300 2020-06-12T17:51:11.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.553+0000 7f7315d9b700 1 -- 172.21.15.38:0/50151387 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72f8003230 con 0x7f7318140300 2020-06-12T17:51:11.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.553+0000 7f7315d9b700 1 -- 172.21.15.38:0/50151387 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834026251 0 0) 0x7f73181466a0 con 0x7f73180b2eb0 2020-06-12T17:51:11.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.553+0000 7f7315d9b700 1 -- 172.21.15.38:0/50151387 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7318146400 con 0x7f73180b2eb0 2020-06-12T17:51:11.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.553+0000 7f730ffff700 1 -- 172.21.15.38:0/50151387 >> v1:172.21.15.150:6789/0 conn(0x7f73180b2eb0 legacy=0x7f73180b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:11.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.553+0000 7f730ffff700 1 -- 172.21.15.38:0/50151387 >> v1:172.21.15.38:6789/0 conn(0x7f7318140300 legacy=0x7f73180b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:11.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.553+0000 7f7315d9b700 1 -- 172.21.15.38:0/50151387 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3913007123 0 0) 0x7f72f8003230 con 0x7f7318140300 2020-06-12T17:51:11.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.553+0000 7f730ffff700 1 -- 172.21.15.38:0/50151387 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7318146940 con 0x7f731809e400 2020-06-12T17:51:11.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.553+0000 7f730ffff700 1 --2- 172.21.15.38:0/50151387 >> v2:172.21.15.150:3300/0 conn(0x7f731809e400 0x7f73180b2820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f73080010d0 tx=0x7f7300007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.553+0000 7f730ffff700 1 --2- 172.21.15.38:0/50151387 >> v2:172.21.15.150:3300/0 conn(0x7f731809e400 0x7f73180b2820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f73080010d0 tx=0x7f7300007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.553+0000 7f730ffff700 1 --2- 172.21.15.38:0/50151387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f731809e400 0x7f73180b2820 secure :-1 s=READY pgs=444 cs=0 l=1 rx=0x7f73080010d0 tx=0x7f7300007e60).ready entity=mon.1 client_cookie=974801a813abd948 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:11.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.554+0000 7f730ffff700 1 --2- 172.21.15.38:0/50151387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f731809e400 0x7f73180b2820 secure :-1 s=THROTTLE_DONE pgs=444 cs=0 l=1 rx=0x7f73080010d0 tx=0x7f7300007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.554+0000 7f7315d9b700 1 -- 172.21.15.38:0/50151387 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73080016d0 con 0x7f731809e400 2020-06-12T17:51:11.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.554+0000 7f730ffff700 1 --2- 172.21.15.38:0/50151387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f731809e400 0x7f73180b2820 secure :-1 s=THROTTLE_DONE pgs=444 cs=0 l=1 rx=0x7f73080010d0 tx=0x7f7300007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.554+0000 7f7315d9b700 1 -- 172.21.15.38:0/50151387 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7300008cb0 con 0x7f731809e400 2020-06-12T17:51:11.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.554+0000 7f730ffff700 1 --2- 172.21.15.38:0/50151387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f731809e400 0x7f73180b2820 secure :-1 s=THROTTLE_DONE pgs=444 cs=0 l=1 rx=0x7f73080010d0 tx=0x7f7300007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.554+0000 7f7315d9b700 1 -- 172.21.15.38:0/50151387 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7300008e20 con 0x7f731809e400 2020-06-12T17:51:11.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.554+0000 7f731cd05700 1 -- 172.21.15.38:0/50151387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f731809e400 msgr2=0x7f73180b2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:11.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.554+0000 7f731cd05700 1 --2- 172.21.15.38:0/50151387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f731809e400 0x7f73180b2820 secure :-1 s=READY pgs=444 cs=0 l=1 rx=0x7f73080010d0 tx=0x7f7300007e60).stop 2020-06-12T17:51:11.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.554+0000 7f731cd05700 1 -- 172.21.15.38:0/50151387 shutdown_connections 2020-06-12T17:51:11.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.554+0000 7f731cd05700 1 --2- 172.21.15.38:0/50151387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f731809e400 0x7f73180b2820 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:11.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.554+0000 7f731cd05700 1 -- 172.21.15.38:0/50151387 >> 172.21.15.38:0/50151387 conn(0x7f73180b5a20 msgr2=0x7f731805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:11.573 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.554+0000 7f731cd05700 1 -- 172.21.15.38:0/50151387 shutdown_connections 2020-06-12T17:51:11.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.554+0000 7f731cd05700 1 -- 172.21.15.38:0/50151387 wait complete. 2020-06-12T17:51:11.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.555+0000 7f731cd05700 1 Processor -- start 2020-06-12T17:51:11.574 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.555+0000 7f731cd05700 1 -- start start 2020-06-12T17:51:11.582 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.556+0000 7f731cd05700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f731809e400 0x7f7318141b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:11.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.556+0000 7f731cd05700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f73180b2eb0 0x7f7318061580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:11.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.556+0000 7f731cd05700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73180620c0 con 0x7f7318140300 2020-06-12T17:51:11.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.556+0000 7f731cd05700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7318141ff0 con 0x7f73180b2eb0 2020-06-12T17:51:11.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.556+0000 7f731cd05700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7318061e20 con 0x7f731809e400 2020-06-12T17:51:11.583 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.556+0000 7f7316d9d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7318140300 0x7f7318063490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41368/0 (socket says 172.21.15.38:41368) 2020-06-12T17:51:11.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.556+0000 7f7316d9d700 1 -- 172.21.15.38:0/760613571 learned_addr learned my addr 172.21.15.38:0/760613571 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:11.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.556+0000 7f730f7fe700 1 -- 172.21.15.38:0/760613571 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3159926209 0 0) 0x7f73180620c0 con 0x7f7318140300 2020-06-12T17:51:11.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.556+0000 7f730ffff700 1 --2- 172.21.15.38:0/760613571 >> v2:172.21.15.150:3300/0 conn(0x7f73180b2eb0 0x7f7318061580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:11.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.556+0000 7f730f7fe700 1 -- 172.21.15.38:0/760613571 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72fc002fe0 con 0x7f7318140300 2020-06-12T17:51:11.584 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.556+0000 7f731659c700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f731809e400 0x7f7318141b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:11.585 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.556+0000 7f730f7fe700 1 -- 172.21.15.38:0/760613571 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1077702756 0 0) 0x7f72fc002fe0 con 0x7f7318140300 2020-06-12T17:51:11.585 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.556+0000 7f730f7fe700 1 -- 172.21.15.38:0/760613571 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f73180620c0 con 0x7f7318140300 2020-06-12T17:51:11.585 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.556+0000 7f730f7fe700 1 -- 172.21.15.38:0/760613571 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f7310001cc0 con 0x7f7318140300 2020-06-12T17:51:11.585 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.556+0000 7f730f7fe700 1 -- 172.21.15.38:0/760613571 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f731809e400 msgr2=0x7f7318141b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:11.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.556+0000 7f730f7fe700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f731809e400 0x7f7318141b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:11.586 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.556+0000 7f730f7fe700 1 -- 172.21.15.38:0/760613571 >> v2:172.21.15.150:3300/0 conn(0x7f73180b2eb0 msgr2=0x7f7318061580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:11.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.556+0000 7f730f7fe700 1 --2- 172.21.15.38:0/760613571 >> v2:172.21.15.150:3300/0 conn(0x7f73180b2eb0 0x7f7318061580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:11.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.556+0000 7f730f7fe700 1 -- 172.21.15.38:0/760613571 >> v1:172.21.15.38:6789/0 conn(0x7f7318140300 legacy=0x7f7318063490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:11.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.556+0000 7f730f7fe700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f731809e400 0x7f72fc0049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:11.587 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.556+0000 7f730f7fe700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72fc004e10 0x7f72fc005230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:11.588 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.556+0000 7f730f7fe700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72fc003a30 0x7f72fc003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:11.588 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.557+0000 7f730f7fe700 1 -- 172.21.15.38:0/760613571 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7318141ff0 con 0x7f72fc003a30 2020-06-12T17:51:11.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.557+0000 7f730f7fe700 1 -- 172.21.15.38:0/760613571 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7318061e20 con 0x7f72fc004e10 2020-06-12T17:51:11.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.557+0000 7f730f7fe700 1 -- 172.21.15.38:0/760613571 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc004600 con 0x7f731809e400 2020-06-12T17:51:11.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.557+0000 7f730ffff700 1 --2- 172.21.15.38:0/760613571 >> v2:172.21.15.150:3300/0 conn(0x7f73180b2eb0 0x7f7318061580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:51:11.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.557+0000 7f7316d9d700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72fc003a30 0x7f72fc003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:11.589 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.557+0000 7f731659c700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f731809e400 0x7f72fc0049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:11.590 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.557+0000 7f730ffff700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72fc004e10 0x7f72fc005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:11.590 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.557+0000 7f7316d9d700 1 -- 172.21.15.38:0/760613571 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f731809e400 msgr2=0x7f72fc0049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:11.590 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.557+0000 7f7316d9d700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f731809e400 0x7f72fc0049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:11.590 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.557+0000 7f7316d9d700 1 -- 172.21.15.38:0/760613571 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72fc004e10 msgr2=0x7f72fc005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:11.590 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.557+0000 7f7316d9d700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72fc004e10 0x7f72fc005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:11.591 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.557+0000 7f7316d9d700 1 -- 172.21.15.38:0/760613571 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7318153870 con 0x7f72fc003a30 2020-06-12T17:51:11.591 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.557+0000 7f731cd05700 1 -- 172.21.15.38:0/760613571 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7318063ba0 con 0x7f72fc003a30 2020-06-12T17:51:11.591 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.557+0000 7f731659c700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f731809e400 0x7f72fc0049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:51:11.591 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.557+0000 7f7316d9d700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72fc003a30 0x7f72fc003eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f73100013a0 tx=0x7f731000ed00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.591 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.557+0000 7f731cd05700 1 -- 172.21.15.38:0/760613571 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7318061ba0 con 0x7f72fc003a30 2020-06-12T17:51:11.592 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.557+0000 7f7316d9d700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72fc003a30 0x7f72fc003eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f73100013a0 tx=0x7f731000ed00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.592 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.557+0000 7f7316d9d700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72fc003a30 0x7f72fc003eb0 secure :-1 s=READY pgs=807 cs=0 l=1 rx=0x7f73100013a0 tx=0x7f731000ed00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:11.592 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.557+0000 7f7316d9d700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72fc003a30 0x7f72fc003eb0 secure :-1 s=THROTTLE_DONE pgs=807 cs=0 l=1 rx=0x7f73100013a0 tx=0x7f731000ed00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.592 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.557+0000 7f730f7fe700 1 -- 172.21.15.38:0/760613571 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7310008630 con 0x7f72fc003a30 2020-06-12T17:51:11.592 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.557+0000 7f7316d9d700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72fc003a30 0x7f72fc003eb0 secure :-1 s=THROTTLE_DONE pgs=807 cs=0 l=1 rx=0x7f73100013a0 tx=0x7f731000ed00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.593 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.557+0000 7f730f7fe700 1 -- 172.21.15.38:0/760613571 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7310005850 con 0x7f72fc003a30 2020-06-12T17:51:11.593 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.557+0000 7f7316d9d700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72fc003a30 0x7f72fc003eb0 secure :-1 s=THROTTLE_DONE pgs=807 cs=0 l=1 rx=0x7f73100013a0 tx=0x7f731000ed00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.593 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.557+0000 7f730f7fe700 1 -- 172.21.15.38:0/760613571 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7310005bf0 con 0x7f72fc003a30 2020-06-12T17:51:11.593 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.558+0000 7f7316d9d700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72fc003a30 0x7f72fc003eb0 secure :-1 s=THROTTLE_DONE pgs=807 cs=0 l=1 rx=0x7f73100013a0 tx=0x7f731000ed00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.593 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.558+0000 7f7316d9d700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72fc003a30 0x7f72fc003eb0 secure :-1 s=THROTTLE_DONE pgs=807 cs=0 l=1 rx=0x7f73100013a0 tx=0x7f731000ed00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.594 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.558+0000 7f730f7fe700 1 -- 172.21.15.38:0/760613571 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f7310005d50 con 0x7f72fc003a30 2020-06-12T17:51:11.594 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.558+0000 7f731cd05700 1 -- 172.21.15.38:0/760613571 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f0003340 con 0x7f72fc003a30 2020-06-12T17:51:11.594 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.559+0000 7f730f7fe700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f72fc055810 0x7f72fc057cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:11.594 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.559+0000 7f730f7fe700 1 -- 172.21.15.38:0/760613571 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f73100619d0 con 0x7f72fc003a30 2020-06-12T17:51:11.594 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.559+0000 7f731659c700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f72fc055810 0x7f72fc057cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:11.595 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.559+0000 7f731659c700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f72fc055810 0x7f72fc057cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7308000fa0 tx=0x7f7308001ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.595 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.559+0000 7f731659c700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f72fc055810 0x7f72fc057cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7308000fa0 tx=0x7f7308001ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.595 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.559+0000 7f731659c700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f72fc055810 0x7f72fc057cd0 secure :-1 s=READY pgs=313 cs=0 l=1 rx=0x7f7308000fa0 tx=0x7f7308001ab0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:11.595 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.562+0000 7f7316d9d700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72fc003a30 0x7f72fc003eb0 secure :-1 s=THROTTLE_DONE pgs=807 cs=0 l=1 rx=0x7f73100013a0 tx=0x7f731000ed00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.596 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.562+0000 7f730f7fe700 1 -- 172.21.15.38:0/760613571 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f731003d130 con 0x7f72fc003a30 2020-06-12T17:51:11.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.763+0000 7f731cd05700 1 -- 172.21.15.38:0/760613571 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_9868", "target": ["mon-mgr", ""]}) v1 -- 0x7f72f0002200 con 0x7f72fc055810 2020-06-12T17:51:11.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.767+0000 7f731659c700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f72fc055810 0x7f72fc057cd0 secure :-1 s=THROTTLE_DONE pgs=313 cs=0 l=1 rx=0x7f7308000fa0 tx=0x7f7308001ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:11.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.767+0000 7f730f7fe700 1 -- 172.21.15.38:0/760613571 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f72f0002200 con 0x7f72fc055810 2020-06-12T17:51:11.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.768+0000 7f731cd05700 1 -- 172.21.15.38:0/760613571 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f72fc055810 msgr2=0x7f72fc057cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:11.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.768+0000 7f731cd05700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f72fc055810 0x7f72fc057cd0 secure :-1 s=READY pgs=313 cs=0 l=1 rx=0x7f7308000fa0 tx=0x7f7308001ab0).stop 2020-06-12T17:51:11.774 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.768+0000 7f731cd05700 1 -- 172.21.15.38:0/760613571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72fc003a30 msgr2=0x7f72fc003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:11.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.768+0000 7f731cd05700 1 --2- 172.21.15.38:0/760613571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72fc003a30 0x7f72fc003eb0 secure :-1 s=READY pgs=807 cs=0 l=1 rx=0x7f73100013a0 tx=0x7f731000ed00).stop 2020-06-12T17:51:11.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.768+0000 7f7316d9d700 1 -- 172.21.15.38:0/760613571 reap_dead start 2020-06-12T17:51:11.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.768+0000 7f7316d9d700 1 -- 172.21.15.38:0/760613571 reap_dead start 2020-06-12T17:51:11.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.768+0000 7f731cd05700 1 -- 172.21.15.38:0/760613571 shutdown_connections 2020-06-12T17:51:11.775 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.768+0000 7f731cd05700 1 -- 172.21.15.38:0/760613571 >> 172.21.15.38:0/760613571 conn(0x7f73180b5a20 msgr2=0x7f73180b68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:11.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.769+0000 7f731cd05700 1 -- 172.21.15.38:0/760613571 shutdown_connections 2020-06-12T17:51:11.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:11.769+0000 7f731cd05700 1 -- 172.21.15.38:0/760613571 wait complete. 2020-06-12T17:51:11.776 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_9868/4278aa4d-aaf4-4d65-a192-108845da52f1 2020-06-12T17:51:11.783 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_9868 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_9868/4278aa4d-aaf4-4d65-a192-108845da52f1 2020-06-12T17:51:11.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:11.784 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:11.785 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:11.799 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:11.800 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:11.801 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9868/4278aa4d-aaf4-4d65-a192-108845da52f1/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:11.899 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:11.899 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:11.899 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123617 s, 84.8 MB/s 2020-06-12T17:51:11.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:11.901 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:11.902 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:11.917 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:11.918 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:11.918 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9868/4278aa4d-aaf4-4d65-a192-108845da52f1/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:12.007 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:12.008 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:12.008 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108694 s, 96.5 MB/s 2020-06-12T17:51:12.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:12.010 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:12.010 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:12.040 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:12.041 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:12.042 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9868/4278aa4d-aaf4-4d65-a192-108845da52f1/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:12.128 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:12.128 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:12.128 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00958819 s, 109 MB/s 2020-06-12T17:51:12.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:12.130 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:12.131 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:12.146 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:12.146 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:12.147 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9868/4278aa4d-aaf4-4d65-a192-108845da52f1/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:12.252 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:12.253 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:12.253 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120516 s, 87.0 MB/s 2020-06-12T17:51:12.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:12.254 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:12.256 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:12.273 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:12.274 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:12.274 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9868/4278aa4d-aaf4-4d65-a192-108845da52f1/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:12.361 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:12.361 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:12.361 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113832 s, 92.1 MB/s 2020-06-12T17:51:12.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:12.363 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:12.364 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:12.390 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:12.391 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:12.392 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9868/4278aa4d-aaf4-4d65-a192-108845da52f1/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:12.485 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:12.485 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:12.485 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148999 s, 70.4 MB/s 2020-06-12T17:51:12.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:12.487 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:12.488 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:12.504 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:12.504 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:12.505 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9868/4278aa4d-aaf4-4d65-a192-108845da52f1/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:12.589 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:12.590 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:12.590 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00896051 s, 117 MB/s 2020-06-12T17:51:12.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:12.592 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:12.592 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:12.607 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:12.607 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:12.608 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9868/4278aa4d-aaf4-4d65-a192-108845da52f1/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:12.695 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:12.696 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:12.696 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102918 s, 102 MB/s 2020-06-12T17:51:12.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:12.699 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:12.699 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:12.715 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:12.715 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:12.717 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9868/4278aa4d-aaf4-4d65-a192-108845da52f1/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:12.803 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:12.803 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:12.804 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113519 s, 92.4 MB/s 2020-06-12T17:51:12.805 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:12.805 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:12.806 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:12.821 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:12.821 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:12.822 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_9868/4278aa4d-aaf4-4d65-a192-108845da52f1/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:12.910 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:12.911 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:12.911 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118207 s, 88.7 MB/s 2020-06-12T17:51:12.913 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_1236 2020-06-12T17:51:13.035 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.031+0000 7f0c5ed9b700 1 Processor -- start 2020-06-12T17:51:13.036 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.031+0000 7f0c5ed9b700 1 -- start start 2020-06-12T17:51:13.047 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.032+0000 7f0c5ed9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0c580ad5b0 0x7f0c580b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:13.047 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.032+0000 7f0c5ed9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0c5809d8d0 0x7f0c581421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:13.048 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.032+0000 7f0c5ed9b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c58146d20 con 0x7f0c58146680 2020-06-12T17:51:13.048 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.032+0000 7f0c5ed9b700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c58066a80 con 0x7f0c580ad5b0 2020-06-12T17:51:13.048 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.032+0000 7f0c5ed9b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c58146f50 con 0x7f0c5809d8d0 2020-06-12T17:51:13.049 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.032+0000 7f0c57fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0c580ad5b0 0x7f0c580b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:13.049 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.032+0000 7f0c57fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0c580ad5b0 0x7f0c580b2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39564/0 (socket says 172.21.15.38:39564) 2020-06-12T17:51:13.049 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.032+0000 7f0c57fff700 1 -- 172.21.15.38:0/2285190929 learned_addr learned my addr 172.21.15.38:0/2285190929 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:13.050 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.032+0000 7f0c5d338700 1 --2- 172.21.15.38:0/2285190929 >> v2:172.21.15.150:3300/0 conn(0x7f0c5809d8d0 0x7f0c581421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:13.050 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.033+0000 7f0c57fff700 1 -- 172.21.15.38:0/2285190929 >> v2:172.21.15.150:3300/0 conn(0x7f0c5809d8d0 msgr2=0x7f0c581421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:13.051 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.033+0000 7f0c57fff700 1 --2- 172.21.15.38:0/2285190929 >> v2:172.21.15.150:3300/0 conn(0x7f0c5809d8d0 0x7f0c581421d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:13.052 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.033+0000 7f0c57fff700 1 -- 172.21.15.38:0/2285190929 >> v1:172.21.15.150:6789/0 conn(0x7f0c58146680 legacy=0x7f0c5809d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:13.052 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.033+0000 7f0c57fff700 1 -- 172.21.15.38:0/2285190929 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c58146a60 con 0x7f0c580ad5b0 2020-06-12T17:51:13.052 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.033+0000 7f0c57fff700 1 --2- 172.21.15.38:0/2285190929 >> v2:172.21.15.38:3300/0 conn(0x7f0c580ad5b0 0x7f0c580b2eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0c4c002f30 tx=0x7f0c4c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.053 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.033+0000 7f0c57fff700 1 --2- 172.21.15.38:0/2285190929 >> v2:172.21.15.38:3300/0 conn(0x7f0c580ad5b0 0x7f0c580b2eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0c4c002f30 tx=0x7f0c4c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.053 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.033+0000 7f0c57fff700 1 --2- 172.21.15.38:0/2285190929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c580ad5b0 0x7f0c580b2eb0 secure :-1 s=READY pgs=808 cs=0 l=1 rx=0x7f0c4c002f30 tx=0x7f0c4c007e60).ready entity=mon.0 client_cookie=ed1b803c9c95cc56 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:13.053 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.033+0000 7f0c57fff700 1 --2- 172.21.15.38:0/2285190929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c580ad5b0 0x7f0c580b2eb0 secure :-1 s=THROTTLE_DONE pgs=808 cs=0 l=1 rx=0x7f0c4c002f30 tx=0x7f0c4c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.054 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.033+0000 7f0c577fe700 1 -- 172.21.15.38:0/2285190929 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c4c0116e0 con 0x7f0c580ad5b0 2020-06-12T17:51:13.054 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.033+0000 7f0c57fff700 1 --2- 172.21.15.38:0/2285190929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c580ad5b0 0x7f0c580b2eb0 secure :-1 s=THROTTLE_DONE pgs=808 cs=0 l=1 rx=0x7f0c4c002f30 tx=0x7f0c4c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.054 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.033+0000 7f0c577fe700 1 -- 172.21.15.38:0/2285190929 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4c011840 con 0x7f0c580ad5b0 2020-06-12T17:51:13.055 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.033+0000 7f0c57fff700 1 --2- 172.21.15.38:0/2285190929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c580ad5b0 0x7f0c580b2eb0 secure :-1 s=THROTTLE_DONE pgs=808 cs=0 l=1 rx=0x7f0c4c002f30 tx=0x7f0c4c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.055 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.033+0000 7f0c577fe700 1 -- 172.21.15.38:0/2285190929 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c4c011c20 con 0x7f0c580ad5b0 2020-06-12T17:51:13.055 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.033+0000 7f0c5ed9b700 1 -- 172.21.15.38:0/2285190929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c580ad5b0 msgr2=0x7f0c580b2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:13.056 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.033+0000 7f0c5ed9b700 1 --2- 172.21.15.38:0/2285190929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c580ad5b0 0x7f0c580b2eb0 secure :-1 s=READY pgs=808 cs=0 l=1 rx=0x7f0c4c002f30 tx=0x7f0c4c007e60).stop 2020-06-12T17:51:13.056 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.033+0000 7f0c5ed9b700 1 -- 172.21.15.38:0/2285190929 shutdown_connections 2020-06-12T17:51:13.056 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.033+0000 7f0c5ed9b700 1 --2- 172.21.15.38:0/2285190929 >> v2:172.21.15.150:3300/0 conn(0x7f0c5809d8d0 0x7f0c581421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:13.057 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.033+0000 7f0c5ed9b700 1 --2- 172.21.15.38:0/2285190929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c580ad5b0 0x7f0c580b2eb0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:13.057 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.033+0000 7f0c5ed9b700 1 -- 172.21.15.38:0/2285190929 >> 172.21.15.38:0/2285190929 conn(0x7f0c580b5a20 msgr2=0x7f0c5805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:13.057 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.033+0000 7f0c5ed9b700 1 -- 172.21.15.38:0/2285190929 shutdown_connections 2020-06-12T17:51:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.034+0000 7f0c5ed9b700 1 -- 172.21.15.38:0/2285190929 wait complete. 2020-06-12T17:51:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.034+0000 7f0c5ed9b700 1 Processor -- start 2020-06-12T17:51:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.034+0000 7f0c5ed9b700 1 -- start start 2020-06-12T17:51:13.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.035+0000 7f0c5ed9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0c5809d8d0 0x7f0c58141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:13.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.035+0000 7f0c5ed9b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c580ad5b0 0x7f0c58154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:13.059 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.035+0000 7f0c5ed9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0c58146680 0x7f0c58157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:13.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.035+0000 7f0c5ed9b700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c58153670 con 0x7f0c58146680 2020-06-12T17:51:13.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.035+0000 7f0c5ed9b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c58153910 con 0x7f0c5809d8d0 2020-06-12T17:51:13.060 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.035+0000 7f0c5ed9b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c58153bb0 con 0x7f0c580ad5b0 2020-06-12T17:51:13.061 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.035+0000 7f0c5d338700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0c58146680 0x7f0c58157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:13.061 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.035+0000 7f0c5d338700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0c58146680 0x7f0c58157470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39572/0 (socket says 172.21.15.38:39572) 2020-06-12T17:51:13.062 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.035+0000 7f0c5d338700 1 -- 172.21.15.38:0/4117577282 learned_addr learned my addr 172.21.15.38:0/4117577282 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:13.062 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.036+0000 7f0c5cb37700 1 --2- 172.21.15.38:0/4117577282 >> v2:172.21.15.150:3300/0 conn(0x7f0c5809d8d0 0x7f0c58141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:13.062 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.036+0000 7f0c57fff700 1 --2- 172.21.15.38:0/4117577282 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c580ad5b0 0x7f0c58154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:13.063 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.036+0000 7f0c5d338700 1 -- 172.21.15.38:0/4117577282 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c580ad5b0 msgr2=0x7f0c58154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:13.063 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.036+0000 7f0c5d338700 1 --2- 172.21.15.38:0/4117577282 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c580ad5b0 0x7f0c58154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:13.063 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.036+0000 7f0c5d338700 1 -- 172.21.15.38:0/4117577282 >> v2:172.21.15.150:3300/0 conn(0x7f0c5809d8d0 msgr2=0x7f0c58141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:13.064 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.036+0000 7f0c5d338700 1 --2- 172.21.15.38:0/4117577282 >> v2:172.21.15.150:3300/0 conn(0x7f0c5809d8d0 0x7f0c58141ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:13.064 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.036+0000 7f0c5d338700 1 -- 172.21.15.38:0/4117577282 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c581544b0 con 0x7f0c58146680 2020-06-12T17:51:13.064 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.036+0000 7f0c5cb37700 1 --2- 172.21.15.38:0/4117577282 >> v2:172.21.15.150:3300/0 conn(0x7f0c5809d8d0 0x7f0c58141ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:51:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.036+0000 7f0c5d338700 1 --2- 172.21.15.38:0/4117577282 >> v2:172.21.15.38:3300/0 conn(0x7f0c58146680 0x7f0c58157470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0c500032b0 tx=0x7f0c5000e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.036+0000 7f0c5d338700 1 --2- 172.21.15.38:0/4117577282 >> v2:172.21.15.38:3300/0 conn(0x7f0c58146680 0x7f0c58157470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0c500032b0 tx=0x7f0c5000e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.036+0000 7f0c5d338700 1 --2- 172.21.15.38:0/4117577282 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c58146680 0x7f0c58157470 secure :-1 s=READY pgs=809 cs=0 l=1 rx=0x7f0c500032b0 tx=0x7f0c5000e440).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:13.066 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.036+0000 7f0c5d338700 1 --2- 172.21.15.38:0/4117577282 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c58146680 0x7f0c58157470 secure :-1 s=THROTTLE_DONE pgs=809 cs=0 l=1 rx=0x7f0c500032b0 tx=0x7f0c5000e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.066 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.036+0000 7f0c55ffb700 1 -- 172.21.15.38:0/4117577282 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c50005e30 con 0x7f0c58146680 2020-06-12T17:51:13.067 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.036+0000 7f0c5d338700 1 --2- 172.21.15.38:0/4117577282 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c58146680 0x7f0c58157470 secure :-1 s=THROTTLE_DONE pgs=809 cs=0 l=1 rx=0x7f0c500032b0 tx=0x7f0c5000e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.067 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.036+0000 7f0c5d338700 1 --2- 172.21.15.38:0/4117577282 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c58146680 0x7f0c58157470 secure :-1 s=THROTTLE_DONE pgs=809 cs=0 l=1 rx=0x7f0c500032b0 tx=0x7f0c5000e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.068 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.036+0000 7f0c55ffb700 1 -- 172.21.15.38:0/4117577282 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c50007540 con 0x7f0c58146680 2020-06-12T17:51:13.068 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.036+0000 7f0c55ffb700 1 -- 172.21.15.38:0/4117577282 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c5000e580 con 0x7f0c58146680 2020-06-12T17:51:13.068 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.036+0000 7f0c5ed9b700 1 -- 172.21.15.38:0/4117577282 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c581578d0 con 0x7f0c58146680 2020-06-12T17:51:13.069 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.036+0000 7f0c5ed9b700 1 -- 172.21.15.38:0/4117577282 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c58065d20 con 0x7f0c58146680 2020-06-12T17:51:13.069 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.037+0000 7f0c5d338700 1 --2- 172.21.15.38:0/4117577282 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c58146680 0x7f0c58157470 secure :-1 s=THROTTLE_DONE pgs=809 cs=0 l=1 rx=0x7f0c500032b0 tx=0x7f0c5000e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.069 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.037+0000 7f0c5ed9b700 1 -- 172.21.15.38:0/4117577282 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c58056c30 con 0x7f0c58146680 2020-06-12T17:51:13.070 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.037+0000 7f0c55ffb700 1 -- 172.21.15.38:0/4117577282 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f0c50010180 con 0x7f0c58146680 2020-06-12T17:51:13.070 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.037+0000 7f0c5d338700 1 --2- 172.21.15.38:0/4117577282 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c58146680 0x7f0c58157470 secure :-1 s=THROTTLE_DONE pgs=809 cs=0 l=1 rx=0x7f0c500032b0 tx=0x7f0c5000e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.070 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.037+0000 7f0c55ffb700 1 --2- 172.21.15.38:0/4117577282 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0c3804d6f0 0x7f0c3804fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:13.071 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.038+0000 7f0c55ffb700 1 -- 172.21.15.38:0/4117577282 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0c50060f80 con 0x7f0c58146680 2020-06-12T17:51:13.071 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.038+0000 7f0c5cb37700 1 --2- 172.21.15.38:0/4117577282 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0c3804d6f0 0x7f0c3804fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:13.072 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.038+0000 7f0c5cb37700 1 --2- 172.21.15.38:0/4117577282 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0c3804d6f0 0x7f0c3804fbb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0c58061380 tx=0x7f0c480016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.073 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.038+0000 7f0c5cb37700 1 --2- 172.21.15.38:0/4117577282 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0c3804d6f0 0x7f0c3804fbb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0c58061380 tx=0x7f0c480016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.073 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.038+0000 7f0c5cb37700 1 --2- 172.21.15.38:0/4117577282 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0c3804d6f0 0x7f0c3804fbb0 secure :-1 s=READY pgs=314 cs=0 l=1 rx=0x7f0c58061380 tx=0x7f0c480016e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:13.073 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.041+0000 7f0c5d338700 1 --2- 172.21.15.38:0/4117577282 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c58146680 0x7f0c58157470 secure :-1 s=THROTTLE_DONE pgs=809 cs=0 l=1 rx=0x7f0c500032b0 tx=0x7f0c5000e440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.074 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.041+0000 7f0c55ffb700 1 -- 172.21.15.38:0/4117577282 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f0c5003c700 con 0x7f0c58146680 2020-06-12T17:51:13.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.235+0000 7f0c5ed9b700 1 -- 172.21.15.38:0/4117577282 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_1236", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c5805a5e0 con 0x7f0c3804d6f0 2020-06-12T17:51:13.260 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.257+0000 7f0c5cb37700 1 --2- 172.21.15.38:0/4117577282 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0c3804d6f0 0x7f0c3804fbb0 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7f0c58061380 tx=0x7f0c480016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.261 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.257+0000 7f0c55ffb700 1 -- 172.21.15.38:0/4117577282 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0c5805a5e0 con 0x7f0c3804d6f0 2020-06-12T17:51:13.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.258+0000 7f0c5ed9b700 1 -- 172.21.15.38:0/4117577282 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0c3804d6f0 msgr2=0x7f0c3804fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:13.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.258+0000 7f0c5ed9b700 1 --2- 172.21.15.38:0/4117577282 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0c3804d6f0 0x7f0c3804fbb0 secure :-1 s=READY pgs=314 cs=0 l=1 rx=0x7f0c58061380 tx=0x7f0c480016e0).stop 2020-06-12T17:51:13.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.258+0000 7f0c5ed9b700 1 -- 172.21.15.38:0/4117577282 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c58146680 msgr2=0x7f0c58157470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:13.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.258+0000 7f0c5ed9b700 1 --2- 172.21.15.38:0/4117577282 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c58146680 0x7f0c58157470 secure :-1 s=READY pgs=809 cs=0 l=1 rx=0x7f0c500032b0 tx=0x7f0c5000e440).stop 2020-06-12T17:51:13.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.258+0000 7f0c5ed9b700 1 -- 172.21.15.38:0/4117577282 shutdown_connections 2020-06-12T17:51:13.264 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.258+0000 7f0c5ed9b700 1 --2- 172.21.15.38:0/4117577282 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f0c3804d6f0 0x7f0c3804fbb0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:13.264 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.258+0000 7f0c5ed9b700 1 --2- 172.21.15.38:0/4117577282 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c58146680 0x7f0c58157470 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:13.264 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.258+0000 7f0c5ed9b700 1 --2- 172.21.15.38:0/4117577282 >> v2:172.21.15.150:3300/0 conn(0x7f0c5809d8d0 0x7f0c58141ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:13.265 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.258+0000 7f0c5ed9b700 1 --2- 172.21.15.38:0/4117577282 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c580ad5b0 0x7f0c58154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:13.265 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.258+0000 7f0c5ed9b700 1 -- 172.21.15.38:0/4117577282 >> 172.21.15.38:0/4117577282 conn(0x7f0c580b5a20 msgr2=0x7f0c581455c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:13.265 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.258+0000 7f0c5ed9b700 1 -- 172.21.15.38:0/4117577282 shutdown_connections 2020-06-12T17:51:13.266 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.258+0000 7f0c5ed9b700 1 -- 172.21.15.38:0/4117577282 wait complete. 2020-06-12T17:51:13.272 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_1236 2020-06-12T17:51:13.391 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.387+0000 7f25369c5700 1 Processor -- start 2020-06-12T17:51:13.391 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.388+0000 7f25369c5700 1 -- start start 2020-06-12T17:51:13.394 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.388+0000 7f25369c5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f253005b0a0 0x7f25300b7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:13.394 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.388+0000 7f25369c5700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f25300b74d0 0x7f2530149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:13.395 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.388+0000 7f25369c5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253005c8e0 con 0x7f2530065420 2020-06-12T17:51:13.395 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.388+0000 7f25369c5700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2530149700 con 0x7f25300b74d0 2020-06-12T17:51:13.395 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.388+0000 7f25369c5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25301467a0 con 0x7f253005b0a0 2020-06-12T17:51:13.395 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.388+0000 7f2534f62700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f25300b74d0 0x7f2530149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:13.395 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.388+0000 7f2534f62700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f25300b74d0 0x7f2530149ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39580/0 (socket says 172.21.15.38:39580) 2020-06-12T17:51:13.396 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.388+0000 7f2534f62700 1 -- 172.21.15.38:0/4186813322 learned_addr learned my addr 172.21.15.38:0/4186813322 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:13.396 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.389+0000 7f2527fff700 1 --2- 172.21.15.38:0/4186813322 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f253005b0a0 0x7f25300b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:13.396 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.389+0000 7f2534f62700 1 -- 172.21.15.38:0/4186813322 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f253005b0a0 msgr2=0x7f25300b7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:13.396 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.389+0000 7f2534f62700 1 --2- 172.21.15.38:0/4186813322 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f253005b0a0 0x7f25300b7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:13.396 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.389+0000 7f2534f62700 1 -- 172.21.15.38:0/4186813322 >> v1:172.21.15.150:6789/0 conn(0x7f2530065420 legacy=0x7f2530146090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:13.397 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.389+0000 7f2534f62700 1 -- 172.21.15.38:0/4186813322 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253005cb80 con 0x7f25300b74d0 2020-06-12T17:51:13.397 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.389+0000 7f2527fff700 1 --2- 172.21.15.38:0/4186813322 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f253005b0a0 0x7f25300b7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:51:13.397 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.389+0000 7f2534f62700 1 --2- 172.21.15.38:0/4186813322 >> v2:172.21.15.38:3300/0 conn(0x7f25300b74d0 0x7f2530149ba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f25280032b0 tx=0x7f25280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.397 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.389+0000 7f2534f62700 1 --2- 172.21.15.38:0/4186813322 >> v2:172.21.15.38:3300/0 conn(0x7f25300b74d0 0x7f2530149ba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f25280032b0 tx=0x7f25280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.397 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.389+0000 7f2534f62700 1 --2- 172.21.15.38:0/4186813322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25300b74d0 0x7f2530149ba0 secure :-1 s=READY pgs=810 cs=0 l=1 rx=0x7f25280032b0 tx=0x7f25280081e0).ready entity=mon.0 client_cookie=b4b5b64038cc76b3 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:13.398 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.389+0000 7f2534f62700 1 --2- 172.21.15.38:0/4186813322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25300b74d0 0x7f2530149ba0 secure :-1 s=THROTTLE_DONE pgs=810 cs=0 l=1 rx=0x7f25280032b0 tx=0x7f25280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.398 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.389+0000 7f2534f62700 1 --2- 172.21.15.38:0/4186813322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25300b74d0 0x7f2530149ba0 secure :-1 s=THROTTLE_DONE pgs=810 cs=0 l=1 rx=0x7f25280032b0 tx=0x7f25280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.398 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.389+0000 7f252f7fe700 1 -- 172.21.15.38:0/4186813322 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f252800a160 con 0x7f25300b74d0 2020-06-12T17:51:13.398 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.389+0000 7f2534f62700 1 --2- 172.21.15.38:0/4186813322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25300b74d0 0x7f2530149ba0 secure :-1 s=THROTTLE_DONE pgs=810 cs=0 l=1 rx=0x7f25280032b0 tx=0x7f25280081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.398 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.389+0000 7f252f7fe700 1 -- 172.21.15.38:0/4186813322 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252800a2c0 con 0x7f25300b74d0 2020-06-12T17:51:13.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.389+0000 7f252f7fe700 1 -- 172.21.15.38:0/4186813322 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f252800a6e0 con 0x7f25300b74d0 2020-06-12T17:51:13.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.389+0000 7f25369c5700 1 -- 172.21.15.38:0/4186813322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25300b74d0 msgr2=0x7f2530149ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:13.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.389+0000 7f25369c5700 1 --2- 172.21.15.38:0/4186813322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25300b74d0 0x7f2530149ba0 secure :-1 s=READY pgs=810 cs=0 l=1 rx=0x7f25280032b0 tx=0x7f25280081e0).stop 2020-06-12T17:51:13.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.390+0000 7f25369c5700 1 -- 172.21.15.38:0/4186813322 shutdown_connections 2020-06-12T17:51:13.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.390+0000 7f25369c5700 1 --2- 172.21.15.38:0/4186813322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25300b74d0 0x7f2530149ba0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:13.400 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.390+0000 7f25369c5700 1 --2- 172.21.15.38:0/4186813322 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f253005b0a0 0x7f25300b7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:13.400 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.390+0000 7f25369c5700 1 -- 172.21.15.38:0/4186813322 >> 172.21.15.38:0/4186813322 conn(0x7f25300ba610 msgr2=0x7f25300baa20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:13.400 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.390+0000 7f25369c5700 1 -- 172.21.15.38:0/4186813322 shutdown_connections 2020-06-12T17:51:13.400 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.390+0000 7f25369c5700 1 -- 172.21.15.38:0/4186813322 wait complete. 2020-06-12T17:51:13.401 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.391+0000 7f25369c5700 1 Processor -- start 2020-06-12T17:51:13.401 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.391+0000 7f25369c5700 1 -- start start 2020-06-12T17:51:13.410 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.391+0000 7f25369c5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f253005b0a0 0x7f2530147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.391+0000 7f25369c5700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2530065420 0x7f253009f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.391+0000 7f25369c5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253009ff20 con 0x7f25300b74d0 2020-06-12T17:51:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.391+0000 7f25369c5700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25300a01c0 con 0x7f2530065420 2020-06-12T17:51:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.391+0000 7f25369c5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25300a0660 con 0x7f253005b0a0 2020-06-12T17:51:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.391+0000 7f2527fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2530065420 0x7f253009f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:13.412 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.391+0000 7f2527fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2530065420 0x7f253009f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39584/0 (socket says 172.21.15.38:39584) 2020-06-12T17:51:13.412 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.392+0000 7f2527fff700 1 -- 172.21.15.38:0/1302739751 learned_addr learned my addr 172.21.15.38:0/1302739751 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:13.412 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.392+0000 7f252ffff700 1 --2- 172.21.15.38:0/1302739751 >> v2:172.21.15.150:3300/0 conn(0x7f253005b0a0 0x7f2530147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:13.412 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.392+0000 7f2527fff700 1 -- 172.21.15.38:0/1302739751 >> v2:172.21.15.150:3300/0 conn(0x7f253005b0a0 msgr2=0x7f2530147610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:13.413 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.392+0000 7f2527fff700 1 --2- 172.21.15.38:0/1302739751 >> v2:172.21.15.150:3300/0 conn(0x7f253005b0a0 0x7f2530147610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:13.413 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.392+0000 7f2527fff700 1 -- 172.21.15.38:0/1302739751 >> v1:172.21.15.150:6789/0 conn(0x7f25300b74d0 legacy=0x7f2530156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:13.413 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.392+0000 7f2527fff700 1 -- 172.21.15.38:0/1302739751 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2530148f30 con 0x7f2530065420 2020-06-12T17:51:13.413 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.392+0000 7f2527fff700 1 --2- 172.21.15.38:0/1302739751 >> v2:172.21.15.38:3300/0 conn(0x7f2530065420 0x7f253009f940 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2518007920 tx=0x7f251800e130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.413 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.392+0000 7f2527fff700 1 --2- 172.21.15.38:0/1302739751 >> v2:172.21.15.38:3300/0 conn(0x7f2530065420 0x7f253009f940 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2518007920 tx=0x7f251800e130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.414 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.392+0000 7f2527fff700 1 --2- 172.21.15.38:0/1302739751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2530065420 0x7f253009f940 secure :-1 s=READY pgs=811 cs=0 l=1 rx=0x7f2518007920 tx=0x7f251800e130).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:13.414 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.392+0000 7f2527fff700 1 --2- 172.21.15.38:0/1302739751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2530065420 0x7f253009f940 secure :-1 s=THROTTLE_DONE pgs=811 cs=0 l=1 rx=0x7f2518007920 tx=0x7f251800e130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.414 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.392+0000 7f2527fff700 1 --2- 172.21.15.38:0/1302739751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2530065420 0x7f253009f940 secure :-1 s=THROTTLE_DONE pgs=811 cs=0 l=1 rx=0x7f2518007920 tx=0x7f251800e130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.414 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.392+0000 7f252dffb700 1 -- 172.21.15.38:0/1302739751 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2518005b40 con 0x7f2530065420 2020-06-12T17:51:13.414 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.392+0000 7f2527fff700 1 --2- 172.21.15.38:0/1302739751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2530065420 0x7f253009f940 secure :-1 s=THROTTLE_DONE pgs=811 cs=0 l=1 rx=0x7f2518007920 tx=0x7f251800e130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.415 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.392+0000 7f252dffb700 1 -- 172.21.15.38:0/1302739751 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2518005ca0 con 0x7f2530065420 2020-06-12T17:51:13.415 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.392+0000 7f25369c5700 1 -- 172.21.15.38:0/1302739751 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25301571f0 con 0x7f2530065420 2020-06-12T17:51:13.415 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.392+0000 7f252dffb700 1 -- 172.21.15.38:0/1302739751 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f251800e800 con 0x7f2530065420 2020-06-12T17:51:13.415 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.392+0000 7f25369c5700 1 -- 172.21.15.38:0/1302739751 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253009de20 con 0x7f2530065420 2020-06-12T17:51:13.415 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.393+0000 7f2527fff700 1 --2- 172.21.15.38:0/1302739751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2530065420 0x7f253009f940 secure :-1 s=THROTTLE_DONE pgs=811 cs=0 l=1 rx=0x7f2518007920 tx=0x7f251800e130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.393+0000 7f25369c5700 1 -- 172.21.15.38:0/1302739751 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2530056c30 con 0x7f2530065420 2020-06-12T17:51:13.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.393+0000 7f252dffb700 1 -- 172.21.15.38:0/1302739751 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f2518007180 con 0x7f2530065420 2020-06-12T17:51:13.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.393+0000 7f2527fff700 1 --2- 172.21.15.38:0/1302739751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2530065420 0x7f253009f940 secure :-1 s=THROTTLE_DONE pgs=811 cs=0 l=1 rx=0x7f2518007920 tx=0x7f251800e130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.393+0000 7f252dffb700 1 --2- 172.21.15.38:0/1302739751 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f251404d580 0x7f251404fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:13.416 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.394+0000 7f252dffb700 1 -- 172.21.15.38:0/1302739751 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2518007e40 con 0x7f2530065420 2020-06-12T17:51:13.417 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.394+0000 7f252ffff700 1 --2- 172.21.15.38:0/1302739751 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f251404d580 0x7f251404fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:13.417 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.394+0000 7f252ffff700 1 --2- 172.21.15.38:0/1302739751 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f251404d580 0x7f251404fa40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f25300b4de0 tx=0x7f2520001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.417 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.394+0000 7f252ffff700 1 --2- 172.21.15.38:0/1302739751 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f251404d580 0x7f251404fa40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f25300b4de0 tx=0x7f2520001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.417 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.394+0000 7f252ffff700 1 --2- 172.21.15.38:0/1302739751 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f251404d580 0x7f251404fa40 secure :-1 s=READY pgs=315 cs=0 l=1 rx=0x7f25300b4de0 tx=0x7f2520001760).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:13.417 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.397+0000 7f2527fff700 1 --2- 172.21.15.38:0/1302739751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2530065420 0x7f253009f940 secure :-1 s=THROTTLE_DONE pgs=811 cs=0 l=1 rx=0x7f2518007920 tx=0x7f251800e130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.418 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.397+0000 7f252dffb700 1 -- 172.21.15.38:0/1302739751 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f251803c790 con 0x7f2530065420 2020-06-12T17:51:13.594 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.590+0000 7f25369c5700 1 -- 172.21.15.38:0/1302739751 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_1236", "target": ["mon-mgr", ""]}) v1 -- 0x7f253009fda0 con 0x7f251404d580 2020-06-12T17:51:13.597 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.594+0000 7f252ffff700 1 --2- 172.21.15.38:0/1302739751 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f251404d580 0x7f251404fa40 secure :-1 s=THROTTLE_DONE pgs=315 cs=0 l=1 rx=0x7f25300b4de0 tx=0x7f2520001760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:13.597 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.594+0000 7f252dffb700 1 -- 172.21.15.38:0/1302739751 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f2520001c90 con 0x7f251404d580 2020-06-12T17:51:13.597 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_1236/4e7dff96-6552-4de1-8ace-0f2b1fbea78c 2020-06-12T17:51:13.599 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.595+0000 7f25369c5700 1 -- 172.21.15.38:0/1302739751 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f251404d580 msgr2=0x7f251404fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:13.599 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.595+0000 7f25369c5700 1 --2- 172.21.15.38:0/1302739751 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f251404d580 0x7f251404fa40 secure :-1 s=READY pgs=315 cs=0 l=1 rx=0x7f25300b4de0 tx=0x7f2520001760).stop 2020-06-12T17:51:13.599 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.595+0000 7f25369c5700 1 -- 172.21.15.38:0/1302739751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2530065420 msgr2=0x7f253009f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:13.599 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.595+0000 7f25369c5700 1 --2- 172.21.15.38:0/1302739751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2530065420 0x7f253009f940 secure :-1 s=READY pgs=811 cs=0 l=1 rx=0x7f2518007920 tx=0x7f251800e130).stop 2020-06-12T17:51:13.599 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.595+0000 7f25369c5700 1 -- 172.21.15.38:0/1302739751 shutdown_connections 2020-06-12T17:51:13.600 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.595+0000 7f25369c5700 1 --2- 172.21.15.38:0/1302739751 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f251404d580 0x7f251404fa40 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:13.600 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.595+0000 7f25369c5700 1 --2- 172.21.15.38:0/1302739751 >> v2:172.21.15.150:3300/0 conn(0x7f253005b0a0 0x7f2530147610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:13.600 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.595+0000 7f25369c5700 1 --2- 172.21.15.38:0/1302739751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2530065420 0x7f253009f940 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:13.600 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.595+0000 7f25369c5700 1 -- 172.21.15.38:0/1302739751 >> 172.21.15.38:0/1302739751 conn(0x7f25300ba610 msgr2=0x7f25300b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:13.600 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.595+0000 7f25369c5700 1 -- 172.21.15.38:0/1302739751 shutdown_connections 2020-06-12T17:51:13.601 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:13.595+0000 7f25369c5700 1 -- 172.21.15.38:0/1302739751 wait complete. 2020-06-12T17:51:13.608 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_1236 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_1236/4e7dff96-6552-4de1-8ace-0f2b1fbea78c 2020-06-12T17:51:13.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:13.610 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:13.610 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:13.625 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:13.625 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:13.626 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1236/4e7dff96-6552-4de1-8ace-0f2b1fbea78c/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:13.718 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:13.718 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:13.718 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130705 s, 80.2 MB/s 2020-06-12T17:51:13.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:13.720 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:13.720 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:13.735 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:13.736 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:13.736 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1236/4e7dff96-6552-4de1-8ace-0f2b1fbea78c/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:13.822 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:13.823 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:13.823 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00992762 s, 106 MB/s 2020-06-12T17:51:13.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:13.824 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:13.825 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:13.841 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:13.849 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:13.849 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1236/4e7dff96-6552-4de1-8ace-0f2b1fbea78c/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:13.931 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:13.932 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:13.932 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125771 s, 83.4 MB/s 2020-06-12T17:51:13.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:13.934 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:13.934 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:13.950 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:13.952 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:13.952 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1236/4e7dff96-6552-4de1-8ace-0f2b1fbea78c/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:14.039 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:14.039 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:14.039 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101258 s, 104 MB/s 2020-06-12T17:51:14.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:14.062 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:14.062 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:14.084 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:14.085 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:14.086 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1236/4e7dff96-6552-4de1-8ace-0f2b1fbea78c/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:14.174 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:14.174 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:14.175 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116578 s, 89.9 MB/s 2020-06-12T17:51:14.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:14.176 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:14.177 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:14.192 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:14.193 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:14.193 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1236/4e7dff96-6552-4de1-8ace-0f2b1fbea78c/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:14.280 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:14.281 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:14.281 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109948 s, 95.4 MB/s 2020-06-12T17:51:14.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:14.283 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:14.283 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:14.304 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:14.304 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:14.305 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1236/4e7dff96-6552-4de1-8ace-0f2b1fbea78c/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:14.394 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:14.394 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:14.394 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116186 s, 90.2 MB/s 2020-06-12T17:51:14.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:14.396 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:14.396 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:14.412 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:14.412 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:14.413 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1236/4e7dff96-6552-4de1-8ace-0f2b1fbea78c/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:14.502 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:14.502 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:14.503 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125874 s, 83.3 MB/s 2020-06-12T17:51:14.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:14.504 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:14.505 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:14.521 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:14.522 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:14.524 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1236/4e7dff96-6552-4de1-8ace-0f2b1fbea78c/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:14.611 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:14.611 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:14.612 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012509 s, 83.8 MB/s 2020-06-12T17:51:14.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:14.615 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:14.615 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:14.631 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:14.632 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:14.633 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1236/4e7dff96-6552-4de1-8ace-0f2b1fbea78c/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:14.719 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:14.720 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:14.720 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105066 s, 99.8 MB/s 2020-06-12T17:51:14.721 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_7753 2020-06-12T17:51:14.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.835+0000 7f8a1b90b700 1 Processor -- start 2020-06-12T17:51:14.839 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.835+0000 7f8a1b90b700 1 -- start start 2020-06-12T17:51:14.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.836+0000 7f8a1b90b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8a14146680 0x7f8a140ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:14.847 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.836+0000 7f8a1b90b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a140b2eb0 0x7f8a1409d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:14.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.836+0000 7f8a1b90b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a14146d20 con 0x7f8a1409d620 2020-06-12T17:51:14.848 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.836+0000 7f8a1b90b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a14066a80 con 0x7f8a14146680 2020-06-12T17:51:14.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.836+0000 7f8a1b90b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a14146f50 con 0x7f8a140b2eb0 2020-06-12T17:51:14.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.837+0000 7f8a18ea6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a140b2eb0 0x7f8a1409d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:14.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.837+0000 7f8a196a7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8a14146680 0x7f8a140ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:14.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.837+0000 7f8a19ea8700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f8a1409d620 0x7f8a1409b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:33910/0 (socket says 172.21.15.38:33910) 2020-06-12T17:51:14.849 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.837+0000 7f8a196a7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8a14146680 0x7f8a140ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.38:49066/0 (socket says 172.21.15.38:49066) 2020-06-12T17:51:14.850 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.837+0000 7f8a19ea8700 1 -- 172.21.15.38:0/303982582 learned_addr learned my addr 172.21.15.38:0/303982582 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:14.850 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.837+0000 7f8a196a7700 1 -- 172.21.15.38:0/303982582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a140b2eb0 msgr2=0x7f8a1409d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:14.850 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.837+0000 7f8a196a7700 1 --2- 172.21.15.38:0/303982582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a140b2eb0 0x7f8a1409d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:14.850 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.837+0000 7f8a196a7700 1 -- 172.21.15.38:0/303982582 >> v1:172.21.15.150:6789/0 conn(0x7f8a1409d620 legacy=0x7f8a1409b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:14.851 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.837+0000 7f8a03fff700 1 -- 172.21.15.38:0/303982582 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916492809 0 0) 0x7f8a14146d20 con 0x7f8a1409d620 2020-06-12T17:51:14.851 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.837+0000 7f8a196a7700 1 -- 172.21.15.38:0/303982582 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a14146a60 con 0x7f8a14146680 2020-06-12T17:51:14.851 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.837+0000 7f8a18ea6700 1 --2- 172.21.15.38:0/303982582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a140b2eb0 0x7f8a1409d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:51:14.851 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.837+0000 7f8a196a7700 1 --2- 172.21.15.38:0/303982582 >> v2:172.21.15.150:3300/0 conn(0x7f8a14146680 0x7f8a140ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8a04002f30 tx=0x7f8a04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:14.852 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.837+0000 7f8a196a7700 1 --2- 172.21.15.38:0/303982582 >> v2:172.21.15.150:3300/0 conn(0x7f8a14146680 0x7f8a140ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8a04002f30 tx=0x7f8a04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:14.852 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.837+0000 7f8a196a7700 1 --2- 172.21.15.38:0/303982582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a14146680 0x7f8a140ad5b0 secure :-1 s=READY pgs=449 cs=0 l=1 rx=0x7f8a04002f30 tx=0x7f8a04007e60).ready entity=mon.1 client_cookie=7440be9b3c426af1 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:14.852 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.837+0000 7f8a196a7700 1 --2- 172.21.15.38:0/303982582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a14146680 0x7f8a140ad5b0 secure :-1 s=THROTTLE_DONE pgs=449 cs=0 l=1 rx=0x7f8a04002f30 tx=0x7f8a04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:14.852 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.837+0000 7f8a03fff700 1 -- 172.21.15.38:0/303982582 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a04011380 con 0x7f8a14146680 2020-06-12T17:51:14.853 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.837+0000 7f8a196a7700 1 --2- 172.21.15.38:0/303982582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a14146680 0x7f8a140ad5b0 secure :-1 s=THROTTLE_DONE pgs=449 cs=0 l=1 rx=0x7f8a04002f30 tx=0x7f8a04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:14.853 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.837+0000 7f8a196a7700 1 --2- 172.21.15.38:0/303982582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a14146680 0x7f8a140ad5b0 secure :-1 s=THROTTLE_DONE pgs=449 cs=0 l=1 rx=0x7f8a04002f30 tx=0x7f8a04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:14.854 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.837+0000 7f8a03fff700 1 -- 172.21.15.38:0/303982582 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a040114e0 con 0x7f8a14146680 2020-06-12T17:51:14.854 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.837+0000 7f8a03fff700 1 -- 172.21.15.38:0/303982582 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a040118c0 con 0x7f8a14146680 2020-06-12T17:51:14.854 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.837+0000 7f8a1b90b700 1 -- 172.21.15.38:0/303982582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a14146680 msgr2=0x7f8a140ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:14.854 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.837+0000 7f8a1b90b700 1 --2- 172.21.15.38:0/303982582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a14146680 0x7f8a140ad5b0 secure :-1 s=READY pgs=449 cs=0 l=1 rx=0x7f8a04002f30 tx=0x7f8a04007e60).stop 2020-06-12T17:51:14.855 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.838+0000 7f8a1b90b700 1 -- 172.21.15.38:0/303982582 shutdown_connections 2020-06-12T17:51:14.855 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.838+0000 7f8a1b90b700 1 --2- 172.21.15.38:0/303982582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a14146680 0x7f8a140ad5b0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:14.855 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.838+0000 7f8a1b90b700 1 --2- 172.21.15.38:0/303982582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a140b2eb0 0x7f8a1409d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:14.856 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.838+0000 7f8a1b90b700 1 -- 172.21.15.38:0/303982582 >> 172.21.15.38:0/303982582 conn(0x7f8a140b5a20 msgr2=0x7f8a1405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:14.856 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.838+0000 7f8a1b90b700 1 -- 172.21.15.38:0/303982582 shutdown_connections 2020-06-12T17:51:14.856 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.838+0000 7f8a1b90b700 1 -- 172.21.15.38:0/303982582 wait complete. 2020-06-12T17:51:14.856 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.839+0000 7f8a1b90b700 1 Processor -- start 2020-06-12T17:51:14.857 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.839+0000 7f8a1b90b700 1 -- start start 2020-06-12T17:51:14.857 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.840+0000 7f8a1b90b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8a140b2eb0 0x7f8a14064c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:14.857 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.840+0000 7f8a1b90b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8a14146680 0x7f8a141506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:14.857 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.840+0000 7f8a1b90b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a14062e20 con 0x7f8a1409d620 2020-06-12T17:51:14.858 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.840+0000 7f8a1b90b700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a14062550 con 0x7f8a140b2eb0 2020-06-12T17:51:14.858 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.840+0000 7f8a1b90b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a14063080 con 0x7f8a14146680 2020-06-12T17:51:14.858 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.840+0000 7f8a18ea6700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8a140b2eb0 0x7f8a14064c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:14.859 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.840+0000 7f8a196a7700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f8a1409d620 0x7f8a1413d410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:33912/0 (socket says 172.21.15.38:33912) 2020-06-12T17:51:14.859 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.840+0000 7f8a18ea6700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8a140b2eb0 0x7f8a14064c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39598/0 (socket says 172.21.15.38:39598) 2020-06-12T17:51:14.859 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.840+0000 7f8a196a7700 1 -- 172.21.15.38:0/505332104 learned_addr learned my addr 172.21.15.38:0/505332104 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:14.860 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.840+0000 7f8a19ea8700 1 --2- 172.21.15.38:0/505332104 >> v2:172.21.15.150:3300/0 conn(0x7f8a14146680 0x7f8a141506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:14.860 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.840+0000 7f8a027fc700 1 -- 172.21.15.38:0/505332104 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1454006863 0 0) 0x7f8a14062e20 con 0x7f8a1409d620 2020-06-12T17:51:14.860 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.840+0000 7f8a027fc700 1 -- 172.21.15.38:0/505332104 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89f4002fe0 con 0x7f8a1409d620 2020-06-12T17:51:14.860 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.840+0000 7f8a18ea6700 1 -- 172.21.15.38:0/505332104 >> v2:172.21.15.150:3300/0 conn(0x7f8a14146680 msgr2=0x7f8a141506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:14.861 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.840+0000 7f8a18ea6700 1 --2- 172.21.15.38:0/505332104 >> v2:172.21.15.150:3300/0 conn(0x7f8a14146680 0x7f8a141506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:14.861 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.840+0000 7f8a18ea6700 1 -- 172.21.15.38:0/505332104 >> v1:172.21.15.150:6789/0 conn(0x7f8a1409d620 legacy=0x7f8a1413d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:14.861 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.840+0000 7f8a18ea6700 1 -- 172.21.15.38:0/505332104 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a140b1f80 con 0x7f8a140b2eb0 2020-06-12T17:51:14.862 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.840+0000 7f8a18ea6700 1 --2- 172.21.15.38:0/505332104 >> v2:172.21.15.38:3300/0 conn(0x7f8a140b2eb0 0x7f8a14064c60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8a10002f30 tx=0x7f8a10007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:14.862 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.840+0000 7f8a18ea6700 1 --2- 172.21.15.38:0/505332104 >> v2:172.21.15.38:3300/0 conn(0x7f8a140b2eb0 0x7f8a14064c60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8a10002f30 tx=0x7f8a10007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:14.862 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.840+0000 7f8a18ea6700 1 --2- 172.21.15.38:0/505332104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a140b2eb0 0x7f8a14064c60 secure :-1 s=READY pgs=812 cs=0 l=1 rx=0x7f8a10002f30 tx=0x7f8a10007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:14.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.840+0000 7f8a18ea6700 1 --2- 172.21.15.38:0/505332104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a140b2eb0 0x7f8a14064c60 secure :-1 s=THROTTLE_DONE pgs=812 cs=0 l=1 rx=0x7f8a10002f30 tx=0x7f8a10007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:14.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.840+0000 7f8a027fc700 1 -- 172.21.15.38:0/505332104 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a1000c940 con 0x7f8a140b2eb0 2020-06-12T17:51:14.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.840+0000 7f8a18ea6700 1 --2- 172.21.15.38:0/505332104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a140b2eb0 0x7f8a14064c60 secure :-1 s=THROTTLE_DONE pgs=812 cs=0 l=1 rx=0x7f8a10002f30 tx=0x7f8a10007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:14.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.840+0000 7f8a027fc700 1 -- 172.21.15.38:0/505332104 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1000caa0 con 0x7f8a140b2eb0 2020-06-12T17:51:14.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.840+0000 7f8a1b90b700 1 -- 172.21.15.38:0/505332104 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a140b21f0 con 0x7f8a140b2eb0 2020-06-12T17:51:14.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.840+0000 7f8a18ea6700 1 --2- 172.21.15.38:0/505332104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a140b2eb0 0x7f8a14064c60 secure :-1 s=THROTTLE_DONE pgs=812 cs=0 l=1 rx=0x7f8a10002f30 tx=0x7f8a10007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:14.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.840+0000 7f8a027fc700 1 -- 172.21.15.38:0/505332104 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a100056c0 con 0x7f8a140b2eb0 2020-06-12T17:51:14.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.841+0000 7f8a1b90b700 1 -- 172.21.15.38:0/505332104 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a140620b0 con 0x7f8a140b2eb0 2020-06-12T17:51:14.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.841+0000 7f8a18ea6700 1 --2- 172.21.15.38:0/505332104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a140b2eb0 0x7f8a14064c60 secure :-1 s=THROTTLE_DONE pgs=812 cs=0 l=1 rx=0x7f8a10002f30 tx=0x7f8a10007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:14.865 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.842+0000 7f8a027fc700 1 -- 172.21.15.38:0/505332104 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f8a10007180 con 0x7f8a140b2eb0 2020-06-12T17:51:14.865 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.842+0000 7f8a18ea6700 1 --2- 172.21.15.38:0/505332104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a140b2eb0 0x7f8a14064c60 secure :-1 s=THROTTLE_DONE pgs=812 cs=0 l=1 rx=0x7f8a10002f30 tx=0x7f8a10007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:14.865 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.842+0000 7f8a1b90b700 1 -- 172.21.15.38:0/505332104 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a140623c0 con 0x7f8a140b2eb0 2020-06-12T17:51:14.865 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.842+0000 7f8a027fc700 1 --2- 172.21.15.38:0/505332104 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f89f404d8d0 0x7f89f404fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:14.866 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.842+0000 7f8a027fc700 1 -- 172.21.15.38:0/505332104 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8a10060f10 con 0x7f8a140b2eb0 2020-06-12T17:51:14.866 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.842+0000 7f8a196a7700 1 --2- 172.21.15.38:0/505332104 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f89f404d8d0 0x7f89f404fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:14.866 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.842+0000 7f8a196a7700 1 --2- 172.21.15.38:0/505332104 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f89f404d8d0 0x7f89f404fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8a040088e0 tx=0x7f8a04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:14.866 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.842+0000 7f8a196a7700 1 --2- 172.21.15.38:0/505332104 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f89f404d8d0 0x7f89f404fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8a040088e0 tx=0x7f8a04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:14.866 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.842+0000 7f8a196a7700 1 --2- 172.21.15.38:0/505332104 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f89f404d8d0 0x7f89f404fd90 secure :-1 s=READY pgs=316 cs=0 l=1 rx=0x7f8a040088e0 tx=0x7f8a04007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:14.867 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.845+0000 7f8a18ea6700 1 --2- 172.21.15.38:0/505332104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a140b2eb0 0x7f8a14064c60 secure :-1 s=THROTTLE_DONE pgs=812 cs=0 l=1 rx=0x7f8a10002f30 tx=0x7f8a10007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:14.868 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:14.845+0000 7f8a027fc700 1 -- 172.21.15.38:0/505332104 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f8a1003c670 con 0x7f8a140b2eb0 2020-06-12T17:51:15.042 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.038+0000 7f8a1b90b700 1 -- 172.21.15.38:0/505332104 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_7753", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a14056c30 con 0x7f89f404d8d0 2020-06-12T17:51:15.063 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.060+0000 7f8a196a7700 1 --2- 172.21.15.38:0/505332104 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f89f404d8d0 0x7f89f404fd90 secure :-1 s=THROTTLE_DONE pgs=316 cs=0 l=1 rx=0x7f8a040088e0 tx=0x7f8a04007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:15.063 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.060+0000 7f8a027fc700 1 -- 172.21.15.38:0/505332104 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8a14056c30 con 0x7f89f404d8d0 2020-06-12T17:51:15.065 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.061+0000 7f8a1b90b700 1 -- 172.21.15.38:0/505332104 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f89f404d8d0 msgr2=0x7f89f404fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:15.065 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.061+0000 7f8a1b90b700 1 --2- 172.21.15.38:0/505332104 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f89f404d8d0 0x7f89f404fd90 secure :-1 s=READY pgs=316 cs=0 l=1 rx=0x7f8a040088e0 tx=0x7f8a04007e60).stop 2020-06-12T17:51:15.065 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.061+0000 7f8a1b90b700 1 -- 172.21.15.38:0/505332104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a140b2eb0 msgr2=0x7f8a14064c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:15.066 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.061+0000 7f8a1b90b700 1 --2- 172.21.15.38:0/505332104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a140b2eb0 0x7f8a14064c60 secure :-1 s=READY pgs=812 cs=0 l=1 rx=0x7f8a10002f30 tx=0x7f8a10007e60).stop 2020-06-12T17:51:15.066 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.061+0000 7f8a1b90b700 1 -- 172.21.15.38:0/505332104 shutdown_connections 2020-06-12T17:51:15.066 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.061+0000 7f8a1b90b700 1 --2- 172.21.15.38:0/505332104 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f89f404d8d0 0x7f89f404fd90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:15.066 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.061+0000 7f8a1b90b700 1 --2- 172.21.15.38:0/505332104 >> v2:172.21.15.150:3300/0 conn(0x7f8a14146680 0x7f8a141506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:15.067 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.061+0000 7f8a1b90b700 1 --2- 172.21.15.38:0/505332104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a140b2eb0 0x7f8a14064c60 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:15.067 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.061+0000 7f8a1b90b700 1 -- 172.21.15.38:0/505332104 >> 172.21.15.38:0/505332104 conn(0x7f8a140b5a20 msgr2=0x7f8a1409c340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:15.067 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.061+0000 7f8a1b90b700 1 -- 172.21.15.38:0/505332104 shutdown_connections 2020-06-12T17:51:15.067 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.061+0000 7f8a1b90b700 1 -- 172.21.15.38:0/505332104 wait complete. 2020-06-12T17:51:15.075 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_7753 2020-06-12T17:51:15.193 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.189+0000 7f28dfa72700 1 Processor -- start 2020-06-12T17:51:15.193 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.189+0000 7f28dfa72700 1 -- start start 2020-06-12T17:51:15.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.190+0000 7f28dfa72700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f28d805b5e0 0x7f28d80b9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:15.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.190+0000 7f28dfa72700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f28d80b73a0 0x7f28d81461a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:15.196 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.190+0000 7f28dfa72700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d814a100 con 0x7f28d805b9c0 2020-06-12T17:51:15.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.190+0000 7f28dfa72700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d814a3a0 con 0x7f28d80b73a0 2020-06-12T17:51:15.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.190+0000 7f28dfa72700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d80b8400 con 0x7f28d805b5e0 2020-06-12T17:51:15.197 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.190+0000 7f28de00f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f28d80b73a0 0x7f28d81461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:15.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.190+0000 7f28de00f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f28d80b73a0 0x7f28d81461a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39608/0 (socket says 172.21.15.38:39608) 2020-06-12T17:51:15.198 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.190+0000 7f28de00f700 1 -- 172.21.15.38:0/2992523091 learned_addr learned my addr 172.21.15.38:0/2992523091 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:15.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.191+0000 7f28dd80e700 1 --2- 172.21.15.38:0/2992523091 >> v2:172.21.15.150:3300/0 conn(0x7f28d805b5e0 0x7f28d80b9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:15.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.191+0000 7f28de00f700 1 -- 172.21.15.38:0/2992523091 >> v2:172.21.15.150:3300/0 conn(0x7f28d805b5e0 msgr2=0x7f28d80b9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:15.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.191+0000 7f28de00f700 1 --2- 172.21.15.38:0/2992523091 >> v2:172.21.15.150:3300/0 conn(0x7f28d805b5e0 0x7f28d80b9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:15.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.191+0000 7f28de00f700 1 -- 172.21.15.38:0/2992523091 >> v1:172.21.15.150:6789/0 conn(0x7f28d805b9c0 legacy=0x7f28d80b7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:15.199 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.191+0000 7f28de00f700 1 -- 172.21.15.38:0/2992523091 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d809db70 con 0x7f28d80b73a0 2020-06-12T17:51:15.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.191+0000 7f28de00f700 1 --2- 172.21.15.38:0/2992523091 >> v2:172.21.15.38:3300/0 conn(0x7f28d80b73a0 0x7f28d81461a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f28d00032b0 tx=0x7f28d00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:15.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.191+0000 7f28de00f700 1 --2- 172.21.15.38:0/2992523091 >> v2:172.21.15.38:3300/0 conn(0x7f28d80b73a0 0x7f28d81461a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f28d00032b0 tx=0x7f28d00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:15.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.191+0000 7f28de00f700 1 --2- 172.21.15.38:0/2992523091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28d80b73a0 0x7f28d81461a0 secure :-1 s=READY pgs=813 cs=0 l=1 rx=0x7f28d00032b0 tx=0x7f28d00081e0).ready entity=mon.0 client_cookie=7149516d43de4e9a server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:15.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.191+0000 7f28de00f700 1 --2- 172.21.15.38:0/2992523091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28d80b73a0 0x7f28d81461a0 secure :-1 s=THROTTLE_DONE pgs=813 cs=0 l=1 rx=0x7f28d00032b0 tx=0x7f28d00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:15.200 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.191+0000 7f28dc80c700 1 -- 172.21.15.38:0/2992523091 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28d000a160 con 0x7f28d80b73a0 2020-06-12T17:51:15.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.191+0000 7f28de00f700 1 --2- 172.21.15.38:0/2992523091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28d80b73a0 0x7f28d81461a0 secure :-1 s=THROTTLE_DONE pgs=813 cs=0 l=1 rx=0x7f28d00032b0 tx=0x7f28d00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:15.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.191+0000 7f28dc80c700 1 -- 172.21.15.38:0/2992523091 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d000a2c0 con 0x7f28d80b73a0 2020-06-12T17:51:15.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.191+0000 7f28de00f700 1 --2- 172.21.15.38:0/2992523091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28d80b73a0 0x7f28d81461a0 secure :-1 s=THROTTLE_DONE pgs=813 cs=0 l=1 rx=0x7f28d00032b0 tx=0x7f28d00081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:15.201 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.191+0000 7f28dfa72700 1 -- 172.21.15.38:0/2992523091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28d80b73a0 msgr2=0x7f28d81461a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:15.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.191+0000 7f28dc80c700 1 -- 172.21.15.38:0/2992523091 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28d000a6a0 con 0x7f28d80b73a0 2020-06-12T17:51:15.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.191+0000 7f28dfa72700 1 --2- 172.21.15.38:0/2992523091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28d80b73a0 0x7f28d81461a0 secure :-1 s=READY pgs=813 cs=0 l=1 rx=0x7f28d00032b0 tx=0x7f28d00081e0).stop 2020-06-12T17:51:15.202 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.191+0000 7f28dfa72700 1 -- 172.21.15.38:0/2992523091 shutdown_connections 2020-06-12T17:51:15.203 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.191+0000 7f28dfa72700 1 --2- 172.21.15.38:0/2992523091 >> v2:172.21.15.150:3300/0 conn(0x7f28d805b5e0 0x7f28d80b9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:15.203 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.191+0000 7f28dfa72700 1 --2- 172.21.15.38:0/2992523091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28d80b73a0 0x7f28d81461a0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:15.203 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.191+0000 7f28dfa72700 1 -- 172.21.15.38:0/2992523091 >> 172.21.15.38:0/2992523091 conn(0x7f28d80b94a0 msgr2=0x7f28d80b98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:15.204 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.192+0000 7f28dfa72700 1 -- 172.21.15.38:0/2992523091 shutdown_connections 2020-06-12T17:51:15.204 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.192+0000 7f28dfa72700 1 -- 172.21.15.38:0/2992523091 wait complete. 2020-06-12T17:51:15.205 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.192+0000 7f28dfa72700 1 Processor -- start 2020-06-12T17:51:15.205 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.193+0000 7f28dfa72700 1 -- start start 2020-06-12T17:51:15.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.193+0000 7f28dfa72700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f28d805b9c0 0x7f28d813fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:15.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.193+0000 7f28dfa72700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d80b1260 con 0x7f28d805b5e0 2020-06-12T17:51:15.212 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.193+0000 7f28dfa72700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d80b1500 con 0x7f28d80b73a0 2020-06-12T17:51:15.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.193+0000 7f28dfa72700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d80b1080 con 0x7f28d805b9c0 2020-06-12T17:51:15.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.193+0000 7f28dd80e700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f28d805b5e0 0x7f28d813f580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41426/0 (socket says 172.21.15.38:41426) 2020-06-12T17:51:15.213 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.193+0000 7f28dd80e700 1 -- 172.21.15.38:0/3854901769 learned_addr learned my addr 172.21.15.38:0/3854901769 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:15.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.193+0000 7f28dd00d700 1 --2- 172.21.15.38:0/3854901769 >> v2:172.21.15.150:3300/0 conn(0x7f28d805b9c0 0x7f28d813fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:15.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.193+0000 7f28c6ffd700 1 -- 172.21.15.38:0/3854901769 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3954679525 0 0) 0x7f28d80b1260 con 0x7f28d805b5e0 2020-06-12T17:51:15.214 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.194+0000 7f28c6ffd700 1 -- 172.21.15.38:0/3854901769 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28b8002fe0 con 0x7f28d805b5e0 2020-06-12T17:51:15.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.194+0000 7f28c6ffd700 1 -- 172.21.15.38:0/3854901769 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1837945987 0 0) 0x7f28b8002fe0 con 0x7f28d805b5e0 2020-06-12T17:51:15.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.194+0000 7f28c6ffd700 1 -- 172.21.15.38:0/3854901769 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f28d80b1260 con 0x7f28d805b5e0 2020-06-12T17:51:15.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.194+0000 7f28c6ffd700 1 -- 172.21.15.38:0/3854901769 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f28c80025c0 con 0x7f28d805b5e0 2020-06-12T17:51:15.216 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.194+0000 7f28dd00d700 1 -- 172.21.15.38:0/3854901769 >> v1:172.21.15.150:6789/0 conn(0x7f28d80b73a0 legacy=0x7f28d80ae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:15.217 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.194+0000 7f28dd00d700 1 -- 172.21.15.38:0/3854901769 >> v1:172.21.15.38:6789/0 conn(0x7f28d805b5e0 legacy=0x7f28d813f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:15.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.194+0000 7f28dd00d700 1 -- 172.21.15.38:0/3854901769 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d80b17a0 con 0x7f28d805b9c0 2020-06-12T17:51:15.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.194+0000 7f28dd00d700 1 --2- 172.21.15.38:0/3854901769 >> v2:172.21.15.150:3300/0 conn(0x7f28d805b9c0 0x7f28d813fc90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f28d0008250 tx=0x7f28d4001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:15.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.194+0000 7f28dd00d700 1 --2- 172.21.15.38:0/3854901769 >> v2:172.21.15.150:3300/0 conn(0x7f28d805b9c0 0x7f28d813fc90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f28d0008250 tx=0x7f28d4001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:15.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.194+0000 7f28dd00d700 1 --2- 172.21.15.38:0/3854901769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28d805b9c0 0x7f28d813fc90 secure :-1 s=READY pgs=453 cs=0 l=1 rx=0x7f28d0008250 tx=0x7f28d4001810).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:15.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.194+0000 7f28dd00d700 1 --2- 172.21.15.38:0/3854901769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28d805b9c0 0x7f28d813fc90 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f28d0008250 tx=0x7f28d4001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:15.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.194+0000 7f28c6ffd700 1 -- 172.21.15.38:0/3854901769 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28d4001ea0 con 0x7f28d805b9c0 2020-06-12T17:51:15.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.194+0000 7f28dd00d700 1 --2- 172.21.15.38:0/3854901769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28d805b9c0 0x7f28d813fc90 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f28d0008250 tx=0x7f28d4001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:15.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.194+0000 7f28dd00d700 1 --2- 172.21.15.38:0/3854901769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28d805b9c0 0x7f28d813fc90 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f28d0008250 tx=0x7f28d4001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:15.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.194+0000 7f28c6ffd700 1 -- 172.21.15.38:0/3854901769 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d400c9e0 con 0x7f28d805b9c0 2020-06-12T17:51:15.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.194+0000 7f28dfa72700 1 -- 172.21.15.38:0/3854901769 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d8144ee0 con 0x7f28d805b9c0 2020-06-12T17:51:15.223 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.194+0000 7f28c6ffd700 1 -- 172.21.15.38:0/3854901769 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28d400ce00 con 0x7f28d805b9c0 2020-06-12T17:51:15.224 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.194+0000 7f28dfa72700 1 -- 172.21.15.38:0/3854901769 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d8148690 con 0x7f28d805b9c0 2020-06-12T17:51:15.224 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.195+0000 7f28dd00d700 1 --2- 172.21.15.38:0/3854901769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28d805b9c0 0x7f28d813fc90 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f28d0008250 tx=0x7f28d4001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:15.224 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.196+0000 7f28dfa72700 1 -- 172.21.15.38:0/3854901769 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d80b1930 con 0x7f28d805b9c0 2020-06-12T17:51:15.224 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.196+0000 7f28c6ffd700 1 -- 172.21.15.38:0/3854901769 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f28d40064e0 con 0x7f28d805b9c0 2020-06-12T17:51:15.224 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.196+0000 7f28dd00d700 1 --2- 172.21.15.38:0/3854901769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28d805b9c0 0x7f28d813fc90 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f28d0008250 tx=0x7f28d4001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:15.225 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.196+0000 7f28c6ffd700 1 --2- 172.21.15.38:0/3854901769 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f28b804dc60 0x7f28b8050120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:15.225 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.196+0000 7f28c6ffd700 1 -- 172.21.15.38:0/3854901769 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f28d4060710 con 0x7f28d805b9c0 2020-06-12T17:51:15.225 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.196+0000 7f28dd80e700 1 --2- 172.21.15.38:0/3854901769 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f28b804dc60 0x7f28b8050120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:15.225 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.197+0000 7f28dd80e700 1 --2- 172.21.15.38:0/3854901769 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f28b804dc60 0x7f28b8050120 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f28c8007a60 tx=0x7f28c8002a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:15.226 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.197+0000 7f28dd80e700 1 --2- 172.21.15.38:0/3854901769 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f28b804dc60 0x7f28b8050120 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f28c8007a60 tx=0x7f28c8002a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:15.226 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.197+0000 7f28dd80e700 1 --2- 172.21.15.38:0/3854901769 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f28b804dc60 0x7f28b8050120 secure :-1 s=READY pgs=317 cs=0 l=1 rx=0x7f28c8007a60 tx=0x7f28c8002a60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:15.226 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.200+0000 7f28dd00d700 1 --2- 172.21.15.38:0/3854901769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28d805b9c0 0x7f28d813fc90 secure :-1 s=THROTTLE_DONE pgs=453 cs=0 l=1 rx=0x7f28d0008250 tx=0x7f28d4001810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:15.226 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.200+0000 7f28c6ffd700 1 -- 172.21.15.38:0/3854901769 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f28d403bdd0 con 0x7f28d805b9c0 2020-06-12T17:51:15.399 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.395+0000 7f28dfa72700 1 -- 172.21.15.38:0/3854901769 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_7753", "target": ["mon-mgr", ""]}) v1 -- 0x7f28d8056c30 con 0x7f28b804dc60 2020-06-12T17:51:15.402 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.399+0000 7f28dd80e700 1 --2- 172.21.15.38:0/3854901769 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f28b804dc60 0x7f28b8050120 secure :-1 s=THROTTLE_DONE pgs=317 cs=0 l=1 rx=0x7f28c8007a60 tx=0x7f28c8002a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:15.402 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.399+0000 7f28c6ffd700 1 -- 172.21.15.38:0/3854901769 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f28d8056c30 con 0x7f28b804dc60 2020-06-12T17:51:15.403 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_7753/51f44f5d-03dc-47e1-9a23-602ad55e562f 2020-06-12T17:51:15.404 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.400+0000 7f28dfa72700 1 -- 172.21.15.38:0/3854901769 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f28b804dc60 msgr2=0x7f28b8050120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:15.404 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.400+0000 7f28dfa72700 1 --2- 172.21.15.38:0/3854901769 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f28b804dc60 0x7f28b8050120 secure :-1 s=READY pgs=317 cs=0 l=1 rx=0x7f28c8007a60 tx=0x7f28c8002a60).stop 2020-06-12T17:51:15.404 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.400+0000 7f28dfa72700 1 -- 172.21.15.38:0/3854901769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28d805b9c0 msgr2=0x7f28d813fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:15.405 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.400+0000 7f28dfa72700 1 --2- 172.21.15.38:0/3854901769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28d805b9c0 0x7f28d813fc90 secure :-1 s=READY pgs=453 cs=0 l=1 rx=0x7f28d0008250 tx=0x7f28d4001810).stop 2020-06-12T17:51:15.405 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.400+0000 7f28dfa72700 1 -- 172.21.15.38:0/3854901769 shutdown_connections 2020-06-12T17:51:15.405 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.400+0000 7f28dfa72700 1 --2- 172.21.15.38:0/3854901769 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f28b804dc60 0x7f28b8050120 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:15.406 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.400+0000 7f28dfa72700 1 --2- 172.21.15.38:0/3854901769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28d805b9c0 0x7f28d813fc90 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:15.406 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.400+0000 7f28dfa72700 1 -- 172.21.15.38:0/3854901769 >> 172.21.15.38:0/3854901769 conn(0x7f28d80b94a0 msgr2=0x7f28d80b5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:15.406 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.400+0000 7f28dfa72700 1 -- 172.21.15.38:0/3854901769 shutdown_connections 2020-06-12T17:51:15.407 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:15.400+0000 7f28dfa72700 1 -- 172.21.15.38:0/3854901769 wait complete. 2020-06-12T17:51:15.415 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_7753 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_7753/51f44f5d-03dc-47e1-9a23-602ad55e562f 2020-06-12T17:51:15.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:15.417 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:15.418 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:15.433 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:15.434 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:15.435 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7753/51f44f5d-03dc-47e1-9a23-602ad55e562f/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:15.525 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:15.525 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:15.525 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119711 s, 87.6 MB/s 2020-06-12T17:51:15.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:15.527 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:15.527 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:15.552 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:15.552 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:15.553 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7753/51f44f5d-03dc-47e1-9a23-602ad55e562f/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:15.637 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:15.638 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:15.638 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113122 s, 92.7 MB/s 2020-06-12T17:51:15.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:15.639 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:15.640 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:15.655 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:15.656 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:15.656 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7753/51f44f5d-03dc-47e1-9a23-602ad55e562f/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:15.743 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:15.743 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:15.744 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102456 s, 102 MB/s 2020-06-12T17:51:15.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:15.745 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:15.746 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:15.761 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:15.761 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:15.762 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7753/51f44f5d-03dc-47e1-9a23-602ad55e562f/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:15.855 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:15.855 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:15.855 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129924 s, 80.7 MB/s 2020-06-12T17:51:15.856 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:15.857 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:15.859 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:15.911 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:15.912 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:15.913 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7753/51f44f5d-03dc-47e1-9a23-602ad55e562f/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:16.003 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:16.004 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:16.004 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125483 s, 83.6 MB/s 2020-06-12T17:51:16.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:16.005 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:16.006 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:16.021 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:16.021 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:16.022 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7753/51f44f5d-03dc-47e1-9a23-602ad55e562f/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:16.114 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:16.114 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:16.114 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122932 s, 85.3 MB/s 2020-06-12T17:51:16.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:16.116 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:16.116 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:16.132 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:16.133 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:16.133 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7753/51f44f5d-03dc-47e1-9a23-602ad55e562f/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:16.221 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:16.221 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:16.221 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121891 s, 86.0 MB/s 2020-06-12T17:51:16.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:16.223 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:16.223 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:16.240 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:16.240 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:16.241 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7753/51f44f5d-03dc-47e1-9a23-602ad55e562f/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:16.330 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:16.330 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:16.330 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114876 s, 91.3 MB/s 2020-06-12T17:51:16.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:16.332 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:16.332 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:16.347 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:16.348 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:16.348 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7753/51f44f5d-03dc-47e1-9a23-602ad55e562f/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:16.436 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:16.437 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:16.437 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109225 s, 96.0 MB/s 2020-06-12T17:51:16.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:16.439 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:16.439 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:16.454 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:16.455 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:16.455 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7753/51f44f5d-03dc-47e1-9a23-602ad55e562f/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:16.543 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:16.544 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:16.544 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101228 s, 104 MB/s 2020-06-12T17:51:16.545 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_7266 2020-06-12T17:51:16.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.659+0000 7f6413311700 1 Processor -- start 2020-06-12T17:51:16.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.659+0000 7f6413311700 1 -- start start 2020-06-12T17:51:16.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.660+0000 7f6413311700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f640c066b20 0x7f640c1438f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:16.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.660+0000 7f6413311700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640c147550 con 0x7f640c09b190 2020-06-12T17:51:16.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.660+0000 7f6413311700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640c09e110 con 0x7f640c09dd30 2020-06-12T17:51:16.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.660+0000 7f6413311700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640c067380 con 0x7f640c066b20 2020-06-12T17:51:16.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.660+0000 7f64108ac700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f640c09b190 0x7f640c0b3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41434/0 (socket says 172.21.15.38:41434) 2020-06-12T17:51:16.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.660+0000 7f64108ac700 1 -- 172.21.15.38:0/3336979320 learned_addr learned my addr 172.21.15.38:0/3336979320 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:16.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.660+0000 7f63fbfff700 1 -- 172.21.15.38:0/3336979320 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3234549956 0 0) 0x7f640c147550 con 0x7f640c09b190 2020-06-12T17:51:16.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.660+0000 7f63fbfff700 1 -- 172.21.15.38:0/3336979320 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63f4003230 con 0x7f640c09b190 2020-06-12T17:51:16.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.660+0000 7f64118ae700 1 --2- 172.21.15.38:0/3336979320 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f640c066b20 0x7f640c1438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:16.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.660+0000 7f63fbfff700 1 -- 172.21.15.38:0/3336979320 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3341931579 0 0) 0x7f63f4003230 con 0x7f640c09b190 2020-06-12T17:51:16.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.660+0000 7f63fbfff700 1 -- 172.21.15.38:0/3336979320 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f640c066b20 msgr2=0x7f640c1438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:16.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.660+0000 7f63fbfff700 1 --2- 172.21.15.38:0/3336979320 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f640c066b20 0x7f640c1438f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:16.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.660+0000 7f63fbfff700 1 -- 172.21.15.38:0/3336979320 >> v1:172.21.15.150:6789/0 conn(0x7f640c09dd30 legacy=0x7f640c1431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:16.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.660+0000 7f63fbfff700 1 -- 172.21.15.38:0/3336979320 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640c067000 con 0x7f640c09b190 2020-06-12T17:51:16.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.660+0000 7f63fbfff700 1 -- 172.21.15.38:0/3336979320 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f63fc0016d0 con 0x7f640c09b190 2020-06-12T17:51:16.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.660+0000 7f63fbfff700 1 -- 172.21.15.38:0/3336979320 >> v1:172.21.15.38:6789/0 conn(0x7f640c09b190 legacy=0x7f640c0b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:16.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.660+0000 7f63fbfff700 1 --2- 172.21.15.38:0/3336979320 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63f4003750 0x7f63f4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:16.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.660+0000 7f63fbfff700 1 --2- 172.21.15.38:0/3336979320 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f640c066b20 0x7f63f40044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:16.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.660+0000 7f63fbfff700 1 --2- 172.21.15.38:0/3336979320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63f4004930 0x7f63f4004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:16.684 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.660+0000 7f63fbfff700 1 -- 172.21.15.38:0/3336979320 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640c067380 con 0x7f63f4004930 2020-06-12T17:51:16.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.660+0000 7f63fbfff700 1 -- 172.21.15.38:0/3336979320 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f4005300 con 0x7f63f4003750 2020-06-12T17:51:16.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.660+0000 7f63fbfff700 1 -- 172.21.15.38:0/3336979320 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f4004120 con 0x7f640c066b20 2020-06-12T17:51:16.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.660+0000 7f64118ae700 1 --2- 172.21.15.38:0/3336979320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63f4004930 0x7f63f4004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:16.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.661+0000 7f64110ad700 1 --2- 172.21.15.38:0/3336979320 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63f4003750 0x7f63f4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:16.686 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.661+0000 7f64108ac700 1 --2- 172.21.15.38:0/3336979320 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f640c066b20 0x7f63f40044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:16.686 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.661+0000 7f64118ae700 1 -- 172.21.15.38:0/3336979320 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f640c066b20 msgr2=0x7f63f40044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:16.687 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.661+0000 7f64118ae700 1 --2- 172.21.15.38:0/3336979320 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f640c066b20 0x7f63f40044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:16.687 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.661+0000 7f64118ae700 1 -- 172.21.15.38:0/3336979320 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63f4003750 msgr2=0x7f63f4003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:16.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.661+0000 7f64118ae700 1 --2- 172.21.15.38:0/3336979320 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63f4003750 0x7f63f4003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:16.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.661+0000 7f64118ae700 1 -- 172.21.15.38:0/3336979320 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f4003230 con 0x7f63f4004930 2020-06-12T17:51:16.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.661+0000 7f64118ae700 1 --2- 172.21.15.38:0/3336979320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63f4004930 0x7f63f4004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6408002f30 tx=0x7f6408007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:16.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.661+0000 7f64118ae700 1 --2- 172.21.15.38:0/3336979320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63f4004930 0x7f63f4004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6408002f30 tx=0x7f6408007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:16.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.661+0000 7f64118ae700 1 --2- 172.21.15.38:0/3336979320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63f4004930 0x7f63f4004db0 secure :-1 s=READY pgs=816 cs=0 l=1 rx=0x7f6408002f30 tx=0x7f6408007e60).ready entity=mon.0 client_cookie=d2b8cb78798ce2f8 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:16.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.661+0000 7f64118ae700 1 --2- 172.21.15.38:0/3336979320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63f4004930 0x7f63f4004db0 secure :-1 s=THROTTLE_DONE pgs=816 cs=0 l=1 rx=0x7f6408002f30 tx=0x7f6408007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:16.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.661+0000 7f64118ae700 1 --2- 172.21.15.38:0/3336979320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63f4004930 0x7f63f4004db0 secure :-1 s=THROTTLE_DONE pgs=816 cs=0 l=1 rx=0x7f6408002f30 tx=0x7f6408007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:16.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.661+0000 7f63fbfff700 1 -- 172.21.15.38:0/3336979320 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6408008d00 con 0x7f63f4004930 2020-06-12T17:51:16.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.661+0000 7f64118ae700 1 --2- 172.21.15.38:0/3336979320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63f4004930 0x7f63f4004db0 secure :-1 s=THROTTLE_DONE pgs=816 cs=0 l=1 rx=0x7f6408002f30 tx=0x7f6408007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:16.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.661+0000 7f63fbfff700 1 -- 172.21.15.38:0/3336979320 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6408008e60 con 0x7f63f4004930 2020-06-12T17:51:16.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.661+0000 7f63fbfff700 1 -- 172.21.15.38:0/3336979320 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6408010ae0 con 0x7f63f4004930 2020-06-12T17:51:16.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.661+0000 7f6413311700 1 -- 172.21.15.38:0/3336979320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63f4004930 msgr2=0x7f63f4004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:16.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.661+0000 7f6413311700 1 --2- 172.21.15.38:0/3336979320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63f4004930 0x7f63f4004db0 secure :-1 s=READY pgs=816 cs=0 l=1 rx=0x7f6408002f30 tx=0x7f6408007e60).stop 2020-06-12T17:51:16.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.661+0000 7f64118ae700 1 -- 172.21.15.38:0/3336979320 reap_dead start 2020-06-12T17:51:16.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.662+0000 7f6413311700 1 -- 172.21.15.38:0/3336979320 shutdown_connections 2020-06-12T17:51:16.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.662+0000 7f6413311700 1 -- 172.21.15.38:0/3336979320 >> 172.21.15.38:0/3336979320 conn(0x7f640c0b5a20 msgr2=0x7f640c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:16.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.662+0000 7f6413311700 1 -- 172.21.15.38:0/3336979320 shutdown_connections 2020-06-12T17:51:16.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.662+0000 7f6413311700 1 -- 172.21.15.38:0/3336979320 wait complete. 2020-06-12T17:51:16.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.663+0000 7f6413311700 1 Processor -- start 2020-06-12T17:51:16.692 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.663+0000 7f6413311700 1 -- start start 2020-06-12T17:51:16.692 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.663+0000 7f6413311700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f640c0b45b0 0x7f640c063300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:16.692 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.663+0000 7f6413311700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f640c064640 0x7f640c064ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:16.692 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.663+0000 7f6413311700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640c144dd0 con 0x7f640c131720 2020-06-12T17:51:16.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.663+0000 7f6413311700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f640c145070 con 0x7f640c0b45b0 2020-06-12T17:51:16.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.663+0000 7f6413311700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f640c145310 con 0x7f640c064640 2020-06-12T17:51:16.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.663+0000 7f64110ad700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f640c0b45b0 0x7f640c063300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:16.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.663+0000 7f64110ad700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f640c0b45b0 0x7f640c063300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39630/0 (socket says 172.21.15.38:39630) 2020-06-12T17:51:16.693 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.663+0000 7f64110ad700 1 -- 172.21.15.38:0/433620573 learned_addr learned my addr 172.21.15.38:0/433620573 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:16.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.663+0000 7f64108ac700 1 --2- 172.21.15.38:0/433620573 >> v2:172.21.15.150:3300/0 conn(0x7f640c064640 0x7f640c064ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:16.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.664+0000 7f64110ad700 1 -- 172.21.15.38:0/433620573 >> v2:172.21.15.150:3300/0 conn(0x7f640c064640 msgr2=0x7f640c064ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:16.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.664+0000 7f64110ad700 1 --2- 172.21.15.38:0/433620573 >> v2:172.21.15.150:3300/0 conn(0x7f640c064640 0x7f640c064ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:16.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.664+0000 7f64110ad700 1 -- 172.21.15.38:0/433620573 >> v1:172.21.15.150:6789/0 conn(0x7f640c131720 legacy=0x7f640c145a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:16.694 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.664+0000 7f64110ad700 1 -- 172.21.15.38:0/433620573 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640c1455b0 con 0x7f640c0b45b0 2020-06-12T17:51:16.695 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.664+0000 7f64110ad700 1 --2- 172.21.15.38:0/433620573 >> v2:172.21.15.38:3300/0 conn(0x7f640c0b45b0 0x7f640c063300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f640c0afd60 tx=0x7f6404001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:16.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.664+0000 7f64110ad700 1 --2- 172.21.15.38:0/433620573 >> v2:172.21.15.38:3300/0 conn(0x7f640c0b45b0 0x7f640c063300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f640c0afd60 tx=0x7f6404001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:16.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.664+0000 7f64110ad700 1 --2- 172.21.15.38:0/433620573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f640c0b45b0 0x7f640c063300 secure :-1 s=READY pgs=817 cs=0 l=1 rx=0x7f640c0afd60 tx=0x7f6404001bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:16.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.664+0000 7f64110ad700 1 --2- 172.21.15.38:0/433620573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f640c0b45b0 0x7f640c063300 secure :-1 s=THROTTLE_DONE pgs=817 cs=0 l=1 rx=0x7f640c0afd60 tx=0x7f6404001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:16.696 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.664+0000 7f63fa7fc700 1 -- 172.21.15.38:0/433620573 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6404003540 con 0x7f640c0b45b0 2020-06-12T17:51:16.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.664+0000 7f64110ad700 1 --2- 172.21.15.38:0/433620573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f640c0b45b0 0x7f640c063300 secure :-1 s=THROTTLE_DONE pgs=817 cs=0 l=1 rx=0x7f640c0afd60 tx=0x7f6404001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:16.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.664+0000 7f64110ad700 1 --2- 172.21.15.38:0/433620573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f640c0b45b0 0x7f640c063300 secure :-1 s=THROTTLE_DONE pgs=817 cs=0 l=1 rx=0x7f640c0afd60 tx=0x7f6404001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:16.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.664+0000 7f63fa7fc700 1 -- 172.21.15.38:0/433620573 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64040036e0 con 0x7f640c0b45b0 2020-06-12T17:51:16.697 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.664+0000 7f6413311700 1 -- 172.21.15.38:0/433620573 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f640c0b4990 con 0x7f640c0b45b0 2020-06-12T17:51:16.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.664+0000 7f63fa7fc700 1 -- 172.21.15.38:0/433620573 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6404003b00 con 0x7f640c0b45b0 2020-06-12T17:51:16.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.664+0000 7f6413311700 1 -- 172.21.15.38:0/433620573 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f640c064490 con 0x7f640c0b45b0 2020-06-12T17:51:16.698 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.665+0000 7f64110ad700 1 --2- 172.21.15.38:0/433620573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f640c0b45b0 0x7f640c063300 secure :-1 s=THROTTLE_DONE pgs=817 cs=0 l=1 rx=0x7f640c0afd60 tx=0x7f6404001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:16.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.665+0000 7f6413311700 1 -- 172.21.15.38:0/433620573 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f640c056c30 con 0x7f640c0b45b0 2020-06-12T17:51:16.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.665+0000 7f63fa7fc700 1 -- 172.21.15.38:0/433620573 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f6404006860 con 0x7f640c0b45b0 2020-06-12T17:51:16.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.665+0000 7f64110ad700 1 --2- 172.21.15.38:0/433620573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f640c0b45b0 0x7f640c063300 secure :-1 s=THROTTLE_DONE pgs=817 cs=0 l=1 rx=0x7f640c0afd60 tx=0x7f6404001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:16.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.665+0000 7f63fa7fc700 1 --2- 172.21.15.38:0/433620573 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f63ec04d650 0x7f63ec04fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:16.699 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.665+0000 7f63fa7fc700 1 -- 172.21.15.38:0/433620573 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f6404060dc0 con 0x7f640c0b45b0 2020-06-12T17:51:16.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.666+0000 7f64108ac700 1 --2- 172.21.15.38:0/433620573 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f63ec04d650 0x7f63ec04fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:16.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.666+0000 7f64108ac700 1 --2- 172.21.15.38:0/433620573 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f63ec04d650 0x7f63ec04fb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f63fc0013e0 tx=0x7f63fc001560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:16.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.666+0000 7f64108ac700 1 --2- 172.21.15.38:0/433620573 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f63ec04d650 0x7f63ec04fb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f63fc0013e0 tx=0x7f63fc001560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:16.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.666+0000 7f64108ac700 1 --2- 172.21.15.38:0/433620573 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f63ec04d650 0x7f63ec04fb10 secure :-1 s=READY pgs=318 cs=0 l=1 rx=0x7f63fc0013e0 tx=0x7f63fc001560).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:16.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.669+0000 7f64110ad700 1 --2- 172.21.15.38:0/433620573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f640c0b45b0 0x7f640c063300 secure :-1 s=THROTTLE_DONE pgs=817 cs=0 l=1 rx=0x7f640c0afd60 tx=0x7f6404001bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:16.700 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.669+0000 7f63fa7fc700 1 -- 172.21.15.38:0/433620573 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f640403c5a0 con 0x7f640c0b45b0 2020-06-12T17:51:16.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.861+0000 7f6413311700 1 -- 172.21.15.38:0/433620573 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_7266", "target": ["mon-mgr", ""]}) v1 -- 0x7f640c1464e0 con 0x7f63ec04d650 2020-06-12T17:51:16.885 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.882+0000 7f64108ac700 1 --2- 172.21.15.38:0/433620573 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f63ec04d650 0x7f63ec04fb10 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7f63fc0013e0 tx=0x7f63fc001560).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:16.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.882+0000 7f63fa7fc700 1 -- 172.21.15.38:0/433620573 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f640c1464e0 con 0x7f63ec04d650 2020-06-12T17:51:16.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.883+0000 7f6413311700 1 -- 172.21.15.38:0/433620573 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f63ec04d650 msgr2=0x7f63ec04fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:16.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.883+0000 7f6413311700 1 --2- 172.21.15.38:0/433620573 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f63ec04d650 0x7f63ec04fb10 secure :-1 s=READY pgs=318 cs=0 l=1 rx=0x7f63fc0013e0 tx=0x7f63fc001560).stop 2020-06-12T17:51:16.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.883+0000 7f6413311700 1 -- 172.21.15.38:0/433620573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f640c0b45b0 msgr2=0x7f640c063300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:16.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.883+0000 7f6413311700 1 --2- 172.21.15.38:0/433620573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f640c0b45b0 0x7f640c063300 secure :-1 s=READY pgs=817 cs=0 l=1 rx=0x7f640c0afd60 tx=0x7f6404001bc0).stop 2020-06-12T17:51:16.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.883+0000 7f6413311700 1 -- 172.21.15.38:0/433620573 shutdown_connections 2020-06-12T17:51:16.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.883+0000 7f6413311700 1 --2- 172.21.15.38:0/433620573 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f63ec04d650 0x7f63ec04fb10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:16.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.883+0000 7f6413311700 1 --2- 172.21.15.38:0/433620573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f640c0b45b0 0x7f640c063300 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:16.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.883+0000 7f6413311700 1 --2- 172.21.15.38:0/433620573 >> v2:172.21.15.150:3300/0 conn(0x7f640c064640 0x7f640c064ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:16.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.883+0000 7f6413311700 1 -- 172.21.15.38:0/433620573 >> 172.21.15.38:0/433620573 conn(0x7f640c0b5a20 msgr2=0x7f640c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:16.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.884+0000 7f6413311700 1 -- 172.21.15.38:0/433620573 shutdown_connections 2020-06-12T17:51:16.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:16.884+0000 7f6413311700 1 -- 172.21.15.38:0/433620573 wait complete. 2020-06-12T17:51:16.897 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_7266 2020-06-12T17:51:17.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.010+0000 7f8c85dee700 1 Processor -- start 2020-06-12T17:51:17.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.010+0000 7f8c85dee700 1 -- start start 2020-06-12T17:51:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.011+0000 7f8c85dee700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8c80146680 0x7f8c800ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:17.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.011+0000 7f8c85dee700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8c8009d8d0 0x7f8c801421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:17.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.011+0000 7f8c85dee700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c80146d20 con 0x7f8c800b2eb0 2020-06-12T17:51:17.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.011+0000 7f8c85dee700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c80066a80 con 0x7f8c80146680 2020-06-12T17:51:17.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.011+0000 7f8c85dee700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c80146f50 con 0x7f8c8009d8d0 2020-06-12T17:51:17.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.011+0000 7f8c7f7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8c80146680 0x7f8c800ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:17.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.011+0000 7f8c7effd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8c800b2eb0 0x7f8c8009d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41454/0 (socket says 172.21.15.38:41454) 2020-06-12T17:51:17.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.011+0000 7f8c7f7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8c80146680 0x7f8c800ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39638/0 (socket says 172.21.15.38:39638) 2020-06-12T17:51:17.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.011+0000 7f8c7effd700 1 -- 172.21.15.38:0/934405682 learned_addr learned my addr 172.21.15.38:0/934405682 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:17.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.011+0000 7f8c7ffff700 1 --2- 172.21.15.38:0/934405682 >> v2:172.21.15.150:3300/0 conn(0x7f8c8009d8d0 0x7f8c801421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:17.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.011+0000 7f8c7f7fe700 1 -- 172.21.15.38:0/934405682 >> v2:172.21.15.150:3300/0 conn(0x7f8c8009d8d0 msgr2=0x7f8c801421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:17.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.011+0000 7f8c7f7fe700 1 --2- 172.21.15.38:0/934405682 >> v2:172.21.15.150:3300/0 conn(0x7f8c8009d8d0 0x7f8c801421d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:17.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.011+0000 7f8c7f7fe700 1 -- 172.21.15.38:0/934405682 >> v1:172.21.15.38:6789/0 conn(0x7f8c800b2eb0 legacy=0x7f8c8009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:17.020 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.011+0000 7f8c7e7fc700 1 -- 172.21.15.38:0/934405682 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3835250617 0 0) 0x7f8c80146d20 con 0x7f8c800b2eb0 2020-06-12T17:51:17.020 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.011+0000 7f8c7f7fe700 1 -- 172.21.15.38:0/934405682 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c80146a60 con 0x7f8c80146680 2020-06-12T17:51:17.020 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.011+0000 7f8c7ffff700 1 --2- 172.21.15.38:0/934405682 >> v2:172.21.15.150:3300/0 conn(0x7f8c8009d8d0 0x7f8c801421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:51:17.020 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.012+0000 7f8c7f7fe700 1 --2- 172.21.15.38:0/934405682 >> v2:172.21.15.38:3300/0 conn(0x7f8c80146680 0x7f8c800ad5b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8c70002f30 tx=0x7f8c70007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:17.020 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.012+0000 7f8c7f7fe700 1 --2- 172.21.15.38:0/934405682 >> v2:172.21.15.38:3300/0 conn(0x7f8c80146680 0x7f8c800ad5b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8c70002f30 tx=0x7f8c70007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:17.021 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.012+0000 7f8c7f7fe700 1 --2- 172.21.15.38:0/934405682 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c80146680 0x7f8c800ad5b0 secure :-1 s=READY pgs=819 cs=0 l=1 rx=0x7f8c70002f30 tx=0x7f8c70007e60).ready entity=mon.0 client_cookie=3c1b3ed65108ae75 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:17.021 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.012+0000 7f8c7f7fe700 1 --2- 172.21.15.38:0/934405682 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c80146680 0x7f8c800ad5b0 secure :-1 s=THROTTLE_DONE pgs=819 cs=0 l=1 rx=0x7f8c70002f30 tx=0x7f8c70007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:17.021 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.012+0000 7f8c7e7fc700 1 -- 172.21.15.38:0/934405682 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c70011430 con 0x7f8c80146680 2020-06-12T17:51:17.021 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.012+0000 7f8c7f7fe700 1 --2- 172.21.15.38:0/934405682 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c80146680 0x7f8c800ad5b0 secure :-1 s=THROTTLE_DONE pgs=819 cs=0 l=1 rx=0x7f8c70002f30 tx=0x7f8c70007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:17.021 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.012+0000 7f8c7e7fc700 1 -- 172.21.15.38:0/934405682 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c70011590 con 0x7f8c80146680 2020-06-12T17:51:17.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.012+0000 7f8c7f7fe700 1 --2- 172.21.15.38:0/934405682 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c80146680 0x7f8c800ad5b0 secure :-1 s=THROTTLE_DONE pgs=819 cs=0 l=1 rx=0x7f8c70002f30 tx=0x7f8c70007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:17.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.012+0000 7f8c7e7fc700 1 -- 172.21.15.38:0/934405682 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c70011930 con 0x7f8c80146680 2020-06-12T17:51:17.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.012+0000 7f8c85dee700 1 -- 172.21.15.38:0/934405682 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c80146680 msgr2=0x7f8c800ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:17.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.012+0000 7f8c85dee700 1 --2- 172.21.15.38:0/934405682 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c80146680 0x7f8c800ad5b0 secure :-1 s=READY pgs=819 cs=0 l=1 rx=0x7f8c70002f30 tx=0x7f8c70007e60).stop 2020-06-12T17:51:17.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.012+0000 7f8c85dee700 1 -- 172.21.15.38:0/934405682 shutdown_connections 2020-06-12T17:51:17.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.012+0000 7f8c85dee700 1 --2- 172.21.15.38:0/934405682 >> v2:172.21.15.150:3300/0 conn(0x7f8c8009d8d0 0x7f8c801421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:17.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.012+0000 7f8c85dee700 1 --2- 172.21.15.38:0/934405682 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c80146680 0x7f8c800ad5b0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:17.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.012+0000 7f8c85dee700 1 -- 172.21.15.38:0/934405682 >> 172.21.15.38:0/934405682 conn(0x7f8c800b5a20 msgr2=0x7f8c8005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:17.023 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.012+0000 7f8c85dee700 1 -- 172.21.15.38:0/934405682 shutdown_connections 2020-06-12T17:51:17.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.012+0000 7f8c85dee700 1 -- 172.21.15.38:0/934405682 wait complete. 2020-06-12T17:51:17.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.013+0000 7f8c85dee700 1 Processor -- start 2020-06-12T17:51:17.024 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.013+0000 7f8c85dee700 1 -- start start 2020-06-12T17:51:17.029 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.014+0000 7f8c85dee700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8c8009d8d0 0x7f8c800661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:17.029 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.014+0000 7f8c85dee700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8c80146680 0x7f8c801452f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:17.029 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.014+0000 7f8c85dee700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c801515b0 con 0x7f8c800b2eb0 2020-06-12T17:51:17.030 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.014+0000 7f8c85dee700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c801513a0 con 0x7f8c80146680 2020-06-12T17:51:17.030 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.014+0000 7f8c85dee700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c80151000 con 0x7f8c8009d8d0 2020-06-12T17:51:17.030 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.014+0000 7f8c7ffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8c80146680 0x7f8c801452f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:17.030 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.014+0000 7f8c7ffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8c80146680 0x7f8c801452f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39648/0 (socket says 172.21.15.38:39648) 2020-06-12T17:51:17.031 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.014+0000 7f8c7ffff700 1 -- 172.21.15.38:0/3501371477 learned_addr learned my addr 172.21.15.38:0/3501371477 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:17.031 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.014+0000 7f8c7f7fe700 1 --2- 172.21.15.38:0/3501371477 >> v2:172.21.15.150:3300/0 conn(0x7f8c8009d8d0 0x7f8c800661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:17.032 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.015+0000 7f8c7ffff700 1 -- 172.21.15.38:0/3501371477 >> v2:172.21.15.150:3300/0 conn(0x7f8c8009d8d0 msgr2=0x7f8c800661c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:17.032 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.015+0000 7f8c7ffff700 1 --2- 172.21.15.38:0/3501371477 >> v2:172.21.15.150:3300/0 conn(0x7f8c8009d8d0 0x7f8c800661c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:17.032 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.015+0000 7f8c7ffff700 1 -- 172.21.15.38:0/3501371477 >> v1:172.21.15.150:6789/0 conn(0x7f8c800b2eb0 legacy=0x7f8c80154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:17.032 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.015+0000 7f8c7ffff700 1 -- 172.21.15.38:0/3501371477 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c80151a50 con 0x7f8c80146680 2020-06-12T17:51:17.033 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.015+0000 7f8c7f7fe700 1 --2- 172.21.15.38:0/3501371477 >> v2:172.21.15.150:3300/0 conn(0x7f8c8009d8d0 0x7f8c800661c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:51:17.033 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.015+0000 7f8c7ffff700 1 --2- 172.21.15.38:0/3501371477 >> v2:172.21.15.38:3300/0 conn(0x7f8c80146680 0x7f8c801452f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8c78003270 tx=0x7f8c780081f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:17.033 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.015+0000 7f8c7ffff700 1 --2- 172.21.15.38:0/3501371477 >> v2:172.21.15.38:3300/0 conn(0x7f8c80146680 0x7f8c801452f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8c78003270 tx=0x7f8c780081f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:17.033 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.015+0000 7f8c7ffff700 1 --2- 172.21.15.38:0/3501371477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c80146680 0x7f8c801452f0 secure :-1 s=READY pgs=820 cs=0 l=1 rx=0x7f8c78003270 tx=0x7f8c780081f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:17.033 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.015+0000 7f8c7ffff700 1 --2- 172.21.15.38:0/3501371477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c80146680 0x7f8c801452f0 secure :-1 s=THROTTLE_DONE pgs=820 cs=0 l=1 rx=0x7f8c78003270 tx=0x7f8c780081f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:17.034 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.015+0000 7f8c7cff9700 1 -- 172.21.15.38:0/3501371477 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c78007350 con 0x7f8c80146680 2020-06-12T17:51:17.034 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.015+0000 7f8c7ffff700 1 --2- 172.21.15.38:0/3501371477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c80146680 0x7f8c801452f0 secure :-1 s=THROTTLE_DONE pgs=820 cs=0 l=1 rx=0x7f8c78003270 tx=0x7f8c780081f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:17.034 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.015+0000 7f8c7ffff700 1 --2- 172.21.15.38:0/3501371477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c80146680 0x7f8c801452f0 secure :-1 s=THROTTLE_DONE pgs=820 cs=0 l=1 rx=0x7f8c78003270 tx=0x7f8c780081f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:17.034 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.015+0000 7f8c7cff9700 1 -- 172.21.15.38:0/3501371477 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c780074b0 con 0x7f8c80146680 2020-06-12T17:51:17.034 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.015+0000 7f8c85dee700 1 -- 172.21.15.38:0/3501371477 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c80151ca0 con 0x7f8c80146680 2020-06-12T17:51:17.035 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.015+0000 7f8c7cff9700 1 -- 172.21.15.38:0/3501371477 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c78007890 con 0x7f8c80146680 2020-06-12T17:51:17.035 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.015+0000 7f8c85dee700 1 -- 172.21.15.38:0/3501371477 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c800b1ee0 con 0x7f8c80146680 2020-06-12T17:51:17.035 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.015+0000 7f8c7ffff700 1 --2- 172.21.15.38:0/3501371477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c80146680 0x7f8c801452f0 secure :-1 s=THROTTLE_DONE pgs=820 cs=0 l=1 rx=0x7f8c78003270 tx=0x7f8c780081f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:17.035 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.016+0000 7f8c85dee700 1 -- 172.21.15.38:0/3501371477 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c80151140 con 0x7f8c80146680 2020-06-12T17:51:17.035 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.016+0000 7f8c7cff9700 1 -- 172.21.15.38:0/3501371477 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f8c78012470 con 0x7f8c80146680 2020-06-12T17:51:17.036 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.016+0000 7f8c7ffff700 1 --2- 172.21.15.38:0/3501371477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c80146680 0x7f8c801452f0 secure :-1 s=THROTTLE_DONE pgs=820 cs=0 l=1 rx=0x7f8c78003270 tx=0x7f8c780081f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:17.036 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.016+0000 7f8c7cff9700 1 --2- 172.21.15.38:0/3501371477 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8c6004d5c0 0x7f8c6004fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:17.036 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.016+0000 7f8c7cff9700 1 -- 172.21.15.38:0/3501371477 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8c78061130 con 0x7f8c80146680 2020-06-12T17:51:17.036 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.016+0000 7f8c7f7fe700 1 --2- 172.21.15.38:0/3501371477 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8c6004d5c0 0x7f8c6004fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:17.036 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.017+0000 7f8c7f7fe700 1 --2- 172.21.15.38:0/3501371477 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8c6004d5c0 0x7f8c6004fa80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8c70002f30 tx=0x7f8c70007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:17.037 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.017+0000 7f8c7f7fe700 1 --2- 172.21.15.38:0/3501371477 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8c6004d5c0 0x7f8c6004fa80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8c70002f30 tx=0x7f8c70007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:17.037 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.017+0000 7f8c7f7fe700 1 --2- 172.21.15.38:0/3501371477 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8c6004d5c0 0x7f8c6004fa80 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7f8c70002f30 tx=0x7f8c70007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:17.037 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.020+0000 7f8c7ffff700 1 --2- 172.21.15.38:0/3501371477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c80146680 0x7f8c801452f0 secure :-1 s=THROTTLE_DONE pgs=820 cs=0 l=1 rx=0x7f8c78003270 tx=0x7f8c780081f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:17.037 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.020+0000 7f8c7cff9700 1 -- 172.21.15.38:0/3501371477 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f8c7803c910 con 0x7f8c80146680 2020-06-12T17:51:17.215 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.212+0000 7f8c85dee700 1 -- 172.21.15.38:0/3501371477 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_7266", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c80151740 con 0x7f8c6004d5c0 2020-06-12T17:51:17.218 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.215+0000 7f8c7f7fe700 1 --2- 172.21.15.38:0/3501371477 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8c6004d5c0 0x7f8c6004fa80 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f8c70002f30 tx=0x7f8c70007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:17.219 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.215+0000 7f8c7cff9700 1 -- 172.21.15.38:0/3501371477 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f8c80151740 con 0x7f8c6004d5c0 2020-06-12T17:51:17.219 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_7266/59830d95-836c-478b-bee4-532825cb6cee 2020-06-12T17:51:17.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.216+0000 7f8c85dee700 1 -- 172.21.15.38:0/3501371477 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8c6004d5c0 msgr2=0x7f8c6004fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:17.220 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.216+0000 7f8c85dee700 1 --2- 172.21.15.38:0/3501371477 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8c6004d5c0 0x7f8c6004fa80 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7f8c70002f30 tx=0x7f8c70007e60).stop 2020-06-12T17:51:17.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.216+0000 7f8c85dee700 1 -- 172.21.15.38:0/3501371477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c80146680 msgr2=0x7f8c801452f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:17.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.216+0000 7f8c85dee700 1 --2- 172.21.15.38:0/3501371477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c80146680 0x7f8c801452f0 secure :-1 s=READY pgs=820 cs=0 l=1 rx=0x7f8c78003270 tx=0x7f8c780081f0).stop 2020-06-12T17:51:17.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.216+0000 7f8c85dee700 1 -- 172.21.15.38:0/3501371477 shutdown_connections 2020-06-12T17:51:17.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.216+0000 7f8c85dee700 1 --2- 172.21.15.38:0/3501371477 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f8c6004d5c0 0x7f8c6004fa80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:17.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.216+0000 7f8c85dee700 1 --2- 172.21.15.38:0/3501371477 >> v2:172.21.15.150:3300/0 conn(0x7f8c8009d8d0 0x7f8c800661c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:17.222 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.216+0000 7f8c85dee700 1 --2- 172.21.15.38:0/3501371477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c80146680 0x7f8c801452f0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:17.222 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.216+0000 7f8c85dee700 1 -- 172.21.15.38:0/3501371477 >> 172.21.15.38:0/3501371477 conn(0x7f8c800b5a20 msgr2=0x7f8c801410c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:17.222 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.216+0000 7f8c85dee700 1 -- 172.21.15.38:0/3501371477 shutdown_connections 2020-06-12T17:51:17.222 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:17.216+0000 7f8c85dee700 1 -- 172.21.15.38:0/3501371477 wait complete. 2020-06-12T17:51:17.230 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_7266 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_7266/59830d95-836c-478b-bee4-532825cb6cee 2020-06-12T17:51:17.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:17.231 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:17.232 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:17.248 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:17.248 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:17.249 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7266/59830d95-836c-478b-bee4-532825cb6cee/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:17.344 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:17.344 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:17.345 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129637 s, 80.9 MB/s 2020-06-12T17:51:17.346 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:17.346 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:17.347 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:17.361 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:17.364 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:17.364 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7266/59830d95-836c-478b-bee4-532825cb6cee/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:17.451 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:17.452 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:17.452 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104409 s, 100 MB/s 2020-06-12T17:51:17.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:17.453 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:17.454 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:17.470 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:17.471 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:17.473 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7266/59830d95-836c-478b-bee4-532825cb6cee/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:17.557 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:17.558 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:17.558 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114043 s, 91.9 MB/s 2020-06-12T17:51:17.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:17.560 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:17.560 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:17.575 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:17.576 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:17.576 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7266/59830d95-836c-478b-bee4-532825cb6cee/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:17.662 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:17.662 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:17.663 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109092 s, 96.1 MB/s 2020-06-12T17:51:17.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:17.665 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:17.665 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:17.680 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:17.681 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:17.681 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7266/59830d95-836c-478b-bee4-532825cb6cee/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:17.766 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:17.767 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:17.767 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949546 s, 110 MB/s 2020-06-12T17:51:17.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:17.768 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:17.769 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:17.784 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:17.784 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:17.785 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7266/59830d95-836c-478b-bee4-532825cb6cee/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:17.874 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:17.875 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:17.875 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115423 s, 90.8 MB/s 2020-06-12T17:51:17.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:17.876 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:17.876 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:17.898 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:17.903 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:17.904 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7266/59830d95-836c-478b-bee4-532825cb6cee/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:17.988 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:17.989 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:17.989 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00911599 s, 115 MB/s 2020-06-12T17:51:17.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:17.990 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:17.991 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:18.006 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:18.007 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:18.007 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7266/59830d95-836c-478b-bee4-532825cb6cee/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:18.033 INFO:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-06-12T17:51:18.051 INFO:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-06-12T17:51:18.097 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:18.097 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:18.098 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106782 s, 98.2 MB/s 2020-06-12T17:51:18.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:18.100 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:18.100 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:18.164 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:18.165 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:18.165 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7266/59830d95-836c-478b-bee4-532825cb6cee/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:18.254 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:18.255 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:18.255 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011535 s, 90.9 MB/s 2020-06-12T17:51:18.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:18.256 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:18.257 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:18.272 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:18.273 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:18.273 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7266/59830d95-836c-478b-bee4-532825cb6cee/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:18.363 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:18.364 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:18.364 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122975 s, 85.3 MB/s 2020-06-12T17:51:18.365 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_7902 2020-06-12T17:51:18.483 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.479+0000 7f11912c9700 1 Processor -- start 2020-06-12T17:51:18.483 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.479+0000 7f11912c9700 1 -- start start 2020-06-12T17:51:18.486 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.480+0000 7f11912c9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f118c0ad5b0 0x7f118c0b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:18.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.480+0000 7f11912c9700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f118c09d8d0 0x7f118c1421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:18.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.480+0000 7f11912c9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c146d20 con 0x7f118c146680 2020-06-12T17:51:18.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.480+0000 7f11912c9700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118c066a80 con 0x7f118c09d8d0 2020-06-12T17:51:18.487 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.480+0000 7f11912c9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118c146f50 con 0x7f118c0ad5b0 2020-06-12T17:51:18.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.481+0000 7f118b7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f118c09d8d0 0x7f118c1421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:18.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.481+0000 7f118b7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f118c09d8d0 0x7f118c1421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39656/0 (socket says 172.21.15.38:39656) 2020-06-12T17:51:18.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.481+0000 7f118b7fe700 1 -- 172.21.15.38:0/864666850 learned_addr learned my addr 172.21.15.38:0/864666850 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:18.488 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.481+0000 7f118a7fc700 1 --2- 172.21.15.38:0/864666850 >> v2:172.21.15.150:3300/0 conn(0x7f118c0ad5b0 0x7f118c0b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:18.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.481+0000 7f118b7fe700 1 -- 172.21.15.38:0/864666850 >> v2:172.21.15.150:3300/0 conn(0x7f118c0ad5b0 msgr2=0x7f118c0b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:18.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.481+0000 7f118b7fe700 1 --2- 172.21.15.38:0/864666850 >> v2:172.21.15.150:3300/0 conn(0x7f118c0ad5b0 0x7f118c0b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:18.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.481+0000 7f118b7fe700 1 -- 172.21.15.38:0/864666850 >> v1:172.21.15.150:6789/0 conn(0x7f118c146680 legacy=0x7f118c09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:18.489 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.481+0000 7f118b7fe700 1 -- 172.21.15.38:0/864666850 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c146a60 con 0x7f118c09d8d0 2020-06-12T17:51:18.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.481+0000 7f118b7fe700 1 --2- 172.21.15.38:0/864666850 >> v2:172.21.15.38:3300/0 conn(0x7f118c09d8d0 0x7f118c1421d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f118c0b61f0 tx=0x7f11840081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.481+0000 7f118b7fe700 1 --2- 172.21.15.38:0/864666850 >> v2:172.21.15.38:3300/0 conn(0x7f118c09d8d0 0x7f118c1421d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f118c0b61f0 tx=0x7f11840081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.481+0000 7f118b7fe700 1 --2- 172.21.15.38:0/864666850 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f118c09d8d0 0x7f118c1421d0 secure :-1 s=READY pgs=821 cs=0 l=1 rx=0x7f118c0b61f0 tx=0x7f11840081e0).ready entity=mon.0 client_cookie=3eea5cf41d52085 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:18.490 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.481+0000 7f118b7fe700 1 --2- 172.21.15.38:0/864666850 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f118c09d8d0 0x7f118c1421d0 secure :-1 s=THROTTLE_DONE pgs=821 cs=0 l=1 rx=0x7f118c0b61f0 tx=0x7f11840081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.481+0000 7f118b7fe700 1 --2- 172.21.15.38:0/864666850 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f118c09d8d0 0x7f118c1421d0 secure :-1 s=THROTTLE_DONE pgs=821 cs=0 l=1 rx=0x7f118c0b61f0 tx=0x7f11840081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.481+0000 7f118b7fe700 1 --2- 172.21.15.38:0/864666850 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f118c09d8d0 0x7f118c1421d0 secure :-1 s=THROTTLE_DONE pgs=821 cs=0 l=1 rx=0x7f118c0b61f0 tx=0x7f11840081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.481+0000 7f1189ffb700 1 -- 172.21.15.38:0/864666850 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1184011ea0 con 0x7f118c09d8d0 2020-06-12T17:51:18.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.481+0000 7f1189ffb700 1 -- 172.21.15.38:0/864666850 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118400a160 con 0x7f118c09d8d0 2020-06-12T17:51:18.491 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.481+0000 7f1189ffb700 1 -- 172.21.15.38:0/864666850 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f118400a540 con 0x7f118c09d8d0 2020-06-12T17:51:18.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.481+0000 7f11912c9700 1 -- 172.21.15.38:0/864666850 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f118c09d8d0 msgr2=0x7f118c1421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:18.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.481+0000 7f11912c9700 1 --2- 172.21.15.38:0/864666850 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f118c09d8d0 0x7f118c1421d0 secure :-1 s=READY pgs=821 cs=0 l=1 rx=0x7f118c0b61f0 tx=0x7f11840081e0).stop 2020-06-12T17:51:18.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.482+0000 7f11912c9700 1 -- 172.21.15.38:0/864666850 shutdown_connections 2020-06-12T17:51:18.492 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.482+0000 7f11912c9700 1 --2- 172.21.15.38:0/864666850 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f118c09d8d0 0x7f118c1421d0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:18.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.482+0000 7f11912c9700 1 --2- 172.21.15.38:0/864666850 >> v2:172.21.15.150:3300/0 conn(0x7f118c0ad5b0 0x7f118c0b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:18.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.482+0000 7f11912c9700 1 -- 172.21.15.38:0/864666850 >> 172.21.15.38:0/864666850 conn(0x7f118c0b5a20 msgr2=0x7f118c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:18.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.482+0000 7f11912c9700 1 -- 172.21.15.38:0/864666850 shutdown_connections 2020-06-12T17:51:18.493 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.482+0000 7f11912c9700 1 -- 172.21.15.38:0/864666850 wait complete. 2020-06-12T17:51:18.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.483+0000 7f11912c9700 1 Processor -- start 2020-06-12T17:51:18.494 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.483+0000 7f11912c9700 1 -- start start 2020-06-12T17:51:18.497 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.484+0000 7f11912c9700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f118c0ad5b0 0x7f118c157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:18.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.484+0000 7f11912c9700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c0b2a70 con 0x7f118c146680 2020-06-12T17:51:18.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.484+0000 7f11912c9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c153770 con 0x7f118c09d8d0 2020-06-12T17:51:18.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.484+0000 7f11912c9700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118c153460 con 0x7f118c0ad5b0 2020-06-12T17:51:18.498 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.484+0000 7f118a7fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f118c0ad5b0 0x7f118c157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:18.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.484+0000 7f118a7fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f118c0ad5b0 0x7f118c157520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39660/0 (socket says 172.21.15.38:39660) 2020-06-12T17:51:18.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.484+0000 7f118a7fc700 1 -- 172.21.15.38:0/2211927796 learned_addr learned my addr 172.21.15.38:0/2211927796 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:18.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.484+0000 7f118a7fc700 1 -- 172.21.15.38:0/2211927796 >> v1:172.21.15.150:6789/0 conn(0x7f118c09d8d0 legacy=0x7f118c065ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:18.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.484+0000 7f1183fff700 1 -- 172.21.15.38:0/2211927796 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1591182259 0 0) 0x7f118c153770 con 0x7f118c09d8d0 2020-06-12T17:51:18.499 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.484+0000 7f118a7fc700 1 -- 172.21.15.38:0/2211927796 >> v1:172.21.15.38:6789/0 conn(0x7f118c146680 legacy=0x7f118c153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:18.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.484+0000 7f118a7fc700 1 -- 172.21.15.38:0/2211927796 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c154320 con 0x7f118c0ad5b0 2020-06-12T17:51:18.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.484+0000 7f118a7fc700 1 --2- 172.21.15.38:0/2211927796 >> v2:172.21.15.38:3300/0 conn(0x7f118c0ad5b0 0x7f118c157520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1184008250 tx=0x7f117c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.484+0000 7f118a7fc700 1 --2- 172.21.15.38:0/2211927796 >> v2:172.21.15.38:3300/0 conn(0x7f118c0ad5b0 0x7f118c157520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1184008250 tx=0x7f117c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.500 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.484+0000 7f118a7fc700 1 --2- 172.21.15.38:0/2211927796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f118c0ad5b0 0x7f118c157520 secure :-1 s=READY pgs=823 cs=0 l=1 rx=0x7f1184008250 tx=0x7f117c007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:18.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.484+0000 7f118a7fc700 1 --2- 172.21.15.38:0/2211927796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f118c0ad5b0 0x7f118c157520 secure :-1 s=THROTTLE_DONE pgs=823 cs=0 l=1 rx=0x7f1184008250 tx=0x7f117c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.484+0000 7f1183fff700 1 -- 172.21.15.38:0/2211927796 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f117c007530 con 0x7f118c0ad5b0 2020-06-12T17:51:18.501 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.484+0000 7f118a7fc700 1 --2- 172.21.15.38:0/2211927796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f118c0ad5b0 0x7f118c157520 secure :-1 s=THROTTLE_DONE pgs=823 cs=0 l=1 rx=0x7f1184008250 tx=0x7f117c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.502 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.484+0000 7f118a7fc700 1 --2- 172.21.15.38:0/2211927796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f118c0ad5b0 0x7f118c157520 secure :-1 s=THROTTLE_DONE pgs=823 cs=0 l=1 rx=0x7f1184008250 tx=0x7f117c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.502 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.484+0000 7f1183fff700 1 -- 172.21.15.38:0/2211927796 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117c0056c0 con 0x7f118c0ad5b0 2020-06-12T17:51:18.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.484+0000 7f11912c9700 1 -- 172.21.15.38:0/2211927796 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118c13ee30 con 0x7f118c0ad5b0 2020-06-12T17:51:18.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.484+0000 7f1183fff700 1 -- 172.21.15.38:0/2211927796 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f117c005ae0 con 0x7f118c0ad5b0 2020-06-12T17:51:18.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.484+0000 7f11912c9700 1 -- 172.21.15.38:0/2211927796 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f118c13f350 con 0x7f118c0ad5b0 2020-06-12T17:51:18.516 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.485+0000 7f118a7fc700 1 --2- 172.21.15.38:0/2211927796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f118c0ad5b0 0x7f118c157520 secure :-1 s=THROTTLE_DONE pgs=823 cs=0 l=1 rx=0x7f1184008250 tx=0x7f117c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.517 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.485+0000 7f11912c9700 1 -- 172.21.15.38:0/2211927796 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118c1535a0 con 0x7f118c0ad5b0 2020-06-12T17:51:18.517 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.485+0000 7f1183fff700 1 -- 172.21.15.38:0/2211927796 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f117c005c40 con 0x7f118c0ad5b0 2020-06-12T17:51:18.517 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.485+0000 7f118a7fc700 1 --2- 172.21.15.38:0/2211927796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f118c0ad5b0 0x7f118c157520 secure :-1 s=THROTTLE_DONE pgs=823 cs=0 l=1 rx=0x7f1184008250 tx=0x7f117c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.517 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.486+0000 7f1183fff700 1 --2- 172.21.15.38:0/2211927796 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f117004d460 0x7f117004f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:18.517 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.486+0000 7f1183fff700 1 -- 172.21.15.38:0/2211927796 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f117c0611b0 con 0x7f118c0ad5b0 2020-06-12T17:51:18.518 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.486+0000 7f118affd700 1 --2- 172.21.15.38:0/2211927796 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f117004d460 0x7f117004f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:18.520 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.486+0000 7f118affd700 1 --2- 172.21.15.38:0/2211927796 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f117004d460 0x7f117004f920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1174002170 tx=0x7f11740025c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.486+0000 7f118affd700 1 --2- 172.21.15.38:0/2211927796 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f117004d460 0x7f117004f920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1174002170 tx=0x7f11740025c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.521 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.486+0000 7f118affd700 1 --2- 172.21.15.38:0/2211927796 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f117004d460 0x7f117004f920 secure :-1 s=READY pgs=320 cs=0 l=1 rx=0x7f1174002170 tx=0x7f11740025c0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:18.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.489+0000 7f118a7fc700 1 --2- 172.21.15.38:0/2211927796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f118c0ad5b0 0x7f118c157520 secure :-1 s=THROTTLE_DONE pgs=823 cs=0 l=1 rx=0x7f1184008250 tx=0x7f117c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.522 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.489+0000 7f1183fff700 1 -- 172.21.15.38:0/2211927796 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f117c03c930 con 0x7f118c0ad5b0 2020-06-12T17:51:18.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.681+0000 7f11912c9700 1 -- 172.21.15.38:0/2211927796 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_7902", "target": ["mon-mgr", ""]}) v1 -- 0x7f118c153900 con 0x7f117004d460 2020-06-12T17:51:18.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.699+0000 7f118affd700 1 --2- 172.21.15.38:0/2211927796 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f117004d460 0x7f117004f920 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7f1174002170 tx=0x7f11740025c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.703 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.699+0000 7f1183fff700 1 -- 172.21.15.38:0/2211927796 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f118c153900 con 0x7f117004d460 2020-06-12T17:51:18.705 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.701+0000 7f11912c9700 1 -- 172.21.15.38:0/2211927796 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f117004d460 msgr2=0x7f117004f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:18.705 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.701+0000 7f11912c9700 1 --2- 172.21.15.38:0/2211927796 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f117004d460 0x7f117004f920 secure :-1 s=READY pgs=320 cs=0 l=1 rx=0x7f1174002170 tx=0x7f11740025c0).stop 2020-06-12T17:51:18.705 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.701+0000 7f11912c9700 1 -- 172.21.15.38:0/2211927796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f118c0ad5b0 msgr2=0x7f118c157520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:18.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.701+0000 7f11912c9700 1 --2- 172.21.15.38:0/2211927796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f118c0ad5b0 0x7f118c157520 secure :-1 s=READY pgs=823 cs=0 l=1 rx=0x7f1184008250 tx=0x7f117c007e60).stop 2020-06-12T17:51:18.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.701+0000 7f11912c9700 1 -- 172.21.15.38:0/2211927796 shutdown_connections 2020-06-12T17:51:18.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.701+0000 7f11912c9700 1 --2- 172.21.15.38:0/2211927796 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f117004d460 0x7f117004f920 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:18.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.701+0000 7f11912c9700 1 --2- 172.21.15.38:0/2211927796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f118c0ad5b0 0x7f118c157520 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:18.706 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.701+0000 7f11912c9700 1 -- 172.21.15.38:0/2211927796 >> 172.21.15.38:0/2211927796 conn(0x7f118c0b5a20 msgr2=0x7f118c0b7010 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:18.707 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.701+0000 7f11912c9700 1 -- 172.21.15.38:0/2211927796 shutdown_connections 2020-06-12T17:51:18.707 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.701+0000 7f11912c9700 1 -- 172.21.15.38:0/2211927796 wait complete. 2020-06-12T17:51:18.721 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_7902 2020-06-12T17:51:18.845 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.841+0000 7ff77696e700 1 Processor -- start 2020-06-12T17:51:18.845 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.841+0000 7ff77696e700 1 -- start start 2020-06-12T17:51:18.851 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.842+0000 7ff77696e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff770065420 0x7ff77005b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:18.852 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.842+0000 7ff77696e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff770146510 0x7ff770149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:18.852 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.842+0000 7ff77696e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff77005c8e0 con 0x7ff770146090 2020-06-12T17:51:18.852 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.842+0000 7ff77696e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff770149700 con 0x7ff770146510 2020-06-12T17:51:18.852 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.842+0000 7ff77696e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77005cb80 con 0x7ff770065420 2020-06-12T17:51:18.853 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.842+0000 7ff774f0b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff770146510 0x7ff770149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:18.853 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.842+0000 7ff774f0b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff770146510 0x7ff770149ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39670/0 (socket says 172.21.15.38:39670) 2020-06-12T17:51:18.853 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.842+0000 7ff774f0b700 1 -- 172.21.15.38:0/4113032059 learned_addr learned my addr 172.21.15.38:0/4113032059 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:18.853 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.842+0000 7ff76ffff700 1 --2- 172.21.15.38:0/4113032059 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff770065420 0x7ff77005b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:18.853 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.842+0000 7ff774f0b700 1 -- 172.21.15.38:0/4113032059 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff770065420 msgr2=0x7ff77005b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:18.854 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.842+0000 7ff774f0b700 1 --2- 172.21.15.38:0/4113032059 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff770065420 0x7ff77005b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:18.854 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.843+0000 7ff774f0b700 1 -- 172.21.15.38:0/4113032059 >> v1:172.21.15.150:6789/0 conn(0x7ff770146090 legacy=0x7ff7700b7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:18.854 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.843+0000 7ff774f0b700 1 -- 172.21.15.38:0/4113032059 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7700b7780 con 0x7ff770146510 2020-06-12T17:51:18.855 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.843+0000 7ff774f0b700 1 --2- 172.21.15.38:0/4113032059 >> v2:172.21.15.38:3300/0 conn(0x7ff770146510 0x7ff770149ba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff7680032b0 tx=0x7ff7680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.855 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.843+0000 7ff774f0b700 1 --2- 172.21.15.38:0/4113032059 >> v2:172.21.15.38:3300/0 conn(0x7ff770146510 0x7ff770149ba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff7680032b0 tx=0x7ff7680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.855 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.843+0000 7ff774f0b700 1 --2- 172.21.15.38:0/4113032059 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146510 0x7ff770149ba0 secure :-1 s=READY pgs=824 cs=0 l=1 rx=0x7ff7680032b0 tx=0x7ff7680081e0).ready entity=mon.0 client_cookie=86c2aebc93b34dc3 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:18.855 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.843+0000 7ff774f0b700 1 --2- 172.21.15.38:0/4113032059 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146510 0x7ff770149ba0 secure :-1 s=THROTTLE_DONE pgs=824 cs=0 l=1 rx=0x7ff7680032b0 tx=0x7ff7680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.855 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.843+0000 7ff76effd700 1 -- 172.21.15.38:0/4113032059 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff76800a160 con 0x7ff770146510 2020-06-12T17:51:18.856 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.843+0000 7ff774f0b700 1 --2- 172.21.15.38:0/4113032059 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146510 0x7ff770149ba0 secure :-1 s=THROTTLE_DONE pgs=824 cs=0 l=1 rx=0x7ff7680032b0 tx=0x7ff7680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.856 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.843+0000 7ff774f0b700 1 --2- 172.21.15.38:0/4113032059 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146510 0x7ff770149ba0 secure :-1 s=THROTTLE_DONE pgs=824 cs=0 l=1 rx=0x7ff7680032b0 tx=0x7ff7680081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.856 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.843+0000 7ff76effd700 1 -- 172.21.15.38:0/4113032059 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76800a2c0 con 0x7ff770146510 2020-06-12T17:51:18.856 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.843+0000 7ff76effd700 1 -- 172.21.15.38:0/4113032059 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff76800a6e0 con 0x7ff770146510 2020-06-12T17:51:18.856 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.843+0000 7ff77696e700 1 -- 172.21.15.38:0/4113032059 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146510 msgr2=0x7ff770149ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:18.857 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.843+0000 7ff77696e700 1 --2- 172.21.15.38:0/4113032059 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146510 0x7ff770149ba0 secure :-1 s=READY pgs=824 cs=0 l=1 rx=0x7ff7680032b0 tx=0x7ff7680081e0).stop 2020-06-12T17:51:18.857 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.843+0000 7ff77696e700 1 -- 172.21.15.38:0/4113032059 shutdown_connections 2020-06-12T17:51:18.857 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.843+0000 7ff77696e700 1 --2- 172.21.15.38:0/4113032059 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff770065420 0x7ff77005b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:18.857 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.843+0000 7ff77696e700 1 --2- 172.21.15.38:0/4113032059 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146510 0x7ff770149ba0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:18.857 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.843+0000 7ff77696e700 1 -- 172.21.15.38:0/4113032059 >> 172.21.15.38:0/4113032059 conn(0x7ff7700ba610 msgr2=0x7ff7700baa20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:18.858 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.843+0000 7ff77696e700 1 -- 172.21.15.38:0/4113032059 shutdown_connections 2020-06-12T17:51:18.858 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.843+0000 7ff77696e700 1 -- 172.21.15.38:0/4113032059 wait complete. 2020-06-12T17:51:18.858 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.844+0000 7ff77696e700 1 Processor -- start 2020-06-12T17:51:18.858 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.844+0000 7ff77696e700 1 -- start start 2020-06-12T17:51:18.859 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.845+0000 7ff77696e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff770146090 0x7ff7700608d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:18.859 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.845+0000 7ff77696e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff770147560 con 0x7ff770146510 2020-06-12T17:51:18.859 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.845+0000 7ff77696e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff77005fd20 con 0x7ff770065420 2020-06-12T17:51:18.860 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.845+0000 7ff77696e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff77005ffc0 con 0x7ff770146090 2020-06-12T17:51:18.860 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.845+0000 7ff76f7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff770146090 0x7ff7700608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:18.860 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.845+0000 7ff774f0b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff770146510 0x7ff770147990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41492/0 (socket says 172.21.15.38:41492) 2020-06-12T17:51:18.860 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.845+0000 7ff774f0b700 1 -- 172.21.15.38:0/3972755978 learned_addr learned my addr 172.21.15.38:0/3972755978 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:18.860 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.845+0000 7ff76f7fe700 1 --2- 172.21.15.38:0/3972755978 >> v2:172.21.15.38:3300/0 conn(0x7ff770146090 0x7ff7700608d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39674/0 (socket says 172.21.15.38:39674) 2020-06-12T17:51:18.861 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.846+0000 7ff76f7fe700 1 -- 172.21.15.38:0/3972755978 >> v1:172.21.15.150:6789/0 conn(0x7ff770065420 legacy=0x7ff77013da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:18.861 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.846+0000 7ff76f7fe700 1 -- 172.21.15.38:0/3972755978 >> v1:172.21.15.38:6789/0 conn(0x7ff770146510 legacy=0x7ff770147990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:18.861 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.846+0000 7ff76d7fa700 1 -- 172.21.15.38:0/3972755978 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2985531487 0 0) 0x7ff770147560 con 0x7ff770146510 2020-06-12T17:51:18.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.846+0000 7ff76f7fe700 1 -- 172.21.15.38:0/3972755978 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77005f950 con 0x7ff770146090 2020-06-12T17:51:18.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.846+0000 7ff76f7fe700 1 --2- 172.21.15.38:0/3972755978 >> v2:172.21.15.38:3300/0 conn(0x7ff770146090 0x7ff7700608d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff7700b4de0 tx=0x7ff7640017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.846+0000 7ff76f7fe700 1 --2- 172.21.15.38:0/3972755978 >> v2:172.21.15.38:3300/0 conn(0x7ff770146090 0x7ff7700608d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff7700b4de0 tx=0x7ff7640017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.863 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.846+0000 7ff76f7fe700 1 --2- 172.21.15.38:0/3972755978 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146090 0x7ff7700608d0 secure :-1 s=READY pgs=826 cs=0 l=1 rx=0x7ff7700b4de0 tx=0x7ff7640017f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:18.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.846+0000 7ff76f7fe700 1 --2- 172.21.15.38:0/3972755978 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146090 0x7ff7700608d0 secure :-1 s=THROTTLE_DONE pgs=826 cs=0 l=1 rx=0x7ff7700b4de0 tx=0x7ff7640017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.846+0000 7ff76d7fa700 1 -- 172.21.15.38:0/3972755978 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff76400cc00 con 0x7ff770146090 2020-06-12T17:51:18.864 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.846+0000 7ff76f7fe700 1 --2- 172.21.15.38:0/3972755978 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146090 0x7ff7700608d0 secure :-1 s=THROTTLE_DONE pgs=826 cs=0 l=1 rx=0x7ff7700b4de0 tx=0x7ff7640017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.865 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.846+0000 7ff76f7fe700 1 --2- 172.21.15.38:0/3972755978 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146090 0x7ff7700608d0 secure :-1 s=THROTTLE_DONE pgs=826 cs=0 l=1 rx=0x7ff7700b4de0 tx=0x7ff7640017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.865 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.846+0000 7ff76d7fa700 1 -- 172.21.15.38:0/3972755978 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76400cda0 con 0x7ff770146090 2020-06-12T17:51:18.865 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.846+0000 7ff77696e700 1 -- 172.21.15.38:0/3972755978 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff77013e110 con 0x7ff770146090 2020-06-12T17:51:18.865 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.846+0000 7ff76d7fa700 1 -- 172.21.15.38:0/3972755978 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff764011110 con 0x7ff770146090 2020-06-12T17:51:18.866 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.846+0000 7ff77696e700 1 -- 172.21.15.38:0/3972755978 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7701457c0 con 0x7ff770146090 2020-06-12T17:51:18.866 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.847+0000 7ff76f7fe700 1 --2- 172.21.15.38:0/3972755978 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146090 0x7ff7700608d0 secure :-1 s=THROTTLE_DONE pgs=826 cs=0 l=1 rx=0x7ff7700b4de0 tx=0x7ff7640017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.866 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.847+0000 7ff77696e700 1 -- 172.21.15.38:0/3972755978 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff77009e390 con 0x7ff770146090 2020-06-12T17:51:18.867 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.847+0000 7ff76d7fa700 1 -- 172.21.15.38:0/3972755978 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7ff7640064e0 con 0x7ff770146090 2020-06-12T17:51:18.867 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.847+0000 7ff76f7fe700 1 --2- 172.21.15.38:0/3972755978 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146090 0x7ff7700608d0 secure :-1 s=THROTTLE_DONE pgs=826 cs=0 l=1 rx=0x7ff7700b4de0 tx=0x7ff7640017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.868 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.847+0000 7ff76d7fa700 1 --2- 172.21.15.38:0/3972755978 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff75004d3e0 0x7ff75004f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:18.868 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.847+0000 7ff76d7fa700 1 -- 172.21.15.38:0/3972755978 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff764060a70 con 0x7ff770146090 2020-06-12T17:51:18.868 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.848+0000 7ff76ffff700 1 --2- 172.21.15.38:0/3972755978 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff75004d3e0 0x7ff75004f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:18.868 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.848+0000 7ff76ffff700 1 --2- 172.21.15.38:0/3972755978 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff75004d3e0 0x7ff75004f8a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff770149560 tx=0x7ff760009490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.869 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.848+0000 7ff76ffff700 1 --2- 172.21.15.38:0/3972755978 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff75004d3e0 0x7ff75004f8a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff770149560 tx=0x7ff760009490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.869 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.848+0000 7ff76ffff700 1 --2- 172.21.15.38:0/3972755978 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff75004d3e0 0x7ff75004f8a0 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7ff770149560 tx=0x7ff760009490).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:18.872 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.851+0000 7ff76f7fe700 1 --2- 172.21.15.38:0/3972755978 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146090 0x7ff7700608d0 secure :-1 s=THROTTLE_DONE pgs=826 cs=0 l=1 rx=0x7ff7700b4de0 tx=0x7ff7640017f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:18.873 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:18.851+0000 7ff76d7fa700 1 -- 172.21.15.38:0/3972755978 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7ff76403c250 con 0x7ff770146090 2020-06-12T17:51:19.045 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:19.042+0000 7ff77696e700 1 -- 172.21.15.38:0/3972755978 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_7902", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7701476f0 con 0x7ff75004d3e0 2020-06-12T17:51:19.049 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:19.045+0000 7ff76ffff700 1 --2- 172.21.15.38:0/3972755978 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff75004d3e0 0x7ff75004f8a0 secure :-1 s=THROTTLE_DONE pgs=321 cs=0 l=1 rx=0x7ff770149560 tx=0x7ff760009490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:19.050 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:19.046+0000 7ff76d7fa700 1 -- 172.21.15.38:0/3972755978 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7ff7600056c0 con 0x7ff75004d3e0 2020-06-12T17:51:19.050 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_7902/ea9f728c-47c9-406d-a272-50452b0fd94d 2020-06-12T17:51:19.051 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:19.047+0000 7ff77696e700 1 -- 172.21.15.38:0/3972755978 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff75004d3e0 msgr2=0x7ff75004f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:19.052 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:19.047+0000 7ff77696e700 1 --2- 172.21.15.38:0/3972755978 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff75004d3e0 0x7ff75004f8a0 secure :-1 s=READY pgs=321 cs=0 l=1 rx=0x7ff770149560 tx=0x7ff760009490).stop 2020-06-12T17:51:19.052 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:19.047+0000 7ff77696e700 1 -- 172.21.15.38:0/3972755978 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146090 msgr2=0x7ff7700608d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:19.052 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:19.047+0000 7ff77696e700 1 --2- 172.21.15.38:0/3972755978 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146090 0x7ff7700608d0 secure :-1 s=READY pgs=826 cs=0 l=1 rx=0x7ff7700b4de0 tx=0x7ff7640017f0).stop 2020-06-12T17:51:19.053 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:19.047+0000 7ff77696e700 1 -- 172.21.15.38:0/3972755978 shutdown_connections 2020-06-12T17:51:19.053 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:19.047+0000 7ff77696e700 1 --2- 172.21.15.38:0/3972755978 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ff75004d3e0 0x7ff75004f8a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:19.053 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:19.047+0000 7ff77696e700 1 --2- 172.21.15.38:0/3972755978 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff770146090 0x7ff7700608d0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:19.054 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:19.047+0000 7ff77696e700 1 -- 172.21.15.38:0/3972755978 >> 172.21.15.38:0/3972755978 conn(0x7ff7700ba610 msgr2=0x7ff77013fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:19.054 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:19.047+0000 7ff77696e700 1 -- 172.21.15.38:0/3972755978 shutdown_connections 2020-06-12T17:51:19.055 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:19.047+0000 7ff77696e700 1 -- 172.21.15.38:0/3972755978 wait complete. 2020-06-12T17:51:19.060 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_7902 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_7902/ea9f728c-47c9-406d-a272-50452b0fd94d 2020-06-12T17:51:19.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:19.062 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:19.062 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:19.077 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:19.078 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:19.079 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7902/ea9f728c-47c9-406d-a272-50452b0fd94d/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:19.167 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:19.168 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:19.168 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947354 s, 111 MB/s 2020-06-12T17:51:19.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:19.169 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:19.170 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:19.184 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:19.185 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:19.186 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7902/ea9f728c-47c9-406d-a272-50452b0fd94d/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:19.272 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:19.272 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:19.273 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103142 s, 102 MB/s 2020-06-12T17:51:19.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:19.274 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:19.275 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:19.290 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:19.290 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:19.291 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7902/ea9f728c-47c9-406d-a272-50452b0fd94d/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:19.381 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:19.382 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:19.382 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121942 s, 86.0 MB/s 2020-06-12T17:51:19.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:19.384 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:19.384 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:19.399 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:19.399 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:19.400 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7902/ea9f728c-47c9-406d-a272-50452b0fd94d/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:19.486 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:19.486 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:19.487 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103279 s, 102 MB/s 2020-06-12T17:51:19.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:19.488 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:19.488 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:19.504 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:19.504 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:19.505 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7902/ea9f728c-47c9-406d-a272-50452b0fd94d/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:19.592 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:19.592 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:19.593 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103374 s, 101 MB/s 2020-06-12T17:51:19.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:19.594 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:19.595 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:19.610 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:19.610 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:19.611 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7902/ea9f728c-47c9-406d-a272-50452b0fd94d/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:19.699 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:19.699 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:19.699 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118025 s, 88.8 MB/s 2020-06-12T17:51:19.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:19.701 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:19.701 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:19.717 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:19.717 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:19.719 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7902/ea9f728c-47c9-406d-a272-50452b0fd94d/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:19.804 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:19.805 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:19.805 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107004 s, 98.0 MB/s 2020-06-12T17:51:19.806 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:19.807 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:19.807 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:19.822 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:19.823 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:19.823 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7902/ea9f728c-47c9-406d-a272-50452b0fd94d/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:19.911 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:19.911 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:19.912 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129347 s, 81.1 MB/s 2020-06-12T17:51:19.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:19.913 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:19.914 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:19.929 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:19.929 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:19.930 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7902/ea9f728c-47c9-406d-a272-50452b0fd94d/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:20.020 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:20.020 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:20.021 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109648 s, 95.6 MB/s 2020-06-12T17:51:20.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:20.022 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:20.023 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:20.038 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:20.039 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:20.039 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7902/ea9f728c-47c9-406d-a272-50452b0fd94d/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:20.124 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:20.125 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:20.126 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00969734 s, 108 MB/s 2020-06-12T17:51:20.127 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_1565 2020-06-12T17:51:20.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.240+0000 7f83dd84d700 1 Processor -- start 2020-06-12T17:51:20.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.240+0000 7f83dd84d700 1 -- start start 2020-06-12T17:51:20.247 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.241+0000 7f83dd84d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f83d80b11e0 0x7f83d80b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:20.247 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.241+0000 7f83dd84d700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d80b2900 con 0x7f83d80b2380 2020-06-12T17:51:20.248 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.241+0000 7f83dd84d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d80ae7d0 con 0x7f83d80afc20 2020-06-12T17:51:20.248 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.241+0000 7f83dd84d700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d80add30 con 0x7f83d80b11e0 2020-06-12T17:51:20.248 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.241+0000 7f83dc84b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f83d80b11e0 0x7f83d80b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:20.248 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.241+0000 7f83d7fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f83d80b2380 0x7f83d80ae0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41496/0 (socket says 172.21.15.38:41496) 2020-06-12T17:51:20.248 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.241+0000 7f83dc84b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f83d80b11e0 0x7f83d80b15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39682/0 (socket says 172.21.15.38:39682) 2020-06-12T17:51:20.249 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.241+0000 7f83d7fff700 1 -- 172.21.15.38:0/2689835709 learned_addr learned my addr 172.21.15.38:0/2689835709 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:20.249 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.242+0000 7f83dc84b700 1 -- 172.21.15.38:0/2689835709 >> v1:172.21.15.150:6789/0 conn(0x7f83d80afc20 legacy=0x7f83d80b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:20.249 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.242+0000 7f83dc84b700 1 -- 172.21.15.38:0/2689835709 >> v1:172.21.15.38:6789/0 conn(0x7f83d80b2380 legacy=0x7f83d80ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:20.249 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.242+0000 7f83dc84b700 1 -- 172.21.15.38:0/2689835709 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d80b1ad0 con 0x7f83d80b11e0 2020-06-12T17:51:20.250 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.242+0000 7f83d77fe700 1 -- 172.21.15.38:0/2689835709 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 38357670 0 0) 0x7f83d80b2900 con 0x7f83d80b2380 2020-06-12T17:51:20.250 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.242+0000 7f83dc84b700 1 --2- 172.21.15.38:0/2689835709 >> v2:172.21.15.38:3300/0 conn(0x7f83d80b11e0 0x7f83d80b15c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f83d80b8110 tx=0x7f83c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.250 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.242+0000 7f83dc84b700 1 --2- 172.21.15.38:0/2689835709 >> v2:172.21.15.38:3300/0 conn(0x7f83d80b11e0 0x7f83d80b15c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f83d80b8110 tx=0x7f83c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.250 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.242+0000 7f83dc84b700 1 --2- 172.21.15.38:0/2689835709 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d80b11e0 0x7f83d80b15c0 secure :-1 s=READY pgs=828 cs=0 l=1 rx=0x7f83d80b8110 tx=0x7f83c8007e60).ready entity=mon.0 client_cookie=63225ce83d7b40fe server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:20.250 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.242+0000 7f83dc84b700 1 --2- 172.21.15.38:0/2689835709 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d80b11e0 0x7f83d80b15c0 secure :-1 s=THROTTLE_DONE pgs=828 cs=0 l=1 rx=0x7f83d80b8110 tx=0x7f83c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.250 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.242+0000 7f83dc84b700 1 --2- 172.21.15.38:0/2689835709 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d80b11e0 0x7f83d80b15c0 secure :-1 s=THROTTLE_DONE pgs=828 cs=0 l=1 rx=0x7f83d80b8110 tx=0x7f83c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.251 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.242+0000 7f83d77fe700 1 -- 172.21.15.38:0/2689835709 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83c80113f0 con 0x7f83d80b11e0 2020-06-12T17:51:20.251 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.242+0000 7f83dc84b700 1 --2- 172.21.15.38:0/2689835709 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d80b11e0 0x7f83d80b15c0 secure :-1 s=THROTTLE_DONE pgs=828 cs=0 l=1 rx=0x7f83d80b8110 tx=0x7f83c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.251 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.242+0000 7f83d77fe700 1 -- 172.21.15.38:0/2689835709 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c8011550 con 0x7f83d80b11e0 2020-06-12T17:51:20.251 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.242+0000 7f83d77fe700 1 -- 172.21.15.38:0/2689835709 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83c8011930 con 0x7f83d80b11e0 2020-06-12T17:51:20.251 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.242+0000 7f83dd84d700 1 -- 172.21.15.38:0/2689835709 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d80b11e0 msgr2=0x7f83d80b15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:20.252 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.242+0000 7f83dd84d700 1 --2- 172.21.15.38:0/2689835709 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d80b11e0 0x7f83d80b15c0 secure :-1 s=READY pgs=828 cs=0 l=1 rx=0x7f83d80b8110 tx=0x7f83c8007e60).stop 2020-06-12T17:51:20.252 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.242+0000 7f83dd84d700 1 -- 172.21.15.38:0/2689835709 shutdown_connections 2020-06-12T17:51:20.252 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.242+0000 7f83dd84d700 1 --2- 172.21.15.38:0/2689835709 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d80b11e0 0x7f83d80b15c0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:20.252 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.242+0000 7f83dd84d700 1 -- 172.21.15.38:0/2689835709 >> 172.21.15.38:0/2689835709 conn(0x7f83d80b4cc0 msgr2=0x7f83d80b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:20.253 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.242+0000 7f83dd84d700 1 -- 172.21.15.38:0/2689835709 shutdown_connections 2020-06-12T17:51:20.253 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.243+0000 7f83dd84d700 1 -- 172.21.15.38:0/2689835709 wait complete. 2020-06-12T17:51:20.254 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.243+0000 7f83dd84d700 1 Processor -- start 2020-06-12T17:51:20.254 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.243+0000 7f83dd84d700 1 -- start start 2020-06-12T17:51:20.257 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.244+0000 7f83dd84d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83d80b11e0 0x7f83d813f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:20.257 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.244+0000 7f83dd84d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f83d80b2380 0x7f83d80b68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:20.257 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.244+0000 7f83dd84d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d8061420 con 0x7f83d80afc20 2020-06-12T17:51:20.257 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.244+0000 7f83dd84d700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d8065ff0 con 0x7f83d80b2380 2020-06-12T17:51:20.258 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.244+0000 7f83dd84d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d8144cd0 con 0x7f83d80b11e0 2020-06-12T17:51:20.258 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.244+0000 7f83dd04c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f83d80b2380 0x7f83d80b68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:20.258 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.244+0000 7f83dd04c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f83d80b2380 0x7f83d80b68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39688/0 (socket says 172.21.15.38:39688) 2020-06-12T17:51:20.258 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.244+0000 7f83dd04c700 1 -- 172.21.15.38:0/2757013967 learned_addr learned my addr 172.21.15.38:0/2757013967 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:20.258 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.245+0000 7f83d7fff700 1 --2- 172.21.15.38:0/2757013967 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83d80b11e0 0x7f83d813f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:20.259 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.245+0000 7f83dd04c700 1 -- 172.21.15.38:0/2757013967 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83d80b11e0 msgr2=0x7f83d813f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:20.259 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.245+0000 7f83dd04c700 1 --2- 172.21.15.38:0/2757013967 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83d80b11e0 0x7f83d813f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:20.259 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.245+0000 7f83dd04c700 1 -- 172.21.15.38:0/2757013967 >> v1:172.21.15.150:6789/0 conn(0x7f83d80afc20 legacy=0x7f83d81445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:20.259 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.245+0000 7f83dd04c700 1 -- 172.21.15.38:0/2757013967 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d813fae0 con 0x7f83d80b2380 2020-06-12T17:51:20.259 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.245+0000 7f83dd04c700 1 --2- 172.21.15.38:0/2757013967 >> v2:172.21.15.38:3300/0 conn(0x7f83d80b2380 0x7f83d80b68d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f83d00032c0 tx=0x7f83d0008000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.260 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.245+0000 7f83dd04c700 1 --2- 172.21.15.38:0/2757013967 >> v2:172.21.15.38:3300/0 conn(0x7f83d80b2380 0x7f83d80b68d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f83d00032c0 tx=0x7f83d0008000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.260 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.245+0000 7f83dd04c700 1 --2- 172.21.15.38:0/2757013967 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d80b2380 0x7f83d80b68d0 secure :-1 s=READY pgs=829 cs=0 l=1 rx=0x7f83d00032c0 tx=0x7f83d0008000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:20.260 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.245+0000 7f83dd04c700 1 --2- 172.21.15.38:0/2757013967 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d80b2380 0x7f83d80b68d0 secure :-1 s=THROTTLE_DONE pgs=829 cs=0 l=1 rx=0x7f83d00032c0 tx=0x7f83d0008000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.260 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.245+0000 7f83dd04c700 1 --2- 172.21.15.38:0/2757013967 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d80b2380 0x7f83d80b68d0 secure :-1 s=THROTTLE_DONE pgs=829 cs=0 l=1 rx=0x7f83d00032c0 tx=0x7f83d0008000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.260 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.245+0000 7f83d5ffb700 1 -- 172.21.15.38:0/2757013967 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83d0008bd0 con 0x7f83d80b2380 2020-06-12T17:51:20.261 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.245+0000 7f83dd04c700 1 --2- 172.21.15.38:0/2757013967 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d80b2380 0x7f83d80b68d0 secure :-1 s=THROTTLE_DONE pgs=829 cs=0 l=1 rx=0x7f83d00032c0 tx=0x7f83d0008000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.261 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.245+0000 7f83d5ffb700 1 -- 172.21.15.38:0/2757013967 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d0008d70 con 0x7f83d80b2380 2020-06-12T17:51:20.261 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.245+0000 7f83dd84d700 1 -- 172.21.15.38:0/2757013967 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d8065dc0 con 0x7f83d80b2380 2020-06-12T17:51:20.261 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.245+0000 7f83d5ffb700 1 -- 172.21.15.38:0/2757013967 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83d0007350 con 0x7f83d80b2380 2020-06-12T17:51:20.261 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.245+0000 7f83dd84d700 1 -- 172.21.15.38:0/2757013967 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d80b6d30 con 0x7f83d80b2380 2020-06-12T17:51:20.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.246+0000 7f83dd04c700 1 --2- 172.21.15.38:0/2757013967 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d80b2380 0x7f83d80b68d0 secure :-1 s=THROTTLE_DONE pgs=829 cs=0 l=1 rx=0x7f83d00032c0 tx=0x7f83d0008000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.246+0000 7f83dd84d700 1 -- 172.21.15.38:0/2757013967 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d8056c30 con 0x7f83d80b2380 2020-06-12T17:51:20.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.246+0000 7f83d5ffb700 1 -- 172.21.15.38:0/2757013967 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f83d00075c0 con 0x7f83d80b2380 2020-06-12T17:51:20.262 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.246+0000 7f83dd04c700 1 --2- 172.21.15.38:0/2757013967 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d80b2380 0x7f83d80b68d0 secure :-1 s=THROTTLE_DONE pgs=829 cs=0 l=1 rx=0x7f83d00032c0 tx=0x7f83d0008000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.246+0000 7f83d5ffb700 1 --2- 172.21.15.38:0/2757013967 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f83b804d660 0x7f83b804fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:20.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.247+0000 7f83d5ffb700 1 -- 172.21.15.38:0/2757013967 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f83d00611f0 con 0x7f83d80b2380 2020-06-12T17:51:20.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.247+0000 7f83dc84b700 1 --2- 172.21.15.38:0/2757013967 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f83b804d660 0x7f83b804fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:20.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.247+0000 7f83dc84b700 1 --2- 172.21.15.38:0/2757013967 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f83b804d660 0x7f83b804fb20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f83d8064460 tx=0x7f83c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.263 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.247+0000 7f83dc84b700 1 --2- 172.21.15.38:0/2757013967 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f83b804d660 0x7f83b804fb20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f83d8064460 tx=0x7f83c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.264 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.247+0000 7f83dc84b700 1 --2- 172.21.15.38:0/2757013967 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f83b804d660 0x7f83b804fb20 secure :-1 s=READY pgs=322 cs=0 l=1 rx=0x7f83d8064460 tx=0x7f83c8007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:20.264 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.250+0000 7f83dd04c700 1 --2- 172.21.15.38:0/2757013967 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d80b2380 0x7f83d80b68d0 secure :-1 s=THROTTLE_DONE pgs=829 cs=0 l=1 rx=0x7f83d00032c0 tx=0x7f83d0008000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.264 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.250+0000 7f83d5ffb700 1 -- 172.21.15.38:0/2757013967 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f83d003c910 con 0x7f83d80b2380 2020-06-12T17:51:20.450 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.446+0000 7f83dd84d700 1 -- 172.21.15.38:0/2757013967 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_1565", "target": ["mon-mgr", ""]}) v1 -- 0x7f83d81457e0 con 0x7f83b804d660 2020-06-12T17:51:20.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.463+0000 7f83dc84b700 1 --2- 172.21.15.38:0/2757013967 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f83b804d660 0x7f83b804fb20 secure :-1 s=THROTTLE_DONE pgs=322 cs=0 l=1 rx=0x7f83d8064460 tx=0x7f83c8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.463+0000 7f83d5ffb700 1 -- 172.21.15.38:0/2757013967 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f83d81457e0 con 0x7f83b804d660 2020-06-12T17:51:20.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.465+0000 7f83dd84d700 1 -- 172.21.15.38:0/2757013967 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f83b804d660 msgr2=0x7f83b804fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:20.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.465+0000 7f83dd84d700 1 --2- 172.21.15.38:0/2757013967 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f83b804d660 0x7f83b804fb20 secure :-1 s=READY pgs=322 cs=0 l=1 rx=0x7f83d8064460 tx=0x7f83c8007e60).stop 2020-06-12T17:51:20.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.465+0000 7f83dd84d700 1 -- 172.21.15.38:0/2757013967 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d80b2380 msgr2=0x7f83d80b68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:20.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.465+0000 7f83dd84d700 1 --2- 172.21.15.38:0/2757013967 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d80b2380 0x7f83d80b68d0 secure :-1 s=READY pgs=829 cs=0 l=1 rx=0x7f83d00032c0 tx=0x7f83d0008000).stop 2020-06-12T17:51:20.470 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.465+0000 7f83dd84d700 1 -- 172.21.15.38:0/2757013967 shutdown_connections 2020-06-12T17:51:20.470 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.465+0000 7f83dd84d700 1 --2- 172.21.15.38:0/2757013967 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f83b804d660 0x7f83b804fb20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:20.470 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.465+0000 7f83dd84d700 1 --2- 172.21.15.38:0/2757013967 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d80b2380 0x7f83d80b68d0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:20.470 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.465+0000 7f83dd84d700 1 --2- 172.21.15.38:0/2757013967 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83d80b11e0 0x7f83d813f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:20.470 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.465+0000 7f83dd84d700 1 -- 172.21.15.38:0/2757013967 >> 172.21.15.38:0/2757013967 conn(0x7f83d80b4cc0 msgr2=0x7f83d80b8200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:20.471 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.465+0000 7f83dd84d700 1 -- 172.21.15.38:0/2757013967 shutdown_connections 2020-06-12T17:51:20.471 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.465+0000 7f83dd84d700 1 -- 172.21.15.38:0/2757013967 wait complete. 2020-06-12T17:51:20.479 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_1565 2020-06-12T17:51:20.596 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.592+0000 7ffa632dc700 1 Processor -- start 2020-06-12T17:51:20.596 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.592+0000 7ffa632dc700 1 -- start start 2020-06-12T17:51:20.599 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.593+0000 7ffa632dc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ffa5c0b3ac0 0x7ffa5c09df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:20.599 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.593+0000 7ffa632dc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffa5c13c650 0x7ffa5c066790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:20.599 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.593+0000 7ffa632dc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5c09b960 con 0x7ffa5c142e90 2020-06-12T17:51:20.600 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.593+0000 7ffa632dc700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa5c09bc00 con 0x7ffa5c13c650 2020-06-12T17:51:20.600 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.593+0000 7ffa632dc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa5c0b48f0 con 0x7ffa5c0b3ac0 2020-06-12T17:51:20.600 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.593+0000 7ffa61879700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffa5c13c650 0x7ffa5c066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:20.600 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.593+0000 7ffa61879700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffa5c13c650 0x7ffa5c066790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39696/0 (socket says 172.21.15.38:39696) 2020-06-12T17:51:20.600 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.593+0000 7ffa61879700 1 -- 172.21.15.38:0/3324003297 learned_addr learned my addr 172.21.15.38:0/3324003297 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:20.601 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.594+0000 7ffa61078700 1 --2- 172.21.15.38:0/3324003297 >> v2:172.21.15.150:3300/0 conn(0x7ffa5c0b3ac0 0x7ffa5c09df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:20.601 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.594+0000 7ffa61879700 1 -- 172.21.15.38:0/3324003297 >> v2:172.21.15.150:3300/0 conn(0x7ffa5c0b3ac0 msgr2=0x7ffa5c09df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:20.601 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.594+0000 7ffa61879700 1 --2- 172.21.15.38:0/3324003297 >> v2:172.21.15.150:3300/0 conn(0x7ffa5c0b3ac0 0x7ffa5c09df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:20.601 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.594+0000 7ffa61879700 1 -- 172.21.15.38:0/3324003297 >> v1:172.21.15.150:6789/0 conn(0x7ffa5c142e90 legacy=0x7ffa5c13bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:20.602 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.594+0000 7ffa61879700 1 -- 172.21.15.38:0/3324003297 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c0b3ea0 con 0x7ffa5c13c650 2020-06-12T17:51:20.602 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.594+0000 7ffa61879700 1 --2- 172.21.15.38:0/3324003297 >> v2:172.21.15.38:3300/0 conn(0x7ffa5c13c650 0x7ffa5c066790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffa5c061380 tx=0x7ffa540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.602 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.594+0000 7ffa61879700 1 --2- 172.21.15.38:0/3324003297 >> v2:172.21.15.38:3300/0 conn(0x7ffa5c13c650 0x7ffa5c066790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffa5c061380 tx=0x7ffa540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.602 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.594+0000 7ffa61879700 1 --2- 172.21.15.38:0/3324003297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa5c13c650 0x7ffa5c066790 secure :-1 s=READY pgs=830 cs=0 l=1 rx=0x7ffa5c061380 tx=0x7ffa540081e0).ready entity=mon.0 client_cookie=233279b800e0fe97 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:20.602 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.594+0000 7ffa61879700 1 --2- 172.21.15.38:0/3324003297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa5c13c650 0x7ffa5c066790 secure :-1 s=THROTTLE_DONE pgs=830 cs=0 l=1 rx=0x7ffa5c061380 tx=0x7ffa540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.603 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.594+0000 7ffa4bfff700 1 -- 172.21.15.38:0/3324003297 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa5400a160 con 0x7ffa5c13c650 2020-06-12T17:51:20.603 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.594+0000 7ffa61879700 1 --2- 172.21.15.38:0/3324003297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa5c13c650 0x7ffa5c066790 secure :-1 s=THROTTLE_DONE pgs=830 cs=0 l=1 rx=0x7ffa5c061380 tx=0x7ffa540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.603 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.594+0000 7ffa4bfff700 1 -- 172.21.15.38:0/3324003297 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5400a2c0 con 0x7ffa5c13c650 2020-06-12T17:51:20.603 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.594+0000 7ffa61879700 1 --2- 172.21.15.38:0/3324003297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa5c13c650 0x7ffa5c066790 secure :-1 s=THROTTLE_DONE pgs=830 cs=0 l=1 rx=0x7ffa5c061380 tx=0x7ffa540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.603 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.594+0000 7ffa4bfff700 1 -- 172.21.15.38:0/3324003297 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa5400a6a0 con 0x7ffa5c13c650 2020-06-12T17:51:20.603 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.594+0000 7ffa632dc700 1 -- 172.21.15.38:0/3324003297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa5c13c650 msgr2=0x7ffa5c066790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:20.604 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.594+0000 7ffa632dc700 1 --2- 172.21.15.38:0/3324003297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa5c13c650 0x7ffa5c066790 secure :-1 s=READY pgs=830 cs=0 l=1 rx=0x7ffa5c061380 tx=0x7ffa540081e0).stop 2020-06-12T17:51:20.604 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.595+0000 7ffa632dc700 1 -- 172.21.15.38:0/3324003297 shutdown_connections 2020-06-12T17:51:20.604 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.595+0000 7ffa632dc700 1 --2- 172.21.15.38:0/3324003297 >> v2:172.21.15.150:3300/0 conn(0x7ffa5c0b3ac0 0x7ffa5c09df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:20.604 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.595+0000 7ffa632dc700 1 --2- 172.21.15.38:0/3324003297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa5c13c650 0x7ffa5c066790 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:20.604 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.595+0000 7ffa632dc700 1 -- 172.21.15.38:0/3324003297 >> 172.21.15.38:0/3324003297 conn(0x7ffa5c0b5a20 msgr2=0x7ffa5c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:20.605 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.595+0000 7ffa632dc700 1 -- 172.21.15.38:0/3324003297 shutdown_connections 2020-06-12T17:51:20.605 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.595+0000 7ffa632dc700 1 -- 172.21.15.38:0/3324003297 wait complete. 2020-06-12T17:51:20.605 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.596+0000 7ffa632dc700 1 Processor -- start 2020-06-12T17:51:20.605 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.596+0000 7ffa632dc700 1 -- start start 2020-06-12T17:51:20.609 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.596+0000 7ffa632dc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ffa5c0b3ac0 0x7ffa5c154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:20.610 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.596+0000 7ffa632dc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa5c13c650 0x7ffa5c0b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:20.610 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.596+0000 7ffa632dc700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5c0b1a90 con 0x7ffa5c142e90 2020-06-12T17:51:20.610 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.596+0000 7ffa632dc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa5c0b1d30 con 0x7ffa5c0b3ac0 2020-06-12T17:51:20.610 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.596+0000 7ffa632dc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c066e70 con 0x7ffa5c13c650 2020-06-12T17:51:20.610 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.596+0000 7ffa61879700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ffa5c142e90 0x7ffa5c066760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41518/0 (socket says 172.21.15.38:41518) 2020-06-12T17:51:20.611 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.596+0000 7ffa61879700 1 -- 172.21.15.38:0/1446127937 learned_addr learned my addr 172.21.15.38:0/1446127937 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:20.611 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa61078700 1 --2- 172.21.15.38:0/1446127937 >> v2:172.21.15.150:3300/0 conn(0x7ffa5c0b3ac0 0x7ffa5c154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:20.611 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa60877700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa5c13c650 0x7ffa5c0b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:20.611 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa4a7fc700 1 -- 172.21.15.38:0/1446127937 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1660259578 0 0) 0x7ffa5c0b1a90 con 0x7ffa5c142e90 2020-06-12T17:51:20.611 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa4a7fc700 1 -- 172.21.15.38:0/1446127937 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa3c002fe0 con 0x7ffa5c142e90 2020-06-12T17:51:20.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa4a7fc700 1 -- 172.21.15.38:0/1446127937 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3739824533 0 0) 0x7ffa3c002fe0 con 0x7ffa5c142e90 2020-06-12T17:51:20.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa4a7fc700 1 -- 172.21.15.38:0/1446127937 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffa5c0b1a90 con 0x7ffa5c142e90 2020-06-12T17:51:20.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa4a7fc700 1 -- 172.21.15.38:0/1446127937 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7ffa540089e0 con 0x7ffa5c142e90 2020-06-12T17:51:20.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa4a7fc700 1 -- 172.21.15.38:0/1446127937 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa5c13c650 msgr2=0x7ffa5c0b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:20.612 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa4a7fc700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa5c13c650 0x7ffa5c0b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:20.613 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa4a7fc700 1 -- 172.21.15.38:0/1446127937 >> v2:172.21.15.150:3300/0 conn(0x7ffa5c0b3ac0 msgr2=0x7ffa5c154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:20.613 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa4a7fc700 1 --2- 172.21.15.38:0/1446127937 >> v2:172.21.15.150:3300/0 conn(0x7ffa5c0b3ac0 0x7ffa5c154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:20.613 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa4a7fc700 1 -- 172.21.15.38:0/1446127937 >> v1:172.21.15.38:6789/0 conn(0x7ffa5c142e90 legacy=0x7ffa5c066760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:20.613 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa4a7fc700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa5c13c650 0x7ffa3c0049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:20.613 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa4a7fc700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa3c004e10 0x7ffa3c003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:20.614 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa4a7fc700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa3c003d80 0x7ffa3c004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:20.614 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa4a7fc700 1 -- 172.21.15.38:0/1446127937 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c0b1d30 con 0x7ffa3c003d80 2020-06-12T17:51:20.614 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa4a7fc700 1 -- 172.21.15.38:0/1446127937 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c066e70 con 0x7ffa3c004e10 2020-06-12T17:51:20.614 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa4a7fc700 1 -- 172.21.15.38:0/1446127937 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3c0052c0 con 0x7ffa5c13c650 2020-06-12T17:51:20.614 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa61879700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa3c003d80 0x7ffa3c004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:20.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa61078700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa5c13c650 0x7ffa3c0049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:20.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa60877700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa3c004e10 0x7ffa3c003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:20.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa61879700 1 -- 172.21.15.38:0/1446127937 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa5c13c650 msgr2=0x7ffa3c0049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:20.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa61879700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa5c13c650 0x7ffa3c0049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:20.615 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa61879700 1 -- 172.21.15.38:0/1446127937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa3c004e10 msgr2=0x7ffa3c003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:20.616 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa61879700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa3c004e10 0x7ffa3c003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:20.616 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa61879700 1 -- 172.21.15.38:0/1446127937 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c141580 con 0x7ffa3c003d80 2020-06-12T17:51:20.616 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa632dc700 1 -- 172.21.15.38:0/1446127937 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5c0b15f0 con 0x7ffa3c003d80 2020-06-12T17:51:20.616 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa61879700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa3c003d80 0x7ffa3c004200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffa54007c40 tx=0x7ffa540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.616 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa61879700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa3c003d80 0x7ffa3c004200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffa54007c40 tx=0x7ffa540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.597+0000 7ffa61879700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa3c003d80 0x7ffa3c004200 secure :-1 s=READY pgs=832 cs=0 l=1 rx=0x7ffa54007c40 tx=0x7ffa540081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:20.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.598+0000 7ffa632dc700 1 -- 172.21.15.38:0/1446127937 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa5c0b26c0 con 0x7ffa3c003d80 2020-06-12T17:51:20.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.598+0000 7ffa61879700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa3c003d80 0x7ffa3c004200 secure :-1 s=THROTTLE_DONE pgs=832 cs=0 l=1 rx=0x7ffa54007c40 tx=0x7ffa540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.598+0000 7ffa4a7fc700 1 -- 172.21.15.38:0/1446127937 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa54003270 con 0x7ffa3c003d80 2020-06-12T17:51:20.617 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.598+0000 7ffa61879700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa3c003d80 0x7ffa3c004200 secure :-1 s=THROTTLE_DONE pgs=832 cs=0 l=1 rx=0x7ffa54007c40 tx=0x7ffa540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.598+0000 7ffa61879700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa3c003d80 0x7ffa3c004200 secure :-1 s=THROTTLE_DONE pgs=832 cs=0 l=1 rx=0x7ffa54007c40 tx=0x7ffa540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.598+0000 7ffa4a7fc700 1 -- 172.21.15.38:0/1446127937 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa54005a40 con 0x7ffa3c003d80 2020-06-12T17:51:20.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.598+0000 7ffa4a7fc700 1 -- 172.21.15.38:0/1446127937 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa54005e20 con 0x7ffa3c003d80 2020-06-12T17:51:20.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.598+0000 7ffa61879700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa3c003d80 0x7ffa3c004200 secure :-1 s=THROTTLE_DONE pgs=832 cs=0 l=1 rx=0x7ffa54007c40 tx=0x7ffa540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.618 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.598+0000 7ffa632dc700 1 -- 172.21.15.38:0/1446127937 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa38003340 con 0x7ffa3c003d80 2020-06-12T17:51:20.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.599+0000 7ffa4a7fc700 1 -- 172.21.15.38:0/1446127937 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7ffa54007150 con 0x7ffa3c003d80 2020-06-12T17:51:20.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.599+0000 7ffa61879700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa3c003d80 0x7ffa3c004200 secure :-1 s=THROTTLE_DONE pgs=832 cs=0 l=1 rx=0x7ffa54007c40 tx=0x7ffa540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.599+0000 7ffa4a7fc700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ffa3c055610 0x7ffa3c057ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:20.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.599+0000 7ffa4a7fc700 1 -- 172.21.15.38:0/1446127937 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ffa540623e0 con 0x7ffa3c003d80 2020-06-12T17:51:20.619 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.599+0000 7ffa61078700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ffa3c055610 0x7ffa3c057ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:20.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.599+0000 7ffa61078700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ffa3c055610 0x7ffa3c057ad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffa4c002f30 tx=0x7ffa4c007e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.599+0000 7ffa61078700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ffa3c055610 0x7ffa3c057ad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffa4c002f30 tx=0x7ffa4c007e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.599+0000 7ffa61078700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ffa3c055610 0x7ffa3c057ad0 secure :-1 s=READY pgs=323 cs=0 l=1 rx=0x7ffa4c002f30 tx=0x7ffa4c007e50).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:20.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.602+0000 7ffa61879700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa3c003d80 0x7ffa3c004200 secure :-1 s=THROTTLE_DONE pgs=832 cs=0 l=1 rx=0x7ffa54007c40 tx=0x7ffa540081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.620 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.602+0000 7ffa4a7fc700 1 -- 172.21.15.38:0/1446127937 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7ffa5403dbc0 con 0x7ffa3c003d80 2020-06-12T17:51:20.800 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.796+0000 7ffa632dc700 1 -- 172.21.15.38:0/1446127937 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_1565", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa38002040 con 0x7ffa3c055610 2020-06-12T17:51:20.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.800+0000 7ffa61078700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ffa3c055610 0x7ffa3c057ad0 secure :-1 s=THROTTLE_DONE pgs=323 cs=0 l=1 rx=0x7ffa4c002f30 tx=0x7ffa4c007e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:20.803 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.800+0000 7ffa4a7fc700 1 -- 172.21.15.38:0/1446127937 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7ffa38002040 con 0x7ffa3c055610 2020-06-12T17:51:20.804 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_1565/ad994172-08a2-4373-acc0-23a430398a47 2020-06-12T17:51:20.805 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.801+0000 7ffa632dc700 1 -- 172.21.15.38:0/1446127937 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ffa3c055610 msgr2=0x7ffa3c057ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:20.805 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.801+0000 7ffa632dc700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7ffa3c055610 0x7ffa3c057ad0 secure :-1 s=READY pgs=323 cs=0 l=1 rx=0x7ffa4c002f30 tx=0x7ffa4c007e50).stop 2020-06-12T17:51:20.805 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.801+0000 7ffa632dc700 1 -- 172.21.15.38:0/1446127937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa3c003d80 msgr2=0x7ffa3c004200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:20.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.801+0000 7ffa632dc700 1 --2- 172.21.15.38:0/1446127937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa3c003d80 0x7ffa3c004200 secure :-1 s=READY pgs=832 cs=0 l=1 rx=0x7ffa54007c40 tx=0x7ffa540081e0).stop 2020-06-12T17:51:20.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.801+0000 7ffa61879700 1 -- 172.21.15.38:0/1446127937 reap_dead start 2020-06-12T17:51:20.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.801+0000 7ffa61879700 1 -- 172.21.15.38:0/1446127937 reap_dead start 2020-06-12T17:51:20.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.801+0000 7ffa632dc700 1 -- 172.21.15.38:0/1446127937 shutdown_connections 2020-06-12T17:51:20.806 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.801+0000 7ffa632dc700 1 -- 172.21.15.38:0/1446127937 >> 172.21.15.38:0/1446127937 conn(0x7ffa5c0b5a20 msgr2=0x7ffa5c0b78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:20.807 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.801+0000 7ffa632dc700 1 -- 172.21.15.38:0/1446127937 shutdown_connections 2020-06-12T17:51:20.807 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:20.801+0000 7ffa632dc700 1 -- 172.21.15.38:0/1446127937 wait complete. 2020-06-12T17:51:20.815 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_1565 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_1565/ad994172-08a2-4373-acc0-23a430398a47 2020-06-12T17:51:20.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:20.816 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:20.816 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:20.832 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:20.832 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:20.833 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1565/ad994172-08a2-4373-acc0-23a430398a47/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:20.921 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:20.921 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:20.922 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00917626 s, 114 MB/s 2020-06-12T17:51:20.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:20.924 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:20.924 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:20.939 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:20.940 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:20.941 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1565/ad994172-08a2-4373-acc0-23a430398a47/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:21.033 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:21.036 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:21.037 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103604 s, 101 MB/s 2020-06-12T17:51:21.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:21.038 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:21.039 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:21.054 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:21.055 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:21.055 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1565/ad994172-08a2-4373-acc0-23a430398a47/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:21.142 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:21.142 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:21.143 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116782 s, 89.8 MB/s 2020-06-12T17:51:21.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:21.144 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:21.145 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:21.160 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:21.161 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:21.161 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1565/ad994172-08a2-4373-acc0-23a430398a47/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:21.248 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:21.248 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:21.248 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109312 s, 95.9 MB/s 2020-06-12T17:51:21.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:21.250 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:21.250 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:21.265 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:21.266 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:21.266 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1565/ad994172-08a2-4373-acc0-23a430398a47/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:21.352 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:21.353 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:21.353 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102848 s, 102 MB/s 2020-06-12T17:51:21.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:21.355 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:21.355 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:21.370 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:21.370 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:21.371 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1565/ad994172-08a2-4373-acc0-23a430398a47/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:21.459 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:21.460 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:21.460 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103665 s, 101 MB/s 2020-06-12T17:51:21.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:21.462 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:21.462 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:21.477 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:21.478 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:21.479 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1565/ad994172-08a2-4373-acc0-23a430398a47/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:21.565 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:21.566 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:21.566 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111873 s, 93.7 MB/s 2020-06-12T17:51:21.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:21.568 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:21.568 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:21.583 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:21.583 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:21.584 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1565/ad994172-08a2-4373-acc0-23a430398a47/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:21.673 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:21.673 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:21.673 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117019 s, 89.6 MB/s 2020-06-12T17:51:21.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:21.675 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:21.675 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:21.690 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:21.691 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:21.691 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1565/ad994172-08a2-4373-acc0-23a430398a47/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:21.777 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:21.778 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:21.778 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104187 s, 101 MB/s 2020-06-12T17:51:21.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:21.780 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:21.780 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:21.795 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:21.796 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:21.796 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1565/ad994172-08a2-4373-acc0-23a430398a47/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:21.883 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:21.884 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:21.884 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114148 s, 91.9 MB/s 2020-06-12T17:51:21.885 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_2349 2020-06-12T17:51:22.002 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:21.998+0000 7fddf7d5a700 1 Processor -- start 2020-06-12T17:51:22.002 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:21.999+0000 7fddf7d5a700 1 -- start start 2020-06-12T17:51:22.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:21.999+0000 7fddf7d5a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fddf00ad5b0 0x7fddf00b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:22.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:21.999+0000 7fddf7d5a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fddf009d8d0 0x7fddf01421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:22.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:21.999+0000 7fddf7d5a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf0146d20 con 0x7fddf0146680 2020-06-12T17:51:22.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:21.999+0000 7fddf7d5a700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf0066a80 con 0x7fddf009d8d0 2020-06-12T17:51:22.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:21.999+0000 7fddf7d5a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf0146f50 con 0x7fddf00ad5b0 2020-06-12T17:51:22.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.000+0000 7fddf62f7700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fddf009d8d0 0x7fddf01421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:22.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.000+0000 7fddf62f7700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fddf009d8d0 0x7fddf01421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39714/0 (socket says 172.21.15.38:39714) 2020-06-12T17:51:22.006 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.000+0000 7fddf62f7700 1 -- 172.21.15.38:0/2998399539 learned_addr learned my addr 172.21.15.38:0/2998399539 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:22.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.000+0000 7fddf52f5700 1 --2- 172.21.15.38:0/2998399539 >> v2:172.21.15.150:3300/0 conn(0x7fddf00ad5b0 0x7fddf00b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:22.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.000+0000 7fddf62f7700 1 -- 172.21.15.38:0/2998399539 >> v2:172.21.15.150:3300/0 conn(0x7fddf00ad5b0 msgr2=0x7fddf00b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:22.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.000+0000 7fddf62f7700 1 --2- 172.21.15.38:0/2998399539 >> v2:172.21.15.150:3300/0 conn(0x7fddf00ad5b0 0x7fddf00b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:22.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.000+0000 7fddf62f7700 1 -- 172.21.15.38:0/2998399539 >> v1:172.21.15.150:6789/0 conn(0x7fddf0146680 legacy=0x7fddf009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:22.007 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.000+0000 7fddf62f7700 1 -- 172.21.15.38:0/2998399539 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf0146a60 con 0x7fddf009d8d0 2020-06-12T17:51:22.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.000+0000 7fddf52f5700 1 --2- 172.21.15.38:0/2998399539 >> v2:172.21.15.150:3300/0 conn(0x7fddf00ad5b0 0x7fddf00b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:51:22.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.000+0000 7fddf62f7700 1 --2- 172.21.15.38:0/2998399539 >> v2:172.21.15.38:3300/0 conn(0x7fddf009d8d0 0x7fddf01421d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fddf0061380 tx=0x7fdde8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.000+0000 7fddf62f7700 1 --2- 172.21.15.38:0/2998399539 >> v2:172.21.15.38:3300/0 conn(0x7fddf009d8d0 0x7fddf01421d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fddf0061380 tx=0x7fdde8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.000+0000 7fddf62f7700 1 --2- 172.21.15.38:0/2998399539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddf009d8d0 0x7fddf01421d0 secure :-1 s=READY pgs=833 cs=0 l=1 rx=0x7fddf0061380 tx=0x7fdde8007e60).ready entity=mon.0 client_cookie=5ae8590aacbbc207 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:22.008 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.000+0000 7fddf62f7700 1 --2- 172.21.15.38:0/2998399539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddf009d8d0 0x7fddf01421d0 secure :-1 s=THROTTLE_DONE pgs=833 cs=0 l=1 rx=0x7fddf0061380 tx=0x7fdde8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.000+0000 7fddf4af4700 1 -- 172.21.15.38:0/2998399539 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdde80116a0 con 0x7fddf009d8d0 2020-06-12T17:51:22.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.000+0000 7fddf62f7700 1 --2- 172.21.15.38:0/2998399539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddf009d8d0 0x7fddf01421d0 secure :-1 s=THROTTLE_DONE pgs=833 cs=0 l=1 rx=0x7fddf0061380 tx=0x7fdde8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.000+0000 7fddf62f7700 1 --2- 172.21.15.38:0/2998399539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddf009d8d0 0x7fddf01421d0 secure :-1 s=THROTTLE_DONE pgs=833 cs=0 l=1 rx=0x7fddf0061380 tx=0x7fdde8007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.000+0000 7fddf4af4700 1 -- 172.21.15.38:0/2998399539 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde8011800 con 0x7fddf009d8d0 2020-06-12T17:51:22.009 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.000+0000 7fddf4af4700 1 -- 172.21.15.38:0/2998399539 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdde8011be0 con 0x7fddf009d8d0 2020-06-12T17:51:22.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.000+0000 7fddf7d5a700 1 -- 172.21.15.38:0/2998399539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddf009d8d0 msgr2=0x7fddf01421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:22.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.000+0000 7fddf7d5a700 1 --2- 172.21.15.38:0/2998399539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddf009d8d0 0x7fddf01421d0 secure :-1 s=READY pgs=833 cs=0 l=1 rx=0x7fddf0061380 tx=0x7fdde8007e60).stop 2020-06-12T17:51:22.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.001+0000 7fddf7d5a700 1 -- 172.21.15.38:0/2998399539 shutdown_connections 2020-06-12T17:51:22.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.001+0000 7fddf7d5a700 1 --2- 172.21.15.38:0/2998399539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddf009d8d0 0x7fddf01421d0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:22.010 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.001+0000 7fddf7d5a700 1 --2- 172.21.15.38:0/2998399539 >> v2:172.21.15.150:3300/0 conn(0x7fddf00ad5b0 0x7fddf00b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:22.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.001+0000 7fddf7d5a700 1 -- 172.21.15.38:0/2998399539 >> 172.21.15.38:0/2998399539 conn(0x7fddf00b5a20 msgr2=0x7fddf005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:22.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.001+0000 7fddf7d5a700 1 -- 172.21.15.38:0/2998399539 shutdown_connections 2020-06-12T17:51:22.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.001+0000 7fddf7d5a700 1 -- 172.21.15.38:0/2998399539 wait complete. 2020-06-12T17:51:22.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.002+0000 7fddf7d5a700 1 Processor -- start 2020-06-12T17:51:22.011 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.002+0000 7fddf7d5a700 1 -- start start 2020-06-12T17:51:22.014 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.002+0000 7fddf7d5a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddf009d8d0 0x7fddf00b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:22.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.002+0000 7fddf7d5a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fddf00ad5b0 0x7fddf01424c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:22.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.002+0000 7fddf7d5a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf00b15d0 con 0x7fddf0146680 2020-06-12T17:51:22.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.002+0000 7fddf7d5a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf0061690 con 0x7fddf00ad5b0 2020-06-12T17:51:22.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.002+0000 7fddf7d5a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf0061930 con 0x7fddf009d8d0 2020-06-12T17:51:22.015 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.003+0000 7fddf52f5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fddf00ad5b0 0x7fddf01424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:22.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.003+0000 7fddf62f7700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fddf0146680 0x7fddf0138020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.38:34038/0 (socket says 172.21.15.38:34038) 2020-06-12T17:51:22.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.003+0000 7fddf62f7700 1 -- 172.21.15.38:0/433581608 learned_addr learned my addr 172.21.15.38:0/433581608 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:22.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.003+0000 7fddf5af6700 1 --2- 172.21.15.38:0/433581608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddf009d8d0 0x7fddf00b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:22.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.003+0000 7fdde2ffd700 1 -- 172.21.15.38:0/433581608 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4209231783 0 0) 0x7fddf0146a60 con 0x7fddf0146680 2020-06-12T17:51:22.016 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.003+0000 7fdde2ffd700 1 -- 172.21.15.38:0/433581608 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddd0002fe0 con 0x7fddf0146680 2020-06-12T17:51:22.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.003+0000 7fddf52f5700 1 -- 172.21.15.38:0/433581608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddf009d8d0 msgr2=0x7fddf00b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:22.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.003+0000 7fddf52f5700 1 --2- 172.21.15.38:0/433581608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddf009d8d0 0x7fddf00b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:22.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.003+0000 7fddf52f5700 1 -- 172.21.15.38:0/433581608 >> v1:172.21.15.150:6789/0 conn(0x7fddf0146680 legacy=0x7fddf0138020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:22.017 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.003+0000 7fddf52f5700 1 -- 172.21.15.38:0/433581608 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf00649c0 con 0x7fddf00ad5b0 2020-06-12T17:51:22.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.003+0000 7fddf5af6700 1 --2- 172.21.15.38:0/433581608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddf009d8d0 0x7fddf00b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-06-12T17:51:22.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.003+0000 7fddf52f5700 1 --2- 172.21.15.38:0/433581608 >> v2:172.21.15.150:3300/0 conn(0x7fddf00ad5b0 0x7fddf01424c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fddec0032b0 tx=0x7fddec00e360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.003+0000 7fddf52f5700 1 --2- 172.21.15.38:0/433581608 >> v2:172.21.15.150:3300/0 conn(0x7fddf00ad5b0 0x7fddf01424c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fddec0032b0 tx=0x7fddec00e360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.003+0000 7fddf52f5700 1 --2- 172.21.15.38:0/433581608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddf00ad5b0 0x7fddf01424c0 secure :-1 s=READY pgs=465 cs=0 l=1 rx=0x7fddec0032b0 tx=0x7fddec00e360).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:22.018 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.003+0000 7fddf52f5700 1 --2- 172.21.15.38:0/433581608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddf00ad5b0 0x7fddf01424c0 secure :-1 s=THROTTLE_DONE pgs=465 cs=0 l=1 rx=0x7fddec0032b0 tx=0x7fddec00e360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.003+0000 7fdde2ffd700 1 -- 172.21.15.38:0/433581608 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddec012ae0 con 0x7fddf00ad5b0 2020-06-12T17:51:22.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.004+0000 7fddf7d5a700 1 -- 172.21.15.38:0/433581608 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf0065f10 con 0x7fddf00ad5b0 2020-06-12T17:51:22.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.004+0000 7fddf52f5700 1 --2- 172.21.15.38:0/433581608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddf00ad5b0 0x7fddf01424c0 secure :-1 s=THROTTLE_DONE pgs=465 cs=0 l=1 rx=0x7fddec0032b0 tx=0x7fddec00e360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.004+0000 7fdde2ffd700 1 -- 172.21.15.38:0/433581608 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec012c40 con 0x7fddf00ad5b0 2020-06-12T17:51:22.019 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.004+0000 7fddf52f5700 1 --2- 172.21.15.38:0/433581608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddf00ad5b0 0x7fddf01424c0 secure :-1 s=THROTTLE_DONE pgs=465 cs=0 l=1 rx=0x7fddec0032b0 tx=0x7fddec00e360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.020 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.004+0000 7fdde2ffd700 1 -- 172.21.15.38:0/433581608 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddec012db0 con 0x7fddf00ad5b0 2020-06-12T17:51:22.020 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.004+0000 7fddf7d5a700 1 -- 172.21.15.38:0/433581608 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf0064710 con 0x7fddf00ad5b0 2020-06-12T17:51:22.020 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.004+0000 7fddf52f5700 1 --2- 172.21.15.38:0/433581608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddf00ad5b0 0x7fddf01424c0 secure :-1 s=THROTTLE_DONE pgs=465 cs=0 l=1 rx=0x7fddec0032b0 tx=0x7fddec00e360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.020 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.005+0000 7fddf7d5a700 1 -- 172.21.15.38:0/433581608 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf0067b20 con 0x7fddf00ad5b0 2020-06-12T17:51:22.020 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.005+0000 7fdde2ffd700 1 -- 172.21.15.38:0/433581608 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fddec005a40 con 0x7fddf00ad5b0 2020-06-12T17:51:22.021 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.005+0000 7fddf52f5700 1 --2- 172.21.15.38:0/433581608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddf00ad5b0 0x7fddf01424c0 secure :-1 s=THROTTLE_DONE pgs=465 cs=0 l=1 rx=0x7fddec0032b0 tx=0x7fddec00e360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.021 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.005+0000 7fdde2ffd700 1 --2- 172.21.15.38:0/433581608 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fddd004d910 0x7fddd004fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:22.021 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.005+0000 7fdde2ffd700 1 -- 172.21.15.38:0/433581608 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fddec061130 con 0x7fddf00ad5b0 2020-06-12T17:51:22.021 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.005+0000 7fddf5af6700 1 --2- 172.21.15.38:0/433581608 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fddd004d910 0x7fddd004fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:22.021 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.006+0000 7fddf5af6700 1 --2- 172.21.15.38:0/433581608 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fddd004d910 0x7fddd004fdd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdde4001f50 tx=0x7fdde4002710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.006+0000 7fddf5af6700 1 --2- 172.21.15.38:0/433581608 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fddd004d910 0x7fddd004fdd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdde4001f50 tx=0x7fdde4002710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.006+0000 7fddf5af6700 1 --2- 172.21.15.38:0/433581608 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fddd004d910 0x7fddd004fdd0 secure :-1 s=READY pgs=324 cs=0 l=1 rx=0x7fdde4001f50 tx=0x7fdde4002710).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:22.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.009+0000 7fddf52f5700 1 --2- 172.21.15.38:0/433581608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddf00ad5b0 0x7fddf01424c0 secure :-1 s=THROTTLE_DONE pgs=465 cs=0 l=1 rx=0x7fddec0032b0 tx=0x7fddec00e360).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.022 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.009+0000 7fdde2ffd700 1 -- 172.21.15.38:0/433581608 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fddec03c8f0 con 0x7fddf00ad5b0 2020-06-12T17:51:22.207 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.203+0000 7fddf7d5a700 1 -- 172.21.15.38:0/433581608 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_2349", "target": ["mon-mgr", ""]}) v1 -- 0x7fddf0061510 con 0x7fddd004d910 2020-06-12T17:51:22.228 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.225+0000 7fddf5af6700 1 --2- 172.21.15.38:0/433581608 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fddd004d910 0x7fddd004fdd0 secure :-1 s=THROTTLE_DONE pgs=324 cs=0 l=1 rx=0x7fdde4001f50 tx=0x7fdde4002710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.228 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.225+0000 7fdde2ffd700 1 -- 172.21.15.38:0/433581608 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fdde4008330 con 0x7fddd004d910 2020-06-12T17:51:22.230 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.226+0000 7fddf7d5a700 1 -- 172.21.15.38:0/433581608 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fddd004d910 msgr2=0x7fddd004fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:22.230 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.226+0000 7fddf7d5a700 1 --2- 172.21.15.38:0/433581608 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fddd004d910 0x7fddd004fdd0 secure :-1 s=READY pgs=324 cs=0 l=1 rx=0x7fdde4001f50 tx=0x7fdde4002710).stop 2020-06-12T17:51:22.230 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.226+0000 7fddf7d5a700 1 -- 172.21.15.38:0/433581608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddf00ad5b0 msgr2=0x7fddf01424c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:22.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.226+0000 7fddf7d5a700 1 --2- 172.21.15.38:0/433581608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddf00ad5b0 0x7fddf01424c0 secure :-1 s=READY pgs=465 cs=0 l=1 rx=0x7fddec0032b0 tx=0x7fddec00e360).stop 2020-06-12T17:51:22.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.226+0000 7fddf7d5a700 1 -- 172.21.15.38:0/433581608 shutdown_connections 2020-06-12T17:51:22.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.226+0000 7fddf7d5a700 1 --2- 172.21.15.38:0/433581608 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fddd004d910 0x7fddd004fdd0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:22.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.226+0000 7fddf7d5a700 1 --2- 172.21.15.38:0/433581608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddf009d8d0 0x7fddf00b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:22.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.226+0000 7fddf7d5a700 1 --2- 172.21.15.38:0/433581608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddf00ad5b0 0x7fddf01424c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:22.232 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.226+0000 7fddf7d5a700 1 -- 172.21.15.38:0/433581608 >> 172.21.15.38:0/433581608 conn(0x7fddf00b5a20 msgr2=0x7fddf005ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:22.232 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.226+0000 7fddf7d5a700 1 -- 172.21.15.38:0/433581608 shutdown_connections 2020-06-12T17:51:22.232 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.226+0000 7fddf7d5a700 1 -- 172.21.15.38:0/433581608 wait complete. 2020-06-12T17:51:22.242 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_2349 2020-06-12T17:51:22.358 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.355+0000 7fe818e27700 1 Processor -- start 2020-06-12T17:51:22.359 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.355+0000 7fe818e27700 1 -- start start 2020-06-12T17:51:22.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.356+0000 7fe818e27700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe814146680 0x7fe8140ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:22.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.356+0000 7fe818e27700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe81409d8d0 0x7fe8141421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:22.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.356+0000 7fe818e27700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe814146d20 con 0x7fe8140b2eb0 2020-06-12T17:51:22.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.356+0000 7fe818e27700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe814066a80 con 0x7fe81409d8d0 2020-06-12T17:51:22.362 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.356+0000 7fe818e27700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe814146f50 con 0x7fe814146680 2020-06-12T17:51:22.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.356+0000 7fe812d9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe81409d8d0 0x7fe8141421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:22.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.356+0000 7fe812d9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe81409d8d0 0x7fe8141421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39726/0 (socket says 172.21.15.38:39726) 2020-06-12T17:51:22.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.356+0000 7fe812d9d700 1 -- 172.21.15.38:0/4201908586 learned_addr learned my addr 172.21.15.38:0/4201908586 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:22.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.356+0000 7fe81259c700 1 --2- 172.21.15.38:0/4201908586 >> v2:172.21.15.150:3300/0 conn(0x7fe814146680 0x7fe8140ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:22.363 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.356+0000 7fe812d9d700 1 -- 172.21.15.38:0/4201908586 >> v2:172.21.15.150:3300/0 conn(0x7fe814146680 msgr2=0x7fe8140ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:22.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.356+0000 7fe812d9d700 1 --2- 172.21.15.38:0/4201908586 >> v2:172.21.15.150:3300/0 conn(0x7fe814146680 0x7fe8140ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:22.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.356+0000 7fe812d9d700 1 -- 172.21.15.38:0/4201908586 >> v1:172.21.15.150:6789/0 conn(0x7fe8140b2eb0 legacy=0x7fe81409d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:22.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.356+0000 7fe812d9d700 1 -- 172.21.15.38:0/4201908586 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe814146a60 con 0x7fe81409d8d0 2020-06-12T17:51:22.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.356+0000 7fe812d9d700 1 --2- 172.21.15.38:0/4201908586 >> v2:172.21.15.38:3300/0 conn(0x7fe81409d8d0 0x7fe8141421d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe814061380 tx=0x7fe80c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.364 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.356+0000 7fe812d9d700 1 --2- 172.21.15.38:0/4201908586 >> v2:172.21.15.38:3300/0 conn(0x7fe81409d8d0 0x7fe8141421d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe814061380 tx=0x7fe80c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.356+0000 7fe812d9d700 1 --2- 172.21.15.38:0/4201908586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe81409d8d0 0x7fe8141421d0 secure :-1 s=READY pgs=834 cs=0 l=1 rx=0x7fe814061380 tx=0x7fe80c007e60).ready entity=mon.0 client_cookie=cfd49153d9d363f4 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:22.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.356+0000 7fe812d9d700 1 --2- 172.21.15.38:0/4201908586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe81409d8d0 0x7fe8141421d0 secure :-1 s=THROTTLE_DONE pgs=834 cs=0 l=1 rx=0x7fe814061380 tx=0x7fe80c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.357+0000 7fe81159a700 1 -- 172.21.15.38:0/4201908586 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe80c0116a0 con 0x7fe81409d8d0 2020-06-12T17:51:22.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.357+0000 7fe812d9d700 1 --2- 172.21.15.38:0/4201908586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe81409d8d0 0x7fe8141421d0 secure :-1 s=THROTTLE_DONE pgs=834 cs=0 l=1 rx=0x7fe814061380 tx=0x7fe80c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.365 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.357+0000 7fe812d9d700 1 --2- 172.21.15.38:0/4201908586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe81409d8d0 0x7fe8141421d0 secure :-1 s=THROTTLE_DONE pgs=834 cs=0 l=1 rx=0x7fe814061380 tx=0x7fe80c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.357+0000 7fe81159a700 1 -- 172.21.15.38:0/4201908586 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80c011800 con 0x7fe81409d8d0 2020-06-12T17:51:22.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.357+0000 7fe81159a700 1 -- 172.21.15.38:0/4201908586 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe80c011be0 con 0x7fe81409d8d0 2020-06-12T17:51:22.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.357+0000 7fe818e27700 1 -- 172.21.15.38:0/4201908586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe81409d8d0 msgr2=0x7fe8141421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:22.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.357+0000 7fe818e27700 1 --2- 172.21.15.38:0/4201908586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe81409d8d0 0x7fe8141421d0 secure :-1 s=READY pgs=834 cs=0 l=1 rx=0x7fe814061380 tx=0x7fe80c007e60).stop 2020-06-12T17:51:22.366 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.357+0000 7fe818e27700 1 -- 172.21.15.38:0/4201908586 shutdown_connections 2020-06-12T17:51:22.367 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.357+0000 7fe818e27700 1 --2- 172.21.15.38:0/4201908586 >> v2:172.21.15.150:3300/0 conn(0x7fe814146680 0x7fe8140ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:22.367 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.357+0000 7fe818e27700 1 --2- 172.21.15.38:0/4201908586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe81409d8d0 0x7fe8141421d0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:22.367 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.357+0000 7fe818e27700 1 -- 172.21.15.38:0/4201908586 >> 172.21.15.38:0/4201908586 conn(0x7fe8140b5a20 msgr2=0x7fe81405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:22.367 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.357+0000 7fe818e27700 1 -- 172.21.15.38:0/4201908586 shutdown_connections 2020-06-12T17:51:22.367 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.357+0000 7fe818e27700 1 -- 172.21.15.38:0/4201908586 wait complete. 2020-06-12T17:51:22.368 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.358+0000 7fe818e27700 1 Processor -- start 2020-06-12T17:51:22.368 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.358+0000 7fe818e27700 1 -- start start 2020-06-12T17:51:22.373 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.359+0000 7fe818e27700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe81409d8d0 0x7fe8140b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:22.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.359+0000 7fe818e27700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8140b1090 con 0x7fe8140b2eb0 2020-06-12T17:51:22.374 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.359+0000 7fe818e27700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8140b1330 con 0x7fe814146680 2020-06-12T17:51:22.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.359+0000 7fe818e27700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8140b15d0 con 0x7fe81409d8d0 2020-06-12T17:51:22.375 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.359+0000 7fe811d9b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe8140b2eb0 0x7fe8140b3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41548/0 (socket says 172.21.15.38:41548) 2020-06-12T17:51:22.376 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.359+0000 7fe811d9b700 1 -- 172.21.15.38:0/1962293061 learned_addr learned my addr 172.21.15.38:0/1962293061 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:22.376 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.359+0000 7fe8037fe700 1 -- 172.21.15.38:0/1962293061 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360037270 0 0) 0x7fe8140b1090 con 0x7fe8140b2eb0 2020-06-12T17:51:22.376 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.359+0000 7fe8037fe700 1 -- 172.21.15.38:0/1962293061 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7f0002fe0 con 0x7fe8140b2eb0 2020-06-12T17:51:22.377 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.359+0000 7fe81259c700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe81409d8d0 0x7fe8140b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:22.377 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.359+0000 7fe8037fe700 1 -- 172.21.15.38:0/1962293061 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3507306209 0 0) 0x7fe7f0002fe0 con 0x7fe8140b2eb0 2020-06-12T17:51:22.377 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.359+0000 7fe8037fe700 1 -- 172.21.15.38:0/1962293061 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe8140b1090 con 0x7fe8140b2eb0 2020-06-12T17:51:22.377 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.359+0000 7fe8037fe700 1 -- 172.21.15.38:0/1962293061 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fe804002d20 con 0x7fe8140b2eb0 2020-06-12T17:51:22.378 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.359+0000 7fe8037fe700 1 -- 172.21.15.38:0/1962293061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe81409d8d0 msgr2=0x7fe8140b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:22.378 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.359+0000 7fe8037fe700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe81409d8d0 0x7fe8140b1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:22.378 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.359+0000 7fe8037fe700 1 -- 172.21.15.38:0/1962293061 >> v1:172.21.15.150:6789/0 conn(0x7fe814146680 legacy=0x7fe814151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:22.378 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.359+0000 7fe8037fe700 1 -- 172.21.15.38:0/1962293061 >> v1:172.21.15.38:6789/0 conn(0x7fe8140b2eb0 legacy=0x7fe8140b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:22.378 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.359+0000 7fe8037fe700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe81409d8d0 0x7fe7f00049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:22.379 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.359+0000 7fe8037fe700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7f0004e10 0x7fe7f0005230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:22.379 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.359+0000 7fe8037fe700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7f00039e0 0x7fe7f0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:22.379 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.359+0000 7fe8037fe700 1 -- 172.21.15.38:0/1962293061 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8140b15d0 con 0x7fe7f00039e0 2020-06-12T17:51:22.379 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.359+0000 7fe8037fe700 1 -- 172.21.15.38:0/1962293061 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f00044a0 con 0x7fe7f0004e10 2020-06-12T17:51:22.379 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.359+0000 7fe8037fe700 1 -- 172.21.15.38:0/1962293061 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f0004660 con 0x7fe81409d8d0 2020-06-12T17:51:22.380 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.360+0000 7fe812d9d700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7f00039e0 0x7fe7f0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:22.380 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.360+0000 7fe81259c700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe81409d8d0 0x7fe7f00049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:22.380 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.360+0000 7fe811d9b700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7f0004e10 0x7fe7f0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:22.380 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.360+0000 7fe812d9d700 1 -- 172.21.15.38:0/1962293061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe81409d8d0 msgr2=0x7fe7f00049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:22.380 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.360+0000 7fe812d9d700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe81409d8d0 0x7fe7f00049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:22.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.360+0000 7fe812d9d700 1 -- 172.21.15.38:0/1962293061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7f0004e10 msgr2=0x7fe7f0005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:22.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.360+0000 7fe812d9d700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7f0004e10 0x7fe7f0005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:22.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.360+0000 7fe812d9d700 1 -- 172.21.15.38:0/1962293061 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8140b3e50 con 0x7fe7f00039e0 2020-06-12T17:51:22.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.360+0000 7fe818e27700 1 -- 172.21.15.38:0/1962293061 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe814065750 con 0x7fe7f00039e0 2020-06-12T17:51:22.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.360+0000 7fe812d9d700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7f00039e0 0x7fe7f0003e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe80c0082e0 tx=0x7fe80c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.381 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.360+0000 7fe818e27700 1 -- 172.21.15.38:0/1962293061 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8140b1a70 con 0x7fe7f00039e0 2020-06-12T17:51:22.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.360+0000 7fe812d9d700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7f00039e0 0x7fe7f0003e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe80c0082e0 tx=0x7fe80c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.360+0000 7fe812d9d700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7f00039e0 0x7fe7f0003e60 secure :-1 s=READY pgs=836 cs=0 l=1 rx=0x7fe80c0082e0 tx=0x7fe80c007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:22.382 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.360+0000 7fe812d9d700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7f00039e0 0x7fe7f0003e60 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7fe80c0082e0 tx=0x7fe80c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.360+0000 7fe8037fe700 1 -- 172.21.15.38:0/1962293061 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe80c011c80 con 0x7fe7f00039e0 2020-06-12T17:51:22.383 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.360+0000 7fe812d9d700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7f00039e0 0x7fe7f0003e60 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7fe80c0082e0 tx=0x7fe80c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.360+0000 7fe8037fe700 1 -- 172.21.15.38:0/1962293061 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80c0140a0 con 0x7fe7f00039e0 2020-06-12T17:51:22.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.360+0000 7fe812d9d700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7f00039e0 0x7fe7f0003e60 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7fe80c0082e0 tx=0x7fe80c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.360+0000 7fe8037fe700 1 -- 172.21.15.38:0/1962293061 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe80c0058b0 con 0x7fe7f00039e0 2020-06-12T17:51:22.384 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.361+0000 7fe812d9d700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7f00039e0 0x7fe7f0003e60 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7fe80c0082e0 tx=0x7fe80c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.361+0000 7fe818e27700 1 -- 172.21.15.38:0/1962293061 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7ec003340 con 0x7fe7f00039e0 2020-06-12T17:51:22.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.361+0000 7fe8037fe700 1 -- 172.21.15.38:0/1962293061 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fe80c005a10 con 0x7fe7f00039e0 2020-06-12T17:51:22.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.361+0000 7fe812d9d700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7f00039e0 0x7fe7f0003e60 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7fe80c0082e0 tx=0x7fe80c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.361+0000 7fe8037fe700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe7f0055820 0x7fe7f0057ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:22.385 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.362+0000 7fe8037fe700 1 -- 172.21.15.38:0/1962293061 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe80c060e70 con 0x7fe7f00039e0 2020-06-12T17:51:22.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.362+0000 7fe81259c700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe7f0055820 0x7fe7f0057ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:22.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.362+0000 7fe81259c700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe7f0055820 0x7fe7f0057ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe808002f30 tx=0x7fe80800e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.362+0000 7fe81259c700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe7f0055820 0x7fe7f0057ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe808002f30 tx=0x7fe80800e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.362+0000 7fe81259c700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe7f0055820 0x7fe7f0057ce0 secure :-1 s=READY pgs=325 cs=0 l=1 rx=0x7fe808002f30 tx=0x7fe80800e0c0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:22.386 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.365+0000 7fe812d9d700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7f00039e0 0x7fe7f0003e60 secure :-1 s=THROTTLE_DONE pgs=836 cs=0 l=1 rx=0x7fe80c0082e0 tx=0x7fe80c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.387 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.365+0000 7fe8037fe700 1 -- 172.21.15.38:0/1962293061 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fe80c03c690 con 0x7fe7f00039e0 2020-06-12T17:51:22.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.561+0000 7fe818e27700 1 -- 172.21.15.38:0/1962293061 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_2349", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7ec002200 con 0x7fe7f0055820 2020-06-12T17:51:22.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.565+0000 7fe81259c700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe7f0055820 0x7fe7f0057ce0 secure :-1 s=THROTTLE_DONE pgs=325 cs=0 l=1 rx=0x7fe808002f30 tx=0x7fe80800e0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:22.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.565+0000 7fe8037fe700 1 -- 172.21.15.38:0/1962293061 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7fe7ec002200 con 0x7fe7f0055820 2020-06-12T17:51:22.569 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_2349/8477d881-ac96-4232-a007-8b4a951e8251 2020-06-12T17:51:22.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.566+0000 7fe818e27700 1 -- 172.21.15.38:0/1962293061 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe7f0055820 msgr2=0x7fe7f0057ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:22.570 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.566+0000 7fe818e27700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe7f0055820 0x7fe7f0057ce0 secure :-1 s=READY pgs=325 cs=0 l=1 rx=0x7fe808002f30 tx=0x7fe80800e0c0).stop 2020-06-12T17:51:22.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.566+0000 7fe818e27700 1 -- 172.21.15.38:0/1962293061 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7f00039e0 msgr2=0x7fe7f0003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:22.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.566+0000 7fe818e27700 1 --2- 172.21.15.38:0/1962293061 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7f00039e0 0x7fe7f0003e60 secure :-1 s=READY pgs=836 cs=0 l=1 rx=0x7fe80c0082e0 tx=0x7fe80c007e60).stop 2020-06-12T17:51:22.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.567+0000 7fe812d9d700 1 -- 172.21.15.38:0/1962293061 reap_dead start 2020-06-12T17:51:22.571 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.567+0000 7fe812d9d700 1 -- 172.21.15.38:0/1962293061 reap_dead start 2020-06-12T17:51:22.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.567+0000 7fe818e27700 1 -- 172.21.15.38:0/1962293061 shutdown_connections 2020-06-12T17:51:22.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.567+0000 7fe818e27700 1 -- 172.21.15.38:0/1962293061 >> 172.21.15.38:0/1962293061 conn(0x7fe8140b5a20 msgr2=0x7fe8141458f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:22.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.567+0000 7fe818e27700 1 -- 172.21.15.38:0/1962293061 shutdown_connections 2020-06-12T17:51:22.572 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:22.567+0000 7fe818e27700 1 -- 172.21.15.38:0/1962293061 wait complete. 2020-06-12T17:51:22.580 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_2349 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_2349/8477d881-ac96-4232-a007-8b4a951e8251 2020-06-12T17:51:22.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:22.582 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:22.582 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:22.597 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:22.597 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:22.598 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2349/8477d881-ac96-4232-a007-8b4a951e8251/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:22.691 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:22.692 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:22.692 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01242 s, 84.4 MB/s 2020-06-12T17:51:22.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:22.693 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:22.694 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:22.716 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:22.716 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:22.717 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2349/8477d881-ac96-4232-a007-8b4a951e8251/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:22.803 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:22.804 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:22.804 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112454 s, 93.2 MB/s 2020-06-12T17:51:22.805 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:22.806 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:22.806 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:22.821 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:22.822 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:22.822 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2349/8477d881-ac96-4232-a007-8b4a951e8251/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:22.910 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:22.910 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:22.910 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119934 s, 87.4 MB/s 2020-06-12T17:51:22.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:22.912 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:22.912 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:22.927 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:22.928 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:22.928 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2349/8477d881-ac96-4232-a007-8b4a951e8251/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:23.017 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:23.018 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:23.018 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113504 s, 92.4 MB/s 2020-06-12T17:51:23.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:23.019 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:23.020 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:23.035 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:23.035 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:23.036 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2349/8477d881-ac96-4232-a007-8b4a951e8251/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:23.123 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:23.123 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:23.123 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114347 s, 91.7 MB/s 2020-06-12T17:51:23.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:23.125 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:23.125 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:23.141 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:23.141 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:23.142 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2349/8477d881-ac96-4232-a007-8b4a951e8251/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:23.229 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:23.230 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:23.230 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111881 s, 93.7 MB/s 2020-06-12T17:51:23.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:23.231 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:23.232 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:23.248 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:23.249 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:23.249 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2349/8477d881-ac96-4232-a007-8b4a951e8251/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:23.337 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:23.338 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:23.338 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126495 s, 82.9 MB/s 2020-06-12T17:51:23.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:23.340 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:23.340 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:23.357 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:23.357 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:23.358 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2349/8477d881-ac96-4232-a007-8b4a951e8251/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:23.446 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:23.447 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:23.447 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113563 s, 92.3 MB/s 2020-06-12T17:51:23.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:23.449 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:23.449 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:23.464 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:23.465 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:23.465 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2349/8477d881-ac96-4232-a007-8b4a951e8251/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:23.551 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:23.552 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:23.552 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106304 s, 98.6 MB/s 2020-06-12T17:51:23.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:23.554 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:23.554 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:23.570 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:23.570 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:23.571 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2349/8477d881-ac96-4232-a007-8b4a951e8251/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:23.656 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:23.657 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:23.657 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939387 s, 112 MB/s 2020-06-12T17:51:23.659 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_2856 2020-06-12T17:51:23.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.772+0000 7f5971f09700 1 Processor -- start 2020-06-12T17:51:23.776 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.772+0000 7f5971f09700 1 -- start start 2020-06-12T17:51:23.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.773+0000 7f5971f09700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f596c0b3ac0 0x7f596c09df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:23.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.773+0000 7f5971f09700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f596c142e90 0x7f596c13bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:23.783 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.773+0000 7f5971f09700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f596c13c3a0 0x7f596c066790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:23.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.773+0000 7f5971f09700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f596c09b960 con 0x7f596c142e90 2020-06-12T17:51:23.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.773+0000 7f5971f09700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f596c09bc00 con 0x7f596c0b3ac0 2020-06-12T17:51:23.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.773+0000 7f5971f09700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596c0b48f0 con 0x7f596c13c3a0 2020-06-12T17:51:23.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.773+0000 7f596affd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f596c142e90 0x7f596c13bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:23.784 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.773+0000 7f596affd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f596c142e90 0x7f596c13bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39746/0 (socket says 172.21.15.38:39746) 2020-06-12T17:51:23.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.773+0000 7f596affd700 1 -- 172.21.15.38:0/1245097156 learned_addr learned my addr 172.21.15.38:0/1245097156 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:23.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.774+0000 7f596affd700 1 -- 172.21.15.38:0/1245097156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f596c13c3a0 msgr2=0x7f596c066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:23.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.774+0000 7f596affd700 1 --2- 172.21.15.38:0/1245097156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f596c13c3a0 0x7f596c066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:23.785 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.774+0000 7f596affd700 1 -- 172.21.15.38:0/1245097156 >> v2:172.21.15.150:3300/0 conn(0x7f596c0b3ac0 msgr2=0x7f596c09df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:23.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.774+0000 7f596affd700 1 --2- 172.21.15.38:0/1245097156 >> v2:172.21.15.150:3300/0 conn(0x7f596c0b3ac0 0x7f596c09df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:23.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.774+0000 7f596affd700 1 -- 172.21.15.38:0/1245097156 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596c0b3ea0 con 0x7f596c142e90 2020-06-12T17:51:23.786 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.774+0000 7f596affd700 1 --2- 172.21.15.38:0/1245097156 >> v2:172.21.15.38:3300/0 conn(0x7f596c142e90 0x7f596c13bf40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5960002f30 tx=0x7f5960007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:23.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.774+0000 7f596affd700 1 --2- 172.21.15.38:0/1245097156 >> v2:172.21.15.38:3300/0 conn(0x7f596c142e90 0x7f596c13bf40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5960002f30 tx=0x7f5960007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:23.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.774+0000 7f596affd700 1 --2- 172.21.15.38:0/1245097156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c142e90 0x7f596c13bf40 secure :-1 s=READY pgs=837 cs=0 l=1 rx=0x7f5960002f30 tx=0x7f5960007e60).ready entity=mon.0 client_cookie=59ebdd52b070d5d4 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:23.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.774+0000 7f596affd700 1 --2- 172.21.15.38:0/1245097156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c142e90 0x7f596c13bf40 secure :-1 s=THROTTLE_DONE pgs=837 cs=0 l=1 rx=0x7f5960002f30 tx=0x7f5960007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:23.787 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.774+0000 7f596a7fc700 1 -- 172.21.15.38:0/1245097156 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5960010670 con 0x7f596c142e90 2020-06-12T17:51:23.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.774+0000 7f596affd700 1 --2- 172.21.15.38:0/1245097156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c142e90 0x7f596c13bf40 secure :-1 s=THROTTLE_DONE pgs=837 cs=0 l=1 rx=0x7f5960002f30 tx=0x7f5960007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:23.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.774+0000 7f596affd700 1 --2- 172.21.15.38:0/1245097156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c142e90 0x7f596c13bf40 secure :-1 s=THROTTLE_DONE pgs=837 cs=0 l=1 rx=0x7f5960002f30 tx=0x7f5960007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:23.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.774+0000 7f596a7fc700 1 -- 172.21.15.38:0/1245097156 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59600107d0 con 0x7f596c142e90 2020-06-12T17:51:23.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.774+0000 7f596a7fc700 1 -- 172.21.15.38:0/1245097156 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f596000a160 con 0x7f596c142e90 2020-06-12T17:51:23.788 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.774+0000 7f5971f09700 1 -- 172.21.15.38:0/1245097156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c142e90 msgr2=0x7f596c13bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:23.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.774+0000 7f5971f09700 1 --2- 172.21.15.38:0/1245097156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c142e90 0x7f596c13bf40 secure :-1 s=READY pgs=837 cs=0 l=1 rx=0x7f5960002f30 tx=0x7f5960007e60).stop 2020-06-12T17:51:23.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.774+0000 7f5971f09700 1 -- 172.21.15.38:0/1245097156 shutdown_connections 2020-06-12T17:51:23.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.774+0000 7f5971f09700 1 --2- 172.21.15.38:0/1245097156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f596c13c3a0 0x7f596c066790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:23.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.774+0000 7f5971f09700 1 --2- 172.21.15.38:0/1245097156 >> v2:172.21.15.150:3300/0 conn(0x7f596c0b3ac0 0x7f596c09df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:23.789 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.774+0000 7f5971f09700 1 --2- 172.21.15.38:0/1245097156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c142e90 0x7f596c13bf40 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:23.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.774+0000 7f5971f09700 1 -- 172.21.15.38:0/1245097156 >> 172.21.15.38:0/1245097156 conn(0x7f596c0b5a20 msgr2=0x7f596c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:23.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.774+0000 7f5971f09700 1 -- 172.21.15.38:0/1245097156 shutdown_connections 2020-06-12T17:51:23.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.774+0000 7f5971f09700 1 -- 172.21.15.38:0/1245097156 wait complete. 2020-06-12T17:51:23.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.775+0000 7f5971f09700 1 Processor -- start 2020-06-12T17:51:23.790 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.776+0000 7f5971f09700 1 -- start start 2020-06-12T17:51:23.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.776+0000 7f5971f09700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f596c0b3ac0 0x7f596c1534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:23.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.776+0000 7f5971f09700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f596c13c3a0 0x7f596c061d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:23.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.776+0000 7f5971f09700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f596c142e90 0x7f596c066ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:23.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.776+0000 7f5971f09700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f596c067330 con 0x7f596c142e90 2020-06-12T17:51:23.791 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.776+0000 7f5971f09700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f596c13e7c0 con 0x7f596c13c3a0 2020-06-12T17:51:23.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.776+0000 7f5971f09700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596c13ea60 con 0x7f596c0b3ac0 2020-06-12T17:51:23.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.776+0000 7f596bfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f596c142e90 0x7f596c066ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:23.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.776+0000 7f596bfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f596c142e90 0x7f596c066ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39754/0 (socket says 172.21.15.38:39754) 2020-06-12T17:51:23.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.776+0000 7f596bfff700 1 -- 172.21.15.38:0/3128204175 learned_addr learned my addr 172.21.15.38:0/3128204175 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:23.792 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.776+0000 7f596affd700 1 --2- 172.21.15.38:0/3128204175 >> v2:172.21.15.150:3300/0 conn(0x7f596c13c3a0 0x7f596c061d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:23.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.776+0000 7f596b7fe700 1 --2- 172.21.15.38:0/3128204175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f596c0b3ac0 0x7f596c1534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:23.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.777+0000 7f596bfff700 1 -- 172.21.15.38:0/3128204175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f596c0b3ac0 msgr2=0x7f596c1534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:23.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.777+0000 7f596bfff700 1 --2- 172.21.15.38:0/3128204175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f596c0b3ac0 0x7f596c1534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:23.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.777+0000 7f596bfff700 1 -- 172.21.15.38:0/3128204175 >> v2:172.21.15.150:3300/0 conn(0x7f596c13c3a0 msgr2=0x7f596c061d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:23.793 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.777+0000 7f596bfff700 1 --2- 172.21.15.38:0/3128204175 >> v2:172.21.15.150:3300/0 conn(0x7f596c13c3a0 0x7f596c061d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:23.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.777+0000 7f596bfff700 1 -- 172.21.15.38:0/3128204175 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596c13ed00 con 0x7f596c142e90 2020-06-12T17:51:23.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.777+0000 7f596bfff700 1 --2- 172.21.15.38:0/3128204175 >> v2:172.21.15.38:3300/0 conn(0x7f596c142e90 0x7f596c066ed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f59640032b0 tx=0x7f5964008050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:23.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.777+0000 7f596bfff700 1 --2- 172.21.15.38:0/3128204175 >> v2:172.21.15.38:3300/0 conn(0x7f596c142e90 0x7f596c066ed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f59640032b0 tx=0x7f5964008050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:23.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.777+0000 7f596bfff700 1 --2- 172.21.15.38:0/3128204175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c142e90 0x7f596c066ed0 secure :-1 s=READY pgs=838 cs=0 l=1 rx=0x7f59640032b0 tx=0x7f5964008050).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:23.794 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.777+0000 7f596bfff700 1 --2- 172.21.15.38:0/3128204175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c142e90 0x7f596c066ed0 secure :-1 s=THROTTLE_DONE pgs=838 cs=0 l=1 rx=0x7f59640032b0 tx=0x7f5964008050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:23.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.777+0000 7f596bfff700 1 --2- 172.21.15.38:0/3128204175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c142e90 0x7f596c066ed0 secure :-1 s=THROTTLE_DONE pgs=838 cs=0 l=1 rx=0x7f59640032b0 tx=0x7f5964008050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:23.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.777+0000 7f5968ff9700 1 -- 172.21.15.38:0/3128204175 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5964005dc0 con 0x7f596c142e90 2020-06-12T17:51:23.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.777+0000 7f596bfff700 1 --2- 172.21.15.38:0/3128204175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c142e90 0x7f596c066ed0 secure :-1 s=THROTTLE_DONE pgs=838 cs=0 l=1 rx=0x7f59640032b0 tx=0x7f5964008050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:23.795 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.777+0000 7f5968ff9700 1 -- 172.21.15.38:0/3128204175 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5964012600 con 0x7f596c142e90 2020-06-12T17:51:23.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.777+0000 7f5971f09700 1 -- 172.21.15.38:0/3128204175 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f596c13e460 con 0x7f596c142e90 2020-06-12T17:51:23.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.777+0000 7f5968ff9700 1 -- 172.21.15.38:0/3128204175 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5964012a20 con 0x7f596c142e90 2020-06-12T17:51:23.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.777+0000 7f5971f09700 1 -- 172.21.15.38:0/3128204175 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f596c13c940 con 0x7f596c142e90 2020-06-12T17:51:23.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.778+0000 7f596bfff700 1 --2- 172.21.15.38:0/3128204175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c142e90 0x7f596c066ed0 secure :-1 s=THROTTLE_DONE pgs=838 cs=0 l=1 rx=0x7f59640032b0 tx=0x7f5964008050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:23.796 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.778+0000 7f5971f09700 1 -- 172.21.15.38:0/3128204175 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f596c13cc50 con 0x7f596c142e90 2020-06-12T17:51:23.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.778+0000 7f5968ff9700 1 -- 172.21.15.38:0/3128204175 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f5964012c90 con 0x7f596c142e90 2020-06-12T17:51:23.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.778+0000 7f596bfff700 1 --2- 172.21.15.38:0/3128204175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c142e90 0x7f596c066ed0 secure :-1 s=THROTTLE_DONE pgs=838 cs=0 l=1 rx=0x7f59640032b0 tx=0x7f5964008050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:23.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.778+0000 7f5968ff9700 1 --2- 172.21.15.38:0/3128204175 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f594c04d650 0x7f594c04fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:23.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.778+0000 7f5968ff9700 1 -- 172.21.15.38:0/3128204175 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f59640616a0 con 0x7f596c142e90 2020-06-12T17:51:23.797 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.778+0000 7f596b7fe700 1 --2- 172.21.15.38:0/3128204175 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f594c04d650 0x7f594c04fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:23.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.779+0000 7f596b7fe700 1 --2- 172.21.15.38:0/3128204175 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f594c04d650 0x7f594c04fb10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f595c002f30 tx=0x7f595c007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:23.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.779+0000 7f596b7fe700 1 --2- 172.21.15.38:0/3128204175 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f594c04d650 0x7f594c04fb10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f595c002f30 tx=0x7f595c007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:23.798 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.779+0000 7f596b7fe700 1 --2- 172.21.15.38:0/3128204175 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f594c04d650 0x7f594c04fb10 secure :-1 s=READY pgs=326 cs=0 l=1 rx=0x7f595c002f30 tx=0x7f595c007d00).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:23.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.782+0000 7f596bfff700 1 --2- 172.21.15.38:0/3128204175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c142e90 0x7f596c066ed0 secure :-1 s=THROTTLE_DONE pgs=838 cs=0 l=1 rx=0x7f59640032b0 tx=0x7f5964008050).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:23.799 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.782+0000 7f5968ff9700 1 -- 172.21.15.38:0/3128204175 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f596403cdc0 con 0x7f596c142e90 2020-06-12T17:51:23.983 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.979+0000 7f5971f09700 1 -- 172.21.15.38:0/3128204175 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_2856", "target": ["mon-mgr", ""]}) v1 -- 0x7f596c056c30 con 0x7f594c04d650 2020-06-12T17:51:24.001 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.997+0000 7f596b7fe700 1 --2- 172.21.15.38:0/3128204175 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f594c04d650 0x7f594c04fb10 secure :-1 s=THROTTLE_DONE pgs=326 cs=0 l=1 rx=0x7f595c002f30 tx=0x7f595c007d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:24.001 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.997+0000 7f5968ff9700 1 -- 172.21.15.38:0/3128204175 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f596c056c30 con 0x7f594c04d650 2020-06-12T17:51:24.002 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.999+0000 7f5971f09700 1 -- 172.21.15.38:0/3128204175 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f594c04d650 msgr2=0x7f594c04fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:24.003 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.999+0000 7f5971f09700 1 --2- 172.21.15.38:0/3128204175 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f594c04d650 0x7f594c04fb10 secure :-1 s=READY pgs=326 cs=0 l=1 rx=0x7f595c002f30 tx=0x7f595c007d00).stop 2020-06-12T17:51:24.003 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.999+0000 7f5971f09700 1 -- 172.21.15.38:0/3128204175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c142e90 msgr2=0x7f596c066ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:24.003 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.999+0000 7f5971f09700 1 --2- 172.21.15.38:0/3128204175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c142e90 0x7f596c066ed0 secure :-1 s=READY pgs=838 cs=0 l=1 rx=0x7f59640032b0 tx=0x7f5964008050).stop 2020-06-12T17:51:24.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.999+0000 7f5971f09700 1 -- 172.21.15.38:0/3128204175 shutdown_connections 2020-06-12T17:51:24.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.999+0000 7f5971f09700 1 --2- 172.21.15.38:0/3128204175 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f594c04d650 0x7f594c04fb10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:24.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.999+0000 7f5971f09700 1 --2- 172.21.15.38:0/3128204175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c142e90 0x7f596c066ed0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:24.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.999+0000 7f5971f09700 1 --2- 172.21.15.38:0/3128204175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f596c0b3ac0 0x7f596c1534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:24.004 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.999+0000 7f5971f09700 1 --2- 172.21.15.38:0/3128204175 >> v2:172.21.15.150:3300/0 conn(0x7f596c13c3a0 0x7f596c061d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:24.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.999+0000 7f5971f09700 1 -- 172.21.15.38:0/3128204175 >> 172.21.15.38:0/3128204175 conn(0x7f596c0b5a20 msgr2=0x7f596c0b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:24.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.999+0000 7f5971f09700 1 -- 172.21.15.38:0/3128204175 shutdown_connections 2020-06-12T17:51:24.005 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:23.999+0000 7f5971f09700 1 -- 172.21.15.38:0/3128204175 wait complete. 2020-06-12T17:51:24.012 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_2856 2020-06-12T17:51:24.130 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.126+0000 7f57a3ea0700 1 Processor -- start 2020-06-12T17:51:24.130 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.127+0000 7f57a3ea0700 1 -- start start 2020-06-12T17:51:24.137 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.127+0000 7f57a3ea0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f579c0b3ac0 0x7f579c09df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:24.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.127+0000 7f57a3ea0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f579c142e90 0x7f579c13bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:24.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.127+0000 7f57a3ea0700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f579c13c3a0 0x7f579c066790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:24.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.127+0000 7f57a3ea0700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f579c09b960 con 0x7f579c13c3a0 2020-06-12T17:51:24.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.127+0000 7f57a3ea0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f579c09bc00 con 0x7f579c142e90 2020-06-12T17:51:24.138 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.127+0000 7f57a3ea0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579c0b48f0 con 0x7f579c0b3ac0 2020-06-12T17:51:24.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.127+0000 7f57a243d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f579c13c3a0 0x7f579c066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:24.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.128+0000 7f57a243d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f579c13c3a0 0x7f579c066790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39758/0 (socket says 172.21.15.38:39758) 2020-06-12T17:51:24.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.128+0000 7f57a243d700 1 -- 172.21.15.38:0/2115809743 learned_addr learned my addr 172.21.15.38:0/2115809743 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:24.139 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.128+0000 7f57a143b700 1 --2- 172.21.15.38:0/2115809743 >> v2:172.21.15.150:3300/0 conn(0x7f579c142e90 0x7f579c13bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:24.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.128+0000 7f57a1c3c700 1 --2- 172.21.15.38:0/2115809743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f579c0b3ac0 0x7f579c09df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:24.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.128+0000 7f57a243d700 1 -- 172.21.15.38:0/2115809743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f579c0b3ac0 msgr2=0x7f579c09df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:24.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.128+0000 7f57a243d700 1 --2- 172.21.15.38:0/2115809743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f579c0b3ac0 0x7f579c09df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:24.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.128+0000 7f57a243d700 1 -- 172.21.15.38:0/2115809743 >> v2:172.21.15.150:3300/0 conn(0x7f579c142e90 msgr2=0x7f579c13bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:24.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.128+0000 7f57a243d700 1 --2- 172.21.15.38:0/2115809743 >> v2:172.21.15.150:3300/0 conn(0x7f579c142e90 0x7f579c13bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:24.140 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.128+0000 7f57a243d700 1 -- 172.21.15.38:0/2115809743 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c0b3ea0 con 0x7f579c13c3a0 2020-06-12T17:51:24.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.128+0000 7f57a143b700 1 --2- 172.21.15.38:0/2115809743 >> v2:172.21.15.150:3300/0 conn(0x7f579c142e90 0x7f579c13bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:51:24.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.128+0000 7f57a1c3c700 1 --2- 172.21.15.38:0/2115809743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f579c0b3ac0 0x7f579c09df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:51:24.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.128+0000 7f57a243d700 1 --2- 172.21.15.38:0/2115809743 >> v2:172.21.15.38:3300/0 conn(0x7f579c13c3a0 0x7f579c066790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f57940032b0 tx=0x7f57940081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:24.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.128+0000 7f57a243d700 1 --2- 172.21.15.38:0/2115809743 >> v2:172.21.15.38:3300/0 conn(0x7f579c13c3a0 0x7f579c066790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f57940032b0 tx=0x7f57940081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:24.141 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.128+0000 7f57a243d700 1 --2- 172.21.15.38:0/2115809743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f579c13c3a0 0x7f579c066790 secure :-1 s=READY pgs=839 cs=0 l=1 rx=0x7f57940032b0 tx=0x7f57940081e0).ready entity=mon.0 client_cookie=d6a92f422019dbc1 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:24.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.128+0000 7f57a243d700 1 --2- 172.21.15.38:0/2115809743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f579c13c3a0 0x7f579c066790 secure :-1 s=THROTTLE_DONE pgs=839 cs=0 l=1 rx=0x7f57940032b0 tx=0x7f57940081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:24.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.128+0000 7f57a0c3a700 1 -- 172.21.15.38:0/2115809743 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f579400a160 con 0x7f579c13c3a0 2020-06-12T17:51:24.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.128+0000 7f57a243d700 1 --2- 172.21.15.38:0/2115809743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f579c13c3a0 0x7f579c066790 secure :-1 s=THROTTLE_DONE pgs=839 cs=0 l=1 rx=0x7f57940032b0 tx=0x7f57940081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:24.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.128+0000 7f57a243d700 1 --2- 172.21.15.38:0/2115809743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f579c13c3a0 0x7f579c066790 secure :-1 s=THROTTLE_DONE pgs=839 cs=0 l=1 rx=0x7f57940032b0 tx=0x7f57940081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:24.142 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.128+0000 7f57a0c3a700 1 -- 172.21.15.38:0/2115809743 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579400a2c0 con 0x7f579c13c3a0 2020-06-12T17:51:24.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.128+0000 7f57a0c3a700 1 -- 172.21.15.38:0/2115809743 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f579400a6e0 con 0x7f579c13c3a0 2020-06-12T17:51:24.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.128+0000 7f57a3ea0700 1 -- 172.21.15.38:0/2115809743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f579c13c3a0 msgr2=0x7f579c066790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:24.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.128+0000 7f57a3ea0700 1 --2- 172.21.15.38:0/2115809743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f579c13c3a0 0x7f579c066790 secure :-1 s=READY pgs=839 cs=0 l=1 rx=0x7f57940032b0 tx=0x7f57940081e0).stop 2020-06-12T17:51:24.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.129+0000 7f57a3ea0700 1 -- 172.21.15.38:0/2115809743 shutdown_connections 2020-06-12T17:51:24.143 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.129+0000 7f57a3ea0700 1 --2- 172.21.15.38:0/2115809743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f579c13c3a0 0x7f579c066790 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:24.144 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.129+0000 7f57a3ea0700 1 --2- 172.21.15.38:0/2115809743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f579c0b3ac0 0x7f579c09df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:24.144 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.129+0000 7f57a3ea0700 1 --2- 172.21.15.38:0/2115809743 >> v2:172.21.15.150:3300/0 conn(0x7f579c142e90 0x7f579c13bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:24.144 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.129+0000 7f57a3ea0700 1 -- 172.21.15.38:0/2115809743 >> 172.21.15.38:0/2115809743 conn(0x7f579c0b5a20 msgr2=0x7f579c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:24.144 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.129+0000 7f57a3ea0700 1 -- 172.21.15.38:0/2115809743 shutdown_connections 2020-06-12T17:51:24.144 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.129+0000 7f57a3ea0700 1 -- 172.21.15.38:0/2115809743 wait complete. 2020-06-12T17:51:24.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.130+0000 7f57a3ea0700 1 Processor -- start 2020-06-12T17:51:24.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.130+0000 7f57a3ea0700 1 -- start start 2020-06-12T17:51:24.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.130+0000 7f57a3ea0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f579c0b3ac0 0x7f579c13f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:24.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.130+0000 7f57a3ea0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f579c13c3a0 0x7f579c146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:24.145 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.130+0000 7f57a3ea0700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f579c142e90 0x7f579c153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:24.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.130+0000 7f57a3ea0700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f579c153320 con 0x7f579c142e90 2020-06-12T17:51:24.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.130+0000 7f57a3ea0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f579c13f4b0 con 0x7f579c0b3ac0 2020-06-12T17:51:24.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.130+0000 7f57a3ea0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579c153510 con 0x7f579c13c3a0 2020-06-12T17:51:24.146 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.130+0000 7f57a243d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f579c142e90 0x7f579c153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:24.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.131+0000 7f57a243d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f579c142e90 0x7f579c153c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39766/0 (socket says 172.21.15.38:39766) 2020-06-12T17:51:24.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.131+0000 7f57a243d700 1 -- 172.21.15.38:0/2638882917 learned_addr learned my addr 172.21.15.38:0/2638882917 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:24.147 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.131+0000 7f57a143b700 1 --2- 172.21.15.38:0/2638882917 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f579c13c3a0 0x7f579c146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:24.148 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.131+0000 7f57a1c3c700 1 --2- 172.21.15.38:0/2638882917 >> v2:172.21.15.150:3300/0 conn(0x7f579c0b3ac0 0x7f579c13f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:24.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.131+0000 7f57a243d700 1 -- 172.21.15.38:0/2638882917 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f579c13c3a0 msgr2=0x7f579c146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:24.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.131+0000 7f57a243d700 1 --2- 172.21.15.38:0/2638882917 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f579c13c3a0 0x7f579c146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:24.149 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.131+0000 7f57a243d700 1 -- 172.21.15.38:0/2638882917 >> v2:172.21.15.150:3300/0 conn(0x7f579c0b3ac0 msgr2=0x7f579c13f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:24.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.131+0000 7f57a243d700 1 --2- 172.21.15.38:0/2638882917 >> v2:172.21.15.150:3300/0 conn(0x7f579c0b3ac0 0x7f579c13f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:24.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.131+0000 7f57a243d700 1 -- 172.21.15.38:0/2638882917 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c1537b0 con 0x7f579c142e90 2020-06-12T17:51:24.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.131+0000 7f57a143b700 1 --2- 172.21.15.38:0/2638882917 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f579c13c3a0 0x7f579c146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:51:24.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.131+0000 7f57a1c3c700 1 --2- 172.21.15.38:0/2638882917 >> v2:172.21.15.150:3300/0 conn(0x7f579c0b3ac0 0x7f579c13f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:51:24.150 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.131+0000 7f57a243d700 1 --2- 172.21.15.38:0/2638882917 >> v2:172.21.15.38:3300/0 conn(0x7f579c142e90 0x7f579c153c50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f57940032b0 tx=0x7f57940081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:24.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.131+0000 7f57a243d700 1 --2- 172.21.15.38:0/2638882917 >> v2:172.21.15.38:3300/0 conn(0x7f579c142e90 0x7f579c153c50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f57940032b0 tx=0x7f57940081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:24.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.131+0000 7f57a243d700 1 --2- 172.21.15.38:0/2638882917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f579c142e90 0x7f579c153c50 secure :-1 s=READY pgs=840 cs=0 l=1 rx=0x7f57940032b0 tx=0x7f57940081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:24.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.131+0000 7f57a243d700 1 --2- 172.21.15.38:0/2638882917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f579c142e90 0x7f579c153c50 secure :-1 s=THROTTLE_DONE pgs=840 cs=0 l=1 rx=0x7f57940032b0 tx=0x7f57940081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:24.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.131+0000 7f57a243d700 1 --2- 172.21.15.38:0/2638882917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f579c142e90 0x7f579c153c50 secure :-1 s=THROTTLE_DONE pgs=840 cs=0 l=1 rx=0x7f57940032b0 tx=0x7f57940081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:24.151 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.131+0000 7f578affd700 1 -- 172.21.15.38:0/2638882917 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5794005c30 con 0x7f579c142e90 2020-06-12T17:51:24.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.131+0000 7f57a243d700 1 --2- 172.21.15.38:0/2638882917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f579c142e90 0x7f579c153c50 secure :-1 s=THROTTLE_DONE pgs=840 cs=0 l=1 rx=0x7f57940032b0 tx=0x7f57940081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:24.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.131+0000 7f578affd700 1 -- 172.21.15.38:0/2638882917 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5794005d90 con 0x7f579c142e90 2020-06-12T17:51:24.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.131+0000 7f578affd700 1 -- 172.21.15.38:0/2638882917 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5794007340 con 0x7f579c142e90 2020-06-12T17:51:24.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.131+0000 7f57a3ea0700 1 -- 172.21.15.38:0/2638882917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f579c146670 con 0x7f579c142e90 2020-06-12T17:51:24.152 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.131+0000 7f57a3ea0700 1 -- 172.21.15.38:0/2638882917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579c1444b0 con 0x7f579c142e90 2020-06-12T17:51:24.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.132+0000 7f57a243d700 1 --2- 172.21.15.38:0/2638882917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f579c142e90 0x7f579c153c50 secure :-1 s=THROTTLE_DONE pgs=840 cs=0 l=1 rx=0x7f57940032b0 tx=0x7f57940081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:24.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.132+0000 7f57a3ea0700 1 -- 172.21.15.38:0/2638882917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579c056c30 con 0x7f579c142e90 2020-06-12T17:51:24.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.132+0000 7f578affd700 1 -- 172.21.15.38:0/2638882917 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f57940074a0 con 0x7f579c142e90 2020-06-12T17:51:24.153 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.132+0000 7f57a243d700 1 --2- 172.21.15.38:0/2638882917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f579c142e90 0x7f579c153c50 secure :-1 s=THROTTLE_DONE pgs=840 cs=0 l=1 rx=0x7f57940032b0 tx=0x7f57940081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:24.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.133+0000 7f578affd700 1 --2- 172.21.15.38:0/2638882917 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f577c04d630 0x7f577c04faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:24.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.133+0000 7f578affd700 1 -- 172.21.15.38:0/2638882917 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5794061b20 con 0x7f579c142e90 2020-06-12T17:51:24.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.133+0000 7f57a1c3c700 1 --2- 172.21.15.38:0/2638882917 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f577c04d630 0x7f577c04faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:24.154 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.133+0000 7f57a1c3c700 1 --2- 172.21.15.38:0/2638882917 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f577c04d630 0x7f577c04faf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f578c002f30 tx=0x7f578c007c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:24.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.133+0000 7f57a1c3c700 1 --2- 172.21.15.38:0/2638882917 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f577c04d630 0x7f577c04faf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f578c002f30 tx=0x7f578c007c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:24.155 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.133+0000 7f57a1c3c700 1 --2- 172.21.15.38:0/2638882917 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f577c04d630 0x7f577c04faf0 secure :-1 s=READY pgs=327 cs=0 l=1 rx=0x7f578c002f30 tx=0x7f578c007c30).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:24.156 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.136+0000 7f57a243d700 1 --2- 172.21.15.38:0/2638882917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f579c142e90 0x7f579c153c50 secure :-1 s=THROTTLE_DONE pgs=840 cs=0 l=1 rx=0x7f57940032b0 tx=0x7f57940081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:24.156 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.136+0000 7f578affd700 1 -- 172.21.15.38:0/2638882917 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f579403d360 con 0x7f579c142e90 2020-06-12T17:51:24.340 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.337+0000 7f57a3ea0700 1 -- 172.21.15.38:0/2638882917 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_2856", "target": ["mon-mgr", ""]}) v1 -- 0x7f579c146800 con 0x7f577c04d630 2020-06-12T17:51:24.343 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.340+0000 7f57a1c3c700 1 --2- 172.21.15.38:0/2638882917 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f577c04d630 0x7f577c04faf0 secure :-1 s=THROTTLE_DONE pgs=327 cs=0 l=1 rx=0x7f578c002f30 tx=0x7f578c007c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:24.344 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.340+0000 7f578affd700 1 -- 172.21.15.38:0/2638882917 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f579c146800 con 0x7f577c04d630 2020-06-12T17:51:24.344 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_2856/e217ed19-e07d-43bb-878b-27c0d7c92996 2020-06-12T17:51:24.345 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.342+0000 7f57a3ea0700 1 -- 172.21.15.38:0/2638882917 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f577c04d630 msgr2=0x7f577c04faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:24.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.342+0000 7f57a3ea0700 1 --2- 172.21.15.38:0/2638882917 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f577c04d630 0x7f577c04faf0 secure :-1 s=READY pgs=327 cs=0 l=1 rx=0x7f578c002f30 tx=0x7f578c007c30).stop 2020-06-12T17:51:24.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.342+0000 7f57a3ea0700 1 -- 172.21.15.38:0/2638882917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f579c142e90 msgr2=0x7f579c153c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:24.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.342+0000 7f57a3ea0700 1 --2- 172.21.15.38:0/2638882917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f579c142e90 0x7f579c153c50 secure :-1 s=READY pgs=840 cs=0 l=1 rx=0x7f57940032b0 tx=0x7f57940081e0).stop 2020-06-12T17:51:24.346 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.342+0000 7f57a3ea0700 1 -- 172.21.15.38:0/2638882917 shutdown_connections 2020-06-12T17:51:24.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.342+0000 7f57a3ea0700 1 --2- 172.21.15.38:0/2638882917 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f577c04d630 0x7f577c04faf0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:24.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.342+0000 7f57a3ea0700 1 --2- 172.21.15.38:0/2638882917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f579c142e90 0x7f579c153c50 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:24.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.342+0000 7f57a3ea0700 1 --2- 172.21.15.38:0/2638882917 >> v2:172.21.15.150:3300/0 conn(0x7f579c0b3ac0 0x7f579c13f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:24.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.342+0000 7f57a3ea0700 1 --2- 172.21.15.38:0/2638882917 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f579c13c3a0 0x7f579c146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:24.347 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.342+0000 7f57a3ea0700 1 -- 172.21.15.38:0/2638882917 >> 172.21.15.38:0/2638882917 conn(0x7f579c0b5a20 msgr2=0x7f579c05b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:24.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.342+0000 7f57a3ea0700 1 -- 172.21.15.38:0/2638882917 shutdown_connections 2020-06-12T17:51:24.348 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:24.342+0000 7f57a3ea0700 1 -- 172.21.15.38:0/2638882917 wait complete. 2020-06-12T17:51:24.355 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_2856 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_2856/e217ed19-e07d-43bb-878b-27c0d7c92996 2020-06-12T17:51:24.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:24.356 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:24.357 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:24.372 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:24.373 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:24.373 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2856/e217ed19-e07d-43bb-878b-27c0d7c92996/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:24.465 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:24.466 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:24.466 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012986 s, 80.7 MB/s 2020-06-12T17:51:24.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:24.468 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:24.468 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:24.484 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:24.484 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:24.485 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2856/e217ed19-e07d-43bb-878b-27c0d7c92996/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:24.573 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:24.573 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:24.573 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113664 s, 92.3 MB/s 2020-06-12T17:51:24.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:24.575 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:24.576 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:24.590 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:24.591 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:24.592 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2856/e217ed19-e07d-43bb-878b-27c0d7c92996/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:24.678 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:24.679 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:24.679 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109198 s, 96.0 MB/s 2020-06-12T17:51:24.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:24.681 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:24.681 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:24.696 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:24.697 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:24.697 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2856/e217ed19-e07d-43bb-878b-27c0d7c92996/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:24.785 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:24.785 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:24.785 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114071 s, 91.9 MB/s 2020-06-12T17:51:24.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:24.787 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:24.787 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:24.802 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:24.803 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:24.804 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2856/e217ed19-e07d-43bb-878b-27c0d7c92996/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:24.891 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:24.892 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:24.892 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113543 s, 92.4 MB/s 2020-06-12T17:51:24.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:24.894 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:24.894 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:24.909 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:24.910 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:24.911 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2856/e217ed19-e07d-43bb-878b-27c0d7c92996/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:25.001 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:25.001 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:25.001 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107165 s, 97.8 MB/s 2020-06-12T17:51:25.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:25.003 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:25.003 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:25.018 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:25.019 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:25.019 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2856/e217ed19-e07d-43bb-878b-27c0d7c92996/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:25.105 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:25.106 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:25.106 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103181 s, 102 MB/s 2020-06-12T17:51:25.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:25.107 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:25.108 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:25.123 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:25.123 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:25.124 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2856/e217ed19-e07d-43bb-878b-27c0d7c92996/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:25.210 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:25.211 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:25.211 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104305 s, 101 MB/s 2020-06-12T17:51:25.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:25.212 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:25.213 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:25.232 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:25.232 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:25.233 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2856/e217ed19-e07d-43bb-878b-27c0d7c92996/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:25.318 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:25.319 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:25.319 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00964091 s, 109 MB/s 2020-06-12T17:51:25.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:25.321 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:25.321 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:25.340 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:25.340 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:25.341 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_2856/e217ed19-e07d-43bb-878b-27c0d7c92996/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:25.428 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:25.429 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:25.429 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011768 s, 89.1 MB/s 2020-06-12T17:51:25.430 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_4646 2020-06-12T17:51:25.547 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.544+0000 7f3437a8c700 1 Processor -- start 2020-06-12T17:51:25.548 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.544+0000 7f3437a8c700 1 -- start start 2020-06-12T17:51:25.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3437a8c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34300b3ac0 0x7f343009df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:25.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3437a8c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3430142e90 0x7f343013bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:25.552 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3437a8c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f343013c3a0 0x7f3430066790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:25.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3437a8c700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f343009b960 con 0x7f343013c3a0 2020-06-12T17:51:25.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3437a8c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f343009bc00 con 0x7f3430142e90 2020-06-12T17:51:25.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3437a8c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34300b48f0 con 0x7f34300b3ac0 2020-06-12T17:51:25.553 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3436029700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f343013c3a0 0x7f3430066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:25.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3436029700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f343013c3a0 0x7f3430066790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39770/0 (socket says 172.21.15.38:39770) 2020-06-12T17:51:25.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3436029700 1 -- 172.21.15.38:0/464495003 learned_addr learned my addr 172.21.15.38:0/464495003 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:25.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3435027700 1 --2- 172.21.15.38:0/464495003 >> v2:172.21.15.150:3300/0 conn(0x7f3430142e90 0x7f343013bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:25.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3435828700 1 --2- 172.21.15.38:0/464495003 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34300b3ac0 0x7f343009df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:25.554 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3436029700 1 -- 172.21.15.38:0/464495003 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34300b3ac0 msgr2=0x7f343009df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:25.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3436029700 1 --2- 172.21.15.38:0/464495003 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34300b3ac0 0x7f343009df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:25.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3436029700 1 -- 172.21.15.38:0/464495003 >> v2:172.21.15.150:3300/0 conn(0x7f3430142e90 msgr2=0x7f343013bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:25.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3436029700 1 --2- 172.21.15.38:0/464495003 >> v2:172.21.15.150:3300/0 conn(0x7f3430142e90 0x7f343013bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:25.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3436029700 1 -- 172.21.15.38:0/464495003 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34300b3ea0 con 0x7f343013c3a0 2020-06-12T17:51:25.555 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3435828700 1 --2- 172.21.15.38:0/464495003 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34300b3ac0 0x7f343009df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:51:25.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3435027700 1 --2- 172.21.15.38:0/464495003 >> v2:172.21.15.150:3300/0 conn(0x7f3430142e90 0x7f343013bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:51:25.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3436029700 1 --2- 172.21.15.38:0/464495003 >> v2:172.21.15.38:3300/0 conn(0x7f343013c3a0 0x7f3430066790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f342c002f30 tx=0x7f342c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3436029700 1 --2- 172.21.15.38:0/464495003 >> v2:172.21.15.38:3300/0 conn(0x7f343013c3a0 0x7f3430066790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f342c002f30 tx=0x7f342c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3436029700 1 --2- 172.21.15.38:0/464495003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343013c3a0 0x7f3430066790 secure :-1 s=READY pgs=841 cs=0 l=1 rx=0x7f342c002f30 tx=0x7f342c007e60).ready entity=mon.0 client_cookie=d4d510510cf39537 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:25.556 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3436029700 1 --2- 172.21.15.38:0/464495003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343013c3a0 0x7f3430066790 secure :-1 s=THROTTLE_DONE pgs=841 cs=0 l=1 rx=0x7f342c002f30 tx=0x7f342c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3434826700 1 -- 172.21.15.38:0/464495003 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f342c0116e0 con 0x7f343013c3a0 2020-06-12T17:51:25.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3436029700 1 --2- 172.21.15.38:0/464495003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343013c3a0 0x7f3430066790 secure :-1 s=THROTTLE_DONE pgs=841 cs=0 l=1 rx=0x7f342c002f30 tx=0x7f342c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3436029700 1 --2- 172.21.15.38:0/464495003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343013c3a0 0x7f3430066790 secure :-1 s=THROTTLE_DONE pgs=841 cs=0 l=1 rx=0x7f342c002f30 tx=0x7f342c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3434826700 1 -- 172.21.15.38:0/464495003 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342c011840 con 0x7f343013c3a0 2020-06-12T17:51:25.557 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3434826700 1 -- 172.21.15.38:0/464495003 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f342c011c60 con 0x7f343013c3a0 2020-06-12T17:51:25.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3437a8c700 1 -- 172.21.15.38:0/464495003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343013c3a0 msgr2=0x7f3430066790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:25.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.545+0000 7f3437a8c700 1 --2- 172.21.15.38:0/464495003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343013c3a0 0x7f3430066790 secure :-1 s=READY pgs=841 cs=0 l=1 rx=0x7f342c002f30 tx=0x7f342c007e60).stop 2020-06-12T17:51:25.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.546+0000 7f3437a8c700 1 -- 172.21.15.38:0/464495003 shutdown_connections 2020-06-12T17:51:25.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.546+0000 7f3437a8c700 1 --2- 172.21.15.38:0/464495003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343013c3a0 0x7f3430066790 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:25.558 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.546+0000 7f3437a8c700 1 --2- 172.21.15.38:0/464495003 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34300b3ac0 0x7f343009df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:25.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.546+0000 7f3437a8c700 1 --2- 172.21.15.38:0/464495003 >> v2:172.21.15.150:3300/0 conn(0x7f3430142e90 0x7f343013bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:25.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.546+0000 7f3437a8c700 1 -- 172.21.15.38:0/464495003 >> 172.21.15.38:0/464495003 conn(0x7f34300b5a20 msgr2=0x7f343005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:25.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.546+0000 7f3437a8c700 1 -- 172.21.15.38:0/464495003 shutdown_connections 2020-06-12T17:51:25.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.546+0000 7f3437a8c700 1 -- 172.21.15.38:0/464495003 wait complete. 2020-06-12T17:51:25.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.547+0000 7f3437a8c700 1 Processor -- start 2020-06-12T17:51:25.559 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.547+0000 7f3437a8c700 1 -- start start 2020-06-12T17:51:25.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.548+0000 7f3437a8c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f343013c3a0 0x7f34300b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:25.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.548+0000 7f3437a8c700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34300b1610 con 0x7f34300b3ac0 2020-06-12T17:51:25.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.548+0000 7f3437a8c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34300b07c0 con 0x7f3430142e90 2020-06-12T17:51:25.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.548+0000 7f3437a8c700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34300b0a60 con 0x7f343013c3a0 2020-06-12T17:51:25.560 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.548+0000 7f3435828700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f34300b3ac0 0x7f34300b0f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41592/0 (socket says 172.21.15.38:41592) 2020-06-12T17:51:25.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.548+0000 7f3435828700 1 -- 172.21.15.38:0/3434578041 learned_addr learned my addr 172.21.15.38:0/3434578041 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:25.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.548+0000 7f3435027700 1 --2- 172.21.15.38:0/3434578041 >> v2:172.21.15.38:3300/0 conn(0x7f343013c3a0 0x7f34300b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:25.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.548+0000 7f3435027700 1 -- 172.21.15.38:0/3434578041 >> v1:172.21.15.150:6789/0 conn(0x7f3430142e90 legacy=0x7f343009c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:25.561 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.548+0000 7f3435027700 1 -- 172.21.15.38:0/3434578041 >> v1:172.21.15.38:6789/0 conn(0x7f34300b3ac0 legacy=0x7f34300b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:25.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.548+0000 7f3435027700 1 -- 172.21.15.38:0/3434578041 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343009c760 con 0x7f343013c3a0 2020-06-12T17:51:25.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.548+0000 7f341effd700 1 -- 172.21.15.38:0/3434578041 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942647552 0 0) 0x7f34300b1610 con 0x7f34300b3ac0 2020-06-12T17:51:25.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.548+0000 7f3435027700 1 --2- 172.21.15.38:0/3434578041 >> v2:172.21.15.38:3300/0 conn(0x7f343013c3a0 0x7f34300b19a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3420002f30 tx=0x7f342000e030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.548+0000 7f3435027700 1 --2- 172.21.15.38:0/3434578041 >> v2:172.21.15.38:3300/0 conn(0x7f343013c3a0 0x7f34300b19a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3420002f30 tx=0x7f342000e030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.562 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.548+0000 7f3435027700 1 --2- 172.21.15.38:0/3434578041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343013c3a0 0x7f34300b19a0 secure :-1 s=READY pgs=843 cs=0 l=1 rx=0x7f3420002f30 tx=0x7f342000e030).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:25.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.548+0000 7f3435027700 1 --2- 172.21.15.38:0/3434578041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343013c3a0 0x7f34300b19a0 secure :-1 s=THROTTLE_DONE pgs=843 cs=0 l=1 rx=0x7f3420002f30 tx=0x7f342000e030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.548+0000 7f341effd700 1 -- 172.21.15.38:0/3434578041 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3420007540 con 0x7f343013c3a0 2020-06-12T17:51:25.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.548+0000 7f3435027700 1 --2- 172.21.15.38:0/3434578041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343013c3a0 0x7f34300b19a0 secure :-1 s=THROTTLE_DONE pgs=843 cs=0 l=1 rx=0x7f3420002f30 tx=0x7f342000e030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.548+0000 7f3437a8c700 1 -- 172.21.15.38:0/3434578041 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3430151b10 con 0x7f343013c3a0 2020-06-12T17:51:25.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.548+0000 7f341effd700 1 -- 172.21.15.38:0/3434578041 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3420013060 con 0x7f343013c3a0 2020-06-12T17:51:25.563 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.548+0000 7f3435027700 1 --2- 172.21.15.38:0/3434578041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343013c3a0 0x7f34300b19a0 secure :-1 s=THROTTLE_DONE pgs=843 cs=0 l=1 rx=0x7f3420002f30 tx=0x7f342000e030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.548+0000 7f341effd700 1 -- 172.21.15.38:0/3434578041 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3420005bb0 con 0x7f343013c3a0 2020-06-12T17:51:25.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.548+0000 7f3437a8c700 1 -- 172.21.15.38:0/3434578041 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3430150a50 con 0x7f343013c3a0 2020-06-12T17:51:25.564 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.549+0000 7f3435027700 1 --2- 172.21.15.38:0/3434578041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343013c3a0 0x7f34300b19a0 secure :-1 s=THROTTLE_DONE pgs=843 cs=0 l=1 rx=0x7f3420002f30 tx=0x7f342000e030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.549+0000 7f341effd700 1 -- 172.21.15.38:0/3434578041 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f342000e170 con 0x7f343013c3a0 2020-06-12T17:51:25.567 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.549+0000 7f3435027700 1 --2- 172.21.15.38:0/3434578041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343013c3a0 0x7f34300b19a0 secure :-1 s=THROTTLE_DONE pgs=843 cs=0 l=1 rx=0x7f3420002f30 tx=0x7f342000e030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.549+0000 7f3437a8c700 1 -- 172.21.15.38:0/3434578041 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34300b0600 con 0x7f343013c3a0 2020-06-12T17:51:25.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.550+0000 7f341effd700 1 --2- 172.21.15.38:0/3434578041 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f341004d3e0 0x7f341004f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:25.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.550+0000 7f341effd700 1 -- 172.21.15.38:0/3434578041 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3420007e40 con 0x7f343013c3a0 2020-06-12T17:51:25.568 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.550+0000 7f3435828700 1 --2- 172.21.15.38:0/3434578041 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f341004d3e0 0x7f341004f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:25.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.550+0000 7f3435828700 1 --2- 172.21.15.38:0/3434578041 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f341004d3e0 0x7f341004f8a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3428007dc0 tx=0x7f3428002450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.550+0000 7f3435828700 1 --2- 172.21.15.38:0/3434578041 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f341004d3e0 0x7f341004f8a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3428007dc0 tx=0x7f3428002450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.550+0000 7f3435828700 1 --2- 172.21.15.38:0/3434578041 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f341004d3e0 0x7f341004f8a0 secure :-1 s=READY pgs=328 cs=0 l=1 rx=0x7f3428007dc0 tx=0x7f3428002450).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:25.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.553+0000 7f3435027700 1 --2- 172.21.15.38:0/3434578041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343013c3a0 0x7f34300b19a0 secure :-1 s=THROTTLE_DONE pgs=843 cs=0 l=1 rx=0x7f3420002f30 tx=0x7f342000e030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.569 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.553+0000 7f341effd700 1 -- 172.21.15.38:0/3434578041 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f342003c3a0 con 0x7f343013c3a0 2020-06-12T17:51:25.751 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.748+0000 7f3437a8c700 1 -- 172.21.15.38:0/3434578041 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_4646", "target": ["mon-mgr", ""]}) v1 -- 0x7f3430056c30 con 0x7f341004d3e0 2020-06-12T17:51:25.769 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.766+0000 7f3435828700 1 --2- 172.21.15.38:0/3434578041 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f341004d3e0 0x7f341004f8a0 secure :-1 s=THROTTLE_DONE pgs=328 cs=0 l=1 rx=0x7f3428007dc0 tx=0x7f3428002450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.770 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.766+0000 7f341effd700 1 -- 172.21.15.38:0/3434578041 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3430056c30 con 0x7f341004d3e0 2020-06-12T17:51:25.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.768+0000 7f3437a8c700 1 -- 172.21.15.38:0/3434578041 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f341004d3e0 msgr2=0x7f341004f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:25.771 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.768+0000 7f3437a8c700 1 --2- 172.21.15.38:0/3434578041 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f341004d3e0 0x7f341004f8a0 secure :-1 s=READY pgs=328 cs=0 l=1 rx=0x7f3428007dc0 tx=0x7f3428002450).stop 2020-06-12T17:51:25.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.768+0000 7f3437a8c700 1 -- 172.21.15.38:0/3434578041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343013c3a0 msgr2=0x7f34300b19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:25.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.768+0000 7f3437a8c700 1 --2- 172.21.15.38:0/3434578041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343013c3a0 0x7f34300b19a0 secure :-1 s=READY pgs=843 cs=0 l=1 rx=0x7f3420002f30 tx=0x7f342000e030).stop 2020-06-12T17:51:25.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.768+0000 7f3437a8c700 1 -- 172.21.15.38:0/3434578041 shutdown_connections 2020-06-12T17:51:25.772 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.768+0000 7f3437a8c700 1 --2- 172.21.15.38:0/3434578041 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f341004d3e0 0x7f341004f8a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:25.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.768+0000 7f3437a8c700 1 --2- 172.21.15.38:0/3434578041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343013c3a0 0x7f34300b19a0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:25.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.768+0000 7f3437a8c700 1 -- 172.21.15.38:0/3434578041 >> 172.21.15.38:0/3434578041 conn(0x7f34300b5a20 msgr2=0x7f3430066b30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:25.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.768+0000 7f3437a8c700 1 -- 172.21.15.38:0/3434578041 shutdown_connections 2020-06-12T17:51:25.773 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.768+0000 7f3437a8c700 1 -- 172.21.15.38:0/3434578041 wait complete. 2020-06-12T17:51:25.781 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_4646 2020-06-12T17:51:25.898 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.895+0000 7f39abb66700 1 Processor -- start 2020-06-12T17:51:25.899 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.895+0000 7f39abb66700 1 -- start start 2020-06-12T17:51:25.901 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.895+0000 7f39abb66700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f39a40b3ac0 0x7f39a409df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:25.902 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.895+0000 7f39abb66700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39a413c650 0x7f39a4066790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:25.902 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.895+0000 7f39abb66700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a409b960 con 0x7f39a4142e90 2020-06-12T17:51:25.902 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.895+0000 7f39abb66700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a409bc00 con 0x7f39a40b3ac0 2020-06-12T17:51:25.902 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.895+0000 7f39abb66700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a40b48f0 con 0x7f39a413c650 2020-06-12T17:51:25.903 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.896+0000 7f39a9902700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f39a40b3ac0 0x7f39a409df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:25.903 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.896+0000 7f39a9902700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f39a40b3ac0 0x7f39a409df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39784/0 (socket says 172.21.15.38:39784) 2020-06-12T17:51:25.903 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.896+0000 7f39a9902700 1 -- 172.21.15.38:0/305530827 learned_addr learned my addr 172.21.15.38:0/305530827 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:25.903 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.896+0000 7f39aa103700 1 --2- 172.21.15.38:0/305530827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39a413c650 0x7f39a4066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:25.903 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.896+0000 7f39a9902700 1 -- 172.21.15.38:0/305530827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39a413c650 msgr2=0x7f39a4066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:25.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.896+0000 7f39a9902700 1 --2- 172.21.15.38:0/305530827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39a413c650 0x7f39a4066790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:25.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.896+0000 7f39a9902700 1 -- 172.21.15.38:0/305530827 >> v1:172.21.15.150:6789/0 conn(0x7f39a4142e90 legacy=0x7f39a413bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:25.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.896+0000 7f39a9902700 1 -- 172.21.15.38:0/305530827 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a40b3ea0 con 0x7f39a40b3ac0 2020-06-12T17:51:25.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.896+0000 7f39a9902700 1 --2- 172.21.15.38:0/305530827 >> v2:172.21.15.38:3300/0 conn(0x7f39a40b3ac0 0x7f39a409df00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3994002f30 tx=0x7f3994007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.904 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.896+0000 7f39a9902700 1 --2- 172.21.15.38:0/305530827 >> v2:172.21.15.38:3300/0 conn(0x7f39a40b3ac0 0x7f39a409df00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3994002f30 tx=0x7f3994007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.896+0000 7f39a9902700 1 --2- 172.21.15.38:0/305530827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39a40b3ac0 0x7f39a409df00 secure :-1 s=READY pgs=844 cs=0 l=1 rx=0x7f3994002f30 tx=0x7f3994007e60).ready entity=mon.0 client_cookie=1dd049083394d631 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:25.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.896+0000 7f39a9902700 1 --2- 172.21.15.38:0/305530827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39a40b3ac0 0x7f39a409df00 secure :-1 s=THROTTLE_DONE pgs=844 cs=0 l=1 rx=0x7f3994002f30 tx=0x7f3994007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.896+0000 7f39a8900700 1 -- 172.21.15.38:0/305530827 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39940116e0 con 0x7f39a40b3ac0 2020-06-12T17:51:25.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.896+0000 7f39a9902700 1 --2- 172.21.15.38:0/305530827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39a40b3ac0 0x7f39a409df00 secure :-1 s=THROTTLE_DONE pgs=844 cs=0 l=1 rx=0x7f3994002f30 tx=0x7f3994007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.905 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.896+0000 7f39a8900700 1 -- 172.21.15.38:0/305530827 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3994011840 con 0x7f39a40b3ac0 2020-06-12T17:51:25.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.896+0000 7f39a9902700 1 --2- 172.21.15.38:0/305530827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39a40b3ac0 0x7f39a409df00 secure :-1 s=THROTTLE_DONE pgs=844 cs=0 l=1 rx=0x7f3994002f30 tx=0x7f3994007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.896+0000 7f39abb66700 1 -- 172.21.15.38:0/305530827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39a40b3ac0 msgr2=0x7f39a409df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:25.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.896+0000 7f39a8900700 1 -- 172.21.15.38:0/305530827 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3994011c60 con 0x7f39a40b3ac0 2020-06-12T17:51:25.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.896+0000 7f39abb66700 1 --2- 172.21.15.38:0/305530827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39a40b3ac0 0x7f39a409df00 secure :-1 s=READY pgs=844 cs=0 l=1 rx=0x7f3994002f30 tx=0x7f3994007e60).stop 2020-06-12T17:51:25.906 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.897+0000 7f39abb66700 1 -- 172.21.15.38:0/305530827 shutdown_connections 2020-06-12T17:51:25.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.897+0000 7f39abb66700 1 --2- 172.21.15.38:0/305530827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39a413c650 0x7f39a4066790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:25.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.897+0000 7f39abb66700 1 --2- 172.21.15.38:0/305530827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39a40b3ac0 0x7f39a409df00 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:25.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.897+0000 7f39abb66700 1 -- 172.21.15.38:0/305530827 >> 172.21.15.38:0/305530827 conn(0x7f39a40b5a20 msgr2=0x7f39a405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:25.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.897+0000 7f39abb66700 1 -- 172.21.15.38:0/305530827 shutdown_connections 2020-06-12T17:51:25.907 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.897+0000 7f39abb66700 1 -- 172.21.15.38:0/305530827 wait complete. 2020-06-12T17:51:25.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.898+0000 7f39abb66700 1 Processor -- start 2020-06-12T17:51:25.908 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.898+0000 7f39abb66700 1 -- start start 2020-06-12T17:51:25.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.898+0000 7f39abb66700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39a4142e90 0x7f39a4061c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:25.911 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.898+0000 7f39abb66700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a4062210 con 0x7f39a40b3ac0 2020-06-12T17:51:25.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.899+0000 7f39abb66700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a4154010 con 0x7f39a413c650 2020-06-12T17:51:25.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.899+0000 7f39abb66700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a4153e30 con 0x7f39a4142e90 2020-06-12T17:51:25.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.899+0000 7f39a9902700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f39a40b3ac0 0x7f39a4061510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41606/0 (socket says 172.21.15.38:41606) 2020-06-12T17:51:25.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.899+0000 7f39a9902700 1 -- 172.21.15.38:0/2524156699 learned_addr learned my addr 172.21.15.38:0/2524156699 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:25.912 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.899+0000 7f39aa103700 1 --2- 172.21.15.38:0/2524156699 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39a4142e90 0x7f39a4061c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:25.913 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.899+0000 7f3992ffd700 1 -- 172.21.15.38:0/2524156699 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879574239 0 0) 0x7f39a4062210 con 0x7f39a40b3ac0 2020-06-12T17:51:25.913 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.899+0000 7f3992ffd700 1 -- 172.21.15.38:0/2524156699 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3984002fe0 con 0x7f39a40b3ac0 2020-06-12T17:51:25.913 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.899+0000 7f3992ffd700 1 -- 172.21.15.38:0/2524156699 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213625616 0 0) 0x7f39a4154010 con 0x7f39a413c650 2020-06-12T17:51:25.913 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.899+0000 7f3992ffd700 1 -- 172.21.15.38:0/2524156699 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39a4062210 con 0x7f39a413c650 2020-06-12T17:51:25.913 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.899+0000 7f3992ffd700 1 -- 172.21.15.38:0/2524156699 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 196423039 0 0) 0x7f3984002fe0 con 0x7f39a40b3ac0 2020-06-12T17:51:25.914 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.899+0000 7f39aa103700 1 -- 172.21.15.38:0/2524156699 >> v1:172.21.15.150:6789/0 conn(0x7f39a413c650 legacy=0x7f39a41435b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:25.914 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.899+0000 7f39aa103700 1 -- 172.21.15.38:0/2524156699 >> v1:172.21.15.38:6789/0 conn(0x7f39a40b3ac0 legacy=0x7f39a4061510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:25.914 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.899+0000 7f39aa103700 1 -- 172.21.15.38:0/2524156699 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a41542b0 con 0x7f39a4142e90 2020-06-12T17:51:25.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.899+0000 7f39aa103700 1 --2- 172.21.15.38:0/2524156699 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39a4142e90 0x7f39a4061c20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3994008760 tx=0x7f399c00e3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.899+0000 7f39aa103700 1 --2- 172.21.15.38:0/2524156699 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39a4142e90 0x7f39a4061c20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3994008760 tx=0x7f399c00e3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.899+0000 7f39aa103700 1 --2- 172.21.15.38:0/2524156699 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39a4142e90 0x7f39a4061c20 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f3994008760 tx=0x7f399c00e3a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:25.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.899+0000 7f39aa103700 1 --2- 172.21.15.38:0/2524156699 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39a4142e90 0x7f39a4061c20 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f3994008760 tx=0x7f399c00e3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.915 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.899+0000 7f3992ffd700 1 -- 172.21.15.38:0/2524156699 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39940085c0 con 0x7f39a4142e90 2020-06-12T17:51:25.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.899+0000 7f39aa103700 1 --2- 172.21.15.38:0/2524156699 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39a4142e90 0x7f39a4061c20 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f3994008760 tx=0x7f399c00e3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.899+0000 7f39abb66700 1 -- 172.21.15.38:0/2524156699 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a40627c0 con 0x7f39a4142e90 2020-06-12T17:51:25.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.899+0000 7f3992ffd700 1 -- 172.21.15.38:0/2524156699 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399c005e30 con 0x7f39a4142e90 2020-06-12T17:51:25.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.899+0000 7f39aa103700 1 --2- 172.21.15.38:0/2524156699 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39a4142e90 0x7f39a4061c20 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f3994008760 tx=0x7f399c00e3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.916 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.899+0000 7f3992ffd700 1 -- 172.21.15.38:0/2524156699 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f399c007540 con 0x7f39a4142e90 2020-06-12T17:51:25.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.900+0000 7f39abb66700 1 -- 172.21.15.38:0/2524156699 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a4144dc0 con 0x7f39a4142e90 2020-06-12T17:51:25.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.900+0000 7f39aa103700 1 --2- 172.21.15.38:0/2524156699 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39a4142e90 0x7f39a4061c20 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f3994008760 tx=0x7f399c00e3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.901+0000 7f39abb66700 1 -- 172.21.15.38:0/2524156699 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a41433f0 con 0x7f39a4142e90 2020-06-12T17:51:25.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.901+0000 7f3992ffd700 1 -- 172.21.15.38:0/2524156699 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f399c007740 con 0x7f39a4142e90 2020-06-12T17:51:25.917 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.901+0000 7f39aa103700 1 --2- 172.21.15.38:0/2524156699 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39a4142e90 0x7f39a4061c20 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f3994008760 tx=0x7f399c00e3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.901+0000 7f3992ffd700 1 --2- 172.21.15.38:0/2524156699 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f398404d9b0 0x7f398404fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:25.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.901+0000 7f3992ffd700 1 -- 172.21.15.38:0/2524156699 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f399c060bb0 con 0x7f39a4142e90 2020-06-12T17:51:25.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.901+0000 7f39a9902700 1 --2- 172.21.15.38:0/2524156699 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f398404d9b0 0x7f398404fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:25.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.901+0000 7f39a9902700 1 --2- 172.21.15.38:0/2524156699 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f398404d9b0 0x7f398404fe70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3994008720 tx=0x7f3994007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.918 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.902+0000 7f39a9902700 1 --2- 172.21.15.38:0/2524156699 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f398404d9b0 0x7f398404fe70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3994008720 tx=0x7f3994007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.902+0000 7f39a9902700 1 --2- 172.21.15.38:0/2524156699 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f398404d9b0 0x7f398404fe70 secure :-1 s=READY pgs=329 cs=0 l=1 rx=0x7f3994008720 tx=0x7f3994007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:25.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.905+0000 7f39aa103700 1 --2- 172.21.15.38:0/2524156699 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39a4142e90 0x7f39a4061c20 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f3994008760 tx=0x7f399c00e3a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:25.919 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:25.905+0000 7f3992ffd700 1 -- 172.21.15.38:0/2524156699 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f399c03c370 con 0x7f39a4142e90 2020-06-12T17:51:26.103 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:26.099+0000 7f39abb66700 1 -- 172.21.15.38:0/2524156699 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_4646", "target": ["mon-mgr", ""]}) v1 -- 0x7f39a40b40e0 con 0x7f398404d9b0 2020-06-12T17:51:26.106 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:26.103+0000 7f39a9902700 1 --2- 172.21.15.38:0/2524156699 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f398404d9b0 0x7f398404fe70 secure :-1 s=THROTTLE_DONE pgs=329 cs=0 l=1 rx=0x7f3994008720 tx=0x7f3994007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:26.106 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:26.103+0000 7f3992ffd700 1 -- 172.21.15.38:0/2524156699 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7f39a40b40e0 con 0x7f398404d9b0 2020-06-12T17:51:26.107 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_4646/37d00c2d-9281-4996-9905-8eb7146ebd01 2020-06-12T17:51:26.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:26.104+0000 7f39abb66700 1 -- 172.21.15.38:0/2524156699 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f398404d9b0 msgr2=0x7f398404fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:26.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:26.104+0000 7f39abb66700 1 --2- 172.21.15.38:0/2524156699 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f398404d9b0 0x7f398404fe70 secure :-1 s=READY pgs=329 cs=0 l=1 rx=0x7f3994008720 tx=0x7f3994007e60).stop 2020-06-12T17:51:26.108 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:26.104+0000 7f39abb66700 1 -- 172.21.15.38:0/2524156699 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39a4142e90 msgr2=0x7f39a4061c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:26.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:26.104+0000 7f39abb66700 1 --2- 172.21.15.38:0/2524156699 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39a4142e90 0x7f39a4061c20 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f3994008760 tx=0x7f399c00e3a0).stop 2020-06-12T17:51:26.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:26.104+0000 7f39abb66700 1 -- 172.21.15.38:0/2524156699 shutdown_connections 2020-06-12T17:51:26.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:26.104+0000 7f39abb66700 1 --2- 172.21.15.38:0/2524156699 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f398404d9b0 0x7f398404fe70 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:26.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:26.104+0000 7f39abb66700 1 --2- 172.21.15.38:0/2524156699 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39a4142e90 0x7f39a4061c20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:26.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:26.105+0000 7f39abb66700 1 -- 172.21.15.38:0/2524156699 >> 172.21.15.38:0/2524156699 conn(0x7f39a40b5a20 msgr2=0x7f39a40b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:26.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:26.105+0000 7f39abb66700 1 -- 172.21.15.38:0/2524156699 shutdown_connections 2020-06-12T17:51:26.110 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:26.105+0000 7f39abb66700 1 -- 172.21.15.38:0/2524156699 wait complete. 2020-06-12T17:51:26.118 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_4646 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_4646/37d00c2d-9281-4996-9905-8eb7146ebd01 2020-06-12T17:51:26.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:26.119 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:26.120 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:26.135 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:26.136 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:26.136 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4646/37d00c2d-9281-4996-9905-8eb7146ebd01/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:26.228 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:26.229 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:26.229 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134337 s, 78.1 MB/s 2020-06-12T17:51:26.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:26.230 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:26.231 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:26.247 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:26.248 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:26.248 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4646/37d00c2d-9281-4996-9905-8eb7146ebd01/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:26.339 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:26.340 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:26.340 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104986 s, 99.9 MB/s 2020-06-12T17:51:26.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:26.342 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:26.342 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:26.357 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:26.358 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:26.358 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4646/37d00c2d-9281-4996-9905-8eb7146ebd01/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:26.446 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:26.447 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:26.447 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125691 s, 83.4 MB/s 2020-06-12T17:51:26.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:26.448 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:26.449 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:26.463 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:26.464 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:26.465 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4646/37d00c2d-9281-4996-9905-8eb7146ebd01/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:26.552 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:26.553 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:26.553 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116244 s, 90.2 MB/s 2020-06-12T17:51:26.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:26.555 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:26.555 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:26.570 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:26.570 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:26.571 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4646/37d00c2d-9281-4996-9905-8eb7146ebd01/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:26.658 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:26.658 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:26.658 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111281 s, 94.2 MB/s 2020-06-12T17:51:26.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:26.660 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:26.660 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:26.676 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:26.676 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:26.677 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4646/37d00c2d-9281-4996-9905-8eb7146ebd01/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:26.764 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:26.765 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:26.765 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115439 s, 90.8 MB/s 2020-06-12T17:51:26.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:26.767 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:26.769 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:26.784 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:26.785 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:26.786 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4646/37d00c2d-9281-4996-9905-8eb7146ebd01/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:26.873 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:26.873 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:26.874 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111073 s, 94.4 MB/s 2020-06-12T17:51:26.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:26.875 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:26.876 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:26.891 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:26.891 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:26.892 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4646/37d00c2d-9281-4996-9905-8eb7146ebd01/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:26.982 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:26.983 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:26.983 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106129 s, 98.8 MB/s 2020-06-12T17:51:26.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:26.985 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:26.985 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:27.000 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:27.000 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:27.001 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4646/37d00c2d-9281-4996-9905-8eb7146ebd01/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:27.089 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:27.090 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:27.090 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126618 s, 82.8 MB/s 2020-06-12T17:51:27.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:27.091 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:27.092 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:27.106 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:27.107 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:27.108 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_4646/37d00c2d-9281-4996-9905-8eb7146ebd01/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:27.195 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:27.195 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:27.196 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110577 s, 94.8 MB/s 2020-06-12T17:51:27.197 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_5302 2020-06-12T17:51:27.314 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.311+0000 7f220ffab700 1 Processor -- start 2020-06-12T17:51:27.315 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.311+0000 7f220ffab700 1 -- start start 2020-06-12T17:51:27.318 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.312+0000 7f220ffab700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2208146680 0x7f22080ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:27.318 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.312+0000 7f220ffab700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f22080b2eb0 0x7f220809d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:27.318 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.312+0000 7f220ffab700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f220809d620 0x7f220809da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:27.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.312+0000 7f220ffab700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2208146d20 con 0x7f220809d620 2020-06-12T17:51:27.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.312+0000 7f220ffab700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2208066a80 con 0x7f22080b2eb0 2020-06-12T17:51:27.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.312+0000 7f220ffab700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2208146f50 con 0x7f2208146680 2020-06-12T17:51:27.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.312+0000 7f220e548700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f220809d620 0x7f220809da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:27.319 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.312+0000 7f220e548700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f220809d620 0x7f220809da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39802/0 (socket says 172.21.15.38:39802) 2020-06-12T17:51:27.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.312+0000 7f220e548700 1 -- 172.21.15.38:0/2535287279 learned_addr learned my addr 172.21.15.38:0/2535287279 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:27.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.312+0000 7f220d546700 1 --2- 172.21.15.38:0/2535287279 >> v2:172.21.15.150:3300/0 conn(0x7f22080b2eb0 0x7f220809d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:27.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.312+0000 7f220dd47700 1 --2- 172.21.15.38:0/2535287279 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2208146680 0x7f22080ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:27.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.312+0000 7f220e548700 1 -- 172.21.15.38:0/2535287279 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2208146680 msgr2=0x7f22080ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:27.320 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.312+0000 7f220e548700 1 --2- 172.21.15.38:0/2535287279 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2208146680 0x7f22080ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:27.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.312+0000 7f220e548700 1 -- 172.21.15.38:0/2535287279 >> v2:172.21.15.150:3300/0 conn(0x7f22080b2eb0 msgr2=0x7f220809d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:27.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.312+0000 7f220e548700 1 --2- 172.21.15.38:0/2535287279 >> v2:172.21.15.150:3300/0 conn(0x7f22080b2eb0 0x7f220809d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:27.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.312+0000 7f220e548700 1 -- 172.21.15.38:0/2535287279 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2208146a60 con 0x7f220809d620 2020-06-12T17:51:27.321 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.313+0000 7f220d546700 1 --2- 172.21.15.38:0/2535287279 >> v2:172.21.15.150:3300/0 conn(0x7f22080b2eb0 0x7f220809d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-06-12T17:51:27.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.313+0000 7f220e548700 1 --2- 172.21.15.38:0/2535287279 >> v2:172.21.15.38:3300/0 conn(0x7f220809d620 0x7f220809da90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f22000032b0 tx=0x7f22000081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.313+0000 7f220e548700 1 --2- 172.21.15.38:0/2535287279 >> v2:172.21.15.38:3300/0 conn(0x7f220809d620 0x7f220809da90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f22000032b0 tx=0x7f22000081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.313+0000 7f220e548700 1 --2- 172.21.15.38:0/2535287279 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f220809d620 0x7f220809da90 secure :-1 s=READY pgs=846 cs=0 l=1 rx=0x7f22000032b0 tx=0x7f22000081e0).ready entity=mon.0 client_cookie=d932c6ba446250b1 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:27.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.313+0000 7f220e548700 1 --2- 172.21.15.38:0/2535287279 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f220809d620 0x7f220809da90 secure :-1 s=THROTTLE_DONE pgs=846 cs=0 l=1 rx=0x7f22000032b0 tx=0x7f22000081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.322 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.313+0000 7f220cd45700 1 -- 172.21.15.38:0/2535287279 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f220000a160 con 0x7f220809d620 2020-06-12T17:51:27.323 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.313+0000 7f220e548700 1 --2- 172.21.15.38:0/2535287279 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f220809d620 0x7f220809da90 secure :-1 s=THROTTLE_DONE pgs=846 cs=0 l=1 rx=0x7f22000032b0 tx=0x7f22000081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.323 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.313+0000 7f220e548700 1 --2- 172.21.15.38:0/2535287279 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f220809d620 0x7f220809da90 secure :-1 s=THROTTLE_DONE pgs=846 cs=0 l=1 rx=0x7f22000032b0 tx=0x7f22000081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.323 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.313+0000 7f220cd45700 1 -- 172.21.15.38:0/2535287279 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220000a2c0 con 0x7f220809d620 2020-06-12T17:51:27.323 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.313+0000 7f220cd45700 1 -- 172.21.15.38:0/2535287279 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f220000a660 con 0x7f220809d620 2020-06-12T17:51:27.323 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.313+0000 7f220ffab700 1 -- 172.21.15.38:0/2535287279 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f220809d620 msgr2=0x7f220809da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:27.324 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.313+0000 7f220ffab700 1 --2- 172.21.15.38:0/2535287279 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f220809d620 0x7f220809da90 secure :-1 s=READY pgs=846 cs=0 l=1 rx=0x7f22000032b0 tx=0x7f22000081e0).stop 2020-06-12T17:51:27.324 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.313+0000 7f220ffab700 1 -- 172.21.15.38:0/2535287279 shutdown_connections 2020-06-12T17:51:27.325 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.313+0000 7f220ffab700 1 --2- 172.21.15.38:0/2535287279 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f220809d620 0x7f220809da90 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:27.325 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.313+0000 7f220ffab700 1 --2- 172.21.15.38:0/2535287279 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2208146680 0x7f22080ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:27.325 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.313+0000 7f220ffab700 1 --2- 172.21.15.38:0/2535287279 >> v2:172.21.15.150:3300/0 conn(0x7f22080b2eb0 0x7f220809d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:27.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.313+0000 7f220ffab700 1 -- 172.21.15.38:0/2535287279 >> 172.21.15.38:0/2535287279 conn(0x7f22080b5a20 msgr2=0x7f220805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:27.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.313+0000 7f220ffab700 1 -- 172.21.15.38:0/2535287279 shutdown_connections 2020-06-12T17:51:27.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.313+0000 7f220ffab700 1 -- 172.21.15.38:0/2535287279 wait complete. 2020-06-12T17:51:27.326 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.314+0000 7f220ffab700 1 Processor -- start 2020-06-12T17:51:27.327 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.314+0000 7f220ffab700 1 -- start start 2020-06-12T17:51:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.315+0000 7f220ffab700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f220809d620 0x7f2208061cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.315+0000 7f220ffab700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f22080b2eb0 0x7f2208064320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:27.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.315+0000 7f220ffab700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2208064780 con 0x7f2208146680 2020-06-12T17:51:27.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.315+0000 7f220ffab700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22080afcf0 con 0x7f22080b2eb0 2020-06-12T17:51:27.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.315+0000 7f220ffab700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22080aff90 con 0x7f220809d620 2020-06-12T17:51:27.332 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.315+0000 7f220d546700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f22080b2eb0 0x7f2208064320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.315+0000 7f220d546700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f22080b2eb0 0x7f2208064320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39806/0 (socket says 172.21.15.38:39806) 2020-06-12T17:51:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.315+0000 7f220d546700 1 -- 172.21.15.38:0/2086676080 learned_addr learned my addr 172.21.15.38:0/2086676080 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.315+0000 7f220dd47700 1 --2- 172.21.15.38:0/2086676080 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f220809d620 0x7f2208061cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.316+0000 7f220d546700 1 -- 172.21.15.38:0/2086676080 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f220809d620 msgr2=0x7f2208061cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.316+0000 7f220d546700 1 --2- 172.21.15.38:0/2086676080 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f220809d620 0x7f2208061cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.316+0000 7f220d546700 1 -- 172.21.15.38:0/2086676080 >> v1:172.21.15.150:6789/0 conn(0x7f2208146680 legacy=0x7f22080b1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.316+0000 7f220d546700 1 -- 172.21.15.38:0/2086676080 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22080afa50 con 0x7f22080b2eb0 2020-06-12T17:51:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.316+0000 7f220d546700 1 --2- 172.21.15.38:0/2086676080 >> v2:172.21.15.38:3300/0 conn(0x7f22080b2eb0 0x7f2208064320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2204002f30 tx=0x7f2204007f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.316+0000 7f220d546700 1 --2- 172.21.15.38:0/2086676080 >> v2:172.21.15.38:3300/0 conn(0x7f22080b2eb0 0x7f2208064320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2204002f30 tx=0x7f2204007f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.316+0000 7f220d546700 1 --2- 172.21.15.38:0/2086676080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22080b2eb0 0x7f2208064320 secure :-1 s=READY pgs=847 cs=0 l=1 rx=0x7f2204002f30 tx=0x7f2204007f80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:27.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.316+0000 7f220d546700 1 --2- 172.21.15.38:0/2086676080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22080b2eb0 0x7f2208064320 secure :-1 s=THROTTLE_DONE pgs=847 cs=0 l=1 rx=0x7f2204002f30 tx=0x7f2204007f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.316+0000 7f21f6ffd700 1 -- 172.21.15.38:0/2086676080 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2204007160 con 0x7f22080b2eb0 2020-06-12T17:51:27.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.316+0000 7f220d546700 1 --2- 172.21.15.38:0/2086676080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22080b2eb0 0x7f2208064320 secure :-1 s=THROTTLE_DONE pgs=847 cs=0 l=1 rx=0x7f2204002f30 tx=0x7f2204007f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.316+0000 7f220d546700 1 --2- 172.21.15.38:0/2086676080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22080b2eb0 0x7f2208064320 secure :-1 s=THROTTLE_DONE pgs=847 cs=0 l=1 rx=0x7f2204002f30 tx=0x7f2204007f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.316+0000 7f21f6ffd700 1 -- 172.21.15.38:0/2086676080 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22040072c0 con 0x7f22080b2eb0 2020-06-12T17:51:27.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.316+0000 7f220ffab700 1 -- 172.21.15.38:0/2086676080 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2208063a10 con 0x7f22080b2eb0 2020-06-12T17:51:27.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.316+0000 7f21f6ffd700 1 -- 172.21.15.38:0/2086676080 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22040059c0 con 0x7f22080b2eb0 2020-06-12T17:51:27.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.316+0000 7f220ffab700 1 -- 172.21.15.38:0/2086676080 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2208063ee0 con 0x7f22080b2eb0 2020-06-12T17:51:27.336 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.317+0000 7f220d546700 1 --2- 172.21.15.38:0/2086676080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22080b2eb0 0x7f2208064320 secure :-1 s=THROTTLE_DONE pgs=847 cs=0 l=1 rx=0x7f2204002f30 tx=0x7f2204007f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.317+0000 7f21f6ffd700 1 -- 172.21.15.38:0/2086676080 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f2204005bc0 con 0x7f22080b2eb0 2020-06-12T17:51:27.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.317+0000 7f220d546700 1 --2- 172.21.15.38:0/2086676080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22080b2eb0 0x7f2208064320 secure :-1 s=THROTTLE_DONE pgs=847 cs=0 l=1 rx=0x7f2204002f30 tx=0x7f2204007f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.317+0000 7f220ffab700 1 -- 172.21.15.38:0/2086676080 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2208056c30 con 0x7f22080b2eb0 2020-06-12T17:51:27.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.317+0000 7f21f6ffd700 1 --2- 172.21.15.38:0/2086676080 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f21e804d5c0 0x7f21e804fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:27.337 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.317+0000 7f21f6ffd700 1 -- 172.21.15.38:0/2086676080 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2204060dc0 con 0x7f22080b2eb0 2020-06-12T17:51:27.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.317+0000 7f220dd47700 1 --2- 172.21.15.38:0/2086676080 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f21e804d5c0 0x7f21e804fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:27.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.318+0000 7f220dd47700 1 --2- 172.21.15.38:0/2086676080 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f21e804d5c0 0x7f21e804fa80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f21f8002f30 tx=0x7f21f8007d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.318+0000 7f220dd47700 1 --2- 172.21.15.38:0/2086676080 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f21e804d5c0 0x7f21e804fa80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f21f8002f30 tx=0x7f21f8007d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.318+0000 7f220dd47700 1 --2- 172.21.15.38:0/2086676080 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f21e804d5c0 0x7f21e804fa80 secure :-1 s=READY pgs=330 cs=0 l=1 rx=0x7f21f8002f30 tx=0x7f21f8007d80).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:27.338 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.321+0000 7f220d546700 1 --2- 172.21.15.38:0/2086676080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22080b2eb0 0x7f2208064320 secure :-1 s=THROTTLE_DONE pgs=847 cs=0 l=1 rx=0x7f2204002f30 tx=0x7f2204007f80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.339 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.321+0000 7f21f6ffd700 1 -- 172.21.15.38:0/2086676080 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f220403c4c0 con 0x7f22080b2eb0 2020-06-12T17:51:27.518 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.515+0000 7f220ffab700 1 -- 172.21.15.38:0/2086676080 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_5302", "target": ["mon-mgr", ""]}) v1 -- 0x7f220805a5e0 con 0x7f21e804d5c0 2020-06-12T17:51:27.535 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.532+0000 7f220dd47700 1 --2- 172.21.15.38:0/2086676080 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f21e804d5c0 0x7f21e804fa80 secure :-1 s=THROTTLE_DONE pgs=330 cs=0 l=1 rx=0x7f21f8002f30 tx=0x7f21f8007d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.536 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.532+0000 7f21f6ffd700 1 -- 172.21.15.38:0/2086676080 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f220805a5e0 con 0x7f21e804d5c0 2020-06-12T17:51:27.537 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.534+0000 7f220ffab700 1 -- 172.21.15.38:0/2086676080 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f21e804d5c0 msgr2=0x7f21e804fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:27.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.534+0000 7f220ffab700 1 --2- 172.21.15.38:0/2086676080 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f21e804d5c0 0x7f21e804fa80 secure :-1 s=READY pgs=330 cs=0 l=1 rx=0x7f21f8002f30 tx=0x7f21f8007d80).stop 2020-06-12T17:51:27.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.534+0000 7f220ffab700 1 -- 172.21.15.38:0/2086676080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22080b2eb0 msgr2=0x7f2208064320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:27.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.534+0000 7f220ffab700 1 --2- 172.21.15.38:0/2086676080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22080b2eb0 0x7f2208064320 secure :-1 s=READY pgs=847 cs=0 l=1 rx=0x7f2204002f30 tx=0x7f2204007f80).stop 2020-06-12T17:51:27.538 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.534+0000 7f220ffab700 1 -- 172.21.15.38:0/2086676080 shutdown_connections 2020-06-12T17:51:27.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.534+0000 7f220ffab700 1 --2- 172.21.15.38:0/2086676080 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f21e804d5c0 0x7f21e804fa80 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:27.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.534+0000 7f220ffab700 1 --2- 172.21.15.38:0/2086676080 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f220809d620 0x7f2208061cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:27.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.534+0000 7f220ffab700 1 --2- 172.21.15.38:0/2086676080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22080b2eb0 0x7f2208064320 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:27.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.534+0000 7f220ffab700 1 -- 172.21.15.38:0/2086676080 >> 172.21.15.38:0/2086676080 conn(0x7f22080b5a20 msgr2=0x7f220805b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:27.539 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.534+0000 7f220ffab700 1 -- 172.21.15.38:0/2086676080 shutdown_connections 2020-06-12T17:51:27.540 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.534+0000 7f220ffab700 1 -- 172.21.15.38:0/2086676080 wait complete. 2020-06-12T17:51:27.547 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_5302 2020-06-12T17:51:27.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.661+0000 7fda60e39700 1 Processor -- start 2020-06-12T17:51:27.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.661+0000 7fda60e39700 1 -- start start 2020-06-12T17:51:27.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.662+0000 7fda60e39700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fda5c0ad5b0 0x7fda5c0b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:27.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.662+0000 7fda60e39700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fda5c09d8d0 0x7fda5c1421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:27.667 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.662+0000 7fda60e39700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5c146d20 con 0x7fda5c146680 2020-06-12T17:51:27.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.662+0000 7fda60e39700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5c066a80 con 0x7fda5c09d8d0 2020-06-12T17:51:27.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.662+0000 7fda60e39700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5c146f50 con 0x7fda5c0ad5b0 2020-06-12T17:51:27.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.662+0000 7fda5ad9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fda5c09d8d0 0x7fda5c1421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:27.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.662+0000 7fda5ad9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fda5c09d8d0 0x7fda5c1421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39816/0 (socket says 172.21.15.38:39816) 2020-06-12T17:51:27.668 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.662+0000 7fda5ad9d700 1 -- 172.21.15.38:0/3403099406 learned_addr learned my addr 172.21.15.38:0/3403099406 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:27.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.662+0000 7fda59d9b700 1 --2- 172.21.15.38:0/3403099406 >> v2:172.21.15.150:3300/0 conn(0x7fda5c0ad5b0 0x7fda5c0b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:27.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.662+0000 7fda5ad9d700 1 -- 172.21.15.38:0/3403099406 >> v2:172.21.15.150:3300/0 conn(0x7fda5c0ad5b0 msgr2=0x7fda5c0b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:27.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.662+0000 7fda5ad9d700 1 --2- 172.21.15.38:0/3403099406 >> v2:172.21.15.150:3300/0 conn(0x7fda5c0ad5b0 0x7fda5c0b2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:27.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.662+0000 7fda5ad9d700 1 -- 172.21.15.38:0/3403099406 >> v1:172.21.15.150:6789/0 conn(0x7fda5c146680 legacy=0x7fda5c09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:27.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.662+0000 7fda5ad9d700 1 -- 172.21.15.38:0/3403099406 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c146a60 con 0x7fda5c09d8d0 2020-06-12T17:51:27.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.662+0000 7fda5ad9d700 1 --2- 172.21.15.38:0/3403099406 >> v2:172.21.15.38:3300/0 conn(0x7fda5c09d8d0 0x7fda5c1421d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fda5c061380 tx=0x7fda4c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.662+0000 7fda5ad9d700 1 --2- 172.21.15.38:0/3403099406 >> v2:172.21.15.38:3300/0 conn(0x7fda5c09d8d0 0x7fda5c1421d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fda5c061380 tx=0x7fda4c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.662+0000 7fda5ad9d700 1 --2- 172.21.15.38:0/3403099406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda5c09d8d0 0x7fda5c1421d0 secure :-1 s=READY pgs=848 cs=0 l=1 rx=0x7fda5c061380 tx=0x7fda4c0081e0).ready entity=mon.0 client_cookie=d87f15f81cfdb03f server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:27.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.662+0000 7fda5ad9d700 1 --2- 172.21.15.38:0/3403099406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda5c09d8d0 0x7fda5c1421d0 secure :-1 s=THROTTLE_DONE pgs=848 cs=0 l=1 rx=0x7fda5c061380 tx=0x7fda4c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.670 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.662+0000 7fda5959a700 1 -- 172.21.15.38:0/3403099406 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda4c00a160 con 0x7fda5c09d8d0 2020-06-12T17:51:27.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.662+0000 7fda5ad9d700 1 --2- 172.21.15.38:0/3403099406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda5c09d8d0 0x7fda5c1421d0 secure :-1 s=THROTTLE_DONE pgs=848 cs=0 l=1 rx=0x7fda5c061380 tx=0x7fda4c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.662+0000 7fda5959a700 1 -- 172.21.15.38:0/3403099406 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4c00a2c0 con 0x7fda5c09d8d0 2020-06-12T17:51:27.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.662+0000 7fda5ad9d700 1 --2- 172.21.15.38:0/3403099406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda5c09d8d0 0x7fda5c1421d0 secure :-1 s=THROTTLE_DONE pgs=848 cs=0 l=1 rx=0x7fda5c061380 tx=0x7fda4c0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.663+0000 7fda5959a700 1 -- 172.21.15.38:0/3403099406 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda4c00a6a0 con 0x7fda5c09d8d0 2020-06-12T17:51:27.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.663+0000 7fda60e39700 1 -- 172.21.15.38:0/3403099406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda5c09d8d0 msgr2=0x7fda5c1421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:27.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.663+0000 7fda60e39700 1 --2- 172.21.15.38:0/3403099406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda5c09d8d0 0x7fda5c1421d0 secure :-1 s=READY pgs=848 cs=0 l=1 rx=0x7fda5c061380 tx=0x7fda4c0081e0).stop 2020-06-12T17:51:27.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.663+0000 7fda60e39700 1 -- 172.21.15.38:0/3403099406 shutdown_connections 2020-06-12T17:51:27.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.663+0000 7fda60e39700 1 --2- 172.21.15.38:0/3403099406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda5c09d8d0 0x7fda5c1421d0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:27.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.663+0000 7fda60e39700 1 --2- 172.21.15.38:0/3403099406 >> v2:172.21.15.150:3300/0 conn(0x7fda5c0ad5b0 0x7fda5c0b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:27.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.663+0000 7fda60e39700 1 -- 172.21.15.38:0/3403099406 >> 172.21.15.38:0/3403099406 conn(0x7fda5c0b5a20 msgr2=0x7fda5c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:27.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.663+0000 7fda60e39700 1 -- 172.21.15.38:0/3403099406 shutdown_connections 2020-06-12T17:51:27.673 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.663+0000 7fda60e39700 1 -- 172.21.15.38:0/3403099406 wait complete. 2020-06-12T17:51:27.677 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.664+0000 7fda60e39700 1 Processor -- start 2020-06-12T17:51:27.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.664+0000 7fda60e39700 1 -- start start 2020-06-12T17:51:27.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.665+0000 7fda60e39700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda5c146680 0x7fda5c0b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:27.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.665+0000 7fda60e39700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5c0b3f20 con 0x7fda5c0ad5b0 2020-06-12T17:51:27.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.665+0000 7fda60e39700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5c08f680 con 0x7fda5c09d8d0 2020-06-12T17:51:27.678 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.665+0000 7fda60e39700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c08f920 con 0x7fda5c146680 2020-06-12T17:51:27.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.665+0000 7fda59d9b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fda5c0ad5b0 0x7fda5c151480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41636/0 (socket says 172.21.15.38:41636) 2020-06-12T17:51:27.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.665+0000 7fda59d9b700 1 -- 172.21.15.38:0/3481383556 learned_addr learned my addr 172.21.15.38:0/3481383556 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:27.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.665+0000 7fda5ad9d700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda5c146680 0x7fda5c0b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:27.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.665+0000 7fda537fe700 1 -- 172.21.15.38:0/3481383556 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436631100 0 0) 0x7fda44002030 con 0x7fda5c0ad5b0 2020-06-12T17:51:27.679 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.665+0000 7fda537fe700 1 -- 172.21.15.38:0/3481383556 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda40002fe0 con 0x7fda5c0ad5b0 2020-06-12T17:51:27.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.665+0000 7fda537fe700 1 -- 172.21.15.38:0/3481383556 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305820830 0 0) 0x7fda5c08f680 con 0x7fda5c09d8d0 2020-06-12T17:51:27.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.665+0000 7fda537fe700 1 -- 172.21.15.38:0/3481383556 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda44002030 con 0x7fda5c09d8d0 2020-06-12T17:51:27.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.665+0000 7fda537fe700 1 -- 172.21.15.38:0/3481383556 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 888817040 0 0) 0x7fda40002fe0 con 0x7fda5c0ad5b0 2020-06-12T17:51:27.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.665+0000 7fda537fe700 1 -- 172.21.15.38:0/3481383556 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fda5c08f680 con 0x7fda5c0ad5b0 2020-06-12T17:51:27.680 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.665+0000 7fda537fe700 1 -- 172.21.15.38:0/3481383556 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fda44002900 con 0x7fda5c0ad5b0 2020-06-12T17:51:27.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.665+0000 7fda537fe700 1 -- 172.21.15.38:0/3481383556 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda5c146680 msgr2=0x7fda5c0b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:27.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.665+0000 7fda537fe700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda5c146680 0x7fda5c0b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:27.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.665+0000 7fda537fe700 1 -- 172.21.15.38:0/3481383556 >> v1:172.21.15.150:6789/0 conn(0x7fda5c09d8d0 legacy=0x7fda5c08ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:27.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.665+0000 7fda537fe700 1 -- 172.21.15.38:0/3481383556 >> v1:172.21.15.38:6789/0 conn(0x7fda5c0ad5b0 legacy=0x7fda5c151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:27.681 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.665+0000 7fda537fe700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda40004b20 0x7fda40004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:27.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.665+0000 7fda537fe700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda40003800 0x7fda40003c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:27.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.665+0000 7fda537fe700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda5c146680 0x7fda400040a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:27.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.665+0000 7fda537fe700 1 -- 172.21.15.38:0/3481383556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c08f920 con 0x7fda40003800 2020-06-12T17:51:27.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.665+0000 7fda537fe700 1 -- 172.21.15.38:0/3481383556 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda40004500 con 0x7fda40004b20 2020-06-12T17:51:27.682 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.665+0000 7fda537fe700 1 -- 172.21.15.38:0/3481383556 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda400046c0 con 0x7fda5c146680 2020-06-12T17:51:27.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.666+0000 7fda59d9b700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda40003800 0x7fda40003c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:27.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.666+0000 7fda5a59c700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda40004b20 0x7fda40004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:27.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.666+0000 7fda5ad9d700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda5c146680 0x7fda400040a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:27.683 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.666+0000 7fda59d9b700 1 -- 172.21.15.38:0/3481383556 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda5c146680 msgr2=0x7fda400040a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:27.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.666+0000 7fda59d9b700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda5c146680 0x7fda400040a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:27.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.666+0000 7fda59d9b700 1 -- 172.21.15.38:0/3481383556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda40004b20 msgr2=0x7fda40004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:27.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.666+0000 7fda59d9b700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda40004b20 0x7fda40004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:27.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.666+0000 7fda59d9b700 1 -- 172.21.15.38:0/3481383556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c066380 con 0x7fda40003800 2020-06-12T17:51:27.685 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.666+0000 7fda60e39700 1 -- 172.21.15.38:0/3481383556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5c0665d0 con 0x7fda40003800 2020-06-12T17:51:27.686 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.666+0000 7fda59d9b700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda40003800 0x7fda40003c40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fda440026d0 tx=0x7fda4400ead0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.686 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.666+0000 7fda60e39700 1 -- 172.21.15.38:0/3481383556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5c0b3d00 con 0x7fda40003800 2020-06-12T17:51:27.686 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.666+0000 7fda59d9b700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda40003800 0x7fda40003c40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fda440026d0 tx=0x7fda4400ead0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.686 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.666+0000 7fda59d9b700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda40003800 0x7fda40003c40 secure :-1 s=READY pgs=850 cs=0 l=1 rx=0x7fda440026d0 tx=0x7fda4400ead0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:27.687 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.666+0000 7fda59d9b700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda40003800 0x7fda40003c40 secure :-1 s=THROTTLE_DONE pgs=850 cs=0 l=1 rx=0x7fda440026d0 tx=0x7fda4400ead0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.687 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.666+0000 7fda59d9b700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda40003800 0x7fda40003c40 secure :-1 s=THROTTLE_DONE pgs=850 cs=0 l=1 rx=0x7fda440026d0 tx=0x7fda4400ead0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.666+0000 7fda537fe700 1 -- 172.21.15.38:0/3481383556 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda44012e60 con 0x7fda40003800 2020-06-12T17:51:27.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.666+0000 7fda59d9b700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda40003800 0x7fda40003c40 secure :-1 s=THROTTLE_DONE pgs=850 cs=0 l=1 rx=0x7fda440026d0 tx=0x7fda4400ead0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.666+0000 7fda537fe700 1 -- 172.21.15.38:0/3481383556 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda44007540 con 0x7fda40003800 2020-06-12T17:51:27.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.666+0000 7fda537fe700 1 -- 172.21.15.38:0/3481383556 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda4400cbf0 con 0x7fda40003800 2020-06-12T17:51:27.688 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.667+0000 7fda59d9b700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda40003800 0x7fda40003c40 secure :-1 s=THROTTLE_DONE pgs=850 cs=0 l=1 rx=0x7fda440026d0 tx=0x7fda4400ead0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.667+0000 7fda537fe700 1 -- 172.21.15.38:0/3481383556 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fda4400cd50 con 0x7fda40003800 2020-06-12T17:51:27.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.667+0000 7fda59d9b700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda40003800 0x7fda40003c40 secure :-1 s=THROTTLE_DONE pgs=850 cs=0 l=1 rx=0x7fda440026d0 tx=0x7fda4400ead0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.667+0000 7fda60e39700 1 -- 172.21.15.38:0/3481383556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5c056c30 con 0x7fda40003800 2020-06-12T17:51:27.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.667+0000 7fda537fe700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fda400559b0 0x7fda40057e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:27.689 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.667+0000 7fda537fe700 1 -- 172.21.15.38:0/3481383556 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fda440614a0 con 0x7fda40003800 2020-06-12T17:51:27.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.668+0000 7fda5a59c700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fda400559b0 0x7fda40057e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:27.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.668+0000 7fda5a59c700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fda400559b0 0x7fda40057e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fda54000e90 tx=0x7fda540017e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.668+0000 7fda5a59c700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fda400559b0 0x7fda40057e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fda54000e90 tx=0x7fda540017e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.668+0000 7fda5a59c700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fda400559b0 0x7fda40057e70 secure :-1 s=READY pgs=331 cs=0 l=1 rx=0x7fda54000e90 tx=0x7fda540017e0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:27.690 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.671+0000 7fda59d9b700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda40003800 0x7fda40003c40 secure :-1 s=THROTTLE_DONE pgs=850 cs=0 l=1 rx=0x7fda440026d0 tx=0x7fda4400ead0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.691 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.671+0000 7fda537fe700 1 -- 172.21.15.38:0/3481383556 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fda4403cc20 con 0x7fda40003800 2020-06-12T17:51:27.871 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.868+0000 7fda60e39700 1 -- 172.21.15.38:0/3481383556 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_5302", "target": ["mon-mgr", ""]}) v1 -- 0x7fda5c0b3f20 con 0x7fda400559b0 2020-06-12T17:51:27.874 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.872+0000 7fda5a59c700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fda400559b0 0x7fda40057e70 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7fda54000e90 tx=0x7fda540017e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:27.875 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.872+0000 7fda537fe700 1 -- 172.21.15.38:0/3481383556 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7fda5c0b3f20 con 0x7fda400559b0 2020-06-12T17:51:27.875 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_5302/4272d6c0-9f10-43e8-9dda-223cc15aac84 2020-06-12T17:51:27.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.872+0000 7fda60e39700 1 -- 172.21.15.38:0/3481383556 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fda400559b0 msgr2=0x7fda40057e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:27.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.872+0000 7fda60e39700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fda400559b0 0x7fda40057e70 secure :-1 s=READY pgs=331 cs=0 l=1 rx=0x7fda54000e90 tx=0x7fda540017e0).stop 2020-06-12T17:51:27.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.872+0000 7fda60e39700 1 -- 172.21.15.38:0/3481383556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda40003800 msgr2=0x7fda40003c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:27.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.872+0000 7fda60e39700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda40003800 0x7fda40003c40 secure :-1 s=READY pgs=850 cs=0 l=1 rx=0x7fda440026d0 tx=0x7fda4400ead0).stop 2020-06-12T17:51:27.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.872+0000 7fda5ad9d700 1 -- 172.21.15.38:0/3481383556 reap_dead start 2020-06-12T17:51:27.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.872+0000 7fda60e39700 1 -- 172.21.15.38:0/3481383556 shutdown_connections 2020-06-12T17:51:27.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.872+0000 7fda60e39700 1 --2- 172.21.15.38:0/3481383556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda40003800 0x7fda40003c40 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:27.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.872+0000 7fda60e39700 1 -- 172.21.15.38:0/3481383556 >> 172.21.15.38:0/3481383556 conn(0x7fda5c0b5a20 msgr2=0x7fda5c09c530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:27.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.873+0000 7fda60e39700 1 -- 172.21.15.38:0/3481383556 shutdown_connections 2020-06-12T17:51:27.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:27.873+0000 7fda60e39700 1 -- 172.21.15.38:0/3481383556 wait complete. 2020-06-12T17:51:27.886 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_5302 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_5302/4272d6c0-9f10-43e8-9dda-223cc15aac84 2020-06-12T17:51:27.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:27.887 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:27.887 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:27.902 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:27.903 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:27.904 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5302/4272d6c0-9f10-43e8-9dda-223cc15aac84/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:27.995 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:27.995 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:27.995 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113178 s, 92.6 MB/s 2020-06-12T17:51:27.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:27.997 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:27.998 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:28.013 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:28.014 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:28.014 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5302/4272d6c0-9f10-43e8-9dda-223cc15aac84/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:28.100 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:28.100 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:28.101 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105624 s, 99.3 MB/s 2020-06-12T17:51:28.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:28.102 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:28.103 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:28.117 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:28.118 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:28.119 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5302/4272d6c0-9f10-43e8-9dda-223cc15aac84/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:28.209 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:28.209 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:28.210 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118406 s, 88.6 MB/s 2020-06-12T17:51:28.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:28.211 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:28.211 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:28.236 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:28.237 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:28.237 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5302/4272d6c0-9f10-43e8-9dda-223cc15aac84/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:28.331 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:28.332 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:28.332 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134624 s, 77.9 MB/s 2020-06-12T17:51:28.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:28.333 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:28.334 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:28.349 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:28.349 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:28.350 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5302/4272d6c0-9f10-43e8-9dda-223cc15aac84/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:28.437 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:28.438 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:28.438 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105512 s, 99.4 MB/s 2020-06-12T17:51:28.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:28.439 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:28.440 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:28.454 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:28.455 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:28.455 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5302/4272d6c0-9f10-43e8-9dda-223cc15aac84/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:28.551 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:28.551 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:28.551 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125728 s, 83.4 MB/s 2020-06-12T17:51:28.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:28.552 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:28.553 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:28.582 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:28.582 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:28.583 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5302/4272d6c0-9f10-43e8-9dda-223cc15aac84/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:28.670 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:28.670 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:28.670 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113858 s, 92.1 MB/s 2020-06-12T17:51:28.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:28.672 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:28.672 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:28.687 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:28.688 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:28.689 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5302/4272d6c0-9f10-43e8-9dda-223cc15aac84/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:28.774 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:28.775 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:28.775 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00986952 s, 106 MB/s 2020-06-12T17:51:28.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:28.777 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:28.777 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:28.791 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:28.792 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:28.793 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5302/4272d6c0-9f10-43e8-9dda-223cc15aac84/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:28.882 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:28.883 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:28.883 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141743 s, 74.0 MB/s 2020-06-12T17:51:28.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:28.885 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:28.885 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:28.900 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:28.901 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:28.901 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_5302/4272d6c0-9f10-43e8-9dda-223cc15aac84/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:28.991 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:28.991 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:28.991 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101286 s, 104 MB/s 2020-06-12T17:51:28.992 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_7500 2020-06-12T17:51:29.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.105+0000 7f993e3ae700 1 Processor -- start 2020-06-12T17:51:29.109 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.105+0000 7f993e3ae700 1 -- start start 2020-06-12T17:51:29.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.106+0000 7f993e3ae700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f99380ad5b0 0x7f99380b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:29.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.106+0000 7f993e3ae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f993809d8d0 0x7f99381421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:29.112 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.106+0000 7f993e3ae700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9938146d20 con 0x7f9938146680 2020-06-12T17:51:29.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.106+0000 7f993e3ae700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9938066a80 con 0x7f99380ad5b0 2020-06-12T17:51:29.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.106+0000 7f993e3ae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9938146f50 con 0x7f993809d8d0 2020-06-12T17:51:29.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.106+0000 7f99377fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f99380ad5b0 0x7f99380b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:29.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.106+0000 7f99377fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f99380ad5b0 0x7f99380b2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39834/0 (socket says 172.21.15.38:39834) 2020-06-12T17:51:29.113 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.106+0000 7f99377fe700 1 -- 172.21.15.38:0/3944528269 learned_addr learned my addr 172.21.15.38:0/3944528269 (peer_addr_for_me v2:172.21.15.38:0/0) 2020-06-12T17:51:29.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.106+0000 7f99377fe700 1 -- 172.21.15.38:0/3944528269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f993809d8d0 msgr2=0x7f99381421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:29.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.106+0000 7f993c94b700 1 --2- 172.21.15.38:0/3944528269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f993809d8d0 0x7f99381421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:29.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.106+0000 7f99377fe700 1 --2- 172.21.15.38:0/3944528269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f993809d8d0 0x7f99381421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:29.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.106+0000 7f99377fe700 1 -- 172.21.15.38:0/3944528269 >> v1:172.21.15.150:6789/0 conn(0x7f9938146680 legacy=0x7f993809d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:29.114 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.106+0000 7f99377fe700 1 -- 172.21.15.38:0/3944528269 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9938146a60 con 0x7f99380ad5b0 2020-06-12T17:51:29.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.107+0000 7f99377fe700 1 --2- 172.21.15.38:0/3944528269 >> v2:172.21.15.38:3300/0 conn(0x7f99380ad5b0 0x7f99380b2eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9938061380 tx=0x7f992c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.107+0000 7f99377fe700 1 --2- 172.21.15.38:0/3944528269 >> v2:172.21.15.38:3300/0 conn(0x7f99380ad5b0 0x7f99380b2eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9938061380 tx=0x7f992c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.107+0000 7f99377fe700 1 --2- 172.21.15.38:0/3944528269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99380ad5b0 0x7f99380b2eb0 secure :-1 s=READY pgs=851 cs=0 l=1 rx=0x7f9938061380 tx=0x7f992c007e60).ready entity=mon.0 client_cookie=8dbfc8139cd42d14 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:29.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.107+0000 7f99377fe700 1 --2- 172.21.15.38:0/3944528269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99380ad5b0 0x7f99380b2eb0 secure :-1 s=THROTTLE_DONE pgs=851 cs=0 l=1 rx=0x7f9938061380 tx=0x7f992c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.115 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.107+0000 7f9936ffd700 1 -- 172.21.15.38:0/3944528269 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f992c0116a0 con 0x7f99380ad5b0 2020-06-12T17:51:29.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.107+0000 7f99377fe700 1 --2- 172.21.15.38:0/3944528269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99380ad5b0 0x7f99380b2eb0 secure :-1 s=THROTTLE_DONE pgs=851 cs=0 l=1 rx=0x7f9938061380 tx=0x7f992c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.107+0000 7f99377fe700 1 --2- 172.21.15.38:0/3944528269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99380ad5b0 0x7f99380b2eb0 secure :-1 s=THROTTLE_DONE pgs=851 cs=0 l=1 rx=0x7f9938061380 tx=0x7f992c007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.107+0000 7f9936ffd700 1 -- 172.21.15.38:0/3944528269 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992c011800 con 0x7f99380ad5b0 2020-06-12T17:51:29.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.107+0000 7f9936ffd700 1 -- 172.21.15.38:0/3944528269 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f992c011c20 con 0x7f99380ad5b0 2020-06-12T17:51:29.116 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.107+0000 7f993e3ae700 1 -- 172.21.15.38:0/3944528269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99380ad5b0 msgr2=0x7f99380b2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:29.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.107+0000 7f993e3ae700 1 --2- 172.21.15.38:0/3944528269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99380ad5b0 0x7f99380b2eb0 secure :-1 s=READY pgs=851 cs=0 l=1 rx=0x7f9938061380 tx=0x7f992c007e60).stop 2020-06-12T17:51:29.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.107+0000 7f993e3ae700 1 -- 172.21.15.38:0/3944528269 shutdown_connections 2020-06-12T17:51:29.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.107+0000 7f993e3ae700 1 --2- 172.21.15.38:0/3944528269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f993809d8d0 0x7f99381421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:29.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.107+0000 7f993e3ae700 1 --2- 172.21.15.38:0/3944528269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99380ad5b0 0x7f99380b2eb0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:29.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.107+0000 7f993e3ae700 1 -- 172.21.15.38:0/3944528269 >> 172.21.15.38:0/3944528269 conn(0x7f99380b5a20 msgr2=0x7f993805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:29.117 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.107+0000 7f993e3ae700 1 -- 172.21.15.38:0/3944528269 shutdown_connections 2020-06-12T17:51:29.118 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.107+0000 7f993e3ae700 1 -- 172.21.15.38:0/3944528269 wait complete. 2020-06-12T17:51:29.118 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.108+0000 7f993e3ae700 1 Processor -- start 2020-06-12T17:51:29.118 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.108+0000 7f993e3ae700 1 -- start start 2020-06-12T17:51:29.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.109+0000 7f993e3ae700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f993809d8d0 0x7f99380b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:29.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.109+0000 7f993e3ae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9938146680 0x7f9938141310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:29.122 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.109+0000 7f993e3ae700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99380627c0 con 0x7f99380ad5b0 2020-06-12T17:51:29.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.109+0000 7f993e3ae700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9938062a60 con 0x7f993809d8d0 2020-06-12T17:51:29.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.109+0000 7f993e3ae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9938062d00 con 0x7f9938146680 2020-06-12T17:51:29.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.109+0000 7f99377fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f99380ad5b0 0x7f9938140c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41656/0 (socket says 172.21.15.38:41656) 2020-06-12T17:51:29.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.109+0000 7f99377fe700 1 -- 172.21.15.38:0/1370667835 learned_addr learned my addr 172.21.15.38:0/1370667835 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:29.123 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.109+0000 7f993c94b700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9938146680 0x7f9938141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:29.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.109+0000 7f9937fff700 1 --2- 172.21.15.38:0/1370667835 >> v2:172.21.15.150:3300/0 conn(0x7f993809d8d0 0x7f99380b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:29.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.109+0000 7f99357fa700 1 -- 172.21.15.38:0/1370667835 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439208593 0 0) 0x7f99380627c0 con 0x7f99380ad5b0 2020-06-12T17:51:29.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.109+0000 7f99357fa700 1 -- 172.21.15.38:0/1370667835 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9918002fe0 con 0x7f99380ad5b0 2020-06-12T17:51:29.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f99357fa700 1 -- 172.21.15.38:0/1370667835 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 644883696 0 0) 0x7f9918002fe0 con 0x7f99380ad5b0 2020-06-12T17:51:29.124 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f99357fa700 1 -- 172.21.15.38:0/1370667835 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f99380627c0 con 0x7f99380ad5b0 2020-06-12T17:51:29.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f99357fa700 1 -- 172.21.15.38:0/1370667835 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f992c011e90 con 0x7f99380ad5b0 2020-06-12T17:51:29.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f99357fa700 1 -- 172.21.15.38:0/1370667835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9938146680 msgr2=0x7f9938141310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:29.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f99357fa700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9938146680 0x7f9938141310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:29.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f99357fa700 1 -- 172.21.15.38:0/1370667835 >> v2:172.21.15.150:3300/0 conn(0x7f993809d8d0 msgr2=0x7f99380b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:29.125 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f99357fa700 1 --2- 172.21.15.38:0/1370667835 >> v2:172.21.15.150:3300/0 conn(0x7f993809d8d0 0x7f99380b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:29.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f99357fa700 1 -- 172.21.15.38:0/1370667835 >> v1:172.21.15.38:6789/0 conn(0x7f99380ad5b0 legacy=0x7f9938140c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:29.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f99357fa700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99180049b0 0x7f9918004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:29.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f99357fa700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9938146680 0x7f9918003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:29.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f99357fa700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9918003d80 0x7f9918004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:29.126 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f99357fa700 1 -- 172.21.15.38:0/1370667835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9938062a60 con 0x7f9918003d80 2020-06-12T17:51:29.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f99357fa700 1 -- 172.21.15.38:0/1370667835 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9938062d00 con 0x7f99180049b0 2020-06-12T17:51:29.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f99357fa700 1 -- 172.21.15.38:0/1370667835 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9918005380 con 0x7f9938146680 2020-06-12T17:51:29.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f993c94b700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9918003d80 0x7f9918004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:29.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f9937fff700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99180049b0 0x7f9918004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:29.127 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f99377fe700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9938146680 0x7f9918003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:29.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f993c94b700 1 -- 172.21.15.38:0/1370667835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9938146680 msgr2=0x7f9918003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:29.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f993c94b700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9938146680 0x7f9918003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:29.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f993c94b700 1 -- 172.21.15.38:0/1370667835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99180049b0 msgr2=0x7f9918004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:29.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f993c94b700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99180049b0 0x7f9918004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:29.128 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f993c94b700 1 -- 172.21.15.38:0/1370667835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9938064a40 con 0x7f9918003d80 2020-06-12T17:51:29.129 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f993e3ae700 1 -- 172.21.15.38:0/1370667835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9938064c90 con 0x7f9918003d80 2020-06-12T17:51:29.129 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f993c94b700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9918003d80 0x7f9918004200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f99300032b0 tx=0x7f993000e190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.129 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f993e3ae700 1 -- 172.21.15.38:0/1370667835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99381414d0 con 0x7f9918003d80 2020-06-12T17:51:29.129 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f993c94b700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9918003d80 0x7f9918004200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f99300032b0 tx=0x7f993000e190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.129 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.110+0000 7f993c94b700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9918003d80 0x7f9918004200 secure :-1 s=READY pgs=853 cs=0 l=1 rx=0x7f99300032b0 tx=0x7f993000e190).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:29.130 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.111+0000 7f993c94b700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9918003d80 0x7f9918004200 secure :-1 s=THROTTLE_DONE pgs=853 cs=0 l=1 rx=0x7f99300032b0 tx=0x7f993000e190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.130 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.111+0000 7f99357fa700 1 -- 172.21.15.38:0/1370667835 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9930005e20 con 0x7f9918003d80 2020-06-12T17:51:29.130 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.111+0000 7f993c94b700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9918003d80 0x7f9918004200 secure :-1 s=THROTTLE_DONE pgs=853 cs=0 l=1 rx=0x7f99300032b0 tx=0x7f993000e190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.130 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.111+0000 7f993c94b700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9918003d80 0x7f9918004200 secure :-1 s=THROTTLE_DONE pgs=853 cs=0 l=1 rx=0x7f99300032b0 tx=0x7f993000e190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.130 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.111+0000 7f99357fa700 1 -- 172.21.15.38:0/1370667835 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99300117e0 con 0x7f9918003d80 2020-06-12T17:51:29.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.111+0000 7f99357fa700 1 -- 172.21.15.38:0/1370667835 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9930011b80 con 0x7f9918003d80 2020-06-12T17:51:29.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.111+0000 7f993c94b700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9918003d80 0x7f9918004200 secure :-1 s=THROTTLE_DONE pgs=853 cs=0 l=1 rx=0x7f99300032b0 tx=0x7f993000e190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.111+0000 7f993e3ae700 1 -- 172.21.15.38:0/1370667835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9914003340 con 0x7f9918003d80 2020-06-12T17:51:29.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.112+0000 7f99357fa700 1 -- 172.21.15.38:0/1370667835 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f9930011ce0 con 0x7f9918003d80 2020-06-12T17:51:29.131 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.112+0000 7f993c94b700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9918003d80 0x7f9918004200 secure :-1 s=THROTTLE_DONE pgs=853 cs=0 l=1 rx=0x7f99300032b0 tx=0x7f993000e190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.112+0000 7f99357fa700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9918055740 0x7f9918057c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:29.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.112+0000 7f99357fa700 1 -- 172.21.15.38:0/1370667835 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9930060e70 con 0x7f9918003d80 2020-06-12T17:51:29.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.112+0000 7f9937fff700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9918055740 0x7f9918057c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:29.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.112+0000 7f9937fff700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9918055740 0x7f9918057c00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9928001f50 tx=0x7f9928002710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.132 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.112+0000 7f9937fff700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9918055740 0x7f9918057c00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9928001f50 tx=0x7f9928002710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.112+0000 7f9937fff700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9918055740 0x7f9918057c00 secure :-1 s=READY pgs=332 cs=0 l=1 rx=0x7f9928001f50 tx=0x7f9928002710).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:29.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.115+0000 7f993c94b700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9918003d80 0x7f9918004200 secure :-1 s=THROTTLE_DONE pgs=853 cs=0 l=1 rx=0x7f99300032b0 tx=0x7f993000e190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.133 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.115+0000 7f99357fa700 1 -- 172.21.15.38:0/1370667835 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f993003c5d0 con 0x7f9918003d80 2020-06-12T17:51:29.313 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.310+0000 7f993e3ae700 1 -- 172.21.15.38:0/1370667835 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_7500", "target": ["mon-mgr", ""]}) v1 -- 0x7f9914002200 con 0x7f9918055740 2020-06-12T17:51:29.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.328+0000 7f9937fff700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9918055740 0x7f9918057c00 secure :-1 s=THROTTLE_DONE pgs=332 cs=0 l=1 rx=0x7f9928001f50 tx=0x7f9928002710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.331 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.328+0000 7f99357fa700 1 -- 172.21.15.38:0/1370667835 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f9914002200 con 0x7f9918055740 2020-06-12T17:51:29.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.329+0000 7f993e3ae700 1 -- 172.21.15.38:0/1370667835 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9918055740 msgr2=0x7f9918057c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:29.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.329+0000 7f993e3ae700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9918055740 0x7f9918057c00 secure :-1 s=READY pgs=332 cs=0 l=1 rx=0x7f9928001f50 tx=0x7f9928002710).stop 2020-06-12T17:51:29.333 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.329+0000 7f993e3ae700 1 -- 172.21.15.38:0/1370667835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9918003d80 msgr2=0x7f9918004200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:29.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.329+0000 7f993e3ae700 1 --2- 172.21.15.38:0/1370667835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9918003d80 0x7f9918004200 secure :-1 s=READY pgs=853 cs=0 l=1 rx=0x7f99300032b0 tx=0x7f993000e190).stop 2020-06-12T17:51:29.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.329+0000 7f993c94b700 1 -- 172.21.15.38:0/1370667835 reap_dead start 2020-06-12T17:51:29.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.329+0000 7f993c94b700 1 -- 172.21.15.38:0/1370667835 reap_dead start 2020-06-12T17:51:29.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.329+0000 7f993e3ae700 1 -- 172.21.15.38:0/1370667835 shutdown_connections 2020-06-12T17:51:29.334 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.329+0000 7f993e3ae700 1 -- 172.21.15.38:0/1370667835 >> 172.21.15.38:0/1370667835 conn(0x7f99380b5a20 msgr2=0x7f993809b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:29.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.329+0000 7f993e3ae700 1 -- 172.21.15.38:0/1370667835 shutdown_connections 2020-06-12T17:51:29.335 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.329+0000 7f993e3ae700 1 -- 172.21.15.38:0/1370667835 wait complete. 2020-06-12T17:51:29.343 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_7500 2020-06-12T17:51:29.460 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.456+0000 7fe61186d700 1 Processor -- start 2020-06-12T17:51:29.460 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.456+0000 7fe61186d700 1 -- start start 2020-06-12T17:51:29.463 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.457+0000 7fe61186d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe60c0ad5b0 0x7fe60c0b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:29.464 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.457+0000 7fe61186d700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60c146d20 con 0x7fe60c09d8d0 2020-06-12T17:51:29.464 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.457+0000 7fe61186d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60c066a80 con 0x7fe60c146680 2020-06-12T17:51:29.464 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.457+0000 7fe61186d700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe60c146f50 con 0x7fe60c0ad5b0 2020-06-12T17:51:29.464 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.457+0000 7fe60a7fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe60c0ad5b0 0x7fe60c0b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:29.464 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.458+0000 7fe60b7fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe60c09d8d0 0x7fe60c1421d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41672/0 (socket says 172.21.15.38:41672) 2020-06-12T17:51:29.465 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.458+0000 7fe60a7fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe60c0ad5b0 0x7fe60c0b2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39854/0 (socket says 172.21.15.38:39854) 2020-06-12T17:51:29.465 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.458+0000 7fe60b7fe700 1 -- 172.21.15.38:0/1668559430 learned_addr learned my addr 172.21.15.38:0/1668559430 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:29.465 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.458+0000 7fe60a7fc700 1 -- 172.21.15.38:0/1668559430 >> v1:172.21.15.150:6789/0 conn(0x7fe60c146680 legacy=0x7fe60c09d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:29.465 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.458+0000 7fe60a7fc700 1 -- 172.21.15.38:0/1668559430 >> v1:172.21.15.38:6789/0 conn(0x7fe60c09d8d0 legacy=0x7fe60c1421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:29.465 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.458+0000 7fe609ffb700 1 -- 172.21.15.38:0/1668559430 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877382095 0 0) 0x7fe60c146d20 con 0x7fe60c09d8d0 2020-06-12T17:51:29.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.458+0000 7fe60a7fc700 1 -- 172.21.15.38:0/1668559430 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60c146a60 con 0x7fe60c0ad5b0 2020-06-12T17:51:29.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.458+0000 7fe60a7fc700 1 --2- 172.21.15.38:0/1668559430 >> v2:172.21.15.38:3300/0 conn(0x7fe60c0ad5b0 0x7fe60c0b2eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe5fc002f30 tx=0x7fe5fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.458+0000 7fe60a7fc700 1 --2- 172.21.15.38:0/1668559430 >> v2:172.21.15.38:3300/0 conn(0x7fe60c0ad5b0 0x7fe60c0b2eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe5fc002f30 tx=0x7fe5fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.466 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.458+0000 7fe60a7fc700 1 --2- 172.21.15.38:0/1668559430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe60c0ad5b0 0x7fe60c0b2eb0 secure :-1 s=READY pgs=855 cs=0 l=1 rx=0x7fe5fc002f30 tx=0x7fe5fc007e60).ready entity=mon.0 client_cookie=151d9282bc85ba2e server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:29.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.458+0000 7fe60a7fc700 1 --2- 172.21.15.38:0/1668559430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe60c0ad5b0 0x7fe60c0b2eb0 secure :-1 s=THROTTLE_DONE pgs=855 cs=0 l=1 rx=0x7fe5fc002f30 tx=0x7fe5fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.458+0000 7fe609ffb700 1 -- 172.21.15.38:0/1668559430 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5fc00ae80 con 0x7fe60c0ad5b0 2020-06-12T17:51:29.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.458+0000 7fe60a7fc700 1 --2- 172.21.15.38:0/1668559430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe60c0ad5b0 0x7fe60c0b2eb0 secure :-1 s=THROTTLE_DONE pgs=855 cs=0 l=1 rx=0x7fe5fc002f30 tx=0x7fe5fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.458+0000 7fe60a7fc700 1 --2- 172.21.15.38:0/1668559430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe60c0ad5b0 0x7fe60c0b2eb0 secure :-1 s=THROTTLE_DONE pgs=855 cs=0 l=1 rx=0x7fe5fc002f30 tx=0x7fe5fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.467 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.458+0000 7fe609ffb700 1 -- 172.21.15.38:0/1668559430 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5fc013a20 con 0x7fe60c0ad5b0 2020-06-12T17:51:29.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.458+0000 7fe609ffb700 1 -- 172.21.15.38:0/1668559430 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5fc013dc0 con 0x7fe60c0ad5b0 2020-06-12T17:51:29.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.458+0000 7fe61186d700 1 -- 172.21.15.38:0/1668559430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe60c0ad5b0 msgr2=0x7fe60c0b2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:29.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.458+0000 7fe61186d700 1 --2- 172.21.15.38:0/1668559430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe60c0ad5b0 0x7fe60c0b2eb0 secure :-1 s=READY pgs=855 cs=0 l=1 rx=0x7fe5fc002f30 tx=0x7fe5fc007e60).stop 2020-06-12T17:51:29.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.459+0000 7fe61186d700 1 -- 172.21.15.38:0/1668559430 shutdown_connections 2020-06-12T17:51:29.468 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.459+0000 7fe61186d700 1 --2- 172.21.15.38:0/1668559430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe60c0ad5b0 0x7fe60c0b2eb0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:29.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.459+0000 7fe61186d700 1 -- 172.21.15.38:0/1668559430 >> 172.21.15.38:0/1668559430 conn(0x7fe60c0b5a20 msgr2=0x7fe60c05ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:29.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.459+0000 7fe61186d700 1 -- 172.21.15.38:0/1668559430 shutdown_connections 2020-06-12T17:51:29.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.459+0000 7fe61186d700 1 -- 172.21.15.38:0/1668559430 wait complete. 2020-06-12T17:51:29.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.460+0000 7fe61186d700 1 Processor -- start 2020-06-12T17:51:29.469 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.460+0000 7fe61186d700 1 -- start start 2020-06-12T17:51:29.473 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.461+0000 7fe61186d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe60c0ad5b0 0x7fe60c0b2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:29.473 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.461+0000 7fe61186d700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60c153500 con 0x7fe60c09d8d0 2020-06-12T17:51:29.474 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.461+0000 7fe61186d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60c1537a0 con 0x7fe60c146680 2020-06-12T17:51:29.474 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.461+0000 7fe60affd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe60c09d8d0 0x7fe60c065ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41674/0 (socket says 172.21.15.38:41674) 2020-06-12T17:51:29.474 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.461+0000 7fe60affd700 1 -- 172.21.15.38:0/2422869397 learned_addr learned my addr 172.21.15.38:0/2422869397 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:29.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.461+0000 7fe61186d700 1 -- 172.21.15.38:0/2422869397 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c153a40 con 0x7fe60c0ad5b0 2020-06-12T17:51:29.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.461+0000 7fe60a7fc700 1 --2- 172.21.15.38:0/2422869397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe60c0ad5b0 0x7fe60c0b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:29.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.461+0000 7fe603fff700 1 -- 172.21.15.38:0/2422869397 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730280966 0 0) 0x7fe60c153500 con 0x7fe60c09d8d0 2020-06-12T17:51:29.475 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.461+0000 7fe603fff700 1 -- 172.21.15.38:0/2422869397 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5f0002fe0 con 0x7fe60c09d8d0 2020-06-12T17:51:29.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.461+0000 7fe603fff700 1 -- 172.21.15.38:0/2422869397 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4182158205 0 0) 0x7fe60c1537a0 con 0x7fe60c146680 2020-06-12T17:51:29.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.461+0000 7fe603fff700 1 -- 172.21.15.38:0/2422869397 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe60c153500 con 0x7fe60c146680 2020-06-12T17:51:29.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.461+0000 7fe603fff700 1 -- 172.21.15.38:0/2422869397 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2230946567 0 0) 0x7fe5f0002fe0 con 0x7fe60c09d8d0 2020-06-12T17:51:29.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.461+0000 7fe603fff700 1 -- 172.21.15.38:0/2422869397 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe60c1537a0 con 0x7fe60c09d8d0 2020-06-12T17:51:29.476 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.461+0000 7fe603fff700 1 -- 172.21.15.38:0/2422869397 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fe5f4001930 con 0x7fe60c09d8d0 2020-06-12T17:51:29.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.461+0000 7fe60a7fc700 1 -- 172.21.15.38:0/2422869397 >> v1:172.21.15.150:6789/0 conn(0x7fe60c146680 legacy=0x7fe60c0b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:29.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.461+0000 7fe60a7fc700 1 -- 172.21.15.38:0/2422869397 >> v1:172.21.15.38:6789/0 conn(0x7fe60c09d8d0 legacy=0x7fe60c065ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:29.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.461+0000 7fe60a7fc700 1 -- 172.21.15.38:0/2422869397 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60c0b1e80 con 0x7fe60c0ad5b0 2020-06-12T17:51:29.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.461+0000 7fe60a7fc700 1 --2- 172.21.15.38:0/2422869397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe60c0ad5b0 0x7fe60c0b2770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe5fc002f30 tx=0x7fe5fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.477 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.461+0000 7fe60a7fc700 1 --2- 172.21.15.38:0/2422869397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe60c0ad5b0 0x7fe60c0b2770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe5fc002f30 tx=0x7fe5fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.478 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.461+0000 7fe60a7fc700 1 --2- 172.21.15.38:0/2422869397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe60c0ad5b0 0x7fe60c0b2770 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7fe5fc002f30 tx=0x7fe5fc007e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:29.478 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.461+0000 7fe60a7fc700 1 --2- 172.21.15.38:0/2422869397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe60c0ad5b0 0x7fe60c0b2770 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fe5fc002f30 tx=0x7fe5fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.478 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.461+0000 7fe603fff700 1 -- 172.21.15.38:0/2422869397 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5fc011920 con 0x7fe60c0ad5b0 2020-06-12T17:51:29.478 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.461+0000 7fe60a7fc700 1 --2- 172.21.15.38:0/2422869397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe60c0ad5b0 0x7fe60c0b2770 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fe5fc002f30 tx=0x7fe5fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.479 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.462+0000 7fe60a7fc700 1 --2- 172.21.15.38:0/2422869397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe60c0ad5b0 0x7fe60c0b2770 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fe5fc002f30 tx=0x7fe5fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.479 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.462+0000 7fe603fff700 1 -- 172.21.15.38:0/2422869397 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5fc011a80 con 0x7fe60c0ad5b0 2020-06-12T17:51:29.479 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.462+0000 7fe61186d700 1 -- 172.21.15.38:0/2422869397 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe60c153ee0 con 0x7fe60c0ad5b0 2020-06-12T17:51:29.479 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.462+0000 7fe603fff700 1 -- 172.21.15.38:0/2422869397 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5fc008b60 con 0x7fe60c0ad5b0 2020-06-12T17:51:29.479 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.462+0000 7fe61186d700 1 -- 172.21.15.38:0/2422869397 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe60c157340 con 0x7fe60c0ad5b0 2020-06-12T17:51:29.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.462+0000 7fe60a7fc700 1 --2- 172.21.15.38:0/2422869397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe60c0ad5b0 0x7fe60c0b2770 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fe5fc002f30 tx=0x7fe5fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.463+0000 7fe61186d700 1 -- 172.21.15.38:0/2422869397 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe60c153340 con 0x7fe60c0ad5b0 2020-06-12T17:51:29.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.463+0000 7fe603fff700 1 -- 172.21.15.38:0/2422869397 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fe5fc008d10 con 0x7fe60c0ad5b0 2020-06-12T17:51:29.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.463+0000 7fe60a7fc700 1 --2- 172.21.15.38:0/2422869397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe60c0ad5b0 0x7fe60c0b2770 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fe5fc002f30 tx=0x7fe5fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.480 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.463+0000 7fe603fff700 1 --2- 172.21.15.38:0/2422869397 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe5f004dd40 0x7fe5f0050200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:29.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.463+0000 7fe603fff700 1 -- 172.21.15.38:0/2422869397 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe5fc060a90 con 0x7fe60c0ad5b0 2020-06-12T17:51:29.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.463+0000 7fe60affd700 1 --2- 172.21.15.38:0/2422869397 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe5f004dd40 0x7fe5f0050200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:29.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.463+0000 7fe60affd700 1 --2- 172.21.15.38:0/2422869397 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe5f004dd40 0x7fe5f0050200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe5f4001700 tx=0x7fe5f4001df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.463+0000 7fe60affd700 1 --2- 172.21.15.38:0/2422869397 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe5f004dd40 0x7fe5f0050200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe5f4001700 tx=0x7fe5f4001df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.481 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.463+0000 7fe60affd700 1 --2- 172.21.15.38:0/2422869397 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe5f004dd40 0x7fe5f0050200 secure :-1 s=READY pgs=333 cs=0 l=1 rx=0x7fe5f4001700 tx=0x7fe5f4001df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:29.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.467+0000 7fe60a7fc700 1 --2- 172.21.15.38:0/2422869397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe60c0ad5b0 0x7fe60c0b2770 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fe5fc002f30 tx=0x7fe5fc007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.482 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.467+0000 7fe603fff700 1 -- 172.21.15.38:0/2422869397 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fe5fc03c2b0 con 0x7fe60c0ad5b0 2020-06-12T17:51:29.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.662+0000 7fe61186d700 1 -- 172.21.15.38:0/2422869397 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_7500", "target": ["mon-mgr", ""]}) v1 -- 0x7fe60c157860 con 0x7fe5f004dd40 2020-06-12T17:51:29.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.665+0000 7fe60affd700 1 --2- 172.21.15.38:0/2422869397 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe5f004dd40 0x7fe5f0050200 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7fe5f4001700 tx=0x7fe5f4001df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:29.669 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.665+0000 7fe603fff700 1 -- 172.21.15.38:0/2422869397 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7fe60c157860 con 0x7fe5f004dd40 2020-06-12T17:51:29.669 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_7500/a8629fb7-0503-4ef0-b69e-fe1923a77dac 2020-06-12T17:51:29.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.667+0000 7fe61186d700 1 -- 172.21.15.38:0/2422869397 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe5f004dd40 msgr2=0x7fe5f0050200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:29.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.667+0000 7fe61186d700 1 --2- 172.21.15.38:0/2422869397 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe5f004dd40 0x7fe5f0050200 secure :-1 s=READY pgs=333 cs=0 l=1 rx=0x7fe5f4001700 tx=0x7fe5f4001df0).stop 2020-06-12T17:51:29.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.667+0000 7fe61186d700 1 -- 172.21.15.38:0/2422869397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe60c0ad5b0 msgr2=0x7fe60c0b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:29.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.667+0000 7fe61186d700 1 --2- 172.21.15.38:0/2422869397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe60c0ad5b0 0x7fe60c0b2770 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7fe5fc002f30 tx=0x7fe5fc007e60).stop 2020-06-12T17:51:29.671 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.667+0000 7fe61186d700 1 -- 172.21.15.38:0/2422869397 shutdown_connections 2020-06-12T17:51:29.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.667+0000 7fe61186d700 1 --2- 172.21.15.38:0/2422869397 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fe5f004dd40 0x7fe5f0050200 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:29.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.667+0000 7fe61186d700 1 --2- 172.21.15.38:0/2422869397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe60c0ad5b0 0x7fe60c0b2770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:29.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.667+0000 7fe61186d700 1 -- 172.21.15.38:0/2422869397 >> 172.21.15.38:0/2422869397 conn(0x7fe60c0b5a20 msgr2=0x7fe60c145520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:29.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.667+0000 7fe61186d700 1 -- 172.21.15.38:0/2422869397 shutdown_connections 2020-06-12T17:51:29.672 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:29.667+0000 7fe61186d700 1 -- 172.21.15.38:0/2422869397 wait complete. 2020-06-12T17:51:29.680 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_7500 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_7500/a8629fb7-0503-4ef0-b69e-fe1923a77dac 2020-06-12T17:51:29.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:29.681 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:29.682 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:29.697 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:29.698 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:29.698 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7500/a8629fb7-0503-4ef0-b69e-fe1923a77dac/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:29.792 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:29.792 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:29.792 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015143 s, 69.2 MB/s 2020-06-12T17:51:29.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:29.794 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:29.794 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:29.809 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:29.810 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:29.810 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7500/a8629fb7-0503-4ef0-b69e-fe1923a77dac/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:29.897 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:29.898 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:29.898 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011207 s, 93.6 MB/s 2020-06-12T17:51:29.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:29.899 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:29.900 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:29.915 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:29.915 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:29.916 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7500/a8629fb7-0503-4ef0-b69e-fe1923a77dac/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:30.002 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:30.002 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:30.002 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935096 s, 112 MB/s 2020-06-12T17:51:30.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:30.004 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:30.004 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:30.019 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:30.020 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:30.020 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7500/a8629fb7-0503-4ef0-b69e-fe1923a77dac/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:30.107 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:30.107 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:30.107 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112085 s, 93.6 MB/s 2020-06-12T17:51:30.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:30.109 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:30.109 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:30.124 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:30.125 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:30.125 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7500/a8629fb7-0503-4ef0-b69e-fe1923a77dac/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:30.213 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:30.214 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:30.214 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121317 s, 86.4 MB/s 2020-06-12T17:51:30.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:30.216 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:30.216 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:30.231 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:30.232 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:30.232 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7500/a8629fb7-0503-4ef0-b69e-fe1923a77dac/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:30.316 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:30.317 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:30.317 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00901166 s, 116 MB/s 2020-06-12T17:51:30.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:30.319 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:30.319 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:30.334 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:30.335 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:30.335 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7500/a8629fb7-0503-4ef0-b69e-fe1923a77dac/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:30.425 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:30.425 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:30.426 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137985 s, 76.0 MB/s 2020-06-12T17:51:30.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:30.428 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:30.429 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:30.444 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:30.445 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:30.446 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7500/a8629fb7-0503-4ef0-b69e-fe1923a77dac/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:30.534 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:30.534 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:30.534 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121766 s, 86.1 MB/s 2020-06-12T17:51:30.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:30.536 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:30.536 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:30.562 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:30.563 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:30.563 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7500/a8629fb7-0503-4ef0-b69e-fe1923a77dac/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:30.647 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:30.647 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:30.647 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103838 s, 101 MB/s 2020-06-12T17:51:30.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:30.649 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:30.649 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:30.665 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:30.665 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:30.666 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_7500/a8629fb7-0503-4ef0-b69e-fe1923a77dac/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:30.752 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:30.752 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:30.752 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105288 s, 99.6 MB/s 2020-06-12T17:51:30.753 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_1795 2020-06-12T17:51:30.870 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.867+0000 7f9f4d5ac700 1 Processor -- start 2020-06-12T17:51:30.871 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.867+0000 7f9f4d5ac700 1 -- start start 2020-06-12T17:51:30.876 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.868+0000 7f9f4d5ac700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f4809b190 0x7f9f48066b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:30.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.868+0000 7f9f4d5ac700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f48147550 con 0x7f9f481438f0 2020-06-12T17:51:30.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.868+0000 7f9f4d5ac700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f4809e110 con 0x7f9f4809dd30 2020-06-12T17:51:30.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.868+0000 7f9f4d5ac700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f48067380 con 0x7f9f4809b190 2020-06-12T17:51:30.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.868+0000 7f9f477fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f9f481438f0 0x7f9f480b3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41686/0 (socket says 172.21.15.38:41686) 2020-06-12T17:51:30.877 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.868+0000 7f9f477fe700 1 -- 172.21.15.38:0/3419139952 learned_addr learned my addr 172.21.15.38:0/3419139952 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:30.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.868+0000 7f9f467fc700 1 --2- 172.21.15.38:0/3419139952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f4809b190 0x7f9f48066b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:30.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.868+0000 7f9f45ffb700 1 -- 172.21.15.38:0/3419139952 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1887898905 0 0) 0x7f9f48147550 con 0x7f9f481438f0 2020-06-12T17:51:30.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.868+0000 7f9f45ffb700 1 -- 172.21.15.38:0/3419139952 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f2c003230 con 0x7f9f481438f0 2020-06-12T17:51:30.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.868+0000 7f9f45ffb700 1 -- 172.21.15.38:0/3419139952 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2910933285 0 0) 0x7f9f4809e110 con 0x7f9f4809dd30 2020-06-12T17:51:30.878 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.868+0000 7f9f45ffb700 1 -- 172.21.15.38:0/3419139952 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f48147550 con 0x7f9f4809dd30 2020-06-12T17:51:30.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.868+0000 7f9f45ffb700 1 -- 172.21.15.38:0/3419139952 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 245657253 0 0) 0x7f9f2c003230 con 0x7f9f481438f0 2020-06-12T17:51:30.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.868+0000 7f9f45ffb700 1 -- 172.21.15.38:0/3419139952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f4809b190 msgr2=0x7f9f48066b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:30.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.868+0000 7f9f45ffb700 1 --2- 172.21.15.38:0/3419139952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f4809b190 0x7f9f48066b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:30.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.868+0000 7f9f45ffb700 1 -- 172.21.15.38:0/3419139952 >> v1:172.21.15.150:6789/0 conn(0x7f9f4809dd30 legacy=0x7f9f481431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:30.879 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.868+0000 7f9f45ffb700 1 -- 172.21.15.38:0/3419139952 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f48067000 con 0x7f9f481438f0 2020-06-12T17:51:30.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.868+0000 7f9f45ffb700 1 -- 172.21.15.38:0/3419139952 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f9f40001a50 con 0x7f9f481438f0 2020-06-12T17:51:30.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.868+0000 7f9f45ffb700 1 -- 172.21.15.38:0/3419139952 >> v1:172.21.15.38:6789/0 conn(0x7f9f481438f0 legacy=0x7f9f480b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:30.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.868+0000 7f9f45ffb700 1 --2- 172.21.15.38:0/3419139952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f2c0038e0 0x7f9f2c003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:30.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.868+0000 7f9f45ffb700 1 --2- 172.21.15.38:0/3419139952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f4809b190 0x7f9f2c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:30.880 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.868+0000 7f9f45ffb700 1 --2- 172.21.15.38:0/3419139952 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f2c004930 0x7f9f2c004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:30.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.868+0000 7f9f45ffb700 1 -- 172.21.15.38:0/3419139952 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f48067380 con 0x7f9f2c004930 2020-06-12T17:51:30.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.868+0000 7f9f45ffb700 1 -- 172.21.15.38:0/3419139952 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c005210 con 0x7f9f2c0038e0 2020-06-12T17:51:30.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.868+0000 7f9f45ffb700 1 -- 172.21.15.38:0/3419139952 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c00b720 con 0x7f9f4809b190 2020-06-12T17:51:30.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.869+0000 7f9f477fe700 1 --2- 172.21.15.38:0/3419139952 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f2c004930 0x7f9f2c004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:30.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.869+0000 7f9f467fc700 1 --2- 172.21.15.38:0/3419139952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f4809b190 0x7f9f2c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:30.881 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.869+0000 7f9f46ffd700 1 --2- 172.21.15.38:0/3419139952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f2c0038e0 0x7f9f2c003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:30.882 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.869+0000 7f9f477fe700 1 -- 172.21.15.38:0/3419139952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f4809b190 msgr2=0x7f9f2c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:30.882 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.869+0000 7f9f477fe700 1 --2- 172.21.15.38:0/3419139952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f4809b190 0x7f9f2c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:30.882 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.869+0000 7f9f477fe700 1 -- 172.21.15.38:0/3419139952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f2c0038e0 msgr2=0x7f9f2c003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:30.882 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.869+0000 7f9f477fe700 1 --2- 172.21.15.38:0/3419139952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f2c0038e0 0x7f9f2c003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:30.882 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.869+0000 7f9f477fe700 1 -- 172.21.15.38:0/3419139952 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c003230 con 0x7f9f2c004930 2020-06-12T17:51:30.883 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.869+0000 7f9f46ffd700 1 --2- 172.21.15.38:0/3419139952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f2c0038e0 0x7f9f2c003ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:51:30.883 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.869+0000 7f9f477fe700 1 --2- 172.21.15.38:0/3419139952 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f2c004930 0x7f9f2c004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9f40001820 tx=0x7f9f4000ebd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:30.883 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.869+0000 7f9f477fe700 1 --2- 172.21.15.38:0/3419139952 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f2c004930 0x7f9f2c004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9f40001820 tx=0x7f9f4000ebd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:30.883 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.869+0000 7f9f477fe700 1 --2- 172.21.15.38:0/3419139952 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f2c004930 0x7f9f2c004db0 secure :-1 s=READY pgs=858 cs=0 l=1 rx=0x7f9f40001820 tx=0x7f9f4000ebd0).ready entity=mon.0 client_cookie=ade1ad06bec916ed server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:30.883 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.869+0000 7f9f477fe700 1 --2- 172.21.15.38:0/3419139952 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f2c004930 0x7f9f2c004db0 secure :-1 s=THROTTLE_DONE pgs=858 cs=0 l=1 rx=0x7f9f40001820 tx=0x7f9f4000ebd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:30.884 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.869+0000 7f9f45ffb700 1 -- 172.21.15.38:0/3419139952 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f4000e540 con 0x7f9f2c004930 2020-06-12T17:51:30.884 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.869+0000 7f9f477fe700 1 --2- 172.21.15.38:0/3419139952 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f2c004930 0x7f9f2c004db0 secure :-1 s=THROTTLE_DONE pgs=858 cs=0 l=1 rx=0x7f9f40001820 tx=0x7f9f4000ebd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:30.884 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.869+0000 7f9f477fe700 1 --2- 172.21.15.38:0/3419139952 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f2c004930 0x7f9f2c004db0 secure :-1 s=THROTTLE_DONE pgs=858 cs=0 l=1 rx=0x7f9f40001820 tx=0x7f9f4000ebd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:30.884 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.869+0000 7f9f45ffb700 1 -- 172.21.15.38:0/3419139952 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4000e6a0 con 0x7f9f2c004930 2020-06-12T17:51:30.884 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.869+0000 7f9f45ffb700 1 -- 172.21.15.38:0/3419139952 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f400100b0 con 0x7f9f2c004930 2020-06-12T17:51:30.885 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.869+0000 7f9f4d5ac700 1 -- 172.21.15.38:0/3419139952 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f2c004930 msgr2=0x7f9f2c004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:30.885 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.869+0000 7f9f4d5ac700 1 --2- 172.21.15.38:0/3419139952 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f2c004930 0x7f9f2c004db0 secure :-1 s=READY pgs=858 cs=0 l=1 rx=0x7f9f40001820 tx=0x7f9f4000ebd0).stop 2020-06-12T17:51:30.885 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.869+0000 7f9f477fe700 1 -- 172.21.15.38:0/3419139952 reap_dead start 2020-06-12T17:51:30.885 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.870+0000 7f9f4d5ac700 1 -- 172.21.15.38:0/3419139952 shutdown_connections 2020-06-12T17:51:30.885 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.870+0000 7f9f4d5ac700 1 -- 172.21.15.38:0/3419139952 >> 172.21.15.38:0/3419139952 conn(0x7f9f480b5a20 msgr2=0x7f9f4805ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:30.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.870+0000 7f9f4d5ac700 1 -- 172.21.15.38:0/3419139952 shutdown_connections 2020-06-12T17:51:30.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.870+0000 7f9f4d5ac700 1 -- 172.21.15.38:0/3419139952 wait complete. 2020-06-12T17:51:30.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.871+0000 7f9f4d5ac700 1 Processor -- start 2020-06-12T17:51:30.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.871+0000 7f9f4d5ac700 1 -- start start 2020-06-12T17:51:30.886 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.871+0000 7f9f4d5ac700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9f48065b10 0x7f9f48141b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:30.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.871+0000 7f9f4d5ac700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f4809d220 con 0x7f9f4808f7c0 2020-06-12T17:51:30.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.871+0000 7f9f4d5ac700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f4809b8b0 con 0x7f9f4808fc70 2020-06-12T17:51:30.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.871+0000 7f9f4d5ac700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f48065ef0 con 0x7f9f48065b10 2020-06-12T17:51:30.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.871+0000 7f9f467fc700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f9f4808f7c0 0x7f9f48140700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41696/0 (socket says 172.21.15.38:41696) 2020-06-12T17:51:30.887 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.871+0000 7f9f467fc700 1 -- 172.21.15.38:0/3183421027 learned_addr learned my addr 172.21.15.38:0/3183421027 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:30.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.872+0000 7f9f46ffd700 1 --2- 172.21.15.38:0/3183421027 >> v2:172.21.15.150:3300/0 conn(0x7f9f48065b10 0x7f9f48141b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:30.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.872+0000 7f9f37fff700 1 -- 172.21.15.38:0/3183421027 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2948274879 0 0) 0x7f9f4809d220 con 0x7f9f4808f7c0 2020-06-12T17:51:30.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.872+0000 7f9f37fff700 1 -- 172.21.15.38:0/3183421027 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f24002fe0 con 0x7f9f4808f7c0 2020-06-12T17:51:30.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.872+0000 7f9f37fff700 1 -- 172.21.15.38:0/3183421027 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3410591621 0 0) 0x7f9f24002fe0 con 0x7f9f4808f7c0 2020-06-12T17:51:30.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.872+0000 7f9f46ffd700 1 -- 172.21.15.38:0/3183421027 >> v1:172.21.15.150:6789/0 conn(0x7f9f4808fc70 legacy=0x7f9f4809bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:30.888 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.872+0000 7f9f46ffd700 1 -- 172.21.15.38:0/3183421027 >> v1:172.21.15.38:6789/0 conn(0x7f9f4808f7c0 legacy=0x7f9f48140700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:30.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.872+0000 7f9f46ffd700 1 -- 172.21.15.38:0/3183421027 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f48141f60 con 0x7f9f48065b10 2020-06-12T17:51:30.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.872+0000 7f9f46ffd700 1 --2- 172.21.15.38:0/3183421027 >> v2:172.21.15.150:3300/0 conn(0x7f9f48065b10 0x7f9f48141b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9f38001630 tx=0x7f9f3c003930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:30.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.872+0000 7f9f46ffd700 1 --2- 172.21.15.38:0/3183421027 >> v2:172.21.15.150:3300/0 conn(0x7f9f48065b10 0x7f9f48141b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9f38001630 tx=0x7f9f3c003930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:30.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.872+0000 7f9f46ffd700 1 --2- 172.21.15.38:0/3183421027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f48065b10 0x7f9f48141b00 secure :-1 s=READY pgs=479 cs=0 l=1 rx=0x7f9f38001630 tx=0x7f9f3c003930).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:30.889 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.872+0000 7f9f46ffd700 1 --2- 172.21.15.38:0/3183421027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f48065b10 0x7f9f48141b00 secure :-1 s=THROTTLE_DONE pgs=479 cs=0 l=1 rx=0x7f9f38001630 tx=0x7f9f3c003930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:30.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.872+0000 7f9f37fff700 1 -- 172.21.15.38:0/3183421027 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f38001490 con 0x7f9f48065b10 2020-06-12T17:51:30.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.872+0000 7f9f46ffd700 1 --2- 172.21.15.38:0/3183421027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f48065b10 0x7f9f48141b00 secure :-1 s=THROTTLE_DONE pgs=479 cs=0 l=1 rx=0x7f9f38001630 tx=0x7f9f3c003930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:30.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.872+0000 7f9f4d5ac700 1 -- 172.21.15.38:0/3183421027 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f4809cf10 con 0x7f9f48065b10 2020-06-12T17:51:30.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.872+0000 7f9f46ffd700 1 --2- 172.21.15.38:0/3183421027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f48065b10 0x7f9f48141b00 secure :-1 s=THROTTLE_DONE pgs=479 cs=0 l=1 rx=0x7f9f38001630 tx=0x7f9f3c003930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:30.890 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.872+0000 7f9f37fff700 1 -- 172.21.15.38:0/3183421027 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3c001a00 con 0x7f9f48065b10 2020-06-12T17:51:30.891 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.872+0000 7f9f37fff700 1 -- 172.21.15.38:0/3183421027 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f3c001d60 con 0x7f9f48065b10 2020-06-12T17:51:30.891 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.872+0000 7f9f4d5ac700 1 -- 172.21.15.38:0/3183421027 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4809caf0 con 0x7f9f48065b10 2020-06-12T17:51:30.891 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.873+0000 7f9f46ffd700 1 --2- 172.21.15.38:0/3183421027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f48065b10 0x7f9f48141b00 secure :-1 s=THROTTLE_DONE pgs=479 cs=0 l=1 rx=0x7f9f38001630 tx=0x7f9f3c003930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:30.891 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.873+0000 7f9f4d5ac700 1 -- 172.21.15.38:0/3183421027 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f4809ba40 con 0x7f9f48065b10 2020-06-12T17:51:30.893 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.873+0000 7f9f37fff700 1 -- 172.21.15.38:0/3183421027 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f9f3c00c810 con 0x7f9f48065b10 2020-06-12T17:51:30.893 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.873+0000 7f9f46ffd700 1 --2- 172.21.15.38:0/3183421027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f48065b10 0x7f9f48141b00 secure :-1 s=THROTTLE_DONE pgs=479 cs=0 l=1 rx=0x7f9f38001630 tx=0x7f9f3c003930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:30.893 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.874+0000 7f9f37fff700 1 --2- 172.21.15.38:0/3183421027 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9f2404d820 0x7f9f2404fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:30.893 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.874+0000 7f9f37fff700 1 -- 172.21.15.38:0/3183421027 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9f3c060470 con 0x7f9f48065b10 2020-06-12T17:51:30.893 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.874+0000 7f9f467fc700 1 --2- 172.21.15.38:0/3183421027 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9f2404d820 0x7f9f2404fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:30.894 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.874+0000 7f9f467fc700 1 --2- 172.21.15.38:0/3183421027 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9f2404d820 0x7f9f2404fce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9f380016c0 tx=0x7f9f38007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:30.894 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.874+0000 7f9f467fc700 1 --2- 172.21.15.38:0/3183421027 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9f2404d820 0x7f9f2404fce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9f380016c0 tx=0x7f9f38007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:30.894 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.874+0000 7f9f467fc700 1 --2- 172.21.15.38:0/3183421027 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9f2404d820 0x7f9f2404fce0 secure :-1 s=READY pgs=334 cs=0 l=1 rx=0x7f9f380016c0 tx=0x7f9f38007e60).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:30.894 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.878+0000 7f9f46ffd700 1 --2- 172.21.15.38:0/3183421027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f48065b10 0x7f9f48141b00 secure :-1 s=THROTTLE_DONE pgs=479 cs=0 l=1 rx=0x7f9f38001630 tx=0x7f9f3c003930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:30.894 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:30.878+0000 7f9f37fff700 1 -- 172.21.15.38:0/3183421027 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f9f3c03bc30 con 0x7f9f48065b10 2020-06-12T17:51:31.073 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.069+0000 7f9f4d5ac700 1 -- 172.21.15.38:0/3183421027 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_1795", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f48056c30 con 0x7f9f2404d820 2020-06-12T17:51:31.092 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.088+0000 7f9f467fc700 1 --2- 172.21.15.38:0/3183421027 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9f2404d820 0x7f9f2404fce0 secure :-1 s=THROTTLE_DONE pgs=334 cs=0 l=1 rx=0x7f9f380016c0 tx=0x7f9f38007e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:31.092 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.088+0000 7f9f37fff700 1 -- 172.21.15.38:0/3183421027 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f9f48056c30 con 0x7f9f2404d820 2020-06-12T17:51:31.093 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.090+0000 7f9f4d5ac700 1 -- 172.21.15.38:0/3183421027 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9f2404d820 msgr2=0x7f9f2404fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:31.094 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.090+0000 7f9f4d5ac700 1 --2- 172.21.15.38:0/3183421027 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9f2404d820 0x7f9f2404fce0 secure :-1 s=READY pgs=334 cs=0 l=1 rx=0x7f9f380016c0 tx=0x7f9f38007e60).stop 2020-06-12T17:51:31.094 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.090+0000 7f9f4d5ac700 1 -- 172.21.15.38:0/3183421027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f48065b10 msgr2=0x7f9f48141b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:31.094 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.090+0000 7f9f4d5ac700 1 --2- 172.21.15.38:0/3183421027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f48065b10 0x7f9f48141b00 secure :-1 s=READY pgs=479 cs=0 l=1 rx=0x7f9f38001630 tx=0x7f9f3c003930).stop 2020-06-12T17:51:31.094 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.090+0000 7f9f4d5ac700 1 -- 172.21.15.38:0/3183421027 shutdown_connections 2020-06-12T17:51:31.094 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.090+0000 7f9f4d5ac700 1 --2- 172.21.15.38:0/3183421027 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f9f2404d820 0x7f9f2404fce0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:31.095 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.090+0000 7f9f4d5ac700 1 --2- 172.21.15.38:0/3183421027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f48065b10 0x7f9f48141b00 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:31.095 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.090+0000 7f9f4d5ac700 1 -- 172.21.15.38:0/3183421027 >> 172.21.15.38:0/3183421027 conn(0x7f9f480b5a20 msgr2=0x7f9f4805ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:31.095 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.090+0000 7f9f4d5ac700 1 -- 172.21.15.38:0/3183421027 shutdown_connections 2020-06-12T17:51:31.095 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.090+0000 7f9f4d5ac700 1 -- 172.21.15.38:0/3183421027 wait complete. 2020-06-12T17:51:31.103 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume getpath cephfs subvolume_1795 2020-06-12T17:51:31.221 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.218+0000 7fd2e9ccf700 1 Processor -- start 2020-06-12T17:51:31.222 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.218+0000 7fd2e9ccf700 1 -- start start 2020-06-12T17:51:31.229 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.219+0000 7fd2e9ccf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2e40b2eb0 0x7fd2e414d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:31.229 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.219+0000 7fd2e9ccf700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e4146d20 con 0x7fd2e4146680 2020-06-12T17:51:31.229 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.219+0000 7fd2e9ccf700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e4066a80 con 0x7fd2e40ad5b0 2020-06-12T17:51:31.230 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.219+0000 7fd2e9ccf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e4146f50 con 0x7fd2e40b2eb0 2020-06-12T17:51:31.230 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.219+0000 7fd2e37fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd2e4146680 0x7fd2e409d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41702/0 (socket says 172.21.15.38:41702) 2020-06-12T17:51:31.230 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.219+0000 7fd2e37fe700 1 -- 172.21.15.38:0/2288275002 learned_addr learned my addr 172.21.15.38:0/2288275002 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:31.230 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.219+0000 7fd2e27fc700 1 -- 172.21.15.38:0/2288275002 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3733558248 0 0) 0x7fd2e4146d20 con 0x7fd2e4146680 2020-06-12T17:51:31.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.219+0000 7fd2e27fc700 1 -- 172.21.15.38:0/2288275002 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2d0003230 con 0x7fd2e4146680 2020-06-12T17:51:31.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.219+0000 7fd2e3fff700 1 --2- 172.21.15.38:0/2288275002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2e40b2eb0 0x7fd2e414d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:31.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.219+0000 7fd2e27fc700 1 -- 172.21.15.38:0/2288275002 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3204701282 0 0) 0x7fd2d0003230 con 0x7fd2e4146680 2020-06-12T17:51:31.231 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.219+0000 7fd2e27fc700 1 -- 172.21.15.38:0/2288275002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2e40b2eb0 msgr2=0x7fd2e414d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:31.232 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.219+0000 7fd2e27fc700 1 --2- 172.21.15.38:0/2288275002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2e40b2eb0 0x7fd2e414d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:31.232 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.219+0000 7fd2e27fc700 1 -- 172.21.15.38:0/2288275002 >> v1:172.21.15.150:6789/0 conn(0x7fd2e40ad5b0 legacy=0x7fd2e409d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:31.232 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e27fc700 1 -- 172.21.15.38:0/2288275002 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e4146a60 con 0x7fd2e4146680 2020-06-12T17:51:31.232 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e27fc700 1 -- 172.21.15.38:0/2288275002 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7fd2d40016d0 con 0x7fd2e4146680 2020-06-12T17:51:31.233 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e27fc700 1 -- 172.21.15.38:0/2288275002 >> v1:172.21.15.38:6789/0 conn(0x7fd2e4146680 legacy=0x7fd2e409d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:31.233 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e27fc700 1 --2- 172.21.15.38:0/2288275002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2e40b2eb0 0x7fd2d0003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:31.233 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e27fc700 1 --2- 172.21.15.38:0/2288275002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2d0003bb0 0x7fd2d0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:31.233 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e27fc700 1 --2- 172.21.15.38:0/2288275002 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2d00045e0 0x7fd2d0004a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:31.234 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e27fc700 1 -- 172.21.15.38:0/2288275002 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e4146f50 con 0x7fd2d00045e0 2020-06-12T17:51:31.234 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e27fc700 1 -- 172.21.15.38:0/2288275002 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d0005010 con 0x7fd2d0003bb0 2020-06-12T17:51:31.234 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e27fc700 1 -- 172.21.15.38:0/2288275002 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d00051d0 con 0x7fd2e40b2eb0 2020-06-12T17:51:31.234 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e3fff700 1 --2- 172.21.15.38:0/2288275002 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2d00045e0 0x7fd2d0004a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:31.235 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e37fe700 1 --2- 172.21.15.38:0/2288275002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2e40b2eb0 0x7fd2d0003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:31.235 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e2ffd700 1 --2- 172.21.15.38:0/2288275002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2d0003bb0 0x7fd2d0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:31.235 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e3fff700 1 -- 172.21.15.38:0/2288275002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2e40b2eb0 msgr2=0x7fd2d0003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:31.235 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e3fff700 1 --2- 172.21.15.38:0/2288275002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2e40b2eb0 0x7fd2d0003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:31.235 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e3fff700 1 -- 172.21.15.38:0/2288275002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2d0003bb0 msgr2=0x7fd2d0004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-06-12T17:51:31.236 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e3fff700 1 --2- 172.21.15.38:0/2288275002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2d0003bb0 0x7fd2d0004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-06-12T17:51:31.236 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e3fff700 1 -- 172.21.15.38:0/2288275002 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d0003230 con 0x7fd2d00045e0 2020-06-12T17:51:31.236 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e2ffd700 1 --2- 172.21.15.38:0/2288275002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2d0003bb0 0x7fd2d0004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-06-12T17:51:31.236 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e3fff700 1 --2- 172.21.15.38:0/2288275002 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2d00045e0 0x7fd2d0004a60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd2dc0032b0 tx=0x7fd2dc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:31.236 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e3fff700 1 --2- 172.21.15.38:0/2288275002 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2d00045e0 0x7fd2d0004a60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd2dc0032b0 tx=0x7fd2dc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:31.236 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e3fff700 1 --2- 172.21.15.38:0/2288275002 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2d00045e0 0x7fd2d0004a60 secure :-1 s=READY pgs=861 cs=0 l=1 rx=0x7fd2dc0032b0 tx=0x7fd2dc0081e0).ready entity=mon.0 client_cookie=848b248a83edc309 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:31.237 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e3fff700 1 --2- 172.21.15.38:0/2288275002 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2d00045e0 0x7fd2d0004a60 secure :-1 s=THROTTLE_DONE pgs=861 cs=0 l=1 rx=0x7fd2dc0032b0 tx=0x7fd2dc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:31.237 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e27fc700 1 -- 172.21.15.38:0/2288275002 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2dc010e60 con 0x7fd2d00045e0 2020-06-12T17:51:31.237 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e3fff700 1 --2- 172.21.15.38:0/2288275002 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2d00045e0 0x7fd2d0004a60 secure :-1 s=THROTTLE_DONE pgs=861 cs=0 l=1 rx=0x7fd2dc0032b0 tx=0x7fd2dc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:31.237 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e27fc700 1 -- 172.21.15.38:0/2288275002 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2dc005c30 con 0x7fd2d00045e0 2020-06-12T17:51:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e3fff700 1 --2- 172.21.15.38:0/2288275002 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2d00045e0 0x7fd2d0004a60 secure :-1 s=THROTTLE_DONE pgs=861 cs=0 l=1 rx=0x7fd2dc0032b0 tx=0x7fd2dc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e27fc700 1 -- 172.21.15.38:0/2288275002 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2dc0110c0 con 0x7fd2d00045e0 2020-06-12T17:51:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e9ccf700 1 -- 172.21.15.38:0/2288275002 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2d00045e0 msgr2=0x7fd2d0004a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e9ccf700 1 --2- 172.21.15.38:0/2288275002 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2d00045e0 0x7fd2d0004a60 secure :-1 s=READY pgs=861 cs=0 l=1 rx=0x7fd2dc0032b0 tx=0x7fd2dc0081e0).stop 2020-06-12T17:51:31.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.220+0000 7fd2e3fff700 1 -- 172.21.15.38:0/2288275002 reap_dead start 2020-06-12T17:51:31.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.221+0000 7fd2e9ccf700 1 -- 172.21.15.38:0/2288275002 shutdown_connections 2020-06-12T17:51:31.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.221+0000 7fd2e9ccf700 1 -- 172.21.15.38:0/2288275002 >> 172.21.15.38:0/2288275002 conn(0x7fd2e40b5a20 msgr2=0x7fd2e405ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:31.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.221+0000 7fd2e9ccf700 1 -- 172.21.15.38:0/2288275002 shutdown_connections 2020-06-12T17:51:31.239 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.221+0000 7fd2e9ccf700 1 -- 172.21.15.38:0/2288275002 wait complete. 2020-06-12T17:51:31.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.222+0000 7fd2e9ccf700 1 Processor -- start 2020-06-12T17:51:31.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.222+0000 7fd2e9ccf700 1 -- start start 2020-06-12T17:51:31.240 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.223+0000 7fd2e9ccf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd2e4065d00 0x7fd2e409b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:31.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.223+0000 7fd2e9ccf700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd2e41433e0 0x7fd2e40626a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:31.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.223+0000 7fd2e9ccf700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e409ad70 con 0x7fd2e40b1d00 2020-06-12T17:51:31.241 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.223+0000 7fd2e9ccf700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e40660e0 con 0x7fd2e41433e0 2020-06-12T17:51:31.242 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.223+0000 7fd2e9ccf700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e408ef60 con 0x7fd2e4065d00 2020-06-12T17:51:31.242 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.223+0000 7fd2e2ffd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd2e40b1d00 0x7fd2e4142cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41716/0 (socket says 172.21.15.38:41716) 2020-06-12T17:51:31.242 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.223+0000 7fd2e2ffd700 1 -- 172.21.15.38:0/4011097981 learned_addr learned my addr 172.21.15.38:0/4011097981 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:31.242 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.223+0000 7fd2e3fff700 1 --2- 172.21.15.38:0/4011097981 >> v2:172.21.15.38:3300/0 conn(0x7fd2e41433e0 0x7fd2e40626a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:31.242 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.223+0000 7fd2e37fe700 1 --2- 172.21.15.38:0/4011097981 >> v2:172.21.15.150:3300/0 conn(0x7fd2e4065d00 0x7fd2e409b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.223+0000 7fd2e0ff9700 1 -- 172.21.15.38:0/4011097981 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672172597 0 0) 0x7fd2e409ad70 con 0x7fd2e40b1d00 2020-06-12T17:51:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.223+0000 7fd2e0ff9700 1 -- 172.21.15.38:0/4011097981 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2c4002fe0 con 0x7fd2e40b1d00 2020-06-12T17:51:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.223+0000 7fd2e3fff700 1 -- 172.21.15.38:0/4011097981 >> v2:172.21.15.150:3300/0 conn(0x7fd2e4065d00 msgr2=0x7fd2e409b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.223+0000 7fd2e3fff700 1 --2- 172.21.15.38:0/4011097981 >> v2:172.21.15.150:3300/0 conn(0x7fd2e4065d00 0x7fd2e409b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.223+0000 7fd2e3fff700 1 -- 172.21.15.38:0/4011097981 >> v1:172.21.15.38:6789/0 conn(0x7fd2e40b1d00 legacy=0x7fd2e4142cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:31.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.223+0000 7fd2e3fff700 1 -- 172.21.15.38:0/4011097981 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e408f200 con 0x7fd2e41433e0 2020-06-12T17:51:31.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.223+0000 7fd2e3fff700 1 --2- 172.21.15.38:0/4011097981 >> v2:172.21.15.38:3300/0 conn(0x7fd2e41433e0 0x7fd2e40626a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2e40aebc0 tx=0x7fd2dc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:31.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.223+0000 7fd2e3fff700 1 --2- 172.21.15.38:0/4011097981 >> v2:172.21.15.38:3300/0 conn(0x7fd2e41433e0 0x7fd2e40626a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2e40aebc0 tx=0x7fd2dc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:31.244 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.223+0000 7fd2e3fff700 1 --2- 172.21.15.38:0/4011097981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e41433e0 0x7fd2e40626a0 secure :-1 s=READY pgs=863 cs=0 l=1 rx=0x7fd2e40aebc0 tx=0x7fd2dc0081e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:31.245 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.223+0000 7fd2e3fff700 1 --2- 172.21.15.38:0/4011097981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e41433e0 0x7fd2e40626a0 secure :-1 s=THROTTLE_DONE pgs=863 cs=0 l=1 rx=0x7fd2e40aebc0 tx=0x7fd2dc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:31.245 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.223+0000 7fd2e3fff700 1 --2- 172.21.15.38:0/4011097981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e41433e0 0x7fd2e40626a0 secure :-1 s=THROTTLE_DONE pgs=863 cs=0 l=1 rx=0x7fd2e40aebc0 tx=0x7fd2dc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:31.246 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.223+0000 7fd2e0ff9700 1 -- 172.21.15.38:0/4011097981 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2dc010e60 con 0x7fd2e41433e0 2020-06-12T17:51:31.246 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.223+0000 7fd2e3fff700 1 --2- 172.21.15.38:0/4011097981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e41433e0 0x7fd2e40626a0 secure :-1 s=THROTTLE_DONE pgs=863 cs=0 l=1 rx=0x7fd2e40aebc0 tx=0x7fd2dc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:31.246 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.223+0000 7fd2e0ff9700 1 -- 172.21.15.38:0/4011097981 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2dc007930 con 0x7fd2e41433e0 2020-06-12T17:51:31.246 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.223+0000 7fd2e0ff9700 1 -- 172.21.15.38:0/4011097981 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2dc00f3e0 con 0x7fd2e41433e0 2020-06-12T17:51:31.246 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.223+0000 7fd2e9ccf700 1 -- 172.21.15.38:0/4011097981 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e409a9f0 con 0x7fd2e41433e0 2020-06-12T17:51:31.247 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.224+0000 7fd2e9ccf700 1 -- 172.21.15.38:0/4011097981 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e40b2190 con 0x7fd2e41433e0 2020-06-12T17:51:31.247 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.224+0000 7fd2e3fff700 1 --2- 172.21.15.38:0/4011097981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e41433e0 0x7fd2e40626a0 secure :-1 s=THROTTLE_DONE pgs=863 cs=0 l=1 rx=0x7fd2e40aebc0 tx=0x7fd2dc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:31.247 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.224+0000 7fd2e9ccf700 1 -- 172.21.15.38:0/4011097981 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e409abe0 con 0x7fd2e41433e0 2020-06-12T17:51:31.247 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.225+0000 7fd2e0ff9700 1 -- 172.21.15.38:0/4011097981 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7fd2dc00f540 con 0x7fd2e41433e0 2020-06-12T17:51:31.247 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.225+0000 7fd2e3fff700 1 --2- 172.21.15.38:0/4011097981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e41433e0 0x7fd2e40626a0 secure :-1 s=THROTTLE_DONE pgs=863 cs=0 l=1 rx=0x7fd2e40aebc0 tx=0x7fd2dc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:31.248 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.225+0000 7fd2e0ff9700 1 --2- 172.21.15.38:0/4011097981 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd2c404d920 0x7fd2c404fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:31.248 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.225+0000 7fd2e0ff9700 1 -- 172.21.15.38:0/4011097981 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd2dc061250 con 0x7fd2e41433e0 2020-06-12T17:51:31.248 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.225+0000 7fd2e37fe700 1 --2- 172.21.15.38:0/4011097981 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd2c404d920 0x7fd2c404fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:31.248 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.225+0000 7fd2e37fe700 1 --2- 172.21.15.38:0/4011097981 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd2c404d920 0x7fd2c404fde0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2d40013e0 tx=0x7fd2e4146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:31.248 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.225+0000 7fd2e37fe700 1 --2- 172.21.15.38:0/4011097981 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd2c404d920 0x7fd2c404fde0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2d40013e0 tx=0x7fd2e4146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:31.248 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.225+0000 7fd2e37fe700 1 --2- 172.21.15.38:0/4011097981 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd2c404d920 0x7fd2c404fde0 secure :-1 s=READY pgs=335 cs=0 l=1 rx=0x7fd2d40013e0 tx=0x7fd2e4146220).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:31.249 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.228+0000 7fd2e3fff700 1 --2- 172.21.15.38:0/4011097981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e41433e0 0x7fd2e40626a0 secure :-1 s=THROTTLE_DONE pgs=863 cs=0 l=1 rx=0x7fd2e40aebc0 tx=0x7fd2dc0081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:31.249 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.228+0000 7fd2e0ff9700 1 -- 172.21.15.38:0/4011097981 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7fd2dc03ca90 con 0x7fd2e41433e0 2020-06-12T17:51:31.424 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.420+0000 7fd2e9ccf700 1 -- 172.21.15.38:0/4011097981 --> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_1795", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2e408f390 con 0x7fd2c404d920 2020-06-12T17:51:31.427 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.425+0000 7fd2e37fe700 1 --2- 172.21.15.38:0/4011097981 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd2c404d920 0x7fd2c404fde0 secure :-1 s=THROTTLE_DONE pgs=335 cs=0 l=1 rx=0x7fd2d40013e0 tx=0x7fd2e4146220).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:31.428 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.425+0000 7fd2e0ff9700 1 -- 172.21.15.38:0/4011097981 <== mgr.4103 v2:172.21.15.150:6800/30312 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+70 (secure 0 0 0) 0x7fd2e408f390 con 0x7fd2c404d920 2020-06-12T17:51:31.428 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/subvolume_1795/75d10438-628b-4daf-9a1a-92f4b61b7de7 2020-06-12T17:51:31.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.425+0000 7fd2e9ccf700 1 -- 172.21.15.38:0/4011097981 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd2c404d920 msgr2=0x7fd2c404fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:31.429 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.425+0000 7fd2e9ccf700 1 --2- 172.21.15.38:0/4011097981 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd2c404d920 0x7fd2c404fde0 secure :-1 s=READY pgs=335 cs=0 l=1 rx=0x7fd2d40013e0 tx=0x7fd2e4146220).stop 2020-06-12T17:51:31.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.425+0000 7fd2e9ccf700 1 -- 172.21.15.38:0/4011097981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e41433e0 msgr2=0x7fd2e40626a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:31.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.425+0000 7fd2e9ccf700 1 --2- 172.21.15.38:0/4011097981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e41433e0 0x7fd2e40626a0 secure :-1 s=READY pgs=863 cs=0 l=1 rx=0x7fd2e40aebc0 tx=0x7fd2dc0081e0).stop 2020-06-12T17:51:31.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.425+0000 7fd2e9ccf700 1 -- 172.21.15.38:0/4011097981 shutdown_connections 2020-06-12T17:51:31.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.425+0000 7fd2e9ccf700 1 --2- 172.21.15.38:0/4011097981 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7fd2c404d920 0x7fd2c404fde0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:31.430 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.425+0000 7fd2e9ccf700 1 --2- 172.21.15.38:0/4011097981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e41433e0 0x7fd2e40626a0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:31.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.425+0000 7fd2e9ccf700 1 --2- 172.21.15.38:0/4011097981 >> v2:172.21.15.150:3300/0 conn(0x7fd2e4065d00 0x7fd2e409b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:31.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.425+0000 7fd2e9ccf700 1 -- 172.21.15.38:0/4011097981 >> 172.21.15.38:0/4011097981 conn(0x7fd2e40b5a20 msgr2=0x7fd2e40b6390 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:31.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.426+0000 7fd2e9ccf700 1 -- 172.21.15.38:0/4011097981 shutdown_connections 2020-06-12T17:51:31.431 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:31.426+0000 7fd2e9ccf700 1 -- 172.21.15.38:0/4011097981 wait complete. 2020-06-12T17:51:31.439 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_1795 with 10 files each 1MB size under directory volumes/_nogroup/subvolume_1795/75d10438-628b-4daf-9a1a-92f4b61b7de7 2020-06-12T17:51:31.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:31.440 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:31.441 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:31.455 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:31.456 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:31.457 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1795/75d10438-628b-4daf-9a1a-92f4b61b7de7/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:31.547 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:31.547 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:31.548 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104745 s, 100 MB/s 2020-06-12T17:51:31.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:31.549 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:31.550 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:31.574 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:31.575 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:31.576 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1795/75d10438-628b-4daf-9a1a-92f4b61b7de7/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:31.662 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:31.663 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:31.663 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112017 s, 93.6 MB/s 2020-06-12T17:51:31.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:31.665 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:31.665 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:31.681 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:31.681 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:31.682 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1795/75d10438-628b-4daf-9a1a-92f4b61b7de7/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:31.769 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:31.769 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:31.769 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109385 s, 95.9 MB/s 2020-06-12T17:51:31.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:31.771 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:31.771 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:31.786 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:31.787 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:31.787 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1795/75d10438-628b-4daf-9a1a-92f4b61b7de7/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:31.873 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:31.873 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:31.873 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101092 s, 104 MB/s 2020-06-12T17:51:31.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:31.875 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:31.876 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:31.891 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:31.891 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:31.892 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1795/75d10438-628b-4daf-9a1a-92f4b61b7de7/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:31.982 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:31.983 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:31.983 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129732 s, 80.8 MB/s 2020-06-12T17:51:31.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:31.984 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:31.985 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:32.001 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:32.001 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:32.002 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1795/75d10438-628b-4daf-9a1a-92f4b61b7de7/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:32.090 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:32.090 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:32.090 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129875 s, 80.7 MB/s 2020-06-12T17:51:32.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:32.092 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:32.092 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:32.107 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:32.108 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:32.109 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1795/75d10438-628b-4daf-9a1a-92f4b61b7de7/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:32.198 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:32.198 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:32.198 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132568 s, 79.1 MB/s 2020-06-12T17:51:32.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:32.200 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:32.200 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:32.216 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:32.216 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:32.217 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1795/75d10438-628b-4daf-9a1a-92f4b61b7de7/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:32.304 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:32.305 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:32.305 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115124 s, 91.1 MB/s 2020-06-12T17:51:32.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:32.307 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:32.307 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:32.322 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:32.323 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:32.323 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1795/75d10438-628b-4daf-9a1a-92f4b61b7de7/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:32.410 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:32.410 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:32.411 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110157 s, 95.2 MB/s 2020-06-12T17:51:32.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-06-12T17:51:32.412 INFO:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-06-12T17:51:32.413 INFO:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-06-12T17:51:32.428 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2020-06-12T17:51:32.428 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-06-12T17:51:32.429 INFO:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=volumes/_nogroup/subvolume_1795/75d10438-628b-4daf-9a1a-92f4b61b7de7/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0 2020-06-12T17:51:32.519 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2020-06-12T17:51:32.519 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2020-06-12T17:51:32.519 INFO:teuthology.orchestra.run.smithi038.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110819 s, 94.6 MB/s 2020-06-12T17:51:32.520 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs subvolume create cephfs subvolume_3152 2020-06-12T17:51:32.643 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.639+0000 7f5a97b32700 1 Processor -- start 2020-06-12T17:51:32.643 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.640+0000 7f5a97b32700 1 -- start start 2020-06-12T17:51:32.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.640+0000 7f5a97b32700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5a900b2eb0 0x7f5a9014d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-06-12T17:51:32.646 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.640+0000 7f5a97b32700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a90146d20 con 0x7f5a90146680 2020-06-12T17:51:32.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.640+0000 7f5a97b32700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a90066a80 con 0x7f5a900ad5b0 2020-06-12T17:51:32.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.640+0000 7f5a97b32700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a90146f50 con 0x7f5a900b2eb0 2020-06-12T17:51:32.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.640+0000 7f5a958ce700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f5a90146680 0x7f5a9009d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41722/0 (socket says 172.21.15.38:41722) 2020-06-12T17:51:32.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.640+0000 7f5a958ce700 1 -- 172.21.15.38:0/3674162941 learned_addr learned my addr 172.21.15.38:0/3674162941 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:32.647 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.641+0000 7f5a960cf700 1 --2- 172.21.15.38:0/3674162941 >> v2:172.21.15.150:3300/0 conn(0x7f5a900b2eb0 0x7f5a9014d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:32.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.641+0000 7f5a948cc700 1 -- 172.21.15.38:0/3674162941 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629147705 0 0) 0x7f5a90146d20 con 0x7f5a90146680 2020-06-12T17:51:32.648 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.641+0000 7f5a948cc700 1 -- 172.21.15.38:0/3674162941 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a78003230 con 0x7f5a90146680 2020-06-12T17:51:32.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.641+0000 7f5a948cc700 1 -- 172.21.15.38:0/3674162941 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2311789338 0 0) 0x7f5a90066a80 con 0x7f5a900ad5b0 2020-06-12T17:51:32.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.641+0000 7f5a948cc700 1 -- 172.21.15.38:0/3674162941 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a90146d20 con 0x7f5a900ad5b0 2020-06-12T17:51:32.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.641+0000 7f5a948cc700 1 -- 172.21.15.38:0/3674162941 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3881682658 0 0) 0x7f5a78003230 con 0x7f5a90146680 2020-06-12T17:51:32.649 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.641+0000 7f5a960cf700 1 -- 172.21.15.38:0/3674162941 >> v1:172.21.15.150:6789/0 conn(0x7f5a900ad5b0 legacy=0x7f5a9009d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:32.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.641+0000 7f5a960cf700 1 -- 172.21.15.38:0/3674162941 >> v1:172.21.15.38:6789/0 conn(0x7f5a90146680 legacy=0x7f5a9009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:32.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.641+0000 7f5a960cf700 1 -- 172.21.15.38:0/3674162941 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a90146a60 con 0x7f5a900b2eb0 2020-06-12T17:51:32.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.641+0000 7f5a960cf700 1 --2- 172.21.15.38:0/3674162941 >> v2:172.21.15.150:3300/0 conn(0x7f5a900b2eb0 0x7f5a9014d490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5a840010d0 tx=0x7f5a880081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:32.650 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.641+0000 7f5a960cf700 1 --2- 172.21.15.38:0/3674162941 >> v2:172.21.15.150:3300/0 conn(0x7f5a900b2eb0 0x7f5a9014d490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5a840010d0 tx=0x7f5a880081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:32.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.641+0000 7f5a960cf700 1 --2- 172.21.15.38:0/3674162941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a900b2eb0 0x7f5a9014d490 secure :-1 s=READY pgs=482 cs=0 l=1 rx=0x7f5a840010d0 tx=0x7f5a880081e0).ready entity=mon.1 client_cookie=c40ab9d028327fb4 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:32.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.641+0000 7f5a960cf700 1 --2- 172.21.15.38:0/3674162941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a900b2eb0 0x7f5a9014d490 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7f5a840010d0 tx=0x7f5a880081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:32.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.641+0000 7f5a948cc700 1 -- 172.21.15.38:0/3674162941 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a840016d0 con 0x7f5a900b2eb0 2020-06-12T17:51:32.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.641+0000 7f5a960cf700 1 --2- 172.21.15.38:0/3674162941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a900b2eb0 0x7f5a9014d490 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7f5a840010d0 tx=0x7f5a880081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:32.651 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.641+0000 7f5a948cc700 1 -- 172.21.15.38:0/3674162941 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a88010920 con 0x7f5a900b2eb0 2020-06-12T17:51:32.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.641+0000 7f5a960cf700 1 --2- 172.21.15.38:0/3674162941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a900b2eb0 0x7f5a9014d490 secure :-1 s=THROTTLE_DONE pgs=482 cs=0 l=1 rx=0x7f5a840010d0 tx=0x7f5a880081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:32.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.641+0000 7f5a97b32700 1 -- 172.21.15.38:0/3674162941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a900b2eb0 msgr2=0x7f5a9014d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:32.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.641+0000 7f5a97b32700 1 --2- 172.21.15.38:0/3674162941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a900b2eb0 0x7f5a9014d490 secure :-1 s=READY pgs=482 cs=0 l=1 rx=0x7f5a840010d0 tx=0x7f5a880081e0).stop 2020-06-12T17:51:32.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.641+0000 7f5a948cc700 1 -- 172.21.15.38:0/3674162941 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a88010c80 con 0x7f5a900b2eb0 2020-06-12T17:51:32.652 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.642+0000 7f5a97b32700 1 -- 172.21.15.38:0/3674162941 shutdown_connections 2020-06-12T17:51:32.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.642+0000 7f5a97b32700 1 --2- 172.21.15.38:0/3674162941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a900b2eb0 0x7f5a9014d490 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rx=0 tx=0).stop 2020-06-12T17:51:32.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.642+0000 7f5a97b32700 1 -- 172.21.15.38:0/3674162941 >> 172.21.15.38:0/3674162941 conn(0x7f5a900b5a20 msgr2=0x7f5a9005ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-06-12T17:51:32.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.642+0000 7f5a97b32700 1 -- 172.21.15.38:0/3674162941 shutdown_connections 2020-06-12T17:51:32.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.642+0000 7f5a97b32700 1 -- 172.21.15.38:0/3674162941 wait complete. 2020-06-12T17:51:32.653 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.643+0000 7f5a97b32700 1 Processor -- start 2020-06-12T17:51:32.654 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.643+0000 7f5a97b32700 1 -- start start 2020-06-12T17:51:32.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.644+0000 7f5a97b32700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5a900b2eb0 0x7f5a9009a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:32.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.644+0000 7f5a97b32700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a90157890 con 0x7f5a900ad5b0 2020-06-12T17:51:32.657 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.644+0000 7f5a97b32700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a90153590 con 0x7f5a90146680 2020-06-12T17:51:32.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.644+0000 7f5a97b32700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a90143410 con 0x7f5a900b2eb0 2020-06-12T17:51:32.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.644+0000 7f5a958ce700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f5a900ad5b0 0x7f5a90153cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41728/0 (socket says 172.21.15.38:41728) 2020-06-12T17:51:32.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.644+0000 7f5a958ce700 1 -- 172.21.15.38:0/3215375792 learned_addr learned my addr 172.21.15.38:0/3215375792 (peer_addr_for_me v1:172.21.15.38:0/0) 2020-06-12T17:51:32.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.644+0000 7f5a950cd700 1 --2- 172.21.15.38:0/3215375792 >> v2:172.21.15.150:3300/0 conn(0x7f5a900b2eb0 0x7f5a9009a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:32.658 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.644+0000 7f5a82ffd700 1 -- 172.21.15.38:0/3215375792 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3033361129 0 0) 0x7f5a90157890 con 0x7f5a900ad5b0 2020-06-12T17:51:32.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.644+0000 7f5a82ffd700 1 -- 172.21.15.38:0/3215375792 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a70002fe0 con 0x7f5a900ad5b0 2020-06-12T17:51:32.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.644+0000 7f5a82ffd700 1 -- 172.21.15.38:0/3215375792 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3816902883 0 0) 0x7f5a90153590 con 0x7f5a90146680 2020-06-12T17:51:32.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.644+0000 7f5a82ffd700 1 -- 172.21.15.38:0/3215375792 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a90157890 con 0x7f5a90146680 2020-06-12T17:51:32.659 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.644+0000 7f5a82ffd700 1 -- 172.21.15.38:0/3215375792 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3910075459 0 0) 0x7f5a70002fe0 con 0x7f5a900ad5b0 2020-06-12T17:51:32.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.644+0000 7f5a82ffd700 1 -- 172.21.15.38:0/3215375792 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5a90153590 con 0x7f5a900ad5b0 2020-06-12T17:51:32.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.644+0000 7f5a82ffd700 1 -- 172.21.15.38:0/3215375792 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 2426377500 0 0) 0x7f5a840016d0 con 0x7f5a900ad5b0 2020-06-12T17:51:32.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.644+0000 7f5a950cd700 1 -- 172.21.15.38:0/3215375792 >> v1:172.21.15.150:6789/0 conn(0x7f5a90146680 legacy=0x7f5a900b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:32.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.644+0000 7f5a950cd700 1 -- 172.21.15.38:0/3215375792 >> v1:172.21.15.38:6789/0 conn(0x7f5a900ad5b0 legacy=0x7f5a90153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-06-12T17:51:32.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.644+0000 7f5a950cd700 1 -- 172.21.15.38:0/3215375792 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a90153830 con 0x7f5a900b2eb0 2020-06-12T17:51:32.660 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.644+0000 7f5a950cd700 1 --2- 172.21.15.38:0/3215375792 >> v2:172.21.15.150:3300/0 conn(0x7f5a900b2eb0 0x7f5a9009a6f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a8c0010d0 tx=0x7f5a8c002810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:32.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.644+0000 7f5a950cd700 1 --2- 172.21.15.38:0/3215375792 >> v2:172.21.15.150:3300/0 conn(0x7f5a900b2eb0 0x7f5a9009a6f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a8c0010d0 tx=0x7f5a8c002810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:32.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.644+0000 7f5a950cd700 1 --2- 172.21.15.38:0/3215375792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a900b2eb0 0x7f5a9009a6f0 secure :-1 s=READY pgs=484 cs=0 l=1 rx=0x7f5a8c0010d0 tx=0x7f5a8c002810).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:32.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.645+0000 7f5a950cd700 1 --2- 172.21.15.38:0/3215375792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a900b2eb0 0x7f5a9009a6f0 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7f5a8c0010d0 tx=0x7f5a8c002810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:32.661 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.645+0000 7f5a82ffd700 1 -- 172.21.15.38:0/3215375792 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a8c00ca10 con 0x7f5a900b2eb0 2020-06-12T17:51:32.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.645+0000 7f5a950cd700 1 --2- 172.21.15.38:0/3215375792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a900b2eb0 0x7f5a9009a6f0 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7f5a8c0010d0 tx=0x7f5a8c002810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:32.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.645+0000 7f5a950cd700 1 --2- 172.21.15.38:0/3215375792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a900b2eb0 0x7f5a9009a6f0 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7f5a8c0010d0 tx=0x7f5a8c002810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:32.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.645+0000 7f5a82ffd700 1 -- 172.21.15.38:0/3215375792 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8c00cb70 con 0x7f5a900b2eb0 2020-06-12T17:51:32.662 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.645+0000 7f5a82ffd700 1 -- 172.21.15.38:0/3215375792 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a8c00e160 con 0x7f5a900b2eb0 2020-06-12T17:51:32.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.645+0000 7f5a97b32700 1 -- 172.21.15.38:0/3215375792 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a900b3e50 con 0x7f5a900b2eb0 2020-06-12T17:51:32.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.645+0000 7f5a97b32700 1 -- 172.21.15.38:0/3215375792 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a90157470 con 0x7f5a900b2eb0 2020-06-12T17:51:32.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.645+0000 7f5a950cd700 1 --2- 172.21.15.38:0/3215375792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a900b2eb0 0x7f5a9009a6f0 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7f5a8c0010d0 tx=0x7f5a8c002810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:32.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.646+0000 7f5a97b32700 1 -- 172.21.15.38:0/3215375792 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a90067b20 con 0x7f5a900b2eb0 2020-06-12T17:51:32.663 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.646+0000 7f5a82ffd700 1 -- 172.21.15.38:0/3215375792 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 59565+0+0 (secure 0 0 0) 0x7f5a8c011d70 con 0x7f5a900b2eb0 2020-06-12T17:51:32.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.646+0000 7f5a950cd700 1 --2- 172.21.15.38:0/3215375792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a900b2eb0 0x7f5a9009a6f0 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7f5a8c0010d0 tx=0x7f5a8c002810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:32.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.646+0000 7f5a82ffd700 1 --2- 172.21.15.38:0/3215375792 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5a7004dd10 0x7f5a700501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-06-12T17:51:32.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.646+0000 7f5a82ffd700 1 -- 172.21.15.38:0/3215375792 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5a8c060770 con 0x7f5a900b2eb0 2020-06-12T17:51:32.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.646+0000 7f5a958ce700 1 --2- 172.21.15.38:0/3215375792 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5a7004dd10 0x7f5a700501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-06-12T17:51:32.664 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.646+0000 7f5a958ce700 1 --2- 172.21.15.38:0/3215375792 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5a7004dd10 0x7f5a700501d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a84001e60 tx=0x7f5a8400a800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:32.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.647+0000 7f5a958ce700 1 --2- 172.21.15.38:0/3215375792 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5a7004dd10 0x7f5a700501d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a84001e60 tx=0x7f5a8400a800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:32.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.647+0000 7f5a958ce700 1 --2- 172.21.15.38:0/3215375792 >> [v2:172.21.15.150:6800/30312,v1:172.21.15.150:6801/30312] conn(0x7f5a7004dd10 0x7f5a700501d0 secure :-1 s=READY pgs=336 cs=0 l=1 rx=0x7f5a84001e60 tx=0x7f5a8400a800).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-06-12T17:51:32.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.650+0000 7f5a950cd700 1 --2- 172.21.15.38:0/3215375792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a900b2eb0 0x7f5a9009a6f0 secure :-1 s=THROTTLE_DONE pgs=484 cs=0 l=1 rx=0x7f5a8c0010d0 tx=0x7f5a8c002810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-06-12T17:51:32.665 INFO:teuthology.orchestra.run.smithi038.stderr:2020-06-12T17:51:32.650+0000 7f5a82ffd700 1 -- 172.21.15.38:0/3215375792 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+128129 (secure 0 0 0) 0x7f5a8c03be90 con 0x7f5a900b2eb0 2020-06-12T17:51:32.729 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-06-12T17:51:32.730 DEBUG:teuthology.task.console_log:Killing console logger for smithi038 2020-06-12T17:51:32.731 DEBUG:teuthology.task.console_log:Killing console logger for smithi150 2020-06-12T17:51:32.731 DEBUG:teuthology.task.console_log:Killing console logger for smithi038 2020-06-12T17:51:32.731 DEBUG:teuthology.task.console_log:Killing console logger for smithi150 2020-06-12T17:51:32.732 DEBUG:teuthology.exit:Finished running handlers